2024-09-13T22:35:46.209 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T22:35:46.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T22:35:46.336 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904340 branch: squid description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904340' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/v18.2.1 ' name: teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 3819 sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 sleep_before_teardown: 0 subset: 43/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOAaik+BTGhGtWTWBX1kXXRiqHlfrFRvs79qU5Qd0yuTI4mx0Zhcc76gwkgG525WAkQkpJoA4fdtWVKbGVlkOCA= smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIAPoV/RdNhXW7UCxPjAF9fdkUMvijJjgDOez5AzNmbQtvE6xbRtZDw6u7TeTCow0lROP/rGA/T/bi/UUWnVXy4= tasks: - install: exclude_packages: - ceph-volume tag: v18.2.1 - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.io/ceph/ceph:v18.2.1 roleless: true - print: '**** done end installing v18.2.1 cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_21:08:03 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-13T22:35:46.337 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa; will attempt to use it 2024-09-13T22:35:46.337 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks 2024-09-13T22:35:46.337 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T22:35:46.339 INFO:teuthology.task.internal:Checking packages... 2024-09-13T22:35:46.359 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ecab7be58963a5bd03910cd73eef66405d7fdd50' 2024-09-13T22:35:46.360 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T22:35:46.360 INFO:teuthology.packaging:ref: None 2024-09-13T22:35:46.360 INFO:teuthology.packaging:tag: None 2024-09-13T22:35:46.360 INFO:teuthology.packaging:branch: squid 2024-09-13T22:35:46.360 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:35:46.360 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-13T22:35:46.579 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-324.gecab7be5 2024-09-13T22:35:46.581 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T22:35:46.588 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T22:35:46.588 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T22:35:46.604 INFO:teuthology.task.internal:Saving configuration 2024-09-13T22:35:46.623 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T22:35:46.629 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T22:35:46.662 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904340', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 22:31:05.705966', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOAaik+BTGhGtWTWBX1kXXRiqHlfrFRvs79qU5Qd0yuTI4mx0Zhcc76gwkgG525WAkQkpJoA4fdtWVKbGVlkOCA='} 2024-09-13T22:35:46.695 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904340', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 22:31:05.707832', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIAPoV/RdNhXW7UCxPjAF9fdkUMvijJjgDOez5AzNmbQtvE6xbRtZDw6u7TeTCow0lROP/rGA/T/bi/UUWnVXy4='} 2024-09-13T22:35:46.695 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T22:35:46.701 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-13T22:35:46.702 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-13T22:35:46.702 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T22:35:46.772 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fda6c1cbac0>, signals=[15]) 2024-09-13T22:35:46.772 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T22:35:46.777 INFO:teuthology.task.internal:Opening connections... 2024-09-13T22:35:46.777 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2024-09-13T22:35:46.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:35:46.867 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-09-13T22:35:46.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:35:46.952 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T22:35:46.958 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-09-13T22:35:46.977 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-09-13T22:35:46.977 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-09-13T22:35:47.034 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2024-09-13T22:35:47.034 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2024-09-13T22:35:47.034 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2024-09-13T22:35:47.034 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2024-09-13T22:35:47.034 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2024-09-13T22:35:47.034 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2024-09-13T22:35:47.035 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T22:35:47.035 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-09-13T22:35:47.035 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2024-09-13T22:35:47.035 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T22:35:47.035 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2024-09-13T22:35:47.035 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T22:35:47.035 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T22:35:47.035 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T22:35:47.036 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-09-13T22:35:47.065 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-09-13T22:35:47.083 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-09-13T22:35:47.084 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-09-13T22:35:47.141 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-09-13T22:35:47.141 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-09-13T22:35:47.141 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-09-13T22:35:47.141 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-09-13T22:35:47.142 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-09-13T22:35:47.142 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-09-13T22:35:47.142 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T22:35:47.142 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-09-13T22:35:47.142 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-09-13T22:35:47.142 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T22:35:47.142 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-09-13T22:35:47.142 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T22:35:47.142 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T22:35:47.142 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T22:35:47.143 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-09-13T22:35:47.173 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T22:35:47.182 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T22:35:47.187 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T22:35:47.188 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2024-09-13T22:35:47.190 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-09-13T22:35:47.207 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T22:35:47.213 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T22:35:47.213 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2024-09-13T22:35:47.248 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-09-13T22:35:47.272 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T22:35:47.350 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T22:35:47.364 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T22:35:47.364 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T22:35:47.364 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T22:35:47.365 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T22:35:47.381 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:35:47.382 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-13T22:35:47.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:35:47.383 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-09-13T22:35:47.438 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-503.el9.x86_64 2024-09-13T22:35:47.439 INFO:teuthology.task.kernel:Running kernel on smithi002: 5.14.0-503.el9.x86_64 2024-09-13T22:35:47.439 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum install -y kernel 2024-09-13T22:35:47.440 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-503.el9.x86_64 2024-09-13T22:35:47.440 INFO:teuthology.task.kernel:Running kernel on smithi047: 5.14.0-503.el9.x86_64 2024-09-13T22:35:47.440 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum install -y kernel 2024-09-13T22:35:50.943 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.2 MB 00:01 2024-09-13T22:35:51.079 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-09-13T22:35:52.694 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 35 MB/s | 20 MB 00:00 2024-09-13T22:35:52.771 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 36 MB/s | 20 MB 00:00 2024-09-13T22:35:57.020 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 18 MB/s | 6.5 MB 00:00 2024-09-13T22:35:57.297 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-13T22:35:59.048 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 19 kB 00:00 2024-09-13T22:35:59.362 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-13T22:36:00.185 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:01 2024-09-13T22:36:00.475 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-13T22:36:05.824 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-13T22:36:06.122 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-13T22:36:07.914 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T22:36:07.914 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T22:36:08.015 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:36:08.030 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:36:08.030 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-13T22:36:08.030 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:36:08.030 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-13T22:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T22:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-13T22:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T22:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T22:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T22:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-13T22:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout:Install 4 Packages 2024-09-13T22:36:08.031 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:36:08.032 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 79 M 2024-09-13T22:36:08.032 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 126 M 2024-09-13T22:36:08.032 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-13T22:36:08.212 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T22:36:08.212 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T22:36:08.297 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:36:08.315 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:36:08.315 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-13T22:36:08.316 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:36:08.316 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-13T22:36:08.316 INFO:teuthology.orchestra.run.smithi047.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T22:36:08.316 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-13T22:36:08.316 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T22:36:08.316 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T22:36:08.316 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T22:36:08.316 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:36:08.316 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-13T22:36:08.316 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:36:08.316 INFO:teuthology.orchestra.run.smithi047.stdout:Install 4 Packages 2024-09-13T22:36:08.316 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:36:08.316 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 79 M 2024-09-13T22:36:08.317 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 126 M 2024-09-13T22:36:08.317 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-13T22:36:08.359 INFO:teuthology.orchestra.run.smithi002.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 308 kB/s | 23 kB 00:00 2024-09-13T22:36:08.565 INFO:teuthology.orchestra.run.smithi047.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 211 kB/s | 23 kB 00:00 2024-09-13T22:36:08.865 INFO:teuthology.orchestra.run.smithi047.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-09-13T22:36:09.201 INFO:teuthology.orchestra.run.smithi002.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 38 MB/s | 35 MB 00:00 2024-09-13T22:36:09.299 INFO:teuthology.orchestra.run.smithi047.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 39 MB/s | 29 MB 00:00 2024-09-13T22:36:09.659 INFO:teuthology.orchestra.run.smithi002.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 22 MB/s | 29 MB 00:01 2024-09-13T22:36:09.816 INFO:teuthology.orchestra.run.smithi047.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 25 MB/s | 35 MB 00:01 2024-09-13T22:36:09.816 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:36:09.816 INFO:teuthology.orchestra.run.smithi047.stdout:Total 52 MB/s | 79 MB 00:01 2024-09-13T22:36:09.817 INFO:teuthology.orchestra.run.smithi002.stdout:(4/4): kernel-core-5.14.0-505.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-09-13T22:36:09.818 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:36:09.818 INFO:teuthology.orchestra.run.smithi002.stdout:Total 44 MB/s | 79 MB 00:01 2024-09-13T22:36:10.529 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-13T22:36:10.530 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-13T22:36:10.899 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-13T22:36:10.899 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-13T22:36:10.924 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-13T22:36:10.924 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-13T22:36:11.874 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-13T22:36:11.874 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-13T22:36:11.907 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-13T22:36:11.908 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-13T22:36:14.441 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-13T22:36:14.461 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-13T22:36:15.128 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T22:36:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T22:36:15.238 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T22:36:15.318 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T22:36:18.003 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T22:36:18.092 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T22:36:18.127 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T22:36:18.221 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T22:36:23.259 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T22:36:23.337 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:36:23.349 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T22:36:23.455 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:36:28.495 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:36:28.607 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:37:07.326 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:37:07.367 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:37:07.763 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:37:07.763 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T22:37:07.763 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T22:37:07.763 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T22:37:07.793 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:37:07.835 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:37:08.344 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:37:08.344 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T22:37:08.344 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T22:37:08.344 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T22:37:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:37:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:37:08.647 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-13T22:37:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T22:37:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T22:37:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T22:37:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T22:37:08.647 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:37:08.648 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:37:08.973 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T22:37:09.107 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T22:37:09.108 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T22:37:09.108 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T22:37:09.108 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T22:37:09.108 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T22:37:09.108 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-13T22:37:09.108 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T22:37:09.109 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T22:37:09.168 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T22:37:09.168 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T22:37:09.168 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -qi grub2-tools 2024-09-13T22:37:09.187 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T22:37:09.187 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:37:09.188 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-13T22:37:09.188 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T22:37:09.188 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T22:37:09.188 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T22:37:09.188 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T22:37:09.188 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:37:09.188 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:37:09.199 INFO:teuthology.orchestra.run.smithi002.stdout:Name : grub2-tools 2024-09-13T22:37:09.199 INFO:teuthology.orchestra.run.smithi002.stdout:Epoch : 1 2024-09-13T22:37:09.199 INFO:teuthology.orchestra.run.smithi002.stdout:Version : 2.06 2024-09-13T22:37:09.199 INFO:teuthology.orchestra.run.smithi002.stdout:Release : 82.el9 2024-09-13T22:37:09.199 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: x86_64 2024-09-13T22:37:09.199 INFO:teuthology.orchestra.run.smithi002.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T22:37:09.199 INFO:teuthology.orchestra.run.smithi002.stdout:Group : Unspecified 2024-09-13T22:37:09.200 INFO:teuthology.orchestra.run.smithi002.stdout:Size : 8274670 2024-09-13T22:37:09.200 INFO:teuthology.orchestra.run.smithi002.stdout:License : GPLv3+ 2024-09-13T22:37:09.200 INFO:teuthology.orchestra.run.smithi002.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T22:37:09.200 INFO:teuthology.orchestra.run.smithi002.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T22:37:09.200 INFO:teuthology.orchestra.run.smithi002.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T22:37:09.200 INFO:teuthology.orchestra.run.smithi002.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T22:37:09.200 INFO:teuthology.orchestra.run.smithi002.stdout:Packager : builder@centos.org 2024-09-13T22:37:09.200 INFO:teuthology.orchestra.run.smithi002.stdout:Vendor : CentOS 2024-09-13T22:37:09.200 INFO:teuthology.orchestra.run.smithi002.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T22:37:09.200 INFO:teuthology.orchestra.run.smithi002.stdout:Summary : Support tools for GRUB. 2024-09-13T22:37:09.200 INFO:teuthology.orchestra.run.smithi002.stdout:Description : 2024-09-13T22:37:09.200 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:37:09.200 INFO:teuthology.orchestra.run.smithi002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T22:37:09.200 INFO:teuthology.orchestra.run.smithi002.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T22:37:09.201 INFO:teuthology.orchestra.run.smithi002.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T22:37:09.201 INFO:teuthology.orchestra.run.smithi002.stdout:hardware devices. 2024-09-13T22:37:09.201 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:37:09.201 INFO:teuthology.orchestra.run.smithi002.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T22:37:09.202 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T22:37:09.202 INFO:teuthology.task.kernel:Updating grub on smithi002 to boot 5.14.0-505.el9.x86_64 2024-09-13T22:37:09.202 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T22:37:09.527 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T22:37:09.611 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T22:37:09.611 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T22:37:09.612 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T22:37:09.612 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T22:37:09.612 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T22:37:09.612 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-13T22:37:09.612 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T22:37:09.612 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T22:37:09.671 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T22:37:09.671 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T22:37:09.671 DEBUG:teuthology.orchestra.run.smithi047:> sudo rpm -qi grub2-tools 2024-09-13T22:37:09.702 INFO:teuthology.orchestra.run.smithi047.stdout:Name : grub2-tools 2024-09-13T22:37:09.702 INFO:teuthology.orchestra.run.smithi047.stdout:Epoch : 1 2024-09-13T22:37:09.703 INFO:teuthology.orchestra.run.smithi047.stdout:Version : 2.06 2024-09-13T22:37:09.703 INFO:teuthology.orchestra.run.smithi047.stdout:Release : 82.el9 2024-09-13T22:37:09.703 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: x86_64 2024-09-13T22:37:09.703 INFO:teuthology.orchestra.run.smithi047.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T22:37:09.703 INFO:teuthology.orchestra.run.smithi047.stdout:Group : Unspecified 2024-09-13T22:37:09.703 INFO:teuthology.orchestra.run.smithi047.stdout:Size : 8274670 2024-09-13T22:37:09.703 INFO:teuthology.orchestra.run.smithi047.stdout:License : GPLv3+ 2024-09-13T22:37:09.703 INFO:teuthology.orchestra.run.smithi047.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T22:37:09.703 INFO:teuthology.orchestra.run.smithi047.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T22:37:09.703 INFO:teuthology.orchestra.run.smithi047.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T22:37:09.703 INFO:teuthology.orchestra.run.smithi047.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T22:37:09.703 INFO:teuthology.orchestra.run.smithi047.stdout:Packager : builder@centos.org 2024-09-13T22:37:09.703 INFO:teuthology.orchestra.run.smithi047.stdout:Vendor : CentOS 2024-09-13T22:37:09.704 INFO:teuthology.orchestra.run.smithi047.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T22:37:09.704 INFO:teuthology.orchestra.run.smithi047.stdout:Summary : Support tools for GRUB. 2024-09-13T22:37:09.704 INFO:teuthology.orchestra.run.smithi047.stdout:Description : 2024-09-13T22:37:09.704 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:37:09.704 INFO:teuthology.orchestra.run.smithi047.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T22:37:09.704 INFO:teuthology.orchestra.run.smithi047.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T22:37:09.704 INFO:teuthology.orchestra.run.smithi047.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T22:37:09.704 INFO:teuthology.orchestra.run.smithi047.stdout:hardware devices. 2024-09-13T22:37:09.704 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:37:09.704 INFO:teuthology.orchestra.run.smithi047.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T22:37:09.705 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T22:37:09.705 INFO:teuthology.task.kernel:Updating grub on smithi047 to boot 5.14.0-505.el9.x86_64 2024-09-13T22:37:09.705 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T22:37:09.896 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2024-09-13T22:37:10.529 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-09-13T22:37:11.218 INFO:teuthology.orchestra.run.smithi002.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T22:37:11.246 INFO:teuthology.orchestra.run.smithi002.stderr:done 2024-09-13T22:37:11.248 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-09-13T22:37:11.263 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.Lg5xJIzhAQ 2024-09-13T22:37:11.263 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Lg5xJIzhAQ 2024-09-13T22:37:11.330 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.Lg5xJIzhAQ 2024-09-13T22:37:11.471 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.Lg5xJIzhAQ is 6KB 2024-09-13T22:37:11.520 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.Lg5xJIzhAQ 2024-09-13T22:37:11.534 DEBUG:teuthology.orchestra.run.smithi002:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T22:37:11.596 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T22:37:11.596 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T22:37:11.596 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T22:37:11.596 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T22:37:11.597 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T22:37:11.754 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2024-09-13T22:37:11.835 INFO:teuthology.orchestra.run.smithi047.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T22:37:11.873 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-09-13T22:37:11.874 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-09-13T22:37:11.889 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.IXhbGmnhw8 2024-09-13T22:37:11.889 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.IXhbGmnhw8 2024-09-13T22:37:11.965 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.IXhbGmnhw8 2024-09-13T22:37:12.106 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.IXhbGmnhw8 is 6KB 2024-09-13T22:37:12.154 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.IXhbGmnhw8 2024-09-13T22:37:12.168 DEBUG:teuthology.orchestra.run.smithi047:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T22:37:12.238 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T22:37:12.238 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T22:37:12.239 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T22:37:12.239 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T22:37:12.240 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T22:37:12.395 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2024-09-13T22:37:41.783 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-13T22:37:41.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-13T22:37:41.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:37:42.399 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-13T22:37:42.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-13T22:37:42.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:38:00.253 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-09-13T22:38:00.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-09-13T22:38:09.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-13T22:38:09.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:38:09.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-13T22:38:09.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:39:09.331 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T22:39:09.795 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T22:39:21.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-13T22:39:21.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:39:21.719 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-13T22:39:21.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-13T22:39:21.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:39:22.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-13T22:39:22.081 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-505.el9.x86_64"... 2024-09-13T22:39:22.081 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-13T22:39:22.099 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-505.el9.x86_64 2024-09-13T22:39:22.099 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T22:39:22.099 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T22:39:22.099 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T22:39:22.186 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-09-13T22:39:22.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-13T22:39:22.513 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-505.el9.x86_64"... 2024-09-13T22:39:22.514 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-09-13T22:39:22.529 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-505.el9.x86_64 2024-09-13T22:39:22.530 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T22:39:22.530 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T22:39:22.530 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T22:39:23.100 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-13T22:39:23.100 DEBUG:teuthology.orchestra.run.smithi002:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T22:39:23.200 INFO:teuthology.orchestra.run.smithi002.stdout:ttyS1 2024-09-13T22:39:23.221 DEBUG:teuthology.parallel:result is None 2024-09-13T22:39:23.531 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-13T22:39:23.531 DEBUG:teuthology.orchestra.run.smithi047:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T22:39:23.608 INFO:teuthology.orchestra.run.smithi047.stdout:ttyS1 2024-09-13T22:39:23.626 DEBUG:teuthology.parallel:result is None 2024-09-13T22:39:23.627 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T22:39:23.634 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T22:39:23.634 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T22:39:23.636 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T22:39:23.655 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T22:39:23.662 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T22:39:23.671 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T22:39:23.671 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T22:39:23.695 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T22:39:23.726 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T22:39:23.732 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T22:39:23.733 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T22:39:23.761 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T22:39:23.795 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T22:39:23.801 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T22:39:23.807 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T22:39:23.813 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T22:39:23.815 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T22:39:23.822 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T22:39:23.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T22:39:23.858 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T22:39:23.888 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T22:39:23.897 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T22:39:23.898 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T22:39:23.928 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T22:39:23.950 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T22:39:24.037 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T22:39:24.085 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T22:39:24.177 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T22:39:24.213 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-13T22:39:24.213 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T22:39:24.279 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T22:39:24.334 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T22:39:24.384 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T22:39:24.479 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T22:39:24.517 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-13T22:39:24.517 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T22:39:24.588 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2024-09-13T22:39:24.591 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-09-13T22:39:24.636 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T22:39:24.672 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T22:39:25.040 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T22:39:25.049 INFO:teuthology.task.internal:Starting timer... 2024-09-13T22:39:25.050 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T22:39:25.061 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T22:39:25.069 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-13T22:39:25.069 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2024-09-13T22:39:25.152 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2024-09-13T22:39:25.154 DEBUG:teuthology.orchestra.run.smithi047:> sudo service auditd rotate 2024-09-13T22:39:25.224 INFO:teuthology.orchestra.run.smithi047.stdout:Rotating logs: 2024-09-13T22:39:25.226 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T22:39:25.226 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2024-09-13T22:39:25.259 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2024-09-13T22:39:25.260 DEBUG:teuthology.orchestra.run.smithi047:> /usr/sbin/getenforce 2024-09-13T22:39:25.283 INFO:teuthology.orchestra.run.smithi047.stdout:Permissive 2024-09-13T22:39:25.284 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi047.front.sepia.ceph.com': 'permissive'} 2024-09-13T22:39:25.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T22:39:25.328 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:39:25.328 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T22:39:25.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:39:25.358 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T22:39:25.358 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2024-09-13T22:39:25.407 DEBUG:teuthology.orchestra.run.smithi047:> sudo /usr/sbin/setenforce permissive 2024-09-13T22:39:25.442 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T22:39:25.451 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T22:39:25.466 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T22:39:25.467 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi047.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T22:43:16.125 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi047.front.sepia.ceph.com')] 2024-09-13T22:43:16.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-13T22:43:16.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:43:16.216 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-13T22:43:16.293 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-13T22:43:16.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-13T22:43:16.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T22:43:16.379 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-09-13T22:43:16.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-13T22:43:16.470 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T22:43:16.484 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T22:43:16.484 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T22:43:16.485 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T22:43:16.487 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T22:43:16.487 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T22:43:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T22:43:16.533 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T22:43:16.541 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T22:43:16.557 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T22:43:16.558 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2024-09-13T22:43:16.570 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2024-09-13T22:43:16.583 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: ntpd: command not found 2024-09-13T22:43:16.585 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T22:43:16.595 INFO:teuthology.orchestra.run.smithi047.stdout:506 Cannot talk to daemon 2024-09-13T22:43:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T22:43:16.610 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T22:43:16.625 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T22:43:16.659 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-13T22:43:16.663 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T22:43:16.663 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-13T22:43:16.663 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:43:16.664 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:43:16.664 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:43:16.664 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:43:16.688 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-09-13T22:43:16.693 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T22:43:16.693 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-09-13T22:43:16.693 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:43:16.693 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:43:16.693 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:43:16.693 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T22:43:16.694 INFO:teuthology.run_tasks:Running task install... 2024-09-13T22:43:16.701 DEBUG:teuthology.task.install:project ceph 2024-09-13T22:43:16.701 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'}} 2024-09-13T22:43:16.701 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v18.2.1', 'flavor': 'default', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'} 2024-09-13T22:43:16.701 INFO:teuthology.task.install:Using flavor: default 2024-09-13T22:43:16.707 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T22:43:16.707 INFO:teuthology.task.install:extra packages: [] 2024-09-13T22:43:16.708 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'tag': 'v18.2.1', 'wait_for_package': False} 2024-09-13T22:43:16.708 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-13T22:43:16.708 INFO:teuthology.packaging:ref: None 2024-09-13T22:43:16.708 INFO:teuthology.packaging:tag: v18.2.1 2024-09-13T22:43:16.708 INFO:teuthology.packaging:branch: None 2024-09-13T22:43:16.708 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:43:17.363 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph v18.2.1^{} -> 7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-09-13T22:43:17.363 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-09-13T22:43:17.365 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'tag': 'v18.2.1', 'wait_for_package': False} 2024-09-13T22:43:17.365 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-13T22:43:17.365 INFO:teuthology.packaging:ref: None 2024-09-13T22:43:17.366 INFO:teuthology.packaging:tag: v18.2.1 2024-09-13T22:43:17.366 INFO:teuthology.packaging:branch: None 2024-09-13T22:43:17.366 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:43:17.366 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-09-13T22:43:17.513 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/ 2024-09-13T22:43:17.514 INFO:teuthology.task.install.rpm:Package version is 18.2.1-0 2024-09-13T22:43:17.529 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/ 2024-09-13T22:43:17.529 INFO:teuthology.task.install.rpm:Package version is 18.2.1-0 2024-09-13T22:43:17.584 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T22:43:17.584 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-13T22:43:17.585 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T22:43:17.587 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T22:43:17.588 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-13T22:43:17.588 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T22:43:17.618 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T22:43:17.618 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-13T22:43:17.618 INFO:teuthology.packaging:ref: None 2024-09-13T22:43:17.619 INFO:teuthology.packaging:tag: v18.2.1 2024-09-13T22:43:17.619 INFO:teuthology.packaging:branch: None 2024-09-13T22:43:17.619 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:43:17.619 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T22:43:17.622 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T22:43:17.622 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-13T22:43:17.622 INFO:teuthology.packaging:ref: None 2024-09-13T22:43:17.622 INFO:teuthology.packaging:tag: v18.2.1 2024-09-13T22:43:17.622 INFO:teuthology.packaging:branch: None 2024-09-13T22:43:17.622 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:43:17.622 DEBUG:teuthology.orchestra.run.smithi047:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T22:43:17.690 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T22:43:17.692 DEBUG:teuthology.orchestra.run.smithi047:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T22:43:17.772 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T22:43:17.775 DEBUG:teuthology.orchestra.run.smithi047:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T22:43:17.840 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2024-09-13T22:43:17.841 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2024-09-13T22:43:17.842 INFO:teuthology.orchestra.run.smithi047.stdout:check_obsoletes = 1 2024-09-13T22:43:17.844 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum clean all 2024-09-13T22:43:18.086 INFO:teuthology.orchestra.run.smithi047.stdout:45 files removed 2024-09-13T22:43:18.089 INFO:teuthology.orchestra.run.smithi002.stdout:45 files removed 2024-09-13T22:43:18.113 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-radosgw 2024-09-13T22:43:18.117 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw 2024-09-13T22:43:18.572 INFO:teuthology.orchestra.run.smithi047.stdout:ceph packages for x86_64 482 kB/s | 76 kB 00:00 2024-09-13T22:43:18.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 463 kB/s | 76 kB 00:00 2024-09-13T22:43:18.715 INFO:teuthology.orchestra.run.smithi047.stdout:ceph noarch packages 99 kB/s | 9.4 kB 00:00 2024-09-13T22:43:18.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 84 kB/s | 9.4 kB 00:00 2024-09-13T22:43:18.865 INFO:teuthology.orchestra.run.smithi047.stdout:ceph source packages 19 kB/s | 2.2 kB 00:00 2024-09-13T22:43:19.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 8.5 kB/s | 2.2 kB 00:00 2024-09-13T22:43:19.307 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.2 MB 00:00 2024-09-13T22:43:19.811 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-13T22:43:21.109 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-13T22:43:26.076 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 6.6 MB/s | 6.5 MB 00:00 2024-09-13T22:43:27.802 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-13T22:43:29.065 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-13T22:43:34.729 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-13T22:43:35.583 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 1.4 MB/s | 20 MB 00:14 2024-09-13T22:43:37.183 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:43:37.207 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:43:37.207 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-13T22:43:37.207 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:43:37.207 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-13T22:43:37.207 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw x86_64 2:18.2.1-0.el9 ceph 7.7 M 2024-09-13T22:43:37.207 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrading: 2024-09-13T22:43:37.208 INFO:teuthology.orchestra.run.smithi047.stdout: librados2 x86_64 2:18.2.1-0.el9 ceph 3.3 M 2024-09-13T22:43:37.208 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1 x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-09-13T22:43:37.208 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-13T22:43:37.208 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T22:43:37.208 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base x86_64 2:18.2.1-0.el9 ceph 5.2 M 2024-09-13T22:43:37.208 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common x86_64 2:18.2.1-0.el9 ceph 18 M 2024-09-13T22:43:37.208 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux x86_64 2:18.2.1-0.el9 ceph 24 k 2024-09-13T22:43:37.208 INFO:teuthology.orchestra.run.smithi047.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T22:43:37.208 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T22:43:37.208 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T22:43:37.208 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T22:43:37.209 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2 x86_64 2:18.2.1-0.el9 ceph 658 k 2024-09-13T22:43:37.209 INFO:teuthology.orchestra.run.smithi047.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T22:43:37.209 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T22:43:37.209 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T22:43:37.209 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 x86_64 2:18.2.1-0.el9 ceph 474 k 2024-09-13T22:43:37.209 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T22:43:37.209 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2 x86_64 2:18.2.1-0.el9 ceph 4.5 M 2024-09-13T22:43:37.209 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T22:43:37.209 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T22:43:37.209 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T22:43:37.210 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse x86_64 2:18.2.1-0.el9 ceph 45 k 2024-09-13T22:43:37.210 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common x86_64 2:18.2.1-0.el9 ceph 124 k 2024-09-13T22:43:37.210 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs x86_64 2:18.2.1-0.el9 ceph 161 k 2024-09-13T22:43:37.210 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T22:43:37.210 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados x86_64 2:18.2.1-0.el9 ceph 321 k 2024-09-13T22:43:37.210 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd x86_64 2:18.2.1-0.el9 ceph 297 k 2024-09-13T22:43:37.210 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw x86_64 2:18.2.1-0.el9 ceph 99 k 2024-09-13T22:43:37.210 INFO:teuthology.orchestra.run.smithi047.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T22:43:37.210 INFO:teuthology.orchestra.run.smithi047.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T22:43:37.210 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:43:37.210 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-13T22:43:37.210 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:43:37.210 INFO:teuthology.orchestra.run.smithi047.stdout:Install 28 Packages 2024-09-13T22:43:37.211 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrade 2 Packages 2024-09-13T22:43:37.211 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:43:37.211 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 53 M 2024-09-13T22:43:37.211 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-13T22:43:37.714 INFO:teuthology.orchestra.run.smithi047.stdout:(1/30): ceph-base-18.2.1-0.el9.x86_64.rpm 35 MB/s | 5.2 MB 00:00 2024-09-13T22:43:37.739 INFO:teuthology.orchestra.run.smithi047.stdout:(2/30): ceph-selinux-18.2.1-0.el9.x86_64.rpm 969 kB/s | 24 kB 00:00 2024-09-13T22:43:37.773 INFO:teuthology.orchestra.run.smithi047.stdout:(3/30): libcephfs2-18.2.1-0.el9.x86_64.rpm 19 MB/s | 658 kB 00:00 2024-09-13T22:43:37.806 INFO:teuthology.orchestra.run.smithi047.stdout:(4/30): libradosstriper1-18.2.1-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-09-13T22:43:37.923 INFO:teuthology.orchestra.run.smithi047.stdout:(5/30): ceph-radosgw-18.2.1-0.el9.x86_64.rpm 21 MB/s | 7.7 MB 00:00 2024-09-13T22:43:37.948 INFO:teuthology.orchestra.run.smithi047.stdout:(6/30): python3-ceph-argparse-18.2.1-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-09-13T22:43:37.973 INFO:teuthology.orchestra.run.smithi047.stdout:(7/30): python3-ceph-common-18.2.1-0.el9.x86_64 4.9 MB/s | 124 kB 00:00 2024-09-13T22:43:38.041 INFO:teuthology.orchestra.run.smithi047.stdout:(8/30): librgw2-18.2.1-0.el9.x86_64.rpm 19 MB/s | 4.5 MB 00:00 2024-09-13T22:43:38.066 INFO:teuthology.orchestra.run.smithi047.stdout:(9/30): python3-cephfs-18.2.1-0.el9.x86_64.rpm 1.7 MB/s | 161 kB 00:00 2024-09-13T22:43:38.091 INFO:teuthology.orchestra.run.smithi047.stdout:(10/30): python3-rados-18.2.1-0.el9.x86_64.rpm 6.2 MB/s | 321 kB 00:00 2024-09-13T22:43:38.116 INFO:teuthology.orchestra.run.smithi047.stdout:(11/30): python3-rbd-18.2.1-0.el9.x86_64.rpm 5.8 MB/s | 297 kB 00:00 2024-09-13T22:43:38.142 INFO:teuthology.orchestra.run.smithi047.stdout:(12/30): python3-rgw-18.2.1-0.el9.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2024-09-13T22:43:38.351 INFO:teuthology.orchestra.run.smithi047.stdout:(13/30): ceph-common-18.2.1-0.el9.x86_64.rpm 23 MB/s | 18 MB 00:00 2024-09-13T22:43:38.401 INFO:teuthology.orchestra.run.smithi047.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 413 kB/s | 107 kB 00:00 2024-09-13T22:43:38.451 INFO:teuthology.orchestra.run.smithi047.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 519 kB/s | 160 kB 00:00 2024-09-13T22:43:38.476 INFO:teuthology.orchestra.run.smithi047.stdout:(16/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 361 kB/s | 45 kB 00:00 2024-09-13T22:43:38.543 INFO:teuthology.orchestra.run.smithi047.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 633 kB/s | 42 kB 00:00 2024-09-13T22:43:38.585 INFO:teuthology.orchestra.run.smithi047.stdout:(18/30): fmt-8.1.1-5.el9.x86_64.rpm 2.6 MB/s | 111 kB 00:00 2024-09-13T22:43:38.619 INFO:teuthology.orchestra.run.smithi047.stdout:(19/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-09-13T22:43:38.652 INFO:teuthology.orchestra.run.smithi047.stdout:(20/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.5 MB/s | 308 kB 00:00 2024-09-13T22:43:38.678 INFO:teuthology.orchestra.run.smithi047.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-13T22:43:38.703 INFO:teuthology.orchestra.run.smithi047.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T22:43:38.728 INFO:teuthology.orchestra.run.smithi047.stdout:(23/30): librdkafka-1.6.1-102.el9.x86_64.rpm 2.0 MB/s | 662 kB 00:00 2024-09-13T22:43:38.754 INFO:teuthology.orchestra.run.smithi047.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T22:43:38.795 INFO:teuthology.orchestra.run.smithi047.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 5.5 MB/s | 191 kB 00:00 2024-09-13T22:43:38.871 INFO:teuthology.orchestra.run.smithi047.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-09-13T22:43:38.932 INFO:teuthology.orchestra.run.smithi047.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-13T22:43:39.021 INFO:teuthology.orchestra.run.smithi047.stdout:(28/30): librados2-18.2.1-0.el9.x86_64.rpm 22 MB/s | 3.3 MB 00:00 2024-09-13T22:43:39.088 INFO:teuthology.orchestra.run.smithi047.stdout:(29/30): libarrow-9.0.0-11.el9.x86_64.rpm 9.4 MB/s | 4.4 MB 00:00 2024-09-13T22:43:39.147 INFO:teuthology.orchestra.run.smithi047.stdout:(30/30): librbd1-18.2.1-0.el9.x86_64.rpm 14 MB/s | 3.0 MB 00:00 2024-09-13T22:43:39.152 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:43:39.152 INFO:teuthology.orchestra.run.smithi047.stdout:Total 27 MB/s | 53 MB 00:01 2024-09-13T22:43:39.227 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-13T22:43:39.267 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-13T22:43:39.267 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-13T22:43:39.909 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-13T22:43:39.928 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-13T22:43:39.928 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-13T22:43:41.369 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-13T22:43:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 83 kB/s | 19 kB 00:00 2024-09-13T22:43:41.463 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-13T22:43:41.494 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-13T22:43:41.545 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-13T22:43:41.882 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-13T22:43:41.993 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librados2-2:18.2.1-0.el9.x86_64 5/32 2024-09-13T22:43:42.086 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:18.2.1-0.el9.x86_64 5/32 2024-09-13T22:43:42.168 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rados-2:18.2.1-0.el9.x86_64 6/32 2024-09-13T22:43:42.203 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-09-13T22:43:42.265 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-09-13T22:43:42.302 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-13T22:43:42.346 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 9/32 2024-09-13T22:43:42.417 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-09-13T22:43:42.438 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-09-13T22:43:42.439 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-13T22:43:42.504 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-09-13T22:43:42.623 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-13T22:43:42.654 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-13T22:43:42.712 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-13T22:43:42.744 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-13T22:43:42.771 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-13T22:43:42.807 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-13T22:43:42.840 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-13T22:43:43.155 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-13T22:43:43.194 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-09-13T22:43:43.291 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-09-13T22:43:43.324 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rbd-2:18.2.1-0.el9.x86_64 21/32 2024-09-13T22:43:43.360 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-13T22:43:43.784 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-13T22:43:43.805 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-09-13T22:43:43.877 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-09-13T22:43:43.964 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rgw-2:18.2.1-0.el9.x86_64 25/32 2024-09-13T22:43:43.999 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-common-2:18.2.1-0.el9.x86_64 26/32 2024-09-13T22:43:46.169 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-09-13T22:43:46.204 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-09-13T22:43:46.784 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-09-13T22:43:46.824 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-09-13T22:43:46.929 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-09-13T22:43:46.930 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T22:43:46.930 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T22:43:46.930 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:43:46.975 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-09-13T22:43:48.137 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-13T22:43:50.582 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:43:50.601 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:43:50.601 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-13T22:43:50.601 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:43:50.601 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-13T22:43:50.601 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:18.2.1-0.el9 ceph 7.7 M 2024-09-13T22:43:50.601 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-09-13T22:43:50.601 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:18.2.1-0.el9 ceph 3.3 M 2024-09-13T22:43:50.601 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-09-13T22:43:50.601 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-13T22:43:50.602 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T22:43:50.602 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:18.2.1-0.el9 ceph 5.2 M 2024-09-13T22:43:50.602 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:18.2.1-0.el9 ceph 18 M 2024-09-13T22:43:50.602 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:18.2.1-0.el9 ceph 24 k 2024-09-13T22:43:50.602 INFO:teuthology.orchestra.run.smithi002.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T22:43:50.602 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T22:43:50.602 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T22:43:50.602 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T22:43:50.602 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:18.2.1-0.el9 ceph 658 k 2024-09-13T22:43:50.602 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T22:43:50.603 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T22:43:50.603 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T22:43:50.603 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:18.2.1-0.el9 ceph 474 k 2024-09-13T22:43:50.603 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T22:43:50.603 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:18.2.1-0.el9 ceph 4.5 M 2024-09-13T22:43:50.603 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T22:43:50.603 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T22:43:50.603 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T22:43:50.603 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:18.2.1-0.el9 ceph 45 k 2024-09-13T22:43:50.603 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:18.2.1-0.el9 ceph 124 k 2024-09-13T22:43:50.603 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:18.2.1-0.el9 ceph 161 k 2024-09-13T22:43:50.604 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T22:43:50.604 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:18.2.1-0.el9 ceph 321 k 2024-09-13T22:43:50.604 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:18.2.1-0.el9 ceph 297 k 2024-09-13T22:43:50.604 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:18.2.1-0.el9 ceph 99 k 2024-09-13T22:43:50.604 INFO:teuthology.orchestra.run.smithi002.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T22:43:50.604 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T22:43:50.604 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:43:50.604 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-13T22:43:50.604 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:43:50.604 INFO:teuthology.orchestra.run.smithi002.stdout:Install 28 Packages 2024-09-13T22:43:50.604 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 2 Packages 2024-09-13T22:43:50.605 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:43:50.605 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 53 M 2024-09-13T22:43:50.605 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-13T22:43:51.029 INFO:teuthology.orchestra.run.smithi002.stdout:(1/30): ceph-base-18.2.1-0.el9.x86_64.rpm 40 MB/s | 5.2 MB 00:00 2024-09-13T22:43:51.046 INFO:teuthology.orchestra.run.smithi002.stdout:(2/30): ceph-selinux-18.2.1-0.el9.x86_64.rpm 1.4 MB/s | 24 kB 00:00 2024-09-13T22:43:51.079 INFO:teuthology.orchestra.run.smithi002.stdout:(3/30): libcephfs2-18.2.1-0.el9.x86_64.rpm 19 MB/s | 658 kB 00:00 2024-09-13T22:43:51.113 INFO:teuthology.orchestra.run.smithi002.stdout:(4/30): libradosstriper1-18.2.1-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-09-13T22:43:51.214 INFO:teuthology.orchestra.run.smithi002.stdout:(5/30): librgw2-18.2.1-0.el9.x86_64.rpm 45 MB/s | 4.5 MB 00:00 2024-09-13T22:43:51.239 INFO:teuthology.orchestra.run.smithi002.stdout:(6/30): python3-ceph-argparse-18.2.1-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-09-13T22:43:51.266 INFO:teuthology.orchestra.run.smithi002.stdout:(7/30): python3-ceph-common-18.2.1-0.el9.x86_64 4.5 MB/s | 124 kB 00:00 2024-09-13T22:43:51.291 INFO:teuthology.orchestra.run.smithi002.stdout:(8/30): python3-cephfs-18.2.1-0.el9.x86_64.rpm 6.3 MB/s | 161 kB 00:00 2024-09-13T22:43:51.317 INFO:teuthology.orchestra.run.smithi002.stdout:(9/30): python3-rados-18.2.1-0.el9.x86_64.rpm 13 MB/s | 321 kB 00:00 2024-09-13T22:43:51.409 INFO:teuthology.orchestra.run.smithi002.stdout:(10/30): ceph-radosgw-18.2.1-0.el9.x86_64.rpm 15 MB/s | 7.7 MB 00:00 2024-09-13T22:43:51.442 INFO:teuthology.orchestra.run.smithi002.stdout:(11/30): python3-rgw-18.2.1-0.el9.x86_64.rpm 2.9 MB/s | 99 kB 00:00 2024-09-13T22:43:51.468 INFO:teuthology.orchestra.run.smithi002.stdout:(12/30): python3-rbd-18.2.1-0.el9.x86_64.rpm 1.9 MB/s | 297 kB 00:00 2024-09-13T22:43:51.685 INFO:teuthology.orchestra.run.smithi002.stdout:(13/30): ceph-common-18.2.1-0.el9.x86_64.rpm 23 MB/s | 18 MB 00:00 2024-09-13T22:43:51.710 INFO:teuthology.orchestra.run.smithi002.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 400 kB/s | 107 kB 00:00 2024-09-13T22:43:51.744 INFO:teuthology.orchestra.run.smithi002.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 581 kB/s | 160 kB 00:00 2024-09-13T22:43:51.769 INFO:teuthology.orchestra.run.smithi002.stdout:(16/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 541 kB/s | 45 kB 00:00 2024-09-13T22:43:51.819 INFO:teuthology.orchestra.run.smithi002.stdout:(17/30): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 662 kB 00:00 2024-09-13T22:43:51.845 INFO:teuthology.orchestra.run.smithi002.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-13T22:43:51.861 INFO:teuthology.orchestra.run.smithi002.stdout:(19/30): python3-prettytable-0.7.2-27.el9.noarc 458 kB/s | 42 kB 00:00 2024-09-13T22:43:51.920 INFO:teuthology.orchestra.run.smithi002.stdout:(20/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.0 MB/s | 308 kB 00:00 2024-09-13T22:43:51.937 INFO:teuthology.orchestra.run.smithi002.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.8 MB/s | 26 kB 00:00 2024-09-13T22:43:51.962 INFO:teuthology.orchestra.run.smithi002.stdout:(22/30): fmt-8.1.1-5.el9.x86_64.rpm 776 kB/s | 111 kB 00:00 2024-09-13T22:43:51.979 INFO:teuthology.orchestra.run.smithi002.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-09-13T22:43:52.004 INFO:teuthology.orchestra.run.smithi002.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-13T22:43:52.038 INFO:teuthology.orchestra.run.smithi002.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-13T22:43:52.088 INFO:teuthology.orchestra.run.smithi002.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-13T22:43:52.164 INFO:teuthology.orchestra.run.smithi002.stdout:(27/30): librados2-18.2.1-0.el9.x86_64.rpm 44 MB/s | 3.3 MB 00:00 2024-09-13T22:43:52.214 INFO:teuthology.orchestra.run.smithi002.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-09-13T22:43:52.272 INFO:teuthology.orchestra.run.smithi002.stdout:(29/30): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-13T22:43:52.323 INFO:teuthology.orchestra.run.smithi002.stdout:(30/30): librbd1-18.2.1-0.el9.x86_64.rpm 19 MB/s | 3.0 MB 00:00 2024-09-13T22:43:52.326 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:43:52.327 INFO:teuthology.orchestra.run.smithi002.stdout:Total 31 MB/s | 53 MB 00:01 2024-09-13T22:43:52.400 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-13T22:43:52.439 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-13T22:43:52.439 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-13T22:43:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-13T22:43:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-13T22:43:54.519 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-13T22:43:54.671 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-13T22:43:54.728 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-13T22:43:54.780 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-13T22:43:55.173 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-13T22:43:55.219 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:18.2.1-0.el9.x86_64 5/32 2024-09-13T22:43:55.312 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:18.2.1-0.el9.x86_64 5/32 2024-09-13T22:43:55.402 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:18.2.1-0.el9.x86_64 6/32 2024-09-13T22:43:55.428 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-09-13T22:43:55.491 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-09-13T22:43:55.528 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-13T22:43:55.572 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 9/32 2024-09-13T22:43:55.642 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-09-13T22:43:55.672 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-09-13T22:43:55.738 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-09-13T22:43:55.849 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-13T22:43:55.888 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-13T22:43:55.945 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-13T22:43:55.978 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-13T22:43:56.005 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-13T22:43:56.041 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-13T22:43:56.074 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-13T22:43:56.389 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-13T22:43:56.428 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-09-13T22:43:56.524 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-09-13T22:43:56.561 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:18.2.1-0.el9.x86_64 21/32 2024-09-13T22:43:56.602 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-13T22:43:57.024 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-13T22:43:57.055 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-09-13T22:43:57.127 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-09-13T22:43:57.215 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:18.2.1-0.el9.x86_64 25/32 2024-09-13T22:43:57.249 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:18.2.1-0.el9.x86_64 26/32 2024-09-13T22:43:57.656 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-09-13T22:43:57.656 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /sys 2024-09-13T22:43:57.656 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /proc 2024-09-13T22:43:57.656 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /mnt 2024-09-13T22:43:57.656 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /var/tmp 2024-09-13T22:43:57.657 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /home 2024-09-13T22:43:57.657 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /root 2024-09-13T22:43:57.657 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /tmp 2024-09-13T22:43:57.657 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:43:58.433 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-09-13T22:43:58.460 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-09-13T22:43:58.461 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:43:58.461 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T22:43:58.461 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T22:43:58.461 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T22:43:58.461 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:43:58.462 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T22:43:58.545 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T22:43:58.545 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T22:43:59.471 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-09-13T22:43:59.512 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-09-13T22:43:59.760 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T22:43:59.760 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-base-2:18.2.1-0.el9.x86_64 1/32 2024-09-13T22:43:59.760 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-common-2:18.2.1-0.el9.x86_64 2/32 2024-09-13T22:43:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-radosgw-2:18.2.1-0.el9.x86_64 3/32 2024-09-13T22:43:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-selinux-2:18.2.1-0.el9.x86_64 4/32 2024-09-13T22:43:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs2-2:18.2.1-0.el9.x86_64 5/32 2024-09-13T22:43:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libradosstriper1-2:18.2.1-0.el9.x86_64 6/32 2024-09-13T22:43:59.761 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librgw2-2:18.2.1-0.el9.x86_64 7/32 2024-09-13T22:43:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 8/32 2024-09-13T22:43:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-common-2:18.2.1-0.el9.x86_64 9/32 2024-09-13T22:43:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-09-13T22:43:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rados-2:18.2.1-0.el9.x86_64 11/32 2024-09-13T22:43:59.762 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rbd-2:18.2.1-0.el9.x86_64 12/32 2024-09-13T22:43:59.763 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rgw-2:18.2.1-0.el9.x86_64 13/32 2024-09-13T22:43:59.763 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-13T22:43:59.763 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-13T22:43:59.763 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-13T22:43:59.763 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-13T22:43:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-13T22:43:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-13T22:43:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-13T22:43:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-13T22:43:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-13T22:43:59.764 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-13T22:43:59.765 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-13T22:43:59.765 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-13T22:43:59.765 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-13T22:43:59.765 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-13T22:43:59.765 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-13T22:43:59.766 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:18.2.1-0.el9.x86_64 29/32 2024-09-13T22:43:59.766 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-13T22:43:59.766 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:18.2.1-0.el9.x86_64 31/32 2024-09-13T22:44:00.130 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-09-13T22:44:00.165 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-09-13T22:44:00.277 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-09-13T22:44:00.277 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T22:44:00.277 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T22:44:00.277 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:00.317 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-09-13T22:44:00.521 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T22:44:00.521 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:00.521 INFO:teuthology.orchestra.run.smithi047.stdout:Upgraded: 2024-09-13T22:44:00.521 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-2:18.2.1-0.el9.x86_64 librbd1-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:00.521 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-13T22:44:00.521 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T22:44:00.521 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:00.522 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:00.522 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:00.522 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:00.522 INFO:teuthology.orchestra.run.smithi047.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T22:44:00.522 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T22:44:00.522 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T22:44:00.522 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T22:44:00.522 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:00.522 INFO:teuthology.orchestra.run.smithi047.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T22:44:00.522 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T22:44:00.522 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T22:44:00.522 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:00.522 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T22:44:00.523 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:00.523 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T22:44:00.523 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T22:44:00.523 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T22:44:00.523 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:00.523 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:00.523 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:00.523 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T22:44:00.523 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:00.523 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:00.523 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:00.523 INFO:teuthology.orchestra.run.smithi047.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T22:44:00.523 INFO:teuthology.orchestra.run.smithi047.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T22:44:00.523 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:00.523 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:44:00.844 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-test 2024-09-13T22:44:01.431 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:27 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:44:01.573 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:44:01.573 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:44:01.573 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-13T22:44:01.573 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:44:01.573 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-13T22:44:01.573 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test x86_64 2:18.2.1-0.el9 ceph 40 M 2024-09-13T22:44:01.574 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-13T22:44:01.574 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite x86_64 2:18.2.1-0.el9 ceph 165 k 2024-09-13T22:44:01.574 INFO:teuthology.orchestra.run.smithi047.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T22:44:01.574 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T22:44:01.574 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:01.574 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-13T22:44:01.574 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:44:01.574 INFO:teuthology.orchestra.run.smithi047.stdout:Install 4 Packages 2024-09-13T22:44:01.574 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:01.575 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 40 M 2024-09-13T22:44:01.575 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 166 M 2024-09-13T22:44:01.575 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-13T22:44:01.993 INFO:teuthology.orchestra.run.smithi047.stdout:(1/4): libcephsqlite-18.2.1-0.el9.x86_64.rpm 1.2 MB/s | 165 kB 00:00 2024-09-13T22:44:02.018 INFO:teuthology.orchestra.run.smithi047.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.8 MB/s | 304 kB 00:00 2024-09-13T22:44:02.101 INFO:teuthology.orchestra.run.smithi047.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 588 kB/s | 64 kB 00:00 2024-09-13T22:44:02.485 INFO:teuthology.orchestra.run.smithi047.stdout:(4/4): ceph-test-18.2.1-0.el9.x86_64.rpm 63 MB/s | 40 MB 00:00 2024-09-13T22:44:02.487 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:44:02.487 INFO:teuthology.orchestra.run.smithi047.stdout:Total 44 MB/s | 40 MB 00:00 2024-09-13T22:44:02.514 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-13T22:44:02.536 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-13T22:44:02.536 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-13T22:44:02.893 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-13T22:44:02.893 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-13T22:44:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-13T22:44:03.475 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T22:44:03.527 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T22:44:03.553 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephsqlite-2:18.2.1-0.el9.x86_64 3/4 2024-09-13T22:44:07.515 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephsqlite-2:18.2.1-0.el9.x86_64 3/4 2024-09-13T22:44:07.605 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-test-2:18.2.1-0.el9.x86_64 4/4 2024-09-13T22:44:09.586 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-test-2:18.2.1-0.el9.x86_64 4/4 2024-09-13T22:44:09.586 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-test-2:18.2.1-0.el9.x86_64 1/4 2024-09-13T22:44:09.586 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephsqlite-2:18.2.1-0.el9.x86_64 2/4 2024-09-13T22:44:09.586 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T22:44:09.874 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T22:44:09.874 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:09.874 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-13T22:44:09.874 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-2:18.2.1-0.el9.x86_64 libcephsqlite-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:09.874 INFO:teuthology.orchestra.run.smithi047.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T22:44:09.874 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:09.874 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:44:10.177 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph 2024-09-13T22:44:10.707 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-09-13T22:44:10.707 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2024-09-13T22:44:10.708 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2024-09-13T22:44:10.708 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2024-09-13T22:44:10.708 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2024-09-13T22:44:10.708 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2024-09-13T22:44:10.708 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /root 2024-09-13T22:44:10.708 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2024-09-13T22:44:10.708 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:10.766 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:36 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:44:10.909 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:44:10.913 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:44:10.913 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-13T22:44:10.913 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:44:10.913 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-13T22:44:10.913 INFO:teuthology.orchestra.run.smithi047.stdout: ceph x86_64 2:18.2.1-0.el9 ceph 6.4 k 2024-09-13T22:44:10.913 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-13T22:44:10.913 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds x86_64 2:18.2.1-0.el9 ceph 2.1 M 2024-09-13T22:44:10.913 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr x86_64 2:18.2.1-0.el9 ceph 1.4 M 2024-09-13T22:44:10.913 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core noarch 2:18.2.1-0.el9 ceph-noarch 242 k 2024-09-13T22:44:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon x86_64 2:18.2.1-0.el9 ceph 4.4 M 2024-09-13T22:44:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd x86_64 2:18.2.1-0.el9 ceph 18 M 2024-09-13T22:44:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T22:44:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T22:44:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T22:44:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T22:44:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T22:44:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T22:44:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T22:44:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T22:44:10.914 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T22:44:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T22:44:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T22:44:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T22:44:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T22:44:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T22:44:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T22:44:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T22:44:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T22:44:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T22:44:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T22:44:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T22:44:10.915 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T22:44:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T22:44:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T22:44:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T22:44:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T22:44:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T22:44:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T22:44:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:10.916 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-13T22:44:10.916 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:44:10.916 INFO:teuthology.orchestra.run.smithi047.stdout:Install 33 Packages 2024-09-13T22:44:10.916 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:10.917 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 30 M 2024-09-13T22:44:10.917 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 110 M 2024-09-13T22:44:10.917 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-13T22:44:11.474 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-09-13T22:44:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-09-13T22:44:11.501 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:44:11.501 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T22:44:11.501 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T22:44:11.501 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T22:44:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:11.503 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T22:44:11.594 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T22:44:11.594 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T22:44:11.653 INFO:teuthology.orchestra.run.smithi047.stdout:(1/33): ceph-18.2.1-0.el9.x86_64.rpm 121 kB/s | 6.4 kB 00:00 2024-09-13T22:44:11.695 INFO:teuthology.orchestra.run.smithi047.stdout:(2/33): ceph-mgr-18.2.1-0.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-09-13T22:44:11.745 INFO:teuthology.orchestra.run.smithi047.stdout:(3/33): ceph-mds-18.2.1-0.el9.x86_64.rpm 14 MB/s | 2.1 MB 00:00 2024-09-13T22:44:11.771 INFO:teuthology.orchestra.run.smithi047.stdout:(4/33): ceph-mgr-modules-core-18.2.1-0.el9.noar 9.5 MB/s | 242 kB 00:00 2024-09-13T22:44:11.854 INFO:teuthology.orchestra.run.smithi047.stdout:(5/33): ceph-mon-18.2.1-0.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-09-13T22:44:12.088 INFO:teuthology.orchestra.run.smithi047.stdout:(6/33): ceph-osd-18.2.1-0.el9.x86_64.rpm 45 MB/s | 18 MB 00:00 2024-09-13T22:44:12.113 INFO:teuthology.orchestra.run.smithi047.stdout:(7/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 740 kB/s | 253 kB 00:00 2024-09-13T22:44:12.163 INFO:teuthology.orchestra.run.smithi047.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-09-13T22:44:12.205 INFO:teuthology.orchestra.run.smithi047.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-09-13T22:44:12.231 INFO:teuthology.orchestra.run.smithi047.stdout:(10/33): python3-ply-3.11-14.el9.noarch.rpm 749 kB/s | 106 kB 00:00 2024-09-13T22:44:12.256 INFO:teuthology.orchestra.run.smithi047.stdout:(11/33): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-13T22:44:12.290 INFO:teuthology.orchestra.run.smithi047.stdout:(12/33): python3-cryptography-36.0.1-4.el9.x86_ 2.8 MB/s | 1.2 MB 00:00 2024-09-13T22:44:12.307 INFO:teuthology.orchestra.run.smithi047.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 691 kB/s | 35 kB 00:00 2024-09-13T22:44:12.332 INFO:teuthology.orchestra.run.smithi047.stdout:(14/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-13T22:44:12.349 INFO:teuthology.orchestra.run.smithi047.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 863 kB/s | 51 kB 00:00 2024-09-13T22:44:12.366 INFO:teuthology.orchestra.run.smithi047.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 705 kB/s | 42 kB 00:00 2024-09-13T22:44:12.408 INFO:teuthology.orchestra.run.smithi047.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 573 kB/s | 43 kB 00:00 2024-09-13T22:44:12.425 INFO:teuthology.orchestra.run.smithi047.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 722 kB/s | 11 kB 00:00 2024-09-13T22:44:12.450 INFO:teuthology.orchestra.run.smithi047.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 709 kB/s | 18 kB 00:00 2024-09-13T22:44:12.475 INFO:teuthology.orchestra.run.smithi047.stdout:(20/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-13T22:44:12.501 INFO:teuthology.orchestra.run.smithi047.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-13T22:44:12.526 INFO:teuthology.orchestra.run.smithi047.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-13T22:44:12.551 INFO:teuthology.orchestra.run.smithi047.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-13T22:44:12.576 INFO:teuthology.orchestra.run.smithi047.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-09-13T22:44:12.610 INFO:teuthology.orchestra.run.smithi047.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2024-09-13T22:44:12.639 INFO:teuthology.orchestra.run.smithi047.stdout:(26/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-09-13T22:44:12.664 INFO:teuthology.orchestra.run.smithi047.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 308 kB/s | 16 kB 00:00 2024-09-13T22:44:12.689 INFO:teuthology.orchestra.run.smithi047.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-13T22:44:12.714 INFO:teuthology.orchestra.run.smithi047.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 710 kB/s | 36 kB 00:00 2024-09-13T22:44:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T22:44:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:18.2.1-0.el9.x86_64 1/32 2024-09-13T22:44:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:18.2.1-0.el9.x86_64 2/32 2024-09-13T22:44:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:18.2.1-0.el9.x86_64 3/32 2024-09-13T22:44:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:18.2.1-0.el9.x86_64 4/32 2024-09-13T22:44:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:18.2.1-0.el9.x86_64 5/32 2024-09-13T22:44:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:18.2.1-0.el9.x86_64 6/32 2024-09-13T22:44:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:18.2.1-0.el9.x86_64 7/32 2024-09-13T22:44:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 8/32 2024-09-13T22:44:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:18.2.1-0.el9.x86_64 9/32 2024-09-13T22:44:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-09-13T22:44:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:18.2.1-0.el9.x86_64 11/32 2024-09-13T22:44:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:18.2.1-0.el9.x86_64 12/32 2024-09-13T22:44:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:18.2.1-0.el9.x86_64 13/32 2024-09-13T22:44:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-13T22:44:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-13T22:44:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-13T22:44:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-13T22:44:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-13T22:44:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-13T22:44:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-13T22:44:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-13T22:44:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-13T22:44:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-13T22:44:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-13T22:44:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-13T22:44:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-13T22:44:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-13T22:44:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-13T22:44:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:18.2.1-0.el9.x86_64 29/32 2024-09-13T22:44:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-13T22:44:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:18.2.1-0.el9.x86_64 31/32 2024-09-13T22:44:12.740 INFO:teuthology.orchestra.run.smithi047.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-13T22:44:12.765 INFO:teuthology.orchestra.run.smithi047.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 803 kB/s | 20 kB 00:00 2024-09-13T22:44:12.790 INFO:teuthology.orchestra.run.smithi047.stdout:(32/33): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-13T22:44:12.815 INFO:teuthology.orchestra.run.smithi047.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-13T22:44:12.819 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:44:12.819 INFO:teuthology.orchestra.run.smithi047.stdout:Total 16 MB/s | 30 MB 00:01 2024-09-13T22:44:12.941 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-13T22:44:12.981 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-13T22:44:12.981 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-13T22:44:13.426 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-13T22:44:13.426 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-13T22:44:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T22:44:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:13.527 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-09-13T22:44:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:18.2.1-0.el9.x86_64 librbd1-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:13.527 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-13T22:44:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T22:44:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:13.527 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T22:44:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T22:44:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T22:44:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T22:44:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T22:44:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T22:44:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T22:44:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T22:44:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:13.528 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T22:44:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T22:44:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T22:44:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T22:44:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T22:44:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T22:44:13.529 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:13.530 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:44:13.889 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-test 2024-09-13T22:44:14.475 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:26 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:44:14.619 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:44:14.620 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:14.620 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-13T22:44:14.620 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:14.620 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-13T22:44:14.620 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:18.2.1-0.el9 ceph 40 M 2024-09-13T22:44:14.620 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-13T22:44:14.620 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:18.2.1-0.el9 ceph 165 k 2024-09-13T22:44:14.620 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T22:44:14.620 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T22:44:14.620 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:14.620 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-13T22:44:14.620 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:14.621 INFO:teuthology.orchestra.run.smithi002.stdout:Install 4 Packages 2024-09-13T22:44:14.621 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:14.621 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 40 M 2024-09-13T22:44:14.621 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 166 M 2024-09-13T22:44:14.621 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-13T22:44:14.694 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-13T22:44:14.761 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-13T22:44:14.791 INFO:teuthology.orchestra.run.smithi002.stdout:(1/4): libcephsqlite-18.2.1-0.el9.x86_64.rpm 2.4 MB/s | 165 kB 00:00 2024-09-13T22:44:14.802 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-13T22:44:14.837 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-13T22:44:14.858 INFO:teuthology.orchestra.run.smithi002.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.2 MB/s | 304 kB 00:00 2024-09-13T22:44:14.892 INFO:teuthology.orchestra.run.smithi002.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 636 kB/s | 64 kB 00:00 2024-09-13T22:44:14.930 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-13T22:44:15.008 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-13T22:44:15.063 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-13T22:44:15.097 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-13T22:44:15.127 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-13T22:44:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-13T22:44:15.195 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-13T22:44:15.236 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-13T22:44:15.288 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-13T22:44:15.317 INFO:teuthology.orchestra.run.smithi002.stdout:(4/4): ceph-test-18.2.1-0.el9.x86_64.rpm 67 MB/s | 40 MB 00:00 2024-09-13T22:44:15.319 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:44:15.320 INFO:teuthology.orchestra.run.smithi002.stdout:Total 57 MB/s | 40 MB 00:00 2024-09-13T22:44:15.330 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-13T22:44:15.348 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-13T22:44:15.370 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-13T22:44:15.370 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-13T22:44:15.377 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-13T22:44:15.453 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-13T22:44:15.604 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-13T22:44:15.688 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-13T22:44:15.727 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-13T22:44:15.727 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-13T22:44:15.755 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-13T22:44:15.818 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-13T22:44:15.877 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-13T22:44:15.940 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-13T22:44:16.135 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-13T22:44:16.200 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-13T22:44:16.213 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-13T22:44:16.282 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-13T22:44:16.317 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T22:44:16.375 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T22:44:16.379 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-13T22:44:16.402 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:18.2.1-0.el9.x86_64 3/4 2024-09-13T22:44:16.420 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-13T22:44:16.557 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-13T22:44:16.719 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 28/33 2024-09-13T22:44:16.751 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-09-13T22:44:16.780 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-09-13T22:44:16.780 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:44:16.780 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T22:44:16.780 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T22:44:16.780 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T22:44:16.781 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:18.386 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-09-13T22:44:18.416 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-09-13T22:44:18.416 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:44:18.416 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T22:44:18.416 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T22:44:18.416 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T22:44:18.416 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-09-13T22:44:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-09-13T22:44:18.912 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:44:18.912 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T22:44:18.913 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T22:44:18.913 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T22:44:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:19.129 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-09-13T22:44:19.154 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-09-13T22:44:19.155 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:44:19.155 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T22:44:19.155 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T22:44:19.155 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T22:44:19.155 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:19.220 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-2:18.2.1-0.el9.x86_64 33/33 2024-09-13T22:44:20.350 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:18.2.1-0.el9.x86_64 3/4 2024-09-13T22:44:20.428 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:18.2.1-0.el9.x86_64 4/4 2024-09-13T22:44:21.029 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-2:18.2.1-0.el9.x86_64 33/33 2024-09-13T22:44:21.029 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-2:18.2.1-0.el9.x86_64 1/33 2024-09-13T22:44:21.030 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mds-2:18.2.1-0.el9.x86_64 2/33 2024-09-13T22:44:21.030 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-2:18.2.1-0.el9.x86_64 3/33 2024-09-13T22:44:21.030 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mon-2:18.2.1-0.el9.x86_64 4/33 2024-09-13T22:44:21.030 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-osd-2:18.2.1-0.el9.x86_64 5/33 2024-09-13T22:44:21.030 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 6/33 2024-09-13T22:44:21.030 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-13T22:44:21.030 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-13T22:44:21.030 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-13T22:44:21.030 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-13T22:44:21.030 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-13T22:44:21.030 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-13T22:44:21.030 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-13T22:44:21.030 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-13T22:44:21.031 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-13T22:44:21.031 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-13T22:44:21.031 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-13T22:44:21.031 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-13T22:44:21.031 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-13T22:44:21.031 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-13T22:44:21.031 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-13T22:44:21.031 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-13T22:44:21.031 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-13T22:44:21.031 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-13T22:44:21.031 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-13T22:44:21.032 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-13T22:44:21.032 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-13T22:44:21.032 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-13T22:44:21.033 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-13T22:44:21.033 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-13T22:44:21.033 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-13T22:44:21.033 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-13T22:44:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-13T22:44:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:22.017 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-13T22:44:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 2024-09-13T22:44:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:22.017 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T22:44:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T22:44:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T22:44:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T22:44:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T22:44:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T22:44:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T22:44:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T22:44:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T22:44:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T22:44:22.018 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T22:44:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T22:44:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T22:44:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T22:44:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T22:44:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T22:44:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T22:44:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T22:44:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T22:44:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T22:44:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T22:44:22.019 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T22:44:22.020 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T22:44:22.020 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T22:44:22.020 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T22:44:22.020 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T22:44:22.020 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T22:44:22.020 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:22.020 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:44:22.344 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-base 2024-09-13T22:44:22.460 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-test-2:18.2.1-0.el9.x86_64 4/4 2024-09-13T22:44:22.460 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:18.2.1-0.el9.x86_64 1/4 2024-09-13T22:44:22.461 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:18.2.1-0.el9.x86_64 2/4 2024-09-13T22:44:22.461 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T22:44:22.768 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T22:44:22.769 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:22.769 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-13T22:44:22.769 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:18.2.1-0.el9.x86_64 libcephsqlite-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:22.769 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T22:44:22.769 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:22.769 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:44:22.933 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:48 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:44:23.026 INFO:teuthology.orchestra.run.smithi047.stdout:Package ceph-base-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-13T22:44:23.070 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph 2024-09-13T22:44:23.070 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:44:23.071 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-13T22:44:23.071 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:44:23.142 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install cephadm 2024-09-13T22:44:23.656 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:35 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:44:23.729 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:49 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:44:23.804 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:44:23.807 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:23.807 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-13T22:44:23.807 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:23.807 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-13T22:44:23.807 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:18.2.1-0.el9 ceph 6.4 k 2024-09-13T22:44:23.807 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-13T22:44:23.807 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:18.2.1-0.el9 ceph 2.1 M 2024-09-13T22:44:23.807 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:18.2.1-0.el9 ceph 1.4 M 2024-09-13T22:44:23.807 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:18.2.1-0.el9 ceph-noarch 242 k 2024-09-13T22:44:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:18.2.1-0.el9 ceph 4.4 M 2024-09-13T22:44:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:18.2.1-0.el9 ceph 18 M 2024-09-13T22:44:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T22:44:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T22:44:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T22:44:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T22:44:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T22:44:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T22:44:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T22:44:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T22:44:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T22:44:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T22:44:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T22:44:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T22:44:23.808 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T22:44:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T22:44:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T22:44:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T22:44:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T22:44:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T22:44:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T22:44:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T22:44:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T22:44:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T22:44:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T22:44:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T22:44:23.809 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T22:44:23.810 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T22:44:23.810 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T22:44:23.810 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:23.810 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-13T22:44:23.810 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:23.810 INFO:teuthology.orchestra.run.smithi002.stdout:Install 33 Packages 2024-09-13T22:44:23.810 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:23.811 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 30 M 2024-09-13T22:44:23.811 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 110 M 2024-09-13T22:44:23.811 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-13T22:44:23.868 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:44:23.869 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:44:23.869 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-13T22:44:23.869 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:44:23.869 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-13T22:44:23.869 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm noarch 2:18.2.1-0.el9 ceph-noarch 221 k 2024-09-13T22:44:23.869 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:23.869 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-13T22:44:23.869 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:44:23.869 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-13T22:44:23.869 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:23.869 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 221 k 2024-09-13T22:44:23.870 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 213 k 2024-09-13T22:44:23.870 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-13T22:44:23.919 INFO:teuthology.orchestra.run.smithi047.stdout:cephadm-18.2.1-0.el9.noarch.rpm 4.4 MB/s | 221 kB 00:00 2024-09-13T22:44:23.920 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:44:23.920 INFO:teuthology.orchestra.run.smithi047.stdout:Total 4.3 MB/s | 221 kB 00:00 2024-09-13T22:44:23.920 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-13T22:44:23.925 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-13T22:44:23.926 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-13T22:44:23.928 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-13T22:44:23.929 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-13T22:44:24.002 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-13T22:44:24.357 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-09-13T22:44:24.401 INFO:teuthology.orchestra.run.smithi002.stdout:(1/33): ceph-18.2.1-0.el9.x86_64.rpm 120 kB/s | 6.4 kB 00:00 2024-09-13T22:44:24.450 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-09-13T22:44:24.452 INFO:teuthology.orchestra.run.smithi002.stdout:(2/33): ceph-mgr-18.2.1-0.el9.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-09-13T22:44:24.519 INFO:teuthology.orchestra.run.smithi002.stdout:(3/33): ceph-mds-18.2.1-0.el9.x86_64.rpm 12 MB/s | 2.1 MB 00:00 2024-09-13T22:44:24.544 INFO:teuthology.orchestra.run.smithi002.stdout:(4/33): ceph-mgr-modules-core-18.2.1-0.el9.noar 9.5 MB/s | 242 kB 00:00 2024-09-13T22:44:24.636 INFO:teuthology.orchestra.run.smithi002.stdout:(5/33): ceph-mon-18.2.1-0.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-09-13T22:44:24.703 INFO:teuthology.orchestra.run.smithi002.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-09-13T22:44:24.825 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-09-13T22:44:24.903 INFO:teuthology.orchestra.run.smithi002.stdout:(7/33): ceph-osd-18.2.1-0.el9.x86_64.rpm 39 MB/s | 18 MB 00:00 2024-09-13T22:44:24.937 INFO:teuthology.orchestra.run.smithi002.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 456 kB/s | 106 kB 00:00 2024-09-13T22:44:25.029 INFO:teuthology.orchestra.run.smithi002.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 1.3 MB/s | 125 kB 00:00 2024-09-13T22:44:25.062 INFO:teuthology.orchestra.run.smithi002.stdout:(10/33): python3-pycparser-2.20-6.el9.noarch.rp 852 kB/s | 135 kB 00:00 2024-09-13T22:44:25.109 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-09-13T22:44:25.109 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:25.109 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-13T22:44:25.109 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm-2:18.2.1-0.el9.noarch 2024-09-13T22:44:25.109 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:25.109 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:44:25.116 INFO:teuthology.orchestra.run.smithi002.stdout:(11/33): python3-urllib3-1.26.5-6.el9.noarch.rp 2.4 MB/s | 215 kB 00:00 2024-09-13T22:44:25.149 INFO:teuthology.orchestra.run.smithi002.stdout:(12/33): python3-cryptography-36.0.1-4.el9.x86_ 2.4 MB/s | 1.2 MB 00:00 2024-09-13T22:44:25.225 INFO:teuthology.orchestra.run.smithi002.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 320 kB/s | 35 kB 00:00 2024-09-13T22:44:25.258 INFO:teuthology.orchestra.run.smithi002.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 469 kB/s | 51 kB 00:00 2024-09-13T22:44:25.284 INFO:teuthology.orchestra.run.smithi002.stdout:(15/33): python3-mako-1.1.4-6.el9.noarch.rpm 778 kB/s | 172 kB 00:00 2024-09-13T22:44:25.309 INFO:teuthology.orchestra.run.smithi002.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 497 kB/s | 42 kB 00:00 2024-09-13T22:44:25.314 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T22:44:25.359 INFO:teuthology.orchestra.run.smithi002.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 433 kB/s | 43 kB 00:00 2024-09-13T22:44:25.384 INFO:teuthology.orchestra.run.smithi002.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 468 kB/s | 11 kB 00:00 2024-09-13T22:44:25.410 INFO:teuthology.orchestra.run.smithi002.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 711 kB/s | 18 kB 00:00 2024-09-13T22:44:25.435 INFO:teuthology.orchestra.run.smithi002.stdout:(20/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-13T22:44:25.460 INFO:teuthology.orchestra.run.smithi002.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-13T22:44:25.488 INFO:teuthology.orchestra.run.smithi002.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-13T22:44:25.511 INFO:teuthology.orchestra.run.smithi002.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-13T22:44:25.536 INFO:teuthology.orchestra.run.smithi002.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-09-13T22:44:25.561 INFO:teuthology.orchestra.run.smithi002.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-13T22:44:25.587 INFO:teuthology.orchestra.run.smithi002.stdout:(26/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-13T22:44:25.612 INFO:teuthology.orchestra.run.smithi002.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-13T22:44:25.637 INFO:teuthology.orchestra.run.smithi002.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-13T22:44:25.662 INFO:teuthology.orchestra.run.smithi002.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 711 kB/s | 36 kB 00:00 2024-09-13T22:44:25.688 INFO:teuthology.orchestra.run.smithi002.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-13T22:44:25.713 INFO:teuthology.orchestra.run.smithi002.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 804 kB/s | 20 kB 00:00 2024-09-13T22:44:25.738 INFO:teuthology.orchestra.run.smithi002.stdout:(32/33): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-13T22:44:25.772 INFO:teuthology.orchestra.run.smithi002.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-13T22:44:25.777 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:44:25.777 INFO:teuthology.orchestra.run.smithi002.stdout:Total 15 MB/s | 30 MB 00:01 2024-09-13T22:44:25.904 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-13T22:44:25.905 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:51 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:44:25.945 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-13T22:44:25.945 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-13T22:44:26.044 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:44:26.045 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:44:26.045 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-09-13T22:44:26.045 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:44:26.045 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-13T22:44:26.045 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-0.el9 ceph 142 k 2024-09-13T22:44:26.045 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:26.045 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-13T22:44:26.045 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:44:26.045 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-13T22:44:26.046 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:26.046 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 142 k 2024-09-13T22:44:26.046 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 395 k 2024-09-13T22:44:26.046 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-13T22:44:26.100 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-immutable-object-cache-18.2.1-0.el9.x86_64 2.6 MB/s | 142 kB 00:00 2024-09-13T22:44:26.101 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:44:26.101 INFO:teuthology.orchestra.run.smithi047.stdout:Total 2.5 MB/s | 142 kB 00:00 2024-09-13T22:44:26.101 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-13T22:44:26.109 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-13T22:44:26.109 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-13T22:44:26.168 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-13T22:44:26.169 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-13T22:44:26.321 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-13T22:44:26.372 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-13T22:44:26.372 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-13T22:44:26.392 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:44:26.419 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:44:26.419 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:44:26.419 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T22:44:26.419 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:27.359 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:44:27.359 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:27.359 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-13T22:44:27.359 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:27.359 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:27.360 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:44:27.562 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr 2024-09-13T22:44:27.617 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-13T22:44:27.683 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-13T22:44:27.716 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-13T22:44:27.749 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-13T22:44:27.846 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-13T22:44:27.944 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-13T22:44:27.994 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-13T22:44:28.045 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-13T22:44:28.074 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-13T22:44:28.110 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-13T22:44:28.150 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:54 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:44:28.151 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-13T22:44:28.200 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-13T22:44:28.243 INFO:teuthology.orchestra.run.smithi047.stdout:Package ceph-mgr-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-13T22:44:28.243 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-13T22:44:28.277 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-13T22:44:28.287 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:44:28.288 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-13T22:44:28.288 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:44:28.326 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-13T22:44:28.355 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T22:44:28.410 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-13T22:44:28.562 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-13T22:44:28.652 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-13T22:44:28.704 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-13T22:44:28.750 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-13T22:44:28.808 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-13T22:44:28.872 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-13T22:44:28.942 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:54 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:44:29.069 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-13T22:44:29.082 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:44:29.083 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:44:29.083 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-13T22:44:29.083 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:44:29.083 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-13T22:44:29.083 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard noarch 2:18.2.1-0.el9 ceph-noarch 1.8 M 2024-09-13T22:44:29.083 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-13T22:44:29.083 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards noarch 2:18.2.1-0.el9 ceph-noarch 23 k 2024-09-13T22:44:29.083 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts noarch 2:18.2.1-0.el9 ceph-noarch 15 k 2024-09-13T22:44:29.083 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-13T22:44:29.083 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T22:44:29.084 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T22:44:29.084 INFO:teuthology.orchestra.run.smithi047.stdout:Installing weak dependencies: 2024-09-13T22:44:29.084 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-13T22:44:29.084 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:29.084 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-13T22:44:29.084 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:44:29.084 INFO:teuthology.orchestra.run.smithi047.stdout:Install 7 Packages 2024-09-13T22:44:29.084 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:29.084 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 2.1 M 2024-09-13T22:44:29.085 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 8.5 M 2024-09-13T22:44:29.085 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-13T22:44:29.129 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-13T22:44:29.212 INFO:teuthology.orchestra.run.smithi047.stdout:(1/7): ceph-grafana-dashboards-18.2.1-0.el9.noa 330 kB/s | 23 kB 00:00 2024-09-13T22:44:29.218 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-13T22:44:29.237 INFO:teuthology.orchestra.run.smithi047.stdout:(2/7): ceph-prometheus-alerts-18.2.1-0.el9.noar 153 kB/s | 15 kB 00:00 2024-09-13T22:44:29.279 INFO:teuthology.orchestra.run.smithi047.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-13T22:44:29.304 INFO:teuthology.orchestra.run.smithi047.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-13T22:44:29.317 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-13T22:44:29.329 INFO:teuthology.orchestra.run.smithi047.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 445 kB/s | 41 kB 00:00 2024-09-13T22:44:29.355 INFO:teuthology.orchestra.run.smithi047.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-13T22:44:29.361 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-13T22:44:29.397 INFO:teuthology.orchestra.run.smithi047.stdout:(7/7): ceph-mgr-dashboard-18.2.1-0.el9.noarch.r 6.9 MB/s | 1.8 MB 00:00 2024-09-13T22:44:29.401 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:44:29.401 INFO:teuthology.orchestra.run.smithi047.stdout:Total 6.5 MB/s | 2.1 MB 00:00 2024-09-13T22:44:29.401 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-13T22:44:29.409 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-13T22:44:29.409 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-13T22:44:29.483 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-13T22:44:29.496 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-13T22:44:29.497 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-13T22:44:29.645 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 28/33 2024-09-13T22:44:29.671 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-09-13T22:44:29.697 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-09-13T22:44:29.697 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:44:29.697 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T22:44:29.698 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T22:44:29.698 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T22:44:29.698 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:29.827 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-13T22:44:29.890 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-13T22:44:29.925 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-13T22:44:29.981 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-13T22:44:30.011 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-13T22:44:30.048 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 5/7 2024-09-13T22:44:30.295 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 6/7 2024-09-13T22:44:30.334 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-09-13T22:44:30.933 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-09-13T22:44:30.933 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 1/7 2024-09-13T22:44:30.933 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2/7 2024-09-13T22:44:30.934 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 3/7 2024-09-13T22:44:30.934 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-13T22:44:30.934 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-13T22:44:30.934 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-13T22:44:31.234 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-13T22:44:31.234 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:31.234 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-13T22:44:31.234 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 2024-09-13T22:44:31.234 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2024-09-13T22:44:31.234 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 2024-09-13T22:44:31.234 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-13T22:44:31.235 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-13T22:44:31.235 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T22:44:31.235 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T22:44:31.235 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:31.235 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:44:31.305 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-09-13T22:44:31.336 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-09-13T22:44:31.337 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:44:31.337 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T22:44:31.337 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T22:44:31.337 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T22:44:31.337 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:31.447 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T22:44:31.814 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-09-13T22:44:31.841 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-09-13T22:44:31.841 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:44:31.841 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T22:44:31.841 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T22:44:31.841 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T22:44:31.841 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:32.032 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:58 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:44:32.057 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-09-13T22:44:32.083 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-09-13T22:44:32.083 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:44:32.083 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T22:44:32.083 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T22:44:32.083 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T22:44:32.083 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:32.149 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:18.2.1-0.el9.x86_64 33/33 2024-09-13T22:44:32.171 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:44:32.172 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:44:32.172 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-13T22:44:32.172 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:44:32.172 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-13T22:44:32.172 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-0.el9 ceph-noarch 7.4 M 2024-09-13T22:44:32.172 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-13T22:44:32.173 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T22:44:32.173 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T22:44:32.173 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T22:44:32.173 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T22:44:32.173 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T22:44:32.173 INFO:teuthology.orchestra.run.smithi047.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T22:44:32.173 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T22:44:32.173 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T22:44:32.173 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T22:44:32.173 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T22:44:32.173 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T22:44:32.173 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:32.173 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-13T22:44:32.174 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:44:32.174 INFO:teuthology.orchestra.run.smithi047.stdout:Install 12 Packages 2024-09-13T22:44:32.174 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:44:32.174 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 38 M 2024-09-13T22:44:32.174 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 212 M 2024-09-13T22:44:32.174 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-13T22:44:32.438 INFO:teuthology.orchestra.run.smithi047.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.1-0. 52 MB/s | 7.4 MB 00:00 2024-09-13T22:44:32.488 INFO:teuthology.orchestra.run.smithi047.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 993 kB/s | 191 kB 00:00 2024-09-13T22:44:32.521 INFO:teuthology.orchestra.run.smithi047.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-13T22:44:32.721 INFO:teuthology.orchestra.run.smithi047.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 115 kB/s | 33 kB 00:00 2024-09-13T22:44:32.805 INFO:teuthology.orchestra.run.smithi047.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 64 kB/s | 18 kB 00:00 2024-09-13T22:44:32.922 INFO:teuthology.orchestra.run.smithi047.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 192 kB/s | 38 kB 00:00 2024-09-13T22:44:33.297 INFO:teuthology.orchestra.run.smithi047.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 652 kB/s | 245 kB 00:00 2024-09-13T22:44:33.547 INFO:teuthology.orchestra.run.smithi047.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.8 MB/s | 3.0 MB 00:01 2024-09-13T22:44:33.673 INFO:teuthology.orchestra.run.smithi047.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.0 MB/s | 250 kB 00:00 2024-09-13T22:44:33.914 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-2:18.2.1-0.el9.x86_64 33/33 2024-09-13T22:44:33.914 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:18.2.1-0.el9.x86_64 1/33 2024-09-13T22:44:33.914 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:18.2.1-0.el9.x86_64 2/33 2024-09-13T22:44:33.915 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:18.2.1-0.el9.x86_64 3/33 2024-09-13T22:44:33.915 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:18.2.1-0.el9.x86_64 4/33 2024-09-13T22:44:33.915 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:18.2.1-0.el9.x86_64 5/33 2024-09-13T22:44:33.915 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 6/33 2024-09-13T22:44:33.915 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-13T22:44:33.915 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-13T22:44:33.915 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-13T22:44:33.915 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-13T22:44:33.915 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-13T22:44:33.915 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-13T22:44:33.915 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-13T22:44:33.915 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-13T22:44:33.915 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-13T22:44:33.916 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-13T22:44:33.916 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-13T22:44:33.916 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-13T22:44:33.916 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-13T22:44:33.916 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-13T22:44:33.916 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-13T22:44:33.916 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-13T22:44:33.916 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-13T22:44:33.916 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-13T22:44:33.916 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-13T22:44:33.916 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-13T22:44:33.916 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-13T22:44:33.916 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-13T22:44:33.917 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-13T22:44:33.917 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-13T22:44:33.917 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-13T22:44:33.917 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-13T22:44:34.892 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-13T22:44:34.892 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:34.892 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-13T22:44:34.893 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:34.893 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:34.893 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:34.893 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 2024-09-13T22:44:34.893 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:34.893 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:34.893 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T22:44:34.893 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T22:44:34.893 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T22:44:34.893 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T22:44:34.893 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T22:44:34.893 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T22:44:34.894 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T22:44:34.894 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T22:44:34.894 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T22:44:34.894 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T22:44:34.894 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T22:44:34.894 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T22:44:34.894 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T22:44:34.894 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T22:44:34.894 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T22:44:34.894 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T22:44:34.894 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T22:44:34.894 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T22:44:34.894 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T22:44:34.895 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T22:44:34.895 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T22:44:34.895 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T22:44:34.895 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T22:44:34.895 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T22:44:34.895 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T22:44:34.895 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T22:44:34.895 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T22:44:34.895 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:34.895 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:44:35.243 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-base 2024-09-13T22:44:35.331 INFO:teuthology.orchestra.run.smithi047.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.0 MB/s | 4.9 MB 00:02 2024-09-13T22:44:35.832 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:47 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:44:35.925 INFO:teuthology.orchestra.run.smithi002.stdout:Package ceph-base-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-13T22:44:35.970 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:44:35.971 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-13T22:44:35.971 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:44:36.045 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install cephadm 2024-09-13T22:44:36.431 INFO:teuthology.orchestra.run.smithi047.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.6 MB/s | 5.1 MB 00:03 2024-09-13T22:44:36.630 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:48 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:44:36.768 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:44:36.769 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:36.769 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-13T22:44:36.769 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:36.769 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-13T22:44:36.769 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:18.2.1-0.el9 ceph-noarch 221 k 2024-09-13T22:44:36.769 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:36.769 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-13T22:44:36.769 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:36.770 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-13T22:44:36.770 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:36.770 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 221 k 2024-09-13T22:44:36.770 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 213 k 2024-09-13T22:44:36.770 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-13T22:44:36.814 INFO:teuthology.orchestra.run.smithi002.stdout:cephadm-18.2.1-0.el9.noarch.rpm 5.0 MB/s | 221 kB 00:00 2024-09-13T22:44:36.814 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:44:36.814 INFO:teuthology.orchestra.run.smithi002.stdout:Total 4.8 MB/s | 221 kB 00:00 2024-09-13T22:44:36.815 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-13T22:44:36.820 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-13T22:44:36.820 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-13T22:44:36.823 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-13T22:44:36.823 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-13T22:44:36.898 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-13T22:44:37.328 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-09-13T22:44:37.420 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-09-13T22:44:37.801 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-09-13T22:44:38.055 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-09-13T22:44:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:38.056 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-13T22:44:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:18.2.1-0.el9.noarch 2024-09-13T22:44:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:38.056 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:44:38.263 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T22:44:38.854 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:50 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:44:38.993 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:44:38.994 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:38.994 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2024-09-13T22:44:38.994 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:38.994 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-13T22:44:38.994 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-0.el9 ceph 142 k 2024-09-13T22:44:38.994 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:38.994 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-13T22:44:38.994 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:38.994 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-13T22:44:38.994 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:38.995 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 142 k 2024-09-13T22:44:38.995 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 395 k 2024-09-13T22:44:38.995 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-13T22:44:39.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-immutable-object-cache-18.2.1-0.el9.x86_64 2.4 MB/s | 142 kB 00:00 2024-09-13T22:44:39.053 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:44:39.054 INFO:teuthology.orchestra.run.smithi002.stdout:Total 2.3 MB/s | 142 kB 00:00 2024-09-13T22:44:39.054 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-13T22:44:39.062 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-13T22:44:39.062 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-13T22:44:39.123 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-13T22:44:39.123 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-13T22:44:39.282 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-13T22:44:39.379 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:44:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:44:39.406 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:44:39.406 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T22:44:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:40.423 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:44:40.423 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-13T22:44:40.423 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 2024-09-13T22:44:40.423 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:44:40.659 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr 2024-09-13T22:44:41.252 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:53 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:44:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:Package ceph-mgr-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-13T22:44:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:44:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-13T22:44:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:44:41.471 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T22:44:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:54 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:44:42.195 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:44:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:42.196 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-13T22:44:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-13T22:44:42.196 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:18.2.1-0.el9 ceph-noarch 1.8 M 2024-09-13T22:44:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-13T22:44:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:18.2.1-0.el9 ceph-noarch 23 k 2024-09-13T22:44:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:18.2.1-0.el9 ceph-noarch 15 k 2024-09-13T22:44:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-13T22:44:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T22:44:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T22:44:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-09-13T22:44:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-13T22:44:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-13T22:44:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:Install 7 Packages 2024-09-13T22:44:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:42.198 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 2.1 M 2024-09-13T22:44:42.198 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 8.5 M 2024-09-13T22:44:42.198 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-13T22:44:42.416 INFO:teuthology.orchestra.run.smithi002.stdout:(1/7): ceph-grafana-dashboards-18.2.1-0.el9.noa 368 kB/s | 23 kB 00:00 2024-09-13T22:44:42.433 INFO:teuthology.orchestra.run.smithi002.stdout:(2/7): ceph-prometheus-alerts-18.2.1-0.el9.noar 184 kB/s | 15 kB 00:00 2024-09-13T22:44:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 181 kB/s | 9.0 kB 00:00 2024-09-13T22:44:42.483 INFO:teuthology.orchestra.run.smithi002.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 2.1 MB/s | 31 kB 00:00 2024-09-13T22:44:42.500 INFO:teuthology.orchestra.run.smithi002.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 610 kB/s | 41 kB 00:00 2024-09-13T22:44:42.525 INFO:teuthology.orchestra.run.smithi002.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2024-09-13T22:44:42.567 INFO:teuthology.orchestra.run.smithi002.stdout:(7/7): ceph-mgr-dashboard-18.2.1-0.el9.noarch.r 8.2 MB/s | 1.8 MB 00:00 2024-09-13T22:44:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:44:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:Total 5.5 MB/s | 2.1 MB 00:00 2024-09-13T22:44:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-13T22:44:42.579 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-13T22:44:42.580 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-13T22:44:42.656 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-13T22:44:42.656 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-13T22:44:42.998 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-13T22:44:43.069 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-13T22:44:43.104 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-13T22:44:43.159 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-13T22:44:43.198 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-13T22:44:43.227 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 5/7 2024-09-13T22:44:43.477 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 6/7 2024-09-13T22:44:43.513 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-09-13T22:44:44.038 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-09-13T22:44:44.039 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 1/7 2024-09-13T22:44:44.039 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2/7 2024-09-13T22:44:44.039 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 3/7 2024-09-13T22:44:44.039 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-13T22:44:44.039 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-13T22:44:44.039 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-13T22:44:44.314 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-13T22:44:44.315 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:44.315 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-13T22:44:44.315 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 2024-09-13T22:44:44.315 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2024-09-13T22:44:44.315 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 2024-09-13T22:44:44.315 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-13T22:44:44.315 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-13T22:44:44.315 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T22:44:44.315 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T22:44:44.315 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:44.315 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:44:44.529 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T22:44:45.117 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:57 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:44:45.256 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:44:45.257 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:45.258 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-13T22:44:45.258 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:45.258 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-13T22:44:45.258 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-0.el9 ceph-noarch 7.4 M 2024-09-13T22:44:45.258 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-13T22:44:45.258 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T22:44:45.258 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T22:44:45.258 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T22:44:45.258 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T22:44:45.258 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T22:44:45.258 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T22:44:45.258 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T22:44:45.258 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T22:44:45.259 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T22:44:45.259 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T22:44:45.259 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T22:44:45.259 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:45.259 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-13T22:44:45.259 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:45.259 INFO:teuthology.orchestra.run.smithi002.stdout:Install 12 Packages 2024-09-13T22:44:45.259 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 38 M 2024-09-13T22:44:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 212 M 2024-09-13T22:44:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-13T22:44:45.482 INFO:teuthology.orchestra.run.smithi002.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.1-0. 48 MB/s | 7.4 MB 00:00 2024-09-13T22:44:45.541 INFO:teuthology.orchestra.run.smithi002.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 561 kB/s | 33 kB 00:00 2024-09-13T22:44:45.591 INFO:teuthology.orchestra.run.smithi002.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 727 kB/s | 191 kB 00:00 2024-09-13T22:44:45.666 INFO:teuthology.orchestra.run.smithi002.stdout:(4/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.3 MB/s | 801 kB 00:00 2024-09-13T22:44:45.691 INFO:teuthology.orchestra.run.smithi002.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 182 kB/s | 18 kB 00:00 2024-09-13T22:44:45.717 INFO:teuthology.orchestra.run.smithi002.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 764 kB/s | 38 kB 00:00 2024-09-13T22:44:45.776 INFO:teuthology.orchestra.run.smithi002.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2024-09-13T22:44:45.801 INFO:teuthology.orchestra.run.smithi002.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-13T22:44:45.851 INFO:teuthology.orchestra.run.smithi002.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.9 MB/s | 250 kB 00:00 2024-09-13T22:44:45.927 INFO:teuthology.orchestra.run.smithi002.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 5.1 MB 00:00 2024-09-13T22:44:46.096 INFO:teuthology.orchestra.run.smithi002.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 12 MB/s | 4.9 MB 00:00 2024-09-13T22:44:46.319 INFO:teuthology.orchestra.run.smithi002.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-09-13T22:44:46.319 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:44:46.320 INFO:teuthology.orchestra.run.smithi002.stdout:Total 36 MB/s | 38 MB 00:01 2024-09-13T22:44:46.684 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-13T22:44:46.711 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-13T22:44:46.711 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-13T22:44:47.252 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-13T22:44:47.253 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-13T22:44:48.061 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-13T22:44:48.153 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T22:44:48.192 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T22:44:48.296 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T22:44:48.335 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T22:44:48.527 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T22:44:48.567 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T22:44:48.652 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T22:44:49.344 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T22:44:49.467 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T22:44:50.813 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T22:44:51.893 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T22:44:51.924 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-09-13T22:44:54.355 INFO:teuthology.orchestra.run.smithi047.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 805 kB/s | 16 MB 00:20 2024-09-13T22:44:54.355 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:44:54.356 INFO:teuthology.orchestra.run.smithi047.stdout:Total 1.7 MB/s | 38 MB 00:22 2024-09-13T22:44:54.470 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-09-13T22:44:54.470 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 1/12 2024-09-13T22:44:54.470 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T22:44:54.470 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T22:44:54.470 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T22:44:54.470 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T22:44:54.470 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T22:44:54.470 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T22:44:54.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T22:44:54.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T22:44:54.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T22:44:54.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T22:44:54.727 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-13T22:44:54.756 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-13T22:44:54.756 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-13T22:44:54.858 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T22:44:54.859 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:54.859 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-13T22:44:54.859 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarch 2024-09-13T22:44:54.859 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T22:44:54.859 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T22:44:54.859 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T22:44:54.859 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T22:44:54.859 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T22:44:54.859 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T22:44:54.860 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T22:44:54.860 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T22:44:54.860 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T22:44:54.860 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T22:44:54.860 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T22:44:54.860 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:54.860 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:44:55.203 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-rook 2024-09-13T22:44:55.298 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-13T22:44:55.298 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-13T22:44:55.798 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:07 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:44:55.937 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:44:55.938 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:55.939 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-13T22:44:55.939 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:55.939 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-13T22:44:55.939 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:18.2.1-0.el9 ceph-noarch 50 k 2024-09-13T22:44:55.939 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-13T22:44:55.939 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T22:44:55.939 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T22:44:55.939 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T22:44:55.939 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T22:44:55.939 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T22:44:55.939 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T22:44:55.939 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T22:44:55.940 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T22:44:55.940 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T22:44:55.940 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T22:44:55.940 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T22:44:55.940 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T22:44:55.940 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:55.940 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-13T22:44:55.940 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:44:55.940 INFO:teuthology.orchestra.run.smithi002.stdout:Install 13 Packages 2024-09-13T22:44:55.940 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:44:55.941 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 2.2 M 2024-09-13T22:44:55.941 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 26 M 2024-09-13T22:44:55.941 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-13T22:44:56.080 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-13T22:44:56.149 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T22:44:56.187 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T22:44:56.274 INFO:teuthology.orchestra.run.smithi002.stdout:(1/13): ceph-mgr-rook-18.2.1-0.el9.noarch.rpm 1.0 MB/s | 50 kB 00:00 2024-09-13T22:44:56.300 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T22:44:56.338 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T22:44:56.534 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T22:44:56.562 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T22:44:56.642 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T22:44:56.708 INFO:teuthology.orchestra.run.smithi002.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 40 kB/s | 19 kB 00:00 2024-09-13T22:44:56.808 INFO:teuthology.orchestra.run.smithi002.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 44 kB/s | 26 kB 00:00 2024-09-13T22:44:57.150 INFO:teuthology.orchestra.run.smithi002.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 254 kB/s | 222 kB 00:00 2024-09-13T22:44:57.351 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T22:44:57.480 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T22:44:57.600 INFO:teuthology.orchestra.run.smithi002.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 178 kB/s | 159 kB 00:00 2024-09-13T22:44:57.659 INFO:teuthology.orchestra.run.smithi002.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 554 kB/s | 32 kB 00:00 2024-09-13T22:44:57.684 INFO:teuthology.orchestra.run.smithi002.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 567 kB/s | 14 kB 00:00 2024-09-13T22:44:57.710 INFO:teuthology.orchestra.run.smithi002.stdout:(8/13): python3-google-auth-2.34.0-1.el9.noarch 8.7 MB/s | 220 kB 00:00 2024-09-13T22:44:57.777 INFO:teuthology.orchestra.run.smithi002.stdout:(9/13): python3-kubernetes-26.1.0-2.el9.noarch. 15 MB/s | 1.0 MB 00:00 2024-09-13T22:44:57.802 INFO:teuthology.orchestra.run.smithi002.stdout:(10/13): python3-requests-oauthlib-1.3.0-12.el9 82 kB/s | 54 kB 00:00 2024-09-13T22:44:57.827 INFO:teuthology.orchestra.run.smithi002.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-13T22:44:57.869 INFO:teuthology.orchestra.run.smithi002.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.3 MB/s | 90 kB 00:00 2024-09-13T22:44:57.894 INFO:teuthology.orchestra.run.smithi002.stdout:(13/13): python3-pyasn1-modules-0.4.8-6.el9.noa 257 kB/s | 279 kB 00:01 2024-09-13T22:44:57.897 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:44:57.898 INFO:teuthology.orchestra.run.smithi002.stdout:Total 1.1 MB/s | 2.2 MB 00:01 2024-09-13T22:44:57.969 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-13T22:44:57.986 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-13T22:44:57.986 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-13T22:44:58.085 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-13T22:44:58.085 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-13T22:44:58.600 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-13T22:44:58.775 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T22:44:58.829 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T22:44:58.831 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T22:44:58.895 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T22:44:58.939 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T22:44:58.981 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T22:44:59.087 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T22:44:59.205 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T22:44:59.258 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T22:44:59.928 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T22:45:00.017 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T22:45:00.027 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-09-13T22:45:00.063 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T22:45:00.096 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T22:45:00.144 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T22:45:00.174 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-09-13T22:45:00.991 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-09-13T22:45:00.992 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:18.2.1-0.el9.noarch 1/13 2024-09-13T22:45:00.992 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T22:45:00.992 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T22:45:00.992 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T22:45:00.992 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T22:45:00.992 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T22:45:00.992 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T22:45:00.992 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T22:45:00.992 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T22:45:00.992 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T22:45:00.993 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T22:45:00.993 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T22:45:01.466 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T22:45:01.466 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:01.467 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-13T22:45:01.467 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:18.2.1-0.el9.noarch 2024-09-13T22:45:01.467 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T22:45:01.467 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T22:45:01.467 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T22:45:01.467 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T22:45:01.467 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T22:45:01.467 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T22:45:01.467 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T22:45:01.467 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T22:45:01.467 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T22:45:01.467 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T22:45:01.467 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T22:45:01.468 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T22:45:01.468 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:01.468 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:45:01.900 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T22:45:02.314 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-09-13T22:45:02.314 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 1/12 2024-09-13T22:45:02.314 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T22:45:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T22:45:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T22:45:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T22:45:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T22:45:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T22:45:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T22:45:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T22:45:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T22:45:02.315 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T22:45:02.487 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:14 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:45:02.626 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:45:02.627 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:02.627 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-13T22:45:02.627 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:02.627 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-13T22:45:02.627 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:18.2.1-0.el9 ceph-noarch 132 k 2024-09-13T22:45:02.627 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-13T22:45:02.627 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T22:45:02.628 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T22:45:02.628 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T22:45:02.628 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T22:45:02.628 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T22:45:02.628 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:02.628 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-13T22:45:02.628 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:02.628 INFO:teuthology.orchestra.run.smithi002.stdout:Install 6 Packages 2024-09-13T22:45:02.629 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:02.629 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 7.0 M 2024-09-13T22:45:02.629 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 33 M 2024-09-13T22:45:02.629 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-13T22:45:02.783 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T22:45:02.783 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:02.783 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-13T22:45:02.783 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarch 2024-09-13T22:45:02.783 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T22:45:02.783 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T22:45:02.783 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T22:45:02.783 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T22:45:02.784 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T22:45:02.784 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T22:45:02.784 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T22:45:02.784 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T22:45:02.784 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T22:45:02.784 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T22:45:02.784 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T22:45:02.784 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:02.784 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:45:03.150 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-rook 2024-09-13T22:45:03.222 INFO:teuthology.orchestra.run.smithi002.stdout:(1/6): ceph-mgr-cephadm-18.2.1-0.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2024-09-13T22:45:03.280 INFO:teuthology.orchestra.run.smithi002.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-13T22:45:03.305 INFO:teuthology.orchestra.run.smithi002.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-13T22:45:03.331 INFO:teuthology.orchestra.run.smithi002.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-13T22:45:03.364 INFO:teuthology.orchestra.run.smithi002.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-13T22:45:03.473 INFO:teuthology.orchestra.run.smithi002.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-09-13T22:45:03.474 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:45:03.475 INFO:teuthology.orchestra.run.smithi002.stdout:Total 8.3 MB/s | 7.0 MB 00:00 2024-09-13T22:45:03.548 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-13T22:45:03.560 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-13T22:45:03.560 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-13T22:45:03.665 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-13T22:45:03.667 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-13T22:45:03.743 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:29 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:45:03.881 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:45:03.882 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:03.882 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-13T22:45:03.882 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:03.882 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-13T22:45:03.882 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook noarch 2:18.2.1-0.el9 ceph-noarch 50 k 2024-09-13T22:45:03.882 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-13T22:45:03.882 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T22:45:03.882 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T22:45:03.882 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T22:45:03.882 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T22:45:03.883 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T22:45:03.883 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T22:45:03.883 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T22:45:03.883 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T22:45:03.883 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T22:45:03.883 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T22:45:03.883 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T22:45:03.883 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T22:45:03.883 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:03.883 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-13T22:45:03.883 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:03.883 INFO:teuthology.orchestra.run.smithi047.stdout:Install 13 Packages 2024-09-13T22:45:03.883 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:03.884 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 2.2 M 2024-09-13T22:45:03.884 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 26 M 2024-09-13T22:45:03.884 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-13T22:45:03.979 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-13T22:45:04.155 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T22:45:04.204 INFO:teuthology.orchestra.run.smithi047.stdout:(1/13): ceph-mgr-rook-18.2.1-0.el9.noarch.rpm 1.3 MB/s | 50 kB 00:00 2024-09-13T22:45:04.217 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T22:45:04.288 INFO:teuthology.orchestra.run.smithi047.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 160 kB/s | 19 kB 00:00 2024-09-13T22:45:04.313 INFO:teuthology.orchestra.run.smithi047.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 176 kB/s | 26 kB 00:00 2024-09-13T22:45:04.405 INFO:teuthology.orchestra.run.smithi047.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.1 MB/s | 222 kB 00:00 2024-09-13T22:45:04.430 INFO:teuthology.orchestra.run.smithi047.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-13T22:45:04.464 INFO:teuthology.orchestra.run.smithi047.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.8 MB/s | 279 kB 00:00 2024-09-13T22:45:04.489 INFO:teuthology.orchestra.run.smithi047.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 917 kB/s | 54 kB 00:00 2024-09-13T22:45:04.632 INFO:teuthology.orchestra.run.smithi047.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 161 kB/s | 32 kB 00:00 2024-09-13T22:45:04.665 INFO:teuthology.orchestra.run.smithi047.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 71 kB/s | 14 kB 00:00 2024-09-13T22:45:04.698 INFO:teuthology.orchestra.run.smithi047.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.8 MB/s | 59 kB 00:00 2024-09-13T22:45:04.740 INFO:teuthology.orchestra.run.smithi047.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 10 MB/s | 1.0 MB 00:00 2024-09-13T22:45:04.765 INFO:teuthology.orchestra.run.smithi047.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 820 kB/s | 220 kB 00:00 2024-09-13T22:45:04.774 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T22:45:04.791 INFO:teuthology.orchestra.run.smithi047.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 976 kB/s | 90 kB 00:00 2024-09-13T22:45:04.795 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:45:04.795 INFO:teuthology.orchestra.run.smithi047.stdout:Total 2.4 MB/s | 2.2 MB 00:00 2024-09-13T22:45:04.863 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T22:45:04.867 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-13T22:45:04.884 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-13T22:45:04.884 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-13T22:45:04.941 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T22:45:04.978 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-09-13T22:45:04.980 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-13T22:45:04.981 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-13T22:45:05.499 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-13T22:45:05.671 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T22:45:05.727 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T22:45:05.783 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T22:45:05.784 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-09-13T22:45:05.784 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 1/6 2024-09-13T22:45:05.785 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T22:45:05.785 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T22:45:05.785 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T22:45:05.785 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T22:45:05.827 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T22:45:05.869 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T22:45:05.975 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T22:45:06.068 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T22:45:06.068 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:06.069 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-13T22:45:06.069 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 2024-09-13T22:45:06.069 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T22:45:06.069 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T22:45:06.069 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T22:45:06.069 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T22:45:06.069 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T22:45:06.069 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:06.069 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:45:06.094 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T22:45:06.146 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T22:45:06.303 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-fuse 2024-09-13T22:45:06.893 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:18 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:45:06.911 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T22:45:06.959 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T22:45:06.993 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T22:45:07.031 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:45:07.033 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:07.033 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-13T22:45:07.033 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:07.033 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-13T22:45:07.033 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:18.2.1-0.el9 ceph 839 k 2024-09-13T22:45:07.034 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-13T22:45:07.034 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T22:45:07.034 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:07.034 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-13T22:45:07.034 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:07.034 INFO:teuthology.orchestra.run.smithi002.stdout:Install 2 Packages 2024-09-13T22:45:07.035 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:07.035 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 919 k 2024-09-13T22:45:07.035 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 2.7 M 2024-09-13T22:45:07.035 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-13T22:45:07.042 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T22:45:07.071 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-09-13T22:45:07.233 INFO:teuthology.orchestra.run.smithi002.stdout:(1/2): ceph-fuse-18.2.1-0.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-13T22:45:07.274 INFO:teuthology.orchestra.run.smithi002.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 705 kB/s | 80 kB 00:00 2024-09-13T22:45:07.275 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:45:07.275 INFO:teuthology.orchestra.run.smithi002.stdout:Total 3.7 MB/s | 919 kB 00:00 2024-09-13T22:45:07.287 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-13T22:45:07.310 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-13T22:45:07.310 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-13T22:45:07.394 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-13T22:45:07.395 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-13T22:45:07.588 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-13T22:45:07.752 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T22:45:07.818 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-09-13T22:45:07.911 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-09-13T22:45:07.911 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-rook-2:18.2.1-0.el9.noarch 1/13 2024-09-13T22:45:07.911 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T22:45:07.911 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T22:45:07.911 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T22:45:07.911 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T22:45:07.911 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T22:45:07.911 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T22:45:07.911 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T22:45:07.911 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T22:45:07.912 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T22:45:07.912 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T22:45:07.912 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T22:45:08.396 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T22:45:08.396 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:08.396 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-13T22:45:08.396 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook-2:18.2.1-0.el9.noarch 2024-09-13T22:45:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T22:45:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T22:45:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T22:45:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T22:45:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T22:45:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T22:45:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T22:45:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T22:45:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T22:45:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T22:45:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T22:45:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T22:45:08.397 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:08.398 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:45:08.514 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-09-13T22:45:08.514 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:18.2.1-0.el9.x86_64 1/2 2024-09-13T22:45:08.649 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T22:45:08.797 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T22:45:08.797 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:08.797 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-13T22:45:08.797 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:18.2.1-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T22:45:08.797 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:08.797 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:45:09.070 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install librados-devel 2024-09-13T22:45:09.241 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:35 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:45:09.381 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:45:09.382 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:09.382 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-13T22:45:09.382 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:09.382 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-13T22:45:09.382 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm noarch 2:18.2.1-0.el9 ceph-noarch 132 k 2024-09-13T22:45:09.382 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-13T22:45:09.382 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T22:45:09.382 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T22:45:09.382 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T22:45:09.382 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T22:45:09.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T22:45:09.383 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:09.383 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-13T22:45:09.383 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:09.383 INFO:teuthology.orchestra.run.smithi047.stdout:Install 6 Packages 2024-09-13T22:45:09.383 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:09.383 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 7.0 M 2024-09-13T22:45:09.383 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 33 M 2024-09-13T22:45:09.383 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-13T22:45:09.510 INFO:teuthology.orchestra.run.smithi047.stdout:(1/6): ceph-mgr-cephadm-18.2.1-0.el9.noarch.rpm 2.5 MB/s | 132 kB 00:00 2024-09-13T22:45:09.610 INFO:teuthology.orchestra.run.smithi047.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 5.4 MB/s | 548 kB 00:00 2024-09-13T22:45:09.636 INFO:teuthology.orchestra.run.smithi047.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-13T22:45:09.661 INFO:teuthology.orchestra.run.smithi047.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-13T22:45:09.670 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:21 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:45:09.810 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:45:09.811 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:09.811 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-13T22:45:09.811 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:09.811 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-13T22:45:09.811 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:18.2.1-0.el9 ceph 127 k 2024-09-13T22:45:09.811 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:09.811 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-13T22:45:09.811 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:09.811 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-13T22:45:09.811 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:09.812 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 127 k 2024-09-13T22:45:09.812 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 456 k 2024-09-13T22:45:09.812 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-13T22:45:09.863 INFO:teuthology.orchestra.run.smithi002.stdout:librados-devel-18.2.1-0.el9.x86_64.rpm 2.4 MB/s | 127 kB 00:00 2024-09-13T22:45:09.863 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:45:09.864 INFO:teuthology.orchestra.run.smithi002.stdout:Total 2.3 MB/s | 127 kB 00:00 2024-09-13T22:45:09.864 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-13T22:45:09.869 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-13T22:45:09.870 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-13T22:45:09.936 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-13T22:45:09.936 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-13T22:45:10.095 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-13T22:45:10.196 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:10.361 INFO:teuthology.orchestra.run.smithi047.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 275 kB/s | 248 kB 00:00 2024-09-13T22:45:10.575 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:10.847 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:10.847 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:10.847 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-13T22:45:10.847 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:18.2.1-0.el9.x86_64 2024-09-13T22:45:10.847 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:10.847 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:45:11.134 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install libcephfs2 2024-09-13T22:45:11.728 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:23 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:45:11.831 INFO:teuthology.orchestra.run.smithi002.stdout:Package libcephfs2-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-13T22:45:11.877 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:45:11.878 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-13T22:45:11.878 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:45:11.920 INFO:teuthology.orchestra.run.smithi047.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.4 MB/s | 6.0 MB 00:02 2024-09-13T22:45:11.922 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:45:11.923 INFO:teuthology.orchestra.run.smithi047.stdout:Total 2.8 MB/s | 7.0 MB 00:02 2024-09-13T22:45:11.946 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install libcephfs-devel 2024-09-13T22:45:11.999 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-13T22:45:12.012 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-13T22:45:12.012 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-13T22:45:12.118 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-13T22:45:12.118 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-13T22:45:12.432 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-13T22:45:12.535 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:24 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:45:12.621 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T22:45:12.674 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:45:12.675 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:12.675 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-13T22:45:12.675 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:12.676 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-13T22:45:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:18.2.1-0.el9 ceph 31 k 2024-09-13T22:45:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:12.676 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-13T22:45:12.676 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:12.676 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-13T22:45:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:12.676 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 31 k 2024-09-13T22:45:12.676 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 139 k 2024-09-13T22:45:12.676 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-13T22:45:12.681 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T22:45:12.733 INFO:teuthology.orchestra.run.smithi002.stdout:libcephfs-devel-18.2.1-0.el9.x86_64.rpm 549 kB/s | 31 kB 00:00 2024-09-13T22:45:12.733 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:45:12.733 INFO:teuthology.orchestra.run.smithi002.stdout:Total 536 kB/s | 31 kB 00:00 2024-09-13T22:45:12.733 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-13T22:45:12.737 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-13T22:45:12.737 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-13T22:45:12.756 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-13T22:45:12.757 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-13T22:45:12.856 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-13T22:45:12.977 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:13.233 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T22:45:13.327 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T22:45:13.349 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:13.404 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T22:45:13.434 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-09-13T22:45:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:13.566 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-13T22:45:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:18.2.1-0.el9.x86_64 2024-09-13T22:45:13.566 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:13.567 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:45:13.757 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install librados2 2024-09-13T22:45:14.307 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-09-13T22:45:14.308 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 1/6 2024-09-13T22:45:14.308 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T22:45:14.308 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T22:45:14.308 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T22:45:14.308 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T22:45:14.350 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:26 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:45:14.444 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-13T22:45:14.490 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:45:14.491 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-13T22:45:14.491 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:45:14.563 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install librbd1 2024-09-13T22:45:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T22:45:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:14.595 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-13T22:45:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 2024-09-13T22:45:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T22:45:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T22:45:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T22:45:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T22:45:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T22:45:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:14.595 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:45:14.833 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-fuse 2024-09-13T22:45:15.153 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:27 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:45:15.247 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-13T22:45:15.292 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:45:15.293 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-13T22:45:15.293 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:45:15.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-rados 2024-09-13T22:45:15.425 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:41 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:45:15.564 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:45:15.565 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:15.565 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-13T22:45:15.565 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:15.565 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-13T22:45:15.566 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse x86_64 2:18.2.1-0.el9 ceph 839 k 2024-09-13T22:45:15.566 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-13T22:45:15.566 INFO:teuthology.orchestra.run.smithi047.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T22:45:15.566 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:15.566 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-13T22:45:15.566 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:15.566 INFO:teuthology.orchestra.run.smithi047.stdout:Install 2 Packages 2024-09-13T22:45:15.566 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:15.566 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 919 k 2024-09-13T22:45:15.566 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 2.7 M 2024-09-13T22:45:15.566 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-13T22:45:15.888 INFO:teuthology.orchestra.run.smithi047.stdout:(1/2): ceph-fuse-18.2.1-0.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-13T22:45:15.938 INFO:teuthology.orchestra.run.smithi047.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 679 kB/s | 80 kB 00:00 2024-09-13T22:45:15.939 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:45:15.939 INFO:teuthology.orchestra.run.smithi047.stdout:Total 2.4 MB/s | 919 kB 00:00 2024-09-13T22:45:15.952 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-13T22:45:15.954 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:27 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:45:15.975 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-13T22:45:15.975 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-13T22:45:16.048 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-rados-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-13T22:45:16.060 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-13T22:45:16.061 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-13T22:45:16.093 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:45:16.095 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-13T22:45:16.095 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:45:16.274 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-rgw 2024-09-13T22:45:16.374 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-13T22:45:16.507 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T22:45:16.583 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-09-13T22:45:16.862 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:28 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:45:16.956 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-rgw-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-13T22:45:17.001 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:45:17.002 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-13T22:45:17.002 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:45:17.072 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-cephfs 2024-09-13T22:45:17.258 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-09-13T22:45:17.258 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-fuse-2:18.2.1-0.el9.x86_64 1/2 2024-09-13T22:45:17.544 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T22:45:17.544 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:17.544 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-13T22:45:17.544 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-2:18.2.1-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T22:45:17.544 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:17.545 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:45:17.665 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:29 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:45:17.759 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-cephfs-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-13T22:45:17.804 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:45:17.805 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-13T22:45:17.805 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:45:17.822 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install librados-devel 2024-09-13T22:45:17.878 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-rbd 2024-09-13T22:45:18.412 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:44 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:45:18.467 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:30 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:45:18.553 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:45:18.554 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:18.554 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-13T22:45:18.554 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:18.554 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-13T22:45:18.554 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel x86_64 2:18.2.1-0.el9 ceph 127 k 2024-09-13T22:45:18.554 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:18.554 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-13T22:45:18.554 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:18.555 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-13T22:45:18.555 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:18.555 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 127 k 2024-09-13T22:45:18.555 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 456 k 2024-09-13T22:45:18.555 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-13T22:45:18.560 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-rbd-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-13T22:45:18.606 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:45:18.607 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-13T22:45:18.607 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:45:18.610 INFO:teuthology.orchestra.run.smithi047.stdout:librados-devel-18.2.1-0.el9.x86_64.rpm 2.2 MB/s | 127 kB 00:00 2024-09-13T22:45:18.610 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:45:18.611 INFO:teuthology.orchestra.run.smithi047.stdout:Total 2.2 MB/s | 127 kB 00:00 2024-09-13T22:45:18.611 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-13T22:45:18.617 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-13T22:45:18.617 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-13T22:45:18.682 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install rbd-fuse 2024-09-13T22:45:18.683 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-13T22:45:18.683 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-13T22:45:18.838 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-13T22:45:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:19.273 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:31 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:45:19.341 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:19.412 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:45:19.413 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:19.413 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-13T22:45:19.413 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:19.413 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-13T22:45:19.414 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:18.2.1-0.el9 ceph 86 k 2024-09-13T22:45:19.414 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:19.414 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-13T22:45:19.414 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:19.414 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-13T22:45:19.414 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:19.414 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 86 k 2024-09-13T22:45:19.414 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 226 k 2024-09-13T22:45:19.414 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-13T22:45:19.461 INFO:teuthology.orchestra.run.smithi002.stdout:rbd-fuse-18.2.1-0.el9.x86_64.rpm 1.8 MB/s | 86 kB 00:00 2024-09-13T22:45:19.461 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:45:19.462 INFO:teuthology.orchestra.run.smithi002.stdout:Total 1.8 MB/s | 86 kB 00:00 2024-09-13T22:45:19.462 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-13T22:45:19.469 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-13T22:45:19.469 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-13T22:45:19.536 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-13T22:45:19.536 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-13T22:45:19.687 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-13T22:45:19.703 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:19.704 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:19.704 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-13T22:45:19.704 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-2:18.2.1-0.el9.x86_64 2024-09-13T22:45:19.704 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:19.704 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:45:19.794 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:19.937 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install libcephfs2 2024-09-13T22:45:20.241 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:20.486 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:20.486 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:20.487 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-13T22:45:20.487 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:18.2.1-0.el9.x86_64 2024-09-13T22:45:20.487 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:20.487 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:45:20.532 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:46 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:45:20.627 INFO:teuthology.orchestra.run.smithi047.stdout:Package libcephfs2-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-13T22:45:20.673 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:45:20.674 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-13T22:45:20.674 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:45:20.749 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install rbd-mirror 2024-09-13T22:45:20.751 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install libcephfs-devel 2024-09-13T22:45:21.344 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:47 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:45:21.349 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:45:21.483 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:45:21.484 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:21.484 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-13T22:45:21.484 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:21.484 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-13T22:45:21.484 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel x86_64 2:18.2.1-0.el9 ceph 31 k 2024-09-13T22:45:21.485 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:21.485 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-13T22:45:21.485 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:21.485 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-13T22:45:21.485 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:21.485 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 31 k 2024-09-13T22:45:21.485 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 139 k 2024-09-13T22:45:21.485 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-13T22:45:21.490 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:45:21.491 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:21.491 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-13T22:45:21.491 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:21.491 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-13T22:45:21.491 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-09-13T22:45:21.491 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:21.491 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-13T22:45:21.491 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:21.491 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-13T22:45:21.491 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:21.492 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 3.0 M 2024-09-13T22:45:21.492 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 12 M 2024-09-13T22:45:21.492 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-13T22:45:21.531 INFO:teuthology.orchestra.run.smithi047.stdout:libcephfs-devel-18.2.1-0.el9.x86_64.rpm 684 kB/s | 31 kB 00:00 2024-09-13T22:45:21.531 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:45:21.531 INFO:teuthology.orchestra.run.smithi047.stdout:Total 665 kB/s | 31 kB 00:00 2024-09-13T22:45:21.531 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-13T22:45:21.535 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-13T22:45:21.535 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-13T22:45:21.559 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-13T22:45:21.559 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-13T22:45:21.589 INFO:teuthology.orchestra.run.smithi002.stdout:rbd-mirror-18.2.1-0.el9.x86_64.rpm 31 MB/s | 3.0 MB 00:00 2024-09-13T22:45:21.590 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:45:21.590 INFO:teuthology.orchestra.run.smithi002.stdout:Total 30 MB/s | 3.0 MB 00:00 2024-09-13T22:45:21.590 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-13T22:45:21.600 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-13T22:45:21.600 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-13T22:45:21.649 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-13T22:45:21.687 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-13T22:45:21.687 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-13T22:45:21.747 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:22.126 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-13T22:45:22.190 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:22.216 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:22.217 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:45:22.217 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T22:45:22.217 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T22:45:22.217 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T22:45:22.217 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:22.242 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:22.484 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:22.484 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:22.484 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-13T22:45:22.484 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel-2:18.2.1-0.el9.x86_64 2024-09-13T22:45:22.484 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:22.485 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:45:22.672 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install librados2 2024-09-13T22:45:23.298 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:23.299 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:23.299 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-13T22:45:23.299 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:18.2.1-0.el9.x86_64 2024-09-13T22:45:23.299 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:23.299 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:45:23.302 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:49 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:45:23.396 INFO:teuthology.orchestra.run.smithi047.stdout:Package librados2-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-13T22:45:23.441 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:45:23.442 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-13T22:45:23.442 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:45:23.505 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install librbd1 2024-09-13T22:45:23.554 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install rbd-nbd 2024-09-13T22:45:24.095 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:50 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:45:24.151 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:36 ago on Fri 13 Sep 2024 10:43:48 PM UTC. 2024-09-13T22:45:24.188 INFO:teuthology.orchestra.run.smithi047.stdout:Package librbd1-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-13T22:45:24.233 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:45:24.234 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-13T22:45:24.234 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:45:24.290 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-13T22:45:24.291 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:24.291 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-13T22:45:24.291 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:24.291 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-13T22:45:24.291 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:18.2.1-0.el9 ceph 171 k 2024-09-13T22:45:24.291 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:24.292 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-13T22:45:24.292 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-13T22:45:24.292 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-13T22:45:24.292 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:24.292 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 171 k 2024-09-13T22:45:24.292 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 494 k 2024-09-13T22:45:24.292 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-13T22:45:24.300 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-rados 2024-09-13T22:45:24.343 INFO:teuthology.orchestra.run.smithi002.stdout:rbd-nbd-18.2.1-0.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-13T22:45:24.343 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:45:24.344 INFO:teuthology.orchestra.run.smithi002.stdout:Total 3.2 MB/s | 171 kB 00:00 2024-09-13T22:45:24.344 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-13T22:45:24.352 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-13T22:45:24.352 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-13T22:45:24.420 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-13T22:45:24.420 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-13T22:45:24.585 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-13T22:45:24.701 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:24.884 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:50 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:45:24.978 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-rados-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-13T22:45:25.023 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:45:25.024 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-13T22:45:25.024 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:45:25.087 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-rgw 2024-09-13T22:45:25.140 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:25.375 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:25.375 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:25.375 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-13T22:45:25.375 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:18.2.1-0.el9.x86_64 2024-09-13T22:45:25.375 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:45:25.376 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-13T22:45:25.590 DEBUG:teuthology.parallel:result is None 2024-09-13T22:45:25.677 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:51 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:45:25.774 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-rgw-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-13T22:45:25.819 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:45:25.820 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-13T22:45:25.820 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:45:25.887 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-cephfs 2024-09-13T22:45:26.480 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:52 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:45:26.573 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-cephfs-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-13T22:45:26.618 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:45:26.620 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-13T22:45:26.620 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:45:26.689 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-rbd 2024-09-13T22:45:27.280 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:53 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:45:27.374 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-rbd-2:18.2.1-0.el9.x86_64 is already installed. 2024-09-13T22:45:27.419 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:45:27.420 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-13T22:45:27.420 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:45:27.488 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install rbd-fuse 2024-09-13T22:45:28.076 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:54 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:45:28.214 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:45:28.215 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:28.215 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-13T22:45:28.215 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:28.215 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-13T22:45:28.215 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse x86_64 2:18.2.1-0.el9 ceph 86 k 2024-09-13T22:45:28.215 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:28.215 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-13T22:45:28.215 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:28.216 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-13T22:45:28.216 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:28.216 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 86 k 2024-09-13T22:45:28.216 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 226 k 2024-09-13T22:45:28.216 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-13T22:45:28.275 INFO:teuthology.orchestra.run.smithi047.stdout:rbd-fuse-18.2.1-0.el9.x86_64.rpm 1.4 MB/s | 86 kB 00:00 2024-09-13T22:45:28.276 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:45:28.276 INFO:teuthology.orchestra.run.smithi047.stdout:Total 1.4 MB/s | 86 kB 00:00 2024-09-13T22:45:28.276 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-13T22:45:28.283 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-13T22:45:28.283 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-13T22:45:28.349 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-13T22:45:28.349 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-13T22:45:28.497 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-13T22:45:28.600 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:28.966 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:29.292 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:29.292 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:29.292 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-13T22:45:29.292 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-2:18.2.1-0.el9.x86_64 2024-09-13T22:45:29.292 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:29.292 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:45:29.524 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install rbd-mirror 2024-09-13T22:45:30.116 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:56 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:45:30.258 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:45:30.259 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:30.259 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-13T22:45:30.259 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:30.259 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-13T22:45:30.260 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-09-13T22:45:30.260 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:30.260 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-13T22:45:30.260 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:30.260 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-13T22:45:30.260 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:30.260 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 3.0 M 2024-09-13T22:45:30.260 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 12 M 2024-09-13T22:45:30.260 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-13T22:45:30.378 INFO:teuthology.orchestra.run.smithi047.stdout:rbd-mirror-18.2.1-0.el9.x86_64.rpm 25 MB/s | 3.0 MB 00:00 2024-09-13T22:45:30.379 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:45:30.379 INFO:teuthology.orchestra.run.smithi047.stdout:Total 25 MB/s | 3.0 MB 00:00 2024-09-13T22:45:30.379 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-13T22:45:30.390 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-13T22:45:30.390 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-13T22:45:30.475 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-13T22:45:30.475 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-13T22:45:30.914 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-13T22:45:31.063 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:31.095 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:31.095 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T22:45:31.095 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T22:45:31.095 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T22:45:31.095 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T22:45:31.095 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:32.376 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:32.376 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:32.376 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-13T22:45:32.376 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-2:18.2.1-0.el9.x86_64 2024-09-13T22:45:32.376 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:32.376 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:45:32.627 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install rbd-nbd 2024-09-13T22:45:33.223 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:59 ago on Fri 13 Sep 2024 10:43:34 PM UTC. 2024-09-13T22:45:33.361 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-13T22:45:33.362 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:33.362 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-13T22:45:33.362 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:33.362 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-13T22:45:33.362 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd x86_64 2:18.2.1-0.el9 ceph 171 k 2024-09-13T22:45:33.362 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:33.362 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-13T22:45:33.362 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-13T22:45:33.362 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-13T22:45:33.362 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:33.362 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 171 k 2024-09-13T22:45:33.363 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 494 k 2024-09-13T22:45:33.363 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-13T22:45:33.416 INFO:teuthology.orchestra.run.smithi047.stdout:rbd-nbd-18.2.1-0.el9.x86_64.rpm 3.1 MB/s | 171 kB 00:00 2024-09-13T22:45:33.417 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:45:33.417 INFO:teuthology.orchestra.run.smithi047.stdout:Total 3.0 MB/s | 171 kB 00:00 2024-09-13T22:45:33.417 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-13T22:45:33.426 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-13T22:45:33.426 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-13T22:45:33.492 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-13T22:45:33.492 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-13T22:45:33.661 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-13T22:45:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:34.184 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:34.442 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-09-13T22:45:34.442 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:34.442 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-13T22:45:34.442 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-2:18.2.1-0.el9.x86_64 2024-09-13T22:45:34.442 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:45:34.442 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-13T22:45:34.662 DEBUG:teuthology.parallel:result is None 2024-09-13T22:45:34.662 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-13T22:45:34.662 INFO:teuthology.packaging:ref: None 2024-09-13T22:45:34.662 INFO:teuthology.packaging:tag: v18.2.1 2024-09-13T22:45:34.662 INFO:teuthology.packaging:branch: None 2024-09-13T22:45:34.663 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:45:34.663 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-09-13T22:45:34.810 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T22:45:34.836 INFO:teuthology.orchestra.run.smithi002.stdout:18.2.1-0.el9 2024-09-13T22:45:34.837 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-0.el9 2024-09-13T22:45:34.837 INFO:teuthology.task.install:The correct ceph version 18.2.1-0 is installed. 2024-09-13T22:45:34.838 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-13T22:45:34.839 INFO:teuthology.packaging:ref: None 2024-09-13T22:45:34.839 INFO:teuthology.packaging:tag: v18.2.1 2024-09-13T22:45:34.839 INFO:teuthology.packaging:branch: None 2024-09-13T22:45:34.839 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:45:34.839 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-09-13T22:45:34.979 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T22:45:35.003 INFO:teuthology.orchestra.run.smithi047.stdout:18.2.1-0.el9 2024-09-13T22:45:35.003 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-0.el9 2024-09-13T22:45:35.003 INFO:teuthology.task.install:The correct ceph version 18.2.1-0 is installed. 2024-09-13T22:45:35.005 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T22:45:35.005 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-13T22:45:35.005 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T22:45:35.037 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-13T22:45:35.038 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T22:45:35.071 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T22:45:35.071 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-13T22:45:35.071 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T22:45:35.108 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T22:45:35.177 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-13T22:45:35.177 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T22:45:35.204 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T22:45:35.271 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T22:45:35.271 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-13T22:45:35.271 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T22:45:35.300 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T22:45:35.369 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-13T22:45:35.369 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T22:45:35.395 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T22:45:35.466 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T22:45:35.467 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-13T22:45:35.467 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T22:45:35.493 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T22:45:35.558 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-13T22:45:35.559 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T22:45:35.585 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T22:45:35.651 INFO:teuthology.run_tasks:Running task print... 2024-09-13T22:45:35.661 INFO:teuthology.task.print:**** done install task... 2024-09-13T22:45:35.661 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-13T22:45:35.752 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.io/ceph/ceph:v18.2.1', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'} 2024-09-13T22:45:35.752 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v18.2.1 2024-09-13T22:45:35.753 INFO:tasks.cephadm:Cluster fsid is e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T22:45:35.753 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-13T22:45:35.753 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-13T22:45:35.754 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi002': '172.21.15.2', 'mon.smithi047': '172.21.15.47'} 2024-09-13T22:45:35.754 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-13T22:45:35.754 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname $(hostname -s) 2024-09-13T22:45:35.791 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname $(hostname -s) 2024-09-13T22:45:35.817 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-09-13T22:45:35.817 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:45:35.971 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56074/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-324-gecab7be5', 'node_name': '172.21.5.34+adami04', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-324.gecab7be5'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-13 18:01:03.383540', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-13T22:45:36.256 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref reef, sha1 e4e227b37858f5109138494e01e5ba1ba7b8ffe8 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-09-13T22:45:36.258 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/x86_64/flavors/default/cephadm 2024-09-13T22:45:36.258 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/x86_64/flavors/default/cephadm 2024-09-13T22:45:36.258 DEBUG:teuthology.orchestra.run.smithi002:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T22:45:36.582 INFO:teuthology.orchestra.run.smithi002.stdout:-rw-r--r--. 1 ubuntu ubuntu 217223 Sep 13 22:45 /home/ubuntu/cephtest/cephadm 2024-09-13T22:45:36.582 DEBUG:teuthology.orchestra.run.smithi047:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T22:45:36.919 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r--. 1 ubuntu ubuntu 217223 Sep 13 22:45 /home/ubuntu/cephtest/cephadm 2024-09-13T22:45:36.919 DEBUG:teuthology.orchestra.run.smithi002:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T22:45:36.936 DEBUG:teuthology.orchestra.run.smithi047:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T22:45:36.967 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v18.2.1 on all hosts... 2024-09-13T22:45:36.967 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 pull 2024-09-13T22:45:36.979 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 pull 2024-09-13T22:45:38.681 INFO:teuthology.orchestra.run.smithi002.stderr:Pulling container image quay.io/ceph/ceph:v18.2.1... 2024-09-13T22:45:38.716 INFO:teuthology.orchestra.run.smithi047.stderr:Pulling container image quay.io/ceph/ceph:v18.2.1... 2024-09-13T22:45:51.093 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-13T22:45:51.093 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)", 2024-09-13T22:45:51.093 INFO:teuthology.orchestra.run.smithi047.stdout: "image_id": "5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf", 2024-09-13T22:45:51.093 INFO:teuthology.orchestra.run.smithi047.stdout: "repo_digests": [ 2024-09-13T22:45:51.093 INFO:teuthology.orchestra.run.smithi047.stdout: "quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3", 2024-09-13T22:45:51.093 INFO:teuthology.orchestra.run.smithi047.stdout: "quay.io/ceph/ceph@sha256:e8e55db8b4fd270dbec25bc764437a2a3abb707971c4dba5f559fb83018049dc" 2024-09-13T22:45:51.093 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-13T22:45:51.094 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-13T22:45:51.177 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:45:51.177 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)", 2024-09-13T22:45:51.177 INFO:teuthology.orchestra.run.smithi002.stdout: "image_id": "5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf", 2024-09-13T22:45:51.177 INFO:teuthology.orchestra.run.smithi002.stdout: "repo_digests": [ 2024-09-13T22:45:51.177 INFO:teuthology.orchestra.run.smithi002.stdout: "quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3", 2024-09-13T22:45:51.177 INFO:teuthology.orchestra.run.smithi002.stdout: "quay.io/ceph/ceph@sha256:e8e55db8b4fd270dbec25bc764437a2a3abb707971c4dba5f559fb83018049dc" 2024-09-13T22:45:51.177 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-13T22:45:51.177 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:45:51.197 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph 2024-09-13T22:45:51.243 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph 2024-09-13T22:45:51.274 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /etc/ceph 2024-09-13T22:45:51.301 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /etc/ceph 2024-09-13T22:45:51.340 INFO:tasks.cephadm:Writing seed config... 2024-09-13T22:45:51.341 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-13T22:45:51.341 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-13T22:45:51.341 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-13T22:45:51.341 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-13T22:45:51.342 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-13T22:45:51.342 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-13T22:45:51.342 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-13T22:45:51.342 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-13T22:45:51.342 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-13T22:45:51.342 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-13T22:45:51.342 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-13T22:45:51.342 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-13T22:45:51.342 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-13T22:45:51.342 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-13T22:45:51.342 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-13T22:45:51.342 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-13T22:45:51.342 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-13T22:45:51.343 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-13T22:45:51.343 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-13T22:45:51.343 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-13T22:45:51.343 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-13T22:45:51.343 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-13T22:45:51.343 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-13T22:45:51.343 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-13T22:45:51.343 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-13T22:45:51.343 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-13T22:45:51.343 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-13T22:45:51.343 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-13T22:45:51.343 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-13T22:45:51.343 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-13T22:45:51.343 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-13T22:45:51.343 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-13T22:45:51.344 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-13T22:45:51.344 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-13T22:45:51.344 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-13T22:45:51.344 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-13T22:45:51.344 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-13T22:45:51.344 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-13T22:45:51.344 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-13T22:45:51.344 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-13T22:45:51.344 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-13T22:45:51.344 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-13T22:45:51.344 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-13T22:45:51.345 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-13T22:45:51.345 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-13T22:45:51.362 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = e41042f8-7221-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-13T22:45:51.362 DEBUG:teuthology.orchestra.run.smithi002:mon.smithi002> sudo journalctl -f -n 0 -u ceph-e41042f8-7221-11ef-bceb-c7b262605968@mon.smithi002.service 2024-09-13T22:45:51.404 INFO:tasks.cephadm:Bootstrapping... 2024-09-13T22:45:51.405 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 -v bootstrap --fsid e41042f8-7221-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.2 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-13T22:45:51.563 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-13T22:45:51.564 INFO:teuthology.orchestra.run.smithi002.stdout:cephadm ['--image', 'quay.io/ceph/ceph:v18.2.1', '-v', 'bootstrap', '--fsid', 'e41042f8-7221-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.2', '--skip-admin-label'] 2024-09-13T22:45:51.589 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-09-13T22:45:51.589 INFO:teuthology.orchestra.run.smithi002.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-13T22:45:51.589 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying podman|docker is present... 2024-09-13T22:45:51.611 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-09-13T22:45:51.612 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying lvm2 is present... 2024-09-13T22:45:51.612 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying time synchronization is in place... 2024-09-13T22:45:51.620 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T22:45:51.620 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T22:45:51.626 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T22:45:51.626 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-13T22:45:51.633 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-09-13T22:45:51.640 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-09-13T22:45:51.640 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-09-13T22:45:51.640 INFO:teuthology.orchestra.run.smithi002.stdout:Repeating the final host check... 2024-09-13T22:45:51.662 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-09-13T22:45:51.662 INFO:teuthology.orchestra.run.smithi002.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-13T22:45:51.662 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl is present 2024-09-13T22:45:51.662 INFO:teuthology.orchestra.run.smithi002.stdout:lvcreate is present 2024-09-13T22:45:51.668 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T22:45:51.669 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T22:45:51.675 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T22:45:51.675 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-13T22:45:51.682 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-09-13T22:45:51.688 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-09-13T22:45:51.688 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-09-13T22:45:51.688 INFO:teuthology.orchestra.run.smithi002.stdout:Host looks OK 2024-09-13T22:45:51.689 INFO:teuthology.orchestra.run.smithi002.stdout:Cluster fsid: e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T22:45:51.689 INFO:teuthology.orchestra.run.smithi002.stdout:Acquiring lock 140401064807248 on /run/cephadm/e41042f8-7221-11ef-bceb-c7b262605968.lock 2024-09-13T22:45:51.689 INFO:teuthology.orchestra.run.smithi002.stdout:Lock 140401064807248 acquired on /run/cephadm/e41042f8-7221-11ef-bceb-c7b262605968.lock 2024-09-13T22:45:51.689 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 3300 ... 2024-09-13T22:45:51.689 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 6789 ... 2024-09-13T22:45:51.689 INFO:teuthology.orchestra.run.smithi002.stdout:Base mon IP(s) is [172.21.15.2:3300, 172.21.15.2:6789], mon addrv is [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-13T22:45:51.693 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.2 metric 100 2024-09-13T22:45:51.693 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.2 metric 100 2024-09-13T22:45:51.695 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-13T22:45:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-13T22:45:51.696 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1792sec hoplimit 64 pref medium 2024-09-13T22:45:51.698 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-13T22:45:51.698 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-13T22:45:51.699 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T22:45:51.699 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-13T22:45:51.699 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1920/64 scope link 2024-09-13T22:45:51.699 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T22:45:51.699 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-09-13T22:45:51.699 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-09-13T22:45:51.700 INFO:teuthology.orchestra.run.smithi002.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-13T22:45:51.700 INFO:teuthology.orchestra.run.smithi002.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-13T22:45:51.700 INFO:teuthology.orchestra.run.smithi002.stdout:Pulling container image quay.io/ceph/ceph:v18.2.1... 2024-09-13T22:45:52.523 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf 2024-09-13T22:45:52.523 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Trying to pull quay.io/ceph/ceph:v18.2.1... 2024-09-13T22:45:52.523 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Getting image source signatures 2024-09-13T22:45:52.523 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:a733d3c618b71f19c168ebecd1953429dce2c1631835ca182e9551c36dce5989 2024-09-13T22:45:52.523 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:7feca07754707458c3945cf0062cf4dabc512f6d90fe1a9a1370b362b6011124 2024-09-13T22:45:52.523 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying config sha256:5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf 2024-09-13T22:45:52.523 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-13T22:45:53.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph: stdout ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable) 2024-09-13T22:45:53.559 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph version: ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable) 2024-09-13T22:45:53.559 INFO:teuthology.orchestra.run.smithi002.stdout:Extracting ceph user uid/gid from container image... 2024-09-13T22:45:55.479 INFO:teuthology.orchestra.run.smithi002.stdout:stat: stdout 167 167 2024-09-13T22:45:55.479 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial keys... 2024-09-13T22:46:04.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQCmwORmL9F7FhAANJckA/RMtIQ+mVOOCrSc7g== 2024-09-13T22:46:06.397 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQCtwORmIcy2KBAA0DJXhAslP9yPAhXCnmhErw== 2024-09-13T22:46:07.284 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQCuwORmNObwKhAAcIhn/vUM5dfTTCkTx5qtxg== 2024-09-13T22:46:07.284 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial monmap... 2024-09-13T22:46:08.341 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T22:46:08.341 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-13T22:46:08.341 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T22:46:08.341 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T22:46:08.342 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool for smithi002 [v2:172.21.15.2:3300,v1:172.21.15.2:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T22:46:08.342 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = pacific 2024-09-13T22:46:08.342 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: set fsid to e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T22:46:08.342 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T22:46:08.342 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:46:08.342 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mon... 2024-09-13T22:46:09.230 INFO:teuthology.orchestra.run.smithi002.stdout:create mon.smithi002 on 2024-09-13T22:46:09.447 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-13T22:46:09.605 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-13T22:46:09.800 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-e41042f8-7221-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-e41042f8-7221-11ef-bceb-c7b262605968.target. 2024-09-13T22:46:09.800 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-e41042f8-7221-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-e41042f8-7221-11ef-bceb-c7b262605968.target. 2024-09-13T22:46:10.030 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e41042f8-7221-11ef-bceb-c7b262605968@mon.smithi002 2024-09-13T22:46:10.030 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e41042f8-7221-11ef-bceb-c7b262605968@mon.smithi002.service: Unit ceph-e41042f8-7221-11ef-bceb-c7b262605968@mon.smithi002.service not loaded. 2024-09-13T22:46:10.199 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e41042f8-7221-11ef-bceb-c7b262605968.target.wants/ceph-e41042f8-7221-11ef-bceb-c7b262605968@mon.smithi002.service → /etc/systemd/system/ceph-e41042f8-7221-11ef-bceb-c7b262605968@.service. 2024-09-13T22:46:10.697 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:10 smithi002 ceph-mon[27269]: mon.smithi002 is new leader, mons smithi002 in quorum (ranks 0) 2024-09-13T22:46:10.711 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T22:46:10.711 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-13T22:46:10.718 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T22:46:10.718 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-13T22:46:10.719 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-13T22:46:10.719 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T22:46:10.719 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon to start... 2024-09-13T22:46:10.719 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon... 2024-09-13T22:46:11.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:10 smithi002 bash[27250]: 03d0964d70a2a2e934d7c1907fd024bee4c3a7243ec596815f8e4c618dd6aa80 2024-09-13T22:46:11.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:10 smithi002 systemd[1]: Started Ceph mon.smithi002 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T22:46:12.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:11 smithi002 ceph-mon[27269]: mon.smithi002 is new leader, mons smithi002 in quorum (ranks 0) 2024-09-13T22:46:12.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:11 smithi002 ceph-mon[27269]: monmap e1: 1 mons at {smithi002=[v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T22:46:12.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:11 smithi002 ceph-mon[27269]: fsmap 2024-09-13T22:46:12.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:11 smithi002 ceph-mon[27269]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T22:46:12.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:11 smithi002 ceph-mon[27269]: mgrmap e1: no daemons active 2024-09-13T22:46:12.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:11 smithi002 ceph-mon[27269]: from='client.? 172.21.15.2:0/1576643770' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-13T22:46:12.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout cluster: 2024-09-13T22:46:12.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout id: e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T22:46:12.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-13T22:46:12.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-13T22:46:12.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout services: 2024-09-13T22:46:12.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi002 (age 0.790958s) 2024-09-13T22:46:12.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-13T22:46:12.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-13T22:46:12.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-13T22:46:12.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout data: 2024-09-13T22:46:12.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-13T22:46:12.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-13T22:46:12.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-13T22:46:12.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pgs: 2024-09-13T22:46:12.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-13T22:46:12.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.375+0000 7f8cb72fa700 1 Processor -- start 2024-09-13T22:46:12.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.375+0000 7f8cb72fa700 1 -- start start 2024-09-13T22:46:12.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.375+0000 7f8cb72fa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb0107080 0x7f8cb0109470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:12.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.375+0000 7f8cb72fa700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb0079e80 con 0x7f8cb0107080 2024-09-13T22:46:12.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.376+0000 7f8cb5096700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb0107080 0x7f8cb0109470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:12.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.376+0000 7f8cb5096700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb0107080 0x7f8cb0109470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48886/0 (socket says 172.21.15.2:48886) 2024-09-13T22:46:12.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.376+0000 7f8cb5096700 1 -- 172.21.15.2:0/3480875331 learned_addr learned my addr 172.21.15.2:0/3480875331 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:12.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.376+0000 7f8cb5096700 1 -- 172.21.15.2:0/3480875331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb01099b0 con 0x7f8cb0107080 2024-09-13T22:46:12.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.376+0000 7f8cb5096700 1 --2- 172.21.15.2:0/3480875331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb0107080 0x7f8cb0109470 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0098a0 tx=0x7f8cac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea2caa688c31ee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:12.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.376+0000 7f8ca7fff700 1 -- 172.21.15.2:0/3480875331 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cac004180 con 0x7f8cb0107080 2024-09-13T22:46:12.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.376+0000 7f8ca7fff700 1 -- 172.21.15.2:0/3480875331 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac0042e0 con 0x7f8cb0107080 2024-09-13T22:46:12.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.376+0000 7f8ca7fff700 1 -- 172.21.15.2:0/3480875331 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cac0036a0 con 0x7f8cb0107080 2024-09-13T22:46:12.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.377+0000 7f8cb72fa700 1 -- 172.21.15.2:0/3480875331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb0107080 msgr2=0x7f8cb0109470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:12.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.377+0000 7f8cb72fa700 1 --2- 172.21.15.2:0/3480875331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb0107080 0x7f8cb0109470 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0098a0 tx=0x7f8cac009bb0 comp rx=0 tx=0).stop 2024-09-13T22:46:12.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.377+0000 7f8cb72fa700 1 -- 172.21.15.2:0/3480875331 shutdown_connections 2024-09-13T22:46:12.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.377+0000 7f8cb72fa700 1 --2- 172.21.15.2:0/3480875331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb0107080 0x7f8cb0109470 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:12.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.377+0000 7f8cb72fa700 1 -- 172.21.15.2:0/3480875331 >> 172.21.15.2:0/3480875331 conn(0x7f8cb0100ad0 msgr2=0x7f8cb0102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:12.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.377+0000 7f8cb72fa700 1 -- 172.21.15.2:0/3480875331 shutdown_connections 2024-09-13T22:46:12.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.377+0000 7f8cb72fa700 1 -- 172.21.15.2:0/3480875331 wait complete. 2024-09-13T22:46:12.057 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.378+0000 7f8cb72fa700 1 Processor -- start 2024-09-13T22:46:12.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.378+0000 7f8cb72fa700 1 -- start start 2024-09-13T22:46:12.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.378+0000 7f8cb72fa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb0107080 0x7f8cb0199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:12.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.378+0000 7f8cb72fa700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb0199ff0 con 0x7f8cb0107080 2024-09-13T22:46:12.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.378+0000 7f8cb5096700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb0107080 0x7f8cb0199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:12.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.378+0000 7f8cb5096700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb0107080 0x7f8cb0199ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48890/0 (socket says 172.21.15.2:48890) 2024-09-13T22:46:12.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.378+0000 7f8cb5096700 1 -- 172.21.15.2:0/1576643770 learned_addr learned my addr 172.21.15.2:0/1576643770 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:12.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.378+0000 7f8cb5096700 1 -- 172.21.15.2:0/1576643770 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac009550 con 0x7f8cb0107080 2024-09-13T22:46:12.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.378+0000 7f8cb5096700 1 --2- 172.21.15.2:0/1576643770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb0107080 0x7f8cb0199ab0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00792c0 tx=0x7f8cac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:12.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.379+0000 7f8ca67fc700 1 -- 172.21.15.2:0/1576643770 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cac003ce0 con 0x7f8cb0107080 2024-09-13T22:46:12.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.379+0000 7f8ca67fc700 1 -- 172.21.15.2:0/1576643770 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac020070 con 0x7f8cb0107080 2024-09-13T22:46:12.058 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.379+0000 7f8cb72fa700 1 -- 172.21.15.2:0/1576643770 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb019a1f0 con 0x7f8cb0107080 2024-09-13T22:46:12.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.379+0000 7f8ca67fc700 1 -- 172.21.15.2:0/1576643770 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8cac011630 con 0x7f8cb0107080 2024-09-13T22:46:12.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.379+0000 7f8cb72fa700 1 -- 172.21.15.2:0/1576643770 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb019a610 con 0x7f8cb0107080 2024-09-13T22:46:12.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.379+0000 7f8ca67fc700 1 -- 172.21.15.2:0/1576643770 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8cac022030 con 0x7f8cb0107080 2024-09-13T22:46:12.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.379+0000 7f8ca67fc700 1 -- 172.21.15.2:0/1576643770 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8cac025d00 con 0x7f8cb0107080 2024-09-13T22:46:12.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.380+0000 7f8cb72fa700 1 -- 172.21.15.2:0/1576643770 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb01938d0 con 0x7f8cb0107080 2024-09-13T22:46:12.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.382+0000 7f8ca67fc700 1 -- 172.21.15.2:0/1576643770 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f8cac025480 con 0x7f8cb0107080 2024-09-13T22:46:12.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.454+0000 7f8cb72fa700 1 -- 172.21.15.2:0/1576643770 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f8cb002cc70 con 0x7f8cb0107080 2024-09-13T22:46:12.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.455+0000 7f8ca67fc700 1 -- 172.21.15.2:0/1576643770 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f8cac011c20 con 0x7f8cb0107080 2024-09-13T22:46:12.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.455+0000 7f8cb72fa700 1 -- 172.21.15.2:0/1576643770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb0107080 msgr2=0x7f8cb0199ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:12.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.455+0000 7f8cb72fa700 1 --2- 172.21.15.2:0/1576643770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb0107080 0x7f8cb0199ab0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00792c0 tx=0x7f8cac004750 comp rx=0 tx=0).stop 2024-09-13T22:46:12.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.455+0000 7f8cb72fa700 1 -- 172.21.15.2:0/1576643770 shutdown_connections 2024-09-13T22:46:12.059 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.455+0000 7f8cb72fa700 1 --2- 172.21.15.2:0/1576643770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cb0107080 0x7f8cb0199ab0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:12.060 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.455+0000 7f8cb72fa700 1 -- 172.21.15.2:0/1576643770 >> 172.21.15.2:0/1576643770 conn(0x7f8cb0100ad0 msgr2=0x7f8cb0102470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:12.060 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.455+0000 7f8cb72fa700 1 -- 172.21.15.2:0/1576643770 shutdown_connections 2024-09-13T22:46:12.060 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:11.455+0000 7f8cb72fa700 1 -- 172.21.15.2:0/1576643770 wait complete. 2024-09-13T22:46:12.060 INFO:teuthology.orchestra.run.smithi002.stdout:mon is available 2024-09-13T22:46:12.060 INFO:teuthology.orchestra.run.smithi002.stdout:Assimilating anything we can from ceph.conf... 2024-09-13T22:46:12.926 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:12 smithi002 ceph-mon[27269]: from='client.? 172.21.15.2:0/418329815' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T22:46:12.926 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:12 smithi002 ceph-mon[27269]: from='client.? 172.21.15.2:0/418329815' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-13T22:46:13.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-13T22:46:13.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T22:46:13.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T22:46:13.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-13T22:46:13.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T22:46:13.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T22:46:13.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T22:46:13.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T22:46:13.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-13T22:46:13.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T22:46:13.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T22:46:13.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-13T22:46:13.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T22:46:13.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T22:46:13.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T22:46:13.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T22:46:13.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T22:46:13.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T22:46:13.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.462+0000 7f655d33a700 1 Processor -- start 2024-09-13T22:46:13.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.462+0000 7f655d33a700 1 -- start start 2024-09-13T22:46:13.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.462+0000 7f655d33a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65581065d0 0x7f65581069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:13.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.462+0000 7f655d33a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6558106fc0 con 0x7f65581065d0 2024-09-13T22:46:13.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.462+0000 7f6556ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65581065d0 0x7f65581069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:13.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.462+0000 7f6556ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65581065d0 0x7f65581069f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48894/0 (socket says 172.21.15.2:48894) 2024-09-13T22:46:13.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.462+0000 7f6556ffd700 1 -- 172.21.15.2:0/2218276885 learned_addr learned my addr 172.21.15.2:0/2218276885 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:13.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.462+0000 7f6556ffd700 1 -- 172.21.15.2:0/2218276885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65581077d0 con 0x7f65581065d0 2024-09-13T22:46:13.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.462+0000 7f6556ffd700 1 --2- 172.21.15.2:0/2218276885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65581065d0 0x7f65581069f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6548009e80 tx=0x7f654800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c18d315d333b205 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:13.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.463+0000 7f6555ffb700 1 -- 172.21.15.2:0/2218276885 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f654800e070 con 0x7f65581065d0 2024-09-13T22:46:13.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.463+0000 7f6555ffb700 1 -- 172.21.15.2:0/2218276885 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6548003a20 con 0x7f65581065d0 2024-09-13T22:46:13.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.463+0000 7f6555ffb700 1 -- 172.21.15.2:0/2218276885 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6548003bd0 con 0x7f65581065d0 2024-09-13T22:46:13.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.463+0000 7f655d33a700 1 -- 172.21.15.2:0/2218276885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65581065d0 msgr2=0x7f65581069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:13.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.463+0000 7f655d33a700 1 --2- 172.21.15.2:0/2218276885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65581065d0 0x7f65581069f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6548009e80 tx=0x7f654800b330 comp rx=0 tx=0).stop 2024-09-13T22:46:13.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.463+0000 7f655d33a700 1 -- 172.21.15.2:0/2218276885 shutdown_connections 2024-09-13T22:46:13.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.463+0000 7f655d33a700 1 --2- 172.21.15.2:0/2218276885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65581065d0 0x7f65581069f0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:13.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.463+0000 7f655d33a700 1 -- 172.21.15.2:0/2218276885 >> 172.21.15.2:0/2218276885 conn(0x7f6558101bd0 msgr2=0x7f6558103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:13.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.463+0000 7f655d33a700 1 -- 172.21.15.2:0/2218276885 shutdown_connections 2024-09-13T22:46:13.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.463+0000 7f655d33a700 1 -- 172.21.15.2:0/2218276885 wait complete. 2024-09-13T22:46:13.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.464+0000 7f655d33a700 1 Processor -- start 2024-09-13T22:46:13.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.464+0000 7f655d33a700 1 -- start start 2024-09-13T22:46:13.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.464+0000 7f655d33a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65581065d0 0x7f655819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:13.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.464+0000 7f655d33a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655819c280 con 0x7f65581065d0 2024-09-13T22:46:13.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.464+0000 7f6556ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65581065d0 0x7f655819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:13.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.464+0000 7f6556ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65581065d0 0x7f655819bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48906/0 (socket says 172.21.15.2:48906) 2024-09-13T22:46:13.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.464+0000 7f6556ffd700 1 -- 172.21.15.2:0/418329815 learned_addr learned my addr 172.21.15.2:0/418329815 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:13.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.465+0000 7f6556ffd700 1 -- 172.21.15.2:0/418329815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6548009b30 con 0x7f65581065d0 2024-09-13T22:46:13.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.465+0000 7f6556ffd700 1 --2- 172.21.15.2:0/418329815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65581065d0 0x7f655819bd40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6548004000 tx=0x7f6548004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:13.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.465+0000 7f654ffff700 1 -- 172.21.15.2:0/418329815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6548004240 con 0x7f65581065d0 2024-09-13T22:46:13.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.465+0000 7f654ffff700 1 -- 172.21.15.2:0/418329815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65480043e0 con 0x7f65581065d0 2024-09-13T22:46:13.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.465+0000 7f654ffff700 1 -- 172.21.15.2:0/418329815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65480046e0 con 0x7f65581065d0 2024-09-13T22:46:13.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.465+0000 7f655d33a700 1 -- 172.21.15.2:0/418329815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655819c480 con 0x7f65581065d0 2024-09-13T22:46:13.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.465+0000 7f655d33a700 1 -- 172.21.15.2:0/418329815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655819c8a0 con 0x7f65581065d0 2024-09-13T22:46:13.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.465+0000 7f654ffff700 1 -- 172.21.15.2:0/418329815 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6548019050 con 0x7f65581065d0 2024-09-13T22:46:13.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.465+0000 7f654ffff700 1 -- 172.21.15.2:0/418329815 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6548025790 con 0x7f65581065d0 2024-09-13T22:46:13.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.466+0000 7f655d33a700 1 -- 172.21.15.2:0/418329815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6558107b40 con 0x7f65581065d0 2024-09-13T22:46:13.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.468+0000 7f654ffff700 1 -- 172.21.15.2:0/418329815 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f654802a060 con 0x7f65581065d0 2024-09-13T22:46:13.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.538+0000 7f655d33a700 1 -- 172.21.15.2:0/418329815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f6558107d00 con 0x7f65581065d0 2024-09-13T22:46:13.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.541+0000 7f654ffff700 1 -- 172.21.15.2:0/418329815 <== mon.0 v2:172.21.15.2:3300/0 7 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6548012d30 con 0x7f65581065d0 2024-09-13T22:46:13.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.541+0000 7f654ffff700 1 -- 172.21.15.2:0/418329815 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+427 (secure 0 0 0) 0x7f6548020030 con 0x7f65581065d0 2024-09-13T22:46:13.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.542+0000 7f655d33a700 1 -- 172.21.15.2:0/418329815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65581065d0 msgr2=0x7f655819bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:13.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.542+0000 7f655d33a700 1 --2- 172.21.15.2:0/418329815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65581065d0 0x7f655819bd40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6548004000 tx=0x7f6548004ad0 comp rx=0 tx=0).stop 2024-09-13T22:46:13.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.542+0000 7f655d33a700 1 -- 172.21.15.2:0/418329815 shutdown_connections 2024-09-13T22:46:13.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.542+0000 7f655d33a700 1 --2- 172.21.15.2:0/418329815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65581065d0 0x7f655819bd40 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:13.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.542+0000 7f655d33a700 1 -- 172.21.15.2:0/418329815 >> 172.21.15.2:0/418329815 conn(0x7f6558101bd0 msgr2=0x7f655807a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:13.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.542+0000 7f655d33a700 1 -- 172.21.15.2:0/418329815 shutdown_connections 2024-09-13T22:46:13.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:12.542+0000 7f655d33a700 1 -- 172.21.15.2:0/418329815 wait complete. 2024-09-13T22:46:13.191 INFO:teuthology.orchestra.run.smithi002.stdout:Generating new minimal ceph.conf... 2024-09-13T22:46:13.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:13 smithi002 ceph-mon[27269]: from='client.? 172.21.15.2:0/974704807' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:46:14.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.568+0000 7f402df34700 1 Processor -- start 2024-09-13T22:46:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.568+0000 7f402df34700 1 -- start start 2024-09-13T22:46:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.568+0000 7f402df34700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4028107040 0x7f4028109430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.568+0000 7f402df34700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4028079ec0 con 0x7f4028107040 2024-09-13T22:46:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.569+0000 7f40277fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4028107040 0x7f4028109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.569+0000 7f40277fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4028107040 0x7f4028109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48914/0 (socket says 172.21.15.2:48914) 2024-09-13T22:46:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.569+0000 7f40277fe700 1 -- 172.21.15.2:0/2933710664 learned_addr learned my addr 172.21.15.2:0/2933710664 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.569+0000 7f40277fe700 1 -- 172.21.15.2:0/2933710664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4028109970 con 0x7f4028107040 2024-09-13T22:46:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.569+0000 7f40277fe700 1 --2- 172.21.15.2:0/2933710664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4028107040 0x7f4028109430 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4018009e80 tx=0x7f401800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f19b3c7e46e13d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.569+0000 7f40267fc700 1 -- 172.21.15.2:0/2933710664 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f401800e070 con 0x7f4028107040 2024-09-13T22:46:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.569+0000 7f40267fc700 1 -- 172.21.15.2:0/2933710664 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4018003e90 con 0x7f4028107040 2024-09-13T22:46:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.569+0000 7f40267fc700 1 -- 172.21.15.2:0/2933710664 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4018004380 con 0x7f4028107040 2024-09-13T22:46:14.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.570+0000 7f402df34700 1 -- 172.21.15.2:0/2933710664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4028107040 msgr2=0x7f4028109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:14.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.570+0000 7f402df34700 1 --2- 172.21.15.2:0/2933710664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4028107040 0x7f4028109430 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4018009e80 tx=0x7f401800b330 comp rx=0 tx=0).stop 2024-09-13T22:46:14.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.570+0000 7f402df34700 1 -- 172.21.15.2:0/2933710664 shutdown_connections 2024-09-13T22:46:14.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.570+0000 7f402df34700 1 --2- 172.21.15.2:0/2933710664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4028107040 0x7f4028109430 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:14.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.570+0000 7f402df34700 1 -- 172.21.15.2:0/2933710664 >> 172.21.15.2:0/2933710664 conn(0x7f4028100ad0 msgr2=0x7f4028102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:14.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.570+0000 7f402df34700 1 -- 172.21.15.2:0/2933710664 shutdown_connections 2024-09-13T22:46:14.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.570+0000 7f402df34700 1 -- 172.21.15.2:0/2933710664 wait complete. 2024-09-13T22:46:14.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.571+0000 7f402df34700 1 Processor -- start 2024-09-13T22:46:14.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.571+0000 7f402df34700 1 -- start start 2024-09-13T22:46:14.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.571+0000 7f402df34700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4028107040 0x7f402819c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:14.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.571+0000 7f402df34700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402819c970 con 0x7f4028107040 2024-09-13T22:46:14.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.571+0000 7f40277fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4028107040 0x7f402819c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:14.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.571+0000 7f40277fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4028107040 0x7f402819c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48922/0 (socket says 172.21.15.2:48922) 2024-09-13T22:46:14.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.571+0000 7f40277fe700 1 -- 172.21.15.2:0/974704807 learned_addr learned my addr 172.21.15.2:0/974704807 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:14.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.571+0000 7f40277fe700 1 -- 172.21.15.2:0/974704807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4018009b30 con 0x7f4028107040 2024-09-13T22:46:14.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.571+0000 7f40277fe700 1 --2- 172.21.15.2:0/974704807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4028107040 0x7f402819c430 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f401800b7b0 tx=0x7f4018004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:14.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.572+0000 7f4024ff9700 1 -- 172.21.15.2:0/974704807 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f401800e040 con 0x7f4028107040 2024-09-13T22:46:14.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.572+0000 7f402df34700 1 -- 172.21.15.2:0/974704807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402819cb70 con 0x7f4028107040 2024-09-13T22:46:14.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.572+0000 7f4024ff9700 1 -- 172.21.15.2:0/974704807 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4018003c70 con 0x7f4028107040 2024-09-13T22:46:14.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.572+0000 7f402df34700 1 -- 172.21.15.2:0/974704807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402819cff0 con 0x7f4028107040 2024-09-13T22:46:14.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.572+0000 7f4024ff9700 1 -- 172.21.15.2:0/974704807 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f401801b760 con 0x7f4028107040 2024-09-13T22:46:14.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.572+0000 7f4024ff9700 1 -- 172.21.15.2:0/974704807 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4018019040 con 0x7f4028107040 2024-09-13T22:46:14.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.572+0000 7f4024ff9700 1 -- 172.21.15.2:0/974704807 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f401801a6d0 con 0x7f4028107040 2024-09-13T22:46:14.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.573+0000 7f402df34700 1 -- 172.21.15.2:0/974704807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4028062430 con 0x7f4028107040 2024-09-13T22:46:14.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.575+0000 7f4024ff9700 1 -- 172.21.15.2:0/974704807 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f4028062430 con 0x7f4028107040 2024-09-13T22:46:14.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.645+0000 7f402df34700 1 -- 172.21.15.2:0/974704807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f402819f9d0 con 0x7f4028107040 2024-09-13T22:46:14.193 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.645+0000 7f4024ff9700 1 -- 172.21.15.2:0/974704807 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+173 (secure 0 0 0) 0x7f4018029060 con 0x7f4028107040 2024-09-13T22:46:14.193 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.646+0000 7f402df34700 1 -- 172.21.15.2:0/974704807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4028107040 msgr2=0x7f402819c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:14.193 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.646+0000 7f402df34700 1 --2- 172.21.15.2:0/974704807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4028107040 0x7f402819c430 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f401800b7b0 tx=0x7f4018004430 comp rx=0 tx=0).stop 2024-09-13T22:46:14.193 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.646+0000 7f402df34700 1 -- 172.21.15.2:0/974704807 shutdown_connections 2024-09-13T22:46:14.193 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.646+0000 7f402df34700 1 --2- 172.21.15.2:0/974704807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4028107040 0x7f402819c430 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:14.193 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.646+0000 7f402df34700 1 -- 172.21.15.2:0/974704807 >> 172.21.15.2:0/974704807 conn(0x7f4028100ad0 msgr2=0x7f4028101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:14.193 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.647+0000 7f402df34700 1 -- 172.21.15.2:0/974704807 shutdown_connections 2024-09-13T22:46:14.193 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:13.647+0000 7f402df34700 1 -- 172.21.15.2:0/974704807 wait complete. 2024-09-13T22:46:14.193 INFO:teuthology.orchestra.run.smithi002.stdout:Restarting the monitor... 2024-09-13T22:46:14.462 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:14 smithi002 systemd[1]: Stopping Ceph mon.smithi002 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T22:46:14.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:14 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002[27265]: 2024-09-13T22:46:14.460+0000 7f7162b11700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi002 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:46:14.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:14 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002[27265]: 2024-09-13T22:46:14.460+0000 7f7162b11700 -1 mon.smithi002@0(leader) e1 *** Got Signal Terminated *** 2024-09-13T22:46:14.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:14 smithi002 podman[27513]: 2024-09-13 22:46:14.614188638 +0000 UTC m=+0.262494884 container died 03d0964d70a2a2e934d7c1907fd024bee4c3a7243ec596815f8e4c618dd6aa80 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002, RELEASE=HEAD, ceph=True, CEPH_POINT_RELEASE=-18.2.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-13T22:46:15.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:14 smithi002 podman[27513]: 2024-09-13 22:46:14.976871277 +0000 UTC m=+0.625177521 container cleanup 03d0964d70a2a2e934d7c1907fd024bee4c3a7243ec596815f8e4c618dd6aa80 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD) 2024-09-13T22:46:15.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:14 smithi002 bash[27513]: ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002 2024-09-13T22:46:15.487 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 podman[27525]: 2024-09-13 22:46:15.236007445 +0000 UTC m=+0.614842895 container remove 03d0964d70a2a2e934d7c1907fd024bee4c3a7243ec596815f8e4c618dd6aa80 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.29.1) 2024-09-13T22:46:15.487 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 systemd[1]: ceph-e41042f8-7221-11ef-bceb-c7b262605968@mon.smithi002.service: Deactivated successfully. 2024-09-13T22:46:15.487 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 systemd[1]: Stopped Ceph mon.smithi002 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T22:46:15.487 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 systemd[1]: Starting Ceph mon.smithi002 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T22:46:15.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 podman[27618]: 2024-09-13 22:46:15.507628312 +0000 UTC m=+0.016134467 image pull 5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf quay.io/ceph/ceph:v18.2.1 2024-09-13T22:46:15.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 podman[27618]: 2024-09-13 22:46:15.611947337 +0000 UTC m=+0.120453473 container create de11be74385db02f075a56ef2443b4c331430dd8abf1279c6753b4a22746eefa (image=quay.io/ceph/ceph:v18.2.1, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002, RELEASE=HEAD, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.1, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240222, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-13T22:46:15.877 INFO:teuthology.orchestra.run.smithi002.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-13T22:46:16.142 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 podman[27618]: 2024-09-13 22:46:15.797540619 +0000 UTC m=+0.306046766 container init de11be74385db02f075a56ef2443b4c331430dd8abf1279c6753b4a22746eefa (image=quay.io/ceph/ceph:v18.2.1, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.1, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20240222) 2024-09-13T22:46:16.143 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 podman[27618]: 2024-09-13 22:46:15.800694914 +0000 UTC m=+0.309201059 container start de11be74385db02f075a56ef2443b4c331430dd8abf1279c6753b4a22746eefa (image=quay.io/ceph/ceph:v18.2.1, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=-18.2.1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.29.1) 2024-09-13T22:46:16.143 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T22:46:16.143 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable), process ceph-mon, pid 2 2024-09-13T22:46:16.143 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: pidfile_write: ignore empty --pid-file 2024-09-13T22:46:16.143 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: load: jerasure load: lrc 2024-09-13T22:46:16.143 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: RocksDB version: 7.9.2 2024-09-13T22:46:16.143 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Git sha 0 2024-09-13T22:46:16.143 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Compile date 2023-12-11 22:07:34 2024-09-13T22:46:16.143 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: DB SUMMARY 2024-09-13T22:46:16.143 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: DB Session ID: 88MRJOKCGBE7P309UN0E 2024-09-13T22:46:16.143 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: CURRENT file: CURRENT 2024-09-13T22:46:16.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T22:46:16.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-13T22:46:16.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi002/store.db dir, Total Num: 1, files: 000008.sst 2024-09-13T22:46:16.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi002/store.db: 000009.log size: 98823 ; 2024-09-13T22:46:16.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.error_if_exists: 0 2024-09-13T22:46:16.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.create_if_missing: 0 2024-09-13T22:46:16.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.paranoid_checks: 1 2024-09-13T22:46:16.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T22:46:16.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T22:46:16.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T22:46:16.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.env: 0x56005afd5720 2024-09-13T22:46:16.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T22:46:16.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.info_log: 0x56005d7cf2e0 2024-09-13T22:46:16.145 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T22:46:16.145 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.statistics: (nil) 2024-09-13T22:46:16.145 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.use_fsync: 0 2024-09-13T22:46:16.146 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_log_file_size: 0 2024-09-13T22:46:16.146 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T22:46:16.146 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T22:46:16.146 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T22:46:16.146 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T22:46:16.146 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.allow_fallocate: 1 2024-09-13T22:46:16.146 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T22:46:16.146 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T22:46:16.147 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.use_direct_reads: 0 2024-09-13T22:46:16.147 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T22:46:16.147 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T22:46:16.147 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.db_log_dir: 2024-09-13T22:46:16.147 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.wal_dir: 2024-09-13T22:46:16.147 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T22:46:16.147 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T22:46:16.147 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T22:46:16.147 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T22:46:16.147 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T22:46:16.147 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T22:46:16.147 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T22:46:16.147 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T22:46:16.148 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.write_buffer_manager: 0x56005ca5e320 2024-09-13T22:46:16.148 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T22:46:16.148 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T22:46:16.148 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T22:46:16.148 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T22:46:16.148 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T22:46:16.148 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T22:46:16.148 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T22:46:16.148 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T22:46:16.148 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.unordered_write: 0 2024-09-13T22:46:16.148 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T22:46:16.148 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T22:46:16.148 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T22:46:16.149 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T22:46:16.149 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.row_cache: None 2024-09-13T22:46:16.149 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.wal_filter: None 2024-09-13T22:46:16.149 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T22:46:16.149 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T22:46:16.149 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.two_write_queues: 0 2024-09-13T22:46:16.149 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T22:46:16.149 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.wal_compression: 0 2024-09-13T22:46:16.149 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.atomic_flush: 0 2024-09-13T22:46:16.149 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T22:46:16.149 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T22:46:16.149 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T22:46:16.149 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.log_readahead_size: 0 2024-09-13T22:46:16.149 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T22:46:16.150 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T22:46:16.150 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T22:46:16.150 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T22:46:16.150 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T22:46:16.150 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T22:46:16.150 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T22:46:16.150 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_background_jobs: 2 2024-09-13T22:46:16.150 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_background_compactions: -1 2024-09-13T22:46:16.150 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_subcompactions: 1 2024-09-13T22:46:16.150 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T22:46:16.150 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T22:46:16.150 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T22:46:16.150 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T22:46:16.150 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T22:46:16.151 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T22:46:16.151 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T22:46:16.151 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T22:46:16.151 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_open_files: -1 2024-09-13T22:46:16.151 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T22:46:16.151 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T22:46:16.151 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T22:46:16.151 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T22:46:16.151 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_background_flushes: -1 2024-09-13T22:46:16.151 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Compression algorithms supported: 2024-09-13T22:46:16.151 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T22:46:16.151 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: kZSTD supported: 0 2024-09-13T22:46:16.151 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: kXpressCompression supported: 0 2024-09-13T22:46:16.151 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T22:46:16.152 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: kZlibCompression supported: 1 2024-09-13T22:46:16.152 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: kSnappyCompression supported: 1 2024-09-13T22:46:16.152 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: kLZ4Compression supported: 1 2024-09-13T22:46:16.152 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: kBZip2Compression supported: 0 2024-09-13T22:46:16.152 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T22:46:16.152 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T22:46:16.152 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi002/store.db/MANIFEST-000010 2024-09-13T22:46:16.152 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T22:46:16.152 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T22:46:16.152 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.merge_operator: 2024-09-13T22:46:16.152 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compaction_filter: None 2024-09-13T22:46:16.152 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T22:46:16.152 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T22:46:16.152 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T22:46:16.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T22:46:16.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56005d7cf3e0) 2024-09-13T22:46:16.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: cache_index_and_filter_blocks: 1 2024-09-13T22:46:16.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T22:46:16.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T22:46:16.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: pin_top_level_index_and_filter: 1 2024-09-13T22:46:16.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: index_type: 0 2024-09-13T22:46:16.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: data_block_index_type: 0 2024-09-13T22:46:16.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: index_shortening: 1 2024-09-13T22:46:16.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T22:46:16.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: checksum: 4 2024-09-13T22:46:16.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: no_block_cache: 0 2024-09-13T22:46:16.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache: 0x56005cae11f0 2024-09-13T22:46:16.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache_name: BinnedLRUCache 2024-09-13T22:46:16.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache_options: 2024-09-13T22:46:16.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: capacity : 536870912 2024-09-13T22:46:16.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: num_shard_bits : 4 2024-09-13T22:46:16.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: strict_capacity_limit : 0 2024-09-13T22:46:16.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: high_pri_pool_ratio: 0.000 2024-09-13T22:46:16.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache_compressed: (nil) 2024-09-13T22:46:16.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: persistent_cache: (nil) 2024-09-13T22:46:16.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_size: 4096 2024-09-13T22:46:16.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_size_deviation: 10 2024-09-13T22:46:16.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_restart_interval: 16 2024-09-13T22:46:16.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: index_block_restart_interval: 1 2024-09-13T22:46:16.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: metadata_block_size: 4096 2024-09-13T22:46:16.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: partition_filters: 0 2024-09-13T22:46:16.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: use_delta_encoding: 1 2024-09-13T22:46:16.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: filter_policy: bloomfilter 2024-09-13T22:46:16.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: whole_key_filtering: 1 2024-09-13T22:46:16.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: verify_compression: 0 2024-09-13T22:46:16.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: read_amp_bytes_per_bit: 0 2024-09-13T22:46:16.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: format_version: 5 2024-09-13T22:46:16.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: enable_index_compression: 1 2024-09-13T22:46:16.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_align: 0 2024-09-13T22:46:16.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: max_auto_readahead_size: 262144 2024-09-13T22:46:16.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: prepopulate_block_cache: 0 2024-09-13T22:46:16.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: initial_auto_readahead_size: 8192 2024-09-13T22:46:16.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T22:46:16.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T22:46:16.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T22:46:16.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compression: NoCompression 2024-09-13T22:46:16.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T22:46:16.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T22:46:16.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T22:46:16.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.num_levels: 7 2024-09-13T22:46:16.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T22:46:16.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T22:46:16.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T22:46:16.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T22:46:16.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T22:46:16.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T22:46:16.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T22:46:16.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:46:16.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T22:46:16.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T22:46:16.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T22:46:16.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T22:46:16.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T22:46:16.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T22:46:16.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T22:46:16.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T22:46:16.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:46:16.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T22:46:16.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T22:46:16.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T22:46:16.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T22:46:16.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T22:46:16.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T22:46:16.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T22:46:16.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T22:46:16.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T22:46:16.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T22:46:16.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T22:46:16.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T22:46:16.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T22:46:16.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T22:46:16.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T22:46:16.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T22:46:16.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T22:46:16.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T22:46:16.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T22:46:16.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T22:46:16.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T22:46:16.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T22:46:16.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T22:46:16.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T22:46:16.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T22:46:16.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T22:46:16.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T22:46:16.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T22:46:16.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T22:46:16.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T22:46:16.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T22:46:16.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T22:46:16.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T22:46:16.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T22:46:16.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T22:46:16.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T22:46:16.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.table_properties_collectors: 2024-09-13T22:46:16.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.inplace_update_support: 0 2024-09-13T22:46:16.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T22:46:16.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T22:46:16.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T22:46:16.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T22:46:16.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.bloom_locality: 0 2024-09-13T22:46:16.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.max_successive_merges: 0 2024-09-13T22:46:16.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T22:46:16.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T22:46:16.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T22:46:16.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T22:46:16.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.ttl: 2592000 2024-09-13T22:46:16.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T22:46:16.161 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T22:46:16.161 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T22:46:16.161 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.enable_blob_files: false 2024-09-13T22:46:16.161 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.min_blob_size: 0 2024-09-13T22:46:16.161 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T22:46:16.161 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T22:46:16.161 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T22:46:16.161 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T22:46:16.161 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T22:46:16.161 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T22:46:16.161 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T22:46:16.161 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T22:46:16.161 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi002/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-13T22:46:16.161 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-13T22:46:16.162 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8cbae438-a7e6-48c3-b229-6db650471b0b 2024-09-13T22:46:16.162 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726267575830536, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-13T22:46:16.162 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-13T22:46:16.162 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726267575831683, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94069, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 316, "table_properties": {"data_size": 92075, "index_size": 276, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13701, "raw_average_key_size": 49, "raw_value_size": 84583, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 275, "num_filter_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726267575, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8cbae438-a7e6-48c3-b229-6db650471b0b", "db_session_id": "88MRJOKCGBE7P309UN0E", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-13T22:46:16.162 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726267575831767, "job": 1, "event": "recovery_finished"} 2024-09-13T22:46:16.162 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-13T22:46:16.162 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi002/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T22:46:16.162 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56005cb7e000 2024-09-13T22:46:16.162 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: DB pointer 0x56005cb6a000 2024-09-13T22:46:16.162 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T22:46:16.162 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T22:46:16.162 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** DB Stats ** 2024-09-13T22:46:16.162 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:46:16.162 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T22:46:16.162 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:46:16.163 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:46:16.163 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T22:46:16.163 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:46:16.163 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:46:16.163 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-13T22:46:16.163 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-13T22:46:16.163 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:46:16.163 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T22:46:16.163 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: L0 2/0 93.74 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 121.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T22:46:16.163 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Sum 2/0 93.74 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 121.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T22:46:16.163 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 121.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T22:46:16.163 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-13T22:46:16.164 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-13T22:46:16.164 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:46:16.164 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T22:46:16.164 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 121.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T22:46:16.164 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-13T22:46:16.164 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T22:46:16.164 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-13T22:46:16.164 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:46:16.164 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T22:46:16.164 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T22:46:16.164 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T22:46:16.164 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T22:46:16.164 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T22:46:16.164 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative compaction: 0.00 GB write, 27.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:46:16.165 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval compaction: 0.00 GB write, 27.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:46:16.165 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T22:46:16.165 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Block cache BinnedLRUCache@0x56005cae11f0#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-13T22:46:16.165 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-13T22:46:16.165 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-13T22:46:16.165 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T22:46:16.165 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: starting mon.smithi002 rank 0 at public addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] at bind addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi002 fsid e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T22:46:16.165 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: mon.smithi002@-1(???) e1 preinit fsid e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T22:46:16.165 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: mon.smithi002@-1(???).mds e1 new map 2024-09-13T22:46:16.165 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: mon.smithi002@-1(???).mds e1 print_map 2024-09-13T22:46:16.165 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: e1 2024-09-13T22:46:16.165 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:46:16.165 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:46:16.165 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: legacy client fscid: -1 2024-09-13T22:46:16.166 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-13T22:46:16.166 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: No filesystems configured 2024-09-13T22:46:16.166 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: mon.smithi002@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T22:46:16.166 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: mon.smithi002@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:46:16.166 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: mon.smithi002@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:46:16.166 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: mon.smithi002@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:46:16.166 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 ceph-mon[27637]: mon.smithi002@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-13T22:46:16.166 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 bash[27618]: de11be74385db02f075a56ef2443b4c331430dd8abf1279c6753b4a22746eefa 2024-09-13T22:46:16.166 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:15 smithi002 systemd[1]: Started Ceph mon.smithi002 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T22:46:17.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:16 smithi002 ceph-mon[27637]: mon.smithi002 is new leader, mons smithi002 in quorum (ranks 0) 2024-09-13T22:46:17.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:16 smithi002 ceph-mon[27637]: monmap e1: 1 mons at {smithi002=[v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T22:46:17.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:16 smithi002 ceph-mon[27637]: fsmap 2024-09-13T22:46:17.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:16 smithi002 ceph-mon[27637]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T22:46:17.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:16 smithi002 ceph-mon[27637]: mgrmap e1: no daemons active 2024-09-13T22:46:17.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:16 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/4099865426' entity='client.admin' 2024-09-13T22:46:17.028 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.348+0000 7eff24d40700 1 Processor -- start 2024-09-13T22:46:17.028 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.348+0000 7eff24d40700 1 -- start start 2024-09-13T22:46:17.028 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.348+0000 7eff24d40700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff20105520 0x7eff20105940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:17.028 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.348+0000 7eff24d40700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff20105f10 con 0x7eff20105520 2024-09-13T22:46:17.028 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.349+0000 7eff1e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff20105520 0x7eff20105940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:17.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.349+0000 7eff1e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff20105520 0x7eff20105940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48934/0 (socket says 172.21.15.2:48934) 2024-09-13T22:46:17.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.349+0000 7eff1e59c700 1 -- 172.21.15.2:0/1888354465 learned_addr learned my addr 172.21.15.2:0/1888354465 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:17.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.349+0000 7eff1e59c700 1 -- 172.21.15.2:0/1888354465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff20106720 con 0x7eff20105520 2024-09-13T22:46:17.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.349+0000 7eff1e59c700 1 --2- 172.21.15.2:0/1888354465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff20105520 0x7eff20105940 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7eff100098a0 tx=0x7eff10009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0a1e61a67a566a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:17.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.349+0000 7eff1d59a700 1 -- 172.21.15.2:0/1888354465 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff10004180 con 0x7eff20105520 2024-09-13T22:46:17.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.349+0000 7eff1d59a700 1 -- 172.21.15.2:0/1888354465 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7eff100042e0 con 0x7eff20105520 2024-09-13T22:46:17.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.349+0000 7eff1d59a700 1 -- 172.21.15.2:0/1888354465 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff10011a50 con 0x7eff20105520 2024-09-13T22:46:17.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.350+0000 7eff24d40700 1 -- 172.21.15.2:0/1888354465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff20105520 msgr2=0x7eff20105940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:17.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.350+0000 7eff24d40700 1 --2- 172.21.15.2:0/1888354465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff20105520 0x7eff20105940 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7eff100098a0 tx=0x7eff10009bb0 comp rx=0 tx=0).stop 2024-09-13T22:46:17.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.350+0000 7eff24d40700 1 -- 172.21.15.2:0/1888354465 shutdown_connections 2024-09-13T22:46:17.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.350+0000 7eff24d40700 1 --2- 172.21.15.2:0/1888354465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff20105520 0x7eff20105940 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:17.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.350+0000 7eff24d40700 1 -- 172.21.15.2:0/1888354465 >> 172.21.15.2:0/1888354465 conn(0x7eff20100ac0 msgr2=0x7eff20102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:17.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.350+0000 7eff24d40700 1 -- 172.21.15.2:0/1888354465 shutdown_connections 2024-09-13T22:46:17.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.350+0000 7eff24d40700 1 -- 172.21.15.2:0/1888354465 wait complete. 2024-09-13T22:46:17.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.351+0000 7eff24d40700 1 Processor -- start 2024-09-13T22:46:17.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.351+0000 7eff24d40700 1 -- start start 2024-09-13T22:46:17.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.351+0000 7eff24d40700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff20105520 0x7eff201906f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:17.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.351+0000 7eff24d40700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff20190c30 con 0x7eff20105520 2024-09-13T22:46:17.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.351+0000 7eff1e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff20105520 0x7eff201906f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:17.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.351+0000 7eff1e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff20105520 0x7eff201906f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48938/0 (socket says 172.21.15.2:48938) 2024-09-13T22:46:17.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.351+0000 7eff1e59c700 1 -- 172.21.15.2:0/4099865426 learned_addr learned my addr 172.21.15.2:0/4099865426 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:17.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.352+0000 7eff1e59c700 1 -- 172.21.15.2:0/4099865426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff10009550 con 0x7eff20105520 2024-09-13T22:46:17.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.352+0000 7eff1e59c700 1 --2- 172.21.15.2:0/4099865426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff20105520 0x7eff201906f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7eff10000c00 tx=0x7eff10011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:17.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.352+0000 7eff0f7fe700 1 -- 172.21.15.2:0/4099865426 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff10003b90 con 0x7eff20105520 2024-09-13T22:46:17.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.352+0000 7eff0f7fe700 1 -- 172.21.15.2:0/4099865426 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7eff100248b0 con 0x7eff20105520 2024-09-13T22:46:17.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.352+0000 7eff24d40700 1 -- 172.21.15.2:0/4099865426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2018ed40 con 0x7eff20105520 2024-09-13T22:46:17.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.352+0000 7eff0f7fe700 1 -- 172.21.15.2:0/4099865426 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff1001a8e0 con 0x7eff20105520 2024-09-13T22:46:17.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.352+0000 7eff24d40700 1 -- 172.21.15.2:0/4099865426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2018f160 con 0x7eff20105520 2024-09-13T22:46:17.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.352+0000 7eff0f7fe700 1 -- 172.21.15.2:0/4099865426 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7eff1002d3f0 con 0x7eff20105520 2024-09-13T22:46:17.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.352+0000 7eff0f7fe700 1 -- 172.21.15.2:0/4099865426 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7eff10019490 con 0x7eff20105520 2024-09-13T22:46:17.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.353+0000 7eff24d40700 1 -- 172.21.15.2:0/4099865426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff200623c0 con 0x7eff20105520 2024-09-13T22:46:17.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.355+0000 7eff0f7fe700 1 -- 172.21.15.2:0/4099865426 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7eff10024a20 con 0x7eff20105520 2024-09-13T22:46:17.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.425+0000 7eff24d40700 1 -- 172.21.15.2:0/4099865426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7eff20109920 con 0x7eff20105520 2024-09-13T22:46:17.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.427+0000 7eff0f7fe700 1 -- 172.21.15.2:0/4099865426 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7eff100350c0 con 0x7eff20105520 2024-09-13T22:46:17.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.428+0000 7eff24d40700 1 -- 172.21.15.2:0/4099865426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff20105520 msgr2=0x7eff201906f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:17.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.428+0000 7eff24d40700 1 --2- 172.21.15.2:0/4099865426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff20105520 0x7eff201906f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7eff10000c00 tx=0x7eff10011ab0 comp rx=0 tx=0).stop 2024-09-13T22:46:17.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.428+0000 7eff24d40700 1 -- 172.21.15.2:0/4099865426 shutdown_connections 2024-09-13T22:46:17.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.428+0000 7eff24d40700 1 --2- 172.21.15.2:0/4099865426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff20105520 0x7eff201906f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:17.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.428+0000 7eff24d40700 1 -- 172.21.15.2:0/4099865426 >> 172.21.15.2:0/4099865426 conn(0x7eff20100ac0 msgr2=0x7eff20074000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:17.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.428+0000 7eff24d40700 1 -- 172.21.15.2:0/4099865426 shutdown_connections 2024-09-13T22:46:17.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:16.428+0000 7eff24d40700 1 -- 172.21.15.2:0/4099865426 wait complete. 2024-09-13T22:46:17.032 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-13T22:46:17.054 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-13T22:46:17.054 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mgr... 2024-09-13T22:46:17.054 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-13T22:46:17.055 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-13T22:46:17.055 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-13T22:46:17.317 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e41042f8-7221-11ef-bceb-c7b262605968@mgr.smithi002.yumtzz 2024-09-13T22:46:17.318 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e41042f8-7221-11ef-bceb-c7b262605968@mgr.smithi002.yumtzz.service: Unit ceph-e41042f8-7221-11ef-bceb-c7b262605968@mgr.smithi002.yumtzz.service not loaded. 2024-09-13T22:46:17.482 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e41042f8-7221-11ef-bceb-c7b262605968.target.wants/ceph-e41042f8-7221-11ef-bceb-c7b262605968@mgr.smithi002.yumtzz.service → /etc/systemd/system/ceph-e41042f8-7221-11ef-bceb-c7b262605968@.service. 2024-09-13T22:46:18.041 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T22:46:18.041 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-13T22:46:18.046 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T22:46:18.046 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-13T22:46:18.047 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-13T22:46:18.047 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T22:46:18.056 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T22:46:18.056 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-13T22:46:18.063 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T22:46:18.063 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-13T22:46:18.063 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-13T22:46:18.063 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-13T22:46:18.063 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr to start... 2024-09-13T22:46:18.063 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr... 2024-09-13T22:46:18.914 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:18 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/107121356' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T22:46:19.177 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-13T22:46:19.177 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:46:19.177 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "e41042f8-7221-11ef-bceb-c7b262605968", 2024-09-13T22:46:19.177 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T22:46:19.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T22:46:19.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T22:46:19.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T22:46:19.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:19.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T22:46:19.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T22:46:19.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-13T22:46:19.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:46:19.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T22:46:19.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "smithi002" 2024-09-13T22:46:19.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:46:19.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-13T22:46:19.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T22:46:19.178 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:46:19.179 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T22:46:19.179 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T22:46:19.179 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:19.179 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T22:46:19.179 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:46:19.179 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T22:46:19.179 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T22:46:19.179 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T22:46:19.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T22:46:19.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T22:46:19.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T22:46:19.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:19.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T22:46:19.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T22:46:19.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T22:46:19.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T22:46:19.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T22:46:19.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T22:46:19.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T22:46:19.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T22:46:19.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T22:46:19.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:19.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T22:46:19.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:46:19.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T22:46:19.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T22:46:19.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:19.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T22:46:19.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T22:46:19.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T22:46:19.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T22:46:19.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T22:46:19.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T22:46:19.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T22:46:19.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:46:19.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:46:19.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:19.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T22:46:19.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:46:19.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T22:46:10.666080+0000", 2024-09-13T22:46:19.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:46:19.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:19.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T22:46:19.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:46:19.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.555+0000 7ff659d2f700 1 Processor -- start 2024-09-13T22:46:19.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.555+0000 7ff659d2f700 1 -- start start 2024-09-13T22:46:19.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.555+0000 7ff659d2f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654105520 0x7ff654105940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:19.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.555+0000 7ff659d2f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff654105f10 con 0x7ff654105520 2024-09-13T22:46:19.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.555+0000 7ff6537fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654105520 0x7ff654105940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:19.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.556+0000 7ff6537fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654105520 0x7ff654105940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48968/0 (socket says 172.21.15.2:48968) 2024-09-13T22:46:19.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.556+0000 7ff6537fe700 1 -- 172.21.15.2:0/2079568127 learned_addr learned my addr 172.21.15.2:0/2079568127 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:19.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.556+0000 7ff6537fe700 1 -- 172.21.15.2:0/2079568127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff654106720 con 0x7ff654105520 2024-09-13T22:46:19.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.556+0000 7ff6537fe700 1 --2- 172.21.15.2:0/2079568127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654105520 0x7ff654105940 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff6440098a0 tx=0x7ff644009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5a2db44376fd8c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:19.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.556+0000 7ff6527fc700 1 -- 172.21.15.2:0/2079568127 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff644004180 con 0x7ff654105520 2024-09-13T22:46:19.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.556+0000 7ff6527fc700 1 -- 172.21.15.2:0/2079568127 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff6440042e0 con 0x7ff654105520 2024-09-13T22:46:19.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.556+0000 7ff6527fc700 1 -- 172.21.15.2:0/2079568127 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff644011a50 con 0x7ff654105520 2024-09-13T22:46:19.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.557+0000 7ff659d2f700 1 -- 172.21.15.2:0/2079568127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654105520 msgr2=0x7ff654105940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:19.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.557+0000 7ff659d2f700 1 --2- 172.21.15.2:0/2079568127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654105520 0x7ff654105940 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff6440098a0 tx=0x7ff644009bb0 comp rx=0 tx=0).stop 2024-09-13T22:46:19.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.557+0000 7ff659d2f700 1 -- 172.21.15.2:0/2079568127 shutdown_connections 2024-09-13T22:46:19.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.557+0000 7ff659d2f700 1 --2- 172.21.15.2:0/2079568127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654105520 0x7ff654105940 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:19.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.557+0000 7ff659d2f700 1 -- 172.21.15.2:0/2079568127 >> 172.21.15.2:0/2079568127 conn(0x7ff654100ac0 msgr2=0x7ff654102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:19.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.557+0000 7ff659d2f700 1 -- 172.21.15.2:0/2079568127 shutdown_connections 2024-09-13T22:46:19.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.557+0000 7ff659d2f700 1 -- 172.21.15.2:0/2079568127 wait complete. 2024-09-13T22:46:19.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.558+0000 7ff659d2f700 1 Processor -- start 2024-09-13T22:46:19.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.558+0000 7ff659d2f700 1 -- start start 2024-09-13T22:46:19.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.558+0000 7ff659d2f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654105520 0x7ff6541906f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:19.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.558+0000 7ff659d2f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff654190c30 con 0x7ff654105520 2024-09-13T22:46:19.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.558+0000 7ff6537fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654105520 0x7ff6541906f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:19.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.558+0000 7ff6537fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654105520 0x7ff6541906f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48980/0 (socket says 172.21.15.2:48980) 2024-09-13T22:46:19.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.558+0000 7ff6537fe700 1 -- 172.21.15.2:0/107121356 learned_addr learned my addr 172.21.15.2:0/107121356 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:19.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.559+0000 7ff6537fe700 1 -- 172.21.15.2:0/107121356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff644009550 con 0x7ff654105520 2024-09-13T22:46:19.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.559+0000 7ff6537fe700 1 --2- 172.21.15.2:0/107121356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654105520 0x7ff6541906f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff644006af0 tx=0x7ff644011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:19.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.559+0000 7ff650ff9700 1 -- 172.21.15.2:0/107121356 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff644003b90 con 0x7ff654105520 2024-09-13T22:46:19.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.559+0000 7ff650ff9700 1 -- 172.21.15.2:0/107121356 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff64401a8a0 con 0x7ff654105520 2024-09-13T22:46:19.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.559+0000 7ff659d2f700 1 -- 172.21.15.2:0/107121356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65418ed40 con 0x7ff654105520 2024-09-13T22:46:19.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.559+0000 7ff650ff9700 1 -- 172.21.15.2:0/107121356 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff644019880 con 0x7ff654105520 2024-09-13T22:46:19.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.559+0000 7ff659d2f700 1 -- 172.21.15.2:0/107121356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65418f160 con 0x7ff654105520 2024-09-13T22:46:19.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.559+0000 7ff650ff9700 1 -- 172.21.15.2:0/107121356 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff64402d440 con 0x7ff654105520 2024-09-13T22:46:19.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.560+0000 7ff650ff9700 1 -- 172.21.15.2:0/107121356 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff644024940 con 0x7ff654105520 2024-09-13T22:46:19.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.560+0000 7ff659d2f700 1 -- 172.21.15.2:0/107121356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6540623c0 con 0x7ff654105520 2024-09-13T22:46:19.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.563+0000 7ff650ff9700 1 -- 172.21.15.2:0/107121356 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7ff64401aa10 con 0x7ff654105520 2024-09-13T22:46:19.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.658+0000 7ff659d2f700 1 -- 172.21.15.2:0/107121356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff654109920 con 0x7ff654105520 2024-09-13T22:46:19.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.658+0000 7ff650ff9700 1 -- 172.21.15.2:0/107121356 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7ff64401abb0 con 0x7ff654105520 2024-09-13T22:46:19.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.659+0000 7ff659d2f700 1 -- 172.21.15.2:0/107121356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654105520 msgr2=0x7ff6541906f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:19.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.659+0000 7ff659d2f700 1 --2- 172.21.15.2:0/107121356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654105520 0x7ff6541906f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff644006af0 tx=0x7ff644011a90 comp rx=0 tx=0).stop 2024-09-13T22:46:19.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.659+0000 7ff659d2f700 1 -- 172.21.15.2:0/107121356 shutdown_connections 2024-09-13T22:46:19.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.659+0000 7ff659d2f700 1 --2- 172.21.15.2:0/107121356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff654105520 0x7ff6541906f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:19.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.659+0000 7ff659d2f700 1 -- 172.21.15.2:0/107121356 >> 172.21.15.2:0/107121356 conn(0x7ff654100ac0 msgr2=0x7ff654073fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:19.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.659+0000 7ff659d2f700 1 -- 172.21.15.2:0/107121356 shutdown_connections 2024-09-13T22:46:19.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:18.659+0000 7ff659d2f700 1 -- 172.21.15.2:0/107121356 wait complete. 2024-09-13T22:46:19.192 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (1/15)... 2024-09-13T22:46:22.209 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:21 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2086271811' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T22:46:22.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-13T22:46:22.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:46:22.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "e41042f8-7221-11ef-bceb-c7b262605968", 2024-09-13T22:46:22.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T22:46:22.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T22:46:22.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T22:46:22.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T22:46:22.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:22.589 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T22:46:22.590 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T22:46:22.590 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-13T22:46:22.590 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:46:22.590 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T22:46:22.590 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "smithi002" 2024-09-13T22:46:22.590 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:46:22.590 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-13T22:46:22.590 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T22:46:22.590 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:46:22.590 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T22:46:22.590 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T22:46:22.590 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:22.590 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T22:46:22.591 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:46:22.591 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T22:46:22.591 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T22:46:22.591 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T22:46:22.598 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T22:46:22.598 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T22:46:22.598 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T22:46:22.598 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:22.599 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T22:46:22.599 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T22:46:22.599 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T22:46:22.599 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T22:46:22.599 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T22:46:22.599 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T22:46:22.599 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T22:46:22.599 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T22:46:22.599 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T22:46:22.599 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:22.599 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T22:46:22.599 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:46:22.599 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T22:46:22.599 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T22:46:22.600 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:22.600 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T22:46:22.600 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T22:46:22.600 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T22:46:22.600 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T22:46:22.600 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T22:46:22.600 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T22:46:22.600 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T22:46:22.600 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:46:22.600 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:46:22.600 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:22.600 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T22:46:22.600 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:46:22.600 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T22:46:10.666080+0000", 2024-09-13T22:46:22.601 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:46:22.601 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:22.601 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T22:46:22.601 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:46:22.601 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.849+0000 7f83d1cad700 1 Processor -- start 2024-09-13T22:46:22.601 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.849+0000 7f83d1cad700 1 -- start start 2024-09-13T22:46:22.601 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.849+0000 7f83d1cad700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc105520 0x7f83cc105940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:22.601 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.849+0000 7f83d1cad700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc105f10 con 0x7f83cc105520 2024-09-13T22:46:22.601 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.849+0000 7f83cb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc105520 0x7f83cc105940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:22.601 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.849+0000 7f83cb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc105520 0x7f83cc105940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44496/0 (socket says 172.21.15.2:44496) 2024-09-13T22:46:22.601 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.849+0000 7f83cb7fe700 1 -- 172.21.15.2:0/1738058881 learned_addr learned my addr 172.21.15.2:0/1738058881 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:22.601 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.849+0000 7f83cb7fe700 1 -- 172.21.15.2:0/1738058881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc106720 con 0x7f83cc105520 2024-09-13T22:46:22.601 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.849+0000 7f83cb7fe700 1 --2- 172.21.15.2:0/1738058881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc105520 0x7f83cc105940 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0098a0 tx=0x7f83bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e0f51b84775a60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:22.602 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.850+0000 7f83ca7fc700 1 -- 172.21.15.2:0/1738058881 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83bc004180 con 0x7f83cc105520 2024-09-13T22:46:22.602 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.850+0000 7f83ca7fc700 1 -- 172.21.15.2:0/1738058881 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f83bc0042e0 con 0x7f83cc105520 2024-09-13T22:46:22.602 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.850+0000 7f83ca7fc700 1 -- 172.21.15.2:0/1738058881 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83bc011a50 con 0x7f83cc105520 2024-09-13T22:46:22.602 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.850+0000 7f83d1cad700 1 -- 172.21.15.2:0/1738058881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc105520 msgr2=0x7f83cc105940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:22.602 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.850+0000 7f83d1cad700 1 --2- 172.21.15.2:0/1738058881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc105520 0x7f83cc105940 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0098a0 tx=0x7f83bc009bb0 comp rx=0 tx=0).stop 2024-09-13T22:46:22.602 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.850+0000 7f83d1cad700 1 -- 172.21.15.2:0/1738058881 shutdown_connections 2024-09-13T22:46:22.602 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.850+0000 7f83d1cad700 1 --2- 172.21.15.2:0/1738058881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc105520 0x7f83cc105940 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:22.602 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.850+0000 7f83d1cad700 1 -- 172.21.15.2:0/1738058881 >> 172.21.15.2:0/1738058881 conn(0x7f83cc100ac0 msgr2=0x7f83cc102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:22.602 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.850+0000 7f83d1cad700 1 -- 172.21.15.2:0/1738058881 shutdown_connections 2024-09-13T22:46:22.602 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.850+0000 7f83d1cad700 1 -- 172.21.15.2:0/1738058881 wait complete. 2024-09-13T22:46:22.602 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.851+0000 7f83d1cad700 1 Processor -- start 2024-09-13T22:46:22.602 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.851+0000 7f83d1cad700 1 -- start start 2024-09-13T22:46:22.602 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.851+0000 7f83d1cad700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc105520 0x7f83cc1906f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:22.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.851+0000 7f83d1cad700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc190c30 con 0x7f83cc105520 2024-09-13T22:46:22.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.852+0000 7f83cb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc105520 0x7f83cc1906f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:22.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.852+0000 7f83cb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc105520 0x7f83cc1906f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44498/0 (socket says 172.21.15.2:44498) 2024-09-13T22:46:22.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.852+0000 7f83cb7fe700 1 -- 172.21.15.2:0/2086271811 learned_addr learned my addr 172.21.15.2:0/2086271811 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:22.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.852+0000 7f83cb7fe700 1 -- 172.21.15.2:0/2086271811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc009550 con 0x7f83cc105520 2024-09-13T22:46:22.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.852+0000 7f83cb7fe700 1 --2- 172.21.15.2:0/2086271811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc105520 0x7f83cc1906f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f83bc000c00 tx=0x7f83bc011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:22.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.852+0000 7f83c8ff9700 1 -- 172.21.15.2:0/2086271811 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83bc003b90 con 0x7f83cc105520 2024-09-13T22:46:22.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.852+0000 7f83d1cad700 1 -- 172.21.15.2:0/2086271811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83cc18ed40 con 0x7f83cc105520 2024-09-13T22:46:22.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.852+0000 7f83c8ff9700 1 -- 172.21.15.2:0/2086271811 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f83bc0248b0 con 0x7f83cc105520 2024-09-13T22:46:22.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.852+0000 7f83c8ff9700 1 -- 172.21.15.2:0/2086271811 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83bc01a8e0 con 0x7f83cc105520 2024-09-13T22:46:22.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.852+0000 7f83d1cad700 1 -- 172.21.15.2:0/2086271811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83cc18f160 con 0x7f83cc105520 2024-09-13T22:46:22.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.853+0000 7f83c8ff9700 1 -- 172.21.15.2:0/2086271811 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f83bc02d3f0 con 0x7f83cc105520 2024-09-13T22:46:22.603 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.853+0000 7f83c8ff9700 1 -- 172.21.15.2:0/2086271811 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f83bc019490 con 0x7f83cc105520 2024-09-13T22:46:22.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.853+0000 7f83d1cad700 1 -- 172.21.15.2:0/2086271811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83cc0623c0 con 0x7f83cc105520 2024-09-13T22:46:22.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.855+0000 7f83c8ff9700 1 -- 172.21.15.2:0/2086271811 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f83bc024a20 con 0x7f83cc105520 2024-09-13T22:46:22.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.929+0000 7f83d1cad700 1 -- 172.21.15.2:0/2086271811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f83cc18fc00 con 0x7f83cc105520 2024-09-13T22:46:22.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.929+0000 7f83c8ff9700 1 -- 172.21.15.2:0/2086271811 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f83bc035090 con 0x7f83cc105520 2024-09-13T22:46:22.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.930+0000 7f83d1cad700 1 -- 172.21.15.2:0/2086271811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc105520 msgr2=0x7f83cc1906f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:22.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.930+0000 7f83d1cad700 1 --2- 172.21.15.2:0/2086271811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc105520 0x7f83cc1906f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f83bc000c00 tx=0x7f83bc011ab0 comp rx=0 tx=0).stop 2024-09-13T22:46:22.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.930+0000 7f83d1cad700 1 -- 172.21.15.2:0/2086271811 shutdown_connections 2024-09-13T22:46:22.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.930+0000 7f83d1cad700 1 --2- 172.21.15.2:0/2086271811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc105520 0x7f83cc1906f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:22.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.930+0000 7f83d1cad700 1 -- 172.21.15.2:0/2086271811 >> 172.21.15.2:0/2086271811 conn(0x7f83cc100ac0 msgr2=0x7f83cc074040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:22.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.930+0000 7f83d1cad700 1 -- 172.21.15.2:0/2086271811 shutdown_connections 2024-09-13T22:46:22.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:21.930+0000 7f83d1cad700 1 -- 172.21.15.2:0/2086271811 wait complete. 2024-09-13T22:46:22.604 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (2/15)... 2024-09-13T22:46:25.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:25 smithi002 ceph-mon[27637]: Activating manager daemon smithi002.yumtzz 2024-09-13T22:46:25.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:25 smithi002 ceph-mon[27637]: mgrmap e2: smithi002.yumtzz(active, starting, since 0.003312s) 2024-09-13T22:46:25.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:25 smithi002 ceph-mon[27637]: from='mgr.14100 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:46:25.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:25 smithi002 ceph-mon[27637]: from='mgr.14100 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:46:25.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:25 smithi002 ceph-mon[27637]: from='mgr.14100 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:46:25.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:25 smithi002 ceph-mon[27637]: from='mgr.14100 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T22:46:25.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:25 smithi002 ceph-mon[27637]: from='mgr.14100 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr metadata", "who": "smithi002.yumtzz", "id": "smithi002.yumtzz"}]: dispatch 2024-09-13T22:46:25.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:25 smithi002 ceph-mon[27637]: Manager daemon smithi002.yumtzz is now available 2024-09-13T22:46:25.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:25 smithi002 ceph-mon[27637]: from='mgr.14100 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.yumtzz/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:46:25.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:25 smithi002 ceph-mon[27637]: from='mgr.14100 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:25.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:25 smithi002 ceph-mon[27637]: from='mgr.14100 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:25.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:25 smithi002 ceph-mon[27637]: from='mgr.14100 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.yumtzz/trash_purge_schedule"}]: dispatch 2024-09-13T22:46:25.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:25 smithi002 ceph-mon[27637]: from='mgr.14100 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:25.747 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-13T22:46:25.747 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:46:25.747 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "e41042f8-7221-11ef-bceb-c7b262605968", 2024-09-13T22:46:25.747 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T22:46:25.747 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T22:46:25.747 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T22:46:25.748 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T22:46:25.748 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:25.748 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T22:46:25.748 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T22:46:25.748 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-13T22:46:25.748 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:46:25.748 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T22:46:25.748 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "smithi002" 2024-09-13T22:46:25.748 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:46:25.748 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-13T22:46:25.748 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T22:46:25.748 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:46:25.749 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T22:46:25.749 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T22:46:25.749 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:25.749 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T22:46:25.749 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:46:25.749 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T22:46:25.749 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T22:46:25.749 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T22:46:25.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T22:46:25.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T22:46:25.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T22:46:25.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:25.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T22:46:25.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T22:46:25.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T22:46:25.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T22:46:25.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T22:46:25.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T22:46:25.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T22:46:25.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T22:46:25.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T22:46:25.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:25.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T22:46:25.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:46:25.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T22:46:25.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T22:46:25.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:25.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T22:46:25.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T22:46:25.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T22:46:25.759 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T22:46:25.760 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T22:46:25.760 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T22:46:25.760 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T22:46:25.760 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:46:25.760 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:46:25.760 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:25.760 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T22:46:25.760 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:46:25.760 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T22:46:10.666080+0000", 2024-09-13T22:46:25.760 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:46:25.760 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:25.760 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T22:46:25.761 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:46:25.761 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.045+0000 7f38ff6bf700 1 Processor -- start 2024-09-13T22:46:25.761 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.045+0000 7f38ff6bf700 1 -- start start 2024-09-13T22:46:25.761 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.046+0000 7f38ff6bf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f81054d0 0x7f38f81058f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:25.761 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.046+0000 7f38ff6bf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f8105ec0 con 0x7f38f81054d0 2024-09-13T22:46:25.761 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.046+0000 7f38fd45b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f81054d0 0x7f38f81058f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:25.761 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.046+0000 7f38fd45b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f81054d0 0x7f38f81058f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44580/0 (socket says 172.21.15.2:44580) 2024-09-13T22:46:25.761 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.046+0000 7f38fd45b700 1 -- 172.21.15.2:0/2338264039 learned_addr learned my addr 172.21.15.2:0/2338264039 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:25.761 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.046+0000 7f38fd45b700 1 -- 172.21.15.2:0/2338264039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f81066d0 con 0x7f38f81054d0 2024-09-13T22:46:25.761 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.047+0000 7f38fd45b700 1 --2- 172.21.15.2:0/2338264039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f81054d0 0x7f38f81058f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f38f40098a0 tx=0x7f38f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614c68ab39a76e7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:25.761 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.047+0000 7f38effff700 1 -- 172.21.15.2:0/2338264039 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f38f4004180 con 0x7f38f81054d0 2024-09-13T22:46:25.762 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.047+0000 7f38effff700 1 -- 172.21.15.2:0/2338264039 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f38f40042e0 con 0x7f38f81054d0 2024-09-13T22:46:25.762 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.047+0000 7f38effff700 1 -- 172.21.15.2:0/2338264039 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f38f4011a50 con 0x7f38f81054d0 2024-09-13T22:46:25.762 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.047+0000 7f38ff6bf700 1 -- 172.21.15.2:0/2338264039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f81054d0 msgr2=0x7f38f81058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:25.762 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.047+0000 7f38ff6bf700 1 --2- 172.21.15.2:0/2338264039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f81054d0 0x7f38f81058f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f38f40098a0 tx=0x7f38f4009bb0 comp rx=0 tx=0).stop 2024-09-13T22:46:25.762 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.047+0000 7f38ff6bf700 1 -- 172.21.15.2:0/2338264039 shutdown_connections 2024-09-13T22:46:25.762 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.048+0000 7f38ff6bf700 1 --2- 172.21.15.2:0/2338264039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f81054d0 0x7f38f81058f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:25.762 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.048+0000 7f38ff6bf700 1 -- 172.21.15.2:0/2338264039 >> 172.21.15.2:0/2338264039 conn(0x7f38f8100ad0 msgr2=0x7f38f8102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:25.762 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.048+0000 7f38ff6bf700 1 -- 172.21.15.2:0/2338264039 shutdown_connections 2024-09-13T22:46:25.762 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.048+0000 7f38ff6bf700 1 -- 172.21.15.2:0/2338264039 wait complete. 2024-09-13T22:46:25.762 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.048+0000 7f38ff6bf700 1 Processor -- start 2024-09-13T22:46:25.762 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.048+0000 7f38ff6bf700 1 -- start start 2024-09-13T22:46:25.762 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.049+0000 7f38ff6bf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f81054d0 0x7f38f819a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:25.763 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.049+0000 7f38ff6bf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f819a5f0 con 0x7f38f81054d0 2024-09-13T22:46:25.763 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.049+0000 7f38fd45b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f81054d0 0x7f38f819a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:25.763 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.049+0000 7f38fd45b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f81054d0 0x7f38f819a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44588/0 (socket says 172.21.15.2:44588) 2024-09-13T22:46:25.763 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.049+0000 7f38fd45b700 1 -- 172.21.15.2:0/1717877404 learned_addr learned my addr 172.21.15.2:0/1717877404 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:25.763 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.049+0000 7f38fd45b700 1 -- 172.21.15.2:0/1717877404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f4009550 con 0x7f38f81054d0 2024-09-13T22:46:25.763 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.049+0000 7f38fd45b700 1 --2- 172.21.15.2:0/1717877404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f81054d0 0x7f38f819a0b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f38f4011a70 tx=0x7f38f4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:25.763 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.049+0000 7f38ee7fc700 1 -- 172.21.15.2:0/1717877404 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f38f4003c00 con 0x7f38f81054d0 2024-09-13T22:46:25.763 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.049+0000 7f38ee7fc700 1 -- 172.21.15.2:0/1717877404 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f38f401a8a0 con 0x7f38f81054d0 2024-09-13T22:46:25.763 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.049+0000 7f38ee7fc700 1 -- 172.21.15.2:0/1717877404 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f38f4019960 con 0x7f38f81054d0 2024-09-13T22:46:25.763 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.049+0000 7f38ff6bf700 1 -- 172.21.15.2:0/1717877404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f819a7f0 con 0x7f38f81054d0 2024-09-13T22:46:25.763 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.049+0000 7f38ff6bf700 1 -- 172.21.15.2:0/1717877404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f819ab50 con 0x7f38f81054d0 2024-09-13T22:46:25.764 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.050+0000 7f38ff6bf700 1 -- 172.21.15.2:0/1717877404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f8193fd0 con 0x7f38f81054d0 2024-09-13T22:46:25.764 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.051+0000 7f38ee7fc700 1 -- 172.21.15.2:0/1717877404 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 2) v1 ==== 45039+0+0 (secure 0 0 0) 0x7f38f4019bd0 con 0x7f38f81054d0 2024-09-13T22:46:25.764 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.051+0000 7f38ee7fc700 1 -- 172.21.15.2:0/1717877404 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f38f404c1e0 con 0x7f38f81054d0 2024-09-13T22:46:25.764 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.053+0000 7f38ee7fc700 1 -- 172.21.15.2:0/1717877404 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f38f402b520 con 0x7f38f81054d0 2024-09-13T22:46:25.764 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.126+0000 7f38ff6bf700 1 -- 172.21.15.2:0/1717877404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f38f802d090 con 0x7f38f81054d0 2024-09-13T22:46:25.764 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.126+0000 7f38ee7fc700 1 -- 172.21.15.2:0/1717877404 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f38f402b340 con 0x7f38f81054d0 2024-09-13T22:46:25.764 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.127+0000 7f38ff6bf700 1 -- 172.21.15.2:0/1717877404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f81054d0 msgr2=0x7f38f819a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:25.764 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.127+0000 7f38ff6bf700 1 --2- 172.21.15.2:0/1717877404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f81054d0 0x7f38f819a0b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f38f4011a70 tx=0x7f38f4011b50 comp rx=0 tx=0).stop 2024-09-13T22:46:25.765 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.127+0000 7f38ff6bf700 1 -- 172.21.15.2:0/1717877404 shutdown_connections 2024-09-13T22:46:25.765 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.127+0000 7f38ff6bf700 1 --2- 172.21.15.2:0/1717877404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38f81054d0 0x7f38f819a0b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:25.765 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.127+0000 7f38ff6bf700 1 -- 172.21.15.2:0/1717877404 >> 172.21.15.2:0/1717877404 conn(0x7f38f8100ad0 msgr2=0x7f38f8101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:25.765 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.127+0000 7f38ff6bf700 1 -- 172.21.15.2:0/1717877404 shutdown_connections 2024-09-13T22:46:25.765 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:25.127+0000 7f38ff6bf700 1 -- 172.21.15.2:0/1717877404 wait complete. 2024-09-13T22:46:25.765 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (3/15)... 2024-09-13T22:46:26.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:26 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/1717877404' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T22:46:26.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:26 smithi002 ceph-mon[27637]: mgrmap e3: smithi002.yumtzz(active, since 1.00707s) 2024-09-13T22:46:28.127 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:28 smithi002 ceph-mon[27637]: mgrmap e4: smithi002.yumtzz(active, since 2s) 2024-09-13T22:46:29.197 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:29 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/4096716217' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T22:46:29.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-13T22:46:29.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:46:29.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "e41042f8-7221-11ef-bceb-c7b262605968", 2024-09-13T22:46:29.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T22:46:29.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T22:46:29.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T22:46:29.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T22:46:29.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:29.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T22:46:29.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T22:46:29.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-13T22:46:29.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:46:29.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T22:46:29.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "smithi002" 2024-09-13T22:46:29.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:46:29.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-09-13T22:46:29.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T22:46:29.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:46:29.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T22:46:29.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T22:46:29.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:29.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T22:46:29.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:46:29.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T22:46:29.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T22:46:29.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T22:46:29.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T22:46:29.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T22:46:29.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T22:46:29.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T22:46:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T22:46:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T22:46:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T22:46:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T22:46:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T22:46:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T22:46:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T22:46:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T22:46:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T22:46:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:46:29.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T22:46:29.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T22:46:29.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:29.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T22:46:29.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T22:46:29.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T22:46:29.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T22:46:29.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T22:46:29.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T22:46:29.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T22:46:29.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-13T22:46:29.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:46:29.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:29.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T22:46:29.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T22:46:29.215 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T22:46:10.666080+0000", 2024-09-13T22:46:29.215 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T22:46:29.215 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-13T22:46:29.215 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T22:46:29.215 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:46:29.215 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.168+0000 7fade0b7c700 1 Processor -- start 2024-09-13T22:46:29.215 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.168+0000 7fade0b7c700 1 -- start start 2024-09-13T22:46:29.215 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.169+0000 7fade0b7c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc1065d0 0x7faddc1069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:29.215 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.169+0000 7fade0b7c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc106fc0 con 0x7faddc1065d0 2024-09-13T22:46:29.215 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.169+0000 7fadda59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc1065d0 0x7faddc1069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:29.215 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.169+0000 7fadda59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc1065d0 0x7faddc1069f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44598/0 (socket says 172.21.15.2:44598) 2024-09-13T22:46:29.215 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.169+0000 7fadda59c700 1 -- 172.21.15.2:0/2804142739 learned_addr learned my addr 172.21.15.2:0/2804142739 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:29.216 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.169+0000 7fadda59c700 1 -- 172.21.15.2:0/2804142739 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc1077d0 con 0x7faddc1065d0 2024-09-13T22:46:29.216 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.170+0000 7fadda59c700 1 --2- 172.21.15.2:0/2804142739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc1065d0 0x7faddc1069f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009e80 tx=0x7fadcc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f79569f1068c5ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:29.216 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.170+0000 7fadd959a700 1 -- 172.21.15.2:0/2804142739 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadcc00e070 con 0x7faddc1065d0 2024-09-13T22:46:29.216 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.170+0000 7fadd959a700 1 -- 172.21.15.2:0/2804142739 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fadcc003e90 con 0x7faddc1065d0 2024-09-13T22:46:29.216 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.170+0000 7fadd959a700 1 -- 172.21.15.2:0/2804142739 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadcc004380 con 0x7faddc1065d0 2024-09-13T22:46:29.216 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.170+0000 7fade0b7c700 1 -- 172.21.15.2:0/2804142739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc1065d0 msgr2=0x7faddc1069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:29.216 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.170+0000 7fade0b7c700 1 --2- 172.21.15.2:0/2804142739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc1065d0 0x7faddc1069f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009e80 tx=0x7fadcc00b330 comp rx=0 tx=0).stop 2024-09-13T22:46:29.216 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.170+0000 7fade0b7c700 1 -- 172.21.15.2:0/2804142739 shutdown_connections 2024-09-13T22:46:29.216 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.170+0000 7fade0b7c700 1 --2- 172.21.15.2:0/2804142739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc1065d0 0x7faddc1069f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:29.216 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.170+0000 7fade0b7c700 1 -- 172.21.15.2:0/2804142739 >> 172.21.15.2:0/2804142739 conn(0x7faddc101bd0 msgr2=0x7faddc103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:29.216 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.170+0000 7fade0b7c700 1 -- 172.21.15.2:0/2804142739 shutdown_connections 2024-09-13T22:46:29.216 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.170+0000 7fade0b7c700 1 -- 172.21.15.2:0/2804142739 wait complete. 2024-09-13T22:46:29.216 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.171+0000 7fade0b7c700 1 Processor -- start 2024-09-13T22:46:29.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.171+0000 7fade0b7c700 1 -- start start 2024-09-13T22:46:29.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.171+0000 7fade0b7c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc1065d0 0x7faddc19a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:29.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.171+0000 7fade0b7c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc19a7b0 con 0x7faddc1065d0 2024-09-13T22:46:29.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.172+0000 7fadda59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc1065d0 0x7faddc19a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:29.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.172+0000 7fadda59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc1065d0 0x7faddc19a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44608/0 (socket says 172.21.15.2:44608) 2024-09-13T22:46:29.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.172+0000 7fadda59c700 1 -- 172.21.15.2:0/4096716217 learned_addr learned my addr 172.21.15.2:0/4096716217 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:29.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.172+0000 7fadda59c700 1 -- 172.21.15.2:0/4096716217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc009b30 con 0x7faddc1065d0 2024-09-13T22:46:29.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.172+0000 7fadda59c700 1 --2- 172.21.15.2:0/4096716217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc1065d0 0x7faddc19a270 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009530 tx=0x7fadcc004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:29.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.172+0000 7fadd37fe700 1 -- 172.21.15.2:0/4096716217 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadcc00e040 con 0x7faddc1065d0 2024-09-13T22:46:29.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.172+0000 7fadd37fe700 1 -- 172.21.15.2:0/4096716217 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fadcc003c30 con 0x7faddc1065d0 2024-09-13T22:46:29.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.172+0000 7fade0b7c700 1 -- 172.21.15.2:0/4096716217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faddc19a9b0 con 0x7faddc1065d0 2024-09-13T22:46:29.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.172+0000 7fadd37fe700 1 -- 172.21.15.2:0/4096716217 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadcc01b740 con 0x7faddc1065d0 2024-09-13T22:46:29.217 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.172+0000 7fade0b7c700 1 -- 172.21.15.2:0/4096716217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faddc19ae30 con 0x7faddc1065d0 2024-09-13T22:46:29.218 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.173+0000 7fadd37fe700 1 -- 172.21.15.2:0/4096716217 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 45272+0+0 (secure 0 0 0) 0x7fadcc019040 con 0x7faddc1065d0 2024-09-13T22:46:29.218 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.173+0000 7fade0b7c700 1 -- 172.21.15.2:0/4096716217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faddc0623c0 con 0x7faddc1065d0 2024-09-13T22:46:29.218 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.173+0000 7fadd37fe700 1 --2- 172.21.15.2:0/4096716217 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fadc80382d0 0x7fadc803a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:29.218 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.173+0000 7fadd37fe700 1 -- 172.21.15.2:0/4096716217 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fadcc04bc00 con 0x7faddc1065d0 2024-09-13T22:46:29.218 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.173+0000 7fadd9d9b700 1 --2- 172.21.15.2:0/4096716217 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fadc80382d0 0x7fadc803a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:29.218 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.174+0000 7fadd9d9b700 1 --2- 172.21.15.2:0/4096716217 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fadc80382d0 0x7fadc803a790 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fadc4006fd0 tx=0x7fadc4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:29.218 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.178+0000 7fadd37fe700 1 -- 172.21.15.2:0/4096716217 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fadcc011750 con 0x7faddc1065d0 2024-09-13T22:46:29.218 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.456+0000 7fade0b7c700 1 -- 172.21.15.2:0/4096716217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7faddc10a9c0 con 0x7faddc1065d0 2024-09-13T22:46:29.218 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.456+0000 7fadd37fe700 1 -- 172.21.15.2:0/4096716217 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fadcc01f030 con 0x7faddc1065d0 2024-09-13T22:46:29.218 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.459+0000 7fade0b7c700 1 -- 172.21.15.2:0/4096716217 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fadc80382d0 msgr2=0x7fadc803a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:29.218 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.459+0000 7fade0b7c700 1 --2- 172.21.15.2:0/4096716217 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fadc80382d0 0x7fadc803a790 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fadc4006fd0 tx=0x7fadc4006e40 comp rx=0 tx=0).stop 2024-09-13T22:46:29.218 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.459+0000 7fade0b7c700 1 -- 172.21.15.2:0/4096716217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc1065d0 msgr2=0x7faddc19a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:29.218 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.459+0000 7fade0b7c700 1 --2- 172.21.15.2:0/4096716217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc1065d0 0x7faddc19a270 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009530 tx=0x7fadcc004920 comp rx=0 tx=0).stop 2024-09-13T22:46:29.219 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.460+0000 7fade0b7c700 1 -- 172.21.15.2:0/4096716217 shutdown_connections 2024-09-13T22:46:29.219 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.460+0000 7fade0b7c700 1 --2- 172.21.15.2:0/4096716217 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fadc80382d0 0x7fadc803a790 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:29.219 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.460+0000 7fade0b7c700 1 --2- 172.21.15.2:0/4096716217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faddc1065d0 0x7faddc19a270 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:29.219 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.460+0000 7fade0b7c700 1 -- 172.21.15.2:0/4096716217 >> 172.21.15.2:0/4096716217 conn(0x7faddc101bd0 msgr2=0x7faddc103260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:29.219 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.460+0000 7fade0b7c700 1 -- 172.21.15.2:0/4096716217 shutdown_connections 2024-09-13T22:46:29.219 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:28.460+0000 7fade0b7c700 1 -- 172.21.15.2:0/4096716217 wait complete. 2024-09-13T22:46:29.219 INFO:teuthology.orchestra.run.smithi002.stdout:mgr is available 2024-09-13T22:46:30.169 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:30 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/3598086633' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T22:46:30.445 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-13T22:46:30.446 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T22:46:30.446 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T22:46:30.446 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T22:46:30.446 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T22:46:30.446 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T22:46:30.446 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T22:46:30.446 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-13T22:46:30.446 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T22:46:30.446 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T22:46:30.446 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-13T22:46:30.446 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T22:46:30.446 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T22:46:30.447 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T22:46:30.447 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T22:46:30.447 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T22:46:30.447 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T22:46:30.447 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.649+0000 7fc2ebccb700 1 Processor -- start 2024-09-13T22:46:30.447 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.650+0000 7fc2ebccb700 1 -- start start 2024-09-13T22:46:30.447 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.650+0000 7fc2ebccb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2e4106af0 0x7fc2e4106f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:30.447 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.650+0000 7fc2ebccb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e41074e0 con 0x7fc2e4106af0 2024-09-13T22:46:30.447 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.650+0000 7fc2e9a67700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2e4106af0 0x7fc2e4106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:30.447 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.650+0000 7fc2e9a67700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2e4106af0 0x7fc2e4106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44614/0 (socket says 172.21.15.2:44614) 2024-09-13T22:46:30.447 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.650+0000 7fc2e9a67700 1 -- 172.21.15.2:0/1553809817 learned_addr learned my addr 172.21.15.2:0/1553809817 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:30.447 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.650+0000 7fc2e9a67700 1 -- 172.21.15.2:0/1553809817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e4107620 con 0x7fc2e4106af0 2024-09-13T22:46:30.447 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.651+0000 7fc2e9a67700 1 --2- 172.21.15.2:0/1553809817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2e4106af0 0x7fc2e4106f10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00098a0 tx=0x7fc2e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f0fd496747252a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:30.448 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.651+0000 7fc2e8a65700 1 -- 172.21.15.2:0/1553809817 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2e0004180 con 0x7fc2e4106af0 2024-09-13T22:46:30.448 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.651+0000 7fc2e8a65700 1 -- 172.21.15.2:0/1553809817 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc2e00042e0 con 0x7fc2e4106af0 2024-09-13T22:46:30.448 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.651+0000 7fc2e8a65700 1 -- 172.21.15.2:0/1553809817 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2e0011a50 con 0x7fc2e4106af0 2024-09-13T22:46:30.448 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.651+0000 7fc2ebccb700 1 -- 172.21.15.2:0/1553809817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2e4106af0 msgr2=0x7fc2e4106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:30.448 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.651+0000 7fc2ebccb700 1 --2- 172.21.15.2:0/1553809817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2e4106af0 0x7fc2e4106f10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00098a0 tx=0x7fc2e0009bb0 comp rx=0 tx=0).stop 2024-09-13T22:46:30.448 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.651+0000 7fc2ebccb700 1 -- 172.21.15.2:0/1553809817 shutdown_connections 2024-09-13T22:46:30.448 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.651+0000 7fc2ebccb700 1 --2- 172.21.15.2:0/1553809817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2e4106af0 0x7fc2e4106f10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:30.448 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.651+0000 7fc2ebccb700 1 -- 172.21.15.2:0/1553809817 >> 172.21.15.2:0/1553809817 conn(0x7fc2e4100220 msgr2=0x7fc2e4102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:30.448 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.652+0000 7fc2ebccb700 1 -- 172.21.15.2:0/1553809817 shutdown_connections 2024-09-13T22:46:30.448 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.652+0000 7fc2ebccb700 1 -- 172.21.15.2:0/1553809817 wait complete. 2024-09-13T22:46:30.448 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.652+0000 7fc2ebccb700 1 Processor -- start 2024-09-13T22:46:30.448 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.652+0000 7fc2ebccb700 1 -- start start 2024-09-13T22:46:30.448 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.652+0000 7fc2ebccb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2e4106af0 0x7fc2e419c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:30.449 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.652+0000 7fc2ebccb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e419ca30 con 0x7fc2e4106af0 2024-09-13T22:46:30.449 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.653+0000 7fc2e9a67700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2e4106af0 0x7fc2e419c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:30.449 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.653+0000 7fc2e9a67700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2e4106af0 0x7fc2e419c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44616/0 (socket says 172.21.15.2:44616) 2024-09-13T22:46:30.449 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.653+0000 7fc2e9a67700 1 -- 172.21.15.2:0/3598086633 learned_addr learned my addr 172.21.15.2:0/3598086633 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:30.449 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.653+0000 7fc2e9a67700 1 -- 172.21.15.2:0/3598086633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e0009550 con 0x7fc2e4106af0 2024-09-13T22:46:30.449 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.653+0000 7fc2e9a67700 1 --2- 172.21.15.2:0/3598086633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2e4106af0 0x7fc2e419c4f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0000c00 tx=0x7fc2e0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:30.449 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.653+0000 7fc2daffd700 1 -- 172.21.15.2:0/3598086633 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2e0003b90 con 0x7fc2e4106af0 2024-09-13T22:46:30.449 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.653+0000 7fc2daffd700 1 -- 172.21.15.2:0/3598086633 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc2e00248b0 con 0x7fc2e4106af0 2024-09-13T22:46:30.449 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.653+0000 7fc2ebccb700 1 -- 172.21.15.2:0/3598086633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e419cc30 con 0x7fc2e4106af0 2024-09-13T22:46:30.449 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.653+0000 7fc2daffd700 1 -- 172.21.15.2:0/3598086633 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2e001a8e0 con 0x7fc2e4106af0 2024-09-13T22:46:30.449 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.653+0000 7fc2ebccb700 1 -- 172.21.15.2:0/3598086633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e419d050 con 0x7fc2e4106af0 2024-09-13T22:46:30.449 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.654+0000 7fc2daffd700 1 -- 172.21.15.2:0/3598086633 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 45272+0+0 (secure 0 0 0) 0x7fc2e0024440 con 0x7fc2e4106af0 2024-09-13T22:46:30.450 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.654+0000 7fc2ebccb700 1 -- 172.21.15.2:0/3598086633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e41961e0 con 0x7fc2e4106af0 2024-09-13T22:46:30.450 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.654+0000 7fc2daffd700 1 --2- 172.21.15.2:0/3598086633 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc2d0038320 0x7fc2d003a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:30.450 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.654+0000 7fc2daffd700 1 -- 172.21.15.2:0/3598086633 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc2e004bf90 con 0x7fc2e4106af0 2024-09-13T22:46:30.450 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.655+0000 7fc2e9266700 1 --2- 172.21.15.2:0/3598086633 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc2d0038320 0x7fc2d003a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:30.450 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.655+0000 7fc2e9266700 1 --2- 172.21.15.2:0/3598086633 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc2d0038320 0x7fc2d003a7e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4006fd0 tx=0x7fc2d4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:30.450 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.659+0000 7fc2daffd700 1 -- 172.21.15.2:0/3598086633 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc2e00233a0 con 0x7fc2e4106af0 2024-09-13T22:46:30.450 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.856+0000 7fc2ebccb700 1 -- 172.21.15.2:0/3598086633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fc2e402cf70 con 0x7fc2e4106af0 2024-09-13T22:46:30.450 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.857+0000 7fc2daffd700 1 -- 172.21.15.2:0/3598086633 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fc2e004bdb0 con 0x7fc2e4106af0 2024-09-13T22:46:30.450 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.859+0000 7fc2ebccb700 1 -- 172.21.15.2:0/3598086633 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc2d0038320 msgr2=0x7fc2d003a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:30.450 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.859+0000 7fc2ebccb700 1 --2- 172.21.15.2:0/3598086633 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc2d0038320 0x7fc2d003a7e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4006fd0 tx=0x7fc2d4006e40 comp rx=0 tx=0).stop 2024-09-13T22:46:30.450 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.859+0000 7fc2ebccb700 1 -- 172.21.15.2:0/3598086633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2e4106af0 msgr2=0x7fc2e419c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:30.450 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.859+0000 7fc2ebccb700 1 --2- 172.21.15.2:0/3598086633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2e4106af0 0x7fc2e419c4f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0000c00 tx=0x7fc2e0011ab0 comp rx=0 tx=0).stop 2024-09-13T22:46:30.451 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.859+0000 7fc2ebccb700 1 -- 172.21.15.2:0/3598086633 shutdown_connections 2024-09-13T22:46:30.451 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.859+0000 7fc2ebccb700 1 --2- 172.21.15.2:0/3598086633 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc2d0038320 0x7fc2d003a7e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:30.451 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.859+0000 7fc2ebccb700 1 --2- 172.21.15.2:0/3598086633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2e4106af0 0x7fc2e419c4f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:30.451 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.859+0000 7fc2ebccb700 1 -- 172.21.15.2:0/3598086633 >> 172.21.15.2:0/3598086633 conn(0x7fc2e4100220 msgr2=0x7fc2e4193320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:30.451 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.859+0000 7fc2ebccb700 1 -- 172.21.15.2:0/3598086633 shutdown_connections 2024-09-13T22:46:30.451 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:29.859+0000 7fc2ebccb700 1 -- 172.21.15.2:0/3598086633 wait complete. 2024-09-13T22:46:30.451 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling cephadm module... 2024-09-13T22:46:32.107 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:31 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2210820667' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-13T22:46:32.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.859+0000 7f88ebdc0700 1 Processor -- start 2024-09-13T22:46:32.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.859+0000 7f88ebdc0700 1 -- start start 2024-09-13T22:46:32.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.859+0000 7f88ebdc0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88e407be70 0x7f88e407a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:32.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.859+0000 7f88ebdc0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e407a8a0 con 0x7f88e407be70 2024-09-13T22:46:32.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.860+0000 7f88e9b5c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88e407be70 0x7f88e407a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:32.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.860+0000 7f88e9b5c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88e407be70 0x7f88e407a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60722/0 (socket says 172.21.15.2:60722) 2024-09-13T22:46:32.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.860+0000 7f88e9b5c700 1 -- 172.21.15.2:0/1783119234 learned_addr learned my addr 172.21.15.2:0/1783119234 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:32.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.860+0000 7f88e9b5c700 1 -- 172.21.15.2:0/1783119234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e407a9e0 con 0x7f88e407be70 2024-09-13T22:46:32.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.860+0000 7f88e9b5c700 1 --2- 172.21.15.2:0/1783119234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88e407be70 0x7f88e407a2d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f88d4009e80 tx=0x7f88d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ee57e015ddb50f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:32.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.860+0000 7f88e8b5a700 1 -- 172.21.15.2:0/1783119234 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88d400e070 con 0x7f88e407be70 2024-09-13T22:46:32.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.860+0000 7f88e8b5a700 1 -- 172.21.15.2:0/1783119234 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f88d4003e90 con 0x7f88e407be70 2024-09-13T22:46:32.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.860+0000 7f88e8b5a700 1 -- 172.21.15.2:0/1783119234 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88d4004380 con 0x7f88e407be70 2024-09-13T22:46:32.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.861+0000 7f88ebdc0700 1 -- 172.21.15.2:0/1783119234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88e407be70 msgr2=0x7f88e407a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:32.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.861+0000 7f88ebdc0700 1 --2- 172.21.15.2:0/1783119234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88e407be70 0x7f88e407a2d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f88d4009e80 tx=0x7f88d400b330 comp rx=0 tx=0).stop 2024-09-13T22:46:32.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.861+0000 7f88ebdc0700 1 -- 172.21.15.2:0/1783119234 shutdown_connections 2024-09-13T22:46:32.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.861+0000 7f88ebdc0700 1 --2- 172.21.15.2:0/1783119234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88e407be70 0x7f88e407a2d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:32.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.861+0000 7f88ebdc0700 1 -- 172.21.15.2:0/1783119234 >> 172.21.15.2:0/1783119234 conn(0x7f88e4101bd0 msgr2=0x7f88e4103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:32.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.861+0000 7f88ebdc0700 1 -- 172.21.15.2:0/1783119234 shutdown_connections 2024-09-13T22:46:32.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.861+0000 7f88ebdc0700 1 -- 172.21.15.2:0/1783119234 wait complete. 2024-09-13T22:46:32.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.862+0000 7f88ebdc0700 1 Processor -- start 2024-09-13T22:46:32.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.862+0000 7f88ebdc0700 1 -- start start 2024-09-13T22:46:32.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.862+0000 7f88ebdc0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88e407be70 0x7f88e419c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:32.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.862+0000 7f88ebdc0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e419c980 con 0x7f88e407be70 2024-09-13T22:46:32.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.862+0000 7f88e9b5c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88e407be70 0x7f88e419c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:32.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.862+0000 7f88e9b5c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88e407be70 0x7f88e419c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60734/0 (socket says 172.21.15.2:60734) 2024-09-13T22:46:32.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.862+0000 7f88e9b5c700 1 -- 172.21.15.2:0/2210820667 learned_addr learned my addr 172.21.15.2:0/2210820667 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:32.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.862+0000 7f88e9b5c700 1 -- 172.21.15.2:0/2210820667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d4009b30 con 0x7f88e407be70 2024-09-13T22:46:32.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.862+0000 7f88e9b5c700 1 --2- 172.21.15.2:0/2210820667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88e407be70 0x7f88e419c440 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f88d4000f80 tx=0x7f88d4004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:32.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.863+0000 7f88e2ffd700 1 -- 172.21.15.2:0/2210820667 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88d400e040 con 0x7f88e407be70 2024-09-13T22:46:32.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.863+0000 7f88e2ffd700 1 -- 172.21.15.2:0/2210820667 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f88d4003cf0 con 0x7f88e407be70 2024-09-13T22:46:32.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.863+0000 7f88ebdc0700 1 -- 172.21.15.2:0/2210820667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e419cb80 con 0x7f88e407be70 2024-09-13T22:46:32.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.863+0000 7f88e2ffd700 1 -- 172.21.15.2:0/2210820667 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88d401b930 con 0x7f88e407be70 2024-09-13T22:46:32.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.863+0000 7f88ebdc0700 1 -- 172.21.15.2:0/2210820667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e419d000 con 0x7f88e407be70 2024-09-13T22:46:32.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.863+0000 7f88e2ffd700 1 -- 172.21.15.2:0/2210820667 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 45272+0+0 (secure 0 0 0) 0x7f88d4019040 con 0x7f88e407be70 2024-09-13T22:46:32.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.864+0000 7f88ebdc0700 1 -- 172.21.15.2:0/2210820667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e4062430 con 0x7f88e407be70 2024-09-13T22:46:32.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.864+0000 7f88e2ffd700 1 --2- 172.21.15.2:0/2210820667 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f88cc038320 0x7f88cc03a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:32.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.864+0000 7f88e2ffd700 1 -- 172.21.15.2:0/2210820667 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f88d404bb30 con 0x7f88e407be70 2024-09-13T22:46:32.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.864+0000 7f88e935b700 1 --2- 172.21.15.2:0/2210820667 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f88cc038320 0x7f88cc03a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:32.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.864+0000 7f88e935b700 1 --2- 172.21.15.2:0/2210820667 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f88cc038320 0x7f88cc03a7e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f88d8006fd0 tx=0x7f88d8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:32.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:30.869+0000 7f88e2ffd700 1 -- 172.21.15.2:0/2210820667 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f88e4062430 con 0x7f88e407be70 2024-09-13T22:46:32.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:31.125+0000 7f88ebdc0700 1 -- 172.21.15.2:0/2210820667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f88e419f9e0 con 0x7f88e407be70 2024-09-13T22:46:32.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:31.844+0000 7f88e2ffd700 1 -- 172.21.15.2:0/2210820667 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 5) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f88d4010d90 con 0x7f88e407be70 2024-09-13T22:46:32.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:31.845+0000 7f88e2ffd700 1 -- 172.21.15.2:0/2210820667 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f88d401ad80 con 0x7f88e407be70 2024-09-13T22:46:32.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:31.848+0000 7f88ebdc0700 1 -- 172.21.15.2:0/2210820667 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f88cc038320 msgr2=0x7f88cc03a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:32.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:31.848+0000 7f88ebdc0700 1 --2- 172.21.15.2:0/2210820667 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f88cc038320 0x7f88cc03a7e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f88d8006fd0 tx=0x7f88d8006e40 comp rx=0 tx=0).stop 2024-09-13T22:46:32.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:31.848+0000 7f88ebdc0700 1 -- 172.21.15.2:0/2210820667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88e407be70 msgr2=0x7f88e419c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:32.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:31.848+0000 7f88ebdc0700 1 --2- 172.21.15.2:0/2210820667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88e407be70 0x7f88e419c440 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f88d4000f80 tx=0x7f88d4004920 comp rx=0 tx=0).stop 2024-09-13T22:46:32.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:31.848+0000 7f88ebdc0700 1 -- 172.21.15.2:0/2210820667 shutdown_connections 2024-09-13T22:46:32.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:31.848+0000 7f88ebdc0700 1 --2- 172.21.15.2:0/2210820667 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f88cc038320 0x7f88cc03a7e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:32.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:31.848+0000 7f88ebdc0700 1 --2- 172.21.15.2:0/2210820667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88e407be70 0x7f88e419c440 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:32.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:31.848+0000 7f88ebdc0700 1 -- 172.21.15.2:0/2210820667 >> 172.21.15.2:0/2210820667 conn(0x7f88e4101bd0 msgr2=0x7f88e4103290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:32.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:31.848+0000 7f88ebdc0700 1 -- 172.21.15.2:0/2210820667 shutdown_connections 2024-09-13T22:46:32.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:31.848+0000 7f88ebdc0700 1 -- 172.21.15.2:0/2210820667 wait complete. 2024-09-13T22:46:33.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:32 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2210820667' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-13T22:46:33.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:32 smithi002 ceph-mon[27637]: mgrmap e5: smithi002.yumtzz(active, since 6s) 2024-09-13T22:46:33.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:46:33.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-13T22:46:33.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T22:46:33.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "smithi002.yumtzz", 2024-09-13T22:46:33.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T22:46:33.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:46:33.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.813+0000 7fc0765cc700 1 Processor -- start 2024-09-13T22:46:33.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.813+0000 7fc0765cc700 1 -- start start 2024-09-13T22:46:33.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.813+0000 7fc0765cc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070108810 0x7fc070108c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:33.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.813+0000 7fc0765cc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc070109200 con 0x7fc070108810 2024-09-13T22:46:33.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.813+0000 7fc06ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070108810 0x7fc070108c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:33.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.813+0000 7fc06ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070108810 0x7fc070108c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60760/0 (socket says 172.21.15.2:60760) 2024-09-13T22:46:33.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.813+0000 7fc06ffff700 1 -- 172.21.15.2:0/376294113 learned_addr learned my addr 172.21.15.2:0/376294113 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:33.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.814+0000 7fc06ffff700 1 -- 172.21.15.2:0/376294113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc070109a10 con 0x7fc070108810 2024-09-13T22:46:33.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.814+0000 7fc06ffff700 1 --2- 172.21.15.2:0/376294113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070108810 0x7fc070108c30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc0600098a0 tx=0x7fc060009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4bdd590232bd655 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:33.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.814+0000 7fc06effd700 1 -- 172.21.15.2:0/376294113 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc060004180 con 0x7fc070108810 2024-09-13T22:46:33.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.814+0000 7fc06effd700 1 -- 172.21.15.2:0/376294113 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc0600042e0 con 0x7fc070108810 2024-09-13T22:46:33.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.814+0000 7fc06effd700 1 -- 172.21.15.2:0/376294113 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc060011a50 con 0x7fc070108810 2024-09-13T22:46:33.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.815+0000 7fc0765cc700 1 -- 172.21.15.2:0/376294113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070108810 msgr2=0x7fc070108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:33.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.815+0000 7fc0765cc700 1 --2- 172.21.15.2:0/376294113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070108810 0x7fc070108c30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc0600098a0 tx=0x7fc060009bb0 comp rx=0 tx=0).stop 2024-09-13T22:46:33.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.815+0000 7fc0765cc700 1 -- 172.21.15.2:0/376294113 shutdown_connections 2024-09-13T22:46:33.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.815+0000 7fc0765cc700 1 --2- 172.21.15.2:0/376294113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070108810 0x7fc070108c30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:33.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.815+0000 7fc0765cc700 1 -- 172.21.15.2:0/376294113 >> 172.21.15.2:0/376294113 conn(0x7fc07007bbf0 msgr2=0x7fc0701064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:33.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.815+0000 7fc0765cc700 1 -- 172.21.15.2:0/376294113 shutdown_connections 2024-09-13T22:46:33.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.815+0000 7fc0765cc700 1 -- 172.21.15.2:0/376294113 wait complete. 2024-09-13T22:46:33.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.815+0000 7fc0765cc700 1 Processor -- start 2024-09-13T22:46:33.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.815+0000 7fc0765cc700 1 -- start start 2024-09-13T22:46:33.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.816+0000 7fc0765cc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070108810 0x7fc07019c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:33.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.816+0000 7fc0765cc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07019c9f0 con 0x7fc070108810 2024-09-13T22:46:33.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.816+0000 7fc06ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070108810 0x7fc07019c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:33.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.816+0000 7fc06ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070108810 0x7fc07019c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60762/0 (socket says 172.21.15.2:60762) 2024-09-13T22:46:33.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.816+0000 7fc06ffff700 1 -- 172.21.15.2:0/2489748323 learned_addr learned my addr 172.21.15.2:0/2489748323 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:33.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.816+0000 7fc06ffff700 1 -- 172.21.15.2:0/2489748323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc060009550 con 0x7fc070108810 2024-09-13T22:46:33.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.816+0000 7fc06ffff700 1 --2- 172.21.15.2:0/2489748323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070108810 0x7fc07019c4b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc060006af0 tx=0x7fc060011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:33.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.817+0000 7fc06d7fa700 1 -- 172.21.15.2:0/2489748323 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc060003b90 con 0x7fc070108810 2024-09-13T22:46:33.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.817+0000 7fc0765cc700 1 -- 172.21.15.2:0/2489748323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07019cbf0 con 0x7fc070108810 2024-09-13T22:46:33.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.817+0000 7fc06d7fa700 1 -- 172.21.15.2:0/2489748323 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc06001a8a0 con 0x7fc070108810 2024-09-13T22:46:33.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.817+0000 7fc06d7fa700 1 -- 172.21.15.2:0/2489748323 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc060019880 con 0x7fc070108810 2024-09-13T22:46:33.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.817+0000 7fc0765cc700 1 -- 172.21.15.2:0/2489748323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07019d010 con 0x7fc070108810 2024-09-13T22:46:33.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.818+0000 7fc06d7fa700 1 -- 172.21.15.2:0/2489748323 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fc060019af0 con 0x7fc070108810 2024-09-13T22:46:33.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.818+0000 7fc0765cc700 1 -- 172.21.15.2:0/2489748323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0700623c0 con 0x7fc070108810 2024-09-13T22:46:33.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.818+0000 7fc06d7fa700 1 --2- 172.21.15.2:0/2489748323 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc058038330 0x7fc05803a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:33.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.818+0000 7fc06d7fa700 1 -- 172.21.15.2:0/2489748323 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc06004c680 con 0x7fc070108810 2024-09-13T22:46:33.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.818+0000 7fc06f7fe700 1 -- 172.21.15.2:0/2489748323 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc058038330 msgr2=0x7fc05803a7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2 2024-09-13T22:46:33.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.818+0000 7fc06f7fe700 1 --2- 172.21.15.2:0/2489748323 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc058038330 0x7fc05803a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T22:46:33.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:32.827+0000 7fc06d7fa700 1 -- 172.21.15.2:0/2489748323 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc06002b750 con 0x7fc070108810 2024-09-13T22:46:33.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:33.019+0000 7fc06f7fe700 1 -- 172.21.15.2:0/2489748323 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc058038330 msgr2=0x7fc05803a7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2 2024-09-13T22:46:33.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:33.019+0000 7fc06f7fe700 1 --2- 172.21.15.2:0/2489748323 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc058038330 0x7fc05803a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T22:46:33.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:33.084+0000 7fc0765cc700 1 -- 172.21.15.2:0/2489748323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fc07019fe70 con 0x7fc070108810 2024-09-13T22:46:33.710 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:33.085+0000 7fc06d7fa700 1 -- 172.21.15.2:0/2489748323 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fc0600172b0 con 0x7fc070108810 2024-09-13T22:46:33.710 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:33.087+0000 7fc0765cc700 1 -- 172.21.15.2:0/2489748323 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc058038330 msgr2=0x7fc05803a7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T22:46:33.710 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:33.087+0000 7fc0765cc700 1 --2- 172.21.15.2:0/2489748323 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc058038330 0x7fc05803a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:33.710 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:33.087+0000 7fc0765cc700 1 -- 172.21.15.2:0/2489748323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070108810 msgr2=0x7fc07019c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:33.710 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:33.087+0000 7fc0765cc700 1 --2- 172.21.15.2:0/2489748323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070108810 0x7fc07019c4b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc060006af0 tx=0x7fc060011a90 comp rx=0 tx=0).stop 2024-09-13T22:46:33.710 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:33.087+0000 7fc0765cc700 1 -- 172.21.15.2:0/2489748323 shutdown_connections 2024-09-13T22:46:33.710 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:33.087+0000 7fc0765cc700 1 --2- 172.21.15.2:0/2489748323 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc058038330 0x7fc05803a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:33.710 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:33.087+0000 7fc0765cc700 1 --2- 172.21.15.2:0/2489748323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc070108810 0x7fc07019c4b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:33.710 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:33.087+0000 7fc0765cc700 1 -- 172.21.15.2:0/2489748323 >> 172.21.15.2:0/2489748323 conn(0x7fc07007bbf0 msgr2=0x7fc070105e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:33.710 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:33.087+0000 7fc0765cc700 1 -- 172.21.15.2:0/2489748323 shutdown_connections 2024-09-13T22:46:33.710 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:33.087+0000 7fc0765cc700 1 -- 172.21.15.2:0/2489748323 wait complete. 2024-09-13T22:46:33.710 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-09-13T22:46:33.710 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 5... 2024-09-13T22:46:33.958 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:33 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2489748323' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T22:46:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:38 smithi002 ceph-mon[27637]: Active manager daemon smithi002.yumtzz restarted 2024-09-13T22:46:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:38 smithi002 ceph-mon[27637]: Activating manager daemon smithi002.yumtzz 2024-09-13T22:46:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:38 smithi002 ceph-mon[27637]: osdmap e2: 0 total, 0 up, 0 in 2024-09-13T22:46:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:38 smithi002 ceph-mon[27637]: mgrmap e6: smithi002.yumtzz(active, starting, since 0.00338019s) 2024-09-13T22:46:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:38 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T22:46:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:38 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr metadata", "who": "smithi002.yumtzz", "id": "smithi002.yumtzz"}]: dispatch 2024-09-13T22:46:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:38 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:46:39.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:38 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:46:39.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:38 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:46:39.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:38 smithi002 ceph-mon[27637]: Manager daemon smithi002.yumtzz is now available 2024-09-13T22:46:39.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:38 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:39.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:38 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:39.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:38 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:46:39.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:38 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:46:39.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:38 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:46:39.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:38 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.yumtzz/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:46:40.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:39 smithi002 ceph-mon[27637]: Found migration_current of "None". Setting to last migration. 2024-09-13T22:46:40.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:39 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.yumtzz/trash_purge_schedule"}]: dispatch 2024-09-13T22:46:40.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:39 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:40.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:39 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:40.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:39 smithi002 ceph-mon[27637]: mgrmap e7: smithi002.yumtzz(active, since 1.00488s) 2024-09-13T22:46:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:46:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-13T22:46:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T22:46:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:46:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.155+0000 7f76c9ad5700 1 Processor -- start 2024-09-13T22:46:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.155+0000 7f76c9ad5700 1 -- start start 2024-09-13T22:46:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.155+0000 7f76c9ad5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76c41070d0 0x7f76c41094c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.155+0000 7f76c9ad5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c40745d0 con 0x7f76c41070d0 2024-09-13T22:46:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.155+0000 7f76c37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76c41070d0 0x7f76c41094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.155+0000 7f76c37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76c41070d0 0x7f76c41094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60772/0 (socket says 172.21.15.2:60772) 2024-09-13T22:46:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.155+0000 7f76c37fe700 1 -- 172.21.15.2:0/1054409825 learned_addr learned my addr 172.21.15.2:0/1054409825 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.155+0000 7f76c37fe700 1 -- 172.21.15.2:0/1054409825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c4109a00 con 0x7f76c41070d0 2024-09-13T22:46:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.156+0000 7f76c37fe700 1 --2- 172.21.15.2:0/1054409825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76c41070d0 0x7f76c41094c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f76b40098a0 tx=0x7f76b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451c68bb03cf448b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.156+0000 7f76c27fc700 1 -- 172.21.15.2:0/1054409825 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76b4004180 con 0x7f76c41070d0 2024-09-13T22:46:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.156+0000 7f76c27fc700 1 -- 172.21.15.2:0/1054409825 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f76b40042e0 con 0x7f76c41070d0 2024-09-13T22:46:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.156+0000 7f76c27fc700 1 -- 172.21.15.2:0/1054409825 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76b4011a50 con 0x7f76c41070d0 2024-09-13T22:46:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.157+0000 7f76c9ad5700 1 -- 172.21.15.2:0/1054409825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76c41070d0 msgr2=0x7f76c41094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.157+0000 7f76c9ad5700 1 --2- 172.21.15.2:0/1054409825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76c41070d0 0x7f76c41094c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f76b40098a0 tx=0x7f76b4009bb0 comp rx=0 tx=0).stop 2024-09-13T22:46:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.157+0000 7f76c9ad5700 1 -- 172.21.15.2:0/1054409825 shutdown_connections 2024-09-13T22:46:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.157+0000 7f76c9ad5700 1 --2- 172.21.15.2:0/1054409825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76c41070d0 0x7f76c41094c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.157+0000 7f76c9ad5700 1 -- 172.21.15.2:0/1054409825 >> 172.21.15.2:0/1054409825 conn(0x7f76c4100ac0 msgr2=0x7f76c4102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.157+0000 7f76c9ad5700 1 -- 172.21.15.2:0/1054409825 shutdown_connections 2024-09-13T22:46:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.157+0000 7f76c9ad5700 1 -- 172.21.15.2:0/1054409825 wait complete. 2024-09-13T22:46:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.157+0000 7f76c9ad5700 1 Processor -- start 2024-09-13T22:46:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.158+0000 7f76c9ad5700 1 -- start start 2024-09-13T22:46:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.158+0000 7f76c9ad5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76c41070d0 0x7f76c419a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.158+0000 7f76c9ad5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c419a7e0 con 0x7f76c41070d0 2024-09-13T22:46:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.158+0000 7f76c37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76c41070d0 0x7f76c419a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.158+0000 7f76c37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76c41070d0 0x7f76c419a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60776/0 (socket says 172.21.15.2:60776) 2024-09-13T22:46:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.158+0000 7f76c37fe700 1 -- 172.21.15.2:0/548674238 learned_addr learned my addr 172.21.15.2:0/548674238 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.158+0000 7f76c37fe700 1 -- 172.21.15.2:0/548674238 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b4009550 con 0x7f76c41070d0 2024-09-13T22:46:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.159+0000 7f76c37fe700 1 --2- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76c41070d0 0x7f76c419a2a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f76b4000c00 tx=0x7f76b4011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.159+0000 7f76c0ff9700 1 -- 172.21.15.2:0/548674238 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76b4003b90 con 0x7f76c41070d0 2024-09-13T22:46:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.159+0000 7f76c0ff9700 1 -- 172.21.15.2:0/548674238 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f76b40248b0 con 0x7f76c41070d0 2024-09-13T22:46:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.159+0000 7f76c9ad5700 1 -- 172.21.15.2:0/548674238 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c419a9e0 con 0x7f76c41070d0 2024-09-13T22:46:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.159+0000 7f76c9ad5700 1 -- 172.21.15.2:0/548674238 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c419ae00 con 0x7f76c41070d0 2024-09-13T22:46:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.159+0000 7f76c0ff9700 1 -- 172.21.15.2:0/548674238 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f76b401a8e0 con 0x7f76c41070d0 2024-09-13T22:46:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.160+0000 7f76c0ff9700 1 -- 172.21.15.2:0/548674238 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f76b4024a20 con 0x7f76c41070d0 2024-09-13T22:46:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.160+0000 7f76c0ff9700 1 --2- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f76ac038320 0x7f76ac03a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.160+0000 7f76c0ff9700 1 -- 172.21.15.2:0/548674238 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76ac03aef0 con 0x7f76ac038320 2024-09-13T22:46:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.160+0000 7f76c0ff9700 1 -- 172.21.15.2:0/548674238 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f76b404c150 con 0x7f76c41070d0 2024-09-13T22:46:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.160+0000 7f76c2ffd700 1 -- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f76ac038320 msgr2=0x7f76ac03a7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2 2024-09-13T22:46:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.160+0000 7f76c2ffd700 1 --2- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f76ac038320 0x7f76ac03a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T22:46:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.361+0000 7f76c2ffd700 1 -- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f76ac038320 msgr2=0x7f76ac03a7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2 2024-09-13T22:46:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.361+0000 7f76c2ffd700 1 --2- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f76ac038320 0x7f76ac03a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T22:46:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.762+0000 7f76c2ffd700 1 -- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f76ac038320 msgr2=0x7f76ac03a7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2 2024-09-13T22:46:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:34.762+0000 7f76c2ffd700 1 --2- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f76ac038320 0x7f76ac03a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T22:46:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:35.563+0000 7f76c2ffd700 1 -- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f76ac038320 msgr2=0x7f76ac03a7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2 2024-09-13T22:46:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:35.563+0000 7f76c2ffd700 1 --2- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f76ac038320 0x7f76ac03a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T22:46:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:37.163+0000 7f76c2ffd700 1 -- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f76ac038320 msgr2=0x7f76ac03a7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2 2024-09-13T22:46:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:37.163+0000 7f76c2ffd700 1 --2- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f76ac038320 0x7f76ac03a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-13T22:46:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:38.904+0000 7f76c0ff9700 1 -- 172.21.15.2:0/548674238 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 6) v1 ==== 45050+0+0 (secure 0 0 0) 0x7f76b4024440 con 0x7f76c41070d0 2024-09-13T22:46:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:38.904+0000 7f76c0ff9700 1 -- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f76ac038320 msgr2=0x7f76ac03a7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T22:46:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:38.904+0000 7f76c0ff9700 1 --2- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f76ac038320 0x7f76ac03a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:39.905+0000 7f76c0ff9700 1 -- 172.21.15.2:0/548674238 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 7) v1 ==== 45177+0+0 (secure 0 0 0) 0x7f76b404d5c0 con 0x7f76c41070d0 2024-09-13T22:46:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:39.905+0000 7f76c0ff9700 1 --2- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f76ac038320 0x7f76ac03a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:39.905+0000 7f76c0ff9700 1 -- 172.21.15.2:0/548674238 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76ac03aef0 con 0x7f76ac038320 2024-09-13T22:46:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:39.905+0000 7f76c2ffd700 1 --2- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f76ac038320 0x7f76ac03a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:39.906+0000 7f76c2ffd700 1 --2- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f76ac038320 0x7f76ac03a7e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f76b8003a10 tx=0x7f76b8009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:39.907+0000 7f76c0ff9700 1 -- 172.21.15.2:0/548674238 <== mgr.14120 v2:172.21.15.2:6800/2 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f76ac03aef0 con 0x7f76ac038320 2024-09-13T22:46:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:39.918+0000 7f76c9ad5700 1 -- 172.21.15.2:0/548674238 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f76c419b5e0 con 0x7f76ac038320 2024-09-13T22:46:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:39.918+0000 7f76c0ff9700 1 -- 172.21.15.2:0/548674238 <== mgr.14120 v2:172.21.15.2:6800/2 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f76c419b5e0 con 0x7f76ac038320 2024-09-13T22:46:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:39.918+0000 7f76c9ad5700 1 -- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f76ac038320 msgr2=0x7f76ac03a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:39.918+0000 7f76c9ad5700 1 --2- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f76ac038320 0x7f76ac03a7e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f76b8003a10 tx=0x7f76b8009290 comp rx=0 tx=0).stop 2024-09-13T22:46:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:39.918+0000 7f76c9ad5700 1 -- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76c41070d0 msgr2=0x7f76c419a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:39.918+0000 7f76c9ad5700 1 --2- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76c41070d0 0x7f76c419a2a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f76b4000c00 tx=0x7f76b4011ab0 comp rx=0 tx=0).stop 2024-09-13T22:46:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:39.918+0000 7f76c9ad5700 1 -- 172.21.15.2:0/548674238 shutdown_connections 2024-09-13T22:46:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:39.918+0000 7f76c9ad5700 1 --2- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f76ac038320 0x7f76ac03a7e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:39.918+0000 7f76c9ad5700 1 --2- 172.21.15.2:0/548674238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76c41070d0 0x7f76c419a2a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:39.918+0000 7f76c9ad5700 1 -- 172.21.15.2:0/548674238 >> 172.21.15.2:0/548674238 conn(0x7f76c4100ac0 msgr2=0x7f76c4101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:39.918+0000 7f76c9ad5700 1 -- 172.21.15.2:0/548674238 shutdown_connections 2024-09-13T22:46:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:39.918+0000 7f76c9ad5700 1 -- 172.21.15.2:0/548674238 wait complete. 2024-09-13T22:46:40.470 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 5 is available 2024-09-13T22:46:40.470 INFO:teuthology.orchestra.run.smithi002.stdout:Setting orchestrator backend to cephadm... 2024-09-13T22:46:41.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:40 smithi002 ceph-mon[27637]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T22:46:41.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:40 smithi002 ceph-mon[27637]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T22:46:41.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:40 smithi002 ceph-mon[27637]: [13/Sep/2024:22:46:40] ENGINE Bus STARTING 2024-09-13T22:46:41.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:40 smithi002 ceph-mon[27637]: [13/Sep/2024:22:46:40] ENGINE Serving on http://172.21.15.2:8765 2024-09-13T22:46:41.145 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:40 smithi002 ceph-mon[27637]: [13/Sep/2024:22:46:40] ENGINE Serving on https://172.21.15.2:7150 2024-09-13T22:46:41.145 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:40 smithi002 ceph-mon[27637]: [13/Sep/2024:22:46:40] ENGINE Bus STARTED 2024-09-13T22:46:41.145 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:40 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:46:41.609 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.911+0000 7fe89ee8a700 1 Processor -- start 2024-09-13T22:46:41.609 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.911+0000 7fe89ee8a700 1 -- start start 2024-09-13T22:46:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.911+0000 7fe89ee8a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe898106b90 0x7fe898106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.911+0000 7fe89ee8a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe898107580 con 0x7fe898106b90 2024-09-13T22:46:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.913+0000 7fe89cc26700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe898106b90 0x7fe898106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.913+0000 7fe89cc26700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe898106b90 0x7fe898106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37756/0 (socket says 172.21.15.2:37756) 2024-09-13T22:46:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.913+0000 7fe89cc26700 1 -- 172.21.15.2:0/1318568546 learned_addr learned my addr 172.21.15.2:0/1318568546 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.913+0000 7fe89cc26700 1 -- 172.21.15.2:0/1318568546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8981076c0 con 0x7fe898106b90 2024-09-13T22:46:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.913+0000 7fe89cc26700 1 --2- 172.21.15.2:0/1318568546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe898106b90 0x7fe898106fb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe88c0098a0 tx=0x7fe88c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa5b074fd324466 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.913+0000 7fe8977fe700 1 -- 172.21.15.2:0/1318568546 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe88c004180 con 0x7fe898106b90 2024-09-13T22:46:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.913+0000 7fe8977fe700 1 -- 172.21.15.2:0/1318568546 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe88c0042e0 con 0x7fe898106b90 2024-09-13T22:46:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.913+0000 7fe8977fe700 1 -- 172.21.15.2:0/1318568546 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe88c011a50 con 0x7fe898106b90 2024-09-13T22:46:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.914+0000 7fe89ee8a700 1 -- 172.21.15.2:0/1318568546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe898106b90 msgr2=0x7fe898106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.914+0000 7fe89ee8a700 1 --2- 172.21.15.2:0/1318568546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe898106b90 0x7fe898106fb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe88c0098a0 tx=0x7fe88c009bb0 comp rx=0 tx=0).stop 2024-09-13T22:46:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.914+0000 7fe89ee8a700 1 -- 172.21.15.2:0/1318568546 shutdown_connections 2024-09-13T22:46:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.914+0000 7fe89ee8a700 1 --2- 172.21.15.2:0/1318568546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe898106b90 0x7fe898106fb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.914+0000 7fe89ee8a700 1 -- 172.21.15.2:0/1318568546 >> 172.21.15.2:0/1318568546 conn(0x7fe898100230 msgr2=0x7fe898102670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.914+0000 7fe89ee8a700 1 -- 172.21.15.2:0/1318568546 shutdown_connections 2024-09-13T22:46:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.914+0000 7fe89ee8a700 1 -- 172.21.15.2:0/1318568546 wait complete. 2024-09-13T22:46:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.914+0000 7fe89ee8a700 1 Processor -- start 2024-09-13T22:46:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.915+0000 7fe89ee8a700 1 -- start start 2024-09-13T22:46:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.915+0000 7fe89ee8a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe898106b90 0x7fe89819c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.915+0000 7fe89ee8a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89819c9e0 con 0x7fe898106b90 2024-09-13T22:46:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.915+0000 7fe89cc26700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe898106b90 0x7fe89819c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.915+0000 7fe89cc26700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe898106b90 0x7fe89819c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37772/0 (socket says 172.21.15.2:37772) 2024-09-13T22:46:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.915+0000 7fe89cc26700 1 -- 172.21.15.2:0/3179378045 learned_addr learned my addr 172.21.15.2:0/3179378045 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.915+0000 7fe89cc26700 1 -- 172.21.15.2:0/3179378045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c009550 con 0x7fe898106b90 2024-09-13T22:46:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.915+0000 7fe89cc26700 1 --2- 172.21.15.2:0/3179378045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe898106b90 0x7fe89819c4a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe88c0119e0 tx=0x7fe88c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.915+0000 7fe895ffb700 1 -- 172.21.15.2:0/3179378045 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe88c003b90 con 0x7fe898106b90 2024-09-13T22:46:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.915+0000 7fe895ffb700 1 -- 172.21.15.2:0/3179378045 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe88c01a8a0 con 0x7fe898106b90 2024-09-13T22:46:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.915+0000 7fe89ee8a700 1 -- 172.21.15.2:0/3179378045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89819cbe0 con 0x7fe898106b90 2024-09-13T22:46:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.915+0000 7fe895ffb700 1 -- 172.21.15.2:0/3179378045 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe88c019930 con 0x7fe898106b90 2024-09-13T22:46:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.915+0000 7fe89ee8a700 1 -- 172.21.15.2:0/3179378045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89819d000 con 0x7fe898106b90 2024-09-13T22:46:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.915+0000 7fe895ffb700 1 -- 172.21.15.2:0/3179378045 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 7) v1 ==== 45177+0+0 (secure 0 0 0) 0x7fe88c019ba0 con 0x7fe898106b90 2024-09-13T22:46:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.917+0000 7fe89ee8a700 1 -- 172.21.15.2:0/3179378045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8981961f0 con 0x7fe898106b90 2024-09-13T22:46:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.917+0000 7fe895ffb700 1 --2- 172.21.15.2:0/3179378045 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe888038260 0x7fe88803a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.917+0000 7fe895ffb700 1 -- 172.21.15.2:0/3179378045 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe88c04c6c0 con 0x7fe898106b90 2024-09-13T22:46:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.917+0000 7fe897fff700 1 --2- 172.21.15.2:0/3179378045 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe888038260 0x7fe88803a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.917+0000 7fe897fff700 1 --2- 172.21.15.2:0/3179378045 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe888038260 0x7fe88803a720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe884006fd0 tx=0x7fe884006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:40.922+0000 7fe895ffb700 1 -- 172.21.15.2:0/3179378045 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe88c02d440 con 0x7fe898106b90 2024-09-13T22:46:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:41.140+0000 7fe89ee8a700 1 -- 172.21.15.2:0/3179378045 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8980611d0 con 0x7fe888038260 2024-09-13T22:46:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:41.145+0000 7fe895ffb700 1 -- 172.21.15.2:0/3179378045 <== mgr.14120 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe8980611d0 con 0x7fe888038260 2024-09-13T22:46:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:41.147+0000 7fe89ee8a700 1 -- 172.21.15.2:0/3179378045 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe888038260 msgr2=0x7fe88803a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:41.147+0000 7fe89ee8a700 1 --2- 172.21.15.2:0/3179378045 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe888038260 0x7fe88803a720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe884006fd0 tx=0x7fe884006e40 comp rx=0 tx=0).stop 2024-09-13T22:46:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:41.147+0000 7fe89ee8a700 1 -- 172.21.15.2:0/3179378045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe898106b90 msgr2=0x7fe89819c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:41.147+0000 7fe89ee8a700 1 --2- 172.21.15.2:0/3179378045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe898106b90 0x7fe89819c4a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe88c0119e0 tx=0x7fe88c011ac0 comp rx=0 tx=0).stop 2024-09-13T22:46:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:41.147+0000 7fe89ee8a700 1 -- 172.21.15.2:0/3179378045 shutdown_connections 2024-09-13T22:46:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:41.147+0000 7fe89ee8a700 1 --2- 172.21.15.2:0/3179378045 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe888038260 0x7fe88803a720 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:41.147+0000 7fe89ee8a700 1 --2- 172.21.15.2:0/3179378045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe898106b90 0x7fe89819c4a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:41.148+0000 7fe89ee8a700 1 -- 172.21.15.2:0/3179378045 >> 172.21.15.2:0/3179378045 conn(0x7fe898100230 msgr2=0x7fe898193330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:41.148+0000 7fe89ee8a700 1 -- 172.21.15.2:0/3179378045 shutdown_connections 2024-09-13T22:46:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:41.148+0000 7fe89ee8a700 1 -- 172.21.15.2:0/3179378045 wait complete. 2024-09-13T22:46:42.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:42 smithi002 ceph-mon[27637]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:42.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:42 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:42.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:42 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:46:42.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:42 smithi002 ceph-mon[27637]: mgrmap e8: smithi002.yumtzz(active, since 2s) 2024-09-13T22:46:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-13T22:46:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.045+0000 7ff718110700 1 Processor -- start 2024-09-13T22:46:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.045+0000 7ff718110700 1 -- start start 2024-09-13T22:46:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.045+0000 7ff718110700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff710104e80 0x7ff7101052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.045+0000 7ff718110700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff710079f80 con 0x7ff710104e80 2024-09-13T22:46:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.045+0000 7ff715eac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff710104e80 0x7ff7101052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.045+0000 7ff715eac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff710104e80 0x7ff7101052a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37786/0 (socket says 172.21.15.2:37786) 2024-09-13T22:46:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.045+0000 7ff715eac700 1 -- 172.21.15.2:0/3667138746 learned_addr learned my addr 172.21.15.2:0/3667138746 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.046+0000 7ff715eac700 1 -- 172.21.15.2:0/3667138746 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7101057e0 con 0x7ff710104e80 2024-09-13T22:46:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.046+0000 7ff715eac700 1 --2- 172.21.15.2:0/3667138746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff710104e80 0x7ff7101052a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0098a0 tx=0x7ff70c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c24c20f31efce91 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.046+0000 7ff714eaa700 1 -- 172.21.15.2:0/3667138746 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff70c004180 con 0x7ff710104e80 2024-09-13T22:46:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.046+0000 7ff714eaa700 1 -- 172.21.15.2:0/3667138746 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff70c0042e0 con 0x7ff710104e80 2024-09-13T22:46:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.046+0000 7ff714eaa700 1 -- 172.21.15.2:0/3667138746 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff70c011a50 con 0x7ff710104e80 2024-09-13T22:46:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.047+0000 7ff718110700 1 -- 172.21.15.2:0/3667138746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff710104e80 msgr2=0x7ff7101052a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.047+0000 7ff718110700 1 --2- 172.21.15.2:0/3667138746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff710104e80 0x7ff7101052a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0098a0 tx=0x7ff70c009bb0 comp rx=0 tx=0).stop 2024-09-13T22:46:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.047+0000 7ff718110700 1 -- 172.21.15.2:0/3667138746 shutdown_connections 2024-09-13T22:46:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.047+0000 7ff718110700 1 --2- 172.21.15.2:0/3667138746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff710104e80 0x7ff7101052a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.047+0000 7ff718110700 1 -- 172.21.15.2:0/3667138746 >> 172.21.15.2:0/3667138746 conn(0x7ff710100ae0 msgr2=0x7ff710102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.047+0000 7ff718110700 1 -- 172.21.15.2:0/3667138746 shutdown_connections 2024-09-13T22:46:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.047+0000 7ff718110700 1 -- 172.21.15.2:0/3667138746 wait complete. 2024-09-13T22:46:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.047+0000 7ff718110700 1 Processor -- start 2024-09-13T22:46:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.047+0000 7ff718110700 1 -- start start 2024-09-13T22:46:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.048+0000 7ff718110700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff710104e80 0x7ff71019c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.048+0000 7ff718110700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71019cb00 con 0x7ff710104e80 2024-09-13T22:46:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.048+0000 7ff715eac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff710104e80 0x7ff71019c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.048+0000 7ff715eac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff710104e80 0x7ff71019c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37790/0 (socket says 172.21.15.2:37790) 2024-09-13T22:46:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.048+0000 7ff715eac700 1 -- 172.21.15.2:0/1466299327 learned_addr learned my addr 172.21.15.2:0/1466299327 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.048+0000 7ff715eac700 1 -- 172.21.15.2:0/1466299327 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c009550 con 0x7ff710104e80 2024-09-13T22:46:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.048+0000 7ff715eac700 1 --2- 172.21.15.2:0/1466299327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff710104e80 0x7ff71019c5c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0119e0 tx=0x7ff70c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.048+0000 7ff706ffd700 1 -- 172.21.15.2:0/1466299327 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff70c003b90 con 0x7ff710104e80 2024-09-13T22:46:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.048+0000 7ff706ffd700 1 -- 172.21.15.2:0/1466299327 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff70c01a8a0 con 0x7ff710104e80 2024-09-13T22:46:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.048+0000 7ff706ffd700 1 -- 172.21.15.2:0/1466299327 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff70c019930 con 0x7ff710104e80 2024-09-13T22:46:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.048+0000 7ff718110700 1 -- 172.21.15.2:0/1466299327 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71019cd00 con 0x7ff710104e80 2024-09-13T22:46:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.048+0000 7ff718110700 1 -- 172.21.15.2:0/1466299327 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71019d120 con 0x7ff710104e80 2024-09-13T22:46:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.049+0000 7ff706ffd700 1 -- 172.21.15.2:0/1466299327 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7ff70c019ba0 con 0x7ff710104e80 2024-09-13T22:46:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.049+0000 7ff718110700 1 -- 172.21.15.2:0/1466299327 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff710195e70 con 0x7ff710104e80 2024-09-13T22:46:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.049+0000 7ff706ffd700 1 --2- 172.21.15.2:0/1466299327 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff6fc038330 0x7ff6fc03a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.049+0000 7ff706ffd700 1 -- 172.21.15.2:0/1466299327 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff70c04c820 con 0x7ff710104e80 2024-09-13T22:46:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.049+0000 7ff7156ab700 1 --2- 172.21.15.2:0/1466299327 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff6fc038330 0x7ff6fc03a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.050+0000 7ff7156ab700 1 --2- 172.21.15.2:0/1466299327 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff6fc038330 0x7ff6fc03a7f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff700006fd0 tx=0x7ff700006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.054+0000 7ff706ffd700 1 -- 172.21.15.2:0/1466299327 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff70c02d440 con 0x7ff710104e80 2024-09-13T22:46:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.257+0000 7ff718110700 1 -- 172.21.15.2:0/1466299327 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7100611d0 con 0x7ff6fc038330 2024-09-13T22:46:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.258+0000 7ff706ffd700 1 -- 172.21.15.2:0/1466299327 <== mgr.14120 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7ff7100611d0 con 0x7ff6fc038330 2024-09-13T22:46:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.260+0000 7ff718110700 1 -- 172.21.15.2:0/1466299327 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff6fc038330 msgr2=0x7ff6fc03a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.260+0000 7ff718110700 1 --2- 172.21.15.2:0/1466299327 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff6fc038330 0x7ff6fc03a7f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff700006fd0 tx=0x7ff700006e40 comp rx=0 tx=0).stop 2024-09-13T22:46:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.260+0000 7ff718110700 1 -- 172.21.15.2:0/1466299327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff710104e80 msgr2=0x7ff71019c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.260+0000 7ff718110700 1 --2- 172.21.15.2:0/1466299327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff710104e80 0x7ff71019c5c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0119e0 tx=0x7ff70c011ac0 comp rx=0 tx=0).stop 2024-09-13T22:46:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.260+0000 7ff718110700 1 -- 172.21.15.2:0/1466299327 shutdown_connections 2024-09-13T22:46:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.260+0000 7ff718110700 1 --2- 172.21.15.2:0/1466299327 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff6fc038330 0x7ff6fc03a7f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:42.828 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.260+0000 7ff718110700 1 --2- 172.21.15.2:0/1466299327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff710104e80 0x7ff71019c5c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:42.828 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.260+0000 7ff718110700 1 -- 172.21.15.2:0/1466299327 >> 172.21.15.2:0/1466299327 conn(0x7ff710100ae0 msgr2=0x7ff710190a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:42.828 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.260+0000 7ff718110700 1 -- 172.21.15.2:0/1466299327 shutdown_connections 2024-09-13T22:46:42.828 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:42.260+0000 7ff718110700 1 -- 172.21.15.2:0/1466299327 wait complete. 2024-09-13T22:46:42.828 INFO:teuthology.orchestra.run.smithi002.stdout:Generating ssh key... 2024-09-13T22:46:43.386 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:43 smithi002 ceph-mon[27637]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.178+0000 7f97e55b3700 1 Processor -- start 2024-09-13T22:46:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.179+0000 7f97e55b3700 1 -- start start 2024-09-13T22:46:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.179+0000 7f97e55b3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e01054d0 0x7f97e01058f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.179+0000 7f97e55b3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e0105ec0 con 0x7f97e01054d0 2024-09-13T22:46:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.179+0000 7f97deffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e01054d0 0x7f97e01058f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.179+0000 7f97deffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e01054d0 0x7f97e01058f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37800/0 (socket says 172.21.15.2:37800) 2024-09-13T22:46:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.179+0000 7f97deffd700 1 -- 172.21.15.2:0/1638102705 learned_addr learned my addr 172.21.15.2:0/1638102705 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.179+0000 7f97deffd700 1 -- 172.21.15.2:0/1638102705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e01066d0 con 0x7f97e01054d0 2024-09-13T22:46:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.179+0000 7f97deffd700 1 --2- 172.21.15.2:0/1638102705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e01054d0 0x7f97e01058f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f97d00098a0 tx=0x7f97d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426fbcf261ffcbf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.180+0000 7f97ddffb700 1 -- 172.21.15.2:0/1638102705 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97d0004180 con 0x7f97e01054d0 2024-09-13T22:46:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.180+0000 7f97ddffb700 1 -- 172.21.15.2:0/1638102705 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f97d00042e0 con 0x7f97e01054d0 2024-09-13T22:46:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.180+0000 7f97ddffb700 1 -- 172.21.15.2:0/1638102705 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97d0011a50 con 0x7f97e01054d0 2024-09-13T22:46:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.180+0000 7f97e55b3700 1 -- 172.21.15.2:0/1638102705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e01054d0 msgr2=0x7f97e01058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.180+0000 7f97e55b3700 1 --2- 172.21.15.2:0/1638102705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e01054d0 0x7f97e01058f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f97d00098a0 tx=0x7f97d0009bb0 comp rx=0 tx=0).stop 2024-09-13T22:46:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.180+0000 7f97e55b3700 1 -- 172.21.15.2:0/1638102705 shutdown_connections 2024-09-13T22:46:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.180+0000 7f97e55b3700 1 --2- 172.21.15.2:0/1638102705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e01054d0 0x7f97e01058f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.180+0000 7f97e55b3700 1 -- 172.21.15.2:0/1638102705 >> 172.21.15.2:0/1638102705 conn(0x7f97e0100ad0 msgr2=0x7f97e0102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.180+0000 7f97e55b3700 1 -- 172.21.15.2:0/1638102705 shutdown_connections 2024-09-13T22:46:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.180+0000 7f97e55b3700 1 -- 172.21.15.2:0/1638102705 wait complete. 2024-09-13T22:46:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.181+0000 7f97e55b3700 1 Processor -- start 2024-09-13T22:46:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.181+0000 7f97e55b3700 1 -- start start 2024-09-13T22:46:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.181+0000 7f97e55b3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e01054d0 0x7f97e019b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.181+0000 7f97e55b3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e019bb50 con 0x7f97e01054d0 2024-09-13T22:46:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.181+0000 7f97deffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e01054d0 0x7f97e019b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.181+0000 7f97deffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e01054d0 0x7f97e019b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37816/0 (socket says 172.21.15.2:37816) 2024-09-13T22:46:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.181+0000 7f97deffd700 1 -- 172.21.15.2:0/1907871565 learned_addr learned my addr 172.21.15.2:0/1907871565 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.182+0000 7f97deffd700 1 -- 172.21.15.2:0/1907871565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d0009550 con 0x7f97e01054d0 2024-09-13T22:46:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.182+0000 7f97deffd700 1 --2- 172.21.15.2:0/1907871565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e01054d0 0x7f97e019b610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f97d0000c00 tx=0x7f97d0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.182+0000 7f97d7fff700 1 -- 172.21.15.2:0/1907871565 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97d0003b90 con 0x7f97e01054d0 2024-09-13T22:46:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.182+0000 7f97e55b3700 1 -- 172.21.15.2:0/1907871565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e019bd50 con 0x7f97e01054d0 2024-09-13T22:46:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.182+0000 7f97d7fff700 1 -- 172.21.15.2:0/1907871565 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f97d00248b0 con 0x7f97e01054d0 2024-09-13T22:46:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.182+0000 7f97d7fff700 1 -- 172.21.15.2:0/1907871565 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97d001a8e0 con 0x7f97e01054d0 2024-09-13T22:46:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.182+0000 7f97e55b3700 1 -- 172.21.15.2:0/1907871565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e0198240 con 0x7f97e01054d0 2024-09-13T22:46:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.183+0000 7f97d7fff700 1 -- 172.21.15.2:0/1907871565 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f97d001aba0 con 0x7f97e01054d0 2024-09-13T22:46:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.183+0000 7f97e55b3700 1 -- 172.21.15.2:0/1907871565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e019bee0 con 0x7f97e01054d0 2024-09-13T22:46:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.183+0000 7f97d7fff700 1 --2- 172.21.15.2:0/1907871565 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f97cc038320 0x7f97cc03a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.183+0000 7f97d7fff700 1 -- 172.21.15.2:0/1907871565 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f97d004c4d0 con 0x7f97e01054d0 2024-09-13T22:46:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.183+0000 7f97de7fc700 1 --2- 172.21.15.2:0/1907871565 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f97cc038320 0x7f97cc03a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.184+0000 7f97de7fc700 1 --2- 172.21.15.2:0/1907871565 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f97cc038320 0x7f97cc03a7e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f97c8006fd0 tx=0x7f97c8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.188+0000 7f97d7fff700 1 -- 172.21.15.2:0/1907871565 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f97d00233a0 con 0x7f97e01054d0 2024-09-13T22:46:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.385+0000 7f97e55b3700 1 -- 172.21.15.2:0/1907871565 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f97e0198d60 con 0x7f97cc038320 2024-09-13T22:46:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.581+0000 7f97d7fff700 1 -- 172.21.15.2:0/1907871565 <== mgr.14120 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f97e0198d60 con 0x7f97cc038320 2024-09-13T22:46:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.583+0000 7f97e55b3700 1 -- 172.21.15.2:0/1907871565 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f97cc038320 msgr2=0x7f97cc03a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.583+0000 7f97e55b3700 1 --2- 172.21.15.2:0/1907871565 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f97cc038320 0x7f97cc03a7e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f97c8006fd0 tx=0x7f97c8006e40 comp rx=0 tx=0).stop 2024-09-13T22:46:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.583+0000 7f97e55b3700 1 -- 172.21.15.2:0/1907871565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e01054d0 msgr2=0x7f97e019b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.583+0000 7f97e55b3700 1 --2- 172.21.15.2:0/1907871565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e01054d0 0x7f97e019b610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f97d0000c00 tx=0x7f97d0011ab0 comp rx=0 tx=0).stop 2024-09-13T22:46:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.583+0000 7f97e55b3700 1 -- 172.21.15.2:0/1907871565 shutdown_connections 2024-09-13T22:46:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.583+0000 7f97e55b3700 1 --2- 172.21.15.2:0/1907871565 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f97cc038320 0x7f97cc03a7e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.583+0000 7f97e55b3700 1 --2- 172.21.15.2:0/1907871565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97e01054d0 0x7f97e019b610 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.583+0000 7f97e55b3700 1 -- 172.21.15.2:0/1907871565 >> 172.21.15.2:0/1907871565 conn(0x7f97e0100ad0 msgr2=0x7f97e018eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.583+0000 7f97e55b3700 1 -- 172.21.15.2:0/1907871565 shutdown_connections 2024-09-13T22:46:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:43.584+0000 7f97e55b3700 1 -- 172.21.15.2:0/1907871565 wait complete. 2024-09-13T22:46:44.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:44 smithi002 ceph-mon[27637]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:44.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:44 smithi002 ceph-mon[27637]: Generating ssh key... 2024-09-13T22:46:44.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:44 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:44.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:44 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:45.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDInl3cB+LXS8NeXKfPd6KsGDUpIjNJc0xYbJQLyXbMxTWb0Ma4yV5SIePCj3XYI0yRilUfjZo1sB87L0lG+pDWy8eHcTDvO0q6uhMPh07UjdxCiIlmtCg+fLnD5n64CR5SezPrM6pyS2ZMvtUluvQ748Vty0pOnkiVK4yXKQMwM4/7lIuFuSoGSfq9f1mA+IKJHnj0vUbS/hcZAC3c4MH7KlLeyOIXmoTWsIJf5rNXmIhGq3NAPjmgAzlUcwn+fijB4Upi+/MHqO9oxwKixmUdsCkpHGk6zikQuVyCYwxe5/yKhUYUs/r4JQRhJACLSXnhRUwvZPv3AlymPScFezE0Z3+vXVasKX2aWPkc9FyHYBc/nratS54QNlXMkSqe5bnhqMqHeFdOJqAoPlmclr92arJKaueU4+rifQhTwQKEkYtuVT1c0WDrd+nv7bWxT3nwV0+59mfbPKbDvt/7LRFnqU5pnGHEUVteo9VkzEBQIJP0Cs2YMpLXju/Tx8+dHME= ceph-e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T22:46:45.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.548+0000 7f80b2175700 1 Processor -- start 2024-09-13T22:46:45.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.548+0000 7f80b2175700 1 -- start start 2024-09-13T22:46:45.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.549+0000 7f80b2175700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80ac1070d0 0x7f80ac1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:45.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.549+0000 7f80b2175700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac0745d0 con 0x7f80ac1070d0 2024-09-13T22:46:45.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.549+0000 7f80ab7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80ac1070d0 0x7f80ac1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:45.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.549+0000 7f80ab7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80ac1070d0 0x7f80ac1094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37818/0 (socket says 172.21.15.2:37818) 2024-09-13T22:46:45.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.549+0000 7f80ab7fe700 1 -- 172.21.15.2:0/3024167443 learned_addr learned my addr 172.21.15.2:0/3024167443 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:45.352 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.549+0000 7f80ab7fe700 1 -- 172.21.15.2:0/3024167443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac109a00 con 0x7f80ac1070d0 2024-09-13T22:46:45.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.549+0000 7f80ab7fe700 1 --2- 172.21.15.2:0/3024167443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80ac1070d0 0x7f80ac1094c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f809c0098a0 tx=0x7f809c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403ac42c23608133 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:45.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.549+0000 7f80aa7fc700 1 -- 172.21.15.2:0/3024167443 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f809c004180 con 0x7f80ac1070d0 2024-09-13T22:46:45.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.549+0000 7f80aa7fc700 1 -- 172.21.15.2:0/3024167443 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f809c0042e0 con 0x7f80ac1070d0 2024-09-13T22:46:45.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.549+0000 7f80aa7fc700 1 -- 172.21.15.2:0/3024167443 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f809c011a50 con 0x7f80ac1070d0 2024-09-13T22:46:45.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.550+0000 7f80b2175700 1 -- 172.21.15.2:0/3024167443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80ac1070d0 msgr2=0x7f80ac1094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:45.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.550+0000 7f80b2175700 1 --2- 172.21.15.2:0/3024167443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80ac1070d0 0x7f80ac1094c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f809c0098a0 tx=0x7f809c009bb0 comp rx=0 tx=0).stop 2024-09-13T22:46:45.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.550+0000 7f80b2175700 1 -- 172.21.15.2:0/3024167443 shutdown_connections 2024-09-13T22:46:45.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.550+0000 7f80b2175700 1 --2- 172.21.15.2:0/3024167443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80ac1070d0 0x7f80ac1094c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:45.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.550+0000 7f80b2175700 1 -- 172.21.15.2:0/3024167443 >> 172.21.15.2:0/3024167443 conn(0x7f80ac100ac0 msgr2=0x7f80ac102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:45.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.550+0000 7f80b2175700 1 -- 172.21.15.2:0/3024167443 shutdown_connections 2024-09-13T22:46:45.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.550+0000 7f80b2175700 1 -- 172.21.15.2:0/3024167443 wait complete. 2024-09-13T22:46:45.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.551+0000 7f80b2175700 1 Processor -- start 2024-09-13T22:46:45.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.551+0000 7f80b2175700 1 -- start start 2024-09-13T22:46:45.353 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.551+0000 7f80b2175700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80ac1070d0 0x7f80ac106a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:45.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.551+0000 7f80b2175700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac106f70 con 0x7f80ac1070d0 2024-09-13T22:46:45.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.551+0000 7f80ab7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80ac1070d0 0x7f80ac106a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:45.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.551+0000 7f80ab7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80ac1070d0 0x7f80ac106a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37826/0 (socket says 172.21.15.2:37826) 2024-09-13T22:46:45.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.551+0000 7f80ab7fe700 1 -- 172.21.15.2:0/107502244 learned_addr learned my addr 172.21.15.2:0/107502244 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:45.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.551+0000 7f80ab7fe700 1 -- 172.21.15.2:0/107502244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c009550 con 0x7f80ac1070d0 2024-09-13T22:46:45.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.552+0000 7f80ab7fe700 1 --2- 172.21.15.2:0/107502244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80ac1070d0 0x7f80ac106a30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f809c0119e0 tx=0x7f809c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:45.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.552+0000 7f80a8ff9700 1 -- 172.21.15.2:0/107502244 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f809c003b90 con 0x7f80ac1070d0 2024-09-13T22:46:45.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.552+0000 7f80b2175700 1 -- 172.21.15.2:0/107502244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ac105080 con 0x7f80ac1070d0 2024-09-13T22:46:45.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.552+0000 7f80a8ff9700 1 -- 172.21.15.2:0/107502244 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f809c01a8a0 con 0x7f80ac1070d0 2024-09-13T22:46:45.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.552+0000 7f80a8ff9700 1 -- 172.21.15.2:0/107502244 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f809c019930 con 0x7f80ac1070d0 2024-09-13T22:46:45.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.552+0000 7f80b2175700 1 -- 172.21.15.2:0/107502244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ac1054a0 con 0x7f80ac1070d0 2024-09-13T22:46:45.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.553+0000 7f80a8ff9700 1 -- 172.21.15.2:0/107502244 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f809c019bf0 con 0x7f80ac1070d0 2024-09-13T22:46:45.354 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.553+0000 7f80b2175700 1 -- 172.21.15.2:0/107502244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ac10a750 con 0x7f80ac1070d0 2024-09-13T22:46:45.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.553+0000 7f80a8ff9700 1 --2- 172.21.15.2:0/107502244 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f80940382e0 0x7f809403a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:45.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.553+0000 7f80a8ff9700 1 -- 172.21.15.2:0/107502244 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f809c04c740 con 0x7f80ac1070d0 2024-09-13T22:46:45.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.553+0000 7f80aaffd700 1 --2- 172.21.15.2:0/107502244 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f80940382e0 0x7f809403a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:45.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.553+0000 7f80aaffd700 1 --2- 172.21.15.2:0/107502244 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f80940382e0 0x7f809403a7a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f80a0006fd0 tx=0x7f80a0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:45.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.558+0000 7f80a8ff9700 1 -- 172.21.15.2:0/107502244 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f809c02d440 con 0x7f80ac1070d0 2024-09-13T22:46:45.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.761+0000 7f80b2175700 1 -- 172.21.15.2:0/107502244 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f80ac101f70 con 0x7f80940382e0 2024-09-13T22:46:45.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.762+0000 7f80a8ff9700 1 -- 172.21.15.2:0/107502244 <== mgr.14120 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f80ac101f70 con 0x7f80940382e0 2024-09-13T22:46:45.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.764+0000 7f80b2175700 1 -- 172.21.15.2:0/107502244 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f80940382e0 msgr2=0x7f809403a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:45.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.764+0000 7f80b2175700 1 --2- 172.21.15.2:0/107502244 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f80940382e0 0x7f809403a7a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f80a0006fd0 tx=0x7f80a0006e40 comp rx=0 tx=0).stop 2024-09-13T22:46:45.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.764+0000 7f80b2175700 1 -- 172.21.15.2:0/107502244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80ac1070d0 msgr2=0x7f80ac106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:45.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.764+0000 7f80b2175700 1 --2- 172.21.15.2:0/107502244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80ac1070d0 0x7f80ac106a30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f809c0119e0 tx=0x7f809c011ac0 comp rx=0 tx=0).stop 2024-09-13T22:46:45.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.764+0000 7f80b2175700 1 -- 172.21.15.2:0/107502244 shutdown_connections 2024-09-13T22:46:45.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.764+0000 7f80b2175700 1 --2- 172.21.15.2:0/107502244 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f80940382e0 0x7f809403a7a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:45.356 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.764+0000 7f80b2175700 1 --2- 172.21.15.2:0/107502244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80ac1070d0 0x7f80ac106a30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:45.356 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.764+0000 7f80b2175700 1 -- 172.21.15.2:0/107502244 >> 172.21.15.2:0/107502244 conn(0x7f80ac100ac0 msgr2=0x7f80ac101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:45.356 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.764+0000 7f80b2175700 1 -- 172.21.15.2:0/107502244 shutdown_connections 2024-09-13T22:46:45.356 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:44.764+0000 7f80b2175700 1 -- 172.21.15.2:0/107502244 wait complete. 2024-09-13T22:46:45.356 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-13T22:46:45.356 INFO:teuthology.orchestra.run.smithi002.stdout:Adding key to root@localhost authorized_keys... 2024-09-13T22:46:45.356 INFO:teuthology.orchestra.run.smithi002.stdout:Adding host smithi002... 2024-09-13T22:46:45.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:45 smithi002 ceph-mon[27637]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:47.065 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:46 smithi002 ceph-mon[27637]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:47.065 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:46 smithi002 ceph-mon[27637]: Deploying cephadm binary to smithi002 2024-09-13T22:46:49.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Added host 'smithi002' with addr '172.21.15.2' 2024-09-13T22:46:49.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.959+0000 7f545a8ef700 1 Processor -- start 2024-09-13T22:46:49.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.959+0000 7f545a8ef700 1 -- start start 2024-09-13T22:46:49.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.959+0000 7f545a8ef700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54541054d0 0x7f54541058f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:49.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.959+0000 7f545a8ef700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5454105ec0 con 0x7f54541054d0 2024-09-13T22:46:49.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.960+0000 7f5453fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54541054d0 0x7f54541058f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:49.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.960+0000 7f5453fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54541054d0 0x7f54541058f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37836/0 (socket says 172.21.15.2:37836) 2024-09-13T22:46:49.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.960+0000 7f5453fff700 1 -- 172.21.15.2:0/262761337 learned_addr learned my addr 172.21.15.2:0/262761337 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:49.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.960+0000 7f5453fff700 1 -- 172.21.15.2:0/262761337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54541066d0 con 0x7f54541054d0 2024-09-13T22:46:49.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.960+0000 7f5453fff700 1 --2- 172.21.15.2:0/262761337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54541054d0 0x7f54541058f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f54440098a0 tx=0x7f5444009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c4cf8ea91a886c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:49.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.960+0000 7f5452ffd700 1 -- 172.21.15.2:0/262761337 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5444004180 con 0x7f54541054d0 2024-09-13T22:46:49.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.960+0000 7f5452ffd700 1 -- 172.21.15.2:0/262761337 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f54440042e0 con 0x7f54541054d0 2024-09-13T22:46:49.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.960+0000 7f5452ffd700 1 -- 172.21.15.2:0/262761337 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5444011a50 con 0x7f54541054d0 2024-09-13T22:46:49.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.961+0000 7f545a8ef700 1 -- 172.21.15.2:0/262761337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54541054d0 msgr2=0x7f54541058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:49.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.961+0000 7f545a8ef700 1 --2- 172.21.15.2:0/262761337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54541054d0 0x7f54541058f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f54440098a0 tx=0x7f5444009bb0 comp rx=0 tx=0).stop 2024-09-13T22:46:49.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.961+0000 7f545a8ef700 1 -- 172.21.15.2:0/262761337 shutdown_connections 2024-09-13T22:46:49.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.961+0000 7f545a8ef700 1 --2- 172.21.15.2:0/262761337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54541054d0 0x7f54541058f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:49.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.961+0000 7f545a8ef700 1 -- 172.21.15.2:0/262761337 >> 172.21.15.2:0/262761337 conn(0x7f5454100ad0 msgr2=0x7f5454102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:49.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.961+0000 7f545a8ef700 1 -- 172.21.15.2:0/262761337 shutdown_connections 2024-09-13T22:46:49.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.961+0000 7f545a8ef700 1 -- 172.21.15.2:0/262761337 wait complete. 2024-09-13T22:46:49.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.962+0000 7f545a8ef700 1 Processor -- start 2024-09-13T22:46:49.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.962+0000 7f545a8ef700 1 -- start start 2024-09-13T22:46:49.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.962+0000 7f545a8ef700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54541054d0 0x7f545419a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:49.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.962+0000 7f545a8ef700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545419a800 con 0x7f54541054d0 2024-09-13T22:46:49.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.962+0000 7f5453fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54541054d0 0x7f545419a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:49.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.962+0000 7f5453fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54541054d0 0x7f545419a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37848/0 (socket says 172.21.15.2:37848) 2024-09-13T22:46:49.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.962+0000 7f5453fff700 1 -- 172.21.15.2:0/2417654703 learned_addr learned my addr 172.21.15.2:0/2417654703 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:49.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.962+0000 7f5453fff700 1 -- 172.21.15.2:0/2417654703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5444009550 con 0x7f54541054d0 2024-09-13T22:46:49.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.962+0000 7f5453fff700 1 --2- 172.21.15.2:0/2417654703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54541054d0 0x7f545419a2c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5444006af0 tx=0x7f5444011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:49.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.963+0000 7f54517fa700 1 -- 172.21.15.2:0/2417654703 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5444003b90 con 0x7f54541054d0 2024-09-13T22:46:49.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.963+0000 7f54517fa700 1 -- 172.21.15.2:0/2417654703 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f544401a8a0 con 0x7f54541054d0 2024-09-13T22:46:49.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.963+0000 7f545a8ef700 1 -- 172.21.15.2:0/2417654703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f545419aa00 con 0x7f54541054d0 2024-09-13T22:46:49.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.963+0000 7f54517fa700 1 -- 172.21.15.2:0/2417654703 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5444019880 con 0x7f54541054d0 2024-09-13T22:46:49.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.963+0000 7f545a8ef700 1 -- 172.21.15.2:0/2417654703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545419ae20 con 0x7f54541054d0 2024-09-13T22:46:49.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.964+0000 7f54517fa700 1 -- 172.21.15.2:0/2417654703 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f5444019af0 con 0x7f54541054d0 2024-09-13T22:46:49.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.964+0000 7f54517fa700 1 --2- 172.21.15.2:0/2417654703 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f543c038330 0x7f543c03a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:49.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.964+0000 7f54517fa700 1 -- 172.21.15.2:0/2417654703 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f544404c750 con 0x7f54541054d0 2024-09-13T22:46:49.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.964+0000 7f545a8ef700 1 -- 172.21.15.2:0/2417654703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54540623c0 con 0x7f54541054d0 2024-09-13T22:46:49.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.964+0000 7f54537fe700 1 --2- 172.21.15.2:0/2417654703 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f543c038330 0x7f543c03a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:49.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.964+0000 7f54537fe700 1 --2- 172.21.15.2:0/2417654703 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f543c038330 0x7f543c03a7f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5448006fd0 tx=0x7f5448006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:49.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:45.969+0000 7f54517fa700 1 -- 172.21.15.2:0/2417654703 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f544402c3a0 con 0x7f54541054d0 2024-09-13T22:46:49.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:46.171+0000 7f545a8ef700 1 -- 172.21.15.2:0/2417654703 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5454109900 con 0x7f543c038330 2024-09-13T22:46:49.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:48.595+0000 7f54517fa700 1 -- 172.21.15.2:0/2417654703 <== mgr.14120 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f5454109900 con 0x7f543c038330 2024-09-13T22:46:49.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:48.598+0000 7f545a8ef700 1 -- 172.21.15.2:0/2417654703 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f543c038330 msgr2=0x7f543c03a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:49.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:48.598+0000 7f545a8ef700 1 --2- 172.21.15.2:0/2417654703 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f543c038330 0x7f543c03a7f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5448006fd0 tx=0x7f5448006e40 comp rx=0 tx=0).stop 2024-09-13T22:46:49.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:48.598+0000 7f545a8ef700 1 -- 172.21.15.2:0/2417654703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54541054d0 msgr2=0x7f545419a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:49.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:48.598+0000 7f545a8ef700 1 --2- 172.21.15.2:0/2417654703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54541054d0 0x7f545419a2c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5444006af0 tx=0x7f5444011a90 comp rx=0 tx=0).stop 2024-09-13T22:46:49.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:48.598+0000 7f545a8ef700 1 -- 172.21.15.2:0/2417654703 shutdown_connections 2024-09-13T22:46:49.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:48.598+0000 7f545a8ef700 1 --2- 172.21.15.2:0/2417654703 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f543c038330 0x7f543c03a7f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:49.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:48.598+0000 7f545a8ef700 1 --2- 172.21.15.2:0/2417654703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54541054d0 0x7f545419a2c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:49.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:48.598+0000 7f545a8ef700 1 -- 172.21.15.2:0/2417654703 >> 172.21.15.2:0/2417654703 conn(0x7f5454100ad0 msgr2=0x7f54540798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:49.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:48.598+0000 7f545a8ef700 1 -- 172.21.15.2:0/2417654703 shutdown_connections 2024-09-13T22:46:49.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:48.598+0000 7f545a8ef700 1 -- 172.21.15.2:0/2417654703 wait complete. 2024-09-13T22:46:49.184 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying mon service with default placement... 2024-09-13T22:46:49.744 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:49 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:49.744 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:49 smithi002 ceph-mon[27637]: Added host smithi002 2024-09-13T22:46:49.744 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:49 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:46:50.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-13T22:46:50.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.580+0000 7fc458797700 1 Processor -- start 2024-09-13T22:46:50.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.580+0000 7fc458797700 1 -- start start 2024-09-13T22:46:50.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.580+0000 7fc458797700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc450107090 0x7fc450109480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:50.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.580+0000 7fc458797700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc450079f80 con 0x7fc450107090 2024-09-13T22:46:50.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.580+0000 7fc456533700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc450107090 0x7fc450109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:50.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.581+0000 7fc456533700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc450107090 0x7fc450109480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37854/0 (socket says 172.21.15.2:37854) 2024-09-13T22:46:50.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.581+0000 7fc456533700 1 -- 172.21.15.2:0/3328312019 learned_addr learned my addr 172.21.15.2:0/3328312019 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:50.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.581+0000 7fc456533700 1 -- 172.21.15.2:0/3328312019 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4501099c0 con 0x7fc450107090 2024-09-13T22:46:50.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.581+0000 7fc456533700 1 --2- 172.21.15.2:0/3328312019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc450107090 0x7fc450109480 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0098a0 tx=0x7fc44c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4767e4f6d20c1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:50.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.581+0000 7fc455531700 1 -- 172.21.15.2:0/3328312019 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc44c004180 con 0x7fc450107090 2024-09-13T22:46:50.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.581+0000 7fc455531700 1 -- 172.21.15.2:0/3328312019 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc44c0042e0 con 0x7fc450107090 2024-09-13T22:46:50.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.581+0000 7fc455531700 1 -- 172.21.15.2:0/3328312019 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc44c011a50 con 0x7fc450107090 2024-09-13T22:46:50.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.582+0000 7fc458797700 1 -- 172.21.15.2:0/3328312019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc450107090 msgr2=0x7fc450109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:50.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.582+0000 7fc458797700 1 --2- 172.21.15.2:0/3328312019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc450107090 0x7fc450109480 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0098a0 tx=0x7fc44c009bb0 comp rx=0 tx=0).stop 2024-09-13T22:46:50.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.582+0000 7fc458797700 1 -- 172.21.15.2:0/3328312019 shutdown_connections 2024-09-13T22:46:50.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.582+0000 7fc458797700 1 --2- 172.21.15.2:0/3328312019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc450107090 0x7fc450109480 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:50.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.582+0000 7fc458797700 1 -- 172.21.15.2:0/3328312019 >> 172.21.15.2:0/3328312019 conn(0x7fc450100ae0 msgr2=0x7fc450102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:50.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.582+0000 7fc458797700 1 -- 172.21.15.2:0/3328312019 shutdown_connections 2024-09-13T22:46:50.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.582+0000 7fc458797700 1 -- 172.21.15.2:0/3328312019 wait complete. 2024-09-13T22:46:50.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.583+0000 7fc458797700 1 Processor -- start 2024-09-13T22:46:50.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.583+0000 7fc458797700 1 -- start start 2024-09-13T22:46:50.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.583+0000 7fc458797700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc450107090 0x7fc45019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:50.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.583+0000 7fc458797700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45019a920 con 0x7fc450107090 2024-09-13T22:46:50.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.583+0000 7fc456533700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc450107090 0x7fc45019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:50.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.583+0000 7fc456533700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc450107090 0x7fc45019a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37870/0 (socket says 172.21.15.2:37870) 2024-09-13T22:46:50.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.583+0000 7fc456533700 1 -- 172.21.15.2:0/938995774 learned_addr learned my addr 172.21.15.2:0/938995774 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:50.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.584+0000 7fc456533700 1 -- 172.21.15.2:0/938995774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c009550 con 0x7fc450107090 2024-09-13T22:46:50.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.584+0000 7fc456533700 1 --2- 172.21.15.2:0/938995774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc450107090 0x7fc45019a3e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc44c000c00 tx=0x7fc44c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:50.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.584+0000 7fc4477fe700 1 -- 172.21.15.2:0/938995774 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc44c003b90 con 0x7fc450107090 2024-09-13T22:46:50.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.584+0000 7fc4477fe700 1 -- 172.21.15.2:0/938995774 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc44c0248b0 con 0x7fc450107090 2024-09-13T22:46:50.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.584+0000 7fc4477fe700 1 -- 172.21.15.2:0/938995774 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc44c01a8e0 con 0x7fc450107090 2024-09-13T22:46:50.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.584+0000 7fc458797700 1 -- 172.21.15.2:0/938995774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45019ab20 con 0x7fc450107090 2024-09-13T22:46:50.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.584+0000 7fc458797700 1 -- 172.21.15.2:0/938995774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45019af40 con 0x7fc450107090 2024-09-13T22:46:50.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.585+0000 7fc4477fe700 1 -- 172.21.15.2:0/938995774 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fc44c01ab50 con 0x7fc450107090 2024-09-13T22:46:50.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.585+0000 7fc4477fe700 1 --2- 172.21.15.2:0/938995774 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc43c038370 0x7fc43c03a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:50.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.585+0000 7fc4477fe700 1 -- 172.21.15.2:0/938995774 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc44c04d310 con 0x7fc450107090 2024-09-13T22:46:50.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.586+0000 7fc455d32700 1 --2- 172.21.15.2:0/938995774 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc43c038370 0x7fc43c03a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:50.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.586+0000 7fc458797700 1 -- 172.21.15.2:0/938995774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4500623c0 con 0x7fc450107090 2024-09-13T22:46:50.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.586+0000 7fc455d32700 1 --2- 172.21.15.2:0/938995774 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc43c038370 0x7fc43c03a830 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc440006fd0 tx=0x7fc440006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:50.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.591+0000 7fc4477fe700 1 -- 172.21.15.2:0/938995774 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc44c01ae00 con 0x7fc450107090 2024-09-13T22:46:50.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.804+0000 7fc458797700 1 -- 172.21.15.2:0/938995774 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fc450102e00 con 0x7fc43c038370 2024-09-13T22:46:50.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.809+0000 7fc4477fe700 1 -- 172.21.15.2:0/938995774 <== mgr.14120 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc450102e00 con 0x7fc43c038370 2024-09-13T22:46:50.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.811+0000 7fc458797700 1 -- 172.21.15.2:0/938995774 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc43c038370 msgr2=0x7fc43c03a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:50.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.811+0000 7fc458797700 1 --2- 172.21.15.2:0/938995774 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc43c038370 0x7fc43c03a830 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc440006fd0 tx=0x7fc440006e40 comp rx=0 tx=0).stop 2024-09-13T22:46:50.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.811+0000 7fc458797700 1 -- 172.21.15.2:0/938995774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc450107090 msgr2=0x7fc45019a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:50.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.811+0000 7fc458797700 1 --2- 172.21.15.2:0/938995774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc450107090 0x7fc45019a3e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc44c000c00 tx=0x7fc44c011ab0 comp rx=0 tx=0).stop 2024-09-13T22:46:50.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.811+0000 7fc458797700 1 -- 172.21.15.2:0/938995774 shutdown_connections 2024-09-13T22:46:50.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.811+0000 7fc458797700 1 --2- 172.21.15.2:0/938995774 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc43c038370 0x7fc43c03a830 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:50.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.811+0000 7fc458797700 1 --2- 172.21.15.2:0/938995774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc450107090 0x7fc45019a3e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:50.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.811+0000 7fc458797700 1 -- 172.21.15.2:0/938995774 >> 172.21.15.2:0/938995774 conn(0x7fc450100ae0 msgr2=0x7fc4501021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:50.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.811+0000 7fc458797700 1 -- 172.21.15.2:0/938995774 shutdown_connections 2024-09-13T22:46:50.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:49.811+0000 7fc458797700 1 -- 172.21.15.2:0/938995774 wait complete. 2024-09-13T22:46:50.726 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying mgr service with default placement... 2024-09-13T22:46:50.968 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:50 smithi002 ceph-mon[27637]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:50.968 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:50 smithi002 ceph-mon[27637]: Saving service mon spec with placement count:5 2024-09-13T22:46:50.968 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:50 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:52.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-13T22:46:52.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.153+0000 7f2be2464700 1 Processor -- start 2024-09-13T22:46:52.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.153+0000 7f2be2464700 1 -- start start 2024-09-13T22:46:52.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.153+0000 7f2be2464700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bdc104ed0 0x7f2bdc1052f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:52.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.153+0000 7f2be2464700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc079e20 con 0x7f2bdc104ed0 2024-09-13T22:46:52.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.153+0000 7f2bdbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bdc104ed0 0x7f2bdc1052f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:52.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.154+0000 7f2bdbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bdc104ed0 0x7f2bdc1052f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58124/0 (socket says 172.21.15.2:58124) 2024-09-13T22:46:52.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.154+0000 7f2bdbfff700 1 -- 172.21.15.2:0/2033313703 learned_addr learned my addr 172.21.15.2:0/2033313703 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:52.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.154+0000 7f2bdbfff700 1 -- 172.21.15.2:0/2033313703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc079f60 con 0x7f2bdc104ed0 2024-09-13T22:46:52.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.154+0000 7f2bdbfff700 1 --2- 172.21.15.2:0/2033313703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bdc104ed0 0x7f2bdc1052f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0098a0 tx=0x7f2bcc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29fdef27150549b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:52.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.154+0000 7f2bdaffd700 1 -- 172.21.15.2:0/2033313703 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2bcc004180 con 0x7f2bdc104ed0 2024-09-13T22:46:52.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.154+0000 7f2bdaffd700 1 -- 172.21.15.2:0/2033313703 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2bcc0042e0 con 0x7f2bdc104ed0 2024-09-13T22:46:52.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.154+0000 7f2bdaffd700 1 -- 172.21.15.2:0/2033313703 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2bcc011a50 con 0x7f2bdc104ed0 2024-09-13T22:46:52.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.155+0000 7f2be2464700 1 -- 172.21.15.2:0/2033313703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bdc104ed0 msgr2=0x7f2bdc1052f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:52.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.155+0000 7f2be2464700 1 --2- 172.21.15.2:0/2033313703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bdc104ed0 0x7f2bdc1052f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0098a0 tx=0x7f2bcc009bb0 comp rx=0 tx=0).stop 2024-09-13T22:46:52.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.155+0000 7f2be2464700 1 -- 172.21.15.2:0/2033313703 shutdown_connections 2024-09-13T22:46:52.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.155+0000 7f2be2464700 1 --2- 172.21.15.2:0/2033313703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bdc104ed0 0x7f2bdc1052f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:52.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.155+0000 7f2be2464700 1 -- 172.21.15.2:0/2033313703 >> 172.21.15.2:0/2033313703 conn(0x7f2bdc100ad0 msgr2=0x7f2bdc102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:52.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.155+0000 7f2be2464700 1 -- 172.21.15.2:0/2033313703 shutdown_connections 2024-09-13T22:46:52.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.155+0000 7f2be2464700 1 -- 172.21.15.2:0/2033313703 wait complete. 2024-09-13T22:46:52.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.155+0000 7f2be2464700 1 Processor -- start 2024-09-13T22:46:52.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.155+0000 7f2be2464700 1 -- start start 2024-09-13T22:46:52.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.156+0000 7f2be2464700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bdc104ed0 0x7f2bdc19c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:52.198 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.156+0000 7f2be2464700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc19c970 con 0x7f2bdc104ed0 2024-09-13T22:46:52.199 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.156+0000 7f2bdbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bdc104ed0 0x7f2bdc19c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:52.199 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.156+0000 7f2bdbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bdc104ed0 0x7f2bdc19c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58136/0 (socket says 172.21.15.2:58136) 2024-09-13T22:46:52.199 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.156+0000 7f2bdbfff700 1 -- 172.21.15.2:0/3032408263 learned_addr learned my addr 172.21.15.2:0/3032408263 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:52.199 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.156+0000 7f2bdbfff700 1 -- 172.21.15.2:0/3032408263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bcc009550 con 0x7f2bdc104ed0 2024-09-13T22:46:52.199 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.156+0000 7f2bdbfff700 1 --2- 172.21.15.2:0/3032408263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bdc104ed0 0x7f2bdc19c430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc000c00 tx=0x7f2bcc011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:52.199 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.156+0000 7f2bd97fa700 1 -- 172.21.15.2:0/3032408263 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2bcc003b90 con 0x7f2bdc104ed0 2024-09-13T22:46:52.199 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.156+0000 7f2bd97fa700 1 -- 172.21.15.2:0/3032408263 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2bcc0248b0 con 0x7f2bdc104ed0 2024-09-13T22:46:52.199 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.157+0000 7f2be2464700 1 -- 172.21.15.2:0/3032408263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bdc19cb70 con 0x7f2bdc104ed0 2024-09-13T22:46:52.199 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.157+0000 7f2bd97fa700 1 -- 172.21.15.2:0/3032408263 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2bcc01a8e0 con 0x7f2bdc104ed0 2024-09-13T22:46:52.199 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.157+0000 7f2be2464700 1 -- 172.21.15.2:0/3032408263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bdc19cf90 con 0x7f2bdc104ed0 2024-09-13T22:46:52.199 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.157+0000 7f2bd97fa700 1 -- 172.21.15.2:0/3032408263 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f2bcc01ab50 con 0x7f2bdc104ed0 2024-09-13T22:46:52.199 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.157+0000 7f2be2464700 1 -- 172.21.15.2:0/3032408263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bdc195d50 con 0x7f2bdc104ed0 2024-09-13T22:46:52.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.158+0000 7f2bd97fa700 1 --2- 172.21.15.2:0/3032408263 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f2bc4038370 0x7f2bc403a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:52.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.158+0000 7f2bd97fa700 1 -- 172.21.15.2:0/3032408263 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2bcc04c410 con 0x7f2bdc104ed0 2024-09-13T22:46:52.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.158+0000 7f2bdb7fe700 1 --2- 172.21.15.2:0/3032408263 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f2bc4038370 0x7f2bc403a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:52.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.158+0000 7f2bdb7fe700 1 --2- 172.21.15.2:0/3032408263 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f2bc4038370 0x7f2bc403a830 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0006fd0 tx=0x7f2bd0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:52.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.163+0000 7f2bd97fa700 1 -- 172.21.15.2:0/3032408263 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f2bcc01ae00 con 0x7f2bdc104ed0 2024-09-13T22:46:52.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.374+0000 7f2be2464700 1 -- 172.21.15.2:0/3032408263 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bdc0611d0 con 0x7f2bc4038370 2024-09-13T22:46:52.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.378+0000 7f2bd97fa700 1 -- 172.21.15.2:0/3032408263 <== mgr.14120 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f2bdc0611d0 con 0x7f2bc4038370 2024-09-13T22:46:52.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.380+0000 7f2be2464700 1 -- 172.21.15.2:0/3032408263 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f2bc4038370 msgr2=0x7f2bc403a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:52.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.380+0000 7f2be2464700 1 --2- 172.21.15.2:0/3032408263 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f2bc4038370 0x7f2bc403a830 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0006fd0 tx=0x7f2bd0006e40 comp rx=0 tx=0).stop 2024-09-13T22:46:52.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.380+0000 7f2be2464700 1 -- 172.21.15.2:0/3032408263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bdc104ed0 msgr2=0x7f2bdc19c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:52.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.380+0000 7f2be2464700 1 --2- 172.21.15.2:0/3032408263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bdc104ed0 0x7f2bdc19c430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc000c00 tx=0x7f2bcc011ab0 comp rx=0 tx=0).stop 2024-09-13T22:46:52.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.380+0000 7f2be2464700 1 -- 172.21.15.2:0/3032408263 shutdown_connections 2024-09-13T22:46:52.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.380+0000 7f2be2464700 1 --2- 172.21.15.2:0/3032408263 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f2bc4038370 0x7f2bc403a830 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:52.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.380+0000 7f2be2464700 1 --2- 172.21.15.2:0/3032408263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bdc104ed0 0x7f2bdc19c430 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:52.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.380+0000 7f2be2464700 1 -- 172.21.15.2:0/3032408263 >> 172.21.15.2:0/3032408263 conn(0x7f2bdc100ad0 msgr2=0x7f2bdc190a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:52.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.380+0000 7f2be2464700 1 -- 172.21.15.2:0/3032408263 shutdown_connections 2024-09-13T22:46:52.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:51.380+0000 7f2be2464700 1 -- 172.21.15.2:0/3032408263 wait complete. 2024-09-13T22:46:52.201 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying crash service with default placement... 2024-09-13T22:46:52.486 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:52 smithi002 ceph-mon[27637]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:52.486 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:52 smithi002 ceph-mon[27637]: Saving service mgr spec with placement count:2 2024-09-13T22:46:52.486 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:52 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:52.486 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:52 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:52.486 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:52 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:53.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-13T22:46:53.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.689+0000 7f03c02f4700 1 Processor -- start 2024-09-13T22:46:53.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.689+0000 7f03c02f4700 1 -- start start 2024-09-13T22:46:53.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.690+0000 7f03c02f4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8106b20 0x7f03b8106f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:53.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.690+0000 7f03c02f4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b8107510 con 0x7f03b8106b20 2024-09-13T22:46:53.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.690+0000 7f03be090700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8106b20 0x7f03b8106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:53.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.690+0000 7f03be090700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8106b20 0x7f03b8106f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58140/0 (socket says 172.21.15.2:58140) 2024-09-13T22:46:53.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.690+0000 7f03be090700 1 -- 172.21.15.2:0/2601097733 learned_addr learned my addr 172.21.15.2:0/2601097733 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:53.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.690+0000 7f03be090700 1 -- 172.21.15.2:0/2601097733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b8105780 con 0x7f03b8106b20 2024-09-13T22:46:53.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.690+0000 7f03be090700 1 --2- 172.21.15.2:0/2601097733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8106b20 0x7f03b8106f40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f03b40098a0 tx=0x7f03b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4373ccb9413d2443 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:53.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.690+0000 7f03bd08e700 1 -- 172.21.15.2:0/2601097733 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f03b4004180 con 0x7f03b8106b20 2024-09-13T22:46:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.690+0000 7f03bd08e700 1 -- 172.21.15.2:0/2601097733 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f03b40042e0 con 0x7f03b8106b20 2024-09-13T22:46:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.690+0000 7f03bd08e700 1 -- 172.21.15.2:0/2601097733 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f03b4011af0 con 0x7f03b8106b20 2024-09-13T22:46:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.691+0000 7f03c02f4700 1 -- 172.21.15.2:0/2601097733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8106b20 msgr2=0x7f03b8106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.691+0000 7f03c02f4700 1 --2- 172.21.15.2:0/2601097733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8106b20 0x7f03b8106f40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f03b40098a0 tx=0x7f03b4009bb0 comp rx=0 tx=0).stop 2024-09-13T22:46:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.691+0000 7f03c02f4700 1 -- 172.21.15.2:0/2601097733 shutdown_connections 2024-09-13T22:46:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.691+0000 7f03c02f4700 1 --2- 172.21.15.2:0/2601097733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8106b20 0x7f03b8106f40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.691+0000 7f03c02f4700 1 -- 172.21.15.2:0/2601097733 >> 172.21.15.2:0/2601097733 conn(0x7f03b8100230 msgr2=0x7f03b8102670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.691+0000 7f03c02f4700 1 -- 172.21.15.2:0/2601097733 shutdown_connections 2024-09-13T22:46:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.691+0000 7f03c02f4700 1 -- 172.21.15.2:0/2601097733 wait complete. 2024-09-13T22:46:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.692+0000 7f03c02f4700 1 Processor -- start 2024-09-13T22:46:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.692+0000 7f03c02f4700 1 -- start start 2024-09-13T22:46:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.692+0000 7f03c02f4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8106b20 0x7f03b81051d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.692+0000 7f03c02f4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b819d0a0 con 0x7f03b8106b20 2024-09-13T22:46:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.693+0000 7f03be090700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8106b20 0x7f03b81051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.693+0000 7f03be090700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8106b20 0x7f03b81051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58154/0 (socket says 172.21.15.2:58154) 2024-09-13T22:46:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.693+0000 7f03be090700 1 -- 172.21.15.2:0/2775787906 learned_addr learned my addr 172.21.15.2:0/2775787906 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.693+0000 7f03be090700 1 -- 172.21.15.2:0/2775787906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b4009550 con 0x7f03b8106b20 2024-09-13T22:46:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.693+0000 7f03be090700 1 --2- 172.21.15.2:0/2775787906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8106b20 0x7f03b81051d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f03b4000c00 tx=0x7f03b4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.693+0000 7f03af7fe700 1 -- 172.21.15.2:0/2775787906 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f03b4003a70 con 0x7f03b8106b20 2024-09-13T22:46:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.693+0000 7f03af7fe700 1 -- 172.21.15.2:0/2775787906 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f03b4003bd0 con 0x7f03b8106b20 2024-09-13T22:46:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.693+0000 7f03c02f4700 1 -- 172.21.15.2:0/2775787906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b819d1e0 con 0x7f03b8106b20 2024-09-13T22:46:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.693+0000 7f03af7fe700 1 -- 172.21.15.2:0/2775787906 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f03b40238c0 con 0x7f03b8106b20 2024-09-13T22:46:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.693+0000 7f03c02f4700 1 -- 172.21.15.2:0/2775787906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b819d600 con 0x7f03b8106b20 2024-09-13T22:46:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.694+0000 7f03af7fe700 1 -- 172.21.15.2:0/2775787906 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f03b4023b30 con 0x7f03b8106b20 2024-09-13T22:46:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.694+0000 7f03c02f4700 1 -- 172.21.15.2:0/2775787906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b80623c0 con 0x7f03b8106b20 2024-09-13T22:46:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.695+0000 7f03af7fe700 1 --2- 172.21.15.2:0/2775787906 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f03a4038370 0x7f03a403a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.695+0000 7f03bd88f700 1 --2- 172.21.15.2:0/2775787906 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f03a4038370 0x7f03a403a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.695+0000 7f03af7fe700 1 -- 172.21.15.2:0/2775787906 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f03b404c4a0 con 0x7f03b8106b20 2024-09-13T22:46:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.695+0000 7f03bd88f700 1 --2- 172.21.15.2:0/2775787906 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f03a4038370 0x7f03a403a830 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f03a8006fd0 tx=0x7f03a8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.700+0000 7f03af7fe700 1 -- 172.21.15.2:0/2775787906 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f03b4010c20 con 0x7f03b8106b20 2024-09-13T22:46:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.925+0000 7f03c02f4700 1 -- 172.21.15.2:0/2775787906 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f03b8102510 con 0x7f03a4038370 2024-09-13T22:46:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.930+0000 7f03af7fe700 1 -- 172.21.15.2:0/2775787906 <== mgr.14120 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f03b8102510 con 0x7f03a4038370 2024-09-13T22:46:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.932+0000 7f03c02f4700 1 -- 172.21.15.2:0/2775787906 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f03a4038370 msgr2=0x7f03a403a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.932+0000 7f03c02f4700 1 --2- 172.21.15.2:0/2775787906 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f03a4038370 0x7f03a403a830 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f03a8006fd0 tx=0x7f03a8006e40 comp rx=0 tx=0).stop 2024-09-13T22:46:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.932+0000 7f03c02f4700 1 -- 172.21.15.2:0/2775787906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8106b20 msgr2=0x7f03b81051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.932+0000 7f03c02f4700 1 --2- 172.21.15.2:0/2775787906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8106b20 0x7f03b81051d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f03b4000c00 tx=0x7f03b4011b50 comp rx=0 tx=0).stop 2024-09-13T22:46:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.932+0000 7f03c02f4700 1 -- 172.21.15.2:0/2775787906 shutdown_connections 2024-09-13T22:46:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.932+0000 7f03c02f4700 1 --2- 172.21.15.2:0/2775787906 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f03a4038370 0x7f03a403a830 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.932+0000 7f03c02f4700 1 --2- 172.21.15.2:0/2775787906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8106b20 0x7f03b81051d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.932+0000 7f03c02f4700 1 -- 172.21.15.2:0/2775787906 >> 172.21.15.2:0/2775787906 conn(0x7f03b8100230 msgr2=0x7f03b81018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.932+0000 7f03c02f4700 1 -- 172.21.15.2:0/2775787906 shutdown_connections 2024-09-13T22:46:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:52.932+0000 7f03c02f4700 1 -- 172.21.15.2:0/2775787906 wait complete. 2024-09-13T22:46:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying ceph-exporter service with default placement... 2024-09-13T22:46:54.184 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:53 smithi002 ceph-mon[27637]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:54.185 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:53 smithi002 ceph-mon[27637]: Saving service crash spec with placement * 2024-09-13T22:46:54.185 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:53 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:55.071 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-13T22:46:55.071 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.004+0000 7f52dd2cf700 1 Processor -- start 2024-09-13T22:46:55.071 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.004+0000 7f52dd2cf700 1 -- start start 2024-09-13T22:46:55.072 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.005+0000 7f52dd2cf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81070e0 0x7f52d81094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:55.072 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.005+0000 7f52dd2cf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d8079e20 con 0x7f52d81070e0 2024-09-13T22:46:55.072 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.005+0000 7f52d6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81070e0 0x7f52d81094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:55.072 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.005+0000 7f52d6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81070e0 0x7f52d81094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58170/0 (socket says 172.21.15.2:58170) 2024-09-13T22:46:55.072 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.005+0000 7f52d6ffd700 1 -- 172.21.15.2:0/522219495 learned_addr learned my addr 172.21.15.2:0/522219495 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:55.072 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.005+0000 7f52d6ffd700 1 -- 172.21.15.2:0/522219495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d8079f60 con 0x7f52d81070e0 2024-09-13T22:46:55.072 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.005+0000 7f52d6ffd700 1 --2- 172.21.15.2:0/522219495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81070e0 0x7f52d81094d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f52c80098a0 tx=0x7f52c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3a165ee03fd564 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:55.072 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.005+0000 7f52d5ffb700 1 -- 172.21.15.2:0/522219495 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52c8004180 con 0x7f52d81070e0 2024-09-13T22:46:55.073 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.005+0000 7f52d5ffb700 1 -- 172.21.15.2:0/522219495 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f52c80042e0 con 0x7f52d81070e0 2024-09-13T22:46:55.073 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.005+0000 7f52d5ffb700 1 -- 172.21.15.2:0/522219495 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52c8011af0 con 0x7f52d81070e0 2024-09-13T22:46:55.073 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.006+0000 7f52dd2cf700 1 -- 172.21.15.2:0/522219495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81070e0 msgr2=0x7f52d81094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:55.073 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.006+0000 7f52dd2cf700 1 --2- 172.21.15.2:0/522219495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81070e0 0x7f52d81094d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f52c80098a0 tx=0x7f52c8009bb0 comp rx=0 tx=0).stop 2024-09-13T22:46:55.073 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.006+0000 7f52dd2cf700 1 -- 172.21.15.2:0/522219495 shutdown_connections 2024-09-13T22:46:55.073 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.006+0000 7f52dd2cf700 1 --2- 172.21.15.2:0/522219495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81070e0 0x7f52d81094d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:55.073 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.006+0000 7f52dd2cf700 1 -- 172.21.15.2:0/522219495 >> 172.21.15.2:0/522219495 conn(0x7f52d8100ad0 msgr2=0x7f52d8102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:55.073 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.006+0000 7f52dd2cf700 1 -- 172.21.15.2:0/522219495 shutdown_connections 2024-09-13T22:46:55.073 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.006+0000 7f52dd2cf700 1 -- 172.21.15.2:0/522219495 wait complete. 2024-09-13T22:46:55.073 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.007+0000 7f52dd2cf700 1 Processor -- start 2024-09-13T22:46:55.073 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.007+0000 7f52dd2cf700 1 -- start start 2024-09-13T22:46:55.073 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.007+0000 7f52dd2cf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81070e0 0x7f52d819c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:55.074 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.007+0000 7f52dd2cf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d819ca20 con 0x7f52d81070e0 2024-09-13T22:46:55.074 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.007+0000 7f52d6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81070e0 0x7f52d819c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:55.074 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.007+0000 7f52d6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81070e0 0x7f52d819c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58186/0 (socket says 172.21.15.2:58186) 2024-09-13T22:46:55.074 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.007+0000 7f52d6ffd700 1 -- 172.21.15.2:0/520486935 learned_addr learned my addr 172.21.15.2:0/520486935 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:55.074 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.008+0000 7f52d6ffd700 1 -- 172.21.15.2:0/520486935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c8009550 con 0x7f52d81070e0 2024-09-13T22:46:55.074 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.008+0000 7f52d6ffd700 1 --2- 172.21.15.2:0/520486935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81070e0 0x7f52d819c4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52c8006ba0 tx=0x7f52c8011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:55.074 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.008+0000 7f52bffff700 1 -- 172.21.15.2:0/520486935 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52c8003b00 con 0x7f52d81070e0 2024-09-13T22:46:55.074 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.008+0000 7f52bffff700 1 -- 172.21.15.2:0/520486935 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f52c801a8e0 con 0x7f52d81070e0 2024-09-13T22:46:55.074 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.008+0000 7f52dd2cf700 1 -- 172.21.15.2:0/520486935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d819cc20 con 0x7f52d81070e0 2024-09-13T22:46:55.074 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.008+0000 7f52bffff700 1 -- 172.21.15.2:0/520486935 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52c80199c0 con 0x7f52d81070e0 2024-09-13T22:46:55.074 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.008+0000 7f52dd2cf700 1 -- 172.21.15.2:0/520486935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d819d040 con 0x7f52d81070e0 2024-09-13T22:46:55.075 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.009+0000 7f52bffff700 1 -- 172.21.15.2:0/520486935 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f52c8019c80 con 0x7f52d81070e0 2024-09-13T22:46:55.075 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.009+0000 7f52dd2cf700 1 -- 172.21.15.2:0/520486935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d80623c0 con 0x7f52d81070e0 2024-09-13T22:46:55.075 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.009+0000 7f52bffff700 1 --2- 172.21.15.2:0/520486935 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f52c00382d0 0x7f52c003a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:55.075 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.009+0000 7f52bffff700 1 -- 172.21.15.2:0/520486935 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f52c804c740 con 0x7f52d81070e0 2024-09-13T22:46:55.075 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.009+0000 7f52d67fc700 1 --2- 172.21.15.2:0/520486935 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f52c00382d0 0x7f52c003a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:55.075 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.010+0000 7f52d67fc700 1 --2- 172.21.15.2:0/520486935 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f52c00382d0 0x7f52c003a790 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f52cc006fd0 tx=0x7f52cc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:55.075 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.014+0000 7f52bffff700 1 -- 172.21.15.2:0/520486935 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f52c802b700 con 0x7f52d81070e0 2024-09-13T22:46:55.075 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.224+0000 7f52dd2cf700 1 -- 172.21.15.2:0/520486935 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f52d8102d80 con 0x7f52c00382d0 2024-09-13T22:46:55.075 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.229+0000 7f52bffff700 1 -- 172.21.15.2:0/520486935 <== mgr.14120 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f52d8102d80 con 0x7f52c00382d0 2024-09-13T22:46:55.075 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.231+0000 7f52dd2cf700 1 -- 172.21.15.2:0/520486935 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f52c00382d0 msgr2=0x7f52c003a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:55.075 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.231+0000 7f52dd2cf700 1 --2- 172.21.15.2:0/520486935 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f52c00382d0 0x7f52c003a790 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f52cc006fd0 tx=0x7f52cc006e40 comp rx=0 tx=0).stop 2024-09-13T22:46:55.075 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.231+0000 7f52dd2cf700 1 -- 172.21.15.2:0/520486935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81070e0 msgr2=0x7f52d819c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:55.075 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.231+0000 7f52dd2cf700 1 --2- 172.21.15.2:0/520486935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81070e0 0x7f52d819c4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52c8006ba0 tx=0x7f52c8011b50 comp rx=0 tx=0).stop 2024-09-13T22:46:55.076 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.231+0000 7f52dd2cf700 1 -- 172.21.15.2:0/520486935 shutdown_connections 2024-09-13T22:46:55.076 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.231+0000 7f52dd2cf700 1 --2- 172.21.15.2:0/520486935 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f52c00382d0 0x7f52c003a790 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:55.076 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.231+0000 7f52dd2cf700 1 --2- 172.21.15.2:0/520486935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d81070e0 0x7f52d819c4e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:55.076 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.231+0000 7f52dd2cf700 1 -- 172.21.15.2:0/520486935 >> 172.21.15.2:0/520486935 conn(0x7f52d8100ad0 msgr2=0x7f52d8102160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:55.076 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.231+0000 7f52dd2cf700 1 -- 172.21.15.2:0/520486935 shutdown_connections 2024-09-13T22:46:55.076 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:54.231+0000 7f52dd2cf700 1 -- 172.21.15.2:0/520486935 wait complete. 2024-09-13T22:46:55.076 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying prometheus service with default placement... 2024-09-13T22:46:55.385 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:55 smithi002 ceph-mon[27637]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:55.385 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:55 smithi002 ceph-mon[27637]: Saving service ceph-exporter spec with placement * 2024-09-13T22:46:55.385 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:55 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:55.385 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:55 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:56.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-13T22:46:56.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.491+0000 7fbaf9a5b700 1 Processor -- start 2024-09-13T22:46:56.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.491+0000 7fbaf9a5b700 1 -- start start 2024-09-13T22:46:56.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.491+0000 7fbaf9a5b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaf4106600 0x7fbaf4106a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:56.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.491+0000 7fbaf9a5b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf4106ff0 con 0x7fbaf4106600 2024-09-13T22:46:56.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.491+0000 7fbaf2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaf4106600 0x7fbaf4106a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:56.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.491+0000 7fbaf2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaf4106600 0x7fbaf4106a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58190/0 (socket says 172.21.15.2:58190) 2024-09-13T22:46:56.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.491+0000 7fbaf2ffd700 1 -- 172.21.15.2:0/2873791362 learned_addr learned my addr 172.21.15.2:0/2873791362 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:56.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.492+0000 7fbaf2ffd700 1 -- 172.21.15.2:0/2873791362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf4107800 con 0x7fbaf4106600 2024-09-13T22:46:56.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.492+0000 7fbaf2ffd700 1 --2- 172.21.15.2:0/2873791362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaf4106600 0x7fbaf4106a20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbae40098a0 tx=0x7fbae4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd5f417e7c331eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:56.220 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.492+0000 7fbaf1ffb700 1 -- 172.21.15.2:0/2873791362 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbae4004180 con 0x7fbaf4106600 2024-09-13T22:46:56.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.492+0000 7fbaf1ffb700 1 -- 172.21.15.2:0/2873791362 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbae40042e0 con 0x7fbaf4106600 2024-09-13T22:46:56.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.492+0000 7fbaf1ffb700 1 -- 172.21.15.2:0/2873791362 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbae4011af0 con 0x7fbaf4106600 2024-09-13T22:46:56.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.493+0000 7fbaf9a5b700 1 -- 172.21.15.2:0/2873791362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaf4106600 msgr2=0x7fbaf4106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:56.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.493+0000 7fbaf9a5b700 1 --2- 172.21.15.2:0/2873791362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaf4106600 0x7fbaf4106a20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbae40098a0 tx=0x7fbae4009bb0 comp rx=0 tx=0).stop 2024-09-13T22:46:56.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.493+0000 7fbaf9a5b700 1 -- 172.21.15.2:0/2873791362 shutdown_connections 2024-09-13T22:46:56.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.493+0000 7fbaf9a5b700 1 --2- 172.21.15.2:0/2873791362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaf4106600 0x7fbaf4106a20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:56.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.493+0000 7fbaf9a5b700 1 -- 172.21.15.2:0/2873791362 >> 172.21.15.2:0/2873791362 conn(0x7fbaf4101bc0 msgr2=0x7fbaf4103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:56.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.493+0000 7fbaf9a5b700 1 -- 172.21.15.2:0/2873791362 shutdown_connections 2024-09-13T22:46:56.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.493+0000 7fbaf9a5b700 1 -- 172.21.15.2:0/2873791362 wait complete. 2024-09-13T22:46:56.221 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.493+0000 7fbaf9a5b700 1 Processor -- start 2024-09-13T22:46:56.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.494+0000 7fbaf9a5b700 1 -- start start 2024-09-13T22:46:56.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.494+0000 7fbaf9a5b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaf4106600 0x7fbaf407ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:56.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.494+0000 7fbaf9a5b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf407b090 con 0x7fbaf4106600 2024-09-13T22:46:56.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.494+0000 7fbaf2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaf4106600 0x7fbaf407ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:56.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.494+0000 7fbaf2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaf4106600 0x7fbaf407ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58206/0 (socket says 172.21.15.2:58206) 2024-09-13T22:46:56.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.494+0000 7fbaf2ffd700 1 -- 172.21.15.2:0/3064113118 learned_addr learned my addr 172.21.15.2:0/3064113118 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:56.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.494+0000 7fbaf2ffd700 1 -- 172.21.15.2:0/3064113118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae4009550 con 0x7fbaf4106600 2024-09-13T22:46:56.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.494+0000 7fbaf2ffd700 1 --2- 172.21.15.2:0/3064113118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaf4106600 0x7fbaf407ab50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbae4006ba0 tx=0x7fbae4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:56.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.495+0000 7fbaf8a59700 1 -- 172.21.15.2:0/3064113118 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbae4003b00 con 0x7fbaf4106600 2024-09-13T22:46:56.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.495+0000 7fbaf9a5b700 1 -- 172.21.15.2:0/3064113118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf40791a0 con 0x7fbaf4106600 2024-09-13T22:46:56.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.495+0000 7fbaf8a59700 1 -- 172.21.15.2:0/3064113118 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbae401a8e0 con 0x7fbaf4106600 2024-09-13T22:46:56.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.495+0000 7fbaf8a59700 1 -- 172.21.15.2:0/3064113118 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbae4019990 con 0x7fbaf4106600 2024-09-13T22:46:56.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.495+0000 7fbaf9a5b700 1 -- 172.21.15.2:0/3064113118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf40795c0 con 0x7fbaf4106600 2024-09-13T22:46:56.222 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.496+0000 7fbaf8a59700 1 -- 172.21.15.2:0/3064113118 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fbae4019c50 con 0x7fbaf4106600 2024-09-13T22:46:56.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.496+0000 7fbaf9a5b700 1 -- 172.21.15.2:0/3064113118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf40623c0 con 0x7fbaf4106600 2024-09-13T22:46:56.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.496+0000 7fbaf8a59700 1 --2- 172.21.15.2:0/3064113118 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fbadc0382d0 0x7fbadc03a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:56.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.496+0000 7fbaf8a59700 1 -- 172.21.15.2:0/3064113118 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbae404c5f0 con 0x7fbaf4106600 2024-09-13T22:46:56.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.496+0000 7fbaf27fc700 1 --2- 172.21.15.2:0/3064113118 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fbadc0382d0 0x7fbadc03a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:56.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.496+0000 7fbaf27fc700 1 --2- 172.21.15.2:0/3064113118 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fbadc0382d0 0x7fbadc03a790 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbae8006fd0 tx=0x7fbae8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:56.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.501+0000 7fbaf8a59700 1 -- 172.21.15.2:0/3064113118 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fbae402b520 con 0x7fbaf4106600 2024-09-13T22:46:56.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.714+0000 7fbaf9a5b700 1 -- 172.21.15.2:0/3064113118 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fbaf410aa00 con 0x7fbadc0382d0 2024-09-13T22:46:56.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.718+0000 7fbaf8a59700 1 -- 172.21.15.2:0/3064113118 <== mgr.14120 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fbaf410aa00 con 0x7fbadc0382d0 2024-09-13T22:46:56.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.720+0000 7fbaf9a5b700 1 -- 172.21.15.2:0/3064113118 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fbadc0382d0 msgr2=0x7fbadc03a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:56.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.720+0000 7fbaf9a5b700 1 --2- 172.21.15.2:0/3064113118 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fbadc0382d0 0x7fbadc03a790 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbae8006fd0 tx=0x7fbae8006e40 comp rx=0 tx=0).stop 2024-09-13T22:46:56.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.720+0000 7fbaf9a5b700 1 -- 172.21.15.2:0/3064113118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaf4106600 msgr2=0x7fbaf407ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:56.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.720+0000 7fbaf9a5b700 1 --2- 172.21.15.2:0/3064113118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaf4106600 0x7fbaf407ab50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbae4006ba0 tx=0x7fbae4011b50 comp rx=0 tx=0).stop 2024-09-13T22:46:56.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.721+0000 7fbaf9a5b700 1 -- 172.21.15.2:0/3064113118 shutdown_connections 2024-09-13T22:46:56.223 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.721+0000 7fbaf9a5b700 1 --2- 172.21.15.2:0/3064113118 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fbadc0382d0 0x7fbadc03a790 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:56.224 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.721+0000 7fbaf9a5b700 1 --2- 172.21.15.2:0/3064113118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaf4106600 0x7fbaf407ab50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:56.224 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.721+0000 7fbaf9a5b700 1 -- 172.21.15.2:0/3064113118 >> 172.21.15.2:0/3064113118 conn(0x7fbaf4101bc0 msgr2=0x7fbaf41032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:56.224 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.721+0000 7fbaf9a5b700 1 -- 172.21.15.2:0/3064113118 shutdown_connections 2024-09-13T22:46:56.224 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:55.721+0000 7fbaf9a5b700 1 -- 172.21.15.2:0/3064113118 wait complete. 2024-09-13T22:46:56.224 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying grafana service with default placement... 2024-09-13T22:46:56.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:56 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:56.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:56 smithi002 ceph-mon[27637]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:56.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:56 smithi002 ceph-mon[27637]: Saving service prometheus spec with placement count:1 2024-09-13T22:46:56.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:56 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:57.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-13T22:46:57.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.712+0000 7f1b2463e700 1 Processor -- start 2024-09-13T22:46:57.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.712+0000 7f1b2463e700 1 -- start start 2024-09-13T22:46:57.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.713+0000 7f1b2463e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b1c106610 0x7f1b1c106a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:57.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.713+0000 7f1b2463e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c107000 con 0x7f1b1c106610 2024-09-13T22:46:57.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.713+0000 7f1b223da700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b1c106610 0x7f1b1c106a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:57.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.713+0000 7f1b223da700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b1c106610 0x7f1b1c106a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58220/0 (socket says 172.21.15.2:58220) 2024-09-13T22:46:57.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.713+0000 7f1b223da700 1 -- 172.21.15.2:0/3972522394 learned_addr learned my addr 172.21.15.2:0/3972522394 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:57.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.713+0000 7f1b223da700 1 -- 172.21.15.2:0/3972522394 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1c107810 con 0x7f1b1c106610 2024-09-13T22:46:57.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.713+0000 7f1b223da700 1 --2- 172.21.15.2:0/3972522394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b1c106610 0x7f1b1c106a30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b180098a0 tx=0x7f1b18009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff875c3e218cce2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:57.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.714+0000 7f1b213d8700 1 -- 172.21.15.2:0/3972522394 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b18004180 con 0x7f1b1c106610 2024-09-13T22:46:57.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.714+0000 7f1b213d8700 1 -- 172.21.15.2:0/3972522394 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1b180042e0 con 0x7f1b1c106610 2024-09-13T22:46:57.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.714+0000 7f1b213d8700 1 -- 172.21.15.2:0/3972522394 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b18011af0 con 0x7f1b1c106610 2024-09-13T22:46:57.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.714+0000 7f1b2463e700 1 -- 172.21.15.2:0/3972522394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b1c106610 msgr2=0x7f1b1c106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:57.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.714+0000 7f1b2463e700 1 --2- 172.21.15.2:0/3972522394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b1c106610 0x7f1b1c106a30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b180098a0 tx=0x7f1b18009bb0 comp rx=0 tx=0).stop 2024-09-13T22:46:57.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.715+0000 7f1b2463e700 1 -- 172.21.15.2:0/3972522394 shutdown_connections 2024-09-13T22:46:57.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.715+0000 7f1b2463e700 1 --2- 172.21.15.2:0/3972522394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b1c106610 0x7f1b1c106a30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:57.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.715+0000 7f1b2463e700 1 -- 172.21.15.2:0/3972522394 >> 172.21.15.2:0/3972522394 conn(0x7f1b1c101bd0 msgr2=0x7f1b1c103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:57.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.715+0000 7f1b2463e700 1 -- 172.21.15.2:0/3972522394 shutdown_connections 2024-09-13T22:46:57.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.715+0000 7f1b2463e700 1 -- 172.21.15.2:0/3972522394 wait complete. 2024-09-13T22:46:57.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.715+0000 7f1b2463e700 1 Processor -- start 2024-09-13T22:46:57.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.715+0000 7f1b2463e700 1 -- start start 2024-09-13T22:46:57.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.715+0000 7f1b2463e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b1c106610 0x7f1b1c07bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:57.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.715+0000 7f1b2463e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c07c1a0 con 0x7f1b1c106610 2024-09-13T22:46:57.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.716+0000 7f1b223da700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b1c106610 0x7f1b1c07bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:57.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.716+0000 7f1b223da700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b1c106610 0x7f1b1c07bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58232/0 (socket says 172.21.15.2:58232) 2024-09-13T22:46:57.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.716+0000 7f1b223da700 1 -- 172.21.15.2:0/2434594032 learned_addr learned my addr 172.21.15.2:0/2434594032 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:57.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.716+0000 7f1b223da700 1 -- 172.21.15.2:0/2434594032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b18009550 con 0x7f1b1c106610 2024-09-13T22:46:57.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.716+0000 7f1b223da700 1 --2- 172.21.15.2:0/2434594032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b1c106610 0x7f1b1c07bc60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1b18000c00 tx=0x7f1b18011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:57.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.716+0000 7f1b137fe700 1 -- 172.21.15.2:0/2434594032 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b18003a70 con 0x7f1b1c106610 2024-09-13T22:46:57.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.716+0000 7f1b137fe700 1 -- 172.21.15.2:0/2434594032 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1b18003bd0 con 0x7f1b1c106610 2024-09-13T22:46:57.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.716+0000 7f1b2463e700 1 -- 172.21.15.2:0/2434594032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b1c07a2b0 con 0x7f1b1c106610 2024-09-13T22:46:57.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.716+0000 7f1b137fe700 1 -- 172.21.15.2:0/2434594032 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1b180238c0 con 0x7f1b1c106610 2024-09-13T22:46:57.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.716+0000 7f1b2463e700 1 -- 172.21.15.2:0/2434594032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1c07a6d0 con 0x7f1b1c106610 2024-09-13T22:46:57.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.717+0000 7f1b137fe700 1 -- 172.21.15.2:0/2434594032 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f1b18023b80 con 0x7f1b1c106610 2024-09-13T22:46:57.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.717+0000 7f1b2463e700 1 -- 172.21.15.2:0/2434594032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1c0623c0 con 0x7f1b1c106610 2024-09-13T22:46:57.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.717+0000 7f1b137fe700 1 --2- 172.21.15.2:0/2434594032 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1b08038320 0x7f1b0803a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:57.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.718+0000 7f1b137fe700 1 -- 172.21.15.2:0/2434594032 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1b1804d200 con 0x7f1b1c106610 2024-09-13T22:46:57.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.718+0000 7f1b21bd9700 1 --2- 172.21.15.2:0/2434594032 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1b08038320 0x7f1b0803a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:57.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.718+0000 7f1b21bd9700 1 --2- 172.21.15.2:0/2434594032 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1b08038320 0x7f1b0803a7e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c006fd0 tx=0x7f1b0c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:57.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.723+0000 7f1b137fe700 1 -- 172.21.15.2:0/2434594032 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1b1802b300 con 0x7f1b1c106610 2024-09-13T22:46:57.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.936+0000 7f1b2463e700 1 -- 172.21.15.2:0/2434594032 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b1c103e80 con 0x7f1b08038320 2024-09-13T22:46:57.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.940+0000 7f1b137fe700 1 -- 172.21.15.2:0/2434594032 <== mgr.14120 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f1b1c103e80 con 0x7f1b08038320 2024-09-13T22:46:57.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.942+0000 7f1b2463e700 1 -- 172.21.15.2:0/2434594032 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1b08038320 msgr2=0x7f1b0803a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:57.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.942+0000 7f1b2463e700 1 --2- 172.21.15.2:0/2434594032 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1b08038320 0x7f1b0803a7e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c006fd0 tx=0x7f1b0c006e40 comp rx=0 tx=0).stop 2024-09-13T22:46:57.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.942+0000 7f1b2463e700 1 -- 172.21.15.2:0/2434594032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b1c106610 msgr2=0x7f1b1c07bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:57.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.942+0000 7f1b2463e700 1 --2- 172.21.15.2:0/2434594032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b1c106610 0x7f1b1c07bc60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1b18000c00 tx=0x7f1b18011b50 comp rx=0 tx=0).stop 2024-09-13T22:46:57.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.942+0000 7f1b2463e700 1 -- 172.21.15.2:0/2434594032 shutdown_connections 2024-09-13T22:46:57.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.942+0000 7f1b2463e700 1 --2- 172.21.15.2:0/2434594032 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1b08038320 0x7f1b0803a7e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:57.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.942+0000 7f1b2463e700 1 --2- 172.21.15.2:0/2434594032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b1c106610 0x7f1b1c07bc60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:57.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.942+0000 7f1b2463e700 1 -- 172.21.15.2:0/2434594032 >> 172.21.15.2:0/2434594032 conn(0x7f1b1c101bd0 msgr2=0x7f1b1c103220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:57.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.942+0000 7f1b2463e700 1 -- 172.21.15.2:0/2434594032 shutdown_connections 2024-09-13T22:46:57.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:56.942+0000 7f1b2463e700 1 -- 172.21.15.2:0/2434594032 wait complete. 2024-09-13T22:46:57.516 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying node-exporter service with default placement... 2024-09-13T22:46:58.191 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:57 smithi002 ceph-mon[27637]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:46:58.191 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:57 smithi002 ceph-mon[27637]: Saving service grafana spec with placement count:1 2024-09-13T22:46:58.191 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:57 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:46:59.404 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-13T22:46:59.405 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.699+0000 7f9f02b01700 1 Processor -- start 2024-09-13T22:46:59.405 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.699+0000 7f9f02b01700 1 -- start start 2024-09-13T22:46:59.405 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.699+0000 7f9f02b01700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc07be90 0x7f9efc07a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:59.405 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.699+0000 7f9f02b01700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc07a8c0 con 0x7f9efc07be90 2024-09-13T22:46:59.405 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.699+0000 7f9f0089d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc07be90 0x7f9efc07a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:59.405 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.699+0000 7f9f0089d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc07be90 0x7f9efc07a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58242/0 (socket says 172.21.15.2:58242) 2024-09-13T22:46:59.405 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.699+0000 7f9f0089d700 1 -- 172.21.15.2:0/3479857588 learned_addr learned my addr 172.21.15.2:0/3479857588 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:59.405 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.700+0000 7f9f0089d700 1 -- 172.21.15.2:0/3479857588 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc07aa00 con 0x7f9efc07be90 2024-09-13T22:46:59.405 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.700+0000 7f9f0089d700 1 --2- 172.21.15.2:0/3479857588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc07be90 0x7f9efc07a2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009e80 tx=0x7f9ef800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4172e90eb8b756d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:59.405 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.700+0000 7f9ef37fe700 1 -- 172.21.15.2:0/3479857588 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ef800e070 con 0x7f9efc07be90 2024-09-13T22:46:59.405 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.700+0000 7f9ef37fe700 1 -- 172.21.15.2:0/3479857588 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9ef800b8c0 con 0x7f9efc07be90 2024-09-13T22:46:59.406 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.700+0000 7f9ef37fe700 1 -- 172.21.15.2:0/3479857588 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ef80044d0 con 0x7f9efc07be90 2024-09-13T22:46:59.406 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.701+0000 7f9f02b01700 1 -- 172.21.15.2:0/3479857588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc07be90 msgr2=0x7f9efc07a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:59.406 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.701+0000 7f9f02b01700 1 --2- 172.21.15.2:0/3479857588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc07be90 0x7f9efc07a2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009e80 tx=0x7f9ef800b330 comp rx=0 tx=0).stop 2024-09-13T22:46:59.406 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.701+0000 7f9f02b01700 1 -- 172.21.15.2:0/3479857588 shutdown_connections 2024-09-13T22:46:59.406 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.701+0000 7f9f02b01700 1 --2- 172.21.15.2:0/3479857588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc07be90 0x7f9efc07a2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:59.406 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.701+0000 7f9f02b01700 1 -- 172.21.15.2:0/3479857588 >> 172.21.15.2:0/3479857588 conn(0x7f9efc101bd0 msgr2=0x7f9efc103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:59.406 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.701+0000 7f9f02b01700 1 -- 172.21.15.2:0/3479857588 shutdown_connections 2024-09-13T22:46:59.406 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.701+0000 7f9f02b01700 1 -- 172.21.15.2:0/3479857588 wait complete. 2024-09-13T22:46:59.406 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.701+0000 7f9f02b01700 1 Processor -- start 2024-09-13T22:46:59.406 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.701+0000 7f9f02b01700 1 -- start start 2024-09-13T22:46:59.406 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.702+0000 7f9f02b01700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc07be90 0x7f9efc19c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:59.406 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.702+0000 7f9f02b01700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc19c9b0 con 0x7f9efc07be90 2024-09-13T22:46:59.406 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.702+0000 7f9f0089d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc07be90 0x7f9efc19c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:59.406 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.702+0000 7f9f0089d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc07be90 0x7f9efc19c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58254/0 (socket says 172.21.15.2:58254) 2024-09-13T22:46:59.406 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.702+0000 7f9f0089d700 1 -- 172.21.15.2:0/3568930249 learned_addr learned my addr 172.21.15.2:0/3568930249 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:46:59.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.702+0000 7f9f0089d700 1 -- 172.21.15.2:0/3568930249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef8009b30 con 0x7f9efc07be90 2024-09-13T22:46:59.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.702+0000 7f9f0089d700 1 --2- 172.21.15.2:0/3568930249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc07be90 0x7f9efc19c470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8004070 tx=0x7f9ef80049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:59.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.702+0000 7f9ef1ffb700 1 -- 172.21.15.2:0/3568930249 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ef800e040 con 0x7f9efc07be90 2024-09-13T22:46:59.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.702+0000 7f9ef1ffb700 1 -- 172.21.15.2:0/3568930249 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9ef800be00 con 0x7f9efc07be90 2024-09-13T22:46:59.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.702+0000 7f9f02b01700 1 -- 172.21.15.2:0/3568930249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9efc19cbb0 con 0x7f9efc07be90 2024-09-13T22:46:59.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.702+0000 7f9ef1ffb700 1 -- 172.21.15.2:0/3568930249 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ef8012770 con 0x7f9efc07be90 2024-09-13T22:46:59.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.703+0000 7f9f02b01700 1 -- 172.21.15.2:0/3568930249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9efc19d030 con 0x7f9efc07be90 2024-09-13T22:46:59.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.703+0000 7f9ef1ffb700 1 -- 172.21.15.2:0/3568930249 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f9ef8019040 con 0x7f9efc07be90 2024-09-13T22:46:59.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.704+0000 7f9f02b01700 1 -- 172.21.15.2:0/3568930249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9efc062430 con 0x7f9efc07be90 2024-09-13T22:46:59.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.704+0000 7f9ef1ffb700 1 --2- 172.21.15.2:0/3568930249 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9ee4038370 0x7f9ee403a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:46:59.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.704+0000 7f9ef1ffb700 1 -- 172.21.15.2:0/3568930249 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9ef804be80 con 0x7f9efc07be90 2024-09-13T22:46:59.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.704+0000 7f9ef3fff700 1 --2- 172.21.15.2:0/3568930249 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9ee4038370 0x7f9ee403a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:46:59.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.704+0000 7f9ef3fff700 1 --2- 172.21.15.2:0/3568930249 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9ee4038370 0x7f9ee403a830 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9eec006fd0 tx=0x7f9eec006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:46:59.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.709+0000 7f9ef1ffb700 1 -- 172.21.15.2:0/3568930249 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9efc062430 con 0x7f9efc07be90 2024-09-13T22:46:59.407 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.922+0000 7f9f02b01700 1 -- 172.21.15.2:0/3568930249 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f9efc062430 con 0x7f9ee4038370 2024-09-13T22:46:59.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.926+0000 7f9ef1ffb700 1 -- 172.21.15.2:0/3568930249 <== mgr.14120 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f9efc062430 con 0x7f9ee4038370 2024-09-13T22:46:59.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.928+0000 7f9f02b01700 1 -- 172.21.15.2:0/3568930249 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9ee4038370 msgr2=0x7f9ee403a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:59.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.928+0000 7f9f02b01700 1 --2- 172.21.15.2:0/3568930249 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9ee4038370 0x7f9ee403a830 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9eec006fd0 tx=0x7f9eec006e40 comp rx=0 tx=0).stop 2024-09-13T22:46:59.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.928+0000 7f9f02b01700 1 -- 172.21.15.2:0/3568930249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc07be90 msgr2=0x7f9efc19c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:46:59.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.928+0000 7f9f02b01700 1 --2- 172.21.15.2:0/3568930249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc07be90 0x7f9efc19c470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8004070 tx=0x7f9ef80049f0 comp rx=0 tx=0).stop 2024-09-13T22:46:59.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.928+0000 7f9f02b01700 1 -- 172.21.15.2:0/3568930249 shutdown_connections 2024-09-13T22:46:59.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.928+0000 7f9f02b01700 1 --2- 172.21.15.2:0/3568930249 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9ee4038370 0x7f9ee403a830 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:59.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.928+0000 7f9f02b01700 1 --2- 172.21.15.2:0/3568930249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9efc07be90 0x7f9efc19c470 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:46:59.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.928+0000 7f9f02b01700 1 -- 172.21.15.2:0/3568930249 >> 172.21.15.2:0/3568930249 conn(0x7f9efc101bd0 msgr2=0x7f9efc103290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:46:59.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.928+0000 7f9f02b01700 1 -- 172.21.15.2:0/3568930249 shutdown_connections 2024-09-13T22:46:59.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:58.928+0000 7f9f02b01700 1 -- 172.21.15.2:0/3568930249 wait complete. 2024-09-13T22:46:59.408 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying alertmanager service with default placement... 2024-09-13T22:47:00.034 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:59 smithi002 ceph-mon[27637]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:47:00.034 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:59 smithi002 ceph-mon[27637]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:00.035 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:59 smithi002 ceph-mon[27637]: Saving service node-exporter spec with placement * 2024-09-13T22:47:00.035 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:46:59 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:00.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-13T22:47:00.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.805+0000 7f822e97e700 1 Processor -- start 2024-09-13T22:47:00.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.806+0000 7f822e97e700 1 -- start start 2024-09-13T22:47:00.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.806+0000 7f822e97e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82281070d0 0x7f82281094c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:00.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.806+0000 7f822e97e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82280745d0 con 0x7f82281070d0 2024-09-13T22:47:00.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.806+0000 7f8227fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82281070d0 0x7f82281094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:00.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.806+0000 7f8227fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82281070d0 0x7f82281094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58270/0 (socket says 172.21.15.2:58270) 2024-09-13T22:47:00.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.806+0000 7f8227fff700 1 -- 172.21.15.2:0/1353695249 learned_addr learned my addr 172.21.15.2:0/1353695249 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:00.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.806+0000 7f8227fff700 1 -- 172.21.15.2:0/1353695249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8228109a00 con 0x7f82281070d0 2024-09-13T22:47:00.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.806+0000 7f8227fff700 1 --2- 172.21.15.2:0/1353695249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82281070d0 0x7f82281094c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f82180098a0 tx=0x7f8218009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3fcf077d636db7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:00.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.807+0000 7f82277fe700 1 -- 172.21.15.2:0/1353695249 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8218004180 con 0x7f82281070d0 2024-09-13T22:47:00.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.807+0000 7f82277fe700 1 -- 172.21.15.2:0/1353695249 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f82180042e0 con 0x7f82281070d0 2024-09-13T22:47:00.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.807+0000 7f82277fe700 1 -- 172.21.15.2:0/1353695249 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8218011af0 con 0x7f82281070d0 2024-09-13T22:47:00.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.807+0000 7f822e97e700 1 -- 172.21.15.2:0/1353695249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82281070d0 msgr2=0x7f82281094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:00.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.807+0000 7f822e97e700 1 --2- 172.21.15.2:0/1353695249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82281070d0 0x7f82281094c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f82180098a0 tx=0x7f8218009bb0 comp rx=0 tx=0).stop 2024-09-13T22:47:00.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.807+0000 7f822e97e700 1 -- 172.21.15.2:0/1353695249 shutdown_connections 2024-09-13T22:47:00.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.807+0000 7f822e97e700 1 --2- 172.21.15.2:0/1353695249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82281070d0 0x7f82281094c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:00.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.807+0000 7f822e97e700 1 -- 172.21.15.2:0/1353695249 >> 172.21.15.2:0/1353695249 conn(0x7f8228100ac0 msgr2=0x7f8228102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:00.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.807+0000 7f822e97e700 1 -- 172.21.15.2:0/1353695249 shutdown_connections 2024-09-13T22:47:00.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.807+0000 7f822e97e700 1 -- 172.21.15.2:0/1353695249 wait complete. 2024-09-13T22:47:00.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.808+0000 7f822e97e700 1 Processor -- start 2024-09-13T22:47:00.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.808+0000 7f822e97e700 1 -- start start 2024-09-13T22:47:00.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.808+0000 7f822e97e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82281070d0 0x7f822819a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:00.553 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.808+0000 7f822e97e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822819a820 con 0x7f82281070d0 2024-09-13T22:47:00.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.808+0000 7f8227fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82281070d0 0x7f822819a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:00.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.808+0000 7f8227fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82281070d0 0x7f822819a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58276/0 (socket says 172.21.15.2:58276) 2024-09-13T22:47:00.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.808+0000 7f8227fff700 1 -- 172.21.15.2:0/4239310613 learned_addr learned my addr 172.21.15.2:0/4239310613 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:00.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.808+0000 7f8227fff700 1 -- 172.21.15.2:0/4239310613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8218009550 con 0x7f82281070d0 2024-09-13T22:47:00.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.809+0000 7f8227fff700 1 --2- 172.21.15.2:0/4239310613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82281070d0 0x7f822819a2e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8218011ad0 tx=0x7f8218011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:00.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.809+0000 7f8225ffb700 1 -- 172.21.15.2:0/4239310613 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8218003ab0 con 0x7f82281070d0 2024-09-13T22:47:00.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.809+0000 7f8225ffb700 1 -- 172.21.15.2:0/4239310613 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8218003c10 con 0x7f82281070d0 2024-09-13T22:47:00.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.809+0000 7f8225ffb700 1 -- 172.21.15.2:0/4239310613 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82180198e0 con 0x7f82281070d0 2024-09-13T22:47:00.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.809+0000 7f822e97e700 1 -- 172.21.15.2:0/4239310613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822819aa20 con 0x7f82281070d0 2024-09-13T22:47:00.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.809+0000 7f822e97e700 1 -- 172.21.15.2:0/4239310613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822819ae40 con 0x7f82281070d0 2024-09-13T22:47:00.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.810+0000 7f8225ffb700 1 -- 172.21.15.2:0/4239310613 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f8218019ba0 con 0x7f82281070d0 2024-09-13T22:47:00.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.810+0000 7f822e97e700 1 -- 172.21.15.2:0/4239310613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82280623c0 con 0x7f82281070d0 2024-09-13T22:47:00.554 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.810+0000 7f8225ffb700 1 --2- 172.21.15.2:0/4239310613 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8214038320 0x7f821403a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:00.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.810+0000 7f8225ffb700 1 -- 172.21.15.2:0/4239310613 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f821804c170 con 0x7f82281070d0 2024-09-13T22:47:00.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.810+0000 7f821ffff700 1 --2- 172.21.15.2:0/4239310613 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8214038320 0x7f821403a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:00.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.811+0000 7f821ffff700 1 --2- 172.21.15.2:0/4239310613 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8214038320 0x7f821403a7e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8210006fd0 tx=0x7f8210006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:00.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:46:59.815+0000 7f8225ffb700 1 -- 172.21.15.2:0/4239310613 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f821801a430 con 0x7f82281070d0 2024-09-13T22:47:00.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.027+0000 7f822e97e700 1 -- 172.21.15.2:0/4239310613 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f8228101f70 con 0x7f8214038320 2024-09-13T22:47:00.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.031+0000 7f8225ffb700 1 -- 172.21.15.2:0/4239310613 <== mgr.14120 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f8228101f70 con 0x7f8214038320 2024-09-13T22:47:00.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.033+0000 7f822e97e700 1 -- 172.21.15.2:0/4239310613 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8214038320 msgr2=0x7f821403a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:00.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.033+0000 7f822e97e700 1 --2- 172.21.15.2:0/4239310613 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8214038320 0x7f821403a7e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8210006fd0 tx=0x7f8210006e40 comp rx=0 tx=0).stop 2024-09-13T22:47:00.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.033+0000 7f822e97e700 1 -- 172.21.15.2:0/4239310613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82281070d0 msgr2=0x7f822819a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:00.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.033+0000 7f822e97e700 1 --2- 172.21.15.2:0/4239310613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82281070d0 0x7f822819a2e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8218011ad0 tx=0x7f8218011bb0 comp rx=0 tx=0).stop 2024-09-13T22:47:00.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.033+0000 7f822e97e700 1 -- 172.21.15.2:0/4239310613 shutdown_connections 2024-09-13T22:47:00.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.033+0000 7f822e97e700 1 --2- 172.21.15.2:0/4239310613 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8214038320 0x7f821403a7e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:00.555 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.033+0000 7f822e97e700 1 --2- 172.21.15.2:0/4239310613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82281070d0 0x7f822819a2e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:00.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.033+0000 7f822e97e700 1 -- 172.21.15.2:0/4239310613 >> 172.21.15.2:0/4239310613 conn(0x7f8228100ac0 msgr2=0x7f8228101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:00.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.033+0000 7f822e97e700 1 -- 172.21.15.2:0/4239310613 shutdown_connections 2024-09-13T22:47:00.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.033+0000 7f822e97e700 1 -- 172.21.15.2:0/4239310613 wait complete. 2024-09-13T22:47:01.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:01 smithi002 ceph-mon[27637]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:01.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:01 smithi002 ceph-mon[27637]: Saving service alertmanager spec with placement count:1 2024-09-13T22:47:01.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:01 smithi002 ceph-mon[27637]: from='mgr.14120 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:01.801 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.937+0000 7fe357098700 1 Processor -- start 2024-09-13T22:47:01.801 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.937+0000 7fe357098700 1 -- start start 2024-09-13T22:47:01.801 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.937+0000 7fe357098700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3501065d0 0x7fe3501069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:01.801 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.937+0000 7fe357098700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe350106fc0 con 0x7fe3501065d0 2024-09-13T22:47:01.801 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.937+0000 7fe354e34700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3501065d0 0x7fe3501069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:01.801 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.937+0000 7fe354e34700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3501065d0 0x7fe3501069f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49226/0 (socket says 172.21.15.2:49226) 2024-09-13T22:47:01.801 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.937+0000 7fe354e34700 1 -- 172.21.15.2:0/705072679 learned_addr learned my addr 172.21.15.2:0/705072679 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:01.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.937+0000 7fe354e34700 1 -- 172.21.15.2:0/705072679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3501077d0 con 0x7fe3501065d0 2024-09-13T22:47:01.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.938+0000 7fe354e34700 1 --2- 172.21.15.2:0/705072679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3501065d0 0x7fe3501069f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe3440098a0 tx=0x7fe344009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bb9c079116b28e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:01.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.938+0000 7fe34f7fe700 1 -- 172.21.15.2:0/705072679 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe344004180 con 0x7fe3501065d0 2024-09-13T22:47:01.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.938+0000 7fe34f7fe700 1 -- 172.21.15.2:0/705072679 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe3440042e0 con 0x7fe3501065d0 2024-09-13T22:47:01.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.938+0000 7fe34f7fe700 1 -- 172.21.15.2:0/705072679 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe344011af0 con 0x7fe3501065d0 2024-09-13T22:47:01.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.938+0000 7fe357098700 1 -- 172.21.15.2:0/705072679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3501065d0 msgr2=0x7fe3501069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:01.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.938+0000 7fe357098700 1 --2- 172.21.15.2:0/705072679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3501065d0 0x7fe3501069f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe3440098a0 tx=0x7fe344009bb0 comp rx=0 tx=0).stop 2024-09-13T22:47:01.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.938+0000 7fe357098700 1 -- 172.21.15.2:0/705072679 shutdown_connections 2024-09-13T22:47:01.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.938+0000 7fe357098700 1 --2- 172.21.15.2:0/705072679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3501065d0 0x7fe3501069f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:01.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.938+0000 7fe357098700 1 -- 172.21.15.2:0/705072679 >> 172.21.15.2:0/705072679 conn(0x7fe350101bd0 msgr2=0x7fe350103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:01.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.938+0000 7fe357098700 1 -- 172.21.15.2:0/705072679 shutdown_connections 2024-09-13T22:47:01.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.938+0000 7fe357098700 1 -- 172.21.15.2:0/705072679 wait complete. 2024-09-13T22:47:01.802 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.939+0000 7fe357098700 1 Processor -- start 2024-09-13T22:47:01.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.939+0000 7fe357098700 1 -- start start 2024-09-13T22:47:01.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.939+0000 7fe357098700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3501065d0 0x7fe35007bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:01.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.939+0000 7fe357098700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35007c1a0 con 0x7fe3501065d0 2024-09-13T22:47:01.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.939+0000 7fe354e34700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3501065d0 0x7fe35007bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:01.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.939+0000 7fe354e34700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3501065d0 0x7fe35007bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49232/0 (socket says 172.21.15.2:49232) 2024-09-13T22:47:01.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.939+0000 7fe354e34700 1 -- 172.21.15.2:0/2739114522 learned_addr learned my addr 172.21.15.2:0/2739114522 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:01.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.940+0000 7fe354e34700 1 -- 172.21.15.2:0/2739114522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe344009550 con 0x7fe3501065d0 2024-09-13T22:47:01.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.940+0000 7fe354e34700 1 --2- 172.21.15.2:0/2739114522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3501065d0 0x7fe35007bc60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe344006ba0 tx=0x7fe344011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:01.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.940+0000 7fe34dffb700 1 -- 172.21.15.2:0/2739114522 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe344003b00 con 0x7fe3501065d0 2024-09-13T22:47:01.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.940+0000 7fe357098700 1 -- 172.21.15.2:0/2739114522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe35007a2b0 con 0x7fe3501065d0 2024-09-13T22:47:01.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.940+0000 7fe34dffb700 1 -- 172.21.15.2:0/2739114522 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe34401a8e0 con 0x7fe3501065d0 2024-09-13T22:47:01.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.940+0000 7fe34dffb700 1 -- 172.21.15.2:0/2739114522 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe344019990 con 0x7fe3501065d0 2024-09-13T22:47:01.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.940+0000 7fe357098700 1 -- 172.21.15.2:0/2739114522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35007a6d0 con 0x7fe3501065d0 2024-09-13T22:47:01.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.941+0000 7fe34dffb700 1 -- 172.21.15.2:0/2739114522 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fe344019c50 con 0x7fe3501065d0 2024-09-13T22:47:01.803 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.941+0000 7fe357098700 1 -- 172.21.15.2:0/2739114522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3500623c0 con 0x7fe3501065d0 2024-09-13T22:47:01.804 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.941+0000 7fe34dffb700 1 --2- 172.21.15.2:0/2739114522 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe3400382d0 0x7fe34003a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:01.804 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.941+0000 7fe34dffb700 1 -- 172.21.15.2:0/2739114522 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe34404c570 con 0x7fe3501065d0 2024-09-13T22:47:01.804 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.941+0000 7fe34ffff700 1 --2- 172.21.15.2:0/2739114522 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe3400382d0 0x7fe34003a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:01.804 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.942+0000 7fe34ffff700 1 --2- 172.21.15.2:0/2739114522 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe3400382d0 0x7fe34003a790 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe33c006fd0 tx=0x7fe33c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:01.804 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:00.946+0000 7fe34dffb700 1 -- 172.21.15.2:0/2739114522 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe344018b40 con 0x7fe3501065d0 2024-09-13T22:47:01.804 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:01.142+0000 7fe357098700 1 -- 172.21.15.2:0/2739114522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fe35010aa00 con 0x7fe3501065d0 2024-09-13T22:47:01.804 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:01.146+0000 7fe34dffb700 1 -- 172.21.15.2:0/2739114522 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fe344018b40 con 0x7fe3501065d0 2024-09-13T22:47:01.804 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:01.148+0000 7fe357098700 1 -- 172.21.15.2:0/2739114522 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe3400382d0 msgr2=0x7fe34003a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:01.804 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:01.148+0000 7fe357098700 1 --2- 172.21.15.2:0/2739114522 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe3400382d0 0x7fe34003a790 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe33c006fd0 tx=0x7fe33c006e40 comp rx=0 tx=0).stop 2024-09-13T22:47:01.804 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:01.148+0000 7fe357098700 1 -- 172.21.15.2:0/2739114522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3501065d0 msgr2=0x7fe35007bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:01.804 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:01.148+0000 7fe357098700 1 --2- 172.21.15.2:0/2739114522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3501065d0 0x7fe35007bc60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe344006ba0 tx=0x7fe344011b50 comp rx=0 tx=0).stop 2024-09-13T22:47:01.804 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:01.148+0000 7fe357098700 1 -- 172.21.15.2:0/2739114522 shutdown_connections 2024-09-13T22:47:01.804 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:01.148+0000 7fe357098700 1 --2- 172.21.15.2:0/2739114522 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe3400382d0 0x7fe34003a790 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:01.805 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:01.148+0000 7fe357098700 1 --2- 172.21.15.2:0/2739114522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3501065d0 0x7fe35007bc60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:01.805 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:01.148+0000 7fe357098700 1 -- 172.21.15.2:0/2739114522 >> 172.21.15.2:0/2739114522 conn(0x7fe350101bd0 msgr2=0x7fe350103290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:01.805 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:01.148+0000 7fe357098700 1 -- 172.21.15.2:0/2739114522 shutdown_connections 2024-09-13T22:47:01.805 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:01.148+0000 7fe357098700 1 -- 172.21.15.2:0/2739114522 wait complete. 2024-09-13T22:47:02.179 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:02 smithi002 ceph-mon[27637]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:47:02.179 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:02 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2739114522' entity='client.admin' 2024-09-13T22:47:03.014 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.223+0000 7fafecbdc700 1 Processor -- start 2024-09-13T22:47:03.014 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.223+0000 7fafecbdc700 1 -- start start 2024-09-13T22:47:03.014 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.223+0000 7fafecbdc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe81048d0 0x7fafe8104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:03.014 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.223+0000 7fafecbdc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe81052c0 con 0x7fafe81048d0 2024-09-13T22:47:03.014 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.223+0000 7fafe659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe81048d0 0x7fafe8104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:03.014 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.223+0000 7fafe659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe81048d0 0x7fafe8104cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49236/0 (socket says 172.21.15.2:49236) 2024-09-13T22:47:03.014 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.223+0000 7fafe659c700 1 -- 172.21.15.2:0/2206330579 learned_addr learned my addr 172.21.15.2:0/2206330579 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:03.014 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.224+0000 7fafe659c700 1 -- 172.21.15.2:0/2206330579 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe8107860 con 0x7fafe81048d0 2024-09-13T22:47:03.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.224+0000 7fafe659c700 1 --2- 172.21.15.2:0/2206330579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe81048d0 0x7fafe8104cf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fafd80098a0 tx=0x7fafd8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7de1000c863ed15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:03.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.224+0000 7fafe559a700 1 -- 172.21.15.2:0/2206330579 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafd8004180 con 0x7fafe81048d0 2024-09-13T22:47:03.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.224+0000 7fafe559a700 1 -- 172.21.15.2:0/2206330579 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fafd80042e0 con 0x7fafe81048d0 2024-09-13T22:47:03.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.224+0000 7fafe559a700 1 -- 172.21.15.2:0/2206330579 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafd8011af0 con 0x7fafe81048d0 2024-09-13T22:47:03.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.225+0000 7fafecbdc700 1 -- 172.21.15.2:0/2206330579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe81048d0 msgr2=0x7fafe8104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:03.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.225+0000 7fafecbdc700 1 --2- 172.21.15.2:0/2206330579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe81048d0 0x7fafe8104cf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fafd80098a0 tx=0x7fafd8009bb0 comp rx=0 tx=0).stop 2024-09-13T22:47:03.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.225+0000 7fafecbdc700 1 -- 172.21.15.2:0/2206330579 shutdown_connections 2024-09-13T22:47:03.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.225+0000 7fafecbdc700 1 --2- 172.21.15.2:0/2206330579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe81048d0 0x7fafe8104cf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:03.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.225+0000 7fafecbdc700 1 -- 172.21.15.2:0/2206330579 >> 172.21.15.2:0/2206330579 conn(0x7fafe8100220 msgr2=0x7fafe8102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:03.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.225+0000 7fafecbdc700 1 -- 172.21.15.2:0/2206330579 shutdown_connections 2024-09-13T22:47:03.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.225+0000 7fafecbdc700 1 -- 172.21.15.2:0/2206330579 wait complete. 2024-09-13T22:47:03.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.226+0000 7fafecbdc700 1 Processor -- start 2024-09-13T22:47:03.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.226+0000 7fafecbdc700 1 -- start start 2024-09-13T22:47:03.015 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.226+0000 7fafecbdc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe81048d0 0x7fafe819a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:03.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.226+0000 7fafecbdc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe819a870 con 0x7fafe81048d0 2024-09-13T22:47:03.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.226+0000 7fafe659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe81048d0 0x7fafe819a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:03.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.226+0000 7fafe659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe81048d0 0x7fafe819a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49242/0 (socket says 172.21.15.2:49242) 2024-09-13T22:47:03.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.226+0000 7fafe659c700 1 -- 172.21.15.2:0/1460223122 learned_addr learned my addr 172.21.15.2:0/1460223122 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:03.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.226+0000 7fafe659c700 1 -- 172.21.15.2:0/1460223122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd8009550 con 0x7fafe81048d0 2024-09-13T22:47:03.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.226+0000 7fafe659c700 1 --2- 172.21.15.2:0/1460223122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe81048d0 0x7fafe819a330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fafd8006ba0 tx=0x7fafd8011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:03.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.226+0000 7fafdf7fe700 1 -- 172.21.15.2:0/1460223122 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafd8003b00 con 0x7fafe81048d0 2024-09-13T22:47:03.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.226+0000 7fafdf7fe700 1 -- 172.21.15.2:0/1460223122 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fafd801a8e0 con 0x7fafe81048d0 2024-09-13T22:47:03.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.227+0000 7fafdf7fe700 1 -- 172.21.15.2:0/1460223122 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafd8019990 con 0x7fafe81048d0 2024-09-13T22:47:03.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.227+0000 7fafecbdc700 1 -- 172.21.15.2:0/1460223122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe819aa70 con 0x7fafe81048d0 2024-09-13T22:47:03.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.227+0000 7fafecbdc700 1 -- 172.21.15.2:0/1460223122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe819ae90 con 0x7fafe81048d0 2024-09-13T22:47:03.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.227+0000 7fafdf7fe700 1 -- 172.21.15.2:0/1460223122 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fafd8019c50 con 0x7fafe81048d0 2024-09-13T22:47:03.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.228+0000 7fafdf7fe700 1 --2- 172.21.15.2:0/1460223122 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fafd40382d0 0x7fafd403a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:03.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.228+0000 7fafecbdc700 1 -- 172.21.15.2:0/1460223122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe80623c0 con 0x7fafe81048d0 2024-09-13T22:47:03.016 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.228+0000 7fafdf7fe700 1 -- 172.21.15.2:0/1460223122 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fafd804c570 con 0x7fafe81048d0 2024-09-13T22:47:03.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.228+0000 7fafe5d9b700 1 --2- 172.21.15.2:0/1460223122 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fafd40382d0 0x7fafd403a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:03.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.228+0000 7fafe5d9b700 1 --2- 172.21.15.2:0/1460223122 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fafd40382d0 0x7fafd403a790 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fafd0006fd0 tx=0x7fafd0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:03.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.232+0000 7fafdf7fe700 1 -- 172.21.15.2:0/1460223122 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fafd8018d20 con 0x7fafe81048d0 2024-09-13T22:47:03.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.429+0000 7fafecbdc700 1 -- 172.21.15.2:0/1460223122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fafe819dd60 con 0x7fafe81048d0 2024-09-13T22:47:03.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.433+0000 7fafdf7fe700 1 -- 172.21.15.2:0/1460223122 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fafd802b340 con 0x7fafe81048d0 2024-09-13T22:47:03.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.435+0000 7fafecbdc700 1 -- 172.21.15.2:0/1460223122 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fafd40382d0 msgr2=0x7fafd403a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:03.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.435+0000 7fafecbdc700 1 --2- 172.21.15.2:0/1460223122 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fafd40382d0 0x7fafd403a790 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fafd0006fd0 tx=0x7fafd0006e40 comp rx=0 tx=0).stop 2024-09-13T22:47:03.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.435+0000 7fafecbdc700 1 -- 172.21.15.2:0/1460223122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe81048d0 msgr2=0x7fafe819a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:03.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.435+0000 7fafecbdc700 1 --2- 172.21.15.2:0/1460223122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe81048d0 0x7fafe819a330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fafd8006ba0 tx=0x7fafd8011b50 comp rx=0 tx=0).stop 2024-09-13T22:47:03.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.435+0000 7fafecbdc700 1 -- 172.21.15.2:0/1460223122 shutdown_connections 2024-09-13T22:47:03.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.435+0000 7fafecbdc700 1 --2- 172.21.15.2:0/1460223122 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fafd40382d0 0x7fafd403a790 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:03.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.435+0000 7fafecbdc700 1 --2- 172.21.15.2:0/1460223122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe81048d0 0x7fafe819a330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:03.017 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.435+0000 7fafecbdc700 1 -- 172.21.15.2:0/1460223122 >> 172.21.15.2:0/1460223122 conn(0x7fafe8100220 msgr2=0x7fafe81018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:03.018 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.435+0000 7fafecbdc700 1 -- 172.21.15.2:0/1460223122 shutdown_connections 2024-09-13T22:47:03.018 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:02.435+0000 7fafecbdc700 1 -- 172.21.15.2:0/1460223122 wait complete. 2024-09-13T22:47:03.018 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling the dashboard module... 2024-09-13T22:47:03.704 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:03 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/1460223122' entity='client.admin' 2024-09-13T22:47:04.712 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:04 smithi002 ceph-mon[27637]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:47:04.712 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:04 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/204133557' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-13T22:47:05.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.434+0000 7f8d49d9e700 1 Processor -- start 2024-09-13T22:47:05.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.434+0000 7f8d49d9e700 1 -- start start 2024-09-13T22:47:05.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.434+0000 7f8d49d9e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d44106610 0x7f8d44106a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:05.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.434+0000 7f8d49d9e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d44107000 con 0x7f8d44106610 2024-09-13T22:47:05.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.434+0000 7f8d437fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d44106610 0x7f8d44106a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:05.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.434+0000 7f8d437fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d44106610 0x7f8d44106a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49252/0 (socket says 172.21.15.2:49252) 2024-09-13T22:47:05.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.434+0000 7f8d437fe700 1 -- 172.21.15.2:0/2412249268 learned_addr learned my addr 172.21.15.2:0/2412249268 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:05.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.435+0000 7f8d437fe700 1 -- 172.21.15.2:0/2412249268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d44107810 con 0x7f8d44106610 2024-09-13T22:47:05.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.435+0000 7f8d437fe700 1 --2- 172.21.15.2:0/2412249268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d44106610 0x7f8d44106a30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d340098a0 tx=0x7f8d34009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec06af65a5b36814 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:05.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.435+0000 7f8d42ffd700 1 -- 172.21.15.2:0/2412249268 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d34004180 con 0x7f8d44106610 2024-09-13T22:47:05.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.435+0000 7f8d42ffd700 1 -- 172.21.15.2:0/2412249268 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8d340042e0 con 0x7f8d44106610 2024-09-13T22:47:05.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.435+0000 7f8d42ffd700 1 -- 172.21.15.2:0/2412249268 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d34011af0 con 0x7f8d44106610 2024-09-13T22:47:05.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.436+0000 7f8d49d9e700 1 -- 172.21.15.2:0/2412249268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d44106610 msgr2=0x7f8d44106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:05.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.436+0000 7f8d49d9e700 1 --2- 172.21.15.2:0/2412249268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d44106610 0x7f8d44106a30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d340098a0 tx=0x7f8d34009bb0 comp rx=0 tx=0).stop 2024-09-13T22:47:05.030 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.436+0000 7f8d49d9e700 1 -- 172.21.15.2:0/2412249268 shutdown_connections 2024-09-13T22:47:05.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.436+0000 7f8d49d9e700 1 --2- 172.21.15.2:0/2412249268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d44106610 0x7f8d44106a30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:05.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.436+0000 7f8d49d9e700 1 -- 172.21.15.2:0/2412249268 >> 172.21.15.2:0/2412249268 conn(0x7f8d44101bd0 msgr2=0x7f8d44103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:05.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.436+0000 7f8d49d9e700 1 -- 172.21.15.2:0/2412249268 shutdown_connections 2024-09-13T22:47:05.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.436+0000 7f8d49d9e700 1 -- 172.21.15.2:0/2412249268 wait complete. 2024-09-13T22:47:05.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.436+0000 7f8d49d9e700 1 Processor -- start 2024-09-13T22:47:05.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.436+0000 7f8d49d9e700 1 -- start start 2024-09-13T22:47:05.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.437+0000 7f8d49d9e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d44106610 0x7f8d4407bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:05.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.437+0000 7f8d49d9e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4407c1a0 con 0x7f8d44106610 2024-09-13T22:47:05.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.437+0000 7f8d437fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d44106610 0x7f8d4407bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:05.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.437+0000 7f8d437fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d44106610 0x7f8d4407bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49256/0 (socket says 172.21.15.2:49256) 2024-09-13T22:47:05.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.437+0000 7f8d437fe700 1 -- 172.21.15.2:0/204133557 learned_addr learned my addr 172.21.15.2:0/204133557 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:05.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.437+0000 7f8d437fe700 1 -- 172.21.15.2:0/204133557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d34009550 con 0x7f8d44106610 2024-09-13T22:47:05.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.437+0000 7f8d437fe700 1 --2- 172.21.15.2:0/204133557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d44106610 0x7f8d4407bc60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8d34006ba0 tx=0x7f8d34011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:05.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.437+0000 7f8d417fa700 1 -- 172.21.15.2:0/204133557 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d34003b00 con 0x7f8d44106610 2024-09-13T22:47:05.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.437+0000 7f8d417fa700 1 -- 172.21.15.2:0/204133557 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8d3401a8e0 con 0x7f8d44106610 2024-09-13T22:47:05.031 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.437+0000 7f8d49d9e700 1 -- 172.21.15.2:0/204133557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4407a2b0 con 0x7f8d44106610 2024-09-13T22:47:05.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.437+0000 7f8d417fa700 1 -- 172.21.15.2:0/204133557 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d34019990 con 0x7f8d44106610 2024-09-13T22:47:05.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.437+0000 7f8d49d9e700 1 -- 172.21.15.2:0/204133557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4407a6d0 con 0x7f8d44106610 2024-09-13T22:47:05.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.438+0000 7f8d417fa700 1 -- 172.21.15.2:0/204133557 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f8d34019c00 con 0x7f8d44106610 2024-09-13T22:47:05.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.439+0000 7f8d49d9e700 1 -- 172.21.15.2:0/204133557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d440623c0 con 0x7f8d44106610 2024-09-13T22:47:05.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.439+0000 7f8d417fa700 1 --2- 172.21.15.2:0/204133557 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8d30038320 0x7f8d3003a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:05.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.439+0000 7f8d417fa700 1 -- 172.21.15.2:0/204133557 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8d3404c6c0 con 0x7f8d44106610 2024-09-13T22:47:05.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.439+0000 7f8d3affd700 1 --2- 172.21.15.2:0/204133557 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8d30038320 0x7f8d3003a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:05.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.439+0000 7f8d3affd700 1 --2- 172.21.15.2:0/204133557 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8d30038320 0x7f8d3003a7e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c006fd0 tx=0x7f8d2c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:05.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.444+0000 7f8d417fa700 1 -- 172.21.15.2:0/204133557 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8d3402d440 con 0x7f8d44106610 2024-09-13T22:47:05.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:03.703+0000 7f8d49d9e700 1 -- 172.21.15.2:0/204133557 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f8d4410aa40 con 0x7f8d44106610 2024-09-13T22:47:05.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:04.437+0000 7f8d417fa700 1 -- 172.21.15.2:0/204133557 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 9) v1 ==== 45296+0+0 (secure 0 0 0) 0x7f8d3402c3a0 con 0x7f8d44106610 2024-09-13T22:47:05.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:04.439+0000 7f8d417fa700 1 -- 172.21.15.2:0/204133557 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f8d3402d440 con 0x7f8d44106610 2024-09-13T22:47:05.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:04.442+0000 7f8d49d9e700 1 -- 172.21.15.2:0/204133557 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8d30038320 msgr2=0x7f8d3003a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:05.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:04.442+0000 7f8d49d9e700 1 --2- 172.21.15.2:0/204133557 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8d30038320 0x7f8d3003a7e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c006fd0 tx=0x7f8d2c006e40 comp rx=0 tx=0).stop 2024-09-13T22:47:05.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:04.442+0000 7f8d49d9e700 1 -- 172.21.15.2:0/204133557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d44106610 msgr2=0x7f8d4407bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:05.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:04.442+0000 7f8d49d9e700 1 --2- 172.21.15.2:0/204133557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d44106610 0x7f8d4407bc60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8d34006ba0 tx=0x7f8d34011b50 comp rx=0 tx=0).stop 2024-09-13T22:47:05.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:04.442+0000 7f8d49d9e700 1 -- 172.21.15.2:0/204133557 shutdown_connections 2024-09-13T22:47:05.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:04.442+0000 7f8d49d9e700 1 --2- 172.21.15.2:0/204133557 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8d30038320 0x7f8d3003a7e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:05.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:04.442+0000 7f8d49d9e700 1 --2- 172.21.15.2:0/204133557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d44106610 0x7f8d4407bc60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:05.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:04.442+0000 7f8d49d9e700 1 -- 172.21.15.2:0/204133557 >> 172.21.15.2:0/204133557 conn(0x7f8d44101bd0 msgr2=0x7f8d44103220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:05.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:04.442+0000 7f8d49d9e700 1 -- 172.21.15.2:0/204133557 shutdown_connections 2024-09-13T22:47:05.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:04.442+0000 7f8d49d9e700 1 -- 172.21.15.2:0/204133557 wait complete. 2024-09-13T22:47:05.711 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:05 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/204133557' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-13T22:47:05.711 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:05 smithi002 ceph-mon[27637]: mgrmap e9: smithi002.yumtzz(active, since 25s) 2024-09-13T22:47:06.385 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:47:06.385 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-13T22:47:06.385 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T22:47:06.385 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "smithi002.yumtzz", 2024-09-13T22:47:06.385 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T22:47:06.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:47:06.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.503+0000 7f998c388700 1 Processor -- start 2024-09-13T22:47:06.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.503+0000 7f998c388700 1 -- start start 2024-09-13T22:47:06.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.504+0000 7f998c388700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99841070d0 0x7f99841094c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:06.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.504+0000 7f998c388700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9984079e80 con 0x7f99841070d0 2024-09-13T22:47:06.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.504+0000 7f998a124700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99841070d0 0x7f99841094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:06.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.504+0000 7f998a124700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99841070d0 0x7f99841094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49278/0 (socket says 172.21.15.2:49278) 2024-09-13T22:47:06.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.504+0000 7f998a124700 1 -- 172.21.15.2:0/1830469823 learned_addr learned my addr 172.21.15.2:0/1830469823 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:06.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.504+0000 7f998a124700 1 -- 172.21.15.2:0/1830469823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9984109a00 con 0x7f99841070d0 2024-09-13T22:47:06.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.504+0000 7f998a124700 1 --2- 172.21.15.2:0/1830469823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99841070d0 0x7f99841094c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f99800098a0 tx=0x7f9980009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b3561ca0e9cd66 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:06.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.505+0000 7f9989122700 1 -- 172.21.15.2:0/1830469823 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9980004180 con 0x7f99841070d0 2024-09-13T22:47:06.386 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.505+0000 7f9989122700 1 -- 172.21.15.2:0/1830469823 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f99800042e0 con 0x7f99841070d0 2024-09-13T22:47:06.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.505+0000 7f9989122700 1 -- 172.21.15.2:0/1830469823 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9980011af0 con 0x7f99841070d0 2024-09-13T22:47:06.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.505+0000 7f998c388700 1 -- 172.21.15.2:0/1830469823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99841070d0 msgr2=0x7f99841094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:06.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.505+0000 7f998c388700 1 --2- 172.21.15.2:0/1830469823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99841070d0 0x7f99841094c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f99800098a0 tx=0x7f9980009bb0 comp rx=0 tx=0).stop 2024-09-13T22:47:06.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.505+0000 7f998c388700 1 -- 172.21.15.2:0/1830469823 shutdown_connections 2024-09-13T22:47:06.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.505+0000 7f998c388700 1 --2- 172.21.15.2:0/1830469823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99841070d0 0x7f99841094c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:06.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.505+0000 7f998c388700 1 -- 172.21.15.2:0/1830469823 >> 172.21.15.2:0/1830469823 conn(0x7f9984100ac0 msgr2=0x7f9984102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:06.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.506+0000 7f998c388700 1 -- 172.21.15.2:0/1830469823 shutdown_connections 2024-09-13T22:47:06.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.506+0000 7f998c388700 1 -- 172.21.15.2:0/1830469823 wait complete. 2024-09-13T22:47:06.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.506+0000 7f998c388700 1 Processor -- start 2024-09-13T22:47:06.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.506+0000 7f998c388700 1 -- start start 2024-09-13T22:47:06.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.506+0000 7f998c388700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99841070d0 0x7f998419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:06.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.506+0000 7f998c388700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998419a820 con 0x7f99841070d0 2024-09-13T22:47:06.387 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.506+0000 7f998a124700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99841070d0 0x7f998419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:06.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.507+0000 7f998a124700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99841070d0 0x7f998419a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49284/0 (socket says 172.21.15.2:49284) 2024-09-13T22:47:06.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.507+0000 7f998a124700 1 -- 172.21.15.2:0/1857551458 learned_addr learned my addr 172.21.15.2:0/1857551458 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:06.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.507+0000 7f998a124700 1 -- 172.21.15.2:0/1857551458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9980009550 con 0x7f99841070d0 2024-09-13T22:47:06.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.507+0000 7f998a124700 1 --2- 172.21.15.2:0/1857551458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99841070d0 0x7f998419a2e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9980006ba0 tx=0x7f9980011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:06.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.507+0000 7f997b7fe700 1 -- 172.21.15.2:0/1857551458 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9980003b00 con 0x7f99841070d0 2024-09-13T22:47:06.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.507+0000 7f998c388700 1 -- 172.21.15.2:0/1857551458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998419aa20 con 0x7f99841070d0 2024-09-13T22:47:06.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.507+0000 7f997b7fe700 1 -- 172.21.15.2:0/1857551458 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f998001a8e0 con 0x7f99841070d0 2024-09-13T22:47:06.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.507+0000 7f997b7fe700 1 -- 172.21.15.2:0/1857551458 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99800199c0 con 0x7f99841070d0 2024-09-13T22:47:06.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.507+0000 7f998c388700 1 -- 172.21.15.2:0/1857551458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998419ae40 con 0x7f99841070d0 2024-09-13T22:47:06.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.508+0000 7f997b7fe700 1 -- 172.21.15.2:0/1857551458 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) v1 ==== 45296+0+0 (secure 0 0 0) 0x7f9980019c80 con 0x7f99841070d0 2024-09-13T22:47:06.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.508+0000 7f998c388700 1 -- 172.21.15.2:0/1857551458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99840623c0 con 0x7f99841070d0 2024-09-13T22:47:06.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.509+0000 7f997b7fe700 1 --2- 172.21.15.2:0/1857551458 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9970038320 0x7f997003a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:06.388 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.509+0000 7f997b7fe700 1 -- 172.21.15.2:0/1857551458 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f998004c5f0 con 0x7f99841070d0 2024-09-13T22:47:06.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.509+0000 7f9989923700 1 -- 172.21.15.2:0/1857551458 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9970038320 msgr2=0x7f997003a7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2 2024-09-13T22:47:06.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.509+0000 7f9989923700 1 --2- 172.21.15.2:0/1857551458 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9970038320 0x7f997003a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T22:47:06.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.513+0000 7f997b7fe700 1 -- 172.21.15.2:0/1857551458 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9980018530 con 0x7f99841070d0 2024-09-13T22:47:06.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.710+0000 7f9989923700 1 -- 172.21.15.2:0/1857551458 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9970038320 msgr2=0x7f997003a7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2 2024-09-13T22:47:06.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.710+0000 7f9989923700 1 --2- 172.21.15.2:0/1857551458 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9970038320 0x7f997003a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T22:47:06.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.770+0000 7f998c388700 1 -- 172.21.15.2:0/1857551458 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f998419dfc0 con 0x7f99841070d0 2024-09-13T22:47:06.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.771+0000 7f997b7fe700 1 -- 172.21.15.2:0/1857551458 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f9980018350 con 0x7f99841070d0 2024-09-13T22:47:06.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.773+0000 7f998c388700 1 -- 172.21.15.2:0/1857551458 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9970038320 msgr2=0x7f997003a7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T22:47:06.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.773+0000 7f998c388700 1 --2- 172.21.15.2:0/1857551458 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9970038320 0x7f997003a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:06.389 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.773+0000 7f998c388700 1 -- 172.21.15.2:0/1857551458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99841070d0 msgr2=0x7f998419a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:06.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.773+0000 7f998c388700 1 --2- 172.21.15.2:0/1857551458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99841070d0 0x7f998419a2e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9980006ba0 tx=0x7f9980011b50 comp rx=0 tx=0).stop 2024-09-13T22:47:06.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.773+0000 7f998c388700 1 -- 172.21.15.2:0/1857551458 shutdown_connections 2024-09-13T22:47:06.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.773+0000 7f998c388700 1 --2- 172.21.15.2:0/1857551458 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9970038320 0x7f997003a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:06.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.773+0000 7f998c388700 1 --2- 172.21.15.2:0/1857551458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99841070d0 0x7f998419a2e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:06.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.773+0000 7f998c388700 1 -- 172.21.15.2:0/1857551458 >> 172.21.15.2:0/1857551458 conn(0x7f9984100ac0 msgr2=0x7f9984101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:06.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.773+0000 7f998c388700 1 -- 172.21.15.2:0/1857551458 shutdown_connections 2024-09-13T22:47:06.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:05.773+0000 7f998c388700 1 -- 172.21.15.2:0/1857551458 wait complete. 2024-09-13T22:47:06.390 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-09-13T22:47:06.390 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 9... 2024-09-13T22:47:06.713 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:06 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/1857551458' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T22:47:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:11 smithi002 ceph-mon[27637]: Active manager daemon smithi002.yumtzz restarted 2024-09-13T22:47:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:11 smithi002 ceph-mon[27637]: Activating manager daemon smithi002.yumtzz 2024-09-13T22:47:12.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:11 smithi002 ceph-mon[27637]: osdmap e3: 0 total, 0 up, 0 in 2024-09-13T22:47:12.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:11 smithi002 ceph-mon[27637]: mgrmap e10: smithi002.yumtzz(active, starting, since 0.00319089s) 2024-09-13T22:47:12.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:11 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T22:47:12.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:11 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr metadata", "who": "smithi002.yumtzz", "id": "smithi002.yumtzz"}]: dispatch 2024-09-13T22:47:12.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:11 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:47:12.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:11 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:47:12.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:11 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:47:12.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:11 smithi002 ceph-mon[27637]: Manager daemon smithi002.yumtzz is now available 2024-09-13T22:47:12.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:11 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:47:12.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:11 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:47:12.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:11 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.yumtzz/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:47:12.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:11 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.yumtzz/trash_purge_schedule"}]: dispatch 2024-09-13T22:47:13.435 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-13T22:47:13.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-13T22:47:13.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T22:47:13.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-13T22:47:13.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.819+0000 7f30c72bc700 1 Processor -- start 2024-09-13T22:47:13.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.819+0000 7f30c72bc700 1 -- start start 2024-09-13T22:47:13.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.819+0000 7f30c72bc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c007bef0 0x7f30c007a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:13.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.819+0000 7f30c72bc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c007a920 con 0x7f30c007bef0 2024-09-13T22:47:13.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.820+0000 7f30c5058700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c007bef0 0x7f30c007a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:13.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.820+0000 7f30c5058700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c007bef0 0x7f30c007a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49300/0 (socket says 172.21.15.2:49300) 2024-09-13T22:47:13.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.820+0000 7f30c5058700 1 -- 172.21.15.2:0/255217219 learned_addr learned my addr 172.21.15.2:0/255217219 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:13.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.820+0000 7f30c5058700 1 -- 172.21.15.2:0/255217219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c007aa60 con 0x7f30c007bef0 2024-09-13T22:47:13.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.820+0000 7f30c5058700 1 --2- 172.21.15.2:0/255217219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c007bef0 0x7f30c007a350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0098a0 tx=0x7f30bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc9c263dacdca4d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:13.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.820+0000 7f30b7fff700 1 -- 172.21.15.2:0/255217219 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30bc004180 con 0x7f30c007bef0 2024-09-13T22:47:13.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.820+0000 7f30b7fff700 1 -- 172.21.15.2:0/255217219 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f30bc0042e0 con 0x7f30c007bef0 2024-09-13T22:47:13.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.820+0000 7f30b7fff700 1 -- 172.21.15.2:0/255217219 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30bc011af0 con 0x7f30c007bef0 2024-09-13T22:47:13.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.821+0000 7f30c72bc700 1 -- 172.21.15.2:0/255217219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c007bef0 msgr2=0x7f30c007a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:13.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.821+0000 7f30c72bc700 1 --2- 172.21.15.2:0/255217219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c007bef0 0x7f30c007a350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0098a0 tx=0x7f30bc009bb0 comp rx=0 tx=0).stop 2024-09-13T22:47:13.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.821+0000 7f30c72bc700 1 -- 172.21.15.2:0/255217219 shutdown_connections 2024-09-13T22:47:13.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.821+0000 7f30c72bc700 1 --2- 172.21.15.2:0/255217219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c007bef0 0x7f30c007a350 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:13.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.821+0000 7f30c72bc700 1 -- 172.21.15.2:0/255217219 >> 172.21.15.2:0/255217219 conn(0x7f30c0101bd0 msgr2=0x7f30c0103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:13.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.821+0000 7f30c72bc700 1 -- 172.21.15.2:0/255217219 shutdown_connections 2024-09-13T22:47:13.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.821+0000 7f30c72bc700 1 -- 172.21.15.2:0/255217219 wait complete. 2024-09-13T22:47:13.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.822+0000 7f30c72bc700 1 Processor -- start 2024-09-13T22:47:13.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.822+0000 7f30c72bc700 1 -- start start 2024-09-13T22:47:13.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.822+0000 7f30c72bc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c007bef0 0x7f30c019c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:13.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.822+0000 7f30c72bc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c019ca60 con 0x7f30c007bef0 2024-09-13T22:47:13.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.822+0000 7f30c5058700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c007bef0 0x7f30c019c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:13.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.822+0000 7f30c5058700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c007bef0 0x7f30c019c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49308/0 (socket says 172.21.15.2:49308) 2024-09-13T22:47:13.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.822+0000 7f30c5058700 1 -- 172.21.15.2:0/508116183 learned_addr learned my addr 172.21.15.2:0/508116183 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:13.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.823+0000 7f30c5058700 1 -- 172.21.15.2:0/508116183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30bc009550 con 0x7f30c007bef0 2024-09-13T22:47:13.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.823+0000 7f30c5058700 1 --2- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c007bef0 0x7f30c019c520 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f30bc000c00 tx=0x7f30bc011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:13.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.823+0000 7f30b67fc700 1 -- 172.21.15.2:0/508116183 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30bc003a70 con 0x7f30c007bef0 2024-09-13T22:47:13.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.823+0000 7f30b67fc700 1 -- 172.21.15.2:0/508116183 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f30bc003bd0 con 0x7f30c007bef0 2024-09-13T22:47:13.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.823+0000 7f30b67fc700 1 -- 172.21.15.2:0/508116183 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30bc0238c0 con 0x7f30c007bef0 2024-09-13T22:47:13.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.823+0000 7f30c72bc700 1 -- 172.21.15.2:0/508116183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c019cc60 con 0x7f30c007bef0 2024-09-13T22:47:13.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.823+0000 7f30c72bc700 1 -- 172.21.15.2:0/508116183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c019d080 con 0x7f30c007bef0 2024-09-13T22:47:13.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.824+0000 7f30b67fc700 1 -- 172.21.15.2:0/508116183 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) v1 ==== 45296+0+0 (secure 0 0 0) 0x7f30bc01a430 con 0x7f30c007bef0 2024-09-13T22:47:13.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.825+0000 7f30b67fc700 1 --2- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f30ac0383c0 0x7f30ac03a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:13.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.825+0000 7f30b67fc700 1 -- 172.21.15.2:0/508116183 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30ac03af90 con 0x7f30ac0383c0 2024-09-13T22:47:13.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.825+0000 7f30c4857700 1 -- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f30ac0383c0 msgr2=0x7f30ac03a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2 2024-09-13T22:47:13.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.825+0000 7f30b67fc700 1 -- 172.21.15.2:0/508116183 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f30bc04c170 con 0x7f30c007bef0 2024-09-13T22:47:13.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:06.825+0000 7f30c4857700 1 --2- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f30ac0383c0 0x7f30ac03a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T22:47:13.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:07.026+0000 7f30c4857700 1 -- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f30ac0383c0 msgr2=0x7f30ac03a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2 2024-09-13T22:47:13.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:07.026+0000 7f30c4857700 1 --2- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f30ac0383c0 0x7f30ac03a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T22:47:13.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:07.427+0000 7f30c4857700 1 -- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f30ac0383c0 msgr2=0x7f30ac03a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2 2024-09-13T22:47:13.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:07.427+0000 7f30c4857700 1 --2- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f30ac0383c0 0x7f30ac03a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T22:47:13.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:08.228+0000 7f30c4857700 1 -- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f30ac0383c0 msgr2=0x7f30ac03a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2 2024-09-13T22:47:13.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:08.228+0000 7f30c4857700 1 --2- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f30ac0383c0 0x7f30ac03a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T22:47:13.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:09.829+0000 7f30c4857700 1 -- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f30ac0383c0 msgr2=0x7f30ac03a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2 2024-09-13T22:47:13.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:09.829+0000 7f30c4857700 1 --2- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f30ac0383c0 0x7f30ac03a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-13T22:47:13.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:11.477+0000 7f30b67fc700 1 -- 172.21.15.2:0/508116183 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 10) v1 ==== 45063+0+0 (secure 0 0 0) 0x7f30bc02c350 con 0x7f30c007bef0 2024-09-13T22:47:13.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:11.477+0000 7f30b67fc700 1 -- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f30ac0383c0 msgr2=0x7f30ac03a880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T22:47:13.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:11.477+0000 7f30b67fc700 1 --2- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f30ac0383c0 0x7f30ac03a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:13.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:12.479+0000 7f30b67fc700 1 -- 172.21.15.2:0/508116183 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 11) v1 ==== 45190+0+0 (secure 0 0 0) 0x7f30bc04db20 con 0x7f30c007bef0 2024-09-13T22:47:13.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:12.479+0000 7f30b67fc700 1 --2- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f30ac0383c0 0x7f30ac03a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:13.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:12.479+0000 7f30b67fc700 1 -- 172.21.15.2:0/508116183 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30ac03af90 con 0x7f30ac0383c0 2024-09-13T22:47:13.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:12.479+0000 7f30c4857700 1 --2- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f30ac0383c0 0x7f30ac03a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:13.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:12.480+0000 7f30c4857700 1 --2- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f30ac0383c0 0x7f30ac03a880 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f30b0003a10 tx=0x7f30b0009270 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:13.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:12.480+0000 7f30b67fc700 1 -- 172.21.15.2:0/508116183 <== mgr.14164 v2:172.21.15.2:6800/2 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f30ac03af90 con 0x7f30ac0383c0 2024-09-13T22:47:13.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:12.487+0000 7f30c72bc700 1 -- 172.21.15.2:0/508116183 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f30c019d860 con 0x7f30ac0383c0 2024-09-13T22:47:13.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:12.487+0000 7f30b67fc700 1 -- 172.21.15.2:0/508116183 <== mgr.14164 v2:172.21.15.2:6800/2 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f30c019d860 con 0x7f30ac0383c0 2024-09-13T22:47:13.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:12.487+0000 7f30c72bc700 1 -- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f30ac0383c0 msgr2=0x7f30ac03a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:13.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:12.487+0000 7f30c72bc700 1 --2- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f30ac0383c0 0x7f30ac03a880 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f30b0003a10 tx=0x7f30b0009270 comp rx=0 tx=0).stop 2024-09-13T22:47:13.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:12.487+0000 7f30c72bc700 1 -- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c007bef0 msgr2=0x7f30c019c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:13.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:12.487+0000 7f30c72bc700 1 --2- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c007bef0 0x7f30c019c520 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f30bc000c00 tx=0x7f30bc011b50 comp rx=0 tx=0).stop 2024-09-13T22:47:13.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:12.487+0000 7f30c72bc700 1 -- 172.21.15.2:0/508116183 shutdown_connections 2024-09-13T22:47:13.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:12.487+0000 7f30c72bc700 1 --2- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f30ac0383c0 0x7f30ac03a880 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:13.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:12.487+0000 7f30c72bc700 1 --2- 172.21.15.2:0/508116183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c007bef0 0x7f30c019c520 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:13.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:12.487+0000 7f30c72bc700 1 -- 172.21.15.2:0/508116183 >> 172.21.15.2:0/508116183 conn(0x7f30c0101bd0 msgr2=0x7f30c0103270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:13.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:12.487+0000 7f30c72bc700 1 -- 172.21.15.2:0/508116183 shutdown_connections 2024-09-13T22:47:13.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:12.487+0000 7f30c72bc700 1 -- 172.21.15.2:0/508116183 wait complete. 2024-09-13T22:47:13.441 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 9 is available 2024-09-13T22:47:13.442 INFO:teuthology.orchestra.run.smithi002.stdout:Generating a dashboard self-signed certificate... 2024-09-13T22:47:13.709 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:13 smithi002 ceph-mon[27637]: [13/Sep/2024:22:47:12] ENGINE Bus STARTING 2024-09-13T22:47:13.709 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:13 smithi002 ceph-mon[27637]: [13/Sep/2024:22:47:12] ENGINE Serving on https://172.21.15.2:7150 2024-09-13T22:47:13.709 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:13 smithi002 ceph-mon[27637]: [13/Sep/2024:22:47:12] ENGINE Serving on http://172.21.15.2:8765 2024-09-13T22:47:13.709 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:13 smithi002 ceph-mon[27637]: [13/Sep/2024:22:47:12] ENGINE Bus STARTED 2024-09-13T22:47:13.709 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:13 smithi002 ceph-mon[27637]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T22:47:13.710 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:13 smithi002 ceph-mon[27637]: mgrmap e11: smithi002.yumtzz(active, since 1.00573s) 2024-09-13T22:47:13.710 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:13 smithi002 ceph-mon[27637]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T22:47:13.710 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:13 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:14.719 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-13T22:47:14.719 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.919+0000 7f73c1674700 1 Processor -- start 2024-09-13T22:47:14.719 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.919+0000 7f73c1674700 1 -- start start 2024-09-13T22:47:14.719 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.919+0000 7f73c1674700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc07ad80 0x7f73bc0791e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:14.719 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.919+0000 7f73c1674700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc0797b0 con 0x7f73bc07ad80 2024-09-13T22:47:14.719 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.920+0000 7f73baffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc07ad80 0x7f73bc0791e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:14.719 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.920+0000 7f73baffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc07ad80 0x7f73bc0791e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41776/0 (socket says 172.21.15.2:41776) 2024-09-13T22:47:14.719 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.920+0000 7f73baffd700 1 -- 172.21.15.2:0/3441818683 learned_addr learned my addr 172.21.15.2:0/3441818683 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:14.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.920+0000 7f73baffd700 1 -- 172.21.15.2:0/3441818683 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc0798f0 con 0x7f73bc07ad80 2024-09-13T22:47:14.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.920+0000 7f73baffd700 1 --2- 172.21.15.2:0/3441818683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc07ad80 0x7f73bc0791e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0098a0 tx=0x7f73ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f495046af470246 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:14.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.920+0000 7f73b9ffb700 1 -- 172.21.15.2:0/3441818683 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73ac004180 con 0x7f73bc07ad80 2024-09-13T22:47:14.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.920+0000 7f73b9ffb700 1 -- 172.21.15.2:0/3441818683 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f73ac0042e0 con 0x7f73bc07ad80 2024-09-13T22:47:14.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.920+0000 7f73b9ffb700 1 -- 172.21.15.2:0/3441818683 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73ac011af0 con 0x7f73bc07ad80 2024-09-13T22:47:14.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.921+0000 7f73c1674700 1 -- 172.21.15.2:0/3441818683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc07ad80 msgr2=0x7f73bc0791e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:14.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.921+0000 7f73c1674700 1 --2- 172.21.15.2:0/3441818683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc07ad80 0x7f73bc0791e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0098a0 tx=0x7f73ac009bb0 comp rx=0 tx=0).stop 2024-09-13T22:47:14.720 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.921+0000 7f73c1674700 1 -- 172.21.15.2:0/3441818683 shutdown_connections 2024-09-13T22:47:14.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.921+0000 7f73c1674700 1 --2- 172.21.15.2:0/3441818683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc07ad80 0x7f73bc0791e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:14.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.921+0000 7f73c1674700 1 -- 172.21.15.2:0/3441818683 >> 172.21.15.2:0/3441818683 conn(0x7f73bc101bc0 msgr2=0x7f73bc104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:14.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.921+0000 7f73c1674700 1 -- 172.21.15.2:0/3441818683 shutdown_connections 2024-09-13T22:47:14.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.921+0000 7f73c1674700 1 -- 172.21.15.2:0/3441818683 wait complete. 2024-09-13T22:47:14.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.922+0000 7f73c1674700 1 Processor -- start 2024-09-13T22:47:14.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.922+0000 7f73c1674700 1 -- start start 2024-09-13T22:47:14.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.922+0000 7f73c1674700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc07ad80 0x7f73bc19c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:14.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.922+0000 7f73c1674700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc19ca30 con 0x7f73bc07ad80 2024-09-13T22:47:14.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.923+0000 7f73baffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc07ad80 0x7f73bc19c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:14.721 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.923+0000 7f73baffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc07ad80 0x7f73bc19c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41780/0 (socket says 172.21.15.2:41780) 2024-09-13T22:47:14.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.923+0000 7f73baffd700 1 -- 172.21.15.2:0/3620936470 learned_addr learned my addr 172.21.15.2:0/3620936470 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:14.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.923+0000 7f73baffd700 1 -- 172.21.15.2:0/3620936470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ac009550 con 0x7f73bc07ad80 2024-09-13T22:47:14.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.923+0000 7f73baffd700 1 --2- 172.21.15.2:0/3620936470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc07ad80 0x7f73bc19c4f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f73ac011ad0 tx=0x7f73ac011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:14.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.923+0000 7f73b3fff700 1 -- 172.21.15.2:0/3620936470 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73ac003ab0 con 0x7f73bc07ad80 2024-09-13T22:47:14.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.923+0000 7f73b3fff700 1 -- 172.21.15.2:0/3620936470 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f73ac003c10 con 0x7f73bc07ad80 2024-09-13T22:47:14.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.923+0000 7f73b3fff700 1 -- 172.21.15.2:0/3620936470 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73ac0198e0 con 0x7f73bc07ad80 2024-09-13T22:47:14.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.923+0000 7f73c1674700 1 -- 172.21.15.2:0/3620936470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73bc19cc30 con 0x7f73bc07ad80 2024-09-13T22:47:14.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.923+0000 7f73c1674700 1 -- 172.21.15.2:0/3620936470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73bc19d050 con 0x7f73bc07ad80 2024-09-13T22:47:14.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.924+0000 7f73c1674700 1 -- 172.21.15.2:0/3620936470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73bc0623c0 con 0x7f73bc07ad80 2024-09-13T22:47:14.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.925+0000 7f73b3fff700 1 -- 172.21.15.2:0/3620936470 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 45296+0+0 (secure 0 0 0) 0x7f73ac019b50 con 0x7f73bc07ad80 2024-09-13T22:47:14.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.925+0000 7f73b3fff700 1 --2- 172.21.15.2:0/3620936470 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f73a80383c0 0x7f73a803a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:14.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.925+0000 7f73b3fff700 1 -- 172.21.15.2:0/3620936470 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f73ac04c230 con 0x7f73bc07ad80 2024-09-13T22:47:14.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.925+0000 7f73ba7fc700 1 --2- 172.21.15.2:0/3620936470 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f73a80383c0 0x7f73a803a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:14.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.925+0000 7f73ba7fc700 1 --2- 172.21.15.2:0/3620936470 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f73a80383c0 0x7f73a803a880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f73a4006fd0 tx=0x7f73a4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:14.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:13.930+0000 7f73b3fff700 1 -- 172.21.15.2:0/3620936470 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f73ac02b300 con 0x7f73bc07ad80 2024-09-13T22:47:14.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:14.139+0000 7f73c1674700 1 -- 172.21.15.2:0/3620936470 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f73bc103090 con 0x7f73a80383c0 2024-09-13T22:47:14.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:14.165+0000 7f73b3fff700 1 -- 172.21.15.2:0/3620936470 <== mgr.14164 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f73bc103090 con 0x7f73a80383c0 2024-09-13T22:47:14.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:14.167+0000 7f73c1674700 1 -- 172.21.15.2:0/3620936470 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f73a80383c0 msgr2=0x7f73a803a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:14.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:14.167+0000 7f73c1674700 1 --2- 172.21.15.2:0/3620936470 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f73a80383c0 0x7f73a803a880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f73a4006fd0 tx=0x7f73a4006e40 comp rx=0 tx=0).stop 2024-09-13T22:47:14.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:14.167+0000 7f73c1674700 1 -- 172.21.15.2:0/3620936470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc07ad80 msgr2=0x7f73bc19c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:14.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:14.167+0000 7f73c1674700 1 --2- 172.21.15.2:0/3620936470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc07ad80 0x7f73bc19c4f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f73ac011ad0 tx=0x7f73ac011bb0 comp rx=0 tx=0).stop 2024-09-13T22:47:14.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:14.167+0000 7f73c1674700 1 -- 172.21.15.2:0/3620936470 shutdown_connections 2024-09-13T22:47:14.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:14.167+0000 7f73c1674700 1 --2- 172.21.15.2:0/3620936470 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f73a80383c0 0x7f73a803a880 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:14.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:14.167+0000 7f73c1674700 1 --2- 172.21.15.2:0/3620936470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc07ad80 0x7f73bc19c4f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:14.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:14.167+0000 7f73c1674700 1 -- 172.21.15.2:0/3620936470 >> 172.21.15.2:0/3620936470 conn(0x7f73bc101bc0 msgr2=0x7f73bc102980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:14.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:14.168+0000 7f73c1674700 1 -- 172.21.15.2:0/3620936470 shutdown_connections 2024-09-13T22:47:14.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:14.168+0000 7f73c1674700 1 -- 172.21.15.2:0/3620936470 wait complete. 2024-09-13T22:47:14.726 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial admin user... 2024-09-13T22:47:14.839 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:14 smithi002 ceph-mon[27637]: mgrmap e12: smithi002.yumtzz(active, since 2s) 2024-09-13T22:47:14.840 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:14 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:14.840 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:14 smithi002 ceph-mon[27637]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:14.840 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:14 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:14.840 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:14 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:15.987 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:15 smithi002 ceph-mon[27637]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:15.987 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:15 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:16.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$upWBJVMXHEz5Z9s63HIqmue1dv4GdeHvyBmwWWXC6xfyys3ymYLVa", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726267635, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-13T22:47:16.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.159+0000 7eff6e83d700 1 Processor -- start 2024-09-13T22:47:16.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.159+0000 7eff6e83d700 1 -- start start 2024-09-13T22:47:16.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.159+0000 7eff6e83d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff681065d0 0x7eff681069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:16.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.159+0000 7eff6e83d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff68106fc0 con 0x7eff681065d0 2024-09-13T22:47:16.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.159+0000 7eff67fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff681065d0 0x7eff681069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:16.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.160+0000 7eff67fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff681065d0 0x7eff681069f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41794/0 (socket says 172.21.15.2:41794) 2024-09-13T22:47:16.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.160+0000 7eff67fff700 1 -- 172.21.15.2:0/2723307897 learned_addr learned my addr 172.21.15.2:0/2723307897 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:16.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.160+0000 7eff67fff700 1 -- 172.21.15.2:0/2723307897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff681077d0 con 0x7eff681065d0 2024-09-13T22:47:16.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.160+0000 7eff67fff700 1 --2- 172.21.15.2:0/2723307897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff681065d0 0x7eff681069f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7eff580098a0 tx=0x7eff58009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205d0af0f77edf83 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:16.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.160+0000 7eff677fe700 1 -- 172.21.15.2:0/2723307897 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff58004180 con 0x7eff681065d0 2024-09-13T22:47:16.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.160+0000 7eff677fe700 1 -- 172.21.15.2:0/2723307897 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7eff580042e0 con 0x7eff681065d0 2024-09-13T22:47:16.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.160+0000 7eff677fe700 1 -- 172.21.15.2:0/2723307897 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff58011af0 con 0x7eff681065d0 2024-09-13T22:47:16.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.161+0000 7eff6e83d700 1 -- 172.21.15.2:0/2723307897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff681065d0 msgr2=0x7eff681069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:16.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.161+0000 7eff6e83d700 1 --2- 172.21.15.2:0/2723307897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff681065d0 0x7eff681069f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7eff580098a0 tx=0x7eff58009bb0 comp rx=0 tx=0).stop 2024-09-13T22:47:16.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.161+0000 7eff6e83d700 1 -- 172.21.15.2:0/2723307897 shutdown_connections 2024-09-13T22:47:16.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.161+0000 7eff6e83d700 1 --2- 172.21.15.2:0/2723307897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff681065d0 0x7eff681069f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:16.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.161+0000 7eff6e83d700 1 -- 172.21.15.2:0/2723307897 >> 172.21.15.2:0/2723307897 conn(0x7eff68101bd0 msgr2=0x7eff68103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:16.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.161+0000 7eff6e83d700 1 -- 172.21.15.2:0/2723307897 shutdown_connections 2024-09-13T22:47:16.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.161+0000 7eff6e83d700 1 -- 172.21.15.2:0/2723307897 wait complete. 2024-09-13T22:47:16.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.162+0000 7eff6e83d700 1 Processor -- start 2024-09-13T22:47:16.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.162+0000 7eff6e83d700 1 -- start start 2024-09-13T22:47:16.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.162+0000 7eff6e83d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff681065d0 0x7eff6819c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:16.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.162+0000 7eff6e83d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6819ca50 con 0x7eff681065d0 2024-09-13T22:47:16.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.162+0000 7eff67fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff681065d0 0x7eff6819c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:16.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.162+0000 7eff67fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff681065d0 0x7eff6819c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41808/0 (socket says 172.21.15.2:41808) 2024-09-13T22:47:16.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.162+0000 7eff67fff700 1 -- 172.21.15.2:0/2943102404 learned_addr learned my addr 172.21.15.2:0/2943102404 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:16.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.162+0000 7eff67fff700 1 -- 172.21.15.2:0/2943102404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff58009550 con 0x7eff681065d0 2024-09-13T22:47:16.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.162+0000 7eff67fff700 1 --2- 172.21.15.2:0/2943102404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff681065d0 0x7eff6819c510 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7eff58000c00 tx=0x7eff58011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:16.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.163+0000 7eff65ffb700 1 -- 172.21.15.2:0/2943102404 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff58003a70 con 0x7eff681065d0 2024-09-13T22:47:16.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.163+0000 7eff65ffb700 1 -- 172.21.15.2:0/2943102404 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7eff58003bd0 con 0x7eff681065d0 2024-09-13T22:47:16.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.163+0000 7eff6e83d700 1 -- 172.21.15.2:0/2943102404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6819cc50 con 0x7eff681065d0 2024-09-13T22:47:16.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.163+0000 7eff6e83d700 1 -- 172.21.15.2:0/2943102404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6819d070 con 0x7eff681065d0 2024-09-13T22:47:16.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.163+0000 7eff65ffb700 1 -- 172.21.15.2:0/2943102404 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff580238c0 con 0x7eff681065d0 2024-09-13T22:47:16.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.164+0000 7eff65ffb700 1 -- 172.21.15.2:0/2943102404 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 45296+0+0 (secure 0 0 0) 0x7eff58023b30 con 0x7eff681065d0 2024-09-13T22:47:16.884 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.164+0000 7eff6e83d700 1 -- 172.21.15.2:0/2943102404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff680623c0 con 0x7eff681065d0 2024-09-13T22:47:16.884 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.164+0000 7eff65ffb700 1 --2- 172.21.15.2:0/2943102404 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7eff540383c0 0x7eff5403a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:16.884 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.164+0000 7eff65ffb700 1 -- 172.21.15.2:0/2943102404 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7eff5804c220 con 0x7eff681065d0 2024-09-13T22:47:16.884 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.164+0000 7eff5ffff700 1 --2- 172.21.15.2:0/2943102404 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7eff540383c0 0x7eff5403a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:16.884 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.165+0000 7eff5ffff700 1 --2- 172.21.15.2:0/2943102404 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7eff540383c0 0x7eff5403a880 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7eff50006fd0 tx=0x7eff50006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:16.884 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.169+0000 7eff65ffb700 1 -- 172.21.15.2:0/2943102404 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7eff58018d20 con 0x7eff681065d0 2024-09-13T22:47:16.884 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.395+0000 7eff6e83d700 1 -- 172.21.15.2:0/2943102404 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7eff680621e0 con 0x7eff540383c0 2024-09-13T22:47:16.884 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.642+0000 7eff65ffb700 1 -- 172.21.15.2:0/2943102404 <== mgr.14164 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7eff680621e0 con 0x7eff540383c0 2024-09-13T22:47:16.884 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.644+0000 7eff6e83d700 1 -- 172.21.15.2:0/2943102404 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7eff540383c0 msgr2=0x7eff5403a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:16.884 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.644+0000 7eff6e83d700 1 --2- 172.21.15.2:0/2943102404 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7eff540383c0 0x7eff5403a880 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7eff50006fd0 tx=0x7eff50006e40 comp rx=0 tx=0).stop 2024-09-13T22:47:16.884 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.644+0000 7eff6e83d700 1 -- 172.21.15.2:0/2943102404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff681065d0 msgr2=0x7eff6819c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:16.885 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.644+0000 7eff6e83d700 1 --2- 172.21.15.2:0/2943102404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff681065d0 0x7eff6819c510 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7eff58000c00 tx=0x7eff58011b50 comp rx=0 tx=0).stop 2024-09-13T22:47:16.885 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.644+0000 7eff6e83d700 1 -- 172.21.15.2:0/2943102404 shutdown_connections 2024-09-13T22:47:16.885 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.644+0000 7eff6e83d700 1 --2- 172.21.15.2:0/2943102404 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7eff540383c0 0x7eff5403a880 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:16.885 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.644+0000 7eff6e83d700 1 --2- 172.21.15.2:0/2943102404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff681065d0 0x7eff6819c510 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:16.885 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.644+0000 7eff6e83d700 1 -- 172.21.15.2:0/2943102404 >> 172.21.15.2:0/2943102404 conn(0x7eff68101bd0 msgr2=0x7eff68103250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:16.885 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.645+0000 7eff6e83d700 1 -- 172.21.15.2:0/2943102404 shutdown_connections 2024-09-13T22:47:16.885 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:15.645+0000 7eff6e83d700 1 -- 172.21.15.2:0/2943102404 wait complete. 2024-09-13T22:47:16.885 INFO:teuthology.orchestra.run.smithi002.stdout:Fetching dashboard port number... 2024-09-13T22:47:18.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:17 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2963306114' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-13T22:47:18.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:17 smithi002 ceph-mon[27637]: mgrmap e13: smithi002.yumtzz(active, since 6s) 2024-09-13T22:47:18.129 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 8443 2024-09-13T22:47:18.129 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.294+0000 7fc049223700 1 Processor -- start 2024-09-13T22:47:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.294+0000 7fc049223700 1 -- start start 2024-09-13T22:47:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.294+0000 7fc049223700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0441065d0 0x7fc0441069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.294+0000 7fc049223700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc044106fc0 con 0x7fc0441065d0 2024-09-13T22:47:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.294+0000 7fc042d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0441065d0 0x7fc0441069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.294+0000 7fc042d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0441065d0 0x7fc0441069f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41814/0 (socket says 172.21.15.2:41814) 2024-09-13T22:47:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.294+0000 7fc042d9d700 1 -- 172.21.15.2:0/2621913144 learned_addr learned my addr 172.21.15.2:0/2621913144 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.295+0000 7fc042d9d700 1 -- 172.21.15.2:0/2621913144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0441077d0 con 0x7fc0441065d0 2024-09-13T22:47:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.295+0000 7fc042d9d700 1 --2- 172.21.15.2:0/2621913144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0441065d0 0x7fc0441069f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc0340098a0 tx=0x7fc034009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d5aae4f4374a96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.295+0000 7fc041d9b700 1 -- 172.21.15.2:0/2621913144 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc034004180 con 0x7fc0441065d0 2024-09-13T22:47:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.295+0000 7fc041d9b700 1 -- 172.21.15.2:0/2621913144 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc0340042e0 con 0x7fc0441065d0 2024-09-13T22:47:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.295+0000 7fc041d9b700 1 -- 172.21.15.2:0/2621913144 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc034011af0 con 0x7fc0441065d0 2024-09-13T22:47:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.295+0000 7fc049223700 1 -- 172.21.15.2:0/2621913144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0441065d0 msgr2=0x7fc0441069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.295+0000 7fc049223700 1 --2- 172.21.15.2:0/2621913144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0441065d0 0x7fc0441069f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc0340098a0 tx=0x7fc034009bb0 comp rx=0 tx=0).stop 2024-09-13T22:47:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.296+0000 7fc049223700 1 -- 172.21.15.2:0/2621913144 shutdown_connections 2024-09-13T22:47:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.296+0000 7fc049223700 1 --2- 172.21.15.2:0/2621913144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0441065d0 0x7fc0441069f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.296+0000 7fc049223700 1 -- 172.21.15.2:0/2621913144 >> 172.21.15.2:0/2621913144 conn(0x7fc044101bd0 msgr2=0x7fc044103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.296+0000 7fc049223700 1 -- 172.21.15.2:0/2621913144 shutdown_connections 2024-09-13T22:47:18.131 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.296+0000 7fc049223700 1 -- 172.21.15.2:0/2621913144 wait complete. 2024-09-13T22:47:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.296+0000 7fc049223700 1 Processor -- start 2024-09-13T22:47:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.297+0000 7fc049223700 1 -- start start 2024-09-13T22:47:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.297+0000 7fc049223700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0441065d0 0x7fc04419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.297+0000 7fc049223700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04419a870 con 0x7fc0441065d0 2024-09-13T22:47:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.297+0000 7fc042d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0441065d0 0x7fc04419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.297+0000 7fc042d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0441065d0 0x7fc04419a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41828/0 (socket says 172.21.15.2:41828) 2024-09-13T22:47:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.297+0000 7fc042d9d700 1 -- 172.21.15.2:0/2963306114 learned_addr learned my addr 172.21.15.2:0/2963306114 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.297+0000 7fc042d9d700 1 -- 172.21.15.2:0/2963306114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc034009550 con 0x7fc0441065d0 2024-09-13T22:47:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.297+0000 7fc042d9d700 1 --2- 172.21.15.2:0/2963306114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0441065d0 0x7fc04419a330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc034006ba0 tx=0x7fc034011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.297+0000 7fc02bfff700 1 -- 172.21.15.2:0/2963306114 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc034003b00 con 0x7fc0441065d0 2024-09-13T22:47:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.298+0000 7fc02bfff700 1 -- 172.21.15.2:0/2963306114 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc03401a8e0 con 0x7fc0441065d0 2024-09-13T22:47:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.298+0000 7fc049223700 1 -- 172.21.15.2:0/2963306114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04419aa70 con 0x7fc0441065d0 2024-09-13T22:47:18.132 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.298+0000 7fc02bfff700 1 -- 172.21.15.2:0/2963306114 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc034019990 con 0x7fc0441065d0 2024-09-13T22:47:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.298+0000 7fc049223700 1 -- 172.21.15.2:0/2963306114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04419ae90 con 0x7fc0441065d0 2024-09-13T22:47:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.298+0000 7fc02bfff700 1 -- 172.21.15.2:0/2963306114 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 45296+0+0 (secure 0 0 0) 0x7fc034019c50 con 0x7fc0441065d0 2024-09-13T22:47:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.299+0000 7fc02bfff700 1 --2- 172.21.15.2:0/2963306114 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc02c038320 0x7fc02c03a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.299+0000 7fc02bfff700 1 -- 172.21.15.2:0/2963306114 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fc03404c6b0 con 0x7fc0441065d0 2024-09-13T22:47:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.299+0000 7fc04259c700 1 --2- 172.21.15.2:0/2963306114 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc02c038320 0x7fc02c03a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:18.133 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.299+0000 7fc049223700 1 -- 172.21.15.2:0/2963306114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0440623c0 con 0x7fc0441065d0 2024-09-13T22:47:18.136 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.299+0000 7fc04259c700 1 --2- 172.21.15.2:0/2963306114 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc02c038320 0x7fc02c03a7e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc038006fd0 tx=0x7fc038006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.304+0000 7fc02bfff700 1 -- 172.21.15.2:0/2963306114 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc03402b930 con 0x7fc0441065d0 2024-09-13T22:47:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.506+0000 7fc049223700 1 -- 172.21.15.2:0/2963306114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fc04419df40 con 0x7fc0441065d0 2024-09-13T22:47:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.507+0000 7fc02bfff700 1 -- 172.21.15.2:0/2963306114 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fc0340172b0 con 0x7fc0441065d0 2024-09-13T22:47:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.509+0000 7fc049223700 1 -- 172.21.15.2:0/2963306114 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc02c038320 msgr2=0x7fc02c03a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.509+0000 7fc049223700 1 --2- 172.21.15.2:0/2963306114 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc02c038320 0x7fc02c03a7e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc038006fd0 tx=0x7fc038006e40 comp rx=0 tx=0).stop 2024-09-13T22:47:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.509+0000 7fc049223700 1 -- 172.21.15.2:0/2963306114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0441065d0 msgr2=0x7fc04419a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.509+0000 7fc049223700 1 --2- 172.21.15.2:0/2963306114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0441065d0 0x7fc04419a330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc034006ba0 tx=0x7fc034011b50 comp rx=0 tx=0).stop 2024-09-13T22:47:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.509+0000 7fc049223700 1 -- 172.21.15.2:0/2963306114 shutdown_connections 2024-09-13T22:47:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.509+0000 7fc049223700 1 --2- 172.21.15.2:0/2963306114 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc02c038320 0x7fc02c03a7e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.509+0000 7fc049223700 1 --2- 172.21.15.2:0/2963306114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0441065d0 0x7fc04419a330 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.509+0000 7fc049223700 1 -- 172.21.15.2:0/2963306114 >> 172.21.15.2:0/2963306114 conn(0x7fc044101bd0 msgr2=0x7fc0441032c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:18.137 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.509+0000 7fc049223700 1 -- 172.21.15.2:0/2963306114 shutdown_connections 2024-09-13T22:47:18.138 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:17.509+0000 7fc049223700 1 -- 172.21.15.2:0/2963306114 wait complete. 2024-09-13T22:47:18.138 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T22:47:18.138 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-13T22:47:18.143 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T22:47:18.143 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-13T22:47:18.143 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-13T22:47:18.143 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-13T22:47:18.145 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph Dashboard is now available at: 2024-09-13T22:47:18.145 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:47:18.145 INFO:teuthology.orchestra.run.smithi002.stdout: URL: https://smithi002.front.sepia.ceph.com:8443/ 2024-09-13T22:47:18.145 INFO:teuthology.orchestra.run.smithi002.stdout: User: admin 2024-09-13T22:47:18.145 INFO:teuthology.orchestra.run.smithi002.stdout: Password: 21gwy5v28u 2024-09-13T22:47:18.145 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:47:18.146 INFO:teuthology.orchestra.run.smithi002.stdout:Saving cluster configuration to /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config directory 2024-09-13T22:47:18.146 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling autotune for osd_memory_target 2024-09-13T22:47:19.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.587+0000 7f7914583700 1 Processor -- start 2024-09-13T22:47:19.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.587+0000 7f7914583700 1 -- start start 2024-09-13T22:47:19.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.587+0000 7f7914583700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f790c1048d0 0x7f790c104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:19.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.587+0000 7f7914583700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c1052c0 con 0x7f790c1048d0 2024-09-13T22:47:19.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.588+0000 7f791231f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f790c1048d0 0x7f790c104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:19.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.588+0000 7f791231f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f790c1048d0 0x7f790c104cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41842/0 (socket says 172.21.15.2:41842) 2024-09-13T22:47:19.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.588+0000 7f791231f700 1 -- 172.21.15.2:0/830090960 learned_addr learned my addr 172.21.15.2:0/830090960 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:19.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.588+0000 7f791231f700 1 -- 172.21.15.2:0/830090960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c107860 con 0x7f790c1048d0 2024-09-13T22:47:19.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.588+0000 7f791231f700 1 --2- 172.21.15.2:0/830090960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f790c1048d0 0x7f790c104cf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7908009e80 tx=0x7f790800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5a4cafc75b5b55 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:19.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.589+0000 7f791131d700 1 -- 172.21.15.2:0/830090960 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f790800e070 con 0x7f790c1048d0 2024-09-13T22:47:19.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.589+0000 7f791131d700 1 -- 172.21.15.2:0/830090960 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f790800b8c0 con 0x7f790c1048d0 2024-09-13T22:47:19.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.589+0000 7f791131d700 1 -- 172.21.15.2:0/830090960 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79080044d0 con 0x7f790c1048d0 2024-09-13T22:47:19.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.589+0000 7f7914583700 1 -- 172.21.15.2:0/830090960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f790c1048d0 msgr2=0x7f790c104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:19.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.589+0000 7f7914583700 1 --2- 172.21.15.2:0/830090960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f790c1048d0 0x7f790c104cf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7908009e80 tx=0x7f790800b330 comp rx=0 tx=0).stop 2024-09-13T22:47:19.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.589+0000 7f7914583700 1 -- 172.21.15.2:0/830090960 shutdown_connections 2024-09-13T22:47:19.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.589+0000 7f7914583700 1 --2- 172.21.15.2:0/830090960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f790c1048d0 0x7f790c104cf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:19.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.589+0000 7f7914583700 1 -- 172.21.15.2:0/830090960 >> 172.21.15.2:0/830090960 conn(0x7f790c100220 msgr2=0x7f790c102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:19.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.589+0000 7f7914583700 1 -- 172.21.15.2:0/830090960 shutdown_connections 2024-09-13T22:47:19.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.589+0000 7f7914583700 1 -- 172.21.15.2:0/830090960 wait complete. 2024-09-13T22:47:19.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.590+0000 7f7914583700 1 Processor -- start 2024-09-13T22:47:19.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.590+0000 7f7914583700 1 -- start start 2024-09-13T22:47:19.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.590+0000 7f7914583700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f790c1048d0 0x7f790c19a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:19.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.590+0000 7f7914583700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c19a7e0 con 0x7f790c1048d0 2024-09-13T22:47:19.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.590+0000 7f791231f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f790c1048d0 0x7f790c19a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:19.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.590+0000 7f791231f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f790c1048d0 0x7f790c19a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41852/0 (socket says 172.21.15.2:41852) 2024-09-13T22:47:19.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.590+0000 7f791231f700 1 -- 172.21.15.2:0/1558925420 learned_addr learned my addr 172.21.15.2:0/1558925420 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:19.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.591+0000 7f791231f700 1 -- 172.21.15.2:0/1558925420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7908009b30 con 0x7f790c1048d0 2024-09-13T22:47:19.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.591+0000 7f791231f700 1 --2- 172.21.15.2:0/1558925420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f790c1048d0 0x7f790c19a2a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f79080072a0 tx=0x7f79080049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:19.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.591+0000 7f79037fe700 1 -- 172.21.15.2:0/1558925420 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f790800e040 con 0x7f790c1048d0 2024-09-13T22:47:19.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.591+0000 7f79037fe700 1 -- 172.21.15.2:0/1558925420 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f790800bd80 con 0x7f790c1048d0 2024-09-13T22:47:19.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.591+0000 7f7914583700 1 -- 172.21.15.2:0/1558925420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790c19a9e0 con 0x7f790c1048d0 2024-09-13T22:47:19.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.591+0000 7f79037fe700 1 -- 172.21.15.2:0/1558925420 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79080126c0 con 0x7f790c1048d0 2024-09-13T22:47:19.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.591+0000 7f7914583700 1 -- 172.21.15.2:0/1558925420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790c19ae60 con 0x7f790c1048d0 2024-09-13T22:47:19.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.592+0000 7f79037fe700 1 -- 172.21.15.2:0/1558925420 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45338+0+0 (secure 0 0 0) 0x7f7908019040 con 0x7f790c1048d0 2024-09-13T22:47:19.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.592+0000 7f7914583700 1 -- 172.21.15.2:0/1558925420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790c0623c0 con 0x7f790c1048d0 2024-09-13T22:47:19.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.592+0000 7f79037fe700 1 --2- 172.21.15.2:0/1558925420 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f78f8038420 0x7f78f803a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:19.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.592+0000 7f79037fe700 1 -- 172.21.15.2:0/1558925420 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f790804c070 con 0x7f790c1048d0 2024-09-13T22:47:19.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.592+0000 7f7911b1e700 1 --2- 172.21.15.2:0/1558925420 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f78f8038420 0x7f78f803a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:19.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.593+0000 7f7911b1e700 1 --2- 172.21.15.2:0/1558925420 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f78f8038420 0x7f78f803a8e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f78fc006fd0 tx=0x7f78fc006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:19.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.597+0000 7f79037fe700 1 -- 172.21.15.2:0/1558925420 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7908011750 con 0x7f790c1048d0 2024-09-13T22:47:19.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.791+0000 7f7914583700 1 -- 172.21.15.2:0/1558925420 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f790c19dcd0 con 0x7f790c1048d0 2024-09-13T22:47:19.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.792+0000 7f79037fe700 1 -- 172.21.15.2:0/1558925420 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f790801f070 con 0x7f790c1048d0 2024-09-13T22:47:19.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.794+0000 7f7914583700 1 -- 172.21.15.2:0/1558925420 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f78f8038420 msgr2=0x7f78f803a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:19.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.794+0000 7f7914583700 1 --2- 172.21.15.2:0/1558925420 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f78f8038420 0x7f78f803a8e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f78fc006fd0 tx=0x7f78fc006e40 comp rx=0 tx=0).stop 2024-09-13T22:47:19.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.794+0000 7f7914583700 1 -- 172.21.15.2:0/1558925420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f790c1048d0 msgr2=0x7f790c19a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:19.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.794+0000 7f7914583700 1 --2- 172.21.15.2:0/1558925420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f790c1048d0 0x7f790c19a2a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f79080072a0 tx=0x7f79080049f0 comp rx=0 tx=0).stop 2024-09-13T22:47:19.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.794+0000 7f7914583700 1 -- 172.21.15.2:0/1558925420 shutdown_connections 2024-09-13T22:47:19.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.794+0000 7f7914583700 1 --2- 172.21.15.2:0/1558925420 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f78f8038420 0x7f78f803a8e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:19.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.794+0000 7f7914583700 1 --2- 172.21.15.2:0/1558925420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f790c1048d0 0x7f790c19a2a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:19.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.794+0000 7f7914583700 1 -- 172.21.15.2:0/1558925420 >> 172.21.15.2:0/1558925420 conn(0x7f790c100220 msgr2=0x7f790c100fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:19.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.794+0000 7f7914583700 1 -- 172.21.15.2:0/1558925420 shutdown_connections 2024-09-13T22:47:19.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:18.794+0000 7f7914583700 1 -- 172.21.15.2:0/1558925420 wait complete. 2024-09-13T22:47:20.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.719+0000 7f8ea69df700 1 Processor -- start 2024-09-13T22:47:20.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.719+0000 7f8ea69df700 1 -- start start 2024-09-13T22:47:20.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.719+0000 7f8ea69df700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea0106ab0 0x7f8ea0106ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:20.614 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.719+0000 7f8ea69df700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea01074a0 con 0x7f8ea0106ab0 2024-09-13T22:47:20.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.719+0000 7f8e9ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea0106ab0 0x7f8ea0106ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:20.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.719+0000 7f8e9ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea0106ab0 0x7f8ea0106ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41860/0 (socket says 172.21.15.2:41860) 2024-09-13T22:47:20.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.719+0000 7f8e9ffff700 1 -- 172.21.15.2:0/2572177342 learned_addr learned my addr 172.21.15.2:0/2572177342 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:20.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.719+0000 7f8e9ffff700 1 -- 172.21.15.2:0/2572177342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea01075e0 con 0x7f8ea0106ab0 2024-09-13T22:47:20.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.719+0000 7f8e9ffff700 1 --2- 172.21.15.2:0/2572177342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea0106ab0 0x7f8ea0106ed0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8e900098a0 tx=0x7f8e90009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f233ad087485502 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:20.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.720+0000 7f8e9effd700 1 -- 172.21.15.2:0/2572177342 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e90004180 con 0x7f8ea0106ab0 2024-09-13T22:47:20.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.720+0000 7f8e9effd700 1 -- 172.21.15.2:0/2572177342 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8e900042e0 con 0x7f8ea0106ab0 2024-09-13T22:47:20.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.720+0000 7f8e9effd700 1 -- 172.21.15.2:0/2572177342 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e90011af0 con 0x7f8ea0106ab0 2024-09-13T22:47:20.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.720+0000 7f8ea69df700 1 -- 172.21.15.2:0/2572177342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea0106ab0 msgr2=0x7f8ea0106ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:20.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.720+0000 7f8ea69df700 1 --2- 172.21.15.2:0/2572177342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea0106ab0 0x7f8ea0106ed0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8e900098a0 tx=0x7f8e90009bb0 comp rx=0 tx=0).stop 2024-09-13T22:47:20.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.720+0000 7f8ea69df700 1 -- 172.21.15.2:0/2572177342 shutdown_connections 2024-09-13T22:47:20.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.720+0000 7f8ea69df700 1 --2- 172.21.15.2:0/2572177342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea0106ab0 0x7f8ea0106ed0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:20.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.720+0000 7f8ea69df700 1 -- 172.21.15.2:0/2572177342 >> 172.21.15.2:0/2572177342 conn(0x7f8ea0100220 msgr2=0x7f8ea0102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:20.615 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.720+0000 7f8ea69df700 1 -- 172.21.15.2:0/2572177342 shutdown_connections 2024-09-13T22:47:20.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.720+0000 7f8ea69df700 1 -- 172.21.15.2:0/2572177342 wait complete. 2024-09-13T22:47:20.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.721+0000 7f8ea69df700 1 Processor -- start 2024-09-13T22:47:20.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.721+0000 7f8ea69df700 1 -- start start 2024-09-13T22:47:20.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.721+0000 7f8ea69df700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea0106ab0 0x7f8ea019c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:20.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.721+0000 7f8ea69df700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea019ca50 con 0x7f8ea0106ab0 2024-09-13T22:47:20.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.722+0000 7f8e9ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea0106ab0 0x7f8ea019c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:20.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.722+0000 7f8e9ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea0106ab0 0x7f8ea019c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41876/0 (socket says 172.21.15.2:41876) 2024-09-13T22:47:20.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.722+0000 7f8e9ffff700 1 -- 172.21.15.2:0/4199268805 learned_addr learned my addr 172.21.15.2:0/4199268805 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:20.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.722+0000 7f8e9ffff700 1 -- 172.21.15.2:0/4199268805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e90009550 con 0x7f8ea0106ab0 2024-09-13T22:47:20.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.722+0000 7f8e9ffff700 1 --2- 172.21.15.2:0/4199268805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea0106ab0 0x7f8ea019c510 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8e90006ba0 tx=0x7f8e90011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:20.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.722+0000 7f8e9d7fa700 1 -- 172.21.15.2:0/4199268805 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e90003b00 con 0x7f8ea0106ab0 2024-09-13T22:47:20.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.722+0000 7f8e9d7fa700 1 -- 172.21.15.2:0/4199268805 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8e9001a8e0 con 0x7f8ea0106ab0 2024-09-13T22:47:20.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.722+0000 7f8ea69df700 1 -- 172.21.15.2:0/4199268805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea019cc50 con 0x7f8ea0106ab0 2024-09-13T22:47:20.616 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.722+0000 7f8e9d7fa700 1 -- 172.21.15.2:0/4199268805 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e900199c0 con 0x7f8ea0106ab0 2024-09-13T22:47:20.617 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.722+0000 7f8ea69df700 1 -- 172.21.15.2:0/4199268805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea019d070 con 0x7f8ea0106ab0 2024-09-13T22:47:20.617 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.723+0000 7f8e9d7fa700 1 -- 172.21.15.2:0/4199268805 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45338+0+0 (secure 0 0 0) 0x7f8e90019c80 con 0x7f8ea0106ab0 2024-09-13T22:47:20.617 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.723+0000 7f8ea69df700 1 -- 172.21.15.2:0/4199268805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea01961a0 con 0x7f8ea0106ab0 2024-09-13T22:47:20.617 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.723+0000 7f8e9d7fa700 1 --2- 172.21.15.2:0/4199268805 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8e880383c0 0x7f8e8803a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:20.617 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.723+0000 7f8e9d7fa700 1 -- 172.21.15.2:0/4199268805 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f8e9004c870 con 0x7f8ea0106ab0 2024-09-13T22:47:20.617 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.724+0000 7f8e9f7fe700 1 --2- 172.21.15.2:0/4199268805 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8e880383c0 0x7f8e8803a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:20.617 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.724+0000 7f8e9f7fe700 1 --2- 172.21.15.2:0/4199268805 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8e880383c0 0x7f8e8803a880 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8e94006fd0 tx=0x7f8e94006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:20.617 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:19.728+0000 7f8e9d7fa700 1 -- 172.21.15.2:0/4199268805 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8e9002d440 con 0x7f8ea0106ab0 2024-09-13T22:47:20.617 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:20.033+0000 7f8ea69df700 1 -- 172.21.15.2:0/4199268805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f8ea00623c0 con 0x7f8ea0106ab0 2024-09-13T22:47:20.617 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:20.036+0000 7f8e9d7fa700 1 -- 172.21.15.2:0/4199268805 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f8e90018ce0 con 0x7f8ea0106ab0 2024-09-13T22:47:20.617 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:20.038+0000 7f8ea69df700 1 -- 172.21.15.2:0/4199268805 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8e880383c0 msgr2=0x7f8e8803a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:20.617 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:20.038+0000 7f8ea69df700 1 --2- 172.21.15.2:0/4199268805 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8e880383c0 0x7f8e8803a880 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8e94006fd0 tx=0x7f8e94006e40 comp rx=0 tx=0).stop 2024-09-13T22:47:20.618 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:20.038+0000 7f8ea69df700 1 -- 172.21.15.2:0/4199268805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea0106ab0 msgr2=0x7f8ea019c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:20.618 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:20.038+0000 7f8ea69df700 1 --2- 172.21.15.2:0/4199268805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea0106ab0 0x7f8ea019c510 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8e90006ba0 tx=0x7f8e90011b50 comp rx=0 tx=0).stop 2024-09-13T22:47:20.618 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:20.038+0000 7f8ea69df700 1 -- 172.21.15.2:0/4199268805 shutdown_connections 2024-09-13T22:47:20.618 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:20.038+0000 7f8ea69df700 1 --2- 172.21.15.2:0/4199268805 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8e880383c0 0x7f8e8803a880 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:20.618 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:20.038+0000 7f8ea69df700 1 --2- 172.21.15.2:0/4199268805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ea0106ab0 0x7f8ea019c510 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:20.618 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:20.038+0000 7f8ea69df700 1 -- 172.21.15.2:0/4199268805 >> 172.21.15.2:0/4199268805 conn(0x7f8ea0100220 msgr2=0x7f8ea01932e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:20.618 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:20.038+0000 7f8ea69df700 1 -- 172.21.15.2:0/4199268805 shutdown_connections 2024-09-13T22:47:20.618 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-13T22:47:20.038+0000 7f8ea69df700 1 -- 172.21.15.2:0/4199268805 wait complete. 2024-09-13T22:47:20.618 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-13T22:47:20.618 INFO:teuthology.orchestra.run.smithi002.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-13T22:47:20.618 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:47:20.618 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-13T22:47:20.618 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:47:20.618 INFO:teuthology.orchestra.run.smithi002.stdout:Or, if you are only running a single cluster on this host: 2024-09-13T22:47:20.619 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:47:20.619 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-13T22:47:20.619 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:47:20.619 INFO:teuthology.orchestra.run.smithi002.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-13T22:47:20.619 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:47:20.619 INFO:teuthology.orchestra.run.smithi002.stdout: ceph telemetry on 2024-09-13T22:47:20.619 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:47:20.619 INFO:teuthology.orchestra.run.smithi002.stdout:For more information see: 2024-09-13T22:47:20.619 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:47:20.619 INFO:teuthology.orchestra.run.smithi002.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-13T22:47:20.619 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:47:20.619 INFO:teuthology.orchestra.run.smithi002.stdout:Bootstrap complete. 2024-09-13T22:47:20.648 INFO:tasks.cephadm:Fetching config... 2024-09-13T22:47:20.648 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-13T22:47:20.648 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-13T22:47:20.705 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-13T22:47:20.705 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-13T22:47:20.705 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-13T22:47:20.762 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-13T22:47:20.762 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-13T22:47:20.762 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/keyring of=/dev/stdout 2024-09-13T22:47:20.828 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-13T22:47:20.828 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-13T22:47:20.828 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-13T22:47:20.885 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-13T22:47:20.885 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDInl3cB+LXS8NeXKfPd6KsGDUpIjNJc0xYbJQLyXbMxTWb0Ma4yV5SIePCj3XYI0yRilUfjZo1sB87L0lG+pDWy8eHcTDvO0q6uhMPh07UjdxCiIlmtCg+fLnD5n64CR5SezPrM6pyS2ZMvtUluvQ748Vty0pOnkiVK4yXKQMwM4/7lIuFuSoGSfq9f1mA+IKJHnj0vUbS/hcZAC3c4MH7KlLeyOIXmoTWsIJf5rNXmIhGq3NAPjmgAzlUcwn+fijB4Upi+/MHqO9oxwKixmUdsCkpHGk6zikQuVyCYwxe5/yKhUYUs/r4JQRhJACLSXnhRUwvZPv3AlymPScFezE0Z3+vXVasKX2aWPkc9FyHYBc/nratS54QNlXMkSqe5bnhqMqHeFdOJqAoPlmclr92arJKaueU4+rifQhTwQKEkYtuVT1c0WDrd+nv7bWxT3nwV0+59mfbPKbDvt/7LRFnqU5pnGHEUVteo9VkzEBQIJP0Cs2YMpLXju/Tx8+dHME= ceph-e41042f8-7221-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T22:47:20.962 INFO:teuthology.orchestra.run.smithi002.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDInl3cB+LXS8NeXKfPd6KsGDUpIjNJc0xYbJQLyXbMxTWb0Ma4yV5SIePCj3XYI0yRilUfjZo1sB87L0lG+pDWy8eHcTDvO0q6uhMPh07UjdxCiIlmtCg+fLnD5n64CR5SezPrM6pyS2ZMvtUluvQ748Vty0pOnkiVK4yXKQMwM4/7lIuFuSoGSfq9f1mA+IKJHnj0vUbS/hcZAC3c4MH7KlLeyOIXmoTWsIJf5rNXmIhGq3NAPjmgAzlUcwn+fijB4Upi+/MHqO9oxwKixmUdsCkpHGk6zikQuVyCYwxe5/yKhUYUs/r4JQRhJACLSXnhRUwvZPv3AlymPScFezE0Z3+vXVasKX2aWPkc9FyHYBc/nratS54QNlXMkSqe5bnhqMqHeFdOJqAoPlmclr92arJKaueU4+rifQhTwQKEkYtuVT1c0WDrd+nv7bWxT3nwV0+59mfbPKbDvt/7LRFnqU5pnGHEUVteo9VkzEBQIJP0Cs2YMpLXju/Tx8+dHME= ceph-e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T22:47:20.974 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDInl3cB+LXS8NeXKfPd6KsGDUpIjNJc0xYbJQLyXbMxTWb0Ma4yV5SIePCj3XYI0yRilUfjZo1sB87L0lG+pDWy8eHcTDvO0q6uhMPh07UjdxCiIlmtCg+fLnD5n64CR5SezPrM6pyS2ZMvtUluvQ748Vty0pOnkiVK4yXKQMwM4/7lIuFuSoGSfq9f1mA+IKJHnj0vUbS/hcZAC3c4MH7KlLeyOIXmoTWsIJf5rNXmIhGq3NAPjmgAzlUcwn+fijB4Upi+/MHqO9oxwKixmUdsCkpHGk6zikQuVyCYwxe5/yKhUYUs/r4JQRhJACLSXnhRUwvZPv3AlymPScFezE0Z3+vXVasKX2aWPkc9FyHYBc/nratS54QNlXMkSqe5bnhqMqHeFdOJqAoPlmclr92arJKaueU4+rifQhTwQKEkYtuVT1c0WDrd+nv7bWxT3nwV0+59mfbPKbDvt/7LRFnqU5pnGHEUVteo9VkzEBQIJP0Cs2YMpLXju/Tx8+dHME= ceph-e41042f8-7221-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T22:47:21.021 INFO:teuthology.orchestra.run.smithi047.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDInl3cB+LXS8NeXKfPd6KsGDUpIjNJc0xYbJQLyXbMxTWb0Ma4yV5SIePCj3XYI0yRilUfjZo1sB87L0lG+pDWy8eHcTDvO0q6uhMPh07UjdxCiIlmtCg+fLnD5n64CR5SezPrM6pyS2ZMvtUluvQ748Vty0pOnkiVK4yXKQMwM4/7lIuFuSoGSfq9f1mA+IKJHnj0vUbS/hcZAC3c4MH7KlLeyOIXmoTWsIJf5rNXmIhGq3NAPjmgAzlUcwn+fijB4Upi+/MHqO9oxwKixmUdsCkpHGk6zikQuVyCYwxe5/yKhUYUs/r4JQRhJACLSXnhRUwvZPv3AlymPScFezE0Z3+vXVasKX2aWPkc9FyHYBc/nratS54QNlXMkSqe5bnhqMqHeFdOJqAoPlmclr92arJKaueU4+rifQhTwQKEkYtuVT1c0WDrd+nv7bWxT3nwV0+59mfbPKbDvt/7LRFnqU5pnGHEUVteo9VkzEBQIJP0Cs2YMpLXju/Tx8+dHME= ceph-e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T22:47:21.034 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-13T22:47:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:47:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:21 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/4199268805' entity='client.admin' 2024-09-13T22:47:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.826+0000 7f7649ef5700 1 -- 172.21.15.2:0/808234766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76440ff780 msgr2=0x7f76440ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.826+0000 7f7649ef5700 1 --2- 172.21.15.2:0/808234766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76440ff780 0x7f76440ffba0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7634009910 tx=0x7f7634009c20 comp rx=0 tx=0).stop 2024-09-13T22:47:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.827+0000 7f7649ef5700 1 -- 172.21.15.2:0/808234766 shutdown_connections 2024-09-13T22:47:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.827+0000 7f7649ef5700 1 --2- 172.21.15.2:0/808234766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76440ff780 0x7f76440ffba0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.827+0000 7f7649ef5700 1 -- 172.21.15.2:0/808234766 >> 172.21.15.2:0/808234766 conn(0x7f76440fad20 msgr2=0x7f76440fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.827+0000 7f7649ef5700 1 -- 172.21.15.2:0/808234766 shutdown_connections 2024-09-13T22:47:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.827+0000 7f7649ef5700 1 -- 172.21.15.2:0/808234766 wait complete. 2024-09-13T22:47:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.827+0000 7f7649ef5700 1 Processor -- start 2024-09-13T22:47:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.828+0000 7f7649ef5700 1 -- start start 2024-09-13T22:47:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.828+0000 7f7649ef5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76440ff780 0x7f76441959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.828+0000 7f7649ef5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7644195ee0 con 0x7f76440ff780 2024-09-13T22:47:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.828+0000 7f76437fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76440ff780 0x7f76441959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.828+0000 7f76437fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76440ff780 0x7f76441959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47088/0 (socket says 172.21.15.2:47088) 2024-09-13T22:47:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.828+0000 7f76437fe700 1 -- 172.21.15.2:0/4187138063 learned_addr learned my addr 172.21.15.2:0/4187138063 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.828+0000 7f76437fe700 1 -- 172.21.15.2:0/4187138063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76340095f0 con 0x7f76440ff780 2024-09-13T22:47:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.828+0000 7f76437fe700 1 --2- 172.21.15.2:0/4187138063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76440ff780 0x7f76441959a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7634005950 tx=0x7f7634009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.829+0000 7f7640ff9700 1 -- 172.21.15.2:0/4187138063 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f763401d070 con 0x7f76440ff780 2024-09-13T22:47:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.829+0000 7f7640ff9700 1 -- 172.21.15.2:0/4187138063 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f763400be10 con 0x7f76440ff780 2024-09-13T22:47:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.829+0000 7f7649ef5700 1 -- 172.21.15.2:0/4187138063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76441960e0 con 0x7f76440ff780 2024-09-13T22:47:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.829+0000 7f7640ff9700 1 -- 172.21.15.2:0/4187138063 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f763400f460 con 0x7f76440ff780 2024-09-13T22:47:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.829+0000 7f7649ef5700 1 -- 172.21.15.2:0/4187138063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7644196580 con 0x7f76440ff780 2024-09-13T22:47:23.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.830+0000 7f7640ff9700 1 -- 172.21.15.2:0/4187138063 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45338+0+0 (secure 0 0 0) 0x7f763400f690 con 0x7f76440ff780 2024-09-13T22:47:23.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.830+0000 7f7649ef5700 1 -- 172.21.15.2:0/4187138063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764418f3b0 con 0x7f76440ff780 2024-09-13T22:47:23.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.830+0000 7f7640ff9700 1 --2- 172.21.15.2:0/4187138063 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f762c0383c0 0x7f762c03a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:23.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.830+0000 7f7640ff9700 1 -- 172.21.15.2:0/4187138063 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f763404c470 con 0x7f76440ff780 2024-09-13T22:47:23.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.830+0000 7f7642ffd700 1 --2- 172.21.15.2:0/4187138063 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f762c0383c0 0x7f762c03a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:23.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.831+0000 7f7642ffd700 1 --2- 172.21.15.2:0/4187138063 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f762c0383c0 0x7f762c03a880 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7638006fd0 tx=0x7f7638006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:23.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:23.835+0000 7f7640ff9700 1 -- 172.21.15.2:0/4187138063 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f763402a360 con 0x7f76440ff780 2024-09-13T22:47:24.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:24.037+0000 7f7649ef5700 1 -- 172.21.15.2:0/4187138063 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f764402cc70 con 0x7f76440ff780 2024-09-13T22:47:24.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:24.040+0000 7f7640ff9700 1 -- 172.21.15.2:0/4187138063 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7634027070 con 0x7f76440ff780 2024-09-13T22:47:24.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:24.043+0000 7f7649ef5700 1 -- 172.21.15.2:0/4187138063 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f762c0383c0 msgr2=0x7f762c03a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:24.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:24.043+0000 7f7649ef5700 1 --2- 172.21.15.2:0/4187138063 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f762c0383c0 0x7f762c03a880 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7638006fd0 tx=0x7f7638006e40 comp rx=0 tx=0).stop 2024-09-13T22:47:24.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:24.043+0000 7f7649ef5700 1 -- 172.21.15.2:0/4187138063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76440ff780 msgr2=0x7f76441959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:24.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:24.043+0000 7f7649ef5700 1 --2- 172.21.15.2:0/4187138063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76440ff780 0x7f76441959a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7634005950 tx=0x7f7634009e60 comp rx=0 tx=0).stop 2024-09-13T22:47:24.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:24.043+0000 7f7649ef5700 1 -- 172.21.15.2:0/4187138063 shutdown_connections 2024-09-13T22:47:24.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:24.043+0000 7f7649ef5700 1 --2- 172.21.15.2:0/4187138063 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f762c0383c0 0x7f762c03a880 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:24.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:24.043+0000 7f7649ef5700 1 --2- 172.21.15.2:0/4187138063 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76440ff780 0x7f76441959a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:24.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:24.043+0000 7f7649ef5700 1 -- 172.21.15.2:0/4187138063 >> 172.21.15.2:0/4187138063 conn(0x7f76440fad20 msgr2=0x7f7644068820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:24.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:24.043+0000 7f7649ef5700 1 -- 172.21.15.2:0/4187138063 shutdown_connections 2024-09-13T22:47:24.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:24.043+0000 7f7649ef5700 1 -- 172.21.15.2:0/4187138063 wait complete. 2024-09-13T22:47:25.039 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-13T22:47:25.040 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-13T22:47:25.294 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:25 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/4187138063' entity='client.admin' 2024-09-13T22:47:25.294 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:25 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:25.294 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:25 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:25.294 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:25 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:47:25.295 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:25 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:25.295 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:25 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi002", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:47:25.295 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:25 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi002", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T22:47:25.295 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:25 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:47:26.080 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:47:26.322 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:26 smithi002 ceph-mon[27637]: Deploying daemon ceph-exporter.smithi002 on smithi002 2024-09-13T22:47:28.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.165+0000 7f9b08fd4700 1 -- 172.21.15.2:0/4037385427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b040ff780 msgr2=0x7f9b040ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:28.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.165+0000 7f9b08fd4700 1 --2- 172.21.15.2:0/4037385427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b040ff780 0x7f9b040ffba0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009910 tx=0x7f9af4009c20 comp rx=0 tx=0).stop 2024-09-13T22:47:28.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.165+0000 7f9b08fd4700 1 -- 172.21.15.2:0/4037385427 shutdown_connections 2024-09-13T22:47:28.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.165+0000 7f9b08fd4700 1 --2- 172.21.15.2:0/4037385427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b040ff780 0x7f9b040ffba0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:28.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.165+0000 7f9b08fd4700 1 -- 172.21.15.2:0/4037385427 >> 172.21.15.2:0/4037385427 conn(0x7f9b040fad20 msgr2=0x7f9b040fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:28.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.165+0000 7f9b08fd4700 1 -- 172.21.15.2:0/4037385427 shutdown_connections 2024-09-13T22:47:28.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.165+0000 7f9b08fd4700 1 -- 172.21.15.2:0/4037385427 wait complete. 2024-09-13T22:47:28.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.165+0000 7f9b08fd4700 1 Processor -- start 2024-09-13T22:47:28.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.166+0000 7f9b08fd4700 1 -- start start 2024-09-13T22:47:28.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.166+0000 7f9b08fd4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b040ff780 0x7f9b04069400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:28.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.166+0000 7f9b08fd4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b041986f0 con 0x7f9b040ff780 2024-09-13T22:47:28.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.166+0000 7f9b0259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b040ff780 0x7f9b04069400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:28.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.166+0000 7f9b0259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b040ff780 0x7f9b04069400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47102/0 (socket says 172.21.15.2:47102) 2024-09-13T22:47:28.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.166+0000 7f9b0259c700 1 -- 172.21.15.2:0/653225121 learned_addr learned my addr 172.21.15.2:0/653225121 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.166+0000 7f9b0259c700 1 -- 172.21.15.2:0/653225121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40095f0 con 0x7f9b040ff780 2024-09-13T22:47:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.166+0000 7f9b0259c700 1 --2- 172.21.15.2:0/653225121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b040ff780 0x7f9b04069400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9af4005b40 tx=0x7f9af4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.166+0000 7f9af37fe700 1 -- 172.21.15.2:0/653225121 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9af401d070 con 0x7f9b040ff780 2024-09-13T22:47:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.166+0000 7f9af37fe700 1 -- 172.21.15.2:0/653225121 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9af400be10 con 0x7f9b040ff780 2024-09-13T22:47:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.166+0000 7f9b08fd4700 1 -- 172.21.15.2:0/653225121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b04198830 con 0x7f9b040ff780 2024-09-13T22:47:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.167+0000 7f9af37fe700 1 -- 172.21.15.2:0/653225121 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9af400f460 con 0x7f9b040ff780 2024-09-13T22:47:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.167+0000 7f9b08fd4700 1 -- 172.21.15.2:0/653225121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b04198cd0 con 0x7f9b040ff780 2024-09-13T22:47:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.168+0000 7f9af37fe700 1 -- 172.21.15.2:0/653225121 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45338+0+0 (secure 0 0 0) 0x7f9af400f5c0 con 0x7f9b040ff780 2024-09-13T22:47:28.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.168+0000 7f9b08fd4700 1 -- 172.21.15.2:0/653225121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b0418e3a0 con 0x7f9b040ff780 2024-09-13T22:47:28.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.168+0000 7f9af37fe700 1 --2- 172.21.15.2:0/653225121 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9aec038410 0x7f9aec03a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:28.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.168+0000 7f9af37fe700 1 -- 172.21.15.2:0/653225121 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f9af404c450 con 0x7f9b040ff780 2024-09-13T22:47:28.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.168+0000 7f9b01d9b700 1 --2- 172.21.15.2:0/653225121 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9aec038410 0x7f9aec03a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:28.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.168+0000 7f9b01d9b700 1 --2- 172.21.15.2:0/653225121 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9aec038410 0x7f9aec03a8d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9af8006fd0 tx=0x7f9af8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:28.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.173+0000 7f9af37fe700 1 -- 172.21.15.2:0/653225121 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9af402a360 con 0x7f9b040ff780 2024-09-13T22:47:28.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.393+0000 7f9b08fd4700 1 -- 172.21.15.2:0/653225121 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b04061260 con 0x7f9aec038410 2024-09-13T22:47:28.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.396+0000 7f9af37fe700 1 -- 172.21.15.2:0/653225121 <== mgr.14164 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9b04061260 con 0x7f9aec038410 2024-09-13T22:47:28.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.398+0000 7f9b08fd4700 1 -- 172.21.15.2:0/653225121 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9aec038410 msgr2=0x7f9aec03a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:28.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.398+0000 7f9b08fd4700 1 --2- 172.21.15.2:0/653225121 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9aec038410 0x7f9aec03a8d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9af8006fd0 tx=0x7f9af8006e40 comp rx=0 tx=0).stop 2024-09-13T22:47:28.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.398+0000 7f9b08fd4700 1 -- 172.21.15.2:0/653225121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b040ff780 msgr2=0x7f9b04069400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:28.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.398+0000 7f9b08fd4700 1 --2- 172.21.15.2:0/653225121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b040ff780 0x7f9b04069400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9af4005b40 tx=0x7f9af4004740 comp rx=0 tx=0).stop 2024-09-13T22:47:28.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.398+0000 7f9b08fd4700 1 -- 172.21.15.2:0/653225121 shutdown_connections 2024-09-13T22:47:28.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.398+0000 7f9b08fd4700 1 --2- 172.21.15.2:0/653225121 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f9aec038410 0x7f9aec03a8d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:28.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.398+0000 7f9b08fd4700 1 --2- 172.21.15.2:0/653225121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b040ff780 0x7f9b04069400 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:28.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.398+0000 7f9b08fd4700 1 -- 172.21.15.2:0/653225121 >> 172.21.15.2:0/653225121 conn(0x7f9b040fad20 msgr2=0x7f9b040fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:28.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.398+0000 7f9b08fd4700 1 -- 172.21.15.2:0/653225121 shutdown_connections 2024-09-13T22:47:28.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:28.398+0000 7f9b08fd4700 1 -- 172.21.15.2:0/653225121 wait complete. 2024-09-13T22:47:29.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:28 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:29.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:28 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:29.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:28 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:29.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:28 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:29.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:28 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:47:29.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:28 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T22:47:29.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:28 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:47:29.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:28 smithi002 ceph-mon[27637]: Deploying daemon crash.smithi002 on smithi002 2024-09-13T22:47:29.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:28 smithi002 ceph-mon[27637]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:29.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:28 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:29.421 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi047 2024-09-13T22:47:29.422 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-13T22:47:29.422 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/etc/ceph/ceph.conf 2024-09-13T22:47:29.441 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-13T22:47:29.442 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:47:29.500 INFO:tasks.cephadm:Adding host smithi047 to orchestrator... 2024-09-13T22:47:29.500 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph orch host add smithi047 2024-09-13T22:47:29.890 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:47:31.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.798+0000 7f3696310700 1 -- 172.21.15.2:0/459476738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36900ff780 msgr2=0x7f36900ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:31.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.798+0000 7f3696310700 1 --2- 172.21.15.2:0/459476738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36900ff780 0x7f36900ffba0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3680009910 tx=0x7f3680009c20 comp rx=0 tx=0).stop 2024-09-13T22:47:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.798+0000 7f3696310700 1 -- 172.21.15.2:0/459476738 shutdown_connections 2024-09-13T22:47:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.798+0000 7f3696310700 1 --2- 172.21.15.2:0/459476738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36900ff780 0x7f36900ffba0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.798+0000 7f3696310700 1 -- 172.21.15.2:0/459476738 >> 172.21.15.2:0/459476738 conn(0x7f36900fad20 msgr2=0x7f36900fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.798+0000 7f3696310700 1 -- 172.21.15.2:0/459476738 shutdown_connections 2024-09-13T22:47:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.798+0000 7f3696310700 1 -- 172.21.15.2:0/459476738 wait complete. 2024-09-13T22:47:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.798+0000 7f3696310700 1 Processor -- start 2024-09-13T22:47:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.799+0000 7f3696310700 1 -- start start 2024-09-13T22:47:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.799+0000 7f3696310700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36900ff780 0x7f3690195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.799+0000 7f3696310700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3690195ec0 con 0x7f36900ff780 2024-09-13T22:47:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.799+0000 7f368ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36900ff780 0x7f3690195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.799+0000 7f368ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36900ff780 0x7f3690195980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39018/0 (socket says 172.21.15.2:39018) 2024-09-13T22:47:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.799+0000 7f368ffff700 1 -- 172.21.15.2:0/169948332 learned_addr learned my addr 172.21.15.2:0/169948332 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.799+0000 7f368ffff700 1 -- 172.21.15.2:0/169948332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36800095f0 con 0x7f36900ff780 2024-09-13T22:47:31.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.799+0000 7f368ffff700 1 --2- 172.21.15.2:0/169948332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36900ff780 0x7f3690195980 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3680005b40 tx=0x7f3680004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:31.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.799+0000 7f368dffb700 1 -- 172.21.15.2:0/169948332 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f368001d070 con 0x7f36900ff780 2024-09-13T22:47:31.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.800+0000 7f3696310700 1 -- 172.21.15.2:0/169948332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36901960c0 con 0x7f36900ff780 2024-09-13T22:47:31.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.800+0000 7f368dffb700 1 -- 172.21.15.2:0/169948332 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f368000be10 con 0x7f36900ff780 2024-09-13T22:47:31.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.800+0000 7f368dffb700 1 -- 172.21.15.2:0/169948332 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f368000f460 con 0x7f36900ff780 2024-09-13T22:47:31.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.800+0000 7f3696310700 1 -- 172.21.15.2:0/169948332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3690196560 con 0x7f36900ff780 2024-09-13T22:47:31.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.800+0000 7f368dffb700 1 -- 172.21.15.2:0/169948332 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45338+0+0 (secure 0 0 0) 0x7f36800227e0 con 0x7f36900ff780 2024-09-13T22:47:31.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.801+0000 7f3696310700 1 -- 172.21.15.2:0/169948332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f369018f3b0 con 0x7f36900ff780 2024-09-13T22:47:31.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.801+0000 7f368dffb700 1 --2- 172.21.15.2:0/169948332 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f367c0383c0 0x7f367c03a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:31.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.801+0000 7f368dffb700 1 -- 172.21.15.2:0/169948332 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f368004c4c0 con 0x7f36900ff780 2024-09-13T22:47:31.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.801+0000 7f3687fff700 1 --2- 172.21.15.2:0/169948332 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f367c0383c0 0x7f367c03a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:31.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.801+0000 7f3687fff700 1 --2- 172.21.15.2:0/169948332 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f367c0383c0 0x7f367c03a880 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3678006fd0 tx=0x7f3678006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:31.806+0000 7f368dffb700 1 -- 172.21.15.2:0/169948332 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f368002bba0 con 0x7f36900ff780 2024-09-13T22:47:31.959 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:31 smithi002 ceph-mon[27637]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:47:31.959 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:31 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:32.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:32.014+0000 7f3696310700 1 -- 172.21.15.2:0/169948332 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi047", "target": ["mon-mgr", ""]}) v1 -- 0x7f36900611d0 con 0x7f367c0383c0 2024-09-13T22:47:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:33 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:33 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:33 smithi002 ceph-mon[27637]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi047", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:33 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:33 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:33 smithi002 ceph-mon[27637]: Deploying daemon node-exporter.smithi002 on smithi002 2024-09-13T22:47:34.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:34 smithi002 ceph-mon[27637]: Deploying cephadm binary to smithi047 2024-09-13T22:47:34.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:34 smithi002 ceph-mon[27637]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:47:34.534 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi047' with addr '172.21.15.47' 2024-09-13T22:47:34.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:34.531+0000 7f368dffb700 1 -- 172.21.15.2:0/169948332 <== mgr.14164 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f36900611d0 con 0x7f367c0383c0 2024-09-13T22:47:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:34.534+0000 7f3696310700 1 -- 172.21.15.2:0/169948332 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f367c0383c0 msgr2=0x7f367c03a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:34.534+0000 7f3696310700 1 --2- 172.21.15.2:0/169948332 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f367c0383c0 0x7f367c03a880 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3678006fd0 tx=0x7f3678006e40 comp rx=0 tx=0).stop 2024-09-13T22:47:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:34.534+0000 7f3696310700 1 -- 172.21.15.2:0/169948332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36900ff780 msgr2=0x7f3690195980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:34.534+0000 7f3696310700 1 --2- 172.21.15.2:0/169948332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36900ff780 0x7f3690195980 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3680005b40 tx=0x7f3680004740 comp rx=0 tx=0).stop 2024-09-13T22:47:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:34.534+0000 7f3696310700 1 -- 172.21.15.2:0/169948332 shutdown_connections 2024-09-13T22:47:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:34.534+0000 7f3696310700 1 --2- 172.21.15.2:0/169948332 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f367c0383c0 0x7f367c03a880 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:34.534+0000 7f3696310700 1 --2- 172.21.15.2:0/169948332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36900ff780 0x7f3690195980 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:34.534+0000 7f3696310700 1 -- 172.21.15.2:0/169948332 >> 172.21.15.2:0/169948332 conn(0x7f36900fad20 msgr2=0x7f36900690f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:34.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:34.534+0000 7f3696310700 1 -- 172.21.15.2:0/169948332 shutdown_connections 2024-09-13T22:47:34.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:34.534+0000 7f3696310700 1 -- 172.21.15.2:0/169948332 wait complete. 2024-09-13T22:47:35.631 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:35 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:35.632 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:35 smithi002 ceph-mon[27637]: Added host smithi047 2024-09-13T22:47:35.632 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:35 smithi002 ceph-mon[27637]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:47:35.658 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T22:47:36.162 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:47:37.274 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:37 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:37.274 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:37 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:37.274 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:37 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:37.275 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:37 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:37.275 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:37 smithi002 ceph-mon[27637]: Deploying daemon alertmanager.smithi002 on smithi002 2024-09-13T22:47:37.275 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:37 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:37.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.809+0000 7f60a9b0b700 1 -- 172.21.15.2:0/1773492027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60a40ff780 msgr2=0x7f60a40ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:37.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.809+0000 7f60a9b0b700 1 --2- 172.21.15.2:0/1773492027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60a40ff780 0x7f60a40ffba0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f609400b0a0 tx=0x7f609400b3b0 comp rx=0 tx=0).stop 2024-09-13T22:47:37.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.809+0000 7f60a9b0b700 1 -- 172.21.15.2:0/1773492027 shutdown_connections 2024-09-13T22:47:37.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.809+0000 7f60a9b0b700 1 --2- 172.21.15.2:0/1773492027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60a40ff780 0x7f60a40ffba0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:37.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.809+0000 7f60a9b0b700 1 -- 172.21.15.2:0/1773492027 >> 172.21.15.2:0/1773492027 conn(0x7f60a40fad20 msgr2=0x7f60a40fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:37.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.809+0000 7f60a9b0b700 1 -- 172.21.15.2:0/1773492027 shutdown_connections 2024-09-13T22:47:37.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.809+0000 7f60a9b0b700 1 -- 172.21.15.2:0/1773492027 wait complete. 2024-09-13T22:47:37.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.810+0000 7f60a9b0b700 1 Processor -- start 2024-09-13T22:47:37.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.810+0000 7f60a9b0b700 1 -- start start 2024-09-13T22:47:37.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.810+0000 7f60a9b0b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60a40ff780 0x7f60a4068af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:37.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.810+0000 7f60a9b0b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a41986f0 con 0x7f60a40ff780 2024-09-13T22:47:37.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.810+0000 7f60a37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60a40ff780 0x7f60a4068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:37.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.810+0000 7f60a37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60a40ff780 0x7f60a4068af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39042/0 (socket says 172.21.15.2:39042) 2024-09-13T22:47:37.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.810+0000 7f60a37fe700 1 -- 172.21.15.2:0/2062544071 learned_addr learned my addr 172.21.15.2:0/2062544071 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:37.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.811+0000 7f60a37fe700 1 -- 172.21.15.2:0/2062544071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6094009d00 con 0x7f60a40ff780 2024-09-13T22:47:37.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.811+0000 7f60a37fe700 1 --2- 172.21.15.2:0/2062544071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60a40ff780 0x7f60a4068af0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6094009fd0 tx=0x7f609400bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:37.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.811+0000 7f60a0ff9700 1 -- 172.21.15.2:0/2062544071 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f609400e040 con 0x7f60a40ff780 2024-09-13T22:47:37.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.811+0000 7f60a0ff9700 1 -- 172.21.15.2:0/2062544071 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f609400bdc0 con 0x7f60a40ff780 2024-09-13T22:47:37.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.811+0000 7f60a9b0b700 1 -- 172.21.15.2:0/2062544071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a4198830 con 0x7f60a40ff780 2024-09-13T22:47:37.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.811+0000 7f60a0ff9700 1 -- 172.21.15.2:0/2062544071 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f609401da40 con 0x7f60a40ff780 2024-09-13T22:47:37.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.811+0000 7f60a9b0b700 1 -- 172.21.15.2:0/2062544071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a4198c50 con 0x7f60a40ff780 2024-09-13T22:47:37.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.812+0000 7f60a0ff9700 1 -- 172.21.15.2:0/2062544071 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45338+0+0 (secure 0 0 0) 0x7f609401dc80 con 0x7f60a40ff780 2024-09-13T22:47:37.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.812+0000 7f60a9b0b700 1 -- 172.21.15.2:0/2062544071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a418e3a0 con 0x7f60a40ff780 2024-09-13T22:47:37.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.812+0000 7f60a0ff9700 1 --2- 172.21.15.2:0/2062544071 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f608c038410 0x7f608c03a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:37.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.812+0000 7f60a0ff9700 1 -- 172.21.15.2:0/2062544071 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f609404c7f0 con 0x7f60a40ff780 2024-09-13T22:47:37.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.812+0000 7f60a2ffd700 1 --2- 172.21.15.2:0/2062544071 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f608c038410 0x7f608c03a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:37.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.813+0000 7f60a2ffd700 1 --2- 172.21.15.2:0/2062544071 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f608c038410 0x7f608c03a8d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6098006fd0 tx=0x7f6098006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:37.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:37.817+0000 7f60a0ff9700 1 -- 172.21.15.2:0/2062544071 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f6094025750 con 0x7f60a40ff780 2024-09-13T22:47:38.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:38.024+0000 7f60a9b0b700 1 -- 172.21.15.2:0/2062544071 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60a40611d0 con 0x7f608c038410 2024-09-13T22:47:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:38.025+0000 7f60a0ff9700 1 -- 172.21.15.2:0/2062544071 <== mgr.14164 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+158 (secure 0 0 0) 0x7f60a40611d0 con 0x7f608c038410 2024-09-13T22:47:38.026 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:47:38.026 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.47", "hostname": "smithi047", "labels": [], "status": ""}] 2024-09-13T22:47:38.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:38.027+0000 7f60a9b0b700 1 -- 172.21.15.2:0/2062544071 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f608c038410 msgr2=0x7f608c03a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:38.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:38.027+0000 7f60a9b0b700 1 --2- 172.21.15.2:0/2062544071 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f608c038410 0x7f608c03a8d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6098006fd0 tx=0x7f6098006e40 comp rx=0 tx=0).stop 2024-09-13T22:47:38.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:38.027+0000 7f60a9b0b700 1 -- 172.21.15.2:0/2062544071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60a40ff780 msgr2=0x7f60a4068af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:38.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:38.027+0000 7f60a9b0b700 1 --2- 172.21.15.2:0/2062544071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60a40ff780 0x7f60a4068af0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6094009fd0 tx=0x7f609400bb10 comp rx=0 tx=0).stop 2024-09-13T22:47:38.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:38.027+0000 7f60a9b0b700 1 -- 172.21.15.2:0/2062544071 shutdown_connections 2024-09-13T22:47:38.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:38.027+0000 7f60a9b0b700 1 --2- 172.21.15.2:0/2062544071 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f608c038410 0x7f608c03a8d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:38.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:38.027+0000 7f60a9b0b700 1 --2- 172.21.15.2:0/2062544071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60a40ff780 0x7f60a4068af0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:38.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:38.027+0000 7f60a9b0b700 1 -- 172.21.15.2:0/2062544071 >> 172.21.15.2:0/2062544071 conn(0x7f60a40fad20 msgr2=0x7f60a40fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:38.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:38.027+0000 7f60a9b0b700 1 -- 172.21.15.2:0/2062544071 shutdown_connections 2024-09-13T22:47:38.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:38.027+0000 7f60a9b0b700 1 -- 172.21.15.2:0/2062544071 wait complete. 2024-09-13T22:47:38.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:38 smithi002 ceph-mon[27637]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:47:39.213 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-13T22:47:39.213 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-13T22:47:39.416 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:47:39.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:39 smithi002 ceph-mon[27637]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:47:40.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:40 smithi002 ceph-mon[27637]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:47:42.207 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:41 smithi002 ceph-mon[27637]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:47:42.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.405+0000 7f1747f1b700 1 -- 172.21.15.2:0/2309024280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17400ff780 msgr2=0x7f17400ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:42.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.405+0000 7f1747f1b700 1 --2- 172.21.15.2:0/2309024280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17400ff780 0x7f17400ffba0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f173c009910 tx=0x7f173c009c20 comp rx=0 tx=0).stop 2024-09-13T22:47:42.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.405+0000 7f1747f1b700 1 -- 172.21.15.2:0/2309024280 shutdown_connections 2024-09-13T22:47:42.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.405+0000 7f1747f1b700 1 --2- 172.21.15.2:0/2309024280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17400ff780 0x7f17400ffba0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:42.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.405+0000 7f1747f1b700 1 -- 172.21.15.2:0/2309024280 >> 172.21.15.2:0/2309024280 conn(0x7f17400fad20 msgr2=0x7f17400fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:42.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.405+0000 7f1747f1b700 1 -- 172.21.15.2:0/2309024280 shutdown_connections 2024-09-13T22:47:42.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.405+0000 7f1747f1b700 1 -- 172.21.15.2:0/2309024280 wait complete. 2024-09-13T22:47:42.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.406+0000 7f1747f1b700 1 Processor -- start 2024-09-13T22:47:42.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.406+0000 7f1747f1b700 1 -- start start 2024-09-13T22:47:42.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.406+0000 7f1747f1b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17400ff780 0x7f17400693c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:42.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.406+0000 7f1747f1b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17401986d0 con 0x7f17400ff780 2024-09-13T22:47:42.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.406+0000 7f1745cb7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17400ff780 0x7f17400693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:42.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.406+0000 7f1745cb7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17400ff780 0x7f17400693c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34124/0 (socket says 172.21.15.2:34124) 2024-09-13T22:47:42.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.406+0000 7f1745cb7700 1 -- 172.21.15.2:0/1624179177 learned_addr learned my addr 172.21.15.2:0/1624179177 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:47:42.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.407+0000 7f1745cb7700 1 -- 172.21.15.2:0/1624179177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c0095f0 con 0x7f17400ff780 2024-09-13T22:47:42.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.407+0000 7f1745cb7700 1 --2- 172.21.15.2:0/1624179177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17400ff780 0x7f17400693c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f173c005b40 tx=0x7f173c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:42.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.407+0000 7f1736ffd700 1 -- 172.21.15.2:0/1624179177 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f173c01d070 con 0x7f17400ff780 2024-09-13T22:47:42.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.407+0000 7f1736ffd700 1 -- 172.21.15.2:0/1624179177 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f173c00be10 con 0x7f17400ff780 2024-09-13T22:47:42.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.407+0000 7f1747f1b700 1 -- 172.21.15.2:0/1624179177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1740198810 con 0x7f17400ff780 2024-09-13T22:47:42.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.407+0000 7f1736ffd700 1 -- 172.21.15.2:0/1624179177 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f173c00f460 con 0x7f17400ff780 2024-09-13T22:47:42.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.407+0000 7f1747f1b700 1 -- 172.21.15.2:0/1624179177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1740198cb0 con 0x7f17400ff780 2024-09-13T22:47:42.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.408+0000 7f1736ffd700 1 -- 172.21.15.2:0/1624179177 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45338+0+0 (secure 0 0 0) 0x7f173c0227e0 con 0x7f17400ff780 2024-09-13T22:47:42.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.408+0000 7f1747f1b700 1 -- 172.21.15.2:0/1624179177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174018e3a0 con 0x7f17400ff780 2024-09-13T22:47:42.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.408+0000 7f1736ffd700 1 --2- 172.21.15.2:0/1624179177 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f172c0383c0 0x7f172c03a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:42.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.408+0000 7f1736ffd700 1 -- 172.21.15.2:0/1624179177 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f173c04c350 con 0x7f17400ff780 2024-09-13T22:47:42.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.408+0000 7f17454b6700 1 --2- 172.21.15.2:0/1624179177 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f172c0383c0 0x7f172c03a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:42.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.409+0000 7f17454b6700 1 --2- 172.21.15.2:0/1624179177 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f172c0383c0 0x7f172c03a880 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1730006fd0 tx=0x7f1730006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:42.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.413+0000 7f1736ffd700 1 -- 172.21.15.2:0/1624179177 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f173c02bba0 con 0x7f17400ff780 2024-09-13T22:47:42.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.624+0000 7f1747f1b700 1 -- 172.21.15.2:0/1624179177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f17400623c0 con 0x7f17400ff780 2024-09-13T22:47:42.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.872+0000 7f1736ffd700 1 -- 172.21.15.2:0/1624179177 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f173c027070 con 0x7f17400ff780 2024-09-13T22:47:42.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.874+0000 7f1747f1b700 1 -- 172.21.15.2:0/1624179177 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f172c0383c0 msgr2=0x7f172c03a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:42.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.874+0000 7f1747f1b700 1 --2- 172.21.15.2:0/1624179177 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f172c0383c0 0x7f172c03a880 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1730006fd0 tx=0x7f1730006e40 comp rx=0 tx=0).stop 2024-09-13T22:47:42.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.874+0000 7f1747f1b700 1 -- 172.21.15.2:0/1624179177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17400ff780 msgr2=0x7f17400693c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:42.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.874+0000 7f1747f1b700 1 --2- 172.21.15.2:0/1624179177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17400ff780 0x7f17400693c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f173c005b40 tx=0x7f173c004740 comp rx=0 tx=0).stop 2024-09-13T22:47:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.874+0000 7f1747f1b700 1 -- 172.21.15.2:0/1624179177 shutdown_connections 2024-09-13T22:47:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.874+0000 7f1747f1b700 1 --2- 172.21.15.2:0/1624179177 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f172c0383c0 0x7f172c03a880 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.874+0000 7f1747f1b700 1 --2- 172.21.15.2:0/1624179177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17400ff780 0x7f17400693c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.874+0000 7f1747f1b700 1 -- 172.21.15.2:0/1624179177 >> 172.21.15.2:0/1624179177 conn(0x7f17400fad20 msgr2=0x7f17400fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.874+0000 7f1747f1b700 1 -- 172.21.15.2:0/1624179177 shutdown_connections 2024-09-13T22:47:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:47:42.874+0000 7f1747f1b700 1 -- 172.21.15.2:0/1624179177 wait complete. 2024-09-13T22:47:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2024-09-13T22:47:43.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:42 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/1624179177' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T22:47:44.216 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:43 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/1624179177' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T22:47:44.217 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:43 smithi002 ceph-mon[27637]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T22:47:44.217 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:43 smithi002 ceph-mon[27637]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:47:44.784 INFO:tasks.cephadm:Adding mon.smithi002 on smithi002 2024-09-13T22:47:44.784 INFO:tasks.cephadm:Adding mon.smithi047 on smithi047 2024-09-13T22:47:44.784 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi002:172.21.15.2=smithi002;smithi047:172.21.15.47=smithi047' 2024-09-13T22:47:44.987 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:47:45.033 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:47:45.987 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:45 smithi002 ceph-mon[27637]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:47:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.476+0000 7f0e93a4d700 1 -- 172.21.15.47:0/348650767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e8c0ff780 msgr2=0x7f0e8c0ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.476+0000 7f0e93a4d700 1 --2- 172.21.15.47:0/348650767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e8c0ff780 0x7f0e8c0ffba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c00b0a0 tx=0x7f0e7c00b3b0 comp rx=0 tx=0).stop 2024-09-13T22:47:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.476+0000 7f0e93a4d700 1 -- 172.21.15.47:0/348650767 shutdown_connections 2024-09-13T22:47:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.476+0000 7f0e93a4d700 1 --2- 172.21.15.47:0/348650767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e8c0ff780 0x7f0e8c0ffba0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.476+0000 7f0e93a4d700 1 -- 172.21.15.47:0/348650767 >> 172.21.15.47:0/348650767 conn(0x7f0e8c0fad20 msgr2=0x7f0e8c0fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.476+0000 7f0e93a4d700 1 -- 172.21.15.47:0/348650767 shutdown_connections 2024-09-13T22:47:46.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.476+0000 7f0e93a4d700 1 -- 172.21.15.47:0/348650767 wait complete. 2024-09-13T22:47:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.477+0000 7f0e93a4d700 1 Processor -- start 2024-09-13T22:47:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.477+0000 7f0e93a4d700 1 -- start start 2024-09-13T22:47:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.477+0000 7f0e93a4d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e8c0ff780 0x7f0e8c1959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.477+0000 7f0e93a4d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c195ee0 con 0x7f0e8c0ff780 2024-09-13T22:47:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.478+0000 7f0e917e9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e8c0ff780 0x7f0e8c1959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.478+0000 7f0e917e9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e8c0ff780 0x7f0e8c1959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.47:34150/0 (socket says 172.21.15.47:34150) 2024-09-13T22:47:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.478+0000 7f0e917e9700 1 -- 172.21.15.47:0/1238082817 learned_addr learned my addr 172.21.15.47:0/1238082817 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:47:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.478+0000 7f0e917e9700 1 -- 172.21.15.47:0/1238082817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c009d00 con 0x7f0e8c0ff780 2024-09-13T22:47:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.478+0000 7f0e917e9700 1 --2- 172.21.15.47:0/1238082817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e8c0ff780 0x7f0e8c1959a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c00b830 tx=0x7f0e7c00bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.478+0000 7f0e8a7fc700 1 -- 172.21.15.47:0/1238082817 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e7c00e040 con 0x7f0e8c0ff780 2024-09-13T22:47:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.478+0000 7f0e8a7fc700 1 -- 172.21.15.47:0/1238082817 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0e7c012af0 con 0x7f0e8c0ff780 2024-09-13T22:47:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.478+0000 7f0e8a7fc700 1 -- 172.21.15.47:0/1238082817 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e7c01d9f0 con 0x7f0e8c0ff780 2024-09-13T22:47:46.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.478+0000 7f0e93a4d700 1 -- 172.21.15.47:0/1238082817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e8c1960e0 con 0x7f0e8c0ff780 2024-09-13T22:47:46.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.478+0000 7f0e93a4d700 1 -- 172.21.15.47:0/1238082817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e8c196500 con 0x7f0e8c0ff780 2024-09-13T22:47:46.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.479+0000 7f0e8a7fc700 1 -- 172.21.15.47:0/1238082817 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45338+0+0 (secure 0 0 0) 0x7f0e7c01dc60 con 0x7f0e8c0ff780 2024-09-13T22:47:46.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.480+0000 7f0e93a4d700 1 -- 172.21.15.47:0/1238082817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e8c18f3b0 con 0x7f0e8c0ff780 2024-09-13T22:47:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.480+0000 7f0e8a7fc700 1 --2- 172.21.15.47:0/1238082817 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f0e74038410 0x7f0e7403a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.480+0000 7f0e8a7fc700 1 -- 172.21.15.47:0/1238082817 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f0e7c04c7d0 con 0x7f0e8c0ff780 2024-09-13T22:47:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.480+0000 7f0e90fe8700 1 --2- 172.21.15.47:0/1238082817 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f0e74038410 0x7f0e7403a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:46.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.481+0000 7f0e90fe8700 1 --2- 172.21.15.47:0/1238082817 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f0e74038410 0x7f0e7403a8d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0e80006fd0 tx=0x7f0e80006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:46.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.486+0000 7f0e8a7fc700 1 -- 172.21.15.47:0/1238082817 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0e7c01c3e0 con 0x7f0e8c0ff780 2024-09-13T22:47:46.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.696+0000 7f0e93a4d700 1 -- 172.21.15.47:0/1238082817 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi002:172.21.15.2=smithi002;smithi047:172.21.15.47=smithi047", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e8c0611d0 con 0x7f0e74038410 2024-09-13T22:47:46.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.701+0000 7f0e8a7fc700 1 -- 172.21.15.47:0/1238082817 <== mgr.14164 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f0e8c0611d0 con 0x7f0e74038410 2024-09-13T22:47:46.702 INFO:teuthology.orchestra.run.smithi047.stdout:Scheduled mon update... 2024-09-13T22:47:46.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.703+0000 7f0e93a4d700 1 -- 172.21.15.47:0/1238082817 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f0e74038410 msgr2=0x7f0e7403a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:46.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.703+0000 7f0e93a4d700 1 --2- 172.21.15.47:0/1238082817 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f0e74038410 0x7f0e7403a8d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0e80006fd0 tx=0x7f0e80006e40 comp rx=0 tx=0).stop 2024-09-13T22:47:46.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.703+0000 7f0e93a4d700 1 -- 172.21.15.47:0/1238082817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e8c0ff780 msgr2=0x7f0e8c1959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:46.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.703+0000 7f0e93a4d700 1 --2- 172.21.15.47:0/1238082817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e8c0ff780 0x7f0e8c1959a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c00b830 tx=0x7f0e7c00bd40 comp rx=0 tx=0).stop 2024-09-13T22:47:46.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.704+0000 7f0e93a4d700 1 -- 172.21.15.47:0/1238082817 shutdown_connections 2024-09-13T22:47:46.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.704+0000 7f0e93a4d700 1 --2- 172.21.15.47:0/1238082817 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f0e74038410 0x7f0e7403a8d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:46.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.704+0000 7f0e93a4d700 1 --2- 172.21.15.47:0/1238082817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e8c0ff780 0x7f0e8c1959a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:46.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.704+0000 7f0e93a4d700 1 -- 172.21.15.47:0/1238082817 >> 172.21.15.47:0/1238082817 conn(0x7f0e8c0fad20 msgr2=0x7f0e8c068820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:46.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.704+0000 7f0e93a4d700 1 -- 172.21.15.47:0/1238082817 shutdown_connections 2024-09-13T22:47:46.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:46.704+0000 7f0e93a4d700 1 -- 172.21.15.47:0/1238082817 wait complete. 2024-09-13T22:47:47.301 DEBUG:teuthology.orchestra.run.smithi047:mon.smithi047> sudo journalctl -f -n 0 -u ceph-e41042f8-7221-11ef-bceb-c7b262605968@mon.smithi047.service 2024-09-13T22:47:47.304 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:47:47.304 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:47:47.536 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:47:47.581 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:47:47.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:47 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:47.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:47 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:47.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:47 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:47.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:47 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:47.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:47 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:47.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:47 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:47.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:47 smithi002 ceph-mon[27637]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-13T22:47:47.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:47 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:47.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:47 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:47.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:47 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T22:47:47.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:47 smithi002 ceph-mon[27637]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T22:47:47.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:47 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:47.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:47 smithi002 ceph-mon[27637]: Deploying daemon grafana.smithi002 on smithi002 2024-09-13T22:47:47.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:47 smithi002 ceph-mon[27637]: from='client.14197 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi002:172.21.15.2=smithi002;smithi047:172.21.15.47=smithi047", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:47:47.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:47 smithi002 ceph-mon[27637]: Saving service mon spec with placement smithi002:172.21.15.2=smithi002;smithi047:172.21.15.47=smithi047;count:2 2024-09-13T22:47:47.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:47 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:47.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:47 smithi002 ceph-mon[27637]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:47:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.091+0000 7f534b27f700 1 -- 172.21.15.47:0/1178076042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5344101370 msgr2=0x7f5344103760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.091+0000 7f534b27f700 1 --2- 172.21.15.47:0/1178076042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5344101370 0x7f5344103760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5340009910 tx=0x7f5340009c20 comp rx=0 tx=0).stop 2024-09-13T22:47:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.091+0000 7f534b27f700 1 -- 172.21.15.47:0/1178076042 shutdown_connections 2024-09-13T22:47:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.091+0000 7f534b27f700 1 --2- 172.21.15.47:0/1178076042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5344101370 0x7f5344103760 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.091+0000 7f534b27f700 1 -- 172.21.15.47:0/1178076042 >> 172.21.15.47:0/1178076042 conn(0x7f53440fad20 msgr2=0x7f53440fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.091+0000 7f534b27f700 1 -- 172.21.15.47:0/1178076042 shutdown_connections 2024-09-13T22:47:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.091+0000 7f534b27f700 1 -- 172.21.15.47:0/1178076042 wait complete. 2024-09-13T22:47:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.091+0000 7f534b27f700 1 Processor -- start 2024-09-13T22:47:49.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.091+0000 7f534b27f700 1 -- start start 2024-09-13T22:47:49.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.092+0000 7f534b27f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5344101370 0x7f5344195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:49.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.092+0000 7f534b27f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5344195e70 con 0x7f5344101370 2024-09-13T22:47:49.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.092+0000 7f534901b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5344101370 0x7f5344195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.092+0000 7f534901b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5344101370 0x7f5344195930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.47:34172/0 (socket says 172.21.15.47:34172) 2024-09-13T22:47:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.092+0000 7f534901b700 1 -- 172.21.15.47:0/2187949822 learned_addr learned my addr 172.21.15.47:0/2187949822 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:47:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.092+0000 7f534901b700 1 -- 172.21.15.47:0/2187949822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53400095f0 con 0x7f5344101370 2024-09-13T22:47:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.092+0000 7f534901b700 1 --2- 172.21.15.47:0/2187949822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5344101370 0x7f5344195930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5340005b40 tx=0x7f5340004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.092+0000 7f533a7fc700 1 -- 172.21.15.47:0/2187949822 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f534001d070 con 0x7f5344101370 2024-09-13T22:47:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.093+0000 7f534b27f700 1 -- 172.21.15.47:0/2187949822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5344196070 con 0x7f5344101370 2024-09-13T22:47:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.093+0000 7f533a7fc700 1 -- 172.21.15.47:0/2187949822 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f534000be10 con 0x7f5344101370 2024-09-13T22:47:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.093+0000 7f533a7fc700 1 -- 172.21.15.47:0/2187949822 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f534000f460 con 0x7f5344101370 2024-09-13T22:47:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.093+0000 7f534b27f700 1 -- 172.21.15.47:0/2187949822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5344196510 con 0x7f5344101370 2024-09-13T22:47:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.093+0000 7f533a7fc700 1 -- 172.21.15.47:0/2187949822 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45338+0+0 (secure 0 0 0) 0x7f534000f6d0 con 0x7f5344101370 2024-09-13T22:47:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.093+0000 7f534b27f700 1 -- 172.21.15.47:0/2187949822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534418f4a0 con 0x7f5344101370 2024-09-13T22:47:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.094+0000 7f533a7fc700 1 --2- 172.21.15.47:0/2187949822 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f53300383c0 0x7f533003a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:49.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.094+0000 7f533a7fc700 1 -- 172.21.15.47:0/2187949822 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f534004c4c0 con 0x7f5344101370 2024-09-13T22:47:49.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.094+0000 7f534881a700 1 --2- 172.21.15.47:0/2187949822 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f53300383c0 0x7f533003a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:49.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.094+0000 7f534881a700 1 --2- 172.21.15.47:0/2187949822 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f53300383c0 0x7f533003a880 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5334006fd0 tx=0x7f5334006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:49.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.098+0000 7f533a7fc700 1 -- 172.21.15.47:0/2187949822 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5340020550 con 0x7f5344101370 2024-09-13T22:47:49.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.378+0000 7f534b27f700 1 -- 172.21.15.47:0/2187949822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f534402cc70 con 0x7f5344101370 2024-09-13T22:47:49.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.379+0000 7f533a7fc700 1 -- 172.21.15.47:0/2187949822 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7f5340027030 con 0x7f5344101370 2024-09-13T22:47:49.380 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:47:49.380 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":1,"fsid":"e41042f8-7221-11ef-bceb-c7b262605968","modified":"2024-09-13T22:46:07.590380Z","created":"2024-09-13T22:46:07.590380Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:47:49.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.381+0000 7f534b27f700 1 -- 172.21.15.47:0/2187949822 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f53300383c0 msgr2=0x7f533003a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:49.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.381+0000 7f534b27f700 1 --2- 172.21.15.47:0/2187949822 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f53300383c0 0x7f533003a880 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5334006fd0 tx=0x7f5334006e40 comp rx=0 tx=0).stop 2024-09-13T22:47:49.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.381+0000 7f534b27f700 1 -- 172.21.15.47:0/2187949822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5344101370 msgr2=0x7f5344195930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:49.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.381+0000 7f534b27f700 1 --2- 172.21.15.47:0/2187949822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5344101370 0x7f5344195930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5340005b40 tx=0x7f5340004740 comp rx=0 tx=0).stop 2024-09-13T22:47:49.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.381+0000 7f534b27f700 1 -- 172.21.15.47:0/2187949822 shutdown_connections 2024-09-13T22:47:49.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.381+0000 7f534b27f700 1 --2- 172.21.15.47:0/2187949822 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f53300383c0 0x7f533003a880 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:49.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.381+0000 7f534b27f700 1 --2- 172.21.15.47:0/2187949822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5344101370 0x7f5344195930 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:49.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.381+0000 7f534b27f700 1 -- 172.21.15.47:0/2187949822 >> 172.21.15.47:0/2187949822 conn(0x7f53440fad20 msgr2=0x7f53440fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:49.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.381+0000 7f534b27f700 1 -- 172.21.15.47:0/2187949822 shutdown_connections 2024-09-13T22:47:49.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:49.381+0000 7f534b27f700 1 -- 172.21.15.47:0/2187949822 wait complete. 2024-09-13T22:47:49.383 INFO:teuthology.orchestra.run.smithi047.stderr:dumped monmap epoch 1 2024-09-13T22:47:49.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:49 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/2187949822' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:47:50.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:50 smithi002 ceph-mon[27637]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:47:50.944 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:47:50.945 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:47:51.151 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:47:51.196 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:47:52.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:51 smithi002 ceph-mon[27637]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:47:52.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:51 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:52.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.575+0000 7fd3add13700 1 -- 172.21.15.47:0/2658027483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a80ff780 msgr2=0x7fd3a80ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:52.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.575+0000 7fd3add13700 1 --2- 172.21.15.47:0/2658027483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a80ff780 0x7fd3a80ffba0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd398009910 tx=0x7fd398009c20 comp rx=0 tx=0).stop 2024-09-13T22:47:52.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.576+0000 7fd3add13700 1 -- 172.21.15.47:0/2658027483 shutdown_connections 2024-09-13T22:47:52.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.576+0000 7fd3add13700 1 --2- 172.21.15.47:0/2658027483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a80ff780 0x7fd3a80ffba0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:52.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.576+0000 7fd3add13700 1 -- 172.21.15.47:0/2658027483 >> 172.21.15.47:0/2658027483 conn(0x7fd3a80fad20 msgr2=0x7fd3a80fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:52.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.576+0000 7fd3add13700 1 -- 172.21.15.47:0/2658027483 shutdown_connections 2024-09-13T22:47:52.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.576+0000 7fd3add13700 1 -- 172.21.15.47:0/2658027483 wait complete. 2024-09-13T22:47:52.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.576+0000 7fd3add13700 1 Processor -- start 2024-09-13T22:47:52.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.576+0000 7fd3add13700 1 -- start start 2024-09-13T22:47:52.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.577+0000 7fd3add13700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a80ff780 0x7fd3a8068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:52.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.577+0000 7fd3add13700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a81986d0 con 0x7fd3a80ff780 2024-09-13T22:47:52.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.577+0000 7fd3a77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a80ff780 0x7fd3a8068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:52.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.577+0000 7fd3a77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a80ff780 0x7fd3a8068b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.47:41920/0 (socket says 172.21.15.47:41920) 2024-09-13T22:47:52.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.577+0000 7fd3a77fe700 1 -- 172.21.15.47:0/2923559279 learned_addr learned my addr 172.21.15.47:0/2923559279 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:47:52.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.577+0000 7fd3a77fe700 1 -- 172.21.15.47:0/2923559279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3980095f0 con 0x7fd3a80ff780 2024-09-13T22:47:52.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.578+0000 7fd3a77fe700 1 --2- 172.21.15.47:0/2923559279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a80ff780 0x7fd3a8068b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd398005b40 tx=0x7fd398004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:52.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.578+0000 7fd3a57fa700 1 -- 172.21.15.47:0/2923559279 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd39801d070 con 0x7fd3a80ff780 2024-09-13T22:47:52.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.578+0000 7fd3a57fa700 1 -- 172.21.15.47:0/2923559279 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd39800be10 con 0x7fd3a80ff780 2024-09-13T22:47:52.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.578+0000 7fd3a57fa700 1 -- 172.21.15.47:0/2923559279 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd39800f460 con 0x7fd3a80ff780 2024-09-13T22:47:52.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.578+0000 7fd3add13700 1 -- 172.21.15.47:0/2923559279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a8198810 con 0x7fd3a80ff780 2024-09-13T22:47:52.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.578+0000 7fd3add13700 1 -- 172.21.15.47:0/2923559279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a8198cb0 con 0x7fd3a80ff780 2024-09-13T22:47:52.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.579+0000 7fd3a57fa700 1 -- 172.21.15.47:0/2923559279 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45338+0+0 (secure 0 0 0) 0x7fd39800b960 con 0x7fd3a80ff780 2024-09-13T22:47:52.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.579+0000 7fd3a57fa700 1 --2- 172.21.15.47:0/2923559279 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd394038410 0x7fd39403a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:52.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.579+0000 7fd3a57fa700 1 -- 172.21.15.47:0/2923559279 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fd39804c4b0 con 0x7fd3a80ff780 2024-09-13T22:47:52.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.579+0000 7fd3add13700 1 -- 172.21.15.47:0/2923559279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a818e3a0 con 0x7fd3a80ff780 2024-09-13T22:47:52.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.579+0000 7fd39effd700 1 --2- 172.21.15.47:0/2923559279 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd394038410 0x7fd39403a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:52.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.580+0000 7fd39effd700 1 --2- 172.21.15.47:0/2923559279 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd394038410 0x7fd39403a8d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd390006fd0 tx=0x7fd390006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.585+0000 7fd3a57fa700 1 -- 172.21.15.47:0/2923559279 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd398027070 con 0x7fd3a80ff780 2024-09-13T22:47:52.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.864+0000 7fd3add13700 1 -- 172.21.15.47:0/2923559279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd3a802cc70 con 0x7fd3a80ff780 2024-09-13T22:47:52.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.864+0000 7fd3a57fa700 1 -- 172.21.15.47:0/2923559279 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7fd39800f5c0 con 0x7fd3a80ff780 2024-09-13T22:47:52.865 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:47:52.865 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":1,"fsid":"e41042f8-7221-11ef-bceb-c7b262605968","modified":"2024-09-13T22:46:07.590380Z","created":"2024-09-13T22:46:07.590380Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:47:52.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.866+0000 7fd3add13700 1 -- 172.21.15.47:0/2923559279 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd394038410 msgr2=0x7fd39403a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:52.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.866+0000 7fd3add13700 1 --2- 172.21.15.47:0/2923559279 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd394038410 0x7fd39403a8d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd390006fd0 tx=0x7fd390006e40 comp rx=0 tx=0).stop 2024-09-13T22:47:52.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.866+0000 7fd3add13700 1 -- 172.21.15.47:0/2923559279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a80ff780 msgr2=0x7fd3a8068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:52.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.866+0000 7fd3add13700 1 --2- 172.21.15.47:0/2923559279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a80ff780 0x7fd3a8068b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd398005b40 tx=0x7fd398004740 comp rx=0 tx=0).stop 2024-09-13T22:47:52.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.866+0000 7fd3add13700 1 -- 172.21.15.47:0/2923559279 shutdown_connections 2024-09-13T22:47:52.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.866+0000 7fd3add13700 1 --2- 172.21.15.47:0/2923559279 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd394038410 0x7fd39403a8d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:52.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.866+0000 7fd3add13700 1 --2- 172.21.15.47:0/2923559279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a80ff780 0x7fd3a8068b10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:52.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.866+0000 7fd3add13700 1 -- 172.21.15.47:0/2923559279 >> 172.21.15.47:0/2923559279 conn(0x7fd3a80fad20 msgr2=0x7fd3a80fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:52.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.867+0000 7fd3add13700 1 -- 172.21.15.47:0/2923559279 shutdown_connections 2024-09-13T22:47:52.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:52.867+0000 7fd3add13700 1 -- 172.21.15.47:0/2923559279 wait complete. 2024-09-13T22:47:52.868 INFO:teuthology.orchestra.run.smithi047.stderr:dumped monmap epoch 1 2024-09-13T22:47:53.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:52 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/2923559279' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:47:54.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:53 smithi002 ceph-mon[27637]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:47:54.424 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:47:54.425 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:47:54.634 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:47:54.679 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:47:55.867 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:55 smithi002 ceph-mon[27637]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:47:56.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.141+0000 7fca7d131700 1 -- 172.21.15.47:0/3747466418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78074d40 msgr2=0x7fca780731a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:56.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.141+0000 7fca7d131700 1 --2- 172.21.15.47:0/3747466418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78074d40 0x7fca780731a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fca6800b0a0 tx=0x7fca6800b3b0 comp rx=0 tx=0).stop 2024-09-13T22:47:56.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.141+0000 7fca7d131700 1 -- 172.21.15.47:0/3747466418 shutdown_connections 2024-09-13T22:47:56.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.141+0000 7fca7d131700 1 --2- 172.21.15.47:0/3747466418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78074d40 0x7fca780731a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:56.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.141+0000 7fca7d131700 1 -- 172.21.15.47:0/3747466418 >> 172.21.15.47:0/3747466418 conn(0x7fca780fbe00 msgr2=0x7fca780fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:56.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.141+0000 7fca7d131700 1 -- 172.21.15.47:0/3747466418 shutdown_connections 2024-09-13T22:47:56.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.141+0000 7fca7d131700 1 -- 172.21.15.47:0/3747466418 wait complete. 2024-09-13T22:47:56.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.142+0000 7fca7d131700 1 Processor -- start 2024-09-13T22:47:56.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.142+0000 7fca7d131700 1 -- start start 2024-09-13T22:47:56.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.143+0000 7fca7d131700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78074d40 0x7fca78197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:56.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.143+0000 7fca7d131700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca781980c0 con 0x7fca78074d40 2024-09-13T22:47:56.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.143+0000 7fca76d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78074d40 0x7fca78197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:56.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.143+0000 7fca76d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78074d40 0x7fca78197b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.47:41940/0 (socket says 172.21.15.47:41940) 2024-09-13T22:47:56.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.143+0000 7fca76d9d700 1 -- 172.21.15.47:0/3600785522 learned_addr learned my addr 172.21.15.47:0/3600785522 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:47:56.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.143+0000 7fca76d9d700 1 -- 172.21.15.47:0/3600785522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca68009d00 con 0x7fca78074d40 2024-09-13T22:47:56.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.143+0000 7fca76d9d700 1 --2- 172.21.15.47:0/3600785522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78074d40 0x7fca78197b80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca68015040 tx=0x7fca6800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:56.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.144+0000 7fca6ffff700 1 -- 172.21.15.47:0/3600785522 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca6800e040 con 0x7fca78074d40 2024-09-13T22:47:56.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.144+0000 7fca7d131700 1 -- 172.21.15.47:0/3600785522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca781982c0 con 0x7fca78074d40 2024-09-13T22:47:56.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.144+0000 7fca6ffff700 1 -- 172.21.15.47:0/3600785522 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fca6801d930 con 0x7fca78074d40 2024-09-13T22:47:56.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.144+0000 7fca6ffff700 1 -- 172.21.15.47:0/3600785522 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca680129d0 con 0x7fca78074d40 2024-09-13T22:47:56.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.144+0000 7fca7d131700 1 -- 172.21.15.47:0/3600785522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca781986e0 con 0x7fca78074d40 2024-09-13T22:47:56.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.145+0000 7fca7d131700 1 -- 172.21.15.47:0/3600785522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca781916a0 con 0x7fca78074d40 2024-09-13T22:47:56.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.145+0000 7fca6ffff700 1 -- 172.21.15.47:0/3600785522 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45338+0+0 (secure 0 0 0) 0x7fca68012c90 con 0x7fca78074d40 2024-09-13T22:47:56.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.145+0000 7fca6ffff700 1 --2- 172.21.15.47:0/3600785522 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fca640383c0 0x7fca6403a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:56.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.145+0000 7fca6ffff700 1 -- 172.21.15.47:0/3600785522 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fca6804c8f0 con 0x7fca78074d40 2024-09-13T22:47:56.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.145+0000 7fca7659c700 1 --2- 172.21.15.47:0/3600785522 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fca640383c0 0x7fca6403a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:56.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.146+0000 7fca7659c700 1 --2- 172.21.15.47:0/3600785522 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fca640383c0 0x7fca6403a880 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fca60006fd0 tx=0x7fca60006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:56.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.150+0000 7fca6ffff700 1 -- 172.21.15.47:0/3600785522 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fca6801c5c0 con 0x7fca78074d40 2024-09-13T22:47:56.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.428+0000 7fca7d131700 1 -- 172.21.15.47:0/3600785522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fca7802cc70 con 0x7fca78074d40 2024-09-13T22:47:56.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.429+0000 7fca6ffff700 1 -- 172.21.15.47:0/3600785522 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7fca6801c3e0 con 0x7fca78074d40 2024-09-13T22:47:56.430 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:47:56.430 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":1,"fsid":"e41042f8-7221-11ef-bceb-c7b262605968","modified":"2024-09-13T22:46:07.590380Z","created":"2024-09-13T22:46:07.590380Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:47:56.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.431+0000 7fca7d131700 1 -- 172.21.15.47:0/3600785522 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fca640383c0 msgr2=0x7fca6403a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:56.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.431+0000 7fca7d131700 1 --2- 172.21.15.47:0/3600785522 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fca640383c0 0x7fca6403a880 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fca60006fd0 tx=0x7fca60006e40 comp rx=0 tx=0).stop 2024-09-13T22:47:56.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.431+0000 7fca7d131700 1 -- 172.21.15.47:0/3600785522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78074d40 msgr2=0x7fca78197b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:56.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.431+0000 7fca7d131700 1 --2- 172.21.15.47:0/3600785522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78074d40 0x7fca78197b80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca68015040 tx=0x7fca6800bb10 comp rx=0 tx=0).stop 2024-09-13T22:47:56.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.431+0000 7fca7d131700 1 -- 172.21.15.47:0/3600785522 shutdown_connections 2024-09-13T22:47:56.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.431+0000 7fca7d131700 1 --2- 172.21.15.47:0/3600785522 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fca640383c0 0x7fca6403a880 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:56.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.431+0000 7fca7d131700 1 --2- 172.21.15.47:0/3600785522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78074d40 0x7fca78197b80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:56.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.431+0000 7fca7d131700 1 -- 172.21.15.47:0/3600785522 >> 172.21.15.47:0/3600785522 conn(0x7fca780fbe00 msgr2=0x7fca780fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:56.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.431+0000 7fca7d131700 1 -- 172.21.15.47:0/3600785522 shutdown_connections 2024-09-13T22:47:56.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:56.431+0000 7fca7d131700 1 -- 172.21.15.47:0/3600785522 wait complete. 2024-09-13T22:47:56.433 INFO:teuthology.orchestra.run.smithi047.stderr:dumped monmap epoch 1 2024-09-13T22:47:57.091 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:56 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/3600785522' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:47:58.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:57 smithi002 ceph-mon[27637]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:47:58.014 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:47:58.014 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:47:58.219 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:47:58.264 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:47:59.172 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:58 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:59.173 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:58 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:59.173 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:58 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:59.173 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:58 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:59.173 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:58 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:59.173 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:58 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:59.173 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:58 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:59.173 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:58 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:47:59.173 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:58 smithi002 ceph-mon[27637]: Deploying daemon prometheus.smithi002 on smithi002 2024-09-13T22:47:59.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.608+0000 7f58fd313700 1 -- 172.21.15.47:0/3562520119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8101310 msgr2=0x7f58f8103700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:59.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.608+0000 7f58fd313700 1 --2- 172.21.15.47:0/3562520119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8101310 0x7f58f8103700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009910 tx=0x7f58e8009c20 comp rx=0 tx=0).stop 2024-09-13T22:47:59.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.608+0000 7f58fd313700 1 -- 172.21.15.47:0/3562520119 shutdown_connections 2024-09-13T22:47:59.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.608+0000 7f58fd313700 1 --2- 172.21.15.47:0/3562520119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8101310 0x7f58f8103700 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:59.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.608+0000 7f58fd313700 1 -- 172.21.15.47:0/3562520119 >> 172.21.15.47:0/3562520119 conn(0x7f58f80fad20 msgr2=0x7f58f80fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:59.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.608+0000 7f58fd313700 1 -- 172.21.15.47:0/3562520119 shutdown_connections 2024-09-13T22:47:59.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.608+0000 7f58fd313700 1 -- 172.21.15.47:0/3562520119 wait complete. 2024-09-13T22:47:59.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.609+0000 7f58fd313700 1 Processor -- start 2024-09-13T22:47:59.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.609+0000 7f58fd313700 1 -- start start 2024-09-13T22:47:59.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.609+0000 7f58fd313700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8101310 0x7f58f8100c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:59.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.609+0000 7f58fd313700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f81011b0 con 0x7f58f8101310 2024-09-13T22:47:59.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.609+0000 7f58f6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8101310 0x7f58f8100c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:59.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.609+0000 7f58f6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8101310 0x7f58f8100c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.47:41962/0 (socket says 172.21.15.47:41962) 2024-09-13T22:47:59.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.609+0000 7f58f6ffd700 1 -- 172.21.15.47:0/2167247553 learned_addr learned my addr 172.21.15.47:0/2167247553 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:47:59.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.609+0000 7f58f6ffd700 1 -- 172.21.15.47:0/2167247553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e80095f0 con 0x7f58f8101310 2024-09-13T22:47:59.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.610+0000 7f58f6ffd700 1 --2- 172.21.15.47:0/2167247553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8101310 0x7f58f8100c70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f58e8005b40 tx=0x7f58e8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.610+0000 7f58dffff700 1 -- 172.21.15.47:0/2167247553 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58e801d070 con 0x7f58f8101310 2024-09-13T22:47:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.610+0000 7f58dffff700 1 -- 172.21.15.47:0/2167247553 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f58e800be10 con 0x7f58f8101310 2024-09-13T22:47:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.610+0000 7f58fd313700 1 -- 172.21.15.47:0/2167247553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f80ff2c0 con 0x7f58f8101310 2024-09-13T22:47:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.610+0000 7f58dffff700 1 -- 172.21.15.47:0/2167247553 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58e800f460 con 0x7f58f8101310 2024-09-13T22:47:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.610+0000 7f58fd313700 1 -- 172.21.15.47:0/2167247553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f80ff760 con 0x7f58f8101310 2024-09-13T22:47:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.611+0000 7f58dffff700 1 -- 172.21.15.47:0/2167247553 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45338+0+0 (secure 0 0 0) 0x7f58e80227e0 con 0x7f58f8101310 2024-09-13T22:47:59.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.611+0000 7f58fd313700 1 -- 172.21.15.47:0/2167247553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f80623c0 con 0x7f58f8101310 2024-09-13T22:47:59.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.611+0000 7f58dffff700 1 --2- 172.21.15.47:0/2167247553 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f58e00383c0 0x7f58e003a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:47:59.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.611+0000 7f58dffff700 1 -- 172.21.15.47:0/2167247553 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f58e804c450 con 0x7f58f8101310 2024-09-13T22:47:59.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.611+0000 7f58f67fc700 1 --2- 172.21.15.47:0/2167247553 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f58e00383c0 0x7f58e003a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:47:59.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.612+0000 7f58f67fc700 1 --2- 172.21.15.47:0/2167247553 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f58e00383c0 0x7f58e003a880 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f58ec006fd0 tx=0x7f58ec006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:47:59.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.618+0000 7f58dffff700 1 -- 172.21.15.47:0/2167247553 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f58e802bba0 con 0x7f58f8101310 2024-09-13T22:47:59.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.895+0000 7f58fd313700 1 -- 172.21.15.47:0/2167247553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f58f818ee80 con 0x7f58f8101310 2024-09-13T22:47:59.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.896+0000 7f58dffff700 1 -- 172.21.15.47:0/2167247553 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7f58e8027020 con 0x7f58f8101310 2024-09-13T22:47:59.897 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:47:59.897 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":1,"fsid":"e41042f8-7221-11ef-bceb-c7b262605968","modified":"2024-09-13T22:46:07.590380Z","created":"2024-09-13T22:46:07.590380Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:47:59.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.898+0000 7f58fd313700 1 -- 172.21.15.47:0/2167247553 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f58e00383c0 msgr2=0x7f58e003a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:59.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.898+0000 7f58fd313700 1 --2- 172.21.15.47:0/2167247553 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f58e00383c0 0x7f58e003a880 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f58ec006fd0 tx=0x7f58ec006e40 comp rx=0 tx=0).stop 2024-09-13T22:47:59.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.898+0000 7f58fd313700 1 -- 172.21.15.47:0/2167247553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8101310 msgr2=0x7f58f8100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:47:59.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.898+0000 7f58fd313700 1 --2- 172.21.15.47:0/2167247553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8101310 0x7f58f8100c70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f58e8005b40 tx=0x7f58e8004740 comp rx=0 tx=0).stop 2024-09-13T22:47:59.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.898+0000 7f58fd313700 1 -- 172.21.15.47:0/2167247553 shutdown_connections 2024-09-13T22:47:59.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.898+0000 7f58fd313700 1 --2- 172.21.15.47:0/2167247553 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f58e00383c0 0x7f58e003a880 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:59.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.898+0000 7f58fd313700 1 --2- 172.21.15.47:0/2167247553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58f8101310 0x7f58f8100c70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:47:59.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.898+0000 7f58fd313700 1 -- 172.21.15.47:0/2167247553 >> 172.21.15.47:0/2167247553 conn(0x7f58f80fad20 msgr2=0x7f58f80fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:47:59.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.898+0000 7f58fd313700 1 -- 172.21.15.47:0/2167247553 shutdown_connections 2024-09-13T22:47:59.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:47:59.898+0000 7f58fd313700 1 -- 172.21.15.47:0/2167247553 wait complete. 2024-09-13T22:47:59.900 INFO:teuthology.orchestra.run.smithi047.stderr:dumped monmap epoch 1 2024-09-13T22:48:00.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:59 smithi002 ceph-mon[27637]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:00.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:47:59 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/2167247553' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:01.454 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:48:01.454 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:48:01.665 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:48:01.710 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:48:02.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:01 smithi002 ceph-mon[27637]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:02.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:01 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.193+0000 7fcc93fa5700 1 -- 172.21.15.47:0/4006716338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc8c0ff780 msgr2=0x7fcc8c0ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.193+0000 7fcc93fa5700 1 --2- 172.21.15.47:0/4006716338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc8c0ff780 0x7fcc8c0ffba0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcc88009910 tx=0x7fcc88009c20 comp rx=0 tx=0).stop 2024-09-13T22:48:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.193+0000 7fcc93fa5700 1 -- 172.21.15.47:0/4006716338 shutdown_connections 2024-09-13T22:48:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.193+0000 7fcc93fa5700 1 --2- 172.21.15.47:0/4006716338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc8c0ff780 0x7fcc8c0ffba0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.193+0000 7fcc93fa5700 1 -- 172.21.15.47:0/4006716338 >> 172.21.15.47:0/4006716338 conn(0x7fcc8c0fad20 msgr2=0x7fcc8c0fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.193+0000 7fcc93fa5700 1 -- 172.21.15.47:0/4006716338 shutdown_connections 2024-09-13T22:48:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.193+0000 7fcc93fa5700 1 -- 172.21.15.47:0/4006716338 wait complete. 2024-09-13T22:48:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.193+0000 7fcc93fa5700 1 Processor -- start 2024-09-13T22:48:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.194+0000 7fcc93fa5700 1 -- start start 2024-09-13T22:48:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.194+0000 7fcc93fa5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc8c0ff780 0x7fcc8c1959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.194+0000 7fcc93fa5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c195ee0 con 0x7fcc8c0ff780 2024-09-13T22:48:03.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.194+0000 7fcc91d41700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc8c0ff780 0x7fcc8c1959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:03.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.194+0000 7fcc91d41700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc8c0ff780 0x7fcc8c1959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.47:60036/0 (socket says 172.21.15.47:60036) 2024-09-13T22:48:03.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.194+0000 7fcc91d41700 1 -- 172.21.15.47:0/1017372692 learned_addr learned my addr 172.21.15.47:0/1017372692 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:48:03.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.194+0000 7fcc91d41700 1 -- 172.21.15.47:0/1017372692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc880095f0 con 0x7fcc8c0ff780 2024-09-13T22:48:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.194+0000 7fcc91d41700 1 --2- 172.21.15.47:0/1017372692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc8c0ff780 0x7fcc8c1959a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcc88005b40 tx=0x7fcc88004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.195+0000 7fcc82ffd700 1 -- 172.21.15.47:0/1017372692 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc8801d070 con 0x7fcc8c0ff780 2024-09-13T22:48:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.195+0000 7fcc82ffd700 1 -- 172.21.15.47:0/1017372692 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcc8800be10 con 0x7fcc8c0ff780 2024-09-13T22:48:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.195+0000 7fcc82ffd700 1 -- 172.21.15.47:0/1017372692 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc8800f460 con 0x7fcc8c0ff780 2024-09-13T22:48:03.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.195+0000 7fcc93fa5700 1 -- 172.21.15.47:0/1017372692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8c1960e0 con 0x7fcc8c0ff780 2024-09-13T22:48:03.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.195+0000 7fcc93fa5700 1 -- 172.21.15.47:0/1017372692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8c196580 con 0x7fcc8c0ff780 2024-09-13T22:48:03.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.196+0000 7fcc93fa5700 1 -- 172.21.15.47:0/1017372692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8c18f3b0 con 0x7fcc8c0ff780 2024-09-13T22:48:03.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.196+0000 7fcc82ffd700 1 -- 172.21.15.47:0/1017372692 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45338+0+0 (secure 0 0 0) 0x7fcc880227e0 con 0x7fcc8c0ff780 2024-09-13T22:48:03.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.196+0000 7fcc82ffd700 1 --2- 172.21.15.47:0/1017372692 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fcc78038410 0x7fcc7803a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:03.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.196+0000 7fcc82ffd700 1 -- 172.21.15.47:0/1017372692 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fcc8804c300 con 0x7fcc8c0ff780 2024-09-13T22:48:03.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.196+0000 7fcc91540700 1 --2- 172.21.15.47:0/1017372692 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fcc78038410 0x7fcc7803a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:03.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.197+0000 7fcc91540700 1 --2- 172.21.15.47:0/1017372692 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fcc78038410 0x7fcc7803a8d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c006fd0 tx=0x7fcc7c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:03.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.202+0000 7fcc82ffd700 1 -- 172.21.15.47:0/1017372692 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fcc8802ba00 con 0x7fcc8c0ff780 2024-09-13T22:48:03.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.482+0000 7fcc93fa5700 1 -- 172.21.15.47:0/1017372692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcc8c02cc70 con 0x7fcc8c0ff780 2024-09-13T22:48:03.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.482+0000 7fcc82ffd700 1 -- 172.21.15.47:0/1017372692 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7fcc88027020 con 0x7fcc8c0ff780 2024-09-13T22:48:03.483 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:48:03.483 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":1,"fsid":"e41042f8-7221-11ef-bceb-c7b262605968","modified":"2024-09-13T22:46:07.590380Z","created":"2024-09-13T22:46:07.590380Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:48:03.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.484+0000 7fcc93fa5700 1 -- 172.21.15.47:0/1017372692 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fcc78038410 msgr2=0x7fcc7803a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:03.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.484+0000 7fcc93fa5700 1 --2- 172.21.15.47:0/1017372692 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fcc78038410 0x7fcc7803a8d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c006fd0 tx=0x7fcc7c006e40 comp rx=0 tx=0).stop 2024-09-13T22:48:03.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.484+0000 7fcc93fa5700 1 -- 172.21.15.47:0/1017372692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc8c0ff780 msgr2=0x7fcc8c1959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:03.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.484+0000 7fcc93fa5700 1 --2- 172.21.15.47:0/1017372692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc8c0ff780 0x7fcc8c1959a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcc88005b40 tx=0x7fcc88004740 comp rx=0 tx=0).stop 2024-09-13T22:48:03.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.484+0000 7fcc93fa5700 1 -- 172.21.15.47:0/1017372692 shutdown_connections 2024-09-13T22:48:03.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.484+0000 7fcc93fa5700 1 --2- 172.21.15.47:0/1017372692 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fcc78038410 0x7fcc7803a8d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:03.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.484+0000 7fcc93fa5700 1 --2- 172.21.15.47:0/1017372692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc8c0ff780 0x7fcc8c1959a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:03.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.484+0000 7fcc93fa5700 1 -- 172.21.15.47:0/1017372692 >> 172.21.15.47:0/1017372692 conn(0x7fcc8c0fad20 msgr2=0x7fcc8c068820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:03.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.484+0000 7fcc93fa5700 1 -- 172.21.15.47:0/1017372692 shutdown_connections 2024-09-13T22:48:03.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:03.484+0000 7fcc93fa5700 1 -- 172.21.15.47:0/1017372692 wait complete. 2024-09-13T22:48:03.486 INFO:teuthology.orchestra.run.smithi047.stderr:dumped monmap epoch 1 2024-09-13T22:48:04.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:03 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/1017372692' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:04.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:03 smithi002 ceph-mon[27637]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:05.061 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:48:05.062 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:48:05.267 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:48:05.312 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:48:05.901 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:05 smithi002 ceph-mon[27637]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:06.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.895+0000 7f7bd306e700 1 -- 172.21.15.47:0/659475668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bcc0ff780 msgr2=0x7f7bcc0ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:06.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.895+0000 7f7bd306e700 1 --2- 172.21.15.47:0/659475668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bcc0ff780 0x7f7bcc0ffba0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009910 tx=0x7f7bbc009c20 comp rx=0 tx=0).stop 2024-09-13T22:48:06.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.896+0000 7f7bd306e700 1 -- 172.21.15.47:0/659475668 shutdown_connections 2024-09-13T22:48:06.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.896+0000 7f7bd306e700 1 --2- 172.21.15.47:0/659475668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bcc0ff780 0x7f7bcc0ffba0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:06.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.896+0000 7f7bd306e700 1 -- 172.21.15.47:0/659475668 >> 172.21.15.47:0/659475668 conn(0x7f7bcc0fad20 msgr2=0x7f7bcc0fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:06.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.896+0000 7f7bd306e700 1 -- 172.21.15.47:0/659475668 shutdown_connections 2024-09-13T22:48:06.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.896+0000 7f7bd306e700 1 -- 172.21.15.47:0/659475668 wait complete. 2024-09-13T22:48:06.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.896+0000 7f7bd306e700 1 Processor -- start 2024-09-13T22:48:06.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.896+0000 7f7bd306e700 1 -- start start 2024-09-13T22:48:06.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.896+0000 7f7bd306e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bcc0ff780 0x7f7bcc1959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:06.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.896+0000 7f7bd306e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc195ef0 con 0x7f7bcc0ff780 2024-09-13T22:48:06.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.897+0000 7f7bd0e0a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bcc0ff780 0x7f7bcc1959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:06.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.897+0000 7f7bd0e0a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bcc0ff780 0x7f7bcc1959b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.47:60058/0 (socket says 172.21.15.47:60058) 2024-09-13T22:48:06.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.897+0000 7f7bd0e0a700 1 -- 172.21.15.47:0/3910349009 learned_addr learned my addr 172.21.15.47:0/3910349009 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:48:06.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.897+0000 7f7bd0e0a700 1 -- 172.21.15.47:0/3910349009 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bbc0095f0 con 0x7f7bcc0ff780 2024-09-13T22:48:06.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.897+0000 7f7bd0e0a700 1 --2- 172.21.15.47:0/3910349009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bcc0ff780 0x7f7bcc1959b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc005b40 tx=0x7f7bbc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:06.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.897+0000 7f7bc9ffb700 1 -- 172.21.15.47:0/3910349009 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bbc01d070 con 0x7f7bcc0ff780 2024-09-13T22:48:06.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.897+0000 7f7bd306e700 1 -- 172.21.15.47:0/3910349009 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bcc1960f0 con 0x7f7bcc0ff780 2024-09-13T22:48:06.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.897+0000 7f7bc9ffb700 1 -- 172.21.15.47:0/3910349009 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7bbc00be10 con 0x7f7bcc0ff780 2024-09-13T22:48:06.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.897+0000 7f7bc9ffb700 1 -- 172.21.15.47:0/3910349009 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7bbc00f460 con 0x7f7bcc0ff780 2024-09-13T22:48:06.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.898+0000 7f7bd306e700 1 -- 172.21.15.47:0/3910349009 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bcc196590 con 0x7f7bcc0ff780 2024-09-13T22:48:06.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.898+0000 7f7bc9ffb700 1 -- 172.21.15.47:0/3910349009 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45338+0+0 (secure 0 0 0) 0x7f7bbc00f6d0 con 0x7f7bcc0ff780 2024-09-13T22:48:06.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.899+0000 7f7bc9ffb700 1 --2- 172.21.15.47:0/3910349009 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f7bb80383c0 0x7f7bb803a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:06.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.899+0000 7f7bc9ffb700 1 -- 172.21.15.47:0/3910349009 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f7bbc04c390 con 0x7f7bcc0ff780 2024-09-13T22:48:06.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.899+0000 7f7bd306e700 1 -- 172.21.15.47:0/3910349009 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bcc1055c0 con 0x7f7bcc0ff780 2024-09-13T22:48:06.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.899+0000 7f7bcbfff700 1 --2- 172.21.15.47:0/3910349009 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f7bb80383c0 0x7f7bb803a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:06.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.900+0000 7f7bcbfff700 1 --2- 172.21.15.47:0/3910349009 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f7bb80383c0 0x7f7bb803a880 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4006fd0 tx=0x7f7bb4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:06.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:06.904+0000 7f7bc9ffb700 1 -- 172.21.15.47:0/3910349009 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7bbc027070 con 0x7f7bcc0ff780 2024-09-13T22:48:07.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:07.183+0000 7f7bd306e700 1 -- 172.21.15.47:0/3910349009 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7bcc105780 con 0x7f7bcc0ff780 2024-09-13T22:48:07.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:07.184+0000 7f7bc9ffb700 1 -- 172.21.15.47:0/3910349009 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7f7bcc105780 con 0x7f7bcc0ff780 2024-09-13T22:48:07.185 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:48:07.185 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":1,"fsid":"e41042f8-7221-11ef-bceb-c7b262605968","modified":"2024-09-13T22:46:07.590380Z","created":"2024-09-13T22:46:07.590380Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:48:07.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:07.186+0000 7f7bd306e700 1 -- 172.21.15.47:0/3910349009 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f7bb80383c0 msgr2=0x7f7bb803a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:07.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:07.186+0000 7f7bd306e700 1 --2- 172.21.15.47:0/3910349009 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f7bb80383c0 0x7f7bb803a880 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4006fd0 tx=0x7f7bb4006e40 comp rx=0 tx=0).stop 2024-09-13T22:48:07.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:07.186+0000 7f7bd306e700 1 -- 172.21.15.47:0/3910349009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bcc0ff780 msgr2=0x7f7bcc1959b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:07.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:07.186+0000 7f7bd306e700 1 --2- 172.21.15.47:0/3910349009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bcc0ff780 0x7f7bcc1959b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc005b40 tx=0x7f7bbc004740 comp rx=0 tx=0).stop 2024-09-13T22:48:07.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:07.186+0000 7f7bd306e700 1 -- 172.21.15.47:0/3910349009 shutdown_connections 2024-09-13T22:48:07.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:07.186+0000 7f7bd306e700 1 --2- 172.21.15.47:0/3910349009 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f7bb80383c0 0x7f7bb803a880 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:07.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:07.186+0000 7f7bd306e700 1 --2- 172.21.15.47:0/3910349009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bcc0ff780 0x7f7bcc1959b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:07.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:07.186+0000 7f7bd306e700 1 -- 172.21.15.47:0/3910349009 >> 172.21.15.47:0/3910349009 conn(0x7f7bcc0fad20 msgr2=0x7f7bcc0fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:07.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:07.186+0000 7f7bd306e700 1 -- 172.21.15.47:0/3910349009 shutdown_connections 2024-09-13T22:48:07.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:07.186+0000 7f7bd306e700 1 -- 172.21.15.47:0/3910349009 wait complete. 2024-09-13T22:48:07.188 INFO:teuthology.orchestra.run.smithi047.stderr:dumped monmap epoch 1 2024-09-13T22:48:07.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:07 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/3910349009' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:08.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:08 smithi002 ceph-mon[27637]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:08.754 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:48:08.755 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:48:08.958 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:48:09.004 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:48:10.321 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:10 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:10.321 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:10 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:10.321 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:10 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:10.321 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:10 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-13T22:48:10.321 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:10 smithi002 ceph-mon[27637]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:10.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.504+0000 7f18fdf8e700 1 -- 172.21.15.47:0/3799239188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f80ff780 msgr2=0x7f18f80ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:10.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.504+0000 7f18fdf8e700 1 --2- 172.21.15.47:0/3799239188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f80ff780 0x7f18f80ffba0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f18e8009910 tx=0x7f18e8009c20 comp rx=0 tx=0).stop 2024-09-13T22:48:10.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.504+0000 7f18fdf8e700 1 -- 172.21.15.47:0/3799239188 shutdown_connections 2024-09-13T22:48:10.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.504+0000 7f18fdf8e700 1 --2- 172.21.15.47:0/3799239188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f80ff780 0x7f18f80ffba0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:10.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.504+0000 7f18fdf8e700 1 -- 172.21.15.47:0/3799239188 >> 172.21.15.47:0/3799239188 conn(0x7f18f80fad20 msgr2=0x7f18f80fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:10.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.504+0000 7f18fdf8e700 1 -- 172.21.15.47:0/3799239188 shutdown_connections 2024-09-13T22:48:10.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.504+0000 7f18fdf8e700 1 -- 172.21.15.47:0/3799239188 wait complete. 2024-09-13T22:48:10.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.504+0000 7f18fdf8e700 1 Processor -- start 2024-09-13T22:48:10.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.505+0000 7f18fdf8e700 1 -- start start 2024-09-13T22:48:10.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.505+0000 7f18fdf8e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f80ff780 0x7f18f8195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:10.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.505+0000 7f18fdf8e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f8195e50 con 0x7f18f80ff780 2024-09-13T22:48:10.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.505+0000 7f18f77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f80ff780 0x7f18f8195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:10.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.505+0000 7f18f77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f80ff780 0x7f18f8195910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.47:60068/0 (socket says 172.21.15.47:60068) 2024-09-13T22:48:10.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.505+0000 7f18f77fe700 1 -- 172.21.15.47:0/978177008 learned_addr learned my addr 172.21.15.47:0/978177008 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:48:10.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.505+0000 7f18f77fe700 1 -- 172.21.15.47:0/978177008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e80095f0 con 0x7f18f80ff780 2024-09-13T22:48:10.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.506+0000 7f18f77fe700 1 --2- 172.21.15.47:0/978177008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f80ff780 0x7f18f8195910 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f18e8005b40 tx=0x7f18e8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:10.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.506+0000 7f18f4ff9700 1 -- 172.21.15.47:0/978177008 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f18e801d070 con 0x7f18f80ff780 2024-09-13T22:48:10.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.506+0000 7f18fdf8e700 1 -- 172.21.15.47:0/978177008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f8196050 con 0x7f18f80ff780 2024-09-13T22:48:10.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.506+0000 7f18f4ff9700 1 -- 172.21.15.47:0/978177008 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f18e800be10 con 0x7f18f80ff780 2024-09-13T22:48:10.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.506+0000 7f18f4ff9700 1 -- 172.21.15.47:0/978177008 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f18e800f460 con 0x7f18f80ff780 2024-09-13T22:48:10.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.506+0000 7f18fdf8e700 1 -- 172.21.15.47:0/978177008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f81964f0 con 0x7f18f80ff780 2024-09-13T22:48:10.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.507+0000 7f18fdf8e700 1 -- 172.21.15.47:0/978177008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f818f3b0 con 0x7f18f80ff780 2024-09-13T22:48:10.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.507+0000 7f18f4ff9700 1 -- 172.21.15.47:0/978177008 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) v1 ==== 45352+0+0 (secure 0 0 0) 0x7f18e80227e0 con 0x7f18f80ff780 2024-09-13T22:48:10.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.507+0000 7f18f4ff9700 1 --2- 172.21.15.47:0/978177008 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f18e0038410 0x7f18e003a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:10.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.507+0000 7f18f4ff9700 1 -- 172.21.15.47:0/978177008 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f18e804c3b0 con 0x7f18f80ff780 2024-09-13T22:48:10.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.507+0000 7f18f6ffd700 1 -- 172.21.15.47:0/978177008 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f18e0038410 msgr2=0x7f18e003a8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2 2024-09-13T22:48:10.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.507+0000 7f18f6ffd700 1 --2- 172.21.15.47:0/978177008 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f18e0038410 0x7f18e003a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T22:48:10.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.516+0000 7f18f4ff9700 1 -- 172.21.15.47:0/978177008 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f18e802bba0 con 0x7f18f80ff780 2024-09-13T22:48:10.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.708+0000 7f18f6ffd700 1 -- 172.21.15.47:0/978177008 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f18e0038410 msgr2=0x7f18e003a8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2 2024-09-13T22:48:10.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.708+0000 7f18f6ffd700 1 --2- 172.21.15.47:0/978177008 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f18e0038410 0x7f18e003a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T22:48:10.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.795+0000 7f18fdf8e700 1 -- 172.21.15.47:0/978177008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f18f802cc70 con 0x7f18f80ff780 2024-09-13T22:48:10.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.795+0000 7f18f4ff9700 1 -- 172.21.15.47:0/978177008 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7f18e8027030 con 0x7f18f80ff780 2024-09-13T22:48:10.797 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:48:10.797 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":1,"fsid":"e41042f8-7221-11ef-bceb-c7b262605968","modified":"2024-09-13T22:46:07.590380Z","created":"2024-09-13T22:46:07.590380Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:48:10.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.797+0000 7f18fdf8e700 1 -- 172.21.15.47:0/978177008 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f18e0038410 msgr2=0x7f18e003a8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T22:48:10.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.797+0000 7f18fdf8e700 1 --2- 172.21.15.47:0/978177008 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f18e0038410 0x7f18e003a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:10.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.797+0000 7f18fdf8e700 1 -- 172.21.15.47:0/978177008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f80ff780 msgr2=0x7f18f8195910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:10.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.797+0000 7f18fdf8e700 1 --2- 172.21.15.47:0/978177008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f80ff780 0x7f18f8195910 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f18e8005b40 tx=0x7f18e8004740 comp rx=0 tx=0).stop 2024-09-13T22:48:10.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.797+0000 7f18fdf8e700 1 -- 172.21.15.47:0/978177008 shutdown_connections 2024-09-13T22:48:10.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.797+0000 7f18fdf8e700 1 --2- 172.21.15.47:0/978177008 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f18e0038410 0x7f18e003a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:10.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.797+0000 7f18fdf8e700 1 --2- 172.21.15.47:0/978177008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18f80ff780 0x7f18f8195910 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:10.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.798+0000 7f18fdf8e700 1 -- 172.21.15.47:0/978177008 >> 172.21.15.47:0/978177008 conn(0x7f18f80fad20 msgr2=0x7f18f80690f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:10.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.798+0000 7f18fdf8e700 1 -- 172.21.15.47:0/978177008 shutdown_connections 2024-09-13T22:48:10.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:10.798+0000 7f18fdf8e700 1 -- 172.21.15.47:0/978177008 wait complete. 2024-09-13T22:48:10.800 INFO:teuthology.orchestra.run.smithi047.stderr:dumped monmap epoch 1 2024-09-13T22:48:11.429 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:11 smithi002 ceph-mon[27637]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-13T22:48:11.429 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:11 smithi002 ceph-mon[27637]: mgrmap e14: smithi002.yumtzz(active, since 58s) 2024-09-13T22:48:11.429 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:11 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/978177008' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:12.520 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:48:12.520 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:48:12.724 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:48:12.768 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:48:14.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.309+0000 7fe6be7ee700 1 -- 172.21.15.47:0/2817439927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b80ff780 msgr2=0x7fe6b80ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:14.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.309+0000 7fe6be7ee700 1 --2- 172.21.15.47:0/2817439927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b80ff780 0x7fe6b80ffba0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009910 tx=0x7fe6a8009c20 comp rx=0 tx=0).stop 2024-09-13T22:48:14.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.309+0000 7fe6be7ee700 1 -- 172.21.15.47:0/2817439927 shutdown_connections 2024-09-13T22:48:14.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.309+0000 7fe6be7ee700 1 --2- 172.21.15.47:0/2817439927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b80ff780 0x7fe6b80ffba0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:14.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.309+0000 7fe6be7ee700 1 -- 172.21.15.47:0/2817439927 >> 172.21.15.47:0/2817439927 conn(0x7fe6b80fad20 msgr2=0x7fe6b80fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:14.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.309+0000 7fe6be7ee700 1 -- 172.21.15.47:0/2817439927 shutdown_connections 2024-09-13T22:48:14.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.309+0000 7fe6be7ee700 1 -- 172.21.15.47:0/2817439927 wait complete. 2024-09-13T22:48:14.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.309+0000 7fe6be7ee700 1 Processor -- start 2024-09-13T22:48:14.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.309+0000 7fe6be7ee700 1 -- start start 2024-09-13T22:48:14.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.310+0000 7fe6be7ee700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b80ff780 0x7fe6b8195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:14.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.310+0000 7fe6be7ee700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b8195ec0 con 0x7fe6b80ff780 2024-09-13T22:48:14.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.310+0000 7fe6b7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b80ff780 0x7fe6b8195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:14.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.310+0000 7fe6b7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b80ff780 0x7fe6b8195980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.47:50728/0 (socket says 172.21.15.47:50728) 2024-09-13T22:48:14.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.310+0000 7fe6b7fff700 1 -- 172.21.15.47:0/1294156648 learned_addr learned my addr 172.21.15.47:0/1294156648 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:48:14.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.310+0000 7fe6b7fff700 1 -- 172.21.15.47:0/1294156648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a80095f0 con 0x7fe6b80ff780 2024-09-13T22:48:14.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.310+0000 7fe6b7fff700 1 --2- 172.21.15.47:0/1294156648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b80ff780 0x7fe6b8195980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8005b40 tx=0x7fe6a8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:14.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.311+0000 7fe6b5ffb700 1 -- 172.21.15.47:0/1294156648 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6a801d070 con 0x7fe6b80ff780 2024-09-13T22:48:14.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.311+0000 7fe6b5ffb700 1 -- 172.21.15.47:0/1294156648 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe6a800be10 con 0x7fe6b80ff780 2024-09-13T22:48:14.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.311+0000 7fe6be7ee700 1 -- 172.21.15.47:0/1294156648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b81960c0 con 0x7fe6b80ff780 2024-09-13T22:48:14.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.311+0000 7fe6b5ffb700 1 -- 172.21.15.47:0/1294156648 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6a800f460 con 0x7fe6b80ff780 2024-09-13T22:48:14.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.311+0000 7fe6be7ee700 1 -- 172.21.15.47:0/1294156648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b8196560 con 0x7fe6b80ff780 2024-09-13T22:48:14.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.312+0000 7fe6b5ffb700 1 -- 172.21.15.47:0/1294156648 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) v1 ==== 45352+0+0 (secure 0 0 0) 0x7fe6a800b960 con 0x7fe6b80ff780 2024-09-13T22:48:14.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.312+0000 7fe6be7ee700 1 -- 172.21.15.47:0/1294156648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b818f3b0 con 0x7fe6b80ff780 2024-09-13T22:48:14.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.312+0000 7fe6b5ffb700 1 --2- 172.21.15.47:0/1294156648 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe6a4038460 0x7fe6a403a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:14.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.312+0000 7fe6b5ffb700 1 -- 172.21.15.47:0/1294156648 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fe6a804c3b0 con 0x7fe6b80ff780 2024-09-13T22:48:14.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.312+0000 7fe6affff700 1 -- 172.21.15.47:0/1294156648 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe6a4038460 msgr2=0x7fe6a403a920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2 2024-09-13T22:48:14.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.312+0000 7fe6affff700 1 --2- 172.21.15.47:0/1294156648 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe6a4038460 0x7fe6a403a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T22:48:14.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.317+0000 7fe6b5ffb700 1 -- 172.21.15.47:0/1294156648 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe6a802bb60 con 0x7fe6b80ff780 2024-09-13T22:48:14.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.513+0000 7fe6affff700 1 -- 172.21.15.47:0/1294156648 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe6a4038460 msgr2=0x7fe6a403a920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2 2024-09-13T22:48:14.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.513+0000 7fe6affff700 1 --2- 172.21.15.47:0/1294156648 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe6a4038460 0x7fe6a403a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T22:48:14.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.595+0000 7fe6be7ee700 1 -- 172.21.15.47:0/1294156648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe6b802cc70 con 0x7fe6b80ff780 2024-09-13T22:48:14.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.596+0000 7fe6b5ffb700 1 -- 172.21.15.47:0/1294156648 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7fe6a8027030 con 0x7fe6b80ff780 2024-09-13T22:48:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:48:14.598 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":1,"fsid":"e41042f8-7221-11ef-bceb-c7b262605968","modified":"2024-09-13T22:46:07.590380Z","created":"2024-09-13T22:46:07.590380Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:48:14.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.598+0000 7fe6be7ee700 1 -- 172.21.15.47:0/1294156648 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe6a4038460 msgr2=0x7fe6a403a920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T22:48:14.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.598+0000 7fe6be7ee700 1 --2- 172.21.15.47:0/1294156648 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe6a4038460 0x7fe6a403a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:14.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.598+0000 7fe6be7ee700 1 -- 172.21.15.47:0/1294156648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b80ff780 msgr2=0x7fe6b8195980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:14.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.598+0000 7fe6be7ee700 1 --2- 172.21.15.47:0/1294156648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b80ff780 0x7fe6b8195980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8005b40 tx=0x7fe6a8004740 comp rx=0 tx=0).stop 2024-09-13T22:48:14.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.598+0000 7fe6be7ee700 1 -- 172.21.15.47:0/1294156648 shutdown_connections 2024-09-13T22:48:14.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.598+0000 7fe6be7ee700 1 --2- 172.21.15.47:0/1294156648 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe6a4038460 0x7fe6a403a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:14.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.598+0000 7fe6be7ee700 1 --2- 172.21.15.47:0/1294156648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe6b80ff780 0x7fe6b8195980 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:14.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.598+0000 7fe6be7ee700 1 -- 172.21.15.47:0/1294156648 >> 172.21.15.47:0/1294156648 conn(0x7fe6b80fad20 msgr2=0x7fe6b80690f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:14.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.598+0000 7fe6be7ee700 1 -- 172.21.15.47:0/1294156648 shutdown_connections 2024-09-13T22:48:14.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:14.598+0000 7fe6be7ee700 1 -- 172.21.15.47:0/1294156648 wait complete. 2024-09-13T22:48:14.601 INFO:teuthology.orchestra.run.smithi047.stderr:dumped monmap epoch 1 2024-09-13T22:48:14.879 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:14 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/1294156648' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:16.187 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:48:16.187 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:48:16.390 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:48:16.435 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:48:17.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:17 smithi002 ceph-mon[27637]: Active manager daemon smithi002.yumtzz restarted 2024-09-13T22:48:17.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:17 smithi002 ceph-mon[27637]: Activating manager daemon smithi002.yumtzz 2024-09-13T22:48:17.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:17 smithi002 ceph-mon[27637]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T22:48:17.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:17 smithi002 ceph-mon[27637]: mgrmap e15: smithi002.yumtzz(active, starting, since 0.00325983s) 2024-09-13T22:48:17.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:17 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T22:48:17.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:17 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr metadata", "who": "smithi002.yumtzz", "id": "smithi002.yumtzz"}]: dispatch 2024-09-13T22:48:17.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:17 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:48:17.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:17 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:48:17.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:17 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:48:17.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:17 smithi002 ceph-mon[27637]: Manager daemon smithi002.yumtzz is now available 2024-09-13T22:48:17.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:17 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:48:17.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:17 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:48:17.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:17 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:17.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:17 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:48:18.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.962+0000 7f31b3e5b700 1 -- 172.21.15.47:0/1907066756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac1008a0 msgr2=0x7f31ac100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.962+0000 7f31b3e5b700 1 --2- 172.21.15.47:0/1907066756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac1008a0 0x7f31ac100cc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f31a8009910 tx=0x7f31a8009c20 comp rx=0 tx=0).stop 2024-09-13T22:48:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.962+0000 7f31b3e5b700 1 -- 172.21.15.47:0/1907066756 shutdown_connections 2024-09-13T22:48:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.962+0000 7f31b3e5b700 1 --2- 172.21.15.47:0/1907066756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac1008a0 0x7f31ac100cc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.962+0000 7f31b3e5b700 1 -- 172.21.15.47:0/1907066756 >> 172.21.15.47:0/1907066756 conn(0x7f31ac0fbe20 msgr2=0x7f31ac0fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.962+0000 7f31b3e5b700 1 -- 172.21.15.47:0/1907066756 shutdown_connections 2024-09-13T22:48:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.962+0000 7f31b3e5b700 1 -- 172.21.15.47:0/1907066756 wait complete. 2024-09-13T22:48:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.963+0000 7f31b3e5b700 1 Processor -- start 2024-09-13T22:48:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.963+0000 7f31b3e5b700 1 -- start start 2024-09-13T22:48:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.963+0000 7f31b3e5b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac1008a0 0x7f31ac1959f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.963+0000 7f31b3e5b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac195f30 con 0x7f31ac1008a0 2024-09-13T22:48:18.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.963+0000 7f31b1bf7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac1008a0 0x7f31ac1959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:18.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.964+0000 7f31b1bf7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac1008a0 0x7f31ac1959f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.47:50744/0 (socket says 172.21.15.47:50744) 2024-09-13T22:48:18.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.964+0000 7f31b1bf7700 1 -- 172.21.15.47:0/174343217 learned_addr learned my addr 172.21.15.47:0/174343217 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:48:18.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.964+0000 7f31b1bf7700 1 -- 172.21.15.47:0/174343217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a80095f0 con 0x7f31ac1008a0 2024-09-13T22:48:18.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.964+0000 7f31b1bf7700 1 --2- 172.21.15.47:0/174343217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac1008a0 0x7f31ac1959f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f31a8005b40 tx=0x7f31a8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:18.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.964+0000 7f31a2ffd700 1 -- 172.21.15.47:0/174343217 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31a801d070 con 0x7f31ac1008a0 2024-09-13T22:48:18.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.964+0000 7f31a2ffd700 1 -- 172.21.15.47:0/174343217 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f31a800be10 con 0x7f31ac1008a0 2024-09-13T22:48:18.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.964+0000 7f31b3e5b700 1 -- 172.21.15.47:0/174343217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ac196130 con 0x7f31ac1008a0 2024-09-13T22:48:18.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.964+0000 7f31a2ffd700 1 -- 172.21.15.47:0/174343217 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31a800f460 con 0x7f31ac1008a0 2024-09-13T22:48:18.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.964+0000 7f31b3e5b700 1 -- 172.21.15.47:0/174343217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ac1965d0 con 0x7f31ac1008a0 2024-09-13T22:48:18.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.965+0000 7f31a2ffd700 1 -- 172.21.15.47:0/174343217 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 15) v1 ==== 45077+0+0 (secure 0 0 0) 0x7f31a800f6d0 con 0x7f31ac1008a0 2024-09-13T22:48:18.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.965+0000 7f31b3e5b700 1 -- 172.21.15.47:0/174343217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ac18f4c0 con 0x7f31ac1008a0 2024-09-13T22:48:18.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.965+0000 7f31a2ffd700 1 -- 172.21.15.47:0/174343217 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f31a804c2f0 con 0x7f31ac1008a0 2024-09-13T22:48:18.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:17.970+0000 7f31a2ffd700 1 -- 172.21.15.47:0/174343217 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f31a802a950 con 0x7f31ac1008a0 2024-09-13T22:48:18.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:18.148+0000 7f31a2ffd700 1 -- 172.21.15.47:0/174343217 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 16) v1 ==== 45204+0+0 (secure 0 0 0) 0x7f31a80227e0 con 0x7f31ac1008a0 2024-09-13T22:48:18.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:18.148+0000 7f31a2ffd700 1 --2- 172.21.15.47:0/174343217 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f3198039300 0x7f319803b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:18.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:18.148+0000 7f31b13f6700 1 --2- 172.21.15.47:0/174343217 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f3198039300 0x7f319803b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:18.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:18.149+0000 7f31b13f6700 1 --2- 172.21.15.47:0/174343217 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f3198039300 0x7f319803b6f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f319c006fd0 tx=0x7f319c006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:18.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:18.257+0000 7f31b3e5b700 1 -- 172.21.15.47:0/174343217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f31ac02cc70 con 0x7f31ac1008a0 2024-09-13T22:48:18.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:18.257+0000 7f31a2ffd700 1 -- 172.21.15.47:0/174343217 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7f31a8027070 con 0x7f31ac1008a0 2024-09-13T22:48:18.259 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:48:18.259 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":1,"fsid":"e41042f8-7221-11ef-bceb-c7b262605968","modified":"2024-09-13T22:46:07.590380Z","created":"2024-09-13T22:46:07.590380Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:48:18.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:18.260+0000 7f31b3e5b700 1 -- 172.21.15.47:0/174343217 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f3198039300 msgr2=0x7f319803b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:18.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:18.260+0000 7f31b3e5b700 1 --2- 172.21.15.47:0/174343217 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f3198039300 0x7f319803b6f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f319c006fd0 tx=0x7f319c006e40 comp rx=0 tx=0).stop 2024-09-13T22:48:18.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:18.260+0000 7f31b3e5b700 1 -- 172.21.15.47:0/174343217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac1008a0 msgr2=0x7f31ac1959f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:18.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:18.260+0000 7f31b3e5b700 1 --2- 172.21.15.47:0/174343217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac1008a0 0x7f31ac1959f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f31a8005b40 tx=0x7f31a8004740 comp rx=0 tx=0).stop 2024-09-13T22:48:18.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:18.260+0000 7f31b3e5b700 1 -- 172.21.15.47:0/174343217 shutdown_connections 2024-09-13T22:48:18.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:18.260+0000 7f31b3e5b700 1 --2- 172.21.15.47:0/174343217 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f3198039300 0x7f319803b6f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:18.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:18.260+0000 7f31b3e5b700 1 --2- 172.21.15.47:0/174343217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31ac1008a0 0x7f31ac1959f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:18.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:18.260+0000 7f31b3e5b700 1 -- 172.21.15.47:0/174343217 >> 172.21.15.47:0/174343217 conn(0x7f31ac0fbe20 msgr2=0x7f31ac0fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:18.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:18.260+0000 7f31b3e5b700 1 -- 172.21.15.47:0/174343217 shutdown_connections 2024-09-13T22:48:18.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:18.261+0000 7f31b3e5b700 1 -- 172.21.15.47:0/174343217 wait complete. 2024-09-13T22:48:18.263 INFO:teuthology.orchestra.run.smithi047.stderr:dumped monmap epoch 1 2024-09-13T22:48:18.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:18 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.yumtzz/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:48:18.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:18 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.yumtzz/trash_purge_schedule"}]: dispatch 2024-09-13T22:48:18.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:18 smithi002 ceph-mon[27637]: [13/Sep/2024:22:48:17] ENGINE Bus STARTING 2024-09-13T22:48:18.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:18 smithi002 ceph-mon[27637]: [13/Sep/2024:22:48:17] ENGINE Serving on http://172.21.15.2:8765 2024-09-13T22:48:18.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:18 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:18.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:18 smithi002 ceph-mon[27637]: [13/Sep/2024:22:48:17] ENGINE Serving on https://172.21.15.2:7150 2024-09-13T22:48:18.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:18 smithi002 ceph-mon[27637]: [13/Sep/2024:22:48:17] ENGINE Bus STARTED 2024-09-13T22:48:18.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:18 smithi002 ceph-mon[27637]: mgrmap e16: smithi002.yumtzz(active, since 1.00564s) 2024-09-13T22:48:19.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:19 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/174343217' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:19.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:19 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:19.874 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:48:19.874 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:48:20.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:20 smithi002 ceph-mon[27637]: mgrmap e17: smithi002.yumtzz(active, since 2s) 2024-09-13T22:48:20.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:20 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:20.721 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:48:20.778 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T22:48:22.713 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:22 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:22.713 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:22 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:22.714 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:22 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:22.714 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:22 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:22.714 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:22 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:48:23.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.009+0000 7ff6983f9700 1 -- 172.21.15.47:0/781383562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6900ff780 msgr2=0x7ff6900ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:23.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.009+0000 7ff6983f9700 1 --2- 172.21.15.47:0/781383562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6900ff780 0x7ff6900ffba0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009910 tx=0x7ff68c009c20 comp rx=0 tx=0).stop 2024-09-13T22:48:23.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.009+0000 7ff6983f9700 1 -- 172.21.15.47:0/781383562 shutdown_connections 2024-09-13T22:48:23.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.009+0000 7ff6983f9700 1 --2- 172.21.15.47:0/781383562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6900ff780 0x7ff6900ffba0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:23.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.009+0000 7ff6983f9700 1 -- 172.21.15.47:0/781383562 >> 172.21.15.47:0/781383562 conn(0x7ff6900fad00 msgr2=0x7ff6900fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:23.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.009+0000 7ff6983f9700 1 -- 172.21.15.47:0/781383562 shutdown_connections 2024-09-13T22:48:23.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.009+0000 7ff6983f9700 1 -- 172.21.15.47:0/781383562 wait complete. 2024-09-13T22:48:23.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.010+0000 7ff6983f9700 1 Processor -- start 2024-09-13T22:48:23.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.010+0000 7ff6983f9700 1 -- start start 2024-09-13T22:48:23.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.010+0000 7ff6983f9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6900ff780 0x7ff690197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:23.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.010+0000 7ff6983f9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff690198110 con 0x7ff6900ff780 2024-09-13T22:48:23.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.010+0000 7ff696195700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6900ff780 0x7ff690197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:23.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.010+0000 7ff696195700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6900ff780 0x7ff690197bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.47:43370/0 (socket says 172.21.15.47:43370) 2024-09-13T22:48:23.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.010+0000 7ff696195700 1 -- 172.21.15.47:0/3479967134 learned_addr learned my addr 172.21.15.47:0/3479967134 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:48:23.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.011+0000 7ff696195700 1 -- 172.21.15.47:0/3479967134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68c0095f0 con 0x7ff6900ff780 2024-09-13T22:48:23.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.011+0000 7ff696195700 1 --2- 172.21.15.47:0/3479967134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6900ff780 0x7ff690197bd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff68c005b40 tx=0x7ff68c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:23.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.011+0000 7ff6877fe700 1 -- 172.21.15.47:0/3479967134 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff68c01d070 con 0x7ff6900ff780 2024-09-13T22:48:23.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.011+0000 7ff6983f9700 1 -- 172.21.15.47:0/3479967134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff690198310 con 0x7ff6900ff780 2024-09-13T22:48:23.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.011+0000 7ff6877fe700 1 -- 172.21.15.47:0/3479967134 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff68c00be10 con 0x7ff6900ff780 2024-09-13T22:48:23.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.011+0000 7ff6877fe700 1 -- 172.21.15.47:0/3479967134 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff68c00f460 con 0x7ff6900ff780 2024-09-13T22:48:23.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.011+0000 7ff6983f9700 1 -- 172.21.15.47:0/3479967134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6901987b0 con 0x7ff6900ff780 2024-09-13T22:48:23.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.012+0000 7ff6983f9700 1 -- 172.21.15.47:0/3479967134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6901917b0 con 0x7ff6900ff780 2024-09-13T22:48:23.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.012+0000 7ff6877fe700 1 -- 172.21.15.47:0/3479967134 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) v1 ==== 45394+0+0 (secure 0 0 0) 0x7ff68c0227e0 con 0x7ff6900ff780 2024-09-13T22:48:23.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.013+0000 7ff6877fe700 1 --2- 172.21.15.47:0/3479967134 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff67c0384b0 0x7ff67c03a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:23.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.013+0000 7ff6877fe700 1 -- 172.21.15.47:0/3479967134 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7ff68c04c500 con 0x7ff6900ff780 2024-09-13T22:48:23.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.013+0000 7ff695994700 1 --2- 172.21.15.47:0/3479967134 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff67c0384b0 0x7ff67c03a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:23.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.013+0000 7ff695994700 1 --2- 172.21.15.47:0/3479967134 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff67c0384b0 0x7ff67c03a970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff680006fd0 tx=0x7ff680006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:23.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.018+0000 7ff6877fe700 1 -- 172.21.15.47:0/3479967134 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff68c02bba0 con 0x7ff6900ff780 2024-09-13T22:48:23.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.300+0000 7ff6983f9700 1 -- 172.21.15.47:0/3479967134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff69002cc70 con 0x7ff6900ff780 2024-09-13T22:48:23.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.301+0000 7ff6877fe700 1 -- 172.21.15.47:0/3479967134 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7ff68c027030 con 0x7ff6900ff780 2024-09-13T22:48:23.303 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:48:23.303 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":1,"fsid":"e41042f8-7221-11ef-bceb-c7b262605968","modified":"2024-09-13T22:46:07.590380Z","created":"2024-09-13T22:46:07.590380Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:48:23.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.304+0000 7ff6983f9700 1 -- 172.21.15.47:0/3479967134 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff67c0384b0 msgr2=0x7ff67c03a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:23.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.304+0000 7ff6983f9700 1 --2- 172.21.15.47:0/3479967134 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff67c0384b0 0x7ff67c03a970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff680006fd0 tx=0x7ff680006e40 comp rx=0 tx=0).stop 2024-09-13T22:48:23.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.304+0000 7ff6983f9700 1 -- 172.21.15.47:0/3479967134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6900ff780 msgr2=0x7ff690197bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:23.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.304+0000 7ff6983f9700 1 --2- 172.21.15.47:0/3479967134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6900ff780 0x7ff690197bd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff68c005b40 tx=0x7ff68c004740 comp rx=0 tx=0).stop 2024-09-13T22:48:23.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.304+0000 7ff6983f9700 1 -- 172.21.15.47:0/3479967134 shutdown_connections 2024-09-13T22:48:23.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.304+0000 7ff6983f9700 1 --2- 172.21.15.47:0/3479967134 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff67c0384b0 0x7ff67c03a970 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:23.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.304+0000 7ff6983f9700 1 --2- 172.21.15.47:0/3479967134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6900ff780 0x7ff690197bd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:23.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.304+0000 7ff6983f9700 1 -- 172.21.15.47:0/3479967134 >> 172.21.15.47:0/3479967134 conn(0x7ff6900fad00 msgr2=0x7ff690069090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:23.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.304+0000 7ff6983f9700 1 -- 172.21.15.47:0/3479967134 shutdown_connections 2024-09-13T22:48:23.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:23.305+0000 7ff6983f9700 1 -- 172.21.15.47:0/3479967134 wait complete. 2024-09-13T22:48:23.309 INFO:teuthology.orchestra.run.smithi047.stderr:dumped monmap epoch 1 2024-09-13T22:48:23.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:23 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/3479967134' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:24.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:24.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:24.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:24.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:24.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi047", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:48:24.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:24.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:48:24.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:24 smithi002 ceph-mon[27637]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-13T22:48:24.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:24 smithi002 ceph-mon[27637]: Updating smithi047:/etc/ceph/ceph.conf 2024-09-13T22:48:24.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:24 smithi002 ceph-mon[27637]: Updating smithi047:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:48:24.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:24 smithi002 ceph-mon[27637]: Updating smithi002:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:48:24.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:24 smithi002 ceph-mon[27637]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:48:24.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:24 smithi002 ceph-mon[27637]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:48:25.164 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:48:25.164 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:48:25.907 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:48:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:25 smithi002 ceph-mon[27637]: Updating smithi047:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:48:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:25 smithi002 ceph-mon[27637]: Updating smithi002:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:48:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:25 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:25 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:25 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:25 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:25 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:25 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi047", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:48:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:25 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi047", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T22:48:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:25 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:26.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:25 smithi002 ceph-mon[27637]: Deploying daemon ceph-exporter.smithi047 on smithi047 2024-09-13T22:48:27.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.776+0000 7ff740c29700 1 -- 172.21.15.47:0/1654107326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff73c106810 msgr2=0x7ff73c106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:27.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.776+0000 7ff740c29700 1 --2- 172.21.15.47:0/1654107326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff73c106810 0x7ff73c106bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009910 tx=0x7ff72c009c20 comp rx=0 tx=0).stop 2024-09-13T22:48:27.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.776+0000 7ff740c29700 1 -- 172.21.15.47:0/1654107326 shutdown_connections 2024-09-13T22:48:27.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.776+0000 7ff740c29700 1 --2- 172.21.15.47:0/1654107326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff73c106810 0x7ff73c106bf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:27.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.776+0000 7ff740c29700 1 -- 172.21.15.47:0/1654107326 >> 172.21.15.47:0/1654107326 conn(0x7ff73c0fc320 msgr2=0x7ff73c0fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:27.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.776+0000 7ff740c29700 1 -- 172.21.15.47:0/1654107326 shutdown_connections 2024-09-13T22:48:27.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.776+0000 7ff740c29700 1 -- 172.21.15.47:0/1654107326 wait complete. 2024-09-13T22:48:27.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.777+0000 7ff740c29700 1 Processor -- start 2024-09-13T22:48:27.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.777+0000 7ff740c29700 1 -- start start 2024-09-13T22:48:27.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.777+0000 7ff740c29700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff73c106810 0x7ff73c19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:27.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.777+0000 7ff740c29700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c19c010 con 0x7ff73c106810 2024-09-13T22:48:27.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.777+0000 7ff73a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff73c106810 0x7ff73c19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:27.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.777+0000 7ff73a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff73c106810 0x7ff73c19bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.47:43380/0 (socket says 172.21.15.47:43380) 2024-09-13T22:48:27.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.777+0000 7ff73a59c700 1 -- 172.21.15.47:0/3593416676 learned_addr learned my addr 172.21.15.47:0/3593416676 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:48:27.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.778+0000 7ff73a59c700 1 -- 172.21.15.47:0/3593416676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c0095f0 con 0x7ff73c106810 2024-09-13T22:48:27.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.778+0000 7ff73a59c700 1 --2- 172.21.15.47:0/3593416676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff73c106810 0x7ff73c19bad0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff72c0092e0 tx=0x7ff72c004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:27.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.778+0000 7ff7337fe700 1 -- 172.21.15.47:0/3593416676 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff72c01d070 con 0x7ff73c106810 2024-09-13T22:48:27.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.778+0000 7ff7337fe700 1 -- 172.21.15.47:0/3593416676 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff72c00be10 con 0x7ff73c106810 2024-09-13T22:48:27.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.778+0000 7ff740c29700 1 -- 172.21.15.47:0/3593416676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff73c19c270 con 0x7ff73c106810 2024-09-13T22:48:27.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.778+0000 7ff7337fe700 1 -- 172.21.15.47:0/3593416676 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff72c022e10 con 0x7ff73c106810 2024-09-13T22:48:27.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.778+0000 7ff740c29700 1 -- 172.21.15.47:0/3593416676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73c195b50 con 0x7ff73c106810 2024-09-13T22:48:27.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.779+0000 7ff740c29700 1 -- 172.21.15.47:0/3593416676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73c0623c0 con 0x7ff73c106810 2024-09-13T22:48:27.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.780+0000 7ff7337fe700 1 -- 172.21.15.47:0/3593416676 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) v1 ==== 45394+0+0 (secure 0 0 0) 0x7ff72c022470 con 0x7ff73c106810 2024-09-13T22:48:27.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.780+0000 7ff7337fe700 1 --2- 172.21.15.47:0/3593416676 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff728038460 0x7ff72803a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:27.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.780+0000 7ff7337fe700 1 -- 172.21.15.47:0/3593416676 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7ff72c04c810 con 0x7ff73c106810 2024-09-13T22:48:27.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.780+0000 7ff739d9b700 1 --2- 172.21.15.47:0/3593416676 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff728038460 0x7ff72803a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:27.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.781+0000 7ff739d9b700 1 --2- 172.21.15.47:0/3593416676 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff728038460 0x7ff72803a920 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff724006fd0 tx=0x7ff724006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:27.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:27.785+0000 7ff7337fe700 1 -- 172.21.15.47:0/3593416676 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff72c02b590 con 0x7ff73c106810 2024-09-13T22:48:28.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:28.077+0000 7ff740c29700 1 -- 172.21.15.47:0/3593416676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff73c196ff0 con 0x7ff73c106810 2024-09-13T22:48:28.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:28.078+0000 7ff7337fe700 1 -- 172.21.15.47:0/3593416676 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7ff72c027070 con 0x7ff73c106810 2024-09-13T22:48:28.080 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:48:28.080 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":1,"fsid":"e41042f8-7221-11ef-bceb-c7b262605968","modified":"2024-09-13T22:46:07.590380Z","created":"2024-09-13T22:46:07.590380Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:48:28.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:28.080+0000 7ff740c29700 1 -- 172.21.15.47:0/3593416676 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff728038460 msgr2=0x7ff72803a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:28.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:28.080+0000 7ff740c29700 1 --2- 172.21.15.47:0/3593416676 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff728038460 0x7ff72803a920 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff724006fd0 tx=0x7ff724006e40 comp rx=0 tx=0).stop 2024-09-13T22:48:28.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:28.080+0000 7ff740c29700 1 -- 172.21.15.47:0/3593416676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff73c106810 msgr2=0x7ff73c19bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:28.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:28.080+0000 7ff740c29700 1 --2- 172.21.15.47:0/3593416676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff73c106810 0x7ff73c19bad0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff72c0092e0 tx=0x7ff72c004c80 comp rx=0 tx=0).stop 2024-09-13T22:48:28.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:28.080+0000 7ff740c29700 1 -- 172.21.15.47:0/3593416676 shutdown_connections 2024-09-13T22:48:28.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:28.080+0000 7ff740c29700 1 --2- 172.21.15.47:0/3593416676 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff728038460 0x7ff72803a920 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:28.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:28.080+0000 7ff740c29700 1 --2- 172.21.15.47:0/3593416676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff73c106810 0x7ff73c19bad0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:28.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:28.080+0000 7ff740c29700 1 -- 172.21.15.47:0/3593416676 >> 172.21.15.47:0/3593416676 conn(0x7ff73c0fc320 msgr2=0x7ff73c108c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:28.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:28.080+0000 7ff740c29700 1 -- 172.21.15.47:0/3593416676 shutdown_connections 2024-09-13T22:48:28.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:28.080+0000 7ff740c29700 1 -- 172.21.15.47:0/3593416676 wait complete. 2024-09-13T22:48:28.083 INFO:teuthology.orchestra.run.smithi047.stderr:dumped monmap epoch 1 2024-09-13T22:48:28.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:28 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/3593416676' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:29.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:29 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:29.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:29 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:29.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:29 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:29.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:29 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:29.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:29 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi047", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:48:29.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:29 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi047", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T22:48:29.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:29 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:29.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:29 smithi002 ceph-mon[27637]: Deploying daemon crash.smithi047 on smithi047 2024-09-13T22:48:29.874 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:48:29.875 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:48:30.091 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:48:31.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.589+0000 7f74de4c4700 1 -- 172.21.15.47:0/3756368212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d8105720 msgr2=0x7f74d8105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:31.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.589+0000 7f74de4c4700 1 --2- 172.21.15.47:0/3756368212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d8105720 0x7f74d8105b00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f74c8009910 tx=0x7f74c8009c20 comp rx=0 tx=0).stop 2024-09-13T22:48:31.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.589+0000 7f74de4c4700 1 -- 172.21.15.47:0/3756368212 shutdown_connections 2024-09-13T22:48:31.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.589+0000 7f74de4c4700 1 --2- 172.21.15.47:0/3756368212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d8105720 0x7f74d8105b00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:31.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.589+0000 7f74de4c4700 1 -- 172.21.15.47:0/3756368212 >> 172.21.15.47:0/3756368212 conn(0x7f74d80fb250 msgr2=0x7f74d80fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:31.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.589+0000 7f74de4c4700 1 -- 172.21.15.47:0/3756368212 shutdown_connections 2024-09-13T22:48:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.589+0000 7f74de4c4700 1 -- 172.21.15.47:0/3756368212 wait complete. 2024-09-13T22:48:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.589+0000 7f74de4c4700 1 Processor -- start 2024-09-13T22:48:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.590+0000 7f74de4c4700 1 -- start start 2024-09-13T22:48:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.590+0000 7f74de4c4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d8105720 0x7f74d8196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.590+0000 7f74de4c4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d8197130 con 0x7f74d8105720 2024-09-13T22:48:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.590+0000 7f74d7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d8105720 0x7f74d8196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.590+0000 7f74d7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d8105720 0x7f74d8196bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.47:43418/0 (socket says 172.21.15.47:43418) 2024-09-13T22:48:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.590+0000 7f74d7fff700 1 -- 172.21.15.47:0/3961301841 learned_addr learned my addr 172.21.15.47:0/3961301841 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:48:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.590+0000 7f74d7fff700 1 -- 172.21.15.47:0/3961301841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c80095f0 con 0x7f74d8105720 2024-09-13T22:48:31.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.591+0000 7f74d7fff700 1 --2- 172.21.15.47:0/3961301841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d8105720 0x7f74d8196bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f74c8005b40 tx=0x7f74c8004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:31.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.591+0000 7f74d57fa700 1 -- 172.21.15.47:0/3961301841 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74c801d070 con 0x7f74d8105720 2024-09-13T22:48:31.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.591+0000 7f74de4c4700 1 -- 172.21.15.47:0/3961301841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d81972d0 con 0x7f74d8105720 2024-09-13T22:48:31.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.591+0000 7f74d57fa700 1 -- 172.21.15.47:0/3961301841 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f74c80044d0 con 0x7f74d8105720 2024-09-13T22:48:31.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.591+0000 7f74d57fa700 1 -- 172.21.15.47:0/3961301841 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74c8003910 con 0x7f74d8105720 2024-09-13T22:48:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.591+0000 7f74de4c4700 1 -- 172.21.15.47:0/3961301841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d8197750 con 0x7f74d8105720 2024-09-13T22:48:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.592+0000 7f74d57fa700 1 -- 172.21.15.47:0/3961301841 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) v1 ==== 45394+0+0 (secure 0 0 0) 0x7f74c8003b90 con 0x7f74d8105720 2024-09-13T22:48:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.592+0000 7f74de4c4700 1 -- 172.21.15.47:0/3961301841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d81039d0 con 0x7f74d8105720 2024-09-13T22:48:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.592+0000 7f74d57fa700 1 --2- 172.21.15.47:0/3961301841 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f74c00384b0 0x7f74c003a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.592+0000 7f74d57fa700 1 -- 172.21.15.47:0/3961301841 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f74c804c4d0 con 0x7f74d8105720 2024-09-13T22:48:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.592+0000 7f74d77fe700 1 --2- 172.21.15.47:0/3961301841 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f74c00384b0 0x7f74c003a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:31.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.593+0000 7f74d77fe700 1 --2- 172.21.15.47:0/3961301841 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f74c00384b0 0x7f74c003a970 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f74cc006fd0 tx=0x7f74cc006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:31.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.597+0000 7f74d57fa700 1 -- 172.21.15.47:0/3961301841 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f74c802a540 con 0x7f74d8105720 2024-09-13T22:48:31.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.886+0000 7f74de4c4700 1 -- 172.21.15.47:0/3961301841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f74d8197a00 con 0x7f74d8105720 2024-09-13T22:48:31.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.887+0000 7f74d57fa700 1 -- 172.21.15.47:0/3961301841 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7f74c802a360 con 0x7f74d8105720 2024-09-13T22:48:31.888 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:48:31.888 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":1,"fsid":"e41042f8-7221-11ef-bceb-c7b262605968","modified":"2024-09-13T22:46:07.590380Z","created":"2024-09-13T22:46:07.590380Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:48:31.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.889+0000 7f74de4c4700 1 -- 172.21.15.47:0/3961301841 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f74c00384b0 msgr2=0x7f74c003a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:31.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.889+0000 7f74de4c4700 1 --2- 172.21.15.47:0/3961301841 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f74c00384b0 0x7f74c003a970 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f74cc006fd0 tx=0x7f74cc006e40 comp rx=0 tx=0).stop 2024-09-13T22:48:31.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.889+0000 7f74de4c4700 1 -- 172.21.15.47:0/3961301841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d8105720 msgr2=0x7f74d8196bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:31.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.889+0000 7f74de4c4700 1 --2- 172.21.15.47:0/3961301841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d8105720 0x7f74d8196bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f74c8005b40 tx=0x7f74c8004c80 comp rx=0 tx=0).stop 2024-09-13T22:48:31.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.889+0000 7f74de4c4700 1 -- 172.21.15.47:0/3961301841 shutdown_connections 2024-09-13T22:48:31.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.889+0000 7f74de4c4700 1 --2- 172.21.15.47:0/3961301841 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f74c00384b0 0x7f74c003a970 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:31.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.889+0000 7f74de4c4700 1 --2- 172.21.15.47:0/3961301841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d8105720 0x7f74d8196bf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:31.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.889+0000 7f74de4c4700 1 -- 172.21.15.47:0/3961301841 >> 172.21.15.47:0/3961301841 conn(0x7f74d80fb250 msgr2=0x7f74d8107b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:31.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.889+0000 7f74de4c4700 1 -- 172.21.15.47:0/3961301841 shutdown_connections 2024-09-13T22:48:31.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:31.889+0000 7f74de4c4700 1 -- 172.21.15.47:0/3961301841 wait complete. 2024-09-13T22:48:31.891 INFO:teuthology.orchestra.run.smithi047.stderr:dumped monmap epoch 1 2024-09-13T22:48:32.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:31 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/3961301841' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:33.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:33 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:33.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:33 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:33.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:33 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:33.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:33 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:33.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:33 smithi002 ceph-mon[27637]: Deploying daemon node-exporter.smithi047 on smithi047 2024-09-13T22:48:33.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:33 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:33.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:33 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:48:33.615 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:48:33.615 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:48:33.818 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:48:36.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.678+0000 7f1ead7a3700 1 -- 172.21.15.47:0/1684432844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea8105720 msgr2=0x7f1ea8105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:36.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.678+0000 7f1ead7a3700 1 --2- 172.21.15.47:0/1684432844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea8105720 0x7f1ea8105b00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009910 tx=0x7f1e98009c20 comp rx=0 tx=0).stop 2024-09-13T22:48:36.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.678+0000 7f1ead7a3700 1 -- 172.21.15.47:0/1684432844 shutdown_connections 2024-09-13T22:48:36.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.678+0000 7f1ead7a3700 1 --2- 172.21.15.47:0/1684432844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea8105720 0x7f1ea8105b00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:36.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.678+0000 7f1ead7a3700 1 -- 172.21.15.47:0/1684432844 >> 172.21.15.47:0/1684432844 conn(0x7f1ea80fb250 msgr2=0x7f1ea80fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:36.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.678+0000 7f1ead7a3700 1 -- 172.21.15.47:0/1684432844 shutdown_connections 2024-09-13T22:48:36.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.678+0000 7f1ead7a3700 1 -- 172.21.15.47:0/1684432844 wait complete. 2024-09-13T22:48:36.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.679+0000 7f1ead7a3700 1 Processor -- start 2024-09-13T22:48:36.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.679+0000 7f1ead7a3700 1 -- start start 2024-09-13T22:48:36.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.679+0000 7f1ead7a3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea8105720 0x7f1ea8196c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:36.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.679+0000 7f1ead7a3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea8197150 con 0x7f1ea8105720 2024-09-13T22:48:36.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.679+0000 7f1ea6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea8105720 0x7f1ea8196c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:36.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.679+0000 7f1ea6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea8105720 0x7f1ea8196c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.47:54866/0 (socket says 172.21.15.47:54866) 2024-09-13T22:48:36.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.679+0000 7f1ea6ffd700 1 -- 172.21.15.47:0/537865038 learned_addr learned my addr 172.21.15.47:0/537865038 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:48:36.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.680+0000 7f1ea6ffd700 1 -- 172.21.15.47:0/537865038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e980095f0 con 0x7f1ea8105720 2024-09-13T22:48:36.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.680+0000 7f1ea6ffd700 1 --2- 172.21.15.47:0/537865038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea8105720 0x7f1ea8196c10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1e98005b40 tx=0x7f1e98004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:36.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.680+0000 7f1ea4ff9700 1 -- 172.21.15.47:0/537865038 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e9801d070 con 0x7f1ea8105720 2024-09-13T22:48:36.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.680+0000 7f1ea4ff9700 1 -- 172.21.15.47:0/537865038 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1e980044d0 con 0x7f1ea8105720 2024-09-13T22:48:36.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.680+0000 7f1ead7a3700 1 -- 172.21.15.47:0/537865038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea8197350 con 0x7f1ea8105720 2024-09-13T22:48:36.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.680+0000 7f1ea4ff9700 1 -- 172.21.15.47:0/537865038 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e98003910 con 0x7f1ea8105720 2024-09-13T22:48:36.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.680+0000 7f1ead7a3700 1 -- 172.21.15.47:0/537865038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea81977d0 con 0x7f1ea8105720 2024-09-13T22:48:36.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.681+0000 7f1ea4ff9700 1 -- 172.21.15.47:0/537865038 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) v1 ==== 45394+0+0 (secure 0 0 0) 0x7f1e9800b960 con 0x7f1ea8105720 2024-09-13T22:48:36.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.681+0000 7f1ead7a3700 1 -- 172.21.15.47:0/537865038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea81039d0 con 0x7f1ea8105720 2024-09-13T22:48:36.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.681+0000 7f1ea4ff9700 1 --2- 172.21.15.47:0/537865038 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1e940384b0 0x7f1e9403a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:36.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.681+0000 7f1ea4ff9700 1 -- 172.21.15.47:0/537865038 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f1e9804c4d0 con 0x7f1ea8105720 2024-09-13T22:48:36.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.682+0000 7f1e9ffff700 1 --2- 172.21.15.47:0/537865038 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1e940384b0 0x7f1e9403a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:36.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.682+0000 7f1e9ffff700 1 --2- 172.21.15.47:0/537865038 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1e940384b0 0x7f1e9403a970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1e90006fd0 tx=0x7f1e90006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:36.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.686+0000 7f1ea4ff9700 1 -- 172.21.15.47:0/537865038 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1e9802a540 con 0x7f1ea8105720 2024-09-13T22:48:36.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.992+0000 7f1ead7a3700 1 -- 172.21.15.47:0/537865038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1ea8068e50 con 0x7f1ea8105720 2024-09-13T22:48:36.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.993+0000 7f1ea4ff9700 1 -- 172.21.15.47:0/537865038 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7f1e9802a360 con 0x7f1ea8105720 2024-09-13T22:48:36.994 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:48:36.994 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":1,"fsid":"e41042f8-7221-11ef-bceb-c7b262605968","modified":"2024-09-13T22:46:07.590380Z","created":"2024-09-13T22:46:07.590380Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:48:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.995+0000 7f1ead7a3700 1 -- 172.21.15.47:0/537865038 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1e940384b0 msgr2=0x7f1e9403a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.995+0000 7f1ead7a3700 1 --2- 172.21.15.47:0/537865038 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1e940384b0 0x7f1e9403a970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1e90006fd0 tx=0x7f1e90006e40 comp rx=0 tx=0).stop 2024-09-13T22:48:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.995+0000 7f1ead7a3700 1 -- 172.21.15.47:0/537865038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea8105720 msgr2=0x7f1ea8196c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.995+0000 7f1ead7a3700 1 --2- 172.21.15.47:0/537865038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea8105720 0x7f1ea8196c10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1e98005b40 tx=0x7f1e98004c80 comp rx=0 tx=0).stop 2024-09-13T22:48:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.995+0000 7f1ead7a3700 1 -- 172.21.15.47:0/537865038 shutdown_connections 2024-09-13T22:48:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.995+0000 7f1ead7a3700 1 --2- 172.21.15.47:0/537865038 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1e940384b0 0x7f1e9403a970 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:36.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.995+0000 7f1ead7a3700 1 --2- 172.21.15.47:0/537865038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea8105720 0x7f1ea8196c10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:36.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.995+0000 7f1ead7a3700 1 -- 172.21.15.47:0/537865038 >> 172.21.15.47:0/537865038 conn(0x7f1ea80fb250 msgr2=0x7f1ea8107b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:36.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.995+0000 7f1ead7a3700 1 -- 172.21.15.47:0/537865038 shutdown_connections 2024-09-13T22:48:36.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:36.995+0000 7f1ead7a3700 1 -- 172.21.15.47:0/537865038 wait complete. 2024-09-13T22:48:36.997 INFO:teuthology.orchestra.run.smithi047.stderr:dumped monmap epoch 1 2024-09-13T22:48:37.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:37 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:37.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:37 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:37.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:37 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:37.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:37 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:37.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:37 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.gcymvd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:48:37.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:37 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.gcymvd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T22:48:37.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:37 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:48:37.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:37 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:37.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:37 smithi002 ceph-mon[27637]: Deploying daemon mgr.smithi047.gcymvd on smithi047 2024-09-13T22:48:37.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:37 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/537865038' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:37.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:37 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:38.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:38 smithi002 ceph-mon[27637]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:38.950 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:48:38.950 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:48:39.348 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:48:40.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:40 smithi002 ceph-mon[27637]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:40.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:40 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:40.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:40 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:40.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:40 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:40.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:40 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:40.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:40 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:48:40.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:40 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:40.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:40 smithi002 ceph-mon[27637]: Deploying daemon mon.smithi047 on smithi047 2024-09-13T22:48:41.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.111+0000 7f404755f700 1 -- 172.21.15.47:0/574184084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40400ff120 msgr2=0x7f40400ff500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:41.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.111+0000 7f404755f700 1 --2- 172.21.15.47:0/574184084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40400ff120 0x7f40400ff500 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f403c009910 tx=0x7f403c009c20 comp rx=0 tx=0).stop 2024-09-13T22:48:41.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.111+0000 7f404755f700 1 -- 172.21.15.47:0/574184084 shutdown_connections 2024-09-13T22:48:41.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.111+0000 7f404755f700 1 --2- 172.21.15.47:0/574184084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40400ff120 0x7f40400ff500 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:41.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.111+0000 7f404755f700 1 -- 172.21.15.47:0/574184084 >> 172.21.15.47:0/574184084 conn(0x7f4040075e80 msgr2=0x7f4040076290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:41.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.111+0000 7f404755f700 1 -- 172.21.15.47:0/574184084 shutdown_connections 2024-09-13T22:48:41.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.111+0000 7f404755f700 1 -- 172.21.15.47:0/574184084 wait complete. 2024-09-13T22:48:41.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.112+0000 7f404755f700 1 Processor -- start 2024-09-13T22:48:41.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.112+0000 7f404755f700 1 -- start start 2024-09-13T22:48:41.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.112+0000 7f404755f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40400ff120 0x7f4040196b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:41.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.112+0000 7f404755f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40401970d0 con 0x7f40400ff120 2024-09-13T22:48:41.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.113+0000 7f40452fb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40400ff120 0x7f4040196b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:41.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.113+0000 7f40452fb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40400ff120 0x7f4040196b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.47:54892/0 (socket says 172.21.15.47:54892) 2024-09-13T22:48:41.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.113+0000 7f40452fb700 1 -- 172.21.15.47:0/1157351850 learned_addr learned my addr 172.21.15.47:0/1157351850 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:48:41.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.113+0000 7f40452fb700 1 -- 172.21.15.47:0/1157351850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403c0095f0 con 0x7f40400ff120 2024-09-13T22:48:41.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.113+0000 7f40452fb700 1 --2- 172.21.15.47:0/1157351850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40400ff120 0x7f4040196b90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f403c005b40 tx=0x7f403c004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:41.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.113+0000 7f40367fc700 1 -- 172.21.15.47:0/1157351850 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f403c01d070 con 0x7f40400ff120 2024-09-13T22:48:41.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.113+0000 7f404755f700 1 -- 172.21.15.47:0/1157351850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40401972d0 con 0x7f40400ff120 2024-09-13T22:48:41.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.113+0000 7f40367fc700 1 -- 172.21.15.47:0/1157351850 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f403c0044d0 con 0x7f40400ff120 2024-09-13T22:48:41.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.113+0000 7f40367fc700 1 -- 172.21.15.47:0/1157351850 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f403c003930 con 0x7f40400ff120 2024-09-13T22:48:41.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.114+0000 7f404755f700 1 -- 172.21.15.47:0/1157351850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4040197690 con 0x7f40400ff120 2024-09-13T22:48:41.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.114+0000 7f404755f700 1 -- 172.21.15.47:0/1157351850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40400623c0 con 0x7f40400ff120 2024-09-13T22:48:41.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.114+0000 7f40367fc700 1 -- 172.21.15.47:0/1157351850 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) v1 ==== 45394+0+0 (secure 0 0 0) 0x7f403c003bf0 con 0x7f40400ff120 2024-09-13T22:48:41.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.115+0000 7f40367fc700 1 --2- 172.21.15.47:0/1157351850 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f402c0384b0 0x7f402c03a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:41.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.115+0000 7f40367fc700 1 -- 172.21.15.47:0/1157351850 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f403c04c790 con 0x7f40400ff120 2024-09-13T22:48:41.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.115+0000 7f4044afa700 1 --2- 172.21.15.47:0/1157351850 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f402c0384b0 0x7f402c03a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:41.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.115+0000 7f4044afa700 1 --2- 172.21.15.47:0/1157351850 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f402c0384b0 0x7f402c03a970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4030006fd0 tx=0x7f4030006e40 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:41.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.120+0000 7f40367fc700 1 -- 172.21.15.47:0/1157351850 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f403c02a950 con 0x7f40400ff120 2024-09-13T22:48:41.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.412+0000 7f404755f700 1 -- 172.21.15.47:0/1157351850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f40401978e0 con 0x7f40400ff120 2024-09-13T22:48:41.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.412+0000 7f40367fc700 1 -- 172.21.15.47:0/1157351850 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7f403c02a360 con 0x7f40400ff120 2024-09-13T22:48:41.413 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:48:41.413 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":1,"fsid":"e41042f8-7221-11ef-bceb-c7b262605968","modified":"2024-09-13T22:46:07.590380Z","created":"2024-09-13T22:46:07.590380Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T22:48:41.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.415+0000 7f404755f700 1 -- 172.21.15.47:0/1157351850 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f402c0384b0 msgr2=0x7f402c03a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:41.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.415+0000 7f404755f700 1 --2- 172.21.15.47:0/1157351850 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f402c0384b0 0x7f402c03a970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4030006fd0 tx=0x7f4030006e40 comp rx=0 tx=0).stop 2024-09-13T22:48:41.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.415+0000 7f404755f700 1 -- 172.21.15.47:0/1157351850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40400ff120 msgr2=0x7f4040196b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:41.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.415+0000 7f404755f700 1 --2- 172.21.15.47:0/1157351850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40400ff120 0x7f4040196b90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f403c005b40 tx=0x7f403c004c80 comp rx=0 tx=0).stop 2024-09-13T22:48:41.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.415+0000 7f404755f700 1 -- 172.21.15.47:0/1157351850 shutdown_connections 2024-09-13T22:48:41.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.415+0000 7f404755f700 1 --2- 172.21.15.47:0/1157351850 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f402c0384b0 0x7f402c03a970 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:41.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.415+0000 7f404755f700 1 --2- 172.21.15.47:0/1157351850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40400ff120 0x7f4040196b90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:41.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.415+0000 7f404755f700 1 -- 172.21.15.47:0/1157351850 >> 172.21.15.47:0/1157351850 conn(0x7f4040075e80 msgr2=0x7f4040106c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:41.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.415+0000 7f404755f700 1 -- 172.21.15.47:0/1157351850 shutdown_connections 2024-09-13T22:48:41.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:41.415+0000 7f404755f700 1 -- 172.21.15.47:0/1157351850 wait complete. 2024-09-13T22:48:41.416 INFO:teuthology.orchestra.run.smithi047.stderr:dumped monmap epoch 1 2024-09-13T22:48:42.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:41 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/1157351850' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:43.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:42 smithi002 ceph-mon[27637]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:43.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:42 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.126 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 podman[34537]: 2024-09-13 22:48:44.10249068 +0000 UTC m=+0.328630994 container start 5642284a23bf6826eb1b272c2f77c29bd6edd65dccedc58f05f10fbfb423bb36 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi047, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.1, ceph=True, org.label-schema.build-date=20240222, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=HEAD, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-13T22:48:44.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T22:48:44.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable), process ceph-mon, pid 2 2024-09-13T22:48:44.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pidfile_write: ignore empty --pid-file 2024-09-13T22:48:44.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: load: jerasure load: lrc 2024-09-13T22:48:44.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: RocksDB version: 7.9.2 2024-09-13T22:48:44.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Git sha 0 2024-09-13T22:48:44.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Compile date 2023-12-11 22:07:34 2024-09-13T22:48:44.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: DB SUMMARY 2024-09-13T22:48:44.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: DB Session ID: 80YJQT7L6I4680PB1LCV 2024-09-13T22:48:44.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: CURRENT file: CURRENT 2024-09-13T22:48:44.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T22:48:44.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-13T22:48:44.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi047/store.db dir, Total Num: 0, files: 2024-09-13T22:48:44.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi047/store.db: 000004.log size: 511 ; 2024-09-13T22:48:44.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.error_if_exists: 0 2024-09-13T22:48:44.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.create_if_missing: 0 2024-09-13T22:48:44.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.paranoid_checks: 1 2024-09-13T22:48:44.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T22:48:44.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T22:48:44.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T22:48:44.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.env: 0x5607cfbe5720 2024-09-13T22:48:44.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T22:48:44.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.info_log: 0x5607d2c832e0 2024-09-13T22:48:44.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T22:48:44.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.statistics: (nil) 2024-09-13T22:48:44.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.use_fsync: 0 2024-09-13T22:48:44.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_log_file_size: 0 2024-09-13T22:48:44.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T22:48:44.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T22:48:44.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T22:48:44.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T22:48:44.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.allow_fallocate: 1 2024-09-13T22:48:44.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T22:48:44.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T22:48:44.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.use_direct_reads: 0 2024-09-13T22:48:44.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T22:48:44.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T22:48:44.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.db_log_dir: 2024-09-13T22:48:44.416 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.wal_dir: 2024-09-13T22:48:44.416 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T22:48:44.418 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T22:48:44.418 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T22:48:44.418 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T22:48:44.418 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T22:48:44.418 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T22:48:44.418 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T22:48:44.418 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T22:48:44.418 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.write_buffer_manager: 0x5607d1ef4140 2024-09-13T22:48:44.418 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T22:48:44.419 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T22:48:44.419 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T22:48:44.419 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T22:48:44.419 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T22:48:44.419 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T22:48:44.419 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T22:48:44.419 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T22:48:44.419 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.unordered_write: 0 2024-09-13T22:48:44.419 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T22:48:44.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T22:48:44.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T22:48:44.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T22:48:44.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.row_cache: None 2024-09-13T22:48:44.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.wal_filter: None 2024-09-13T22:48:44.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T22:48:44.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T22:48:44.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.two_write_queues: 0 2024-09-13T22:48:44.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T22:48:44.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.wal_compression: 0 2024-09-13T22:48:44.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.atomic_flush: 0 2024-09-13T22:48:44.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T22:48:44.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T22:48:44.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T22:48:44.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.log_readahead_size: 0 2024-09-13T22:48:44.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T22:48:44.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T22:48:44.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T22:48:44.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T22:48:44.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T22:48:44.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T22:48:44.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T22:48:44.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_background_jobs: 2 2024-09-13T22:48:44.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_background_compactions: -1 2024-09-13T22:48:44.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_subcompactions: 1 2024-09-13T22:48:44.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T22:48:44.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T22:48:44.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T22:48:44.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T22:48:44.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T22:48:44.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T22:48:44.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T22:48:44.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T22:48:44.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_open_files: -1 2024-09-13T22:48:44.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T22:48:44.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T22:48:44.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T22:48:44.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T22:48:44.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_background_flushes: -1 2024-09-13T22:48:44.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Compression algorithms supported: 2024-09-13T22:48:44.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T22:48:44.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: kZSTD supported: 0 2024-09-13T22:48:44.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: kXpressCompression supported: 0 2024-09-13T22:48:44.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T22:48:44.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: kZlibCompression supported: 1 2024-09-13T22:48:44.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: kSnappyCompression supported: 1 2024-09-13T22:48:44.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: kLZ4Compression supported: 1 2024-09-13T22:48:44.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: kBZip2Compression supported: 0 2024-09-13T22:48:44.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T22:48:44.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T22:48:44.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi047/store.db/MANIFEST-000005 2024-09-13T22:48:44.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T22:48:44.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T22:48:44.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.merge_operator: 2024-09-13T22:48:44.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compaction_filter: None 2024-09-13T22:48:44.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T22:48:44.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T22:48:44.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T22:48:44.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T22:48:44.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5607d2c833e0) 2024-09-13T22:48:44.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: cache_index_and_filter_blocks: 1 2024-09-13T22:48:44.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T22:48:44.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T22:48:44.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: pin_top_level_index_and_filter: 1 2024-09-13T22:48:44.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: index_type: 0 2024-09-13T22:48:44.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: data_block_index_type: 0 2024-09-13T22:48:44.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: index_shortening: 1 2024-09-13T22:48:44.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T22:48:44.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: checksum: 4 2024-09-13T22:48:44.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: no_block_cache: 0 2024-09-13T22:48:44.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_cache: 0x5607d1f95350 2024-09-13T22:48:44.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_cache_name: BinnedLRUCache 2024-09-13T22:48:44.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_cache_options: 2024-09-13T22:48:44.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: capacity : 536870912 2024-09-13T22:48:44.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: num_shard_bits : 4 2024-09-13T22:48:44.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: strict_capacity_limit : 0 2024-09-13T22:48:44.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: high_pri_pool_ratio: 0.000 2024-09-13T22:48:44.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_cache_compressed: (nil) 2024-09-13T22:48:44.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: persistent_cache: (nil) 2024-09-13T22:48:44.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_size: 4096 2024-09-13T22:48:44.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_size_deviation: 10 2024-09-13T22:48:44.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_restart_interval: 16 2024-09-13T22:48:44.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: index_block_restart_interval: 1 2024-09-13T22:48:44.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: metadata_block_size: 4096 2024-09-13T22:48:44.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: partition_filters: 0 2024-09-13T22:48:44.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: use_delta_encoding: 1 2024-09-13T22:48:44.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: filter_policy: bloomfilter 2024-09-13T22:48:44.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: whole_key_filtering: 1 2024-09-13T22:48:44.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: verify_compression: 0 2024-09-13T22:48:44.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: read_amp_bytes_per_bit: 0 2024-09-13T22:48:44.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: format_version: 5 2024-09-13T22:48:44.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: enable_index_compression: 1 2024-09-13T22:48:44.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_align: 0 2024-09-13T22:48:44.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: max_auto_readahead_size: 262144 2024-09-13T22:48:44.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: prepopulate_block_cache: 0 2024-09-13T22:48:44.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: initial_auto_readahead_size: 8192 2024-09-13T22:48:44.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T22:48:44.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T22:48:44.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T22:48:44.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compression: NoCompression 2024-09-13T22:48:44.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T22:48:44.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T22:48:44.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T22:48:44.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.num_levels: 7 2024-09-13T22:48:44.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T22:48:44.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T22:48:44.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T22:48:44.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T22:48:44.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T22:48:44.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T22:48:44.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T22:48:44.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:48:44.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T22:48:44.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T22:48:44.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T22:48:44.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T22:48:44.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T22:48:44.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T22:48:44.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T22:48:44.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T22:48:44.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:48:44.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T22:48:44.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T22:48:44.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T22:48:44.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T22:48:44.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T22:48:44.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T22:48:44.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T22:48:44.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T22:48:44.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T22:48:44.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T22:48:44.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T22:48:44.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T22:48:44.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T22:48:44.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T22:48:44.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T22:48:44.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T22:48:44.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T22:48:44.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T22:48:44.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T22:48:44.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T22:48:44.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T22:48:44.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T22:48:44.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T22:48:44.432 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T22:48:44.432 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T22:48:44.432 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T22:48:44.432 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T22:48:44.432 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T22:48:44.432 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T22:48:44.432 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T22:48:44.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T22:48:44.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T22:48:44.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T22:48:44.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T22:48:44.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T22:48:44.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T22:48:44.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.table_properties_collectors: 2024-09-13T22:48:44.434 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.inplace_update_support: 0 2024-09-13T22:48:44.434 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T22:48:44.434 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T22:48:44.434 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T22:48:44.434 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T22:48:44.434 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.bloom_locality: 0 2024-09-13T22:48:44.434 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.max_successive_merges: 0 2024-09-13T22:48:44.434 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T22:48:44.435 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T22:48:44.435 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T22:48:44.435 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T22:48:44.435 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.ttl: 2592000 2024-09-13T22:48:44.435 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T22:48:44.435 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T22:48:44.435 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T22:48:44.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.enable_blob_files: false 2024-09-13T22:48:44.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.min_blob_size: 0 2024-09-13T22:48:44.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T22:48:44.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T22:48:44.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T22:48:44.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T22:48:44.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T22:48:44.437 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T22:48:44.437 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T22:48:44.437 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T22:48:44.437 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi047/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T22:48:44.437 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-13T22:48:44.437 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fc653135-93c2-4f85-b24e-bf9b42994ae0 2024-09-13T22:48:44.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726267724132824, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-13T22:48:44.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-13T22:48:44.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726267724133232, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726267724, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fc653135-93c2-4f85-b24e-bf9b42994ae0", "db_session_id": "80YJQT7L6I4680PB1LCV", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-13T22:48:44.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726267724133316, "job": 1, "event": "recovery_finished"} 2024-09-13T22:48:44.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-13T22:48:44.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi047/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T22:48:44.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5607d2032000 2024-09-13T22:48:44.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: DB pointer 0x5607d201e000 2024-09-13T22:48:44.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T22:48:44.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T22:48:44.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ** DB Stats ** 2024-09-13T22:48:44.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:48:44.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T22:48:44.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:48:44.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:48:44.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T22:48:44.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:48:44.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:48:44.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-09-13T22:48:44.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ** Compaction Stats [default] ** 2024-09-13T22:48:44.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:48:44.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T22:48:44.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T22:48:44.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T22:48:44.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T22:48:44.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-09-13T22:48:44.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ** Compaction Stats [default] ** 2024-09-13T22:48:44.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:48:44.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T22:48:44.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T22:48:44.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-09-13T22:48:44.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T22:48:44.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-09-13T22:48:44.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:48:44.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T22:48:44.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T22:48:44.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T22:48:44.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T22:48:44.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T22:48:44.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:48:44.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:48:44.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T22:48:44.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Block cache BinnedLRUCache@0x5607d1f95350#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.5e-05 secs_since: 0 2024-09-13T22:48:44.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-13T22:48:44.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-09-13T22:48:44.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T22:48:44.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mon.smithi047 does not exist in monmap, will attempt to join an existing cluster 2024-09-13T22:48:44.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: using public_addr v2:172.21.15.47:0/0 -> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] 2024-09-13T22:48:44.442 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: starting mon.smithi047 rank -1 at public addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] at bind addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi047 fsid e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T22:48:44.442 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mon.smithi047@-1(???) e0 preinit fsid e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T22:48:44.442 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mon.smithi047@-1(synchronizing).mds e1 new map 2024-09-13T22:48:44.442 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mon.smithi047@-1(synchronizing).mds e1 print_map 2024-09-13T22:48:44.442 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: e1 2024-09-13T22:48:44.442 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:48:44.442 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:48:44.442 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: legacy client fscid: -1 2024-09-13T22:48:44.442 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-09-13T22:48:44.442 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: No filesystems configured 2024-09-13T22:48:44.442 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mon.smithi047@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-13T22:48:44.442 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mon.smithi047@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-13T22:48:44.442 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mon.smithi047@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-13T22:48:44.442 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mon.smithi047@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-13T22:48:44.443 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mon.smithi047@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-13T22:48:44.443 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mon.smithi047@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-13T22:48:44.443 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mon.smithi047@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-09-13T22:48:44.443 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mon.smithi047@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T22:48:44.443 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mon.smithi047@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:48:44.443 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mon.smithi047@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:48:44.443 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mon.smithi047@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T22:48:44.443 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.443 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.443 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.443 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.443 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Deploying daemon alertmanager.smithi002 on smithi002 2024-09-13T22:48:44.443 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.443 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.444 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:48:44.444 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.444 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.444 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/1624179177' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T22:48:44.444 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/1624179177' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T22:48:44.444 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T22:48:44.444 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.444 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.444 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.444 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.444 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.444 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.444 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.445 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.445 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-13T22:48:44.445 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.445 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.445 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T22:48:44.445 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T22:48:44.445 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.445 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Deploying daemon grafana.smithi002 on smithi002 2024-09-13T22:48:44.445 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='client.14197 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi002:172.21.15.2=smithi002;smithi047:172.21.15.47=smithi047", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:48:44.445 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Saving service mon spec with placement smithi002:172.21.15.2=smithi002;smithi047:172.21.15.47=smithi047;count:2 2024-09-13T22:48:44.445 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.445 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.445 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/2187949822' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:44.446 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.446 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.446 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.446 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/2923559279' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:44.446 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.446 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.446 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/3600785522' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:44.446 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.446 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.446 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.446 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.447 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.447 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.447 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.447 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.447 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.447 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Deploying daemon prometheus.smithi002 on smithi002 2024-09-13T22:48:44.447 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.447 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/2167247553' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:44.447 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.447 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.447 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/1017372692' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:44.447 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.447 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.447 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/3910349009' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:44.448 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.448 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.448 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.448 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.448 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-13T22:48:44.448 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.448 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14164 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-13T22:48:44.448 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mgrmap e14: smithi002.yumtzz(active, since 58s) 2024-09-13T22:48:44.448 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/978177008' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:44.448 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/1294156648' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:44.448 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Active manager daemon smithi002.yumtzz restarted 2024-09-13T22:48:44.448 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Activating manager daemon smithi002.yumtzz 2024-09-13T22:48:44.448 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T22:48:44.448 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mgrmap e15: smithi002.yumtzz(active, starting, since 0.00325983s) 2024-09-13T22:48:44.449 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T22:48:44.449 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr metadata", "who": "smithi002.yumtzz", "id": "smithi002.yumtzz"}]: dispatch 2024-09-13T22:48:44.449 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:48:44.449 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:48:44.449 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:48:44.449 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Manager daemon smithi002.yumtzz is now available 2024-09-13T22:48:44.449 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:48:44.449 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:48:44.449 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.449 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:48:44.449 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.yumtzz/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:48:44.449 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.yumtzz/trash_purge_schedule"}]: dispatch 2024-09-13T22:48:44.449 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: [13/Sep/2024:22:48:17] ENGINE Bus STARTING 2024-09-13T22:48:44.450 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: [13/Sep/2024:22:48:17] ENGINE Serving on http://172.21.15.2:8765 2024-09-13T22:48:44.450 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.450 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: [13/Sep/2024:22:48:17] ENGINE Serving on https://172.21.15.2:7150 2024-09-13T22:48:44.450 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: [13/Sep/2024:22:48:17] ENGINE Bus STARTED 2024-09-13T22:48:44.450 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mgrmap e16: smithi002.yumtzz(active, since 1.00564s) 2024-09-13T22:48:44.450 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/174343217' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:44.450 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.450 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mgrmap e17: smithi002.yumtzz(active, since 2s) 2024-09-13T22:48:44.450 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.450 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.450 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.450 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.450 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.451 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:48:44.451 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/3479967134' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:44.451 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.451 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.451 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.451 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.451 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi047", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:48:44.451 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:44.451 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:48:44.451 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-13T22:48:44.451 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Updating smithi047:/etc/ceph/ceph.conf 2024-09-13T22:48:44.451 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Updating smithi047:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:48:44.451 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Updating smithi002:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:48:44.452 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:48:44.452 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:48:44.452 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Updating smithi047:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:48:44.452 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Updating smithi002:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:48:44.452 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.452 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.452 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.452 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.452 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.452 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi047", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:48:44.453 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi047", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T22:48:44.453 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:44.453 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Deploying daemon ceph-exporter.smithi047 on smithi047 2024-09-13T22:48:44.453 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/3593416676' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:44.453 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.453 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.453 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.453 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.453 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi047", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:48:44.453 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi047", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T22:48:44.453 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:44.453 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Deploying daemon crash.smithi047 on smithi047 2024-09-13T22:48:44.453 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/3961301841' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:44.454 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.454 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.454 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.454 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.454 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Deploying daemon node-exporter.smithi047 on smithi047 2024-09-13T22:48:44.454 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.454 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:48:44.454 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.454 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.454 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.454 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.455 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.gcymvd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:48:44.455 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.gcymvd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T22:48:44.455 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:48:44.455 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:44.455 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Deploying daemon mgr.smithi047.gcymvd on smithi047 2024-09-13T22:48:44.455 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/537865038' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:44.455 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.455 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.455 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.455 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.455 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.455 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.455 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.455 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:48:44.456 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:44.456 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: Deploying daemon mon.smithi047 on smithi047 2024-09-13T22:48:44.456 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/1157351850' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:44.456 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:44.456 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:44.456 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mon.smithi047@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-09-13T22:48:44.456 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: expand_channel_meta expand map: {default=false} 2024-09-13T22:48:44.456 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: expand_channel_meta from 'false' to 'false' 2024-09-13T22:48:44.456 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: expand_channel_meta expanded map: {default=false} 2024-09-13T22:48:44.456 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: expand_channel_meta expand map: {default=info} 2024-09-13T22:48:44.456 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: expand_channel_meta from 'info' to 'info' 2024-09-13T22:48:44.456 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: expand_channel_meta expanded map: {default=info} 2024-09-13T22:48:44.456 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: expand_channel_meta expand map: {default=daemon} 2024-09-13T22:48:44.457 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: expand_channel_meta from 'daemon' to 'daemon' 2024-09-13T22:48:44.457 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: expand_channel_meta expanded map: {default=daemon} 2024-09-13T22:48:44.457 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: expand_channel_meta expand map: {default=debug} 2024-09-13T22:48:44.457 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: expand_channel_meta from 'debug' to 'debug' 2024-09-13T22:48:44.457 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: expand_channel_meta expanded map: {default=debug} 2024-09-13T22:48:44.457 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 ceph-mon[34560]: mon.smithi047@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete,mon_cluster_log_to_file 2024-09-13T22:48:44.458 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 bash[34537]: 5642284a23bf6826eb1b272c2f77c29bd6edd65dccedc58f05f10fbfb423bb36 2024-09-13T22:48:44.458 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:44 smithi047 systemd[1]: Started Ceph mon.smithi047 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T22:48:44.655 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T22:48:44.656 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T22:48:44.865 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi047/config 2024-09-13T22:48:49.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.258+0000 7f5462ec8700 1 -- 172.21.15.47:0/45664960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c106930 msgr2=0x7f544c005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:49.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.258+0000 7f5462ec8700 1 --2- 172.21.15.47:0/45664960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c106930 0x7f544c005610 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5450005fa0 tx=0x7f545000ffc0 comp rx=0 tx=0).stop 2024-09-13T22:48:49.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.258+0000 7f5462ec8700 1 -- 172.21.15.47:0/45664960 shutdown_connections 2024-09-13T22:48:49.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.258+0000 7f5462ec8700 1 --2- 172.21.15.47:0/45664960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c106930 0x7f544c005610 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:49.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.258+0000 7f5462ec8700 1 -- 172.21.15.47:0/45664960 >> 172.21.15.47:0/45664960 conn(0x7f545c0fc400 msgr2=0x7f545c0fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:49.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.258+0000 7f5462ec8700 1 -- 172.21.15.47:0/45664960 shutdown_connections 2024-09-13T22:48:49.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.258+0000 7f5462ec8700 1 -- 172.21.15.47:0/45664960 wait complete. 2024-09-13T22:48:49.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.258+0000 7f5462ec8700 1 Processor -- start 2024-09-13T22:48:49.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.259+0000 7f5462ec8700 1 -- start start 2024-09-13T22:48:49.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.259+0000 7f5462ec8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545c106930 0x7f545c073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:49.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.259+0000 7f5462ec8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c0735d0 0x7f545c073a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:49.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.259+0000 7f5462ec8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c1a2100 con 0x7f545c0735d0 2024-09-13T22:48:49.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.259+0000 7f5462ec8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c1a2240 con 0x7f545c106930 2024-09-13T22:48:49.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.259+0000 7f5460c64700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545c106930 0x7f545c073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:49.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.259+0000 7f5460c64700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545c106930 0x7f545c073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54948/0 (socket says 172.21.15.47:54948) 2024-09-13T22:48:49.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.259+0000 7f545bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c0735d0 0x7f545c073a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:49.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.259+0000 7f5460c64700 1 -- 172.21.15.47:0/505407692 learned_addr learned my addr 172.21.15.47:0/505407692 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:48:49.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.259+0000 7f5460c64700 1 -- 172.21.15.47:0/505407692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545c106930 msgr2=0x7f545c073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-13T22:48:49.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.259+0000 7f5460c64700 1 -- 172.21.15.47:0/505407692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545c106930 msgr2=0x7f545c073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T22:48:49.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.259+0000 7f5460c64700 1 --2- 172.21.15.47:0/505407692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545c106930 0x7f545c073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T22:48:49.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.259+0000 7f5460c64700 1 --2- 172.21.15.47:0/505407692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545c106930 0x7f545c073090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T22:48:49.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.259+0000 7f545bfff700 1 -- 172.21.15.47:0/505407692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545c106930 msgr2=0x7f545c073090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T22:48:49.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.259+0000 7f545bfff700 1 --2- 172.21.15.47:0/505407692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545c106930 0x7f545c073090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:49.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.259+0000 7f545bfff700 1 -- 172.21.15.47:0/505407692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545000f9c0 con 0x7f545c0735d0 2024-09-13T22:48:49.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.260+0000 7f545bfff700 1 --2- 172.21.15.47:0/505407692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c0735d0 0x7f545c073a50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f544800b500 tx=0x7f544800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:49.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.260+0000 7f5459ffb700 1 -- 172.21.15.47:0/505407692 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5448011800 con 0x7f545c0735d0 2024-09-13T22:48:49.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.260+0000 7f5459ffb700 1 -- 172.21.15.47:0/505407692 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5448011e10 con 0x7f545c0735d0 2024-09-13T22:48:49.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.260+0000 7f5462ec8700 1 -- 172.21.15.47:0/505407692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f545c1a2380 con 0x7f545c0735d0 2024-09-13T22:48:49.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.260+0000 7f5459ffb700 1 -- 172.21.15.47:0/505407692 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f544800f2e0 con 0x7f545c0735d0 2024-09-13T22:48:49.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.260+0000 7f5462ec8700 1 -- 172.21.15.47:0/505407692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545c1a28d0 con 0x7f545c0735d0 2024-09-13T22:48:49.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.261+0000 7f5462ec8700 1 -- 172.21.15.47:0/505407692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f545c0623c0 con 0x7f545c0735d0 2024-09-13T22:48:49.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.262+0000 7f5459ffb700 1 -- 172.21.15.47:0/505407692 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90254+0+0 (secure 0 0 0) 0x7f544800f440 con 0x7f545c0735d0 2024-09-13T22:48:49.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.262+0000 7f5459ffb700 1 --2- 172.21.15.47:0/505407692 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f544006c5b0 0x7f544006ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:49.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.262+0000 7f5459ffb700 1 -- 172.21.15.47:0/505407692 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f5448089b00 con 0x7f545c0735d0 2024-09-13T22:48:49.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.263+0000 7f5460c64700 1 --2- 172.21.15.47:0/505407692 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f544006c5b0 0x7f544006ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:49.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.263+0000 7f5460c64700 1 --2- 172.21.15.47:0/505407692 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f544006c5b0 0x7f544006ea70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5450005ed0 tx=0x7f5450005da0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:49.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.267+0000 7f5459ffb700 1 -- 172.21.15.47:0/505407692 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f54480554f0 con 0x7f545c0735d0 2024-09-13T22:48:49.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T22:48:49.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: mon.smithi002 calling monitor election 2024-09-13T22:48:49.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:48:49.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:49.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:48:49.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:48:49.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: mon.smithi047 calling monitor election 2024-09-13T22:48:49.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.47:0/1720546613' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/crt"}]: dispatch 2024-09-13T22:48:49.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:49.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:48:49.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:48:49.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:48:49.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:48:49.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: mon.smithi002 is new leader, mons smithi002,smithi047 in quorum (ranks 0,1) 2024-09-13T22:48:49.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: monmap e2: 2 mons at {smithi002=[v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0],smithi047=[v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T22:48:49.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: fsmap 2024-09-13T22:48:49.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T22:48:49.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: mgrmap e17: smithi002.yumtzz(active, since 32s) 2024-09-13T22:48:49.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: Standby manager daemon smithi047.gcymvd started 2024-09-13T22:48:49.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.47:0/1720546613' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:48:49.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: overall HEALTH_OK 2024-09-13T22:48:49.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.47:0/1720546613' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/key"}]: dispatch 2024-09-13T22:48:49.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.47:0/1720546613' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:48:49.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:49.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:49.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:49.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:49.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:49 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:49.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.557+0000 7f5462ec8700 1 -- 172.21.15.47:0/505407692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f545c1a2d10 con 0x7f545c0735d0 2024-09-13T22:48:49.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.557+0000 7f5459ffb700 1 -- 172.21.15.47:0/505407692 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1014 (secure 0 0 0) 0x7f5448089370 con 0x7f545c0735d0 2024-09-13T22:48:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:48:49.559 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":2,"fsid":"e41042f8-7221-11ef-bceb-c7b262605968","modified":"2024-09-13T22:48:44.161311Z","created":"2024-09-13T22:46:07.590380Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi047","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T22:48:49.559 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T22:48:49.559 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: mon.smithi002 calling monitor election 2024-09-13T22:48:49.559 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:48:49.560 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:49.560 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:48:49.560 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:48:49.560 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: mon.smithi047 calling monitor election 2024-09-13T22:48:49.560 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/1720546613' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/crt"}]: dispatch 2024-09-13T22:48:49.561 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:49.561 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:48:49.561 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:48:49.561 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:48:49.561 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:48:49.561 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: mon.smithi002 is new leader, mons smithi002,smithi047 in quorum (ranks 0,1) 2024-09-13T22:48:49.562 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: monmap e2: 2 mons at {smithi002=[v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0],smithi047=[v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T22:48:49.562 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: fsmap 2024-09-13T22:48:49.562 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T22:48:49.562 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: mgrmap e17: smithi002.yumtzz(active, since 32s) 2024-09-13T22:48:49.562 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: Standby manager daemon smithi047.gcymvd started 2024-09-13T22:48:49.562 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/1720546613' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:48:49.563 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: overall HEALTH_OK 2024-09-13T22:48:49.563 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/1720546613' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/key"}]: dispatch 2024-09-13T22:48:49.563 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/1720546613' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:48:49.563 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:49.563 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:49.563 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:49.564 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:49.564 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:49 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:49.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.559+0000 7f5462ec8700 1 -- 172.21.15.47:0/505407692 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f544006c5b0 msgr2=0x7f544006ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:49.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.559+0000 7f5462ec8700 1 --2- 172.21.15.47:0/505407692 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f544006c5b0 0x7f544006ea70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5450005ed0 tx=0x7f5450005da0 comp rx=0 tx=0).stop 2024-09-13T22:48:49.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.559+0000 7f5462ec8700 1 -- 172.21.15.47:0/505407692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c0735d0 msgr2=0x7f545c073a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:49.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.559+0000 7f5462ec8700 1 --2- 172.21.15.47:0/505407692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c0735d0 0x7f545c073a50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f544800b500 tx=0x7f544800b8c0 comp rx=0 tx=0).stop 2024-09-13T22:48:49.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.559+0000 7f5462ec8700 1 -- 172.21.15.47:0/505407692 shutdown_connections 2024-09-13T22:48:49.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.559+0000 7f5462ec8700 1 --2- 172.21.15.47:0/505407692 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f544006c5b0 0x7f544006ea70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:49.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.559+0000 7f5462ec8700 1 --2- 172.21.15.47:0/505407692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f545c106930 0x7f545c073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:49.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.559+0000 7f5462ec8700 1 --2- 172.21.15.47:0/505407692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f545c0735d0 0x7f545c073a50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:49.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.559+0000 7f5462ec8700 1 -- 172.21.15.47:0/505407692 >> 172.21.15.47:0/505407692 conn(0x7f545c0fc400 msgr2=0x7f545c18e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:49.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.560+0000 7f5462ec8700 1 -- 172.21.15.47:0/505407692 shutdown_connections 2024-09-13T22:48:49.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:48:49.560+0000 7f5462ec8700 1 -- 172.21.15.47:0/505407692 wait complete. 2024-09-13T22:48:49.567 INFO:teuthology.orchestra.run.smithi047.stderr:dumped monmap epoch 2 2024-09-13T22:48:50.115 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-13T22:48:50.115 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-13T22:48:50.335 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:48:50.407 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:50 smithi047 ceph-mon[34560]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:50.407 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:50 smithi047 ceph-mon[34560]: mgrmap e18: smithi002.yumtzz(active, since 32s), standbys: smithi047.gcymvd 2024-09-13T22:48:50.407 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:50 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr metadata", "who": "smithi047.gcymvd", "id": "smithi047.gcymvd"}]: dispatch 2024-09-13T22:48:50.407 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:50 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:48:50.407 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:50 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/505407692' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:50.407 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:50 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:48:50.456 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:50 smithi002 ceph-mon[27637]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:50.457 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:50 smithi002 ceph-mon[27637]: mgrmap e18: smithi002.yumtzz(active, since 32s), standbys: smithi047.gcymvd 2024-09-13T22:48:50.457 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:50 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr metadata", "who": "smithi047.gcymvd", "id": "smithi047.gcymvd"}]: dispatch 2024-09-13T22:48:50.457 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:50 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:48:50.457 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:50 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/505407692' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T22:48:50.457 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:50 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:48:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.211+0000 7f5a3d2e0700 1 -- 172.21.15.2:0/2403430404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a381019c0 msgr2=0x7f5a38101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.211+0000 7f5a3d2e0700 1 --2- 172.21.15.2:0/2403430404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a381019c0 0x7f5a38101da0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009910 tx=0x7f5a28009c20 comp rx=0 tx=0).stop 2024-09-13T22:48:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.211+0000 7f5a3d2e0700 1 -- 172.21.15.2:0/2403430404 shutdown_connections 2024-09-13T22:48:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.211+0000 7f5a3d2e0700 1 --2- 172.21.15.2:0/2403430404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a381019c0 0x7f5a38101da0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.211+0000 7f5a3d2e0700 1 -- 172.21.15.2:0/2403430404 >> 172.21.15.2:0/2403430404 conn(0x7f5a380fb210 msgr2=0x7f5a380fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.211+0000 7f5a3d2e0700 1 -- 172.21.15.2:0/2403430404 shutdown_connections 2024-09-13T22:48:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.211+0000 7f5a3d2e0700 1 -- 172.21.15.2:0/2403430404 wait complete. 2024-09-13T22:48:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.211+0000 7f5a3d2e0700 1 Processor -- start 2024-09-13T22:48:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.212+0000 7f5a3d2e0700 1 -- start start 2024-09-13T22:48:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.212+0000 7f5a3d2e0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a381019c0 0x7f5a38195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.212+0000 7f5a3d2e0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a38196470 0x7f5a3819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.212+0000 7f5a3d2e0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a38196a90 con 0x7f5a38196470 2024-09-13T22:48:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.212+0000 7f5a3d2e0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a38196c00 con 0x7f5a381019c0 2024-09-13T22:48:52.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.212+0000 7f5a367fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a38196470 0x7f5a3819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:52.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.212+0000 7f5a367fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a38196470 0x7f5a3819a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34446/0 (socket says 172.21.15.2:34446) 2024-09-13T22:48:52.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.212+0000 7f5a367fc700 1 -- 172.21.15.2:0/3564791131 learned_addr learned my addr 172.21.15.2:0/3564791131 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:48:52.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.212+0000 7f5a36ffd700 1 --2- 172.21.15.2:0/3564791131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a381019c0 0x7f5a38195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:52.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.212+0000 7f5a36ffd700 1 -- 172.21.15.2:0/3564791131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a381019c0 msgr2=0x7f5a38195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-13T22:48:52.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.212+0000 7f5a36ffd700 1 -- 172.21.15.2:0/3564791131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a381019c0 msgr2=0x7f5a38195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T22:48:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.212+0000 7f5a36ffd700 1 --2- 172.21.15.2:0/3564791131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a381019c0 0x7f5a38195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T22:48:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.212+0000 7f5a36ffd700 1 --2- 172.21.15.2:0/3564791131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a381019c0 0x7f5a38195f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T22:48:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.212+0000 7f5a367fc700 1 -- 172.21.15.2:0/3564791131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a381019c0 msgr2=0x7f5a38195f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T22:48:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.212+0000 7f5a367fc700 1 --2- 172.21.15.2:0/3564791131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a381019c0 0x7f5a38195f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.212+0000 7f5a367fc700 1 -- 172.21.15.2:0/3564791131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a280095f0 con 0x7f5a38196470 2024-09-13T22:48:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.212+0000 7f5a367fc700 1 --2- 172.21.15.2:0/3564791131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a38196470 0x7f5a3819a8e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00b700 tx=0x7f5a2c00bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.213+0000 7f5a1ffff700 1 -- 172.21.15.2:0/3564791131 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a2c011800 con 0x7f5a38196470 2024-09-13T22:48:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.213+0000 7f5a1ffff700 1 -- 172.21.15.2:0/3564791131 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5a2c011e10 con 0x7f5a38196470 2024-09-13T22:48:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.213+0000 7f5a3d2e0700 1 -- 172.21.15.2:0/3564791131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3819aee0 con 0x7f5a38196470 2024-09-13T22:48:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.213+0000 7f5a1ffff700 1 -- 172.21.15.2:0/3564791131 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a2c00f2e0 con 0x7f5a38196470 2024-09-13T22:48:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.213+0000 7f5a3d2e0700 1 -- 172.21.15.2:0/3564791131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3819b430 con 0x7f5a38196470 2024-09-13T22:48:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.214+0000 7f5a3d2e0700 1 -- 172.21.15.2:0/3564791131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a381080b0 con 0x7f5a38196470 2024-09-13T22:48:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.214+0000 7f5a1ffff700 1 -- 172.21.15.2:0/3564791131 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90254+0+0 (secure 0 0 0) 0x7f5a2c010380 con 0x7f5a38196470 2024-09-13T22:48:52.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.215+0000 7f5a1ffff700 1 --2- 172.21.15.2:0/3564791131 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f5a2006c5c0 0x7f5a2006ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:48:52.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.215+0000 7f5a36ffd700 1 --2- 172.21.15.2:0/3564791131 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f5a2006c5c0 0x7f5a2006ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:48:52.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.215+0000 7f5a1ffff700 1 -- 172.21.15.2:0/3564791131 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f5a2c08a3a0 con 0x7f5a38196470 2024-09-13T22:48:52.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.215+0000 7f5a36ffd700 1 --2- 172.21.15.2:0/3564791131 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f5a2006c5c0 0x7f5a2006ea80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5a28006010 tx=0x7f5a2800b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:48:52.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.219+0000 7f5a1ffff700 1 -- 172.21.15.2:0/3564791131 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5a2c055cb0 con 0x7f5a38196470 2024-09-13T22:48:52.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.426+0000 7f5a3d2e0700 1 -- 172.21.15.2:0/3564791131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f5a38197290 con 0x7f5a38196470 2024-09-13T22:48:52.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.426+0000 7f5a1ffff700 1 -- 172.21.15.2:0/3564791131 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+221 (secure 0 0 0) 0x7f5a2c0592d0 con 0x7f5a38196470 2024-09-13T22:48:52.429 INFO:teuthology.orchestra.run.smithi002.stdout:# minimal ceph.conf for e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T22:48:52.429 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2024-09-13T22:48:52.429 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T22:48:52.429 INFO:teuthology.orchestra.run.smithi002.stdout: mon_host = [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] 2024-09-13T22:48:52.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.428+0000 7f5a3d2e0700 1 -- 172.21.15.2:0/3564791131 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f5a2006c5c0 msgr2=0x7f5a2006ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.428+0000 7f5a3d2e0700 1 --2- 172.21.15.2:0/3564791131 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f5a2006c5c0 0x7f5a2006ea80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5a28006010 tx=0x7f5a2800b540 comp rx=0 tx=0).stop 2024-09-13T22:48:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.428+0000 7f5a3d2e0700 1 -- 172.21.15.2:0/3564791131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a38196470 msgr2=0x7f5a3819a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:48:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.428+0000 7f5a3d2e0700 1 --2- 172.21.15.2:0/3564791131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a38196470 0x7f5a3819a8e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00b700 tx=0x7f5a2c00bac0 comp rx=0 tx=0).stop 2024-09-13T22:48:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.429+0000 7f5a3d2e0700 1 -- 172.21.15.2:0/3564791131 shutdown_connections 2024-09-13T22:48:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.429+0000 7f5a3d2e0700 1 --2- 172.21.15.2:0/3564791131 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f5a2006c5c0 0x7f5a2006ea80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.429+0000 7f5a3d2e0700 1 --2- 172.21.15.2:0/3564791131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a381019c0 0x7f5a38195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.429+0000 7f5a3d2e0700 1 --2- 172.21.15.2:0/3564791131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a38196470 0x7f5a3819a8e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:48:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.429+0000 7f5a3d2e0700 1 -- 172.21.15.2:0/3564791131 >> 172.21.15.2:0/3564791131 conn(0x7f5a380fb210 msgr2=0x7f5a381051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:48:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.429+0000 7f5a3d2e0700 1 -- 172.21.15.2:0/3564791131 shutdown_connections 2024-09-13T22:48:52.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:48:52.429+0000 7f5a3d2e0700 1 -- 172.21.15.2:0/3564791131 wait complete. 2024-09-13T22:48:52.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:52 smithi002 ceph-mon[27637]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:52.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:52 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:52.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:52 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:52.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:52 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:52.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:52 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:48:52.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:52 smithi002 ceph-mon[27637]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-13T22:48:52.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:52 smithi002 ceph-mon[27637]: Updating smithi047:/etc/ceph/ceph.conf 2024-09-13T22:48:52.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:52 smithi002 ceph-mon[27637]: Updating smithi047:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:48:52.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:52 smithi002 ceph-mon[27637]: Updating smithi002:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:48:52.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:52 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:52.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:52 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:52.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:52 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:52.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:52 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:52.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:52 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:52.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:52 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:52.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:52 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:48:52.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:52 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:48:52.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:52 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:52.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:52 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/3564791131' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:52.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:52 smithi047 ceph-mon[34560]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:52.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:52 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:52.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:52 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:52.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:52 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:52.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:52 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:48:52.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:52 smithi047 ceph-mon[34560]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-13T22:48:52.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:52 smithi047 ceph-mon[34560]: Updating smithi047:/etc/ceph/ceph.conf 2024-09-13T22:48:52.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:52 smithi047 ceph-mon[34560]: Updating smithi047:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:48:52.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:52 smithi047 ceph-mon[34560]: Updating smithi002:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:48:52.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:52 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:52.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:52 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:52.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:52 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:52.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:52 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:52.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:52 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:52.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:52 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:52.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:52 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:48:52.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:52 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:48:52.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:52 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:52.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:52 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/3564791131' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:53.206 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-13T22:48:53.207 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-13T22:48:53.207 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T22:48:53.235 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-13T22:48:53.236 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:48:53.303 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-13T22:48:53.303 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T22:48:53.337 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-13T22:48:53.337 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:48:53.408 INFO:tasks.cephadm:Deploying OSDs... 2024-09-13T22:48:53.408 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-13T22:48:53.408 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T22:48:53.425 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T22:48:53.425 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2024-09-13T22:48:53.482 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T22:48:53.482 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:48:53.482 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-13T22:48:53.482 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:48:53.482 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:48:53.482 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-13 22:48:08.408939518 +0000 2024-09-13T22:48:53.482 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-13 22:42:56.549519258 +0000 2024-09-13T22:48:53.483 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-13 22:42:56.549519258 +0000 2024-09-13T22:48:53.483 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-13 22:42:56.549519258 +0000 2024-09-13T22:48:53.483 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T22:48:53.555 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-13T22:48:53.555 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-13T22:48:53.555 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000108279 s, 4.7 MB/s 2024-09-13T22:48:53.556 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T22:48:53.614 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2024-09-13T22:48:53.671 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T22:48:53.672 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:48:53.672 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-13T22:48:53.672 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:48:53.672 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:48:53.672 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-13 22:48:08.409939495 +0000 2024-09-13T22:48:53.672 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-13 22:42:56.872511955 +0000 2024-09-13T22:48:53.672 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-13 22:42:56.872511955 +0000 2024-09-13T22:48:53.672 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-13 22:42:56.872511955 +0000 2024-09-13T22:48:53.672 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T22:48:53.737 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-13T22:48:53.737 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-13T22:48:53.737 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000107942 s, 4.7 MB/s 2024-09-13T22:48:53.739 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T22:48:53.797 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2024-09-13T22:48:53.853 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T22:48:53.853 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:48:53.853 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-13T22:48:53.853 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:48:53.853 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:48:53.853 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-13 22:48:08.409939495 +0000 2024-09-13T22:48:53.853 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-13 22:42:57.189504788 +0000 2024-09-13T22:48:53.853 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-13 22:42:57.189504788 +0000 2024-09-13T22:48:53.854 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-13 22:42:57.189504788 +0000 2024-09-13T22:48:53.854 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T22:48:53.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:53 smithi047 ceph-mon[34560]: Reconfiguring mon.smithi002 (unknown last config time)... 2024-09-13T22:48:53.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:53 smithi047 ceph-mon[34560]: Reconfiguring daemon mon.smithi002 on smithi002 2024-09-13T22:48:53.915 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:53 smithi002 ceph-mon[27637]: Reconfiguring mon.smithi002 (unknown last config time)... 2024-09-13T22:48:53.915 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:53 smithi002 ceph-mon[27637]: Reconfiguring daemon mon.smithi002 on smithi002 2024-09-13T22:48:53.917 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-13T22:48:53.917 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-13T22:48:53.918 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 9.9803e-05 s, 5.1 MB/s 2024-09-13T22:48:53.919 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T22:48:53.976 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2024-09-13T22:48:54.033 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T22:48:54.033 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:48:54.033 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-13T22:48:54.034 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:48:54.034 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:48:54.034 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-13 22:48:08.409939495 +0000 2024-09-13T22:48:54.034 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-13 22:42:57.524497215 +0000 2024-09-13T22:48:54.034 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-13 22:42:57.524497215 +0000 2024-09-13T22:48:54.034 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-13 22:42:57.524497215 +0000 2024-09-13T22:48:54.034 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T22:48:54.098 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-13T22:48:54.098 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-13T22:48:54.098 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 9.4903e-05 s, 5.4 MB/s 2024-09-13T22:48:54.099 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T22:48:54.157 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-13T22:48:54.157 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T22:48:54.177 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T22:48:54.177 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-09-13T22:48:54.236 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T22:48:54.237 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:48:54.237 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-13T22:48:54.237 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:48:54.237 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:48:54.237 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-13 22:48:43.592316045 +0000 2024-09-13T22:48:54.237 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-13 22:42:56.538408557 +0000 2024-09-13T22:48:54.237 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-13 22:42:56.538408557 +0000 2024-09-13T22:48:54.237 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-13 22:42:56.538408557 +0000 2024-09-13T22:48:54.237 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T22:48:54.304 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-13T22:48:54.304 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-13T22:48:54.304 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000110958 s, 4.6 MB/s 2024-09-13T22:48:54.306 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T22:48:54.366 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-09-13T22:48:54.424 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T22:48:54.424 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:48:54.424 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-13T22:48:54.424 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:48:54.424 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:48:54.425 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-13 22:48:43.592316045 +0000 2024-09-13T22:48:54.425 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-13 22:42:57.033398417 +0000 2024-09-13T22:48:54.425 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-13 22:42:57.033398417 +0000 2024-09-13T22:48:54.425 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-13 22:42:57.033398417 +0000 2024-09-13T22:48:54.425 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T22:48:54.491 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-13T22:48:54.491 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-13T22:48:54.491 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000116805 s, 4.4 MB/s 2024-09-13T22:48:54.492 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T22:48:54.550 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-09-13T22:48:54.608 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T22:48:54.608 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:48:54.608 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-13T22:48:54.608 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:48:54.608 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:48:54.608 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-13 22:48:43.593316024 +0000 2024-09-13T22:48:54.608 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-13 22:42:57.360391718 +0000 2024-09-13T22:48:54.608 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-13 22:42:57.360391718 +0000 2024-09-13T22:48:54.608 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-13 22:42:57.360391718 +0000 2024-09-13T22:48:54.609 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T22:48:54.674 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-13T22:48:54.674 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-13T22:48:54.674 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000114854 s, 4.5 MB/s 2024-09-13T22:48:54.675 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T22:48:54.733 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-09-13T22:48:54.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:54 smithi002 ceph-mon[27637]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:54.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:54 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:54.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:54 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:54.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:54 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.yumtzz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:48:54.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:54 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:48:54.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:54 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:54.790 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T22:48:54.790 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T22:48:54.790 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-13T22:48:54.790 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:48:54.790 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T22:48:54.790 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-13 22:48:43.593316024 +0000 2024-09-13T22:48:54.790 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-13 22:42:57.691384937 +0000 2024-09-13T22:48:54.790 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-13 22:42:57.691384937 +0000 2024-09-13T22:48:54.790 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-13 22:42:57.691384937 +0000 2024-09-13T22:48:54.790 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T22:48:54.854 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-13T22:48:54.854 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-13T22:48:54.854 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000111548 s, 4.6 MB/s 2024-09-13T22:48:54.855 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:54 smithi047 ceph-mon[34560]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:54.855 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:54 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:54.855 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:54 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:54.855 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:54 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.yumtzz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:48:54.855 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:54 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:48:54.855 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:54 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:54.856 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T22:48:54.913 INFO:tasks.cephadm:Deploying osd.0 on smithi002 with /dev/vg_nvme/lv_4... 2024-09-13T22:48:54.914 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T22:48:55.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:55 smithi002 ceph-mon[27637]: Reconfiguring mgr.smithi002.yumtzz (unknown last config time)... 2024-09-13T22:48:55.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:55 smithi002 ceph-mon[27637]: Reconfiguring daemon mgr.smithi002.yumtzz on smithi002 2024-09-13T22:48:55.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:55 smithi047 ceph-mon[34560]: Reconfiguring mgr.smithi002.yumtzz (unknown last config time)... 2024-09-13T22:48:55.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:55 smithi047 ceph-mon[34560]: Reconfiguring daemon mgr.smithi002.yumtzz on smithi002 2024-09-13T22:48:56.054 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:48:57.196 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:56 smithi002 ceph-mon[27637]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:57.197 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:56 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:57.197 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:56 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:57.197 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:56 smithi002 ceph-mon[27637]: Reconfiguring ceph-exporter.smithi002 (monmap changed)... 2024-09-13T22:48:57.197 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:56 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi002", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:48:57.197 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:56 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:57.197 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:56 smithi002 ceph-mon[27637]: Reconfiguring daemon ceph-exporter.smithi002 on smithi002 2024-09-13T22:48:57.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:56 smithi047 ceph-mon[34560]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:57.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:56 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:57.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:56 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:57.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:56 smithi047 ceph-mon[34560]: Reconfiguring ceph-exporter.smithi002 (monmap changed)... 2024-09-13T22:48:57.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:56 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi002", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:48:57.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:56 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:57.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:56 smithi047 ceph-mon[34560]: Reconfiguring daemon ceph-exporter.smithi002 on smithi002 2024-09-13T22:48:59.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:58 smithi002 ceph-mon[27637]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:59.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:58 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:59.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:58 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:59.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:58 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:48:59.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:58 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:59.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:58 smithi047 ceph-mon[34560]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:48:59.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:58 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:59.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:58 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:48:59.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:58 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:48:59.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:58 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:48:59.871 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:48:59.893 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_4 2024-09-13T22:49:00.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:59 smithi002 ceph-mon[27637]: Reconfiguring crash.smithi002 (monmap changed)... 2024-09-13T22:49:00.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:48:59 smithi002 ceph-mon[27637]: Reconfiguring daemon crash.smithi002 on smithi002 2024-09-13T22:49:00.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:59 smithi047 ceph-mon[34560]: Reconfiguring crash.smithi002 (monmap changed)... 2024-09-13T22:49:00.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:48:59 smithi047 ceph-mon[34560]: Reconfiguring daemon crash.smithi002 on smithi002 2024-09-13T22:49:00.997 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:49:01.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:00 smithi002 ceph-mon[27637]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:01.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:00 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:01.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:00 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:01.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:00 smithi047 ceph-mon[34560]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:01.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:00 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:01.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:00 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:02.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:01 smithi002 ceph-mon[27637]: Reconfiguring alertmanager.smithi002 (dependencies changed)... 2024-09-13T22:49:02.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:01 smithi002 ceph-mon[27637]: Reconfiguring daemon alertmanager.smithi002 on smithi002 2024-09-13T22:49:02.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:01 smithi047 ceph-mon[34560]: Reconfiguring alertmanager.smithi002 (dependencies changed)... 2024-09-13T22:49:02.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:01 smithi047 ceph-mon[34560]: Reconfiguring daemon alertmanager.smithi002 on smithi002 2024-09-13T22:49:03.140 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:02 smithi002 ceph-mon[27637]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:03.140 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:02 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:49:03.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:02 smithi047 ceph-mon[34560]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:03.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:02 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:49:03.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.365+0000 7f0b627a8700 1 -- 172.21.15.2:0/1301869927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b5c1017b0 msgr2=0x7f0b5c103ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:49:03.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.365+0000 7f0b627a8700 1 --2- 172.21.15.2:0/1301869927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b5c1017b0 0x7f0b5c103ba0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009910 tx=0x7f0b4c009c20 comp rx=0 tx=0).stop 2024-09-13T22:49:03.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.365+0000 7f0b627a8700 1 -- 172.21.15.2:0/1301869927 shutdown_connections 2024-09-13T22:49:03.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.365+0000 7f0b627a8700 1 --2- 172.21.15.2:0/1301869927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c1040e0 0x7f0b5c1064d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:49:03.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.365+0000 7f0b627a8700 1 --2- 172.21.15.2:0/1301869927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b5c1017b0 0x7f0b5c103ba0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:49:03.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.365+0000 7f0b627a8700 1 -- 172.21.15.2:0/1301869927 >> 172.21.15.2:0/1301869927 conn(0x7f0b5c0fb160 msgr2=0x7f0b5c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:49:03.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.365+0000 7f0b627a8700 1 -- 172.21.15.2:0/1301869927 shutdown_connections 2024-09-13T22:49:03.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.365+0000 7f0b627a8700 1 -- 172.21.15.2:0/1301869927 wait complete. 2024-09-13T22:49:03.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.366+0000 7f0b627a8700 1 Processor -- start 2024-09-13T22:49:03.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.366+0000 7f0b627a8700 1 -- start start 2024-09-13T22:49:03.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.366+0000 7f0b627a8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c1017b0 0x7f0b5c1967b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:49:03.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.366+0000 7f0b627a8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b5c1040e0 0x7f0b5c196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:49:03.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.366+0000 7f0b627a8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c197310 con 0x7f0b5c1040e0 2024-09-13T22:49:03.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.366+0000 7f0b627a8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c197450 con 0x7f0b5c1017b0 2024-09-13T22:49:03.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.366+0000 7f0b53fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b5c1040e0 0x7f0b5c196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:49:03.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.366+0000 7f0b53fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b5c1040e0 0x7f0b5c196cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34124/0 (socket says 172.21.15.2:34124) 2024-09-13T22:49:03.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.366+0000 7f0b53fff700 1 -- 172.21.15.2:0/195004764 learned_addr learned my addr 172.21.15.2:0/195004764 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:49:03.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.366+0000 7f0b5bfff700 1 --2- 172.21.15.2:0/195004764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c1017b0 0x7f0b5c1967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:49:03.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.367+0000 7f0b53fff700 1 -- 172.21.15.2:0/195004764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c1017b0 msgr2=0x7f0b5c1967b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:49:03.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.367+0000 7f0b53fff700 1 --2- 172.21.15.2:0/195004764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c1017b0 0x7f0b5c1967b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:49:03.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.367+0000 7f0b53fff700 1 -- 172.21.15.2:0/195004764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c0095f0 con 0x7f0b5c1040e0 2024-09-13T22:49:03.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.367+0000 7f0b53fff700 1 --2- 172.21.15.2:0/195004764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b5c1040e0 0x7f0b5c196cf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400e940 tx=0x7f0b4400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:49:03.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.367+0000 7f0b59ffb700 1 -- 172.21.15.2:0/195004764 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b4400cba0 con 0x7f0b5c1040e0 2024-09-13T22:49:03.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.367+0000 7f0b59ffb700 1 -- 172.21.15.2:0/195004764 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0b4400ee90 con 0x7f0b5c1040e0 2024-09-13T22:49:03.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.367+0000 7f0b627a8700 1 -- 172.21.15.2:0/195004764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c19bf00 con 0x7f0b5c1040e0 2024-09-13T22:49:03.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.367+0000 7f0b59ffb700 1 -- 172.21.15.2:0/195004764 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b44005650 con 0x7f0b5c1040e0 2024-09-13T22:49:03.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.367+0000 7f0b627a8700 1 -- 172.21.15.2:0/195004764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c19c420 con 0x7f0b5c1040e0 2024-09-13T22:49:03.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.369+0000 7f0b627a8700 1 -- 172.21.15.2:0/195004764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5c190650 con 0x7f0b5c1040e0 2024-09-13T22:49:03.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.369+0000 7f0b59ffb700 1 -- 172.21.15.2:0/195004764 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90254+0+0 (secure 0 0 0) 0x7f0b44004750 con 0x7f0b5c1040e0 2024-09-13T22:49:03.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.369+0000 7f0b59ffb700 1 --2- 172.21.15.2:0/195004764 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f0b4806c470 0x7f0b4806e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:49:03.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.369+0000 7f0b59ffb700 1 -- 172.21.15.2:0/195004764 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f0b44014070 con 0x7f0b5c1040e0 2024-09-13T22:49:03.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.369+0000 7f0b5bfff700 1 --2- 172.21.15.2:0/195004764 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f0b4806c470 0x7f0b4806e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:49:03.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.370+0000 7f0b5bfff700 1 --2- 172.21.15.2:0/195004764 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f0b4806c470 0x7f0b4806e930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00b6f0 tx=0x7f0b4c005a90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:49:03.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.374+0000 7f0b59ffb700 1 -- 172.21.15.2:0/195004764 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0b44059d20 con 0x7f0b5c1040e0 2024-09-13T22:49:03.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:03.582+0000 7f0b627a8700 1 -- 172.21.15.2:0/195004764 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b5c02cf70 con 0x7f0b4806c470 2024-09-13T22:49:04.063 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:04 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:49:04.063 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:04 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:49:04.063 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:04 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:04.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:04 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:49:04.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:04 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:49:04.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:04 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:05.259 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:05 smithi002 ceph-mon[27637]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:05.259 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:05 smithi002 ceph-mon[27637]: from='client.14248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:05.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:05 smithi047 ceph-mon[34560]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:05.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:05 smithi047 ceph-mon[34560]: from='client.14248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:07.192 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:07 smithi002 ceph-mon[27637]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:07.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:07 smithi047 ceph-mon[34560]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:09.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:09 smithi047 ceph-mon[34560]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:09.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:09 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:09.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:09 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:09.455 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:09 smithi002 ceph-mon[27637]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:09.455 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:09 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:09.455 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:09 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:10.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:10 smithi047 ceph-mon[34560]: Reconfiguring grafana.smithi002 (dependencies changed)... 2024-09-13T22:49:10.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:10 smithi047 ceph-mon[34560]: Reconfiguring daemon grafana.smithi002 on smithi002 2024-09-13T22:49:10.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:10 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/2126393487' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c671c42-9846-4f40-ba31-8acc1c184352"}]: dispatch 2024-09-13T22:49:10.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:10 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/2126393487' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c671c42-9846-4f40-ba31-8acc1c184352"}]': finished 2024-09-13T22:49:10.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:10 smithi047 ceph-mon[34560]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T22:49:10.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:10 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:49:10.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:10 smithi002 ceph-mon[27637]: Reconfiguring grafana.smithi002 (dependencies changed)... 2024-09-13T22:49:10.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:10 smithi002 ceph-mon[27637]: Reconfiguring daemon grafana.smithi002 on smithi002 2024-09-13T22:49:10.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:10 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2126393487' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c671c42-9846-4f40-ba31-8acc1c184352"}]: dispatch 2024-09-13T22:49:10.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:10 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2126393487' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c671c42-9846-4f40-ba31-8acc1c184352"}]': finished 2024-09-13T22:49:10.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:10 smithi002 ceph-mon[27637]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T22:49:10.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:10 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:49:11.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:11 smithi047 ceph-mon[34560]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:11.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:11 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/3417348247' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:49:11.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:11 smithi002 ceph-mon[27637]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:11.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:11 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/3417348247' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:49:13.044 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:13 smithi002 ceph-mon[27637]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:13.388 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:13 smithi047 ceph-mon[34560]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:15.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:15 smithi002 ceph-mon[27637]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:15.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:15 smithi047 ceph-mon[34560]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:17.049 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:17 smithi002 ceph-mon[27637]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:17.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:17 smithi047 ceph-mon[34560]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:18.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:18 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:49:18.394 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:18 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:49:19.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:19 smithi002 ceph-mon[27637]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:19.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:19 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:19.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:19 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:19.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:19 smithi047 ceph-mon[34560]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:19.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:19 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:19.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:19 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:20.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:20 smithi002 ceph-mon[27637]: Reconfiguring prometheus.smithi002 (dependencies changed)... 2024-09-13T22:49:20.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:20 smithi002 ceph-mon[27637]: Reconfiguring daemon prometheus.smithi002 on smithi002 2024-09-13T22:49:20.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:20 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T22:49:20.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:20 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:20.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:20 smithi047 ceph-mon[34560]: Reconfiguring prometheus.smithi002 (dependencies changed)... 2024-09-13T22:49:20.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:20 smithi047 ceph-mon[34560]: Reconfiguring daemon prometheus.smithi002 on smithi002 2024-09-13T22:49:20.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:20 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T22:49:20.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:20 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:21.161 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:21 smithi002 ceph-mon[27637]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:21.162 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:21 smithi002 ceph-mon[27637]: Deploying daemon osd.0 on smithi002 2024-09-13T22:49:21.314 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:21 smithi047 ceph-mon[34560]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:21.314 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:21 smithi047 ceph-mon[34560]: Deploying daemon osd.0 on smithi002 2024-09-13T22:49:23.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:23 smithi002 ceph-mon[27637]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:23.401 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:23 smithi047 ceph-mon[34560]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:25.341 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:25 smithi002 ceph-mon[27637]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:25.341 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:25 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:25.341 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:25 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:25.342 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:25 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi047", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:49:25.342 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:25 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:25.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:25 smithi047 ceph-mon[34560]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:25.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:25 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:25.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:25 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:25.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:25 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi047", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T22:49:25.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:25 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:26.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:26 smithi002 ceph-mon[27637]: Reconfiguring ceph-exporter.smithi047 (monmap changed)... 2024-09-13T22:49:26.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:26 smithi002 ceph-mon[27637]: Reconfiguring daemon ceph-exporter.smithi047 on smithi047 2024-09-13T22:49:26.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:26 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:26.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:26 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:26.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:26 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi047", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:49:26.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:26 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:26.296 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:26 smithi047 ceph-mon[34560]: Reconfiguring ceph-exporter.smithi047 (monmap changed)... 2024-09-13T22:49:26.296 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:26 smithi047 ceph-mon[34560]: Reconfiguring daemon ceph-exporter.smithi047 on smithi047 2024-09-13T22:49:26.296 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:26 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:26.296 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:26 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:26.296 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:26 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi047", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T22:49:26.296 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:26 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:27.181 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:27 smithi047 ceph-mon[34560]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:27.181 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:27 smithi047 ceph-mon[34560]: Reconfiguring crash.smithi047 (monmap changed)... 2024-09-13T22:49:27.182 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:27 smithi047 ceph-mon[34560]: Reconfiguring daemon crash.smithi047 on smithi047 2024-09-13T22:49:27.212 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:27 smithi002 ceph-mon[27637]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:27.212 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:27 smithi002 ceph-mon[27637]: Reconfiguring crash.smithi047 (monmap changed)... 2024-09-13T22:49:27.212 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:27 smithi002 ceph-mon[27637]: Reconfiguring daemon crash.smithi047 on smithi047 2024-09-13T22:49:28.336 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:28 smithi047 ceph-mon[34560]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:28.336 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:28 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:28.336 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:28 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:28.336 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:28 smithi047 ceph-mon[34560]: Reconfiguring mgr.smithi047.gcymvd (monmap changed)... 2024-09-13T22:49:28.336 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:28 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.gcymvd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:49:28.336 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:28 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:49:28.336 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:28 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:28.336 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:28 smithi047 ceph-mon[34560]: Reconfiguring daemon mgr.smithi047.gcymvd on smithi047 2024-09-13T22:49:28.460 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:28 smithi002 ceph-mon[27637]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:28.460 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:28 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:28.460 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:28 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:28.460 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:28 smithi002 ceph-mon[27637]: Reconfiguring mgr.smithi047.gcymvd (monmap changed)... 2024-09-13T22:49:28.460 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:28 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.gcymvd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:49:28.460 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:28 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:49:28.460 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:28 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:28.460 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:28 smithi002 ceph-mon[27637]: Reconfiguring daemon mgr.smithi047.gcymvd on smithi047 2024-09-13T22:49:29.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:29 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:29.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:29 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:29.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:29 smithi047 ceph-mon[34560]: Reconfiguring mon.smithi047 (monmap changed)... 2024-09-13T22:49:29.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:29 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:49:29.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:29 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:49:29.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:29 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:29.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:29 smithi047 ceph-mon[34560]: Reconfiguring daemon mon.smithi047 on smithi047 2024-09-13T22:49:29.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:29 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:29.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:29 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:29.970 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:29 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:29.970 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:29 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:29.970 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:29 smithi002 ceph-mon[27637]: Reconfiguring mon.smithi047 (monmap changed)... 2024-09-13T22:49:29.970 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:29 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:49:29.970 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:29 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:49:29.970 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:29 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:29.970 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:29 smithi002 ceph-mon[27637]: Reconfiguring daemon mon.smithi047 on smithi047 2024-09-13T22:49:29.970 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:29 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:29.971 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:29 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:31.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:31 smithi047 ceph-mon[34560]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:31.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:31 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:31.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:31 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:31.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:31 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T22:49:31.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:31 smithi047 ceph-mon[34560]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T22:49:31.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:31 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi002.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T22:49:31.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:31 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:31.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:31 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T22:49:31.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:31 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi002.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T22:49:31.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:31 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:31.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:31 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:49:31.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:31 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi002.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T22:49:31.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:31 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:31.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:31 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:49:31.471 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:31 smithi002 ceph-mon[27637]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:31.472 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:31 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:31.472 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:31 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:31.472 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:31 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T22:49:31.472 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:31 smithi002 ceph-mon[27637]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T22:49:31.473 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:31 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi002.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T22:49:31.473 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:31 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:31.473 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:31 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T22:49:31.473 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:31 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi002.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T22:49:31.473 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:31 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:31.473 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:31 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:49:31.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:31 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi002.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T22:49:31.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:31 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:31.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:31 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:49:32.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:32 smithi002 ceph-mon[27637]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi002.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T22:49:32.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:32 smithi002 ceph-mon[27637]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T22:49:32.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:32 smithi002 ceph-mon[27637]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi002.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T22:49:32.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:32 smithi002 ceph-mon[27637]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:49:32.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:32 smithi002 ceph-mon[27637]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi002.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T22:49:32.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:32 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:32.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:32 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:32.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:32 smithi047 ceph-mon[34560]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi002.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T22:49:32.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:32 smithi047 ceph-mon[34560]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T22:49:32.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:32 smithi047 ceph-mon[34560]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi002.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T22:49:32.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:32 smithi047 ceph-mon[34560]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:49:32.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:32 smithi047 ceph-mon[34560]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi002.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T22:49:32.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:32 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:32.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:32 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:32.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:32.663+0000 7f0b59ffb700 1 -- 172.21.15.2:0/195004764 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0b5c02cf70 con 0x7f0b4806c470 2024-09-13T22:49:32.664 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 0 on host 'smithi002' 2024-09-13T22:49:32.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:32.665+0000 7f0b627a8700 1 -- 172.21.15.2:0/195004764 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f0b4806c470 msgr2=0x7f0b4806e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:49:32.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:32.665+0000 7f0b627a8700 1 --2- 172.21.15.2:0/195004764 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f0b4806c470 0x7f0b4806e930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00b6f0 tx=0x7f0b4c005a90 comp rx=0 tx=0).stop 2024-09-13T22:49:32.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:32.665+0000 7f0b627a8700 1 -- 172.21.15.2:0/195004764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b5c1040e0 msgr2=0x7f0b5c196cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:49:32.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:32.665+0000 7f0b627a8700 1 --2- 172.21.15.2:0/195004764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b5c1040e0 0x7f0b5c196cf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400e940 tx=0x7f0b4400ec50 comp rx=0 tx=0).stop 2024-09-13T22:49:32.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:32.665+0000 7f0b627a8700 1 -- 172.21.15.2:0/195004764 shutdown_connections 2024-09-13T22:49:32.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:32.665+0000 7f0b627a8700 1 --2- 172.21.15.2:0/195004764 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f0b4806c470 0x7f0b4806e930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:49:32.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:32.665+0000 7f0b627a8700 1 --2- 172.21.15.2:0/195004764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b5c1017b0 0x7f0b5c1967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:49:32.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:32.665+0000 7f0b627a8700 1 --2- 172.21.15.2:0/195004764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b5c1040e0 0x7f0b5c196cf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:49:32.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:32.665+0000 7f0b627a8700 1 -- 172.21.15.2:0/195004764 >> 172.21.15.2:0/195004764 conn(0x7f0b5c0fb160 msgr2=0x7f0b5c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:49:32.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:32.665+0000 7f0b627a8700 1 -- 172.21.15.2:0/195004764 shutdown_connections 2024-09-13T22:49:32.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:32.665+0000 7f0b627a8700 1 -- 172.21.15.2:0/195004764 wait complete. 2024-09-13T22:49:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:33 smithi002 ceph-mon[27637]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:33 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:49:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:33 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:33 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:33.304 DEBUG:teuthology.orchestra.run.smithi002:osd.0> sudo journalctl -f -n 0 -u ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.0.service 2024-09-13T22:49:33.306 INFO:tasks.cephadm:Deploying osd.1 on smithi002 with /dev/vg_nvme/lv_3... 2024-09-13T22:49:33.307 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-13T22:49:33.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:33 smithi047 ceph-mon[34560]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:33.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:33 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:49:33.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:33 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:33.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:33 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:49:34.395 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:34 smithi002 ceph-mon[27637]: from='osd.0 [v2:172.21.15.2:6802/3953793391,v1:172.21.15.2:6803/3953793391]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T22:49:34.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:34 smithi047 ceph-mon[34560]: from='osd.0 [v2:172.21.15.2:6802/3953793391,v1:172.21.15.2:6803/3953793391]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T22:49:35.312 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:35 smithi002 ceph-mon[27637]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:35.312 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:35 smithi002 ceph-mon[27637]: from='osd.0 [v2:172.21.15.2:6802/3953793391,v1:172.21.15.2:6803/3953793391]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T22:49:35.312 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:35 smithi002 ceph-mon[27637]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T22:49:35.312 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:35 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:49:35.313 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:35 smithi002 ceph-mon[27637]: from='osd.0 [v2:172.21.15.2:6802/3953793391,v1:172.21.15.2:6803/3953793391]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-13T22:49:35.313 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 22:49:35 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0[46175]: 2024-09-13T22:49:35.114+0000 7fb0674f0700 -1 osd.0 0 waiting for initial osdmap 2024-09-13T22:49:35.313 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 22:49:35 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0[46175]: 2024-09-13T22:49:35.118+0000 7fb0632e5700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:49:35.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:35 smithi047 ceph-mon[34560]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:35.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:35 smithi047 ceph-mon[34560]: from='osd.0 [v2:172.21.15.2:6802/3953793391,v1:172.21.15.2:6803/3953793391]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T22:49:35.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:35 smithi047 ceph-mon[34560]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T22:49:35.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:35 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:49:35.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:35 smithi047 ceph-mon[34560]: from='osd.0 [v2:172.21.15.2:6802/3953793391,v1:172.21.15.2:6803/3953793391]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-13T22:49:36.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:36 smithi002 ceph-mon[27637]: from='osd.0 [v2:172.21.15.2:6802/3953793391,v1:172.21.15.2:6803/3953793391]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-13T22:49:36.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:36 smithi002 ceph-mon[27637]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T22:49:36.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:36 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:49:36.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:36 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:49:36.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:36 smithi047 ceph-mon[34560]: from='osd.0 [v2:172.21.15.2:6802/3953793391,v1:172.21.15.2:6803/3953793391]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-13T22:49:36.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:36 smithi047 ceph-mon[34560]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T22:49:36.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:36 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:49:36.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:36 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:49:37.022 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:49:37.042 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_3 2024-09-13T22:49:37.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:37 smithi047 ceph-mon[34560]: purged_snaps scrub starts 2024-09-13T22:49:37.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:37 smithi047 ceph-mon[34560]: purged_snaps scrub ok 2024-09-13T22:49:37.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:37 smithi047 ceph-mon[34560]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:37.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:37 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:49:37.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:37 smithi047 ceph-mon[34560]: osd.0 [v2:172.21.15.2:6802/3953793391,v1:172.21.15.2:6803/3953793391] boot 2024-09-13T22:49:37.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:37 smithi047 ceph-mon[34560]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T22:49:37.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:37 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:49:37.454 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:49:37.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:37 smithi002 ceph-mon[27637]: purged_snaps scrub starts 2024-09-13T22:49:37.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:37 smithi002 ceph-mon[27637]: purged_snaps scrub ok 2024-09-13T22:49:37.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:37 smithi002 ceph-mon[27637]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T22:49:37.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:37 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:49:37.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:37 smithi002 ceph-mon[27637]: osd.0 [v2:172.21.15.2:6802/3953793391,v1:172.21.15.2:6803/3953793391] boot 2024-09-13T22:49:37.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:37 smithi002 ceph-mon[27637]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T22:49:37.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:37 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:49:38.366 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:38 smithi002 ceph-mon[27637]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T22:49:38.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:38 smithi047 ceph-mon[34560]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T22:49:39.180 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:39 smithi002 ceph-mon[27637]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:39.180 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:39 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:39.180 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:39 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:39.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:39 smithi047 ceph-mon[34560]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:39.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:39 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:39.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:39 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:39.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.719+0000 7f6d1ca42700 1 -- 172.21.15.2:0/3860692265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18104060 msgr2=0x7f6d18106450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:49:39.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.719+0000 7f6d1ca42700 1 --2- 172.21.15.2:0/3860692265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18104060 0x7f6d18106450 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c009910 tx=0x7f6d0c009c20 comp rx=0 tx=0).stop 2024-09-13T22:49:39.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.720+0000 7f6d1ca42700 1 -- 172.21.15.2:0/3860692265 shutdown_connections 2024-09-13T22:49:39.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.720+0000 7f6d1ca42700 1 --2- 172.21.15.2:0/3860692265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18104060 0x7f6d18106450 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:49:39.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.720+0000 7f6d1ca42700 1 --2- 172.21.15.2:0/3860692265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d18101730 0x7f6d18103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:49:39.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.720+0000 7f6d1ca42700 1 -- 172.21.15.2:0/3860692265 >> 172.21.15.2:0/3860692265 conn(0x7f6d180fb120 msgr2=0x7f6d180fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:49:39.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.720+0000 7f6d1ca42700 1 -- 172.21.15.2:0/3860692265 shutdown_connections 2024-09-13T22:49:39.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.720+0000 7f6d1ca42700 1 -- 172.21.15.2:0/3860692265 wait complete. 2024-09-13T22:49:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.721+0000 7f6d1ca42700 1 Processor -- start 2024-09-13T22:49:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.721+0000 7f6d1ca42700 1 -- start start 2024-09-13T22:49:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.721+0000 7f6d1ca42700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d18101730 0x7f6d181986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:49:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.721+0000 7f6d1ca42700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18104060 0x7f6d18198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:49:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.721+0000 7f6d1ca42700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d18199210 con 0x7f6d18104060 2024-09-13T22:49:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.721+0000 7f6d1ca42700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d18199350 con 0x7f6d18101730 2024-09-13T22:49:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.721+0000 7f6d15d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18104060 0x7f6d18198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:49:39.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.721+0000 7f6d15d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18104060 0x7f6d18198bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41476/0 (socket says 172.21.15.2:41476) 2024-09-13T22:49:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.721+0000 7f6d15d9b700 1 -- 172.21.15.2:0/3273584647 learned_addr learned my addr 172.21.15.2:0/3273584647 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:49:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.721+0000 7f6d1659c700 1 --2- 172.21.15.2:0/3273584647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d18101730 0x7f6d181986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:49:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.721+0000 7f6d15d9b700 1 -- 172.21.15.2:0/3273584647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d18101730 msgr2=0x7f6d181986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:49:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.721+0000 7f6d15d9b700 1 --2- 172.21.15.2:0/3273584647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d18101730 0x7f6d181986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:49:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.721+0000 7f6d15d9b700 1 -- 172.21.15.2:0/3273584647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c0095f0 con 0x7f6d18104060 2024-09-13T22:49:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.721+0000 7f6d1659c700 1 --2- 172.21.15.2:0/3273584647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d18101730 0x7f6d181986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:49:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.722+0000 7f6d15d9b700 1 --2- 172.21.15.2:0/3273584647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18104060 0x7f6d18198bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c000c00 tx=0x7f6d0c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:49:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.722+0000 7f6d077fe700 1 -- 172.21.15.2:0/3273584647 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d0c01d070 con 0x7f6d18104060 2024-09-13T22:49:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.722+0000 7f6d077fe700 1 -- 172.21.15.2:0/3273584647 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6d0c005dc0 con 0x7f6d18104060 2024-09-13T22:49:39.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.722+0000 7f6d077fe700 1 -- 172.21.15.2:0/3273584647 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d0c0226a0 con 0x7f6d18104060 2024-09-13T22:49:39.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.722+0000 7f6d1ca42700 1 -- 172.21.15.2:0/3273584647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d1819dda0 con 0x7f6d18104060 2024-09-13T22:49:39.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.723+0000 7f6d1ca42700 1 -- 172.21.15.2:0/3273584647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d1819e210 con 0x7f6d18104060 2024-09-13T22:49:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.724+0000 7f6d1ca42700 1 -- 172.21.15.2:0/3273584647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d180fcd10 con 0x7f6d18104060 2024-09-13T22:49:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.724+0000 7f6d077fe700 1 -- 172.21.15.2:0/3273584647 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90254+0+0 (secure 0 0 0) 0x7f6d0c003680 con 0x7f6d18104060 2024-09-13T22:49:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.725+0000 7f6d077fe700 1 --2- 172.21.15.2:0/3273584647 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f6d0006c460 0x7f6d0006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:49:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.725+0000 7f6d077fe700 1 -- 172.21.15.2:0/3273584647 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1810+0+0 (secure 0 0 0) 0x7f6d0c08bec0 con 0x7f6d18104060 2024-09-13T22:49:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.725+0000 7f6d1659c700 1 --2- 172.21.15.2:0/3273584647 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f6d0006c460 0x7f6d0006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:49:39.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.725+0000 7f6d1659c700 1 --2- 172.21.15.2:0/3273584647 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f6d0006c460 0x7f6d0006e920 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009cb0 tx=0x7f6d08009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:49:39.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.730+0000 7f6d077fe700 1 -- 172.21.15.2:0/3273584647 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f6d0c05b050 con 0x7f6d18104060 2024-09-13T22:49:39.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:49:39.944+0000 7f6d1ca42700 1 -- 172.21.15.2:0/3273584647 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d180611d0 con 0x7f6d0006c460 2024-09-13T22:49:40.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:40 smithi002 ceph-mon[27637]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:40.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:40 smithi002 ceph-mon[27637]: from='client.14266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:40.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:40 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:49:40.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:40 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:49:40.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:40 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:40.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:40 smithi047 ceph-mon[34560]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:40.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:40 smithi047 ceph-mon[34560]: from='client.14266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:49:40.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:40 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:49:40.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:40 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:49:40.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:40 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:43.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:42 smithi002 ceph-mon[27637]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:43.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:42 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:43.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:42 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:43.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:42 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:49:43.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:42 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:43.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:42 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:43.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:42 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:49:43.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:42 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:43.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:42 smithi047 ceph-mon[34560]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:43.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:42 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:43.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:42 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:43.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:42 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:49:43.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:42 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:43.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:42 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:43.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:42 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:49:43.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:42 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:44.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:43 smithi047 ceph-mon[34560]: Detected new or changed devices on smithi002 2024-09-13T22:49:44.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:43 smithi047 ceph-mon[34560]: Adjusting osd_memory_target on smithi002 to 11844M 2024-09-13T22:49:44.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:43 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:49:44.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:43 smithi002 ceph-mon[27637]: Detected new or changed devices on smithi002 2024-09-13T22:49:44.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:43 smithi002 ceph-mon[27637]: Adjusting osd_memory_target on smithi002 to 11844M 2024-09-13T22:49:44.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:43 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:49:44.935 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:44 smithi002 ceph-mon[27637]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:44.935 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:44 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/1040992832' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e6b4859-b5cf-4548-8a37-9f836fdab3ad"}]: dispatch 2024-09-13T22:49:44.935 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:44 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/1040992832' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e6b4859-b5cf-4548-8a37-9f836fdab3ad"}]': finished 2024-09-13T22:49:44.936 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:44 smithi002 ceph-mon[27637]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T22:49:44.936 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:44 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:49:44.936 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:44 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:45.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:44 smithi047 ceph-mon[34560]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:45.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:44 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/1040992832' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e6b4859-b5cf-4548-8a37-9f836fdab3ad"}]: dispatch 2024-09-13T22:49:45.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:44 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/1040992832' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e6b4859-b5cf-4548-8a37-9f836fdab3ad"}]': finished 2024-09-13T22:49:45.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:44 smithi047 ceph-mon[34560]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T22:49:45.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:49:45.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:46.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:45 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:46.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:45 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/419866887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:49:46.244 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:45 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:46.244 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:45 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/419866887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:49:47.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:46 smithi047 ceph-mon[34560]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:47.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:46 smithi002 ceph-mon[27637]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:48.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:47 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:49:48.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:47 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:48.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:47 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:48.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:47 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:48.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:47 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:49:48.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:47 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:48.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:47 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:49:48.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:47 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:48.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:47 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:48.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:47 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:48.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:47 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:49:48.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:47 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:49.141 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:48 smithi002 ceph-mon[27637]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:49.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:48 smithi047 ceph-mon[34560]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:51.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:50 smithi047 ceph-mon[34560]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:51.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:50 smithi002 ceph-mon[27637]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:52.162 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:51 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T22:49:52.163 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:51 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:52.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:51 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T22:49:52.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:51 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:49:53.024 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:52 smithi002 ceph-mon[27637]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:53.024 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:52 smithi002 ceph-mon[27637]: Deploying daemon osd.1 on smithi002 2024-09-13T22:49:53.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:52 smithi047 ceph-mon[34560]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:53.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:52 smithi047 ceph-mon[34560]: Deploying daemon osd.1 on smithi002 2024-09-13T22:49:55.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:54 smithi047 ceph-mon[34560]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:55.187 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:54 smithi002 ceph-mon[27637]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:57.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:56 smithi047 ceph-mon[34560]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:57.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:56 smithi002 ceph-mon[27637]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:58.083 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:57 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:58.083 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:57 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:58.083 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:57 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:49:58.334 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:57 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:58.334 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:57 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:58.334 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:57 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:49:59.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:58 smithi002 ceph-mon[27637]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:59.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:58 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:59.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:49:58 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:59.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:58 smithi047 ceph-mon[34560]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:49:59.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:58 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:49:59.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:49:58 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:00.803 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 1 on host 'smithi002' 2024-09-13T22:50:00.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:00.801+0000 7f6d077fe700 1 -- 172.21.15.2:0/3273584647 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6d180611d0 con 0x7f6d0006c460 2024-09-13T22:50:00.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:00.804+0000 7f6d1ca42700 1 -- 172.21.15.2:0/3273584647 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f6d0006c460 msgr2=0x7f6d0006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:50:00.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:00.804+0000 7f6d1ca42700 1 --2- 172.21.15.2:0/3273584647 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f6d0006c460 0x7f6d0006e920 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009cb0 tx=0x7f6d08009260 comp rx=0 tx=0).stop 2024-09-13T22:50:00.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:00.804+0000 7f6d1ca42700 1 -- 172.21.15.2:0/3273584647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18104060 msgr2=0x7f6d18198bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:50:00.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:00.804+0000 7f6d1ca42700 1 --2- 172.21.15.2:0/3273584647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18104060 0x7f6d18198bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c000c00 tx=0x7f6d0c00f740 comp rx=0 tx=0).stop 2024-09-13T22:50:00.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:00.804+0000 7f6d1ca42700 1 -- 172.21.15.2:0/3273584647 shutdown_connections 2024-09-13T22:50:00.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:00.804+0000 7f6d1ca42700 1 --2- 172.21.15.2:0/3273584647 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f6d0006c460 0x7f6d0006e920 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:50:00.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:00.804+0000 7f6d1ca42700 1 --2- 172.21.15.2:0/3273584647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d18101730 0x7f6d181986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:50:00.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:00.804+0000 7f6d1ca42700 1 --2- 172.21.15.2:0/3273584647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18104060 0x7f6d18198bf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:50:00.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:00.804+0000 7f6d1ca42700 1 -- 172.21.15.2:0/3273584647 >> 172.21.15.2:0/3273584647 conn(0x7f6d180fb120 msgr2=0x7f6d18104cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:50:00.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:00.804+0000 7f6d1ca42700 1 -- 172.21.15.2:0/3273584647 shutdown_connections 2024-09-13T22:50:00.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:00.804+0000 7f6d1ca42700 1 -- 172.21.15.2:0/3273584647 wait complete. 2024-09-13T22:50:01.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:00 smithi002 ceph-mon[27637]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:50:01.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:00 smithi002 ceph-mon[27637]: overall HEALTH_OK 2024-09-13T22:50:01.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:00 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:01.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:00 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:01.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:00 smithi002 ceph-mon[27637]: from='osd.1 [v2:172.21.15.2:6810/182375359,v1:172.21.15.2:6811/182375359]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T22:50:01.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:00 smithi047 ceph-mon[34560]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:50:01.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:00 smithi047 ceph-mon[34560]: overall HEALTH_OK 2024-09-13T22:50:01.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:00 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:01.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:00 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:01.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:00 smithi047 ceph-mon[34560]: from='osd.1 [v2:172.21.15.2:6810/182375359,v1:172.21.15.2:6811/182375359]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T22:50:01.671 DEBUG:teuthology.orchestra.run.smithi002:osd.1> sudo journalctl -f -n 0 -u ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.1.service 2024-09-13T22:50:01.673 INFO:tasks.cephadm:Deploying osd.2 on smithi002 with /dev/vg_nvme/lv_2... 2024-09-13T22:50:01.674 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-13T22:50:02.332 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:50:03.091 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:02 smithi002 ceph-mon[27637]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:50:03.092 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:02 smithi002 ceph-mon[27637]: from='osd.1 [v2:172.21.15.2:6810/182375359,v1:172.21.15.2:6811/182375359]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T22:50:03.092 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:02 smithi002 ceph-mon[27637]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T22:50:03.092 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:02 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:50:03.092 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:02 smithi002 ceph-mon[27637]: from='osd.1 [v2:172.21.15.2:6810/182375359,v1:172.21.15.2:6811/182375359]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-13T22:50:03.092 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:02 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:50:03.092 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 22:50:02 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1[53733]: 2024-09-13T22:50:02.888+0000 7f573ec00700 -1 osd.1 0 waiting for initial osdmap 2024-09-13T22:50:03.092 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 22:50:02 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1[53733]: 2024-09-13T22:50:02.892+0000 7f573a9f5700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:50:03.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:02 smithi047 ceph-mon[34560]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:50:03.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:02 smithi047 ceph-mon[34560]: from='osd.1 [v2:172.21.15.2:6810/182375359,v1:172.21.15.2:6811/182375359]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T22:50:03.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:02 smithi047 ceph-mon[34560]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T22:50:03.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:02 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:50:03.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:02 smithi047 ceph-mon[34560]: from='osd.1 [v2:172.21.15.2:6810/182375359,v1:172.21.15.2:6811/182375359]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-13T22:50:03.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:02 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:50:04.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:03 smithi047 ceph-mon[34560]: purged_snaps scrub starts 2024-09-13T22:50:04.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:03 smithi047 ceph-mon[34560]: purged_snaps scrub ok 2024-09-13T22:50:04.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:03 smithi047 ceph-mon[34560]: from='osd.1 [v2:172.21.15.2:6810/182375359,v1:172.21.15.2:6811/182375359]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-13T22:50:04.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:03 smithi047 ceph-mon[34560]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T22:50:04.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:03 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:50:04.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:03 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:50:04.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:03 smithi002 ceph-mon[27637]: purged_snaps scrub starts 2024-09-13T22:50:04.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:03 smithi002 ceph-mon[27637]: purged_snaps scrub ok 2024-09-13T22:50:04.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:03 smithi002 ceph-mon[27637]: from='osd.1 [v2:172.21.15.2:6810/182375359,v1:172.21.15.2:6811/182375359]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-13T22:50:04.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:03 smithi002 ceph-mon[27637]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T22:50:04.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:03 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:50:04.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:03 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:50:05.127 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:04 smithi002 ceph-mon[27637]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:50:05.127 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:04 smithi002 ceph-mon[27637]: osd.1 [v2:172.21.15.2:6810/182375359,v1:172.21.15.2:6811/182375359] boot 2024-09-13T22:50:05.127 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:04 smithi002 ceph-mon[27637]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T22:50:05.127 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:04 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:50:05.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:04 smithi047 ceph-mon[34560]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-13T22:50:05.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:04 smithi047 ceph-mon[34560]: osd.1 [v2:172.21.15.2:6810/182375359,v1:172.21.15.2:6811/182375359] boot 2024-09-13T22:50:05.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:04 smithi047 ceph-mon[34560]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T22:50:05.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:04 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:50:05.717 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:50:05.736 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_2 2024-09-13T22:50:05.960 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:50:05.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:05 smithi002 ceph-mon[27637]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T22:50:06.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:05 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:06.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:05 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:06.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:05 smithi047 ceph-mon[34560]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T22:50:06.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:05 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:06.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:05 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:07.087 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:06 smithi002 ceph-mon[27637]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:07.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:06 smithi047 ceph-mon[34560]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:08.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.898+0000 7fece4da9700 1 -- 172.21.15.2:0/3793381465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0104070 msgr2=0x7fece0106460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:50:08.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.898+0000 7fece4da9700 1 --2- 172.21.15.2:0/3793381465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0104070 0x7fece0106460 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009910 tx=0x7fecd4009c20 comp rx=0 tx=0).stop 2024-09-13T22:50:08.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.898+0000 7fece4da9700 1 -- 172.21.15.2:0/3793381465 shutdown_connections 2024-09-13T22:50:08.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.898+0000 7fece4da9700 1 --2- 172.21.15.2:0/3793381465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0104070 0x7fece0106460 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:50:08.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.898+0000 7fece4da9700 1 --2- 172.21.15.2:0/3793381465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fece0101740 0x7fece0103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:50:08.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.898+0000 7fece4da9700 1 -- 172.21.15.2:0/3793381465 >> 172.21.15.2:0/3793381465 conn(0x7fece00fb150 msgr2=0x7fece00fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:50:08.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.898+0000 7fece4da9700 1 -- 172.21.15.2:0/3793381465 shutdown_connections 2024-09-13T22:50:08.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.898+0000 7fece4da9700 1 -- 172.21.15.2:0/3793381465 wait complete. 2024-09-13T22:50:08.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.899+0000 7fece4da9700 1 Processor -- start 2024-09-13T22:50:08.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.899+0000 7fece4da9700 1 -- start start 2024-09-13T22:50:08.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.899+0000 7fece4da9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fece0101740 0x7fece0196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:50:08.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.899+0000 7fece4da9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0104070 0x7fece01969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:50:08.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.899+0000 7fece4da9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece0196fc0 con 0x7fece0104070 2024-09-13T22:50:08.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.899+0000 7fece4da9700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece0197100 con 0x7fece0101740 2024-09-13T22:50:08.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.899+0000 7fecddd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0104070 0x7fece01969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:50:08.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.899+0000 7fecddd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0104070 0x7fece01969a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47592/0 (socket says 172.21.15.2:47592) 2024-09-13T22:50:08.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.899+0000 7fecddd9b700 1 -- 172.21.15.2:0/4252676918 learned_addr learned my addr 172.21.15.2:0/4252676918 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:50:08.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.899+0000 7fecde59c700 1 --2- 172.21.15.2:0/4252676918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fece0101740 0x7fece0196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:50:08.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.899+0000 7fecddd9b700 1 -- 172.21.15.2:0/4252676918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fece0101740 msgr2=0x7fece0196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:50:08.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.899+0000 7fecddd9b700 1 --2- 172.21.15.2:0/4252676918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fece0101740 0x7fece0196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:50:08.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.899+0000 7fecddd9b700 1 -- 172.21.15.2:0/4252676918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd40095f0 con 0x7fece0104070 2024-09-13T22:50:08.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.900+0000 7fecddd9b700 1 --2- 172.21.15.2:0/4252676918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0104070 0x7fece01969a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fecd4000c00 tx=0x7fecd400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:50:08.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.900+0000 7feccf7fe700 1 -- 172.21.15.2:0/4252676918 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecd401d070 con 0x7fece0104070 2024-09-13T22:50:08.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.900+0000 7feccf7fe700 1 -- 172.21.15.2:0/4252676918 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fecd4005dc0 con 0x7fece0104070 2024-09-13T22:50:08.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.900+0000 7feccf7fe700 1 -- 172.21.15.2:0/4252676918 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecd40226a0 con 0x7fece0104070 2024-09-13T22:50:08.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.900+0000 7fece4da9700 1 -- 172.21.15.2:0/4252676918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece019bb50 con 0x7fece0104070 2024-09-13T22:50:08.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.900+0000 7fece4da9700 1 -- 172.21.15.2:0/4252676918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece019bff0 con 0x7fece0104070 2024-09-13T22:50:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.901+0000 7fece4da9700 1 -- 172.21.15.2:0/4252676918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece0190620 con 0x7fece0104070 2024-09-13T22:50:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.902+0000 7feccf7fe700 1 -- 172.21.15.2:0/4252676918 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90254+0+0 (secure 0 0 0) 0x7fecd4003680 con 0x7fece0104070 2024-09-13T22:50:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.902+0000 7feccf7fe700 1 --2- 172.21.15.2:0/4252676918 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fecc806c460 0x7fecc806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:50:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.902+0000 7feccf7fe700 1 -- 172.21.15.2:0/4252676918 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2242+0+0 (secure 0 0 0) 0x7fecd408c020 con 0x7fece0104070 2024-09-13T22:50:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.902+0000 7fecde59c700 1 --2- 172.21.15.2:0/4252676918 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fecc806c460 0x7fecc806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:50:08.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.903+0000 7fecde59c700 1 --2- 172.21.15.2:0/4252676918 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fecc806c460 0x7fecc806e920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009bf0 tx=0x7fecd0009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:50:08.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:08.909+0000 7feccf7fe700 1 -- 172.21.15.2:0/4252676918 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fecd405b000 con 0x7fece0104070 2024-09-13T22:50:09.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:09.119+0000 7fece4da9700 1 -- 172.21.15.2:0/4252676918 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fece00611d0 con 0x7fecc806c460 2024-09-13T22:50:09.143 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:08 smithi002 ceph-mon[27637]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:09.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:08 smithi047 ceph-mon[34560]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:10.145 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:09 smithi002 ceph-mon[27637]: from='client.14284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:10.146 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:09 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:50:10.146 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:09 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:50:10.146 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:09 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:50:10.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:09 smithi047 ceph-mon[34560]: from='client.14284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:10.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:09 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:50:10.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:09 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:50:10.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:09 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:50:11.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:10 smithi047 ceph-mon[34560]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:11.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:10 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:10 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:10 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:50:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:10 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:50:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:10 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:10 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:50:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:10 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:50:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:10 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:11.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:10 smithi002 ceph-mon[27637]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:11.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:10 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:11.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:10 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:11.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:10 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:50:11.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:10 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:50:11.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:10 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:11.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:10 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:50:11.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:10 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:50:11.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:10 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:12.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:11 smithi047 ceph-mon[34560]: Detected new or changed devices on smithi002 2024-09-13T22:50:12.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:11 smithi047 ceph-mon[34560]: Adjusting osd_memory_target on smithi002 to 5922M 2024-09-13T22:50:12.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:11 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:50:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:11 smithi002 ceph-mon[27637]: Detected new or changed devices on smithi002 2024-09-13T22:50:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:11 smithi002 ceph-mon[27637]: Adjusting osd_memory_target on smithi002 to 5922M 2024-09-13T22:50:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:11 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:50:13.131 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:12 smithi002 ceph-mon[27637]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:13.131 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:12 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2585060804' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "746451f4-049b-4613-9cce-31bda05dc08c"}]: dispatch 2024-09-13T22:50:13.131 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:12 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2585060804' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "746451f4-049b-4613-9cce-31bda05dc08c"}]': finished 2024-09-13T22:50:13.131 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:12 smithi002 ceph-mon[27637]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T22:50:13.131 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:12 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:50:13.131 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:12 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:13.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:12 smithi047 ceph-mon[34560]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:13.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:12 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/2585060804' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "746451f4-049b-4613-9cce-31bda05dc08c"}]: dispatch 2024-09-13T22:50:13.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:12 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/2585060804' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "746451f4-049b-4613-9cce-31bda05dc08c"}]': finished 2024-09-13T22:50:13.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:12 smithi047 ceph-mon[34560]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T22:50:13.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:12 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:50:13.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:12 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:14.221 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:13 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:14.221 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:13 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/1706168788' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:50:14.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:13 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:14.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:13 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/1706168788' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:50:15.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:14 smithi002 ceph-mon[27637]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:15.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:14 smithi047 ceph-mon[34560]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:16.662 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:16 smithi002 ceph-mon[27637]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:16.662 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:16 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:16.662 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:16 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:16.662 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:16 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:50:16.663 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:16 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:50:16.663 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:16 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:16.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:16 smithi047 ceph-mon[34560]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:16.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:16 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:16.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:16 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:16.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:16 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:50:16.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:16 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:50:16.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:16 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:17.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:17 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:50:17.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:17 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:50:18.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:18 smithi002 ceph-mon[27637]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:18.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:18 smithi047 ceph-mon[34560]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:20.589 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:20 smithi002 ceph-mon[27637]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:20.589 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:20 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T22:50:20.589 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:20 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:50:20.589 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:20 smithi002 ceph-mon[27637]: Deploying daemon osd.2 on smithi002 2024-09-13T22:50:20.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:20 smithi047 ceph-mon[34560]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:20.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:20 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T22:50:20.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:20 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:50:20.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:20 smithi047 ceph-mon[34560]: Deploying daemon osd.2 on smithi002 2024-09-13T22:50:23.147 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:22 smithi002 ceph-mon[27637]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:23.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:22 smithi047 ceph-mon[34560]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:25.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:24 smithi002 ceph-mon[27637]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:25.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:24 smithi047 ceph-mon[34560]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:26.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:26 smithi002 ceph-mon[27637]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:26.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:26 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:26.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:26 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:26.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:26 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:50:26.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:26 smithi047 ceph-mon[34560]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:26.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:26 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:26.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:26 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:26.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:26 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:50:28.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:28 smithi047 ceph-mon[34560]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:28.715 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:28 smithi002 ceph-mon[27637]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:29.397 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:29 smithi002 ceph-mon[27637]: from='osd.2 [v2:172.21.15.2:6818/2103429173,v1:172.21.15.2:6819/2103429173]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T22:50:29.531 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 2 on host 'smithi002' 2024-09-13T22:50:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:29.530+0000 7feccf7fe700 1 -- 172.21.15.2:0/4252676918 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fece00611d0 con 0x7fecc806c460 2024-09-13T22:50:29.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:29.532+0000 7fece4da9700 1 -- 172.21.15.2:0/4252676918 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fecc806c460 msgr2=0x7fecc806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:50:29.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:29.532+0000 7fece4da9700 1 --2- 172.21.15.2:0/4252676918 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fecc806c460 0x7fecc806e920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009bf0 tx=0x7fecd0009260 comp rx=0 tx=0).stop 2024-09-13T22:50:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:29.532+0000 7fece4da9700 1 -- 172.21.15.2:0/4252676918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0104070 msgr2=0x7fece01969a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:50:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:29.532+0000 7fece4da9700 1 --2- 172.21.15.2:0/4252676918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0104070 0x7fece01969a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fecd4000c00 tx=0x7fecd400f740 comp rx=0 tx=0).stop 2024-09-13T22:50:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:29.532+0000 7fece4da9700 1 -- 172.21.15.2:0/4252676918 shutdown_connections 2024-09-13T22:50:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:29.532+0000 7fece4da9700 1 --2- 172.21.15.2:0/4252676918 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fecc806c460 0x7fecc806e920 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:50:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:29.532+0000 7fece4da9700 1 --2- 172.21.15.2:0/4252676918 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fece0101740 0x7fece0196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:50:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:29.532+0000 7fece4da9700 1 --2- 172.21.15.2:0/4252676918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0104070 0x7fece01969a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:50:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:29.532+0000 7fece4da9700 1 -- 172.21.15.2:0/4252676918 >> 172.21.15.2:0/4252676918 conn(0x7fece00fb150 msgr2=0x7fece00fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:50:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:29.533+0000 7fece4da9700 1 -- 172.21.15.2:0/4252676918 shutdown_connections 2024-09-13T22:50:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:50:29.533+0000 7fece4da9700 1 -- 172.21.15.2:0/4252676918 wait complete. 2024-09-13T22:50:29.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:29 smithi047 ceph-mon[34560]: from='osd.2 [v2:172.21.15.2:6818/2103429173,v1:172.21.15.2:6819/2103429173]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T22:50:30.272 DEBUG:teuthology.orchestra.run.smithi002:osd.2> sudo journalctl -f -n 0 -u ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.2.service 2024-09-13T22:50:30.275 INFO:tasks.cephadm:Deploying osd.3 on smithi047 with /dev/vg_nvme/lv_4... 2024-09-13T22:50:30.276 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T22:50:30.496 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi047/config 2024-09-13T22:50:30.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:30 smithi002 ceph-mon[27637]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:30.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:30 smithi002 ceph-mon[27637]: from='osd.2 [v2:172.21.15.2:6818/2103429173,v1:172.21.15.2:6819/2103429173]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T22:50:30.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:30 smithi002 ceph-mon[27637]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T22:50:30.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:30 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:50:30.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:30 smithi002 ceph-mon[27637]: from='osd.2 [v2:172.21.15.2:6818/2103429173,v1:172.21.15.2:6819/2103429173]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-13T22:50:30.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:30 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:30.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:30 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:30.501 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 22:50:30 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2[61377]: 2024-09-13T22:50:30.338+0000 7f42c749c700 -1 osd.2 0 waiting for initial osdmap 2024-09-13T22:50:30.501 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 22:50:30 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2[61377]: 2024-09-13T22:50:30.343+0000 7f42c3a92700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:50:30.618 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:30 smithi047 ceph-mon[34560]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:30.618 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:30 smithi047 ceph-mon[34560]: from='osd.2 [v2:172.21.15.2:6818/2103429173,v1:172.21.15.2:6819/2103429173]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T22:50:30.618 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:30 smithi047 ceph-mon[34560]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T22:50:30.618 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:30 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:50:30.618 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:30 smithi047 ceph-mon[34560]: from='osd.2 [v2:172.21.15.2:6818/2103429173,v1:172.21.15.2:6819/2103429173]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-13T22:50:30.618 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:30 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:30.618 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:30 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:31.631 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:31 smithi002 ceph-mon[27637]: from='osd.2 [v2:172.21.15.2:6818/2103429173,v1:172.21.15.2:6819/2103429173]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-13T22:50:31.631 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:31 smithi002 ceph-mon[27637]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T22:50:31.631 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:31 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:50:31.631 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:31 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:50:31.651 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:31 smithi047 ceph-mon[34560]: from='osd.2 [v2:172.21.15.2:6818/2103429173,v1:172.21.15.2:6819/2103429173]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-13T22:50:31.651 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:31 smithi047 ceph-mon[34560]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T22:50:31.651 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:31 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:50:31.652 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:31 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:50:32.511 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:32 smithi047 ceph-mon[34560]: purged_snaps scrub starts 2024-09-13T22:50:32.511 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:32 smithi047 ceph-mon[34560]: purged_snaps scrub ok 2024-09-13T22:50:32.511 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:32 smithi047 ceph-mon[34560]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:32.511 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:32 smithi047 ceph-mon[34560]: osd.2 [v2:172.21.15.2:6818/2103429173,v1:172.21.15.2:6819/2103429173] boot 2024-09-13T22:50:32.511 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:32 smithi047 ceph-mon[34560]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T22:50:32.511 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:32 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:50:32.511 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:32 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:50:32.512 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:32 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:32.512 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:32 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:32.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:32 smithi002 ceph-mon[27637]: purged_snaps scrub starts 2024-09-13T22:50:32.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:32 smithi002 ceph-mon[27637]: purged_snaps scrub ok 2024-09-13T22:50:32.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:32 smithi002 ceph-mon[27637]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-13T22:50:32.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:32 smithi002 ceph-mon[27637]: osd.2 [v2:172.21.15.2:6818/2103429173,v1:172.21.15.2:6819/2103429173] boot 2024-09-13T22:50:32.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:32 smithi002 ceph-mon[27637]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T22:50:32.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:32 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:50:32.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:32 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:50:32.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:32 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:32.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:32 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:33.071 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:50:33.091 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_4 2024-09-13T22:50:33.297 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi047/config 2024-09-13T22:50:33.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:33 smithi002 ceph-mon[27637]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T22:50:34.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:33 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T22:50:34.048 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:33 smithi047 ceph-mon[34560]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T22:50:34.048 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:33 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T22:50:34.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.929+0000 7f8e3a4b4700 1 -- 172.21.15.47:0/239062369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e340ffc10 msgr2=0x7f8e34100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:50:34.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.929+0000 7f8e3a4b4700 1 --2- 172.21.15.47:0/239062369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e340ffc10 0x7f8e34100030 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8e24009910 tx=0x7f8e24009c20 comp rx=0 tx=0).stop 2024-09-13T22:50:34.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.929+0000 7f8e3a4b4700 1 -- 172.21.15.47:0/239062369 shutdown_connections 2024-09-13T22:50:34.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.929+0000 7f8e3a4b4700 1 --2- 172.21.15.47:0/239062369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e34100e10 0x7f8e34101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:50:34.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.929+0000 7f8e3a4b4700 1 --2- 172.21.15.47:0/239062369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e340ffc10 0x7f8e34100030 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:50:34.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.929+0000 7f8e3a4b4700 1 -- 172.21.15.47:0/239062369 >> 172.21.15.47:0/239062369 conn(0x7f8e340fb190 msgr2=0x7f8e340fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:50:34.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.929+0000 7f8e3a4b4700 1 -- 172.21.15.47:0/239062369 shutdown_connections 2024-09-13T22:50:34.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.929+0000 7f8e3a4b4700 1 -- 172.21.15.47:0/239062369 wait complete. 2024-09-13T22:50:34.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.930+0000 7f8e3a4b4700 1 Processor -- start 2024-09-13T22:50:34.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.930+0000 7f8e3a4b4700 1 -- start start 2024-09-13T22:50:34.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.930+0000 7f8e3a4b4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e340ffc10 0x7f8e341964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:50:34.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.930+0000 7f8e3a4b4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e34100e10 0x7f8e341969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:50:34.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.930+0000 7f8e3a4b4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e34196f80 con 0x7f8e34100e10 2024-09-13T22:50:34.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.930+0000 7f8e3a4b4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e341970c0 con 0x7f8e340ffc10 2024-09-13T22:50:34.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.930+0000 7f8e33fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e340ffc10 0x7f8e341964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:50:34.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.930+0000 7f8e33fff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e340ffc10 0x7f8e341964b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59384/0 (socket says 172.21.15.47:59384) 2024-09-13T22:50:34.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.930+0000 7f8e33fff700 1 -- 172.21.15.47:0/2376047787 learned_addr learned my addr 172.21.15.47:0/2376047787 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:50:34.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.931+0000 7f8e2bfff700 1 --2- 172.21.15.47:0/2376047787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e34100e10 0x7f8e341969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:50:34.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.931+0000 7f8e33fff700 1 -- 172.21.15.47:0/2376047787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e34100e10 msgr2=0x7f8e341969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:50:34.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.931+0000 7f8e33fff700 1 --2- 172.21.15.47:0/2376047787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e34100e10 0x7f8e341969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:50:34.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.931+0000 7f8e33fff700 1 -- 172.21.15.47:0/2376047787 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e240095f0 con 0x7f8e340ffc10 2024-09-13T22:50:34.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.931+0000 7f8e33fff700 1 --2- 172.21.15.47:0/2376047787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e340ffc10 0x7f8e341964b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400bda0 tx=0x7f8e2400bdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:50:34.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.931+0000 7f8e31ffb700 1 -- 172.21.15.47:0/2376047787 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e2401d070 con 0x7f8e340ffc10 2024-09-13T22:50:34.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.931+0000 7f8e31ffb700 1 -- 172.21.15.47:0/2376047787 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8e24022470 con 0x7f8e340ffc10 2024-09-13T22:50:34.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.931+0000 7f8e3a4b4700 1 -- 172.21.15.47:0/2376047787 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3419bb20 con 0x7f8e340ffc10 2024-09-13T22:50:34.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.931+0000 7f8e31ffb700 1 -- 172.21.15.47:0/2376047787 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e2400f670 con 0x7f8e340ffc10 2024-09-13T22:50:34.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.931+0000 7f8e3a4b4700 1 -- 172.21.15.47:0/2376047787 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3419bfe0 con 0x7f8e340ffc10 2024-09-13T22:50:34.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.932+0000 7f8e3a4b4700 1 -- 172.21.15.47:0/2376047787 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e34108700 con 0x7f8e340ffc10 2024-09-13T22:50:34.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.933+0000 7f8e31ffb700 1 -- 172.21.15.47:0/2376047787 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 18) v1 ==== 90254+0+0 (secure 0 0 0) 0x7f8e24004af0 con 0x7f8e340ffc10 2024-09-13T22:50:34.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.933+0000 7f8e31ffb700 1 --2- 172.21.15.47:0/2376047787 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8e2006c460 0x7f8e2006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:50:34.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.933+0000 7f8e31ffb700 1 -- 172.21.15.47:0/2376047787 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3060+0+0 (secure 0 0 0) 0x7f8e2408c3b0 con 0x7f8e340ffc10 2024-09-13T22:50:34.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.933+0000 7f8e2bfff700 1 --2- 172.21.15.47:0/2376047787 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8e2006c460 0x7f8e2006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:50:34.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.934+0000 7f8e2bfff700 1 --2- 172.21.15.47:0/2376047787 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8e2006c460 0x7f8e2006e920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00ac50 tx=0x7f8e1c00a380 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:50:34.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:34.938+0000 7f8e31ffb700 1 -- 172.21.15.47:0/2376047787 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8e2405b2b0 con 0x7f8e340ffc10 2024-09-13T22:50:35.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:35.144+0000 7f8e3a4b4700 1 -- 172.21.15.47:0/2376047787 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e34068c90 con 0x7f8e2006c460 2024-09-13T22:50:35.145 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:34 smithi047 ceph-mon[34560]: pgmap v76: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:50:35.145 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:34 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T22:50:35.145 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:34 smithi047 ceph-mon[34560]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T22:50:35.145 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:34 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T22:50:35.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:34 smithi002 ceph-mon[27637]: pgmap v76: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:50:35.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:34 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T22:50:35.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:34 smithi002 ceph-mon[27637]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T22:50:35.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:34 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T22:50:36.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:35 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T22:50:36.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:35 smithi047 ceph-mon[34560]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T22:50:36.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:35 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:50:36.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:35 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:50:36.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:35 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:50:36.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:35 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:36.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:35 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:36.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:35 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:50:36.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:35 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:50:36.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:35 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:50:36.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:35 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:36.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:35 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:50:36.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:35 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:50:36.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:35 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:36.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:35 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:50:36.247 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 22:50:35 smithi002 sudo[66026]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T22:50:36.247 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 22:50:35 smithi002 sudo[66026]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:50:36.247 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 22:50:35 smithi002 sudo[66026]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-13T22:50:36.247 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 22:50:35 smithi002 sudo[66026]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:50:36.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:35 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T22:50:36.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:35 smithi002 ceph-mon[27637]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T22:50:36.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:35 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:50:36.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:35 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:50:36.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:35 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:50:36.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:35 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:36.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:35 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:36.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:35 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:50:36.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:35 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:50:36.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:35 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:50:36.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:35 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:36.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:35 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:50:36.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:35 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:50:36.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:35 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:36.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:35 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:50:36.499 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 22:50:36 smithi002 sudo[66116]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T22:50:36.500 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 22:50:36 smithi002 sudo[66116]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:50:36.500 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 22:50:36 smithi002 sudo[66116]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-13T22:50:36.500 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 22:50:36 smithi002 sudo[66116]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:50:37.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:36 smithi002 ceph-mon[27637]: from='client.24139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:37.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:36 smithi002 ceph-mon[27637]: pgmap v79: 1 pgs: 1 creating+activating; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:50:37.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:36 smithi002 ceph-mon[27637]: Detected new or changed devices on smithi002 2024-09-13T22:50:37.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:36 smithi002 ceph-mon[27637]: Adjusting osd_memory_target on smithi002 to 3948M 2024-09-13T22:50:37.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:36 smithi002 ceph-mon[27637]: osdmap e23: 3 total, 3 up, 3 in 2024-09-13T22:50:37.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:36 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:37.001 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 22:50:36 smithi002 sudo[66136]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T22:50:37.001 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 22:50:36 smithi002 sudo[66136]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:50:37.001 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 22:50:36 smithi002 sudo[66136]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-13T22:50:37.001 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 22:50:36 smithi002 sudo[66136]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:50:37.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:36 smithi047 ceph-mon[34560]: from='client.24139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:50:37.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:36 smithi047 ceph-mon[34560]: pgmap v79: 1 pgs: 1 creating+activating; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:50:37.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:36 smithi047 ceph-mon[34560]: Detected new or changed devices on smithi002 2024-09-13T22:50:37.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:36 smithi047 ceph-mon[34560]: Adjusting osd_memory_target on smithi002 to 3948M 2024-09-13T22:50:37.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:36 smithi047 ceph-mon[34560]: osdmap e23: 3 total, 3 up, 3 in 2024-09-13T22:50:37.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:36 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:37.384 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 22:50:37 smithi002 sudo[66241]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T22:50:37.384 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 22:50:37 smithi002 sudo[66241]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:50:37.384 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 22:50:37 smithi002 sudo[66241]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-13T22:50:37.385 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 22:50:37 smithi002 sudo[66241]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:50:37.906 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 22:50:37 smithi002 sudo[66265]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T22:50:37.906 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 22:50:37 smithi002 sudo[66265]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:50:37.906 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 22:50:37 smithi002 sudo[66265]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-13T22:50:37.907 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 22:50:37 smithi002 sudo[66265]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:50:37.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:37.908+0000 7f8e31ffb700 1 -- 172.21.15.47:0/2376047787 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f8e24057bf0 con 0x7f8e340ffc10 2024-09-13T22:50:38.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:37 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/2030675299' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9732042d-4a75-48e6-b8d5-003e8b472c1d"}]: dispatch 2024-09-13T22:50:38.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:37 smithi047 ceph-mon[34560]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9732042d-4a75-48e6-b8d5-003e8b472c1d"}]: dispatch 2024-09-13T22:50:38.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:37 smithi047 ceph-mon[34560]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9732042d-4a75-48e6-b8d5-003e8b472c1d"}]': finished 2024-09-13T22:50:38.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:37 smithi047 ceph-mon[34560]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T22:50:38.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:37 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:50:38.175 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 22:50:38 smithi002 sudo[66338]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T22:50:38.175 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 22:50:38 smithi002 sudo[66338]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:50:38.175 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 22:50:38 smithi002 sudo[66338]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-13T22:50:38.175 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 22:50:38 smithi002 sudo[66338]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:50:38.176 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:37 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/2030675299' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9732042d-4a75-48e6-b8d5-003e8b472c1d"}]: dispatch 2024-09-13T22:50:38.176 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:37 smithi002 ceph-mon[27637]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9732042d-4a75-48e6-b8d5-003e8b472c1d"}]: dispatch 2024-09-13T22:50:38.176 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:37 smithi002 ceph-mon[27637]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9732042d-4a75-48e6-b8d5-003e8b472c1d"}]': finished 2024-09-13T22:50:38.176 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:37 smithi002 ceph-mon[27637]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T22:50:38.176 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:37 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:50:38.900 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:38 smithi002 sudo[66387]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T22:50:38.900 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:38 smithi002 sudo[66387]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:50:38.900 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:38 smithi002 sudo[66387]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-13T22:50:38.900 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:38 smithi002 sudo[66387]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:50:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:39 smithi002 sudo[66419]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T22:50:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:39 smithi002 sudo[66419]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:50:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:39 smithi002 sudo[66419]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-13T22:50:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:39 smithi002 sudo[66419]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:50:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:39 smithi002 ceph-mon[27637]: mgrmap e19: smithi002.yumtzz(active, since 2m), standbys: smithi047.gcymvd 2024-09-13T22:50:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:39 smithi002 ceph-mon[27637]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T22:50:39.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:39 smithi047 ceph-mon[34560]: mgrmap e19: smithi002.yumtzz(active, since 2m), standbys: smithi047.gcymvd 2024-09-13T22:50:39.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:39 smithi047 ceph-mon[34560]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T22:50:39.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:39 smithi047 sudo[38954]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T22:50:39.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:39 smithi047 sudo[38954]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:50:39.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:39 smithi047 sudo[38954]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-13T22:50:39.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:39 smithi047 sudo[38954]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:50:40.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:39 smithi047 sudo[39330]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T22:50:40.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:39 smithi047 sudo[39330]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T22:50:40.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:39 smithi047 sudo[39330]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-09-13T22:50:40.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:39 smithi047 sudo[39330]: pam_unix(sudo:session): session closed for user root 2024-09-13T22:50:40.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:40 smithi047 ceph-mon[34560]: pgmap v81: 1 pgs: 1 creating+activating; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:50:40.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:40 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/803085529' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:50:40.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:40 smithi047 ceph-mon[34560]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T22:50:40.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:40 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T22:50:40.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:40 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:50:40.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:40 smithi047 ceph-mon[34560]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T22:50:40.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:40 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T22:50:40.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:40 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:50:40.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:40 smithi047 ceph-mon[34560]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T22:50:40.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:40 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:40.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:40 smithi002 ceph-mon[27637]: pgmap v81: 1 pgs: 1 creating+activating; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:50:40.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:40 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/803085529' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:50:40.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:40 smithi002 ceph-mon[27637]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T22:50:40.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:40 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T22:50:40.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:40 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:50:40.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:40 smithi002 ceph-mon[27637]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T22:50:40.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:40 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T22:50:40.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:40 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:50:40.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:40 smithi002 ceph-mon[27637]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T22:50:40.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:40 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:41.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:41 smithi047 ceph-mon[34560]: pgmap v83: 1 pgs: 1 creating+activating; 0 B data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:50:41.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:41 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:41.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:41 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:41.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:41 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:50:41.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:41 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:50:41.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:41 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:41.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:41 smithi002 ceph-mon[27637]: pgmap v83: 1 pgs: 1 creating+activating; 0 B data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:50:41.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:41 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:41.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:41 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:41.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:41 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:50:41.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:41 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:50:41.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:41 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:43.111 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:43 smithi047 ceph-mon[34560]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:50:43.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:43 smithi002 ceph-mon[27637]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:50:45.216 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:45 smithi047 ceph-mon[34560]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:50:45.216 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:45 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T22:50:45.216 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:45 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:50:45.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:45 smithi002 ceph-mon[27637]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:50:45.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:45 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T22:50:45.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:45 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:50:46.289 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:46 smithi047 ceph-mon[34560]: Deploying daemon osd.3 on smithi047 2024-09-13T22:50:46.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:46 smithi002 ceph-mon[27637]: Deploying daemon osd.3 on smithi047 2024-09-13T22:50:47.393 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:47 smithi047 ceph-mon[34560]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-13T22:50:47.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:47 smithi002 ceph-mon[27637]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-13T22:50:48.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:48 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:50:48.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:48 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:50:49.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:49 smithi047 ceph-mon[34560]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-13T22:50:49.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:49 smithi002 ceph-mon[27637]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-13T22:50:50.297 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:50 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:50:50.297 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:50 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:50.298 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:50 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:50.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:50 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:50:50.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:50 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:50.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:50 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:51.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:51 smithi047 ceph-mon[34560]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-13T22:50:51.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:51 smithi002 ceph-mon[27637]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-13T22:50:53.223 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:53 smithi047 ceph-mon[34560]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-13T22:50:53.258 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 3 on host 'smithi047' 2024-09-13T22:50:53.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:53.256+0000 7f8e31ffb700 1 -- 172.21.15.47:0/2376047787 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8e34068c90 con 0x7f8e2006c460 2024-09-13T22:50:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:53.258+0000 7f8e3a4b4700 1 -- 172.21.15.47:0/2376047787 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8e2006c460 msgr2=0x7f8e2006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:50:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:53.258+0000 7f8e3a4b4700 1 --2- 172.21.15.47:0/2376047787 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8e2006c460 0x7f8e2006e920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00ac50 tx=0x7f8e1c00a380 comp rx=0 tx=0).stop 2024-09-13T22:50:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:53.258+0000 7f8e3a4b4700 1 -- 172.21.15.47:0/2376047787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e340ffc10 msgr2=0x7f8e341964b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:50:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:53.258+0000 7f8e3a4b4700 1 --2- 172.21.15.47:0/2376047787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e340ffc10 0x7f8e341964b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400bda0 tx=0x7f8e2400bdd0 comp rx=0 tx=0).stop 2024-09-13T22:50:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:53.258+0000 7f8e3a4b4700 1 -- 172.21.15.47:0/2376047787 shutdown_connections 2024-09-13T22:50:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:53.258+0000 7f8e3a4b4700 1 --2- 172.21.15.47:0/2376047787 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8e2006c460 0x7f8e2006e920 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:50:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:53.258+0000 7f8e3a4b4700 1 --2- 172.21.15.47:0/2376047787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e340ffc10 0x7f8e341964b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:50:53.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:53.258+0000 7f8e3a4b4700 1 --2- 172.21.15.47:0/2376047787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e34100e10 0x7f8e341969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:50:53.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:53.258+0000 7f8e3a4b4700 1 -- 172.21.15.47:0/2376047787 >> 172.21.15.47:0/2376047787 conn(0x7f8e340fb190 msgr2=0x7f8e34068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:50:53.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:53.258+0000 7f8e3a4b4700 1 -- 172.21.15.47:0/2376047787 shutdown_connections 2024-09-13T22:50:53.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:50:53.258+0000 7f8e3a4b4700 1 -- 172.21.15.47:0/2376047787 wait complete. 2024-09-13T22:50:53.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:53 smithi002 ceph-mon[27637]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-13T22:50:53.849 DEBUG:teuthology.orchestra.run.smithi047:osd.3> sudo journalctl -f -n 0 -u ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.3.service 2024-09-13T22:50:53.851 INFO:tasks.cephadm:Deploying osd.4 on smithi047 with /dev/vg_nvme/lv_3... 2024-09-13T22:50:53.851 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-13T22:50:54.113 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi047/config 2024-09-13T22:50:54.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:54 smithi002 ceph-mon[27637]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-13T22:50:54.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:54 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:54.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:54 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:54.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:54 smithi002 ceph-mon[27637]: from='osd.3 [v2:172.21.15.47:6800/4105215181,v1:172.21.15.47:6801/4105215181]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T22:50:54.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:54 smithi002 ceph-mon[27637]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T22:50:54.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:54 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:54.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:54 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:54.543 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:54 smithi047 ceph-mon[34560]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-13T22:50:54.543 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:54 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:54.543 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:54 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:54.543 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:54 smithi047 ceph-mon[34560]: from='osd.3 [v2:172.21.15.47:6800/4105215181,v1:172.21.15.47:6801/4105215181]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T22:50:54.543 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:54 smithi047 ceph-mon[34560]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T22:50:54.543 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:54 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:54.543 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:54 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:50:55.544 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:55 smithi047 ceph-mon[34560]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T22:50:55.544 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:55 smithi047 ceph-mon[34560]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T22:50:55.544 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:55 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:50:55.544 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:55 smithi047 ceph-mon[34560]: from='osd.3 [v2:172.21.15.47:6800/4105215181,v1:172.21.15.47:6801/4105215181]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T22:50:55.544 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:55 smithi047 ceph-mon[34560]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T22:50:55.545 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 22:50:55 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3[40579]: 2024-09-13T22:50:55.261+0000 7f3752bb9700 -1 osd.3 0 waiting for initial osdmap 2024-09-13T22:50:55.545 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 22:50:55 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3[40579]: 2024-09-13T22:50:55.270+0000 7f374c1a9700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:50:55.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:55 smithi002 ceph-mon[27637]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T22:50:55.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:55 smithi002 ceph-mon[27637]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T22:50:55.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:55 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:50:55.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:55 smithi002 ceph-mon[27637]: from='osd.3 [v2:172.21.15.47:6800/4105215181,v1:172.21.15.47:6801/4105215181]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T22:50:55.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:55 smithi002 ceph-mon[27637]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T22:50:56.592 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:56 smithi047 ceph-mon[34560]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:50:56.592 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:56 smithi047 ceph-mon[34560]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-13T22:50:56.592 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:56 smithi047 ceph-mon[34560]: osdmap e26: 4 total, 3 up, 4 in 2024-09-13T22:50:56.592 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:56 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:50:56.592 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:56 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:50:56.593 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:56 smithi047 ceph-mon[34560]: osd.3 [v2:172.21.15.47:6800/4105215181,v1:172.21.15.47:6801/4105215181] boot 2024-09-13T22:50:56.593 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:56 smithi047 ceph-mon[34560]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T22:50:56.593 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:56 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:50:56.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:56 smithi002 ceph-mon[27637]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-13T22:50:56.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:56 smithi002 ceph-mon[27637]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-13T22:50:56.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:56 smithi002 ceph-mon[27637]: osdmap e26: 4 total, 3 up, 4 in 2024-09-13T22:50:56.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:56 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:50:56.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:56 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:50:56.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:56 smithi002 ceph-mon[27637]: osd.3 [v2:172.21.15.47:6800/4105215181,v1:172.21.15.47:6801/4105215181] boot 2024-09-13T22:50:56.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:56 smithi002 ceph-mon[27637]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T22:50:56.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:56 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:50:57.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:57 smithi047 ceph-mon[34560]: purged_snaps scrub starts 2024-09-13T22:50:57.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:57 smithi047 ceph-mon[34560]: purged_snaps scrub ok 2024-09-13T22:50:57.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:57 smithi047 ceph-mon[34560]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T22:50:57.682 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:50:57.705 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_3 2024-09-13T22:50:57.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:57 smithi002 ceph-mon[27637]: purged_snaps scrub starts 2024-09-13T22:50:57.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:57 smithi002 ceph-mon[27637]: purged_snaps scrub ok 2024-09-13T22:50:57.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:57 smithi002 ceph-mon[27637]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T22:50:58.227 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi047/config 2024-09-13T22:50:59.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:58 smithi047 ceph-mon[34560]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T22:50:59.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:58 smithi047 ceph-mon[34560]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T22:50:59.190 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:58 smithi002 ceph-mon[27637]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T22:50:59.190 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:58 smithi002 ceph-mon[27637]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T22:51:00.144 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:59 smithi047 ceph-mon[34560]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T22:51:00.145 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:59 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:00.145 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:59 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:00.145 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:59 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:51:00.145 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:59 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:00.145 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:59 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:00.145 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:59 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:51:00.145 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:50:59 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:00.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.170+0000 7f9653d4d700 1 -- 172.21.15.47:0/3079225835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f964c100cb0 msgr2=0x7f964c1010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:00.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.170+0000 7f9653d4d700 1 --2- 172.21.15.47:0/3079225835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f964c100cb0 0x7f964c1010d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9648009910 tx=0x7f9648009c20 comp rx=0 tx=0).stop 2024-09-13T22:51:00.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.170+0000 7f9653d4d700 1 -- 172.21.15.47:0/3079225835 shutdown_connections 2024-09-13T22:51:00.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.170+0000 7f9653d4d700 1 --2- 172.21.15.47:0/3079225835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f964c101eb0 0x7f964c102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.170+0000 7f9653d4d700 1 --2- 172.21.15.47:0/3079225835 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f964c100cb0 0x7f964c1010d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.170+0000 7f9653d4d700 1 -- 172.21.15.47:0/3079225835 >> 172.21.15.47:0/3079225835 conn(0x7f964c0fc230 msgr2=0x7f964c0fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:51:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.170+0000 7f9653d4d700 1 -- 172.21.15.47:0/3079225835 shutdown_connections 2024-09-13T22:51:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.170+0000 7f9653d4d700 1 -- 172.21.15.47:0/3079225835 wait complete. 2024-09-13T22:51:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.170+0000 7f9653d4d700 1 Processor -- start 2024-09-13T22:51:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.170+0000 7f9653d4d700 1 -- start start 2024-09-13T22:51:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.170+0000 7f9653d4d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f964c100cb0 0x7f964c074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.170+0000 7f9653d4d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f964c101eb0 0x7f964c073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.171+0000 7f9653d4d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964c0736c0 con 0x7f964c100cb0 2024-09-13T22:51:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.171+0000 7f9653d4d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964c073800 con 0x7f964c101eb0 2024-09-13T22:51:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.171+0000 7f96512e8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f964c101eb0 0x7f964c073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.171+0000 7f96512e8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f964c101eb0 0x7f964c073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47468/0 (socket says 172.21.15.47:47468) 2024-09-13T22:51:00.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.171+0000 7f96512e8700 1 -- 172.21.15.47:0/3458290488 learned_addr learned my addr 172.21.15.47:0/3458290488 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:51:00.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.171+0000 7f9651ae9700 1 --2- 172.21.15.47:0/3458290488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f964c100cb0 0x7f964c074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:00.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.171+0000 7f96512e8700 1 -- 172.21.15.47:0/3458290488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f964c100cb0 msgr2=0x7f964c074b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:00.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.171+0000 7f96512e8700 1 --2- 172.21.15.47:0/3458290488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f964c100cb0 0x7f964c074b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:00.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.171+0000 7f96512e8700 1 -- 172.21.15.47:0/3458290488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96480095f0 con 0x7f964c101eb0 2024-09-13T22:51:00.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.171+0000 7f96512e8700 1 --2- 172.21.15.47:0/3458290488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f964c101eb0 0x7f964c073180 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f964000e920 tx=0x7f964000ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:51:00.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.171+0000 7f963effd700 1 -- 172.21.15.47:0/3458290488 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f964000c9d0 con 0x7f964c101eb0 2024-09-13T22:51:00.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.171+0000 7f963effd700 1 -- 172.21.15.47:0/3458290488 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9640010430 con 0x7f964c101eb0 2024-09-13T22:51:00.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.171+0000 7f9653d4d700 1 -- 172.21.15.47:0/3458290488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964c073ae0 con 0x7f964c101eb0 2024-09-13T22:51:00.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.171+0000 7f963effd700 1 -- 172.21.15.47:0/3458290488 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9640018650 con 0x7f964c101eb0 2024-09-13T22:51:00.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.171+0000 7f9653d4d700 1 -- 172.21.15.47:0/3458290488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964c19e540 con 0x7f964c101eb0 2024-09-13T22:51:00.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.172+0000 7f9653d4d700 1 -- 172.21.15.47:0/3458290488 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f964c109810 con 0x7f964c101eb0 2024-09-13T22:51:00.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.173+0000 7f963effd700 1 -- 172.21.15.47:0/3458290488 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f96400105a0 con 0x7f964c101eb0 2024-09-13T22:51:00.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.173+0000 7f963effd700 1 --2- 172.21.15.47:0/3458290488 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f963806c4e0 0x7f963806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:00.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.174+0000 7f963effd700 1 -- 172.21.15.47:0/3458290488 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3602+0+0 (secure 0 0 0) 0x7f9640014070 con 0x7f964c101eb0 2024-09-13T22:51:00.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.174+0000 7f9651ae9700 1 --2- 172.21.15.47:0/3458290488 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f963806c4e0 0x7f963806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:00.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.174+0000 7f9651ae9700 1 --2- 172.21.15.47:0/3458290488 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f963806c4e0 0x7f963806e9a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f964800b6f0 tx=0x7f9648005940 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:51:00.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.178+0000 7f963effd700 1 -- 172.21.15.47:0/3458290488 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f96400520e0 con 0x7f964c101eb0 2024-09-13T22:51:00.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:59 smithi002 ceph-mon[27637]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T22:51:00.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:59 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:00.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:59 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:00.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:59 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:51:00.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:59 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:00.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:59 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:00.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:59 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:51:00.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:50:59 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:00.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:00.389+0000 7f9653d4d700 1 -- 172.21.15.47:0/3458290488 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f964c19eaf0 con 0x7f963806c4e0 2024-09-13T22:51:01.122 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:00 smithi047 ceph-mon[34560]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T22:51:01.122 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:00 smithi047 ceph-mon[34560]: Detected new or changed devices on smithi047 2024-09-13T22:51:01.122 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:00 smithi047 ceph-mon[34560]: Adjusting osd_memory_target on smithi047 to 14916M 2024-09-13T22:51:01.122 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:00 smithi047 ceph-mon[34560]: osdmap e31: 4 total, 4 up, 4 in 2024-09-13T22:51:01.123 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:00 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:51:01.123 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:00 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:01.123 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:00 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:51:01.123 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:00 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:01.123 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:00 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:51:01.123 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:00 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:51:01.123 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:00 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:01.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:00 smithi002 ceph-mon[27637]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T22:51:01.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:00 smithi002 ceph-mon[27637]: Detected new or changed devices on smithi047 2024-09-13T22:51:01.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:00 smithi002 ceph-mon[27637]: Adjusting osd_memory_target on smithi047 to 14916M 2024-09-13T22:51:01.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:00 smithi002 ceph-mon[27637]: osdmap e31: 4 total, 4 up, 4 in 2024-09-13T22:51:01.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:00 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:51:01.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:00 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:01.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:00 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:51:01.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:00 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:01.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:00 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:51:01.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:00 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:51:01.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:00 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:02.186 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:01 smithi047 ceph-mon[34560]: from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:02.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:01 smithi002 ceph-mon[27637]: from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:02 smithi002 ceph-mon[27637]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-09-13T22:51:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:02 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:51:03.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:02 smithi047 ceph-mon[34560]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-09-13T22:51:03.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:02 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:51:04.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:03 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/567891035' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfbaa035-e904-4aef-80dc-52dbf7942ce7"}]: dispatch 2024-09-13T22:51:04.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:03 smithi002 ceph-mon[27637]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfbaa035-e904-4aef-80dc-52dbf7942ce7"}]: dispatch 2024-09-13T22:51:04.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:03 smithi002 ceph-mon[27637]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bfbaa035-e904-4aef-80dc-52dbf7942ce7"}]': finished 2024-09-13T22:51:04.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:03 smithi002 ceph-mon[27637]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T22:51:04.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:03 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:51:04.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:03 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/2494463613' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:51:04.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:03 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/567891035' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfbaa035-e904-4aef-80dc-52dbf7942ce7"}]: dispatch 2024-09-13T22:51:04.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:03 smithi047 ceph-mon[34560]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfbaa035-e904-4aef-80dc-52dbf7942ce7"}]: dispatch 2024-09-13T22:51:04.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:03 smithi047 ceph-mon[34560]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bfbaa035-e904-4aef-80dc-52dbf7942ce7"}]': finished 2024-09-13T22:51:04.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:03 smithi047 ceph-mon[34560]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T22:51:04.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:03 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:51:04.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:03 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/2494463613' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:51:05.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:04 smithi002 ceph-mon[27637]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-13T22:51:05.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:04 smithi047 ceph-mon[34560]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-13T22:51:07.209 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:06 smithi047 ceph-mon[34560]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-13T22:51:07.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:06 smithi002 ceph-mon[27637]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-13T22:51:09.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:08 smithi002 ceph-mon[27637]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T22:51:09.257 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:08 smithi047 ceph-mon[34560]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T22:51:10.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:09 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T22:51:10.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:09 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:10.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:09 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T22:51:10.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:09 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:11.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:10 smithi002 ceph-mon[27637]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T22:51:11.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:10 smithi002 ceph-mon[27637]: Deploying daemon osd.4 on smithi047 2024-09-13T22:51:11.252 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:10 smithi047 ceph-mon[34560]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T22:51:11.252 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:10 smithi047 ceph-mon[34560]: Deploying daemon osd.4 on smithi047 2024-09-13T22:51:13.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:12 smithi047 ceph-mon[34560]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T22:51:13.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:12 smithi002 ceph-mon[27637]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T22:51:15.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:15 smithi047 ceph-mon[34560]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T22:51:15.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:15 smithi002 ceph-mon[27637]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T22:51:16.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:16 smithi002 ceph-mon[27637]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T22:51:16.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:16 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:16.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:16 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:16.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:16 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:51:16.501 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:16 smithi047 ceph-mon[34560]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T22:51:16.501 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:16 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:16.501 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:16 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:16.501 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:16 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:51:17.498 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:17 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:51:17.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:17 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:51:18.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:18 smithi002 ceph-mon[27637]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T22:51:18.520 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:18 smithi047 ceph-mon[34560]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T22:51:18.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:18.902+0000 7f963effd700 1 -- 172.21.15.47:0/3458290488 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f964c19eaf0 con 0x7f963806c4e0 2024-09-13T22:51:18.903 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 4 on host 'smithi047' 2024-09-13T22:51:18.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:18.905+0000 7f9653d4d700 1 -- 172.21.15.47:0/3458290488 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f963806c4e0 msgr2=0x7f963806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:18.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:18.905+0000 7f9653d4d700 1 --2- 172.21.15.47:0/3458290488 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f963806c4e0 0x7f963806e9a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f964800b6f0 tx=0x7f9648005940 comp rx=0 tx=0).stop 2024-09-13T22:51:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:18.905+0000 7f9653d4d700 1 -- 172.21.15.47:0/3458290488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f964c101eb0 msgr2=0x7f964c073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:18.905+0000 7f9653d4d700 1 --2- 172.21.15.47:0/3458290488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f964c101eb0 0x7f964c073180 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f964000e920 tx=0x7f964000ec30 comp rx=0 tx=0).stop 2024-09-13T22:51:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:18.905+0000 7f9653d4d700 1 -- 172.21.15.47:0/3458290488 shutdown_connections 2024-09-13T22:51:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:18.905+0000 7f9653d4d700 1 --2- 172.21.15.47:0/3458290488 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f963806c4e0 0x7f963806e9a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:18.905+0000 7f9653d4d700 1 --2- 172.21.15.47:0/3458290488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f964c100cb0 0x7f964c074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:18.905+0000 7f9653d4d700 1 --2- 172.21.15.47:0/3458290488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f964c101eb0 0x7f964c073180 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:18.905+0000 7f9653d4d700 1 -- 172.21.15.47:0/3458290488 >> 172.21.15.47:0/3458290488 conn(0x7f964c0fc230 msgr2=0x7f964c1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:51:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:18.905+0000 7f9653d4d700 1 -- 172.21.15.47:0/3458290488 shutdown_connections 2024-09-13T22:51:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:18.905+0000 7f9653d4d700 1 -- 172.21.15.47:0/3458290488 wait complete. 2024-09-13T22:51:19.541 DEBUG:teuthology.orchestra.run.smithi047:osd.4> sudo journalctl -f -n 0 -u ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.4.service 2024-09-13T22:51:19.544 INFO:tasks.cephadm:Deploying osd.5 on smithi047 with /dev/vg_nvme/lv_2... 2024-09-13T22:51:19.544 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-13T22:51:19.795 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi047/config 2024-09-13T22:51:20.145 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:19 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:20.145 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:19 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:20.145 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:19 smithi047 ceph-mon[34560]: from='osd.4 [v2:172.21.15.47:6808/2444218504,v1:172.21.15.47:6809/2444218504]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T22:51:20.145 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:19 smithi047 ceph-mon[34560]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T22:51:20.145 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:19 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:20.145 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:19 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:20.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:19 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:20.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:19 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:20.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:19 smithi002 ceph-mon[27637]: from='osd.4 [v2:172.21.15.47:6808/2444218504,v1:172.21.15.47:6809/2444218504]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T22:51:20.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:19 smithi002 ceph-mon[27637]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T22:51:20.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:19 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:20.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:19 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:20.991 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:20 smithi047 ceph-mon[34560]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T22:51:20.991 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:20 smithi047 ceph-mon[34560]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T22:51:20.991 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:20 smithi047 ceph-mon[34560]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T22:51:20.991 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:20 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:51:20.991 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:20 smithi047 ceph-mon[34560]: from='osd.4 [v2:172.21.15.47:6808/2444218504,v1:172.21.15.47:6809/2444218504]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T22:51:20.991 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:20 smithi047 ceph-mon[34560]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T22:51:20.991 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 22:51:20 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[47271]: 2024-09-13T22:51:20.896+0000 7fb4d3766700 -1 osd.4 0 waiting for initial osdmap 2024-09-13T22:51:20.992 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 22:51:20 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[47271]: 2024-09-13T22:51:20.904+0000 7fb4cdd58700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:51:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:20 smithi002 ceph-mon[27637]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T22:51:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:20 smithi002 ceph-mon[27637]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T22:51:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:20 smithi002 ceph-mon[27637]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T22:51:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:20 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:51:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:20 smithi002 ceph-mon[27637]: from='osd.4 [v2:172.21.15.47:6808/2444218504,v1:172.21.15.47:6809/2444218504]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T22:51:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:20 smithi002 ceph-mon[27637]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T22:51:22.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:21 smithi047 ceph-mon[34560]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-13T22:51:22.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:21 smithi047 ceph-mon[34560]: osdmap e34: 5 total, 4 up, 5 in 2024-09-13T22:51:22.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:21 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:51:22.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:21 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:51:22.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:21 smithi002 ceph-mon[27637]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-13T22:51:22.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:21 smithi002 ceph-mon[27637]: osdmap e34: 5 total, 4 up, 5 in 2024-09-13T22:51:22.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:21 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:51:22.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:21 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:51:22.873 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-13T22:51:22.892 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_2 2024-09-13T22:51:23.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:22 smithi047 ceph-mon[34560]: purged_snaps scrub starts 2024-09-13T22:51:23.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:22 smithi047 ceph-mon[34560]: purged_snaps scrub ok 2024-09-13T22:51:23.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:22 smithi047 ceph-mon[34560]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T22:51:23.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:22 smithi047 ceph-mon[34560]: osd.4 [v2:172.21.15.47:6808/2444218504,v1:172.21.15.47:6809/2444218504] boot 2024-09-13T22:51:23.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:22 smithi047 ceph-mon[34560]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T22:51:23.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:22 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:51:23.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:22 smithi002 ceph-mon[27637]: purged_snaps scrub starts 2024-09-13T22:51:23.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:22 smithi002 ceph-mon[27637]: purged_snaps scrub ok 2024-09-13T22:51:23.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:22 smithi002 ceph-mon[27637]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-13T22:51:23.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:22 smithi002 ceph-mon[27637]: osd.4 [v2:172.21.15.47:6808/2444218504,v1:172.21.15.47:6809/2444218504] boot 2024-09-13T22:51:23.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:22 smithi002 ceph-mon[27637]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T22:51:23.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:22 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:51:23.447 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi047/config 2024-09-13T22:51:24.093 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:23 smithi047 ceph-mon[34560]: osdmap e36: 5 total, 5 up, 5 in 2024-09-13T22:51:24.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:23 smithi002 ceph-mon[27637]: osdmap e36: 5 total, 5 up, 5 in 2024-09-13T22:51:24.943 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:24 smithi047 ceph-mon[34560]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:24.943 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:24 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:24.943 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:24 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:24.943 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:24 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:51:24.943 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:24 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:51:24.943 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:24 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:24.943 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:24 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:24.943 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:24 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:51:24.943 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:24 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:24.944 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:24 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:51:24.944 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:24 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:24.944 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:24 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:51:24.944 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:24 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:25.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:24 smithi002 ceph-mon[27637]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:25.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:25.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:25.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:51:25.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:51:25.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:25.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:25.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:51:25.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:25.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:51:25.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:25.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:51:25.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:25.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.510+0000 7f95d6547700 1 -- 172.21.15.47:0/2233188683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d0101ea0 msgr2=0x7f95d0102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:25.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.510+0000 7f95d6547700 1 --2- 172.21.15.47:0/2233188683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d0101ea0 0x7f95d0102300 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f95c4009910 tx=0x7f95c4009c20 comp rx=0 tx=0).stop 2024-09-13T22:51:25.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.510+0000 7f95d6547700 1 -- 172.21.15.47:0/2233188683 shutdown_connections 2024-09-13T22:51:25.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.510+0000 7f95d6547700 1 --2- 172.21.15.47:0/2233188683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d0101ea0 0x7f95d0102300 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:25.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.510+0000 7f95d6547700 1 --2- 172.21.15.47:0/2233188683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95d0100ca0 0x7f95d01010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:25.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.510+0000 7f95d6547700 1 -- 172.21.15.47:0/2233188683 >> 172.21.15.47:0/2233188683 conn(0x7f95d00fc260 msgr2=0x7f95d00fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:51:25.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.510+0000 7f95d6547700 1 -- 172.21.15.47:0/2233188683 shutdown_connections 2024-09-13T22:51:25.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.510+0000 7f95d6547700 1 -- 172.21.15.47:0/2233188683 wait complete. 2024-09-13T22:51:25.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.510+0000 7f95d6547700 1 Processor -- start 2024-09-13T22:51:25.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.510+0000 7f95d6547700 1 -- start start 2024-09-13T22:51:25.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.511+0000 7f95d6547700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95d0100ca0 0x7f95d0196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:25.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.511+0000 7f95d6547700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d0101ea0 0x7f95d01969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:25.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.511+0000 7f95d6547700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d0196fe0 con 0x7f95d0100ca0 2024-09-13T22:51:25.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.511+0000 7f95d6547700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d0197120 con 0x7f95d0101ea0 2024-09-13T22:51:25.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.511+0000 7f95cf7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d0101ea0 0x7f95d01969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:25.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.511+0000 7f95cf7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d0101ea0 0x7f95d01969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59732/0 (socket says 172.21.15.47:59732) 2024-09-13T22:51:25.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.511+0000 7f95cf7fe700 1 -- 172.21.15.47:0/2209456543 learned_addr learned my addr 172.21.15.47:0/2209456543 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:51:25.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.511+0000 7f95cffff700 1 --2- 172.21.15.47:0/2209456543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95d0100ca0 0x7f95d0196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:25.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.511+0000 7f95cf7fe700 1 -- 172.21.15.47:0/2209456543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95d0100ca0 msgr2=0x7f95d0196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:25.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.511+0000 7f95cf7fe700 1 --2- 172.21.15.47:0/2209456543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95d0100ca0 0x7f95d0196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:25.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.511+0000 7f95cf7fe700 1 -- 172.21.15.47:0/2209456543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c40095f0 con 0x7f95d0101ea0 2024-09-13T22:51:25.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.511+0000 7f95cf7fe700 1 --2- 172.21.15.47:0/2209456543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d0101ea0 0x7f95d01969c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f95c4006010 tx=0x7f95c400bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:51:25.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.512+0000 7f95cd7fa700 1 -- 172.21.15.47:0/2209456543 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95c401d070 con 0x7f95d0101ea0 2024-09-13T22:51:25.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.512+0000 7f95d6547700 1 -- 172.21.15.47:0/2209456543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d019bb70 con 0x7f95d0101ea0 2024-09-13T22:51:25.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.512+0000 7f95cd7fa700 1 -- 172.21.15.47:0/2209456543 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f95c400f460 con 0x7f95d0101ea0 2024-09-13T22:51:25.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.512+0000 7f95cd7fa700 1 -- 172.21.15.47:0/2209456543 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95c4021640 con 0x7f95d0101ea0 2024-09-13T22:51:25.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.512+0000 7f95d6547700 1 -- 172.21.15.47:0/2209456543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d019c060 con 0x7f95d0101ea0 2024-09-13T22:51:25.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.513+0000 7f95d6547700 1 -- 172.21.15.47:0/2209456543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d0109800 con 0x7f95d0101ea0 2024-09-13T22:51:25.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.513+0000 7f95cd7fa700 1 -- 172.21.15.47:0/2209456543 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f95c400fab0 con 0x7f95d0101ea0 2024-09-13T22:51:25.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.514+0000 7f95cd7fa700 1 --2- 172.21.15.47:0/2209456543 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f95b806c4e0 0x7f95b806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:25.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.514+0000 7f95cd7fa700 1 -- 172.21.15.47:0/2209456543 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4034+0+0 (secure 0 0 0) 0x7f95c408c4e0 con 0x7f95d0101ea0 2024-09-13T22:51:25.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.514+0000 7f95cffff700 1 --2- 172.21.15.47:0/2209456543 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f95b806c4e0 0x7f95b806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:25.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.515+0000 7f95cffff700 1 --2- 172.21.15.47:0/2209456543 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f95b806c4e0 0x7f95b806e9a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f95d0101d00 tx=0x7f95c000b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:51:25.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.519+0000 7f95cd7fa700 1 -- 172.21.15.47:0/2209456543 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f95c405aeb0 con 0x7f95d0101ea0 2024-09-13T22:51:25.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:25.727+0000 7f95d6547700 1 -- 172.21.15.47:0/2209456543 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f95d01067f0 con 0x7f95b806c4e0 2024-09-13T22:51:26.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:25 smithi047 ceph-mon[34560]: Detected new or changed devices on smithi047 2024-09-13T22:51:26.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:25 smithi047 ceph-mon[34560]: Adjusting osd_memory_target on smithi047 to 7458M 2024-09-13T22:51:26.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:25 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:51:26.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:25 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:51:26.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:25 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:26.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:25 smithi002 ceph-mon[27637]: Detected new or changed devices on smithi047 2024-09-13T22:51:26.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:25 smithi002 ceph-mon[27637]: Adjusting osd_memory_target on smithi047 to 7458M 2024-09-13T22:51:26.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:25 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T22:51:26.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:25 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T22:51:26.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:25 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:27.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:26 smithi047 ceph-mon[34560]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:27.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:26 smithi047 ceph-mon[34560]: from='client.24179 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:27.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:26 smithi002 ceph-mon[27637]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:27.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:26 smithi002 ceph-mon[27637]: from='client.24179 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:51:29.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:28 smithi047 ceph-mon[34560]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:29.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:28 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/49537529' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d83de4e-4a7b-4cbe-b4d1-6cc958a03031"}]: dispatch 2024-09-13T22:51:29.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:28 smithi047 ceph-mon[34560]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d83de4e-4a7b-4cbe-b4d1-6cc958a03031"}]: dispatch 2024-09-13T22:51:29.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:28 smithi047 ceph-mon[34560]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d83de4e-4a7b-4cbe-b4d1-6cc958a03031"}]': finished 2024-09-13T22:51:29.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:28 smithi047 ceph-mon[34560]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T22:51:29.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:28 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:51:29.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:28 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/3595056168' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:51:29.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:28 smithi002 ceph-mon[27637]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:29.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:28 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/49537529' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d83de4e-4a7b-4cbe-b4d1-6cc958a03031"}]: dispatch 2024-09-13T22:51:29.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:28 smithi002 ceph-mon[27637]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d83de4e-4a7b-4cbe-b4d1-6cc958a03031"}]: dispatch 2024-09-13T22:51:29.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:28 smithi002 ceph-mon[27637]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d83de4e-4a7b-4cbe-b4d1-6cc958a03031"}]': finished 2024-09-13T22:51:29.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:28 smithi002 ceph-mon[27637]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T22:51:29.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:28 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:51:29.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:28 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/3595056168' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T22:51:31.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:30 smithi002 ceph-mon[27637]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:31.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:30 smithi047 ceph-mon[34560]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:32 smithi002 ceph-mon[27637]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:32 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:51:33.268 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:32 smithi047 ceph-mon[34560]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:33.269 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:32 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:51:35.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:34 smithi047 ceph-mon[34560]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:35.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:34 smithi002 ceph-mon[27637]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:36.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:35 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T22:51:36.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:35 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:36.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:35 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T22:51:36.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:35 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:37.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:36 smithi047 ceph-mon[34560]: Deploying daemon osd.5 on smithi047 2024-09-13T22:51:37.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:36 smithi047 ceph-mon[34560]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:37.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:36 smithi002 ceph-mon[27637]: Deploying daemon osd.5 on smithi047 2024-09-13T22:51:37.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:36 smithi002 ceph-mon[27637]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:39.119 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:38 smithi047 ceph-mon[34560]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:38 smithi002 ceph-mon[27637]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:41.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:40 smithi002 ceph-mon[27637]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:41.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:40 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:41.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:40 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:41.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:40 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:51:41.349 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:40 smithi047 ceph-mon[34560]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:41.349 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:40 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:41.349 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:40 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:41.349 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:40 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:51:43.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:42 smithi002 ceph-mon[27637]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:43.312 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:42 smithi047 ceph-mon[34560]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:43.996 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 5 on host 'smithi047' 2024-09-13T22:51:43.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:43.995+0000 7f95cd7fa700 1 -- 172.21.15.47:0/2209456543 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f95d01067f0 con 0x7f95b806c4e0 2024-09-13T22:51:43.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:43.998+0000 7f95d6547700 1 -- 172.21.15.47:0/2209456543 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f95b806c4e0 msgr2=0x7f95b806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:43.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:43.998+0000 7f95d6547700 1 --2- 172.21.15.47:0/2209456543 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f95b806c4e0 0x7f95b806e9a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f95d0101d00 tx=0x7f95c000b410 comp rx=0 tx=0).stop 2024-09-13T22:51:43.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:43.998+0000 7f95d6547700 1 -- 172.21.15.47:0/2209456543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d0101ea0 msgr2=0x7f95d01969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:43.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:43.998+0000 7f95d6547700 1 --2- 172.21.15.47:0/2209456543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d0101ea0 0x7f95d01969c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f95c4006010 tx=0x7f95c400bd70 comp rx=0 tx=0).stop 2024-09-13T22:51:43.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:43.998+0000 7f95d6547700 1 -- 172.21.15.47:0/2209456543 shutdown_connections 2024-09-13T22:51:43.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:43.998+0000 7f95d6547700 1 --2- 172.21.15.47:0/2209456543 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f95b806c4e0 0x7f95b806e9a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:43.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:43.998+0000 7f95d6547700 1 --2- 172.21.15.47:0/2209456543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95d0100ca0 0x7f95d0196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:43.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:43.998+0000 7f95d6547700 1 --2- 172.21.15.47:0/2209456543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95d0101ea0 0x7f95d01969c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:43.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:43.998+0000 7f95d6547700 1 -- 172.21.15.47:0/2209456543 >> 172.21.15.47:0/2209456543 conn(0x7f95d00fc260 msgr2=0x7f95d01050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:51:43.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:43.998+0000 7f95d6547700 1 -- 172.21.15.47:0/2209456543 shutdown_connections 2024-09-13T22:51:43.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:43.998+0000 7f95d6547700 1 -- 172.21.15.47:0/2209456543 wait complete. 2024-09-13T22:51:44.630 DEBUG:teuthology.orchestra.run.smithi047:osd.5> sudo journalctl -f -n 0 -u ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.5.service 2024-09-13T22:51:44.633 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-13T22:51:44.633 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T22:51:44.854 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:51:45.206 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:44 smithi047 ceph-mon[34560]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:45.206 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:45.206 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:45.207 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:44 smithi047 ceph-mon[34560]: from='osd.5 [v2:172.21.15.47:6816/1979123292,v1:172.21.15.47:6817/1979123292]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T22:51:45.207 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:44 smithi047 ceph-mon[34560]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T22:51:45.207 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:45.207 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:45.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:44 smithi002 ceph-mon[27637]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:45.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:44 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:45.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:44 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:45.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:44 smithi002 ceph-mon[27637]: from='osd.5 [v2:172.21.15.47:6816/1979123292,v1:172.21.15.47:6817/1979123292]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T22:51:45.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:44 smithi002 ceph-mon[27637]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T22:51:45.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:44 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:45.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:44 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:46.085 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:45 smithi047 ceph-mon[34560]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T22:51:46.086 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:45 smithi047 ceph-mon[34560]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T22:51:46.086 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:45 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:51:46.086 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:45 smithi047 ceph-mon[34560]: from='osd.5 [v2:172.21.15.47:6816/1979123292,v1:172.21.15.47:6817/1979123292]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T22:51:46.086 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:45 smithi047 ceph-mon[34560]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T22:51:46.086 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 22:51:45 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[53864]: 2024-09-13T22:51:45.966+0000 7f82f549f700 -1 osd.5 0 waiting for initial osdmap 2024-09-13T22:51:46.086 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 22:51:45 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[53864]: 2024-09-13T22:51:45.974+0000 7f82eda8d700 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T22:51:46.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:45 smithi002 ceph-mon[27637]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T22:51:46.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:45 smithi002 ceph-mon[27637]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T22:51:46.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:45 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:51:46.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:45 smithi002 ceph-mon[27637]: from='osd.5 [v2:172.21.15.47:6816/1979123292,v1:172.21.15.47:6817/1979123292]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T22:51:46.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:45 smithi002 ceph-mon[27637]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T22:51:46.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.842+0000 7f74ee342700 1 -- 172.21.15.2:0/405819644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e81017a0 msgr2=0x7f74e8103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:46.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.842+0000 7f74ee342700 1 --2- 172.21.15.2:0/405819644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e81017a0 0x7f74e8103b90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009910 tx=0x7f74d8009c20 comp rx=0 tx=0).stop 2024-09-13T22:51:46.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.843+0000 7f74ee342700 1 -- 172.21.15.2:0/405819644 shutdown_connections 2024-09-13T22:51:46.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.843+0000 7f74ee342700 1 --2- 172.21.15.2:0/405819644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e81040d0 0x7f74e81064c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:46.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.843+0000 7f74ee342700 1 --2- 172.21.15.2:0/405819644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e81017a0 0x7f74e8103b90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:46.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.843+0000 7f74ee342700 1 -- 172.21.15.2:0/405819644 >> 172.21.15.2:0/405819644 conn(0x7f74e80fb190 msgr2=0x7f74e80fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:51:46.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.843+0000 7f74ee342700 1 -- 172.21.15.2:0/405819644 shutdown_connections 2024-09-13T22:51:46.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.843+0000 7f74ee342700 1 -- 172.21.15.2:0/405819644 wait complete. 2024-09-13T22:51:46.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.843+0000 7f74ee342700 1 Processor -- start 2024-09-13T22:51:46.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.843+0000 7f74ee342700 1 -- start start 2024-09-13T22:51:46.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.843+0000 7f74ee342700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e81017a0 0x7f74e81986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:46.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.843+0000 7f74ee342700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e81040d0 0x7f74e8198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:46.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.843+0000 7f74ee342700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e8199210 con 0x7f74e81017a0 2024-09-13T22:51:46.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.843+0000 7f74ee342700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e8199350 con 0x7f74e81040d0 2024-09-13T22:51:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.844+0000 7f74e7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e81017a0 0x7f74e81986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.844+0000 7f74e7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e81017a0 0x7f74e81986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37730/0 (socket says 172.21.15.2:37730) 2024-09-13T22:51:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.844+0000 7f74e7fff700 1 -- 172.21.15.2:0/74785042 learned_addr learned my addr 172.21.15.2:0/74785042 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:51:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.844+0000 7f74dffff700 1 --2- 172.21.15.2:0/74785042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e81040d0 0x7f74e8198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.844+0000 7f74e7fff700 1 -- 172.21.15.2:0/74785042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e81040d0 msgr2=0x7f74e8198bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.844+0000 7f74e7fff700 1 --2- 172.21.15.2:0/74785042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e81040d0 0x7f74e8198bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.844+0000 7f74e7fff700 1 -- 172.21.15.2:0/74785042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d80095f0 con 0x7f74e81017a0 2024-09-13T22:51:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.844+0000 7f74e7fff700 1 --2- 172.21.15.2:0/74785042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e81017a0 0x7f74e81986b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f74d8006010 tx=0x7f74d800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:51:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.844+0000 7f74e5ffb700 1 -- 172.21.15.2:0/74785042 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74d801d070 con 0x7f74e81017a0 2024-09-13T22:51:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.844+0000 7f74e5ffb700 1 -- 172.21.15.2:0/74785042 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f74d800f460 con 0x7f74e81017a0 2024-09-13T22:51:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.844+0000 7f74ee342700 1 -- 172.21.15.2:0/74785042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e819dd50 con 0x7f74e81017a0 2024-09-13T22:51:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.844+0000 7f74e5ffb700 1 -- 172.21.15.2:0/74785042 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74d8021640 con 0x7f74e81017a0 2024-09-13T22:51:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.844+0000 7f74ee342700 1 -- 172.21.15.2:0/74785042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e819e1e0 con 0x7f74e81017a0 2024-09-13T22:51:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.845+0000 7f74ee342700 1 -- 172.21.15.2:0/74785042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e80fcd80 con 0x7f74e81017a0 2024-09-13T22:51:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.846+0000 7f74e5ffb700 1 -- 172.21.15.2:0/74785042 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f74d800fab0 con 0x7f74e81017a0 2024-09-13T22:51:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.846+0000 7f74e5ffb700 1 --2- 172.21.15.2:0/74785042 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f74d406c4e0 0x7f74d406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.847+0000 7f74e5ffb700 1 -- 172.21.15.2:0/74785042 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4186+0+0 (secure 0 0 0) 0x7f74d808c660 con 0x7f74e81017a0 2024-09-13T22:51:46.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.847+0000 7f74dffff700 1 --2- 172.21.15.2:0/74785042 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f74d406c4e0 0x7f74d406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:46.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.847+0000 7f74dffff700 1 --2- 172.21.15.2:0/74785042 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f74d406c4e0 0x7f74d406e9a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f74d0005950 tx=0x7f74d000b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:51:46.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:46.851+0000 7f74e5ffb700 1 -- 172.21.15.2:0/74785042 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f74d805ad30 con 0x7f74e81017a0 2024-09-13T22:51:47.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:47.054+0000 7f74ee342700 1 -- 172.21.15.2:0/74785042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f74e802cc70 con 0x7f74e81017a0 2024-09-13T22:51:47.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:47.055+0000 7f74e5ffb700 1 -- 172.21.15.2:0/74785042 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7f74d805a8c0 con 0x7f74e81017a0 2024-09-13T22:51:47.056 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:51:47.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:47.057+0000 7f74ee342700 1 -- 172.21.15.2:0/74785042 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f74d406c4e0 msgr2=0x7f74d406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:47.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:47.057+0000 7f74ee342700 1 --2- 172.21.15.2:0/74785042 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f74d406c4e0 0x7f74d406e9a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f74d0005950 tx=0x7f74d000b410 comp rx=0 tx=0).stop 2024-09-13T22:51:47.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:47.057+0000 7f74ee342700 1 -- 172.21.15.2:0/74785042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e81017a0 msgr2=0x7f74e81986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:47.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:47.057+0000 7f74ee342700 1 --2- 172.21.15.2:0/74785042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e81017a0 0x7f74e81986b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f74d8006010 tx=0x7f74d800bd70 comp rx=0 tx=0).stop 2024-09-13T22:51:47.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:47.057+0000 7f74ee342700 1 -- 172.21.15.2:0/74785042 shutdown_connections 2024-09-13T22:51:47.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:47.057+0000 7f74ee342700 1 --2- 172.21.15.2:0/74785042 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f74d406c4e0 0x7f74d406e9a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:47.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:47.057+0000 7f74ee342700 1 --2- 172.21.15.2:0/74785042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e81017a0 0x7f74e81986b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:47.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:47.057+0000 7f74ee342700 1 --2- 172.21.15.2:0/74785042 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74e81040d0 0x7f74e8198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:47.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:47.057+0000 7f74ee342700 1 -- 172.21.15.2:0/74785042 >> 172.21.15.2:0/74785042 conn(0x7f74e80fb190 msgr2=0x7f74e8101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:51:47.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:47.057+0000 7f74ee342700 1 -- 172.21.15.2:0/74785042 shutdown_connections 2024-09-13T22:51:47.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:47.057+0000 7f74ee342700 1 -- 172.21.15.2:0/74785042 wait complete. 2024-09-13T22:51:47.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:46 smithi002 ceph-mon[27637]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:47.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:46 smithi002 ceph-mon[27637]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-13T22:51:47.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:46 smithi002 ceph-mon[27637]: osdmap e39: 6 total, 5 up, 6 in 2024-09-13T22:51:47.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:46 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:51:47.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:46 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:51:47.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:46 smithi047 ceph-mon[34560]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:47.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:46 smithi047 ceph-mon[34560]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-13T22:51:47.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:46 smithi047 ceph-mon[34560]: osdmap e39: 6 total, 5 up, 6 in 2024-09-13T22:51:47.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:46 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:51:47.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:46 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:51:47.736 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1726267906,"num_in_osds":6,"osd_in_since":1726267888,"num_remapped_pgs":0} 2024-09-13T22:51:47.737 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T22:51:47.946 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:51:47.974 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:47 smithi002 ceph-mon[27637]: purged_snaps scrub starts 2024-09-13T22:51:47.974 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:47 smithi002 ceph-mon[27637]: purged_snaps scrub ok 2024-09-13T22:51:47.987 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:47 smithi047 ceph-mon[34560]: purged_snaps scrub starts 2024-09-13T22:51:47.987 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:47 smithi047 ceph-mon[34560]: purged_snaps scrub ok 2024-09-13T22:51:47.987 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:47 smithi047 ceph-mon[34560]: osd.5 [v2:172.21.15.47:6816/1979123292,v1:172.21.15.47:6817/1979123292] boot 2024-09-13T22:51:47.988 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:47 smithi047 ceph-mon[34560]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T22:51:47.988 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:47 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:51:47.988 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:47 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/74785042' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T22:51:47.988 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:47 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:51:48.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:47 smithi002 ceph-mon[27637]: osd.5 [v2:172.21.15.47:6816/1979123292,v1:172.21.15.47:6817/1979123292] boot 2024-09-13T22:51:48.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:47 smithi002 ceph-mon[27637]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T22:51:48.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:47 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:51:48.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:47 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/74785042' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T22:51:48.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:47 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:51:49.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:48 smithi047 ceph-mon[34560]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:49.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:48 smithi047 ceph-mon[34560]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T22:51:49.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:48 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:49.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:48 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:49.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:48 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:51:49.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:48 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:51:49.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:48 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:51:49.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:48 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:49.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:48 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:49.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:48 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:51:49.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:48 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:49.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:48 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:51:49.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:48 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:49.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:48 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:51:49.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:48 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:49.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:48 smithi002 ceph-mon[27637]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-13T22:51:49.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:48 smithi002 ceph-mon[27637]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T22:51:49.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:48 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:49.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:48 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:49.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:48 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:51:49.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:48 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:51:49.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:48 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:51:49.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:48 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:49.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:48 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:49.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:48 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:51:49.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:48 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:49.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:48 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:51:49.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:48 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:51:49.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:48 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:51:49.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:48 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:51:49.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.790+0000 7f990eeaa700 1 -- 172.21.15.2:0/2137838354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99080ffda0 msgr2=0x7f9908100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:49.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.790+0000 7f990eeaa700 1 --2- 172.21.15.2:0/2137838354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99080ffda0 0x7f9908100180 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009910 tx=0x7f98fc009c20 comp rx=0 tx=0).stop 2024-09-13T22:51:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.790+0000 7f990eeaa700 1 -- 172.21.15.2:0/2137838354 shutdown_connections 2024-09-13T22:51:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.790+0000 7f990eeaa700 1 --2- 172.21.15.2:0/2137838354 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9908100750 0x7f99081047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.790+0000 7f990eeaa700 1 --2- 172.21.15.2:0/2137838354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99080ffda0 0x7f9908100180 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.790+0000 7f990eeaa700 1 -- 172.21.15.2:0/2137838354 >> 172.21.15.2:0/2137838354 conn(0x7f99080fb650 msgr2=0x7f99080fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:51:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.790+0000 7f990eeaa700 1 -- 172.21.15.2:0/2137838354 shutdown_connections 2024-09-13T22:51:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.790+0000 7f990eeaa700 1 -- 172.21.15.2:0/2137838354 wait complete. 2024-09-13T22:51:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.791+0000 7f990eeaa700 1 Processor -- start 2024-09-13T22:51:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.791+0000 7f990eeaa700 1 -- start start 2024-09-13T22:51:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.791+0000 7f990eeaa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99080ffda0 0x7f990819c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.791+0000 7f990eeaa700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9908100750 0x7f990819cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.791+0000 7f990eeaa700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990819d200 con 0x7f99080ffda0 2024-09-13T22:51:49.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.791+0000 7f990eeaa700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99081966b0 con 0x7f9908100750 2024-09-13T22:51:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.791+0000 7f990cc46700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99080ffda0 0x7f990819c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.791+0000 7f990cc46700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99080ffda0 0x7f990819c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37748/0 (socket says 172.21.15.2:37748) 2024-09-13T22:51:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.791+0000 7f990cc46700 1 -- 172.21.15.2:0/1495926362 learned_addr learned my addr 172.21.15.2:0/1495926362 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:51:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.791+0000 7f9907fff700 1 --2- 172.21.15.2:0/1495926362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9908100750 0x7f990819cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.791+0000 7f990cc46700 1 -- 172.21.15.2:0/1495926362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9908100750 msgr2=0x7f990819cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.791+0000 7f990cc46700 1 --2- 172.21.15.2:0/1495926362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9908100750 0x7f990819cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.791+0000 7f990cc46700 1 -- 172.21.15.2:0/1495926362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc0095f0 con 0x7f99080ffda0 2024-09-13T22:51:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.792+0000 7f990cc46700 1 --2- 172.21.15.2:0/1495926362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99080ffda0 0x7f990819c630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f98fc006010 tx=0x7f98fc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:51:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.792+0000 7f9905ffb700 1 -- 172.21.15.2:0/1495926362 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98fc01d070 con 0x7f99080ffda0 2024-09-13T22:51:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.792+0000 7f990eeaa700 1 -- 172.21.15.2:0/1495926362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9908196930 con 0x7f99080ffda0 2024-09-13T22:51:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.792+0000 7f9905ffb700 1 -- 172.21.15.2:0/1495926362 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f98fc00f460 con 0x7f99080ffda0 2024-09-13T22:51:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.792+0000 7f9905ffb700 1 -- 172.21.15.2:0/1495926362 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98fc021640 con 0x7f99080ffda0 2024-09-13T22:51:49.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.792+0000 7f990eeaa700 1 -- 172.21.15.2:0/1495926362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9908196e20 con 0x7f99080ffda0 2024-09-13T22:51:49.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.793+0000 7f990eeaa700 1 -- 172.21.15.2:0/1495926362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f990804f2e0 con 0x7f99080ffda0 2024-09-13T22:51:49.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.794+0000 7f9905ffb700 1 -- 172.21.15.2:0/1495926362 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f98fc00faf0 con 0x7f99080ffda0 2024-09-13T22:51:49.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.794+0000 7f9905ffb700 1 --2- 172.21.15.2:0/1495926362 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f98f806c4e0 0x7f98f806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:49.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.794+0000 7f9905ffb700 1 -- 172.21.15.2:0/1495926362 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f98fc08c730 con 0x7f99080ffda0 2024-09-13T22:51:49.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.794+0000 7f9907fff700 1 --2- 172.21.15.2:0/1495926362 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f98f806c4e0 0x7f98f806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:49.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.795+0000 7f9907fff700 1 --2- 172.21.15.2:0/1495926362 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f98f806c4e0 0x7f98f806e9a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f98f4005fd0 tx=0x7f98f400a560 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:51:49.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.799+0000 7f9905ffb700 1 -- 172.21.15.2:0/1495926362 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f98fc05ad80 con 0x7f99080ffda0 2024-09-13T22:51:49.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.996+0000 7f990eeaa700 1 -- 172.21.15.2:0/1495926362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9908197100 con 0x7f99080ffda0 2024-09-13T22:51:49.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:49.997+0000 7f9905ffb700 1 -- 172.21.15.2:0/1495926362 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+10975 (secure 0 0 0) 0x7f98fc05a910 con 0x7f99080ffda0 2024-09-13T22:51:49.999 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:51:49.999 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":41,"fsid":"e41042f8-7221-11ef-bceb-c7b262605968","created":"2024-09-13T22:46:10.665594+0000","modified":"2024-09-13T22:51:47.968609+0000","last_up_change":"2024-09-13T22:51:46.964066+0000","last_in_change":"2024-09-13T22:51:28.127149+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T22:50:33.659140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c671c42-9846-4f40-ba31-8acc1c184352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3953793391},{"type":"v1","addr":"172.21.15.2:6803","nonce":3953793391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3953793391},{"type":"v1","addr":"172.21.15.2:6805","nonce":3953793391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3953793391},{"type":"v1","addr":"172.21.15.2:6809","nonce":3953793391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3953793391},{"type":"v1","addr":"172.21.15.2:6807","nonce":3953793391}]},"public_addr":"172.21.15.2:6803/3953793391","cluster_addr":"172.21.15.2:6805/3953793391","heartbeat_back_addr":"172.21.15.2:6809/3953793391","heartbeat_front_addr":"172.21.15.2:6807/3953793391","state":["exists","up"]},{"osd":1,"uuid":"2e6b4859-b5cf-4548-8a37-9f836fdab3ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":182375359},{"type":"v1","addr":"172.21.15.2:6811","nonce":182375359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":182375359},{"type":"v1","addr":"172.21.15.2:6813","nonce":182375359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":182375359},{"type":"v1","addr":"172.21.15.2:6817","nonce":182375359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":182375359},{"type":"v1","addr":"172.21.15.2:6815","nonce":182375359}]},"public_addr":"172.21.15.2:6811/182375359","cluster_addr":"172.21.15.2:6813/182375359","heartbeat_back_addr":"172.21.15.2:6817/182375359","heartbeat_front_addr":"172.21.15.2:6815/182375359","state":["exists","up"]},{"osd":2,"uuid":"746451f4-049b-4613-9cce-31bda05dc08c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2103429173},{"type":"v1","addr":"172.21.15.2:6819","nonce":2103429173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2103429173},{"type":"v1","addr":"172.21.15.2:6821","nonce":2103429173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2103429173},{"type":"v1","addr":"172.21.15.2:6825","nonce":2103429173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2103429173},{"type":"v1","addr":"172.21.15.2:6823","nonce":2103429173}]},"public_addr":"172.21.15.2:6819/2103429173","cluster_addr":"172.21.15.2:6821/2103429173","heartbeat_back_addr":"172.21.15.2:6825/2103429173","heartbeat_front_addr":"172.21.15.2:6823/2103429173","state":["exists","up"]},{"osd":3,"uuid":"9732042d-4a75-48e6-b8d5-003e8b472c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4105215181},{"type":"v1","addr":"172.21.15.47:6801","nonce":4105215181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4105215181},{"type":"v1","addr":"172.21.15.47:6803","nonce":4105215181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4105215181},{"type":"v1","addr":"172.21.15.47:6807","nonce":4105215181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4105215181},{"type":"v1","addr":"172.21.15.47:6805","nonce":4105215181}]},"public_addr":"172.21.15.47:6801/4105215181","cluster_addr":"172.21.15.47:6803/4105215181","heartbeat_back_addr":"172.21.15.47:6807/4105215181","heartbeat_front_addr":"172.21.15.47:6805/4105215181","state":["exists","up"]},{"osd":4,"uuid":"bfbaa035-e904-4aef-80dc-52dbf7942ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2444218504},{"type":"v1","addr":"172.21.15.47:6809","nonce":2444218504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2444218504},{"type":"v1","addr":"172.21.15.47:6811","nonce":2444218504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2444218504},{"type":"v1","addr":"172.21.15.47:6815","nonce":2444218504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2444218504},{"type":"v1","addr":"172.21.15.47:6813","nonce":2444218504}]},"public_addr":"172.21.15.47:6809/2444218504","cluster_addr":"172.21.15.47:6811/2444218504","heartbeat_back_addr":"172.21.15.47:6815/2444218504","heartbeat_front_addr":"172.21.15.47:6813/2444218504","state":["exists","up"]},{"osd":5,"uuid":"5d83de4e-4a7b-4cbe-b4d1-6cc958a03031","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1979123292},{"type":"v1","addr":"172.21.15.47:6817","nonce":1979123292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1979123292},{"type":"v1","addr":"172.21.15.47:6819","nonce":1979123292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1979123292},{"type":"v1","addr":"172.21.15.47:6823","nonce":1979123292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1979123292},{"type":"v1","addr":"172.21.15.47:6821","nonce":1979123292}]},"public_addr":"172.21.15.47:6817/1979123292","cluster_addr":"172.21.15.47:6819/1979123292","heartbeat_back_addr":"172.21.15.47:6823/1979123292","heartbeat_front_addr":"172.21.15.47:6821/1979123292","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:49:34.259127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:50:01.898559+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:50:30.265570+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:50:54.473342+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:51:20.051398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:51:45.097262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/1925931750":"2024-09-14T22:48:17.145993+0000","172.21.15.2:0/1799605279":"2024-09-14T22:48:17.145993+0000","172.21.15.2:0/2669476310":"2024-09-14T22:47:11.476346+0000","172.21.15.2:0/3872121752":"2024-09-14T22:48:17.145993+0000","172.21.15.2:0/487476157":"2024-09-14T22:47:11.476346+0000","172.21.15.2:6801/2":"2024-09-14T22:46:38.903914+0000","172.21.15.2:6800/2":"2024-09-14T22:46:38.903914+0000","172.21.15.2:0/2072024940":"2024-09-14T22:46:38.903914+0000","172.21.15.2:0/963250354":"2024-09-14T22:46:38.903914+0000","172.21.15.2:0/921759862":"2024-09-14T22:46:38.903914+0000","172.21.15.2:0/3109882737":"2024-09-14T22:47:11.476346+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T22:51:50.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:50.000+0000 7f990eeaa700 1 -- 172.21.15.2:0/1495926362 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f98f806c4e0 msgr2=0x7f98f806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:50.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:50.000+0000 7f990eeaa700 1 --2- 172.21.15.2:0/1495926362 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f98f806c4e0 0x7f98f806e9a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f98f4005fd0 tx=0x7f98f400a560 comp rx=0 tx=0).stop 2024-09-13T22:51:50.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:50.000+0000 7f990eeaa700 1 -- 172.21.15.2:0/1495926362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99080ffda0 msgr2=0x7f990819c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:50.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:50.000+0000 7f990eeaa700 1 --2- 172.21.15.2:0/1495926362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99080ffda0 0x7f990819c630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f98fc006010 tx=0x7f98fc00be20 comp rx=0 tx=0).stop 2024-09-13T22:51:50.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:50.000+0000 7f990eeaa700 1 -- 172.21.15.2:0/1495926362 shutdown_connections 2024-09-13T22:51:50.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:50.000+0000 7f990eeaa700 1 --2- 172.21.15.2:0/1495926362 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f98f806c4e0 0x7f98f806e9a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:50.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:50.000+0000 7f990eeaa700 1 --2- 172.21.15.2:0/1495926362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99080ffda0 0x7f990819c630 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:50.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:50.000+0000 7f990eeaa700 1 --2- 172.21.15.2:0/1495926362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9908100750 0x7f990819cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:50.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:50.000+0000 7f990eeaa700 1 -- 172.21.15.2:0/1495926362 >> 172.21.15.2:0/1495926362 conn(0x7f99080fb650 msgr2=0x7f9908103f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:51:50.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:50.000+0000 7f990eeaa700 1 -- 172.21.15.2:0/1495926362 shutdown_connections 2024-09-13T22:51:50.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:50.000+0000 7f990eeaa700 1 -- 172.21.15.2:0/1495926362 wait complete. 2024-09-13T22:51:50.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:49 smithi002 ceph-mon[27637]: Detected new or changed devices on smithi047 2024-09-13T22:51:50.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:49 smithi002 ceph-mon[27637]: Adjusting osd_memory_target on smithi047 to 4972M 2024-09-13T22:51:50.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:49 smithi047 ceph-mon[34560]: Detected new or changed devices on smithi047 2024-09-13T22:51:50.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:49 smithi047 ceph-mon[34560]: Adjusting osd_memory_target on smithi047 to 4972M 2024-09-13T22:51:50.701 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T22:50:33.659140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T22:51:50.702 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-13T22:51:50.916 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:51:51.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:50 smithi002 ceph-mon[27637]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:51:51.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:50 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/1495926362' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:51:51.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:50 smithi047 ceph-mon[34560]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:51:51.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:50 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/1495926362' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:51:52.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.737+0000 7fe29b214700 1 -- 172.21.15.2:0/670880554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe294100ea0 msgr2=0x7fe294101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:52.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.737+0000 7fe29b214700 1 --2- 172.21.15.2:0/670880554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe294100ea0 0x7fe294101280 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe288009910 tx=0x7fe288009c20 comp rx=0 tx=0).stop 2024-09-13T22:51:52.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.738+0000 7fe29b214700 1 -- 172.21.15.2:0/670880554 shutdown_connections 2024-09-13T22:51:52.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.738+0000 7fe29b214700 1 --2- 172.21.15.2:0/670880554 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe294101850 0x7fe2941058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:52.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.738+0000 7fe29b214700 1 --2- 172.21.15.2:0/670880554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe294100ea0 0x7fe294101280 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:52.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.738+0000 7fe29b214700 1 -- 172.21.15.2:0/670880554 >> 172.21.15.2:0/670880554 conn(0x7fe2940fc750 msgr2=0x7fe2940feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:51:52.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.738+0000 7fe29b214700 1 -- 172.21.15.2:0/670880554 shutdown_connections 2024-09-13T22:51:52.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.738+0000 7fe29b214700 1 -- 172.21.15.2:0/670880554 wait complete. 2024-09-13T22:51:52.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.738+0000 7fe29b214700 1 Processor -- start 2024-09-13T22:51:52.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.738+0000 7fe29b214700 1 -- start start 2024-09-13T22:51:52.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.738+0000 7fe29b214700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe294100ea0 0x7fe294073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:52.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.738+0000 7fe29b214700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe294101850 0x7fe2940735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:52.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.738+0000 7fe29b214700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe294073b10 con 0x7fe294101850 2024-09-13T22:51:52.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.738+0000 7fe29b214700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe294073c50 con 0x7fe294100ea0 2024-09-13T22:51:52.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.739+0000 7fe293fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe294101850 0x7fe2940735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:52.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.739+0000 7fe293fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe294101850 0x7fe2940735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41432/0 (socket says 172.21.15.2:41432) 2024-09-13T22:51:52.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.739+0000 7fe293fff700 1 -- 172.21.15.2:0/723021667 learned_addr learned my addr 172.21.15.2:0/723021667 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:51:52.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.739+0000 7fe298fb0700 1 --2- 172.21.15.2:0/723021667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe294100ea0 0x7fe294073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:52.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.739+0000 7fe293fff700 1 -- 172.21.15.2:0/723021667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe294100ea0 msgr2=0x7fe294073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:52.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.739+0000 7fe293fff700 1 --2- 172.21.15.2:0/723021667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe294100ea0 0x7fe294073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:52.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.739+0000 7fe293fff700 1 -- 172.21.15.2:0/723021667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2880095f0 con 0x7fe294101850 2024-09-13T22:51:52.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.739+0000 7fe293fff700 1 --2- 172.21.15.2:0/723021667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe294101850 0x7fe2940735d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe28000d900 tx=0x7fe28000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:51:52.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.739+0000 7fe291ffb700 1 -- 172.21.15.2:0/723021667 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe280009900 con 0x7fe294101850 2024-09-13T22:51:52.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.739+0000 7fe291ffb700 1 -- 172.21.15.2:0/723021667 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe280010460 con 0x7fe294101850 2024-09-13T22:51:52.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.739+0000 7fe29b214700 1 -- 172.21.15.2:0/723021667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2941a2af0 con 0x7fe294101850 2024-09-13T22:51:52.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.739+0000 7fe291ffb700 1 -- 172.21.15.2:0/723021667 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe28000f5f0 con 0x7fe294101850 2024-09-13T22:51:52.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.740+0000 7fe29b214700 1 -- 172.21.15.2:0/723021667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2941a2f00 con 0x7fe294101850 2024-09-13T22:51:52.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.740+0000 7fe29b214700 1 -- 172.21.15.2:0/723021667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe294109240 con 0x7fe294101850 2024-09-13T22:51:52.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.741+0000 7fe291ffb700 1 -- 172.21.15.2:0/723021667 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fe2800105d0 con 0x7fe294101850 2024-09-13T22:51:52.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.741+0000 7fe291ffb700 1 --2- 172.21.15.2:0/723021667 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe28406c4e0 0x7fe28406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:52.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.741+0000 7fe291ffb700 1 -- 172.21.15.2:0/723021667 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fe28008aee0 con 0x7fe294101850 2024-09-13T22:51:52.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.741+0000 7fe298fb0700 1 --2- 172.21.15.2:0/723021667 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe28406c4e0 0x7fe28406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:52.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.742+0000 7fe298fb0700 1 --2- 172.21.15.2:0/723021667 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe28406c4e0 0x7fe28406e9a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe288006010 tx=0x7fe28801a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:51:52.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.746+0000 7fe291ffb700 1 -- 172.21.15.2:0/723021667 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe280055b20 con 0x7fe294101850 2024-09-13T22:51:52.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.945+0000 7fe29b214700 1 -- 172.21.15.2:0/723021667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe294108c20 con 0x7fe294101850 2024-09-13T22:51:52.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.945+0000 7fe291ffb700 1 -- 172.21.15.2:0/723021667 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2800200a0 con 0x7fe294101850 2024-09-13T22:51:52.948 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-09-13T22:51:52.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.948+0000 7fe29b214700 1 -- 172.21.15.2:0/723021667 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe28406c4e0 msgr2=0x7fe28406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:52.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.948+0000 7fe29b214700 1 --2- 172.21.15.2:0/723021667 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe28406c4e0 0x7fe28406e9a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe288006010 tx=0x7fe28801a040 comp rx=0 tx=0).stop 2024-09-13T22:51:52.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.948+0000 7fe29b214700 1 -- 172.21.15.2:0/723021667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe294101850 msgr2=0x7fe2940735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:52.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.948+0000 7fe29b214700 1 --2- 172.21.15.2:0/723021667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe294101850 0x7fe2940735d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe28000d900 tx=0x7fe28000dc10 comp rx=0 tx=0).stop 2024-09-13T22:51:52.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.948+0000 7fe29b214700 1 -- 172.21.15.2:0/723021667 shutdown_connections 2024-09-13T22:51:52.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.948+0000 7fe29b214700 1 --2- 172.21.15.2:0/723021667 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe28406c4e0 0x7fe28406e9a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:52.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.948+0000 7fe29b214700 1 --2- 172.21.15.2:0/723021667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe294100ea0 0x7fe294073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:52.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.948+0000 7fe29b214700 1 --2- 172.21.15.2:0/723021667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe294101850 0x7fe2940735d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:52.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.948+0000 7fe29b214700 1 -- 172.21.15.2:0/723021667 >> 172.21.15.2:0/723021667 conn(0x7fe2940fc750 msgr2=0x7fe2940fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:51:52.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.948+0000 7fe29b214700 1 -- 172.21.15.2:0/723021667 shutdown_connections 2024-09-13T22:51:52.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:52.948+0000 7fe29b214700 1 -- 172.21.15.2:0/723021667 wait complete. 2024-09-13T22:51:53.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:52 smithi002 ceph-mon[27637]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:51:53.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:52 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/723021667' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T22:51:53.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:52 smithi047 ceph-mon[34560]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:51:53.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:52 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/723021667' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T22:51:53.632 INFO:tasks.cephadm:Setting up client nodes... 2024-09-13T22:51:53.633 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T22:51:53.845 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:51:55.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:54 smithi002 ceph-mon[27637]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:51:55.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:54 smithi047 ceph-mon[34560]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:51:55.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.559+0000 7f4117e7c700 1 -- 172.21.15.2:0/1847020183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110100cb0 msgr2=0x7f41101010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:55.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.559+0000 7f4117e7c700 1 --2- 172.21.15.2:0/1847020183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110100cb0 0x7f41101010d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f410c009910 tx=0x7f410c009c20 comp rx=0 tx=0).stop 2024-09-13T22:51:55.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.559+0000 7f4117e7c700 1 -- 172.21.15.2:0/1847020183 shutdown_connections 2024-09-13T22:51:55.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.559+0000 7f4117e7c700 1 --2- 172.21.15.2:0/1847020183 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4110101eb0 0x7f4110102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:55.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.559+0000 7f4117e7c700 1 --2- 172.21.15.2:0/1847020183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110100cb0 0x7f41101010d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:55.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.559+0000 7f4117e7c700 1 -- 172.21.15.2:0/1847020183 >> 172.21.15.2:0/1847020183 conn(0x7f41100fc230 msgr2=0x7f41100fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:51:55.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.559+0000 7f4117e7c700 1 -- 172.21.15.2:0/1847020183 shutdown_connections 2024-09-13T22:51:55.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.559+0000 7f4117e7c700 1 -- 172.21.15.2:0/1847020183 wait complete. 2024-09-13T22:51:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.559+0000 7f4117e7c700 1 Processor -- start 2024-09-13T22:51:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.559+0000 7f4117e7c700 1 -- start start 2024-09-13T22:51:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.560+0000 7f4117e7c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110100cb0 0x7f41101986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.560+0000 7f4117e7c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4110101eb0 0x7f4110198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.560+0000 7f4117e7c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4110199230 con 0x7f4110100cb0 2024-09-13T22:51:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.560+0000 7f4117e7c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4110199370 con 0x7f4110101eb0 2024-09-13T22:51:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.560+0000 7f4115c18700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110100cb0 0x7f41101986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:55.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.560+0000 7f4115c18700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110100cb0 0x7f41101986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41450/0 (socket says 172.21.15.2:41450) 2024-09-13T22:51:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.560+0000 7f4115c18700 1 -- 172.21.15.2:0/4172157658 learned_addr learned my addr 172.21.15.2:0/4172157658 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:51:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.560+0000 7f4115c18700 1 -- 172.21.15.2:0/4172157658 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4110101eb0 msgr2=0x7f4110198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.560+0000 7f4115c18700 1 --2- 172.21.15.2:0/4172157658 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4110101eb0 0x7f4110198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.560+0000 7f4115c18700 1 -- 172.21.15.2:0/4172157658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c0095f0 con 0x7f4110100cb0 2024-09-13T22:51:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.560+0000 7f4115c18700 1 --2- 172.21.15.2:0/4172157658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110100cb0 0x7f41101986d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f410c00bda0 tx=0x7f410c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:51:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.560+0000 7f4106ffd700 1 -- 172.21.15.2:0/4172157658 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f410c01d070 con 0x7f4110100cb0 2024-09-13T22:51:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.560+0000 7f4117e7c700 1 -- 172.21.15.2:0/4172157658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411019ddc0 con 0x7f4110100cb0 2024-09-13T22:51:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.560+0000 7f4106ffd700 1 -- 172.21.15.2:0/4172157658 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f410c00f460 con 0x7f4110100cb0 2024-09-13T22:51:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.560+0000 7f4106ffd700 1 -- 172.21.15.2:0/4172157658 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f410c021640 con 0x7f4110100cb0 2024-09-13T22:51:55.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.561+0000 7f4117e7c700 1 -- 172.21.15.2:0/4172157658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411019e250 con 0x7f4110100cb0 2024-09-13T22:51:55.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.562+0000 7f4117e7c700 1 -- 172.21.15.2:0/4172157658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4110105f90 con 0x7f4110100cb0 2024-09-13T22:51:55.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.562+0000 7f4106ffd700 1 -- 172.21.15.2:0/4172157658 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f410c00fa00 con 0x7f4110100cb0 2024-09-13T22:51:55.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.563+0000 7f4106ffd700 1 --2- 172.21.15.2:0/4172157658 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f40fc06c4e0 0x7f40fc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:55.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.563+0000 7f4106ffd700 1 -- 172.21.15.2:0/4172157658 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f410c08c6e0 con 0x7f4110100cb0 2024-09-13T22:51:55.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.563+0000 7f4115417700 1 --2- 172.21.15.2:0/4172157658 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f40fc06c4e0 0x7f40fc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:55.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.563+0000 7f4115417700 1 --2- 172.21.15.2:0/4172157658 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f40fc06c4e0 0x7f40fc06e9a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4100005950 tx=0x7f41000058e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:51:55.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.567+0000 7f4106ffd700 1 -- 172.21.15.2:0/4172157658 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f410c05ad30 con 0x7f4110100cb0 2024-09-13T22:51:55.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.847+0000 7f4117e7c700 1 -- 172.21.15.2:0/4172157658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f411002cc70 con 0x7f4110100cb0 2024-09-13T22:51:55.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.850+0000 7f4106ffd700 1 -- 172.21.15.2:0/4172157658 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f410c05a8c0 con 0x7f4110100cb0 2024-09-13T22:51:55.852 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-09-13T22:51:55.852 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQALwuRm1mOTMhAACciI85aSbeoqfkuNWJ8tKg== 2024-09-13T22:51:55.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.853+0000 7f4117e7c700 1 -- 172.21.15.2:0/4172157658 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f40fc06c4e0 msgr2=0x7f40fc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:55.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.853+0000 7f4117e7c700 1 --2- 172.21.15.2:0/4172157658 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f40fc06c4e0 0x7f40fc06e9a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4100005950 tx=0x7f41000058e0 comp rx=0 tx=0).stop 2024-09-13T22:51:55.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.853+0000 7f4117e7c700 1 -- 172.21.15.2:0/4172157658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110100cb0 msgr2=0x7f41101986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:55.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.853+0000 7f4117e7c700 1 --2- 172.21.15.2:0/4172157658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110100cb0 0x7f41101986d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f410c00bda0 tx=0x7f410c00be80 comp rx=0 tx=0).stop 2024-09-13T22:51:55.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.853+0000 7f4117e7c700 1 -- 172.21.15.2:0/4172157658 shutdown_connections 2024-09-13T22:51:55.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.853+0000 7f4117e7c700 1 --2- 172.21.15.2:0/4172157658 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f40fc06c4e0 0x7f40fc06e9a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:55.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.853+0000 7f4117e7c700 1 --2- 172.21.15.2:0/4172157658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4110100cb0 0x7f41101986d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:55.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.853+0000 7f4117e7c700 1 --2- 172.21.15.2:0/4172157658 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4110101eb0 0x7f4110198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:55.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.853+0000 7f4117e7c700 1 -- 172.21.15.2:0/4172157658 >> 172.21.15.2:0/4172157658 conn(0x7f41100fc230 msgr2=0x7f41101030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:51:55.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.853+0000 7f4117e7c700 1 -- 172.21.15.2:0/4172157658 shutdown_connections 2024-09-13T22:51:55.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:51:55.853+0000 7f4117e7c700 1 -- 172.21.15.2:0/4172157658 wait complete. 2024-09-13T22:51:56.207 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:55 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/4172157658' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T22:51:56.224 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:55 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/4172157658' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T22:51:56.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:55 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/4172157658' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T22:51:56.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:55 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/4172157658' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T22:51:56.643 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-13T22:51:56.643 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-13T22:51:56.643 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T22:51:56.686 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T22:51:56.908 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi047/config 2024-09-13T22:51:57.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:56 smithi002 ceph-mon[27637]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:51:57.315 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:56 smithi047 ceph-mon[34560]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:51:58.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.369+0000 7fe8e58f8700 1 -- 172.21.15.47:0/1516924287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8e0100db0 msgr2=0x7fe8e0101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:58.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.369+0000 7fe8e58f8700 1 --2- 172.21.15.47:0/1516924287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8e0100db0 0x7fe8e0101210 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8009910 tx=0x7fe8c8009c20 comp rx=0 tx=0).stop 2024-09-13T22:51:58.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.369+0000 7fe8e58f8700 1 -- 172.21.15.47:0/1516924287 shutdown_connections 2024-09-13T22:51:58.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.369+0000 7fe8e58f8700 1 --2- 172.21.15.47:0/1516924287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8e0100db0 0x7fe8e0101210 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:58.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.369+0000 7fe8e58f8700 1 --2- 172.21.15.47:0/1516924287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8e00ffbb0 0x7fe8e00fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:58.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.369+0000 7fe8e58f8700 1 -- 172.21.15.47:0/1516924287 >> 172.21.15.47:0/1516924287 conn(0x7fe8e00fb150 msgr2=0x7fe8e00fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:51:58.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.369+0000 7fe8e58f8700 1 -- 172.21.15.47:0/1516924287 shutdown_connections 2024-09-13T22:51:58.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.369+0000 7fe8e58f8700 1 -- 172.21.15.47:0/1516924287 wait complete. 2024-09-13T22:51:58.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.370+0000 7fe8e58f8700 1 Processor -- start 2024-09-13T22:51:58.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.370+0000 7fe8e58f8700 1 -- start start 2024-09-13T22:51:58.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.370+0000 7fe8e58f8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8e00ffbb0 0x7fe8e0069970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:58.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.370+0000 7fe8e58f8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8e0100db0 0x7fe8e019b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:58.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.370+0000 7fe8e58f8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e019b750 con 0x7fe8e00ffbb0 2024-09-13T22:51:58.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.370+0000 7fe8e58f8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e019b890 con 0x7fe8e0100db0 2024-09-13T22:51:58.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.370+0000 7fe8d67fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8e0100db0 0x7fe8e019b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:58.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.370+0000 7fe8d67fc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8e0100db0 0x7fe8e019b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36802/0 (socket says 172.21.15.47:36802) 2024-09-13T22:51:58.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.370+0000 7fe8d67fc700 1 -- 172.21.15.47:0/194291706 learned_addr learned my addr 172.21.15.47:0/194291706 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-13T22:51:58.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.371+0000 7fe8deffd700 1 --2- 172.21.15.47:0/194291706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8e00ffbb0 0x7fe8e0069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:58.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.371+0000 7fe8d67fc700 1 -- 172.21.15.47:0/194291706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8e00ffbb0 msgr2=0x7fe8e0069970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:58.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.371+0000 7fe8d67fc700 1 --2- 172.21.15.47:0/194291706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8e00ffbb0 0x7fe8e0069970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:58.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.371+0000 7fe8d67fc700 1 -- 172.21.15.47:0/194291706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c80095f0 con 0x7fe8e0100db0 2024-09-13T22:51:58.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.371+0000 7fe8d67fc700 1 --2- 172.21.15.47:0/194291706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8e0100db0 0x7fe8e019b180 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe8c800bd70 tx=0x7fe8c800bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:51:58.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.371+0000 7fe8e48f6700 1 -- 172.21.15.47:0/194291706 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8c801d070 con 0x7fe8e0100db0 2024-09-13T22:51:58.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.371+0000 7fe8e48f6700 1 -- 172.21.15.47:0/194291706 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe8c8005dc0 con 0x7fe8e0100db0 2024-09-13T22:51:58.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.371+0000 7fe8e48f6700 1 -- 172.21.15.47:0/194291706 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8c8017400 con 0x7fe8e0100db0 2024-09-13T22:51:58.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.371+0000 7fe8e58f8700 1 -- 172.21.15.47:0/194291706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e019bb10 con 0x7fe8e0100db0 2024-09-13T22:51:58.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.371+0000 7fe8e58f8700 1 -- 172.21.15.47:0/194291706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e019bfb0 con 0x7fe8e0100db0 2024-09-13T22:51:58.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.373+0000 7fe8e58f8700 1 -- 172.21.15.47:0/194291706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e0108710 con 0x7fe8e0100db0 2024-09-13T22:51:58.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.373+0000 7fe8e48f6700 1 -- 172.21.15.47:0/194291706 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fe8c800f7d0 con 0x7fe8e0100db0 2024-09-13T22:51:58.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.374+0000 7fe8e48f6700 1 --2- 172.21.15.47:0/194291706 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe8cc06c4e0 0x7fe8cc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:51:58.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.374+0000 7fe8e48f6700 1 -- 172.21.15.47:0/194291706 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fe8c808c940 con 0x7fe8e0100db0 2024-09-13T22:51:58.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.374+0000 7fe8deffd700 1 --2- 172.21.15.47:0/194291706 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe8cc06c4e0 0x7fe8cc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:51:58.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.374+0000 7fe8deffd700 1 --2- 172.21.15.47:0/194291706 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe8cc06c4e0 0x7fe8cc06e9a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0100c10 tx=0x7fe8d000b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:51:58.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.378+0000 7fe8e48f6700 1 -- 172.21.15.47:0/194291706 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe8c805af90 con 0x7fe8e0100db0 2024-09-13T22:51:58.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.658+0000 7fe8e58f8700 1 -- 172.21.15.47:0/194291706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fe8e0108900 con 0x7fe8e0100db0 2024-09-13T22:51:58.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.663+0000 7fe8e48f6700 1 -- 172.21.15.47:0/194291706 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7fe8c800f460 con 0x7fe8e0100db0 2024-09-13T22:51:58.663 INFO:teuthology.orchestra.run.smithi047.stdout:[client.1] 2024-09-13T22:51:58.663 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQAOwuRmQQVSJxAAOr+8ypVYRTN5XWi1WWovZw== 2024-09-13T22:51:58.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.665+0000 7fe8e58f8700 1 -- 172.21.15.47:0/194291706 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe8cc06c4e0 msgr2=0x7fe8cc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:58.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.665+0000 7fe8e58f8700 1 --2- 172.21.15.47:0/194291706 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe8cc06c4e0 0x7fe8cc06e9a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0100c10 tx=0x7fe8d000b410 comp rx=0 tx=0).stop 2024-09-13T22:51:58.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.665+0000 7fe8e58f8700 1 -- 172.21.15.47:0/194291706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8e0100db0 msgr2=0x7fe8e019b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:51:58.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.665+0000 7fe8e58f8700 1 --2- 172.21.15.47:0/194291706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8e0100db0 0x7fe8e019b180 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe8c800bd70 tx=0x7fe8c800bda0 comp rx=0 tx=0).stop 2024-09-13T22:51:58.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.665+0000 7fe8e58f8700 1 -- 172.21.15.47:0/194291706 shutdown_connections 2024-09-13T22:51:58.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.665+0000 7fe8e58f8700 1 --2- 172.21.15.47:0/194291706 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe8cc06c4e0 0x7fe8cc06e9a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:58.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.665+0000 7fe8e58f8700 1 --2- 172.21.15.47:0/194291706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8e00ffbb0 0x7fe8e0069970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:58.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.665+0000 7fe8e58f8700 1 --2- 172.21.15.47:0/194291706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8e0100db0 0x7fe8e019b180 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:51:58.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.665+0000 7fe8e58f8700 1 -- 172.21.15.47:0/194291706 >> 172.21.15.47:0/194291706 conn(0x7fe8e00fb150 msgr2=0x7fe8e0103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:51:58.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.665+0000 7fe8e58f8700 1 -- 172.21.15.47:0/194291706 shutdown_connections 2024-09-13T22:51:58.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:51:58.665+0000 7fe8e58f8700 1 -- 172.21.15.47:0/194291706 wait complete. 2024-09-13T22:51:59.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:58 smithi002 ceph-mon[27637]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:51:59.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:58 smithi002 ceph-mon[27637]: from='client.? 172.21.15.47:0/194291706' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T22:51:59.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:58 smithi002 ceph-mon[27637]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T22:51:59.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:51:58 smithi002 ceph-mon[27637]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T22:51:59.375 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:58 smithi047 ceph-mon[34560]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:51:59.375 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:58 smithi047 ceph-mon[34560]: from='client.? 172.21.15.47:0/194291706' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T22:51:59.375 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:58 smithi047 ceph-mon[34560]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T22:51:59.375 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:51:58 smithi047 ceph-mon[34560]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T22:51:59.400 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-13T22:51:59.401 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-13T22:51:59.401 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T22:51:59.442 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T22:51:59.443 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-13T22:51:59.443 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-13T22:51:59.662 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:01.181 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:00 smithi002 ceph-mon[27637]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:01.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:00 smithi047 ceph-mon[34560]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.419+0000 7fdc37341700 1 -- 172.21.15.2:0/4238534049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc300ff970 msgr2=0x7fdc300ffd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.419+0000 7fdc37341700 1 --2- 172.21.15.2:0/4238534049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc300ff970 0x7fdc300ffd50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009910 tx=0x7fdc2c009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.419+0000 7fdc37341700 1 -- 172.21.15.2:0/4238534049 shutdown_connections 2024-09-13T22:52:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.419+0000 7fdc37341700 1 --2- 172.21.15.2:0/4238534049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc30100320 0x7fdc3010cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.419+0000 7fdc37341700 1 --2- 172.21.15.2:0/4238534049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc300ff970 0x7fdc300ffd50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.419+0000 7fdc37341700 1 -- 172.21.15.2:0/4238534049 >> 172.21.15.2:0/4238534049 conn(0x7fdc300fb650 msgr2=0x7fdc300fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.419+0000 7fdc37341700 1 -- 172.21.15.2:0/4238534049 shutdown_connections 2024-09-13T22:52:01.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.419+0000 7fdc37341700 1 -- 172.21.15.2:0/4238534049 wait complete. 2024-09-13T22:52:01.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.420+0000 7fdc37341700 1 Processor -- start 2024-09-13T22:52:01.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.420+0000 7fdc37341700 1 -- start start 2024-09-13T22:52:01.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.420+0000 7fdc37341700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc300ff970 0x7fdc3019e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:01.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.420+0000 7fdc37341700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc30100320 0x7fdc3019edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:01.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.420+0000 7fdc37341700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3019f440 con 0x7fdc30100320 2024-09-13T22:52:01.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.420+0000 7fdc37341700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc301988f0 con 0x7fdc300ff970 2024-09-13T22:52:01.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.420+0000 7fdc348dc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc30100320 0x7fdc3019edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:01.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.420+0000 7fdc348dc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc30100320 0x7fdc3019edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34768/0 (socket says 172.21.15.2:34768) 2024-09-13T22:52:01.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.420+0000 7fdc348dc700 1 -- 172.21.15.2:0/3617266933 learned_addr learned my addr 172.21.15.2:0/3617266933 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:01.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.420+0000 7fdc348dc700 1 -- 172.21.15.2:0/3617266933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc300ff970 msgr2=0x7fdc3019e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:01.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.420+0000 7fdc348dc700 1 --2- 172.21.15.2:0/3617266933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc300ff970 0x7fdc3019e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:01.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.420+0000 7fdc348dc700 1 -- 172.21.15.2:0/3617266933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c0095f0 con 0x7fdc30100320 2024-09-13T22:52:01.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.420+0000 7fdc348dc700 1 --2- 172.21.15.2:0/3617266933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc30100320 0x7fdc3019edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400d900 tx=0x7fdc2400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:01.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.421+0000 7fdc227fc700 1 -- 172.21.15.2:0/3617266933 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc240041f0 con 0x7fdc30100320 2024-09-13T22:52:01.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.421+0000 7fdc227fc700 1 -- 172.21.15.2:0/3617266933 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdc24004ce0 con 0x7fdc30100320 2024-09-13T22:52:01.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.421+0000 7fdc37341700 1 -- 172.21.15.2:0/3617266933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc30198bd0 con 0x7fdc30100320 2024-09-13T22:52:01.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.421+0000 7fdc227fc700 1 -- 172.21.15.2:0/3617266933 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc2400b750 con 0x7fdc30100320 2024-09-13T22:52:01.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.421+0000 7fdc37341700 1 -- 172.21.15.2:0/3617266933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc30199120 con 0x7fdc30100320 2024-09-13T22:52:01.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.422+0000 7fdc37341700 1 -- 172.21.15.2:0/3617266933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc3010a750 con 0x7fdc30100320 2024-09-13T22:52:01.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.422+0000 7fdc227fc700 1 -- 172.21.15.2:0/3617266933 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fdc24004350 con 0x7fdc30100320 2024-09-13T22:52:01.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.423+0000 7fdc227fc700 1 --2- 172.21.15.2:0/3617266933 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fdc1c06c4e0 0x7fdc1c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:01.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.423+0000 7fdc227fc700 1 -- 172.21.15.2:0/3617266933 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fdc2408b260 con 0x7fdc30100320 2024-09-13T22:52:01.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.423+0000 7fdc350dd700 1 --2- 172.21.15.2:0/3617266933 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fdc1c06c4e0 0x7fdc1c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:01.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.423+0000 7fdc350dd700 1 --2- 172.21.15.2:0/3617266933 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fdc1c06c4e0 0x7fdc1c06e9a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c00b5c0 tx=0x7fdc2c005960 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:01.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.427+0000 7fdc227fc700 1 -- 172.21.15.2:0/3617266933 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fdc24059930 con 0x7fdc30100320 2024-09-13T22:52:01.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.683+0000 7fdc37341700 1 -- 172.21.15.2:0/3617266933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fdc3004f2e0 con 0x7fdc30100320 2024-09-13T22:52:01.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.687+0000 7fdc227fc700 1 -- 172.21.15.2:0/3617266933 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+173002 (secure 0 0 0) 0x7fdc24016090 con 0x7fdc30100320 2024-09-13T22:52:01.690 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:52:01.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.689+0000 7fdc37341700 1 -- 172.21.15.2:0/3617266933 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fdc1c06c4e0 msgr2=0x7fdc1c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:01.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.689+0000 7fdc37341700 1 --2- 172.21.15.2:0/3617266933 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fdc1c06c4e0 0x7fdc1c06e9a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c00b5c0 tx=0x7fdc2c005960 comp rx=0 tx=0).stop 2024-09-13T22:52:01.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.689+0000 7fdc37341700 1 -- 172.21.15.2:0/3617266933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc30100320 msgr2=0x7fdc3019edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:01.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.689+0000 7fdc37341700 1 --2- 172.21.15.2:0/3617266933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc30100320 0x7fdc3019edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400d900 tx=0x7fdc2400dcc0 comp rx=0 tx=0).stop 2024-09-13T22:52:01.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.690+0000 7fdc37341700 1 -- 172.21.15.2:0/3617266933 shutdown_connections 2024-09-13T22:52:01.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.690+0000 7fdc37341700 1 --2- 172.21.15.2:0/3617266933 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fdc1c06c4e0 0x7fdc1c06e9a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:01.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.690+0000 7fdc37341700 1 --2- 172.21.15.2:0/3617266933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc300ff970 0x7fdc3019e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:01.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.690+0000 7fdc37341700 1 --2- 172.21.15.2:0/3617266933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc30100320 0x7fdc3019edb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:01.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.690+0000 7fdc37341700 1 -- 172.21.15.2:0/3617266933 >> 172.21.15.2:0/3617266933 conn(0x7fdc300fb650 msgr2=0x7fdc300fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:01.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.690+0000 7fdc37341700 1 -- 172.21.15.2:0/3617266933 shutdown_connections 2024-09-13T22:52:01.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:01.690+0000 7fdc37341700 1 -- 172.21.15.2:0/3617266933 wait complete. 2024-09-13T22:52:02.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:01 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/3617266933' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T22:52:02.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:01 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/3617266933' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T22:52:02.474 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"active_gid":14211,"active_name":"smithi002.yumtzz","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2},{"type":"v1","addr":"172.21.15.2:6801","nonce":2}]},"active_addr":"172.21.15.2:6801/2","active_change":"2024-09-13T22:48:17.146106+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14234,"name":"smithi047.gcymvd","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.2:8443/","prometheus":"http://172.21.15.2:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":4160322064}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":3631424419}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":525112908}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":2148833897}]}]} 2024-09-13T22:52:02.481 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-13T22:52:02.481 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-13T22:52:02.481 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T22:52:02.693 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:03.076 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:03 smithi002 ceph-mon[27637]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:03.076 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:03 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:52:03.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:03 smithi047 ceph-mon[34560]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:03.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:03 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:52:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.379+0000 7f39517f0700 1 -- 172.21.15.2:0/3886670199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f394c100ea0 msgr2=0x7f394c101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.380+0000 7f39517f0700 1 --2- 172.21.15.2:0/3886670199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f394c100ea0 0x7f394c101280 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f393c009910 tx=0x7f393c009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.380+0000 7f39517f0700 1 -- 172.21.15.2:0/3886670199 shutdown_connections 2024-09-13T22:52:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.380+0000 7f39517f0700 1 --2- 172.21.15.2:0/3886670199 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f394c101850 0x7f394c1058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.380+0000 7f39517f0700 1 --2- 172.21.15.2:0/3886670199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f394c100ea0 0x7f394c101280 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:04.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.380+0000 7f39517f0700 1 -- 172.21.15.2:0/3886670199 >> 172.21.15.2:0/3886670199 conn(0x7f394c0fc750 msgr2=0x7f394c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.380+0000 7f39517f0700 1 -- 172.21.15.2:0/3886670199 shutdown_connections 2024-09-13T22:52:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.380+0000 7f39517f0700 1 -- 172.21.15.2:0/3886670199 wait complete. 2024-09-13T22:52:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.380+0000 7f39517f0700 1 Processor -- start 2024-09-13T22:52:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.380+0000 7f39517f0700 1 -- start start 2024-09-13T22:52:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.381+0000 7f39517f0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f394c100ea0 0x7f394c19e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.381+0000 7f39517f0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f394c101850 0x7f394c19ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.381+0000 7f39517f0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c19f4b0 con 0x7f394c101850 2024-09-13T22:52:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.381+0000 7f39517f0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c198960 con 0x7f394c100ea0 2024-09-13T22:52:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.381+0000 7f394a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f394c101850 0x7f394c19ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.381+0000 7f394a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f394c101850 0x7f394c19ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34796/0 (socket says 172.21.15.2:34796) 2024-09-13T22:52:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.381+0000 7f394a7fc700 1 -- 172.21.15.2:0/2265883608 learned_addr learned my addr 172.21.15.2:0/2265883608 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:04.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.381+0000 7f394affd700 1 --2- 172.21.15.2:0/2265883608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f394c100ea0 0x7f394c19e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.381+0000 7f394a7fc700 1 -- 172.21.15.2:0/2265883608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f394c100ea0 msgr2=0x7f394c19e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.381+0000 7f394a7fc700 1 --2- 172.21.15.2:0/2265883608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f394c100ea0 0x7f394c19e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.381+0000 7f394a7fc700 1 -- 172.21.15.2:0/2265883608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393c0095f0 con 0x7f394c101850 2024-09-13T22:52:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.381+0000 7f394a7fc700 1 --2- 172.21.15.2:0/2265883608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f394c101850 0x7f394c19ee20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f394000b480 tx=0x7f394000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.381+0000 7f3933fff700 1 -- 172.21.15.2:0/2265883608 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39400118c0 con 0x7f394c101850 2024-09-13T22:52:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.382+0000 7f39517f0700 1 -- 172.21.15.2:0/2265883608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394c198c40 con 0x7f394c101850 2024-09-13T22:52:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.382+0000 7f3933fff700 1 -- 172.21.15.2:0/2265883608 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3940010380 con 0x7f394c101850 2024-09-13T22:52:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.382+0000 7f3933fff700 1 -- 172.21.15.2:0/2265883608 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f394000f4f0 con 0x7f394c101850 2024-09-13T22:52:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.382+0000 7f39517f0700 1 -- 172.21.15.2:0/2265883608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394c199190 con 0x7f394c101850 2024-09-13T22:52:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.383+0000 7f39517f0700 1 -- 172.21.15.2:0/2265883608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394c105020 con 0x7f394c101850 2024-09-13T22:52:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.383+0000 7f3933fff700 1 -- 172.21.15.2:0/2265883608 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f39400104f0 con 0x7f394c101850 2024-09-13T22:52:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.384+0000 7f3933fff700 1 --2- 172.21.15.2:0/2265883608 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f393406c4e0 0x7f393406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.384+0000 7f3933fff700 1 -- 172.21.15.2:0/2265883608 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f394008b090 con 0x7f394c101850 2024-09-13T22:52:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.384+0000 7f394affd700 1 --2- 172.21.15.2:0/2265883608 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f393406c4e0 0x7f393406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.384+0000 7f394affd700 1 --2- 172.21.15.2:0/2265883608 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f393406c4e0 0x7f393406e9a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f393c00b5c0 tx=0x7f393c01a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.388+0000 7f3933fff700 1 -- 172.21.15.2:0/2265883608 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f39400596e0 con 0x7f394c101850 2024-09-13T22:52:04.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.588+0000 7f39517f0700 1 -- 172.21.15.2:0/2265883608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f394c04f2e0 con 0x7f394c101850 2024-09-13T22:52:04.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.589+0000 7f3933fff700 1 -- 172.21.15.2:0/2265883608 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+10975 (secure 0 0 0) 0x7f3940059270 con 0x7f394c101850 2024-09-13T22:52:04.590 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:52:04.590 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":41,"fsid":"e41042f8-7221-11ef-bceb-c7b262605968","created":"2024-09-13T22:46:10.665594+0000","modified":"2024-09-13T22:51:47.968609+0000","last_up_change":"2024-09-13T22:51:46.964066+0000","last_in_change":"2024-09-13T22:51:28.127149+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T22:50:33.659140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c671c42-9846-4f40-ba31-8acc1c184352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3953793391},{"type":"v1","addr":"172.21.15.2:6803","nonce":3953793391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3953793391},{"type":"v1","addr":"172.21.15.2:6805","nonce":3953793391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3953793391},{"type":"v1","addr":"172.21.15.2:6809","nonce":3953793391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3953793391},{"type":"v1","addr":"172.21.15.2:6807","nonce":3953793391}]},"public_addr":"172.21.15.2:6803/3953793391","cluster_addr":"172.21.15.2:6805/3953793391","heartbeat_back_addr":"172.21.15.2:6809/3953793391","heartbeat_front_addr":"172.21.15.2:6807/3953793391","state":["exists","up"]},{"osd":1,"uuid":"2e6b4859-b5cf-4548-8a37-9f836fdab3ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":182375359},{"type":"v1","addr":"172.21.15.2:6811","nonce":182375359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":182375359},{"type":"v1","addr":"172.21.15.2:6813","nonce":182375359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":182375359},{"type":"v1","addr":"172.21.15.2:6817","nonce":182375359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":182375359},{"type":"v1","addr":"172.21.15.2:6815","nonce":182375359}]},"public_addr":"172.21.15.2:6811/182375359","cluster_addr":"172.21.15.2:6813/182375359","heartbeat_back_addr":"172.21.15.2:6817/182375359","heartbeat_front_addr":"172.21.15.2:6815/182375359","state":["exists","up"]},{"osd":2,"uuid":"746451f4-049b-4613-9cce-31bda05dc08c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2103429173},{"type":"v1","addr":"172.21.15.2:6819","nonce":2103429173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2103429173},{"type":"v1","addr":"172.21.15.2:6821","nonce":2103429173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2103429173},{"type":"v1","addr":"172.21.15.2:6825","nonce":2103429173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2103429173},{"type":"v1","addr":"172.21.15.2:6823","nonce":2103429173}]},"public_addr":"172.21.15.2:6819/2103429173","cluster_addr":"172.21.15.2:6821/2103429173","heartbeat_back_addr":"172.21.15.2:6825/2103429173","heartbeat_front_addr":"172.21.15.2:6823/2103429173","state":["exists","up"]},{"osd":3,"uuid":"9732042d-4a75-48e6-b8d5-003e8b472c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4105215181},{"type":"v1","addr":"172.21.15.47:6801","nonce":4105215181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4105215181},{"type":"v1","addr":"172.21.15.47:6803","nonce":4105215181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4105215181},{"type":"v1","addr":"172.21.15.47:6807","nonce":4105215181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4105215181},{"type":"v1","addr":"172.21.15.47:6805","nonce":4105215181}]},"public_addr":"172.21.15.47:6801/4105215181","cluster_addr":"172.21.15.47:6803/4105215181","heartbeat_back_addr":"172.21.15.47:6807/4105215181","heartbeat_front_addr":"172.21.15.47:6805/4105215181","state":["exists","up"]},{"osd":4,"uuid":"bfbaa035-e904-4aef-80dc-52dbf7942ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2444218504},{"type":"v1","addr":"172.21.15.47:6809","nonce":2444218504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2444218504},{"type":"v1","addr":"172.21.15.47:6811","nonce":2444218504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2444218504},{"type":"v1","addr":"172.21.15.47:6815","nonce":2444218504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2444218504},{"type":"v1","addr":"172.21.15.47:6813","nonce":2444218504}]},"public_addr":"172.21.15.47:6809/2444218504","cluster_addr":"172.21.15.47:6811/2444218504","heartbeat_back_addr":"172.21.15.47:6815/2444218504","heartbeat_front_addr":"172.21.15.47:6813/2444218504","state":["exists","up"]},{"osd":5,"uuid":"5d83de4e-4a7b-4cbe-b4d1-6cc958a03031","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1979123292},{"type":"v1","addr":"172.21.15.47:6817","nonce":1979123292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1979123292},{"type":"v1","addr":"172.21.15.47:6819","nonce":1979123292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1979123292},{"type":"v1","addr":"172.21.15.47:6823","nonce":1979123292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1979123292},{"type":"v1","addr":"172.21.15.47:6821","nonce":1979123292}]},"public_addr":"172.21.15.47:6817/1979123292","cluster_addr":"172.21.15.47:6819/1979123292","heartbeat_back_addr":"172.21.15.47:6823/1979123292","heartbeat_front_addr":"172.21.15.47:6821/1979123292","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:49:34.259127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:50:01.898559+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:50:30.265570+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:50:54.473342+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:51:20.051398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:51:45.097262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/1925931750":"2024-09-14T22:48:17.145993+0000","172.21.15.2:0/1799605279":"2024-09-14T22:48:17.145993+0000","172.21.15.2:0/2669476310":"2024-09-14T22:47:11.476346+0000","172.21.15.2:0/3872121752":"2024-09-14T22:48:17.145993+0000","172.21.15.2:0/487476157":"2024-09-14T22:47:11.476346+0000","172.21.15.2:6801/2":"2024-09-14T22:46:38.903914+0000","172.21.15.2:6800/2":"2024-09-14T22:46:38.903914+0000","172.21.15.2:0/2072024940":"2024-09-14T22:46:38.903914+0000","172.21.15.2:0/963250354":"2024-09-14T22:46:38.903914+0000","172.21.15.2:0/921759862":"2024-09-14T22:46:38.903914+0000","172.21.15.2:0/3109882737":"2024-09-14T22:47:11.476346+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T22:52:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.591+0000 7f39517f0700 1 -- 172.21.15.2:0/2265883608 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f393406c4e0 msgr2=0x7f393406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.591+0000 7f39517f0700 1 --2- 172.21.15.2:0/2265883608 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f393406c4e0 0x7f393406e9a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f393c00b5c0 tx=0x7f393c01a040 comp rx=0 tx=0).stop 2024-09-13T22:52:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.591+0000 7f39517f0700 1 -- 172.21.15.2:0/2265883608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f394c101850 msgr2=0x7f394c19ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.591+0000 7f39517f0700 1 --2- 172.21.15.2:0/2265883608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f394c101850 0x7f394c19ee20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f394000b480 tx=0x7f394000b840 comp rx=0 tx=0).stop 2024-09-13T22:52:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.591+0000 7f39517f0700 1 -- 172.21.15.2:0/2265883608 shutdown_connections 2024-09-13T22:52:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.591+0000 7f39517f0700 1 --2- 172.21.15.2:0/2265883608 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f393406c4e0 0x7f393406e9a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.591+0000 7f39517f0700 1 --2- 172.21.15.2:0/2265883608 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f394c100ea0 0x7f394c19e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.591+0000 7f39517f0700 1 --2- 172.21.15.2:0/2265883608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f394c101850 0x7f394c19ee20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.591+0000 7f39517f0700 1 -- 172.21.15.2:0/2265883608 >> 172.21.15.2:0/2265883608 conn(0x7f394c0fc750 msgr2=0x7f394c0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.591+0000 7f39517f0700 1 -- 172.21.15.2:0/2265883608 shutdown_connections 2024-09-13T22:52:04.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:04.591+0000 7f39517f0700 1 -- 172.21.15.2:0/2265883608 wait complete. 2024-09-13T22:52:05.329 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:05 smithi002 ceph-mon[27637]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:05.329 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:05 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2265883608' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:52:05.352 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-13T22:52:05.352 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T22:52:05.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:05 smithi047 ceph-mon[34560]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:05.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:05 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/2265883608' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:52:05.560 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:07.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.212+0000 7f4115eb5700 1 -- 172.21.15.2:0/4011128297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41100ffda0 msgr2=0x7f4110100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:07.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.212+0000 7f4115eb5700 1 --2- 172.21.15.2:0/4011128297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41100ffda0 0x7f4110100180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4100009910 tx=0x7f4100009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:07.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.212+0000 7f4115eb5700 1 -- 172.21.15.2:0/4011128297 shutdown_connections 2024-09-13T22:52:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.212+0000 7f4115eb5700 1 --2- 172.21.15.2:0/4011128297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4110100750 0x7f41101047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.212+0000 7f4115eb5700 1 --2- 172.21.15.2:0/4011128297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41100ffda0 0x7f4110100180 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.212+0000 7f4115eb5700 1 -- 172.21.15.2:0/4011128297 >> 172.21.15.2:0/4011128297 conn(0x7f41100fb650 msgr2=0x7f41100fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.212+0000 7f4115eb5700 1 -- 172.21.15.2:0/4011128297 shutdown_connections 2024-09-13T22:52:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.212+0000 7f4115eb5700 1 -- 172.21.15.2:0/4011128297 wait complete. 2024-09-13T22:52:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.212+0000 7f4115eb5700 1 Processor -- start 2024-09-13T22:52:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.213+0000 7f4115eb5700 1 -- start start 2024-09-13T22:52:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.213+0000 7f4115eb5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41100ffda0 0x7f411019e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.213+0000 7f4115eb5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4110100750 0x7f411019edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.213+0000 7f4115eb5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411019f440 con 0x7f41100ffda0 2024-09-13T22:52:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.213+0000 7f4115eb5700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41101988f0 con 0x7f4110100750 2024-09-13T22:52:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.213+0000 7f410f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41100ffda0 0x7f411019e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.213+0000 7f410f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41100ffda0 0x7f411019e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34814/0 (socket says 172.21.15.2:34814) 2024-09-13T22:52:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.213+0000 7f410f7fe700 1 -- 172.21.15.2:0/376791802 learned_addr learned my addr 172.21.15.2:0/376791802 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.213+0000 7f410effd700 1 --2- 172.21.15.2:0/376791802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4110100750 0x7f411019edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.213+0000 7f410f7fe700 1 -- 172.21.15.2:0/376791802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4110100750 msgr2=0x7f411019edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.213+0000 7f410f7fe700 1 --2- 172.21.15.2:0/376791802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4110100750 0x7f411019edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.213+0000 7f410f7fe700 1 -- 172.21.15.2:0/376791802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41000095f0 con 0x7f41100ffda0 2024-09-13T22:52:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.213+0000 7f410f7fe700 1 --2- 172.21.15.2:0/376791802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41100ffda0 0x7f411019e870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4100000c00 tx=0x7f410000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.214+0000 7f410cff9700 1 -- 172.21.15.2:0/376791802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f410001d070 con 0x7f41100ffda0 2024-09-13T22:52:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.214+0000 7f4115eb5700 1 -- 172.21.15.2:0/376791802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4110198b70 con 0x7f41100ffda0 2024-09-13T22:52:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.214+0000 7f410cff9700 1 -- 172.21.15.2:0/376791802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f410000f460 con 0x7f41100ffda0 2024-09-13T22:52:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.214+0000 7f410cff9700 1 -- 172.21.15.2:0/376791802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4100017630 con 0x7f41100ffda0 2024-09-13T22:52:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.214+0000 7f4115eb5700 1 -- 172.21.15.2:0/376791802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4110199060 con 0x7f41100ffda0 2024-09-13T22:52:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.215+0000 7f4115eb5700 1 -- 172.21.15.2:0/376791802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411004f2e0 con 0x7f41100ffda0 2024-09-13T22:52:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.215+0000 7f410cff9700 1 -- 172.21.15.2:0/376791802 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f410000f5d0 con 0x7f41100ffda0 2024-09-13T22:52:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.216+0000 7f410cff9700 1 --2- 172.21.15.2:0/376791802 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f40fc06c4e0 0x7f40fc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.216+0000 7f410cff9700 1 -- 172.21.15.2:0/376791802 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f410008ca80 con 0x7f41100ffda0 2024-09-13T22:52:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.216+0000 7f410effd700 1 --2- 172.21.15.2:0/376791802 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f40fc06c4e0 0x7f40fc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.216+0000 7f410effd700 1 --2- 172.21.15.2:0/376791802 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f40fc06c4e0 0x7f40fc06e9a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f40f8005fd0 tx=0x7f40f800a560 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:07.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.221+0000 7f410cff9700 1 -- 172.21.15.2:0/376791802 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f410005b0d0 con 0x7f41100ffda0 2024-09-13T22:52:07.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:07 smithi002 ceph-mon[27637]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:07.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:07 smithi047 ceph-mon[34560]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:07.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.424+0000 7f4115eb5700 1 -- 172.21.15.2:0/376791802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4110199e00 con 0x7f41100ffda0 2024-09-13T22:52:07.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.426+0000 7f410cff9700 1 -- 172.21.15.2:0/376791802 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+10975 (secure 0 0 0) 0x7f410005ac60 con 0x7f41100ffda0 2024-09-13T22:52:07.427 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:52:07.427 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":41,"fsid":"e41042f8-7221-11ef-bceb-c7b262605968","created":"2024-09-13T22:46:10.665594+0000","modified":"2024-09-13T22:51:47.968609+0000","last_up_change":"2024-09-13T22:51:46.964066+0000","last_in_change":"2024-09-13T22:51:28.127149+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T22:50:33.659140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c671c42-9846-4f40-ba31-8acc1c184352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3953793391},{"type":"v1","addr":"172.21.15.2:6803","nonce":3953793391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3953793391},{"type":"v1","addr":"172.21.15.2:6805","nonce":3953793391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3953793391},{"type":"v1","addr":"172.21.15.2:6809","nonce":3953793391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3953793391},{"type":"v1","addr":"172.21.15.2:6807","nonce":3953793391}]},"public_addr":"172.21.15.2:6803/3953793391","cluster_addr":"172.21.15.2:6805/3953793391","heartbeat_back_addr":"172.21.15.2:6809/3953793391","heartbeat_front_addr":"172.21.15.2:6807/3953793391","state":["exists","up"]},{"osd":1,"uuid":"2e6b4859-b5cf-4548-8a37-9f836fdab3ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":182375359},{"type":"v1","addr":"172.21.15.2:6811","nonce":182375359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":182375359},{"type":"v1","addr":"172.21.15.2:6813","nonce":182375359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":182375359},{"type":"v1","addr":"172.21.15.2:6817","nonce":182375359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":182375359},{"type":"v1","addr":"172.21.15.2:6815","nonce":182375359}]},"public_addr":"172.21.15.2:6811/182375359","cluster_addr":"172.21.15.2:6813/182375359","heartbeat_back_addr":"172.21.15.2:6817/182375359","heartbeat_front_addr":"172.21.15.2:6815/182375359","state":["exists","up"]},{"osd":2,"uuid":"746451f4-049b-4613-9cce-31bda05dc08c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2103429173},{"type":"v1","addr":"172.21.15.2:6819","nonce":2103429173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2103429173},{"type":"v1","addr":"172.21.15.2:6821","nonce":2103429173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2103429173},{"type":"v1","addr":"172.21.15.2:6825","nonce":2103429173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2103429173},{"type":"v1","addr":"172.21.15.2:6823","nonce":2103429173}]},"public_addr":"172.21.15.2:6819/2103429173","cluster_addr":"172.21.15.2:6821/2103429173","heartbeat_back_addr":"172.21.15.2:6825/2103429173","heartbeat_front_addr":"172.21.15.2:6823/2103429173","state":["exists","up"]},{"osd":3,"uuid":"9732042d-4a75-48e6-b8d5-003e8b472c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4105215181},{"type":"v1","addr":"172.21.15.47:6801","nonce":4105215181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4105215181},{"type":"v1","addr":"172.21.15.47:6803","nonce":4105215181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4105215181},{"type":"v1","addr":"172.21.15.47:6807","nonce":4105215181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4105215181},{"type":"v1","addr":"172.21.15.47:6805","nonce":4105215181}]},"public_addr":"172.21.15.47:6801/4105215181","cluster_addr":"172.21.15.47:6803/4105215181","heartbeat_back_addr":"172.21.15.47:6807/4105215181","heartbeat_front_addr":"172.21.15.47:6805/4105215181","state":["exists","up"]},{"osd":4,"uuid":"bfbaa035-e904-4aef-80dc-52dbf7942ce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":2444218504},{"type":"v1","addr":"172.21.15.47:6809","nonce":2444218504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":2444218504},{"type":"v1","addr":"172.21.15.47:6811","nonce":2444218504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":2444218504},{"type":"v1","addr":"172.21.15.47:6815","nonce":2444218504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":2444218504},{"type":"v1","addr":"172.21.15.47:6813","nonce":2444218504}]},"public_addr":"172.21.15.47:6809/2444218504","cluster_addr":"172.21.15.47:6811/2444218504","heartbeat_back_addr":"172.21.15.47:6815/2444218504","heartbeat_front_addr":"172.21.15.47:6813/2444218504","state":["exists","up"]},{"osd":5,"uuid":"5d83de4e-4a7b-4cbe-b4d1-6cc958a03031","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":1979123292},{"type":"v1","addr":"172.21.15.47:6817","nonce":1979123292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1979123292},{"type":"v1","addr":"172.21.15.47:6819","nonce":1979123292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1979123292},{"type":"v1","addr":"172.21.15.47:6823","nonce":1979123292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1979123292},{"type":"v1","addr":"172.21.15.47:6821","nonce":1979123292}]},"public_addr":"172.21.15.47:6817/1979123292","cluster_addr":"172.21.15.47:6819/1979123292","heartbeat_back_addr":"172.21.15.47:6823/1979123292","heartbeat_front_addr":"172.21.15.47:6821/1979123292","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:49:34.259127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:50:01.898559+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:50:30.265570+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:50:54.473342+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:51:20.051398+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T22:51:45.097262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/1925931750":"2024-09-14T22:48:17.145993+0000","172.21.15.2:0/1799605279":"2024-09-14T22:48:17.145993+0000","172.21.15.2:0/2669476310":"2024-09-14T22:47:11.476346+0000","172.21.15.2:0/3872121752":"2024-09-14T22:48:17.145993+0000","172.21.15.2:0/487476157":"2024-09-14T22:47:11.476346+0000","172.21.15.2:6801/2":"2024-09-14T22:46:38.903914+0000","172.21.15.2:6800/2":"2024-09-14T22:46:38.903914+0000","172.21.15.2:0/2072024940":"2024-09-14T22:46:38.903914+0000","172.21.15.2:0/963250354":"2024-09-14T22:46:38.903914+0000","172.21.15.2:0/921759862":"2024-09-14T22:46:38.903914+0000","172.21.15.2:0/3109882737":"2024-09-14T22:47:11.476346+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T22:52:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.428+0000 7f4115eb5700 1 -- 172.21.15.2:0/376791802 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f40fc06c4e0 msgr2=0x7f40fc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.428+0000 7f4115eb5700 1 --2- 172.21.15.2:0/376791802 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f40fc06c4e0 0x7f40fc06e9a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f40f8005fd0 tx=0x7f40f800a560 comp rx=0 tx=0).stop 2024-09-13T22:52:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.428+0000 7f4115eb5700 1 -- 172.21.15.2:0/376791802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41100ffda0 msgr2=0x7f411019e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.428+0000 7f4115eb5700 1 --2- 172.21.15.2:0/376791802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41100ffda0 0x7f411019e870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4100000c00 tx=0x7f410000be20 comp rx=0 tx=0).stop 2024-09-13T22:52:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.428+0000 7f4115eb5700 1 -- 172.21.15.2:0/376791802 shutdown_connections 2024-09-13T22:52:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.428+0000 7f4115eb5700 1 --2- 172.21.15.2:0/376791802 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f40fc06c4e0 0x7f40fc06e9a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.428+0000 7f4115eb5700 1 --2- 172.21.15.2:0/376791802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41100ffda0 0x7f411019e870 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.428+0000 7f4115eb5700 1 --2- 172.21.15.2:0/376791802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4110100750 0x7f411019edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.428+0000 7f4115eb5700 1 -- 172.21.15.2:0/376791802 >> 172.21.15.2:0/376791802 conn(0x7f41100fb650 msgr2=0x7f41100696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.428+0000 7f4115eb5700 1 -- 172.21.15.2:0/376791802 shutdown_connections 2024-09-13T22:52:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:07.428+0000 7f4115eb5700 1 -- 172.21.15.2:0/376791802 wait complete. 2024-09-13T22:52:08.034 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-13T22:52:08.035 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-13T22:52:08.035 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-13T22:52:08.035 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-13T22:52:08.036 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-13T22:52:08.036 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-13T22:52:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:08.412 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:08.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:08 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/376791802' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:52:08.417 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:08.417 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:08.419 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:08.425 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:08.498 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:08 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/376791802' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T22:52:09.173 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:09 smithi002 ceph-mon[27637]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:09.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:09 smithi047 ceph-mon[34560]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:11.131 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:11 smithi002 ceph-mon[27637]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:11.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:11 smithi047 ceph-mon[34560]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:13.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:13 smithi002 ceph-mon[27637]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:13.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:13 smithi047 ceph-mon[34560]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:15.027 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:15 smithi002 ceph-mon[27637]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.061+0000 7fd248d4d700 1 -- 172.21.15.2:0/1273566189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd244102720 msgr2=0x7fd24410ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.061+0000 7fd248d4d700 1 --2- 172.21.15.2:0/1273566189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd244102720 0x7fd24410ac10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009910 tx=0x7fd22c009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.061+0000 7fd248d4d700 1 -- 172.21.15.2:0/1273566189 shutdown_connections 2024-09-13T22:52:15.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.061+0000 7fd248d4d700 1 --2- 172.21.15.2:0/1273566189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd244102720 0x7fd24410ac10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.061+0000 7fd248d4d700 1 --2- 172.21.15.2:0/1273566189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd244101e00 0x7fd2441021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.061+0000 7fd248d4d700 1 -- 172.21.15.2:0/1273566189 >> 172.21.15.2:0/1273566189 conn(0x7fd2440fb650 msgr2=0x7fd2440fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.061+0000 7fd248d4d700 1 -- 172.21.15.2:0/1273566189 shutdown_connections 2024-09-13T22:52:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.061+0000 7fd248d4d700 1 -- 172.21.15.2:0/1273566189 wait complete. 2024-09-13T22:52:15.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.062+0000 7fd248d4d700 1 Processor -- start 2024-09-13T22:52:15.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.062+0000 7fd248d4d700 1 -- start start 2024-09-13T22:52:15.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.062+0000 7fd248d4d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd244101e00 0x7fd244196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:15.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.062+0000 7fd248d4d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd244102720 0x7fd244196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:15.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.062+0000 7fd248d4d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd244197520 con 0x7fd244102720 2024-09-13T22:52:15.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.062+0000 7fd248d4d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24419b330 con 0x7fd244101e00 2024-09-13T22:52:15.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.062+0000 7fd239d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd244102720 0x7fd244196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:15.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.062+0000 7fd239d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd244102720 0x7fd244196e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58268/0 (socket says 172.21.15.2:58268) 2024-09-13T22:52:15.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.062+0000 7fd239d9b700 1 -- 172.21.15.2:0/519617499 learned_addr learned my addr 172.21.15.2:0/519617499 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:15.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.063+0000 7fd24259c700 1 --2- 172.21.15.2:0/519617499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd244101e00 0x7fd244196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:15.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.063+0000 7fd239d9b700 1 -- 172.21.15.2:0/519617499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd244101e00 msgr2=0x7fd244196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:15.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.063+0000 7fd239d9b700 1 --2- 172.21.15.2:0/519617499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd244101e00 0x7fd244196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:15.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.063+0000 7fd239d9b700 1 -- 172.21.15.2:0/519617499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c0095f0 con 0x7fd244102720 2024-09-13T22:52:15.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.063+0000 7fd24259c700 1 --2- 172.21.15.2:0/519617499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd244101e00 0x7fd244196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:52:15.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.063+0000 7fd239d9b700 1 --2- 172.21.15.2:0/519617499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd244102720 0x7fd244196e90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00bda0 tx=0x7fd22c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:15.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.063+0000 7fd23bfff700 1 -- 172.21.15.2:0/519617499 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd22c01d070 con 0x7fd244102720 2024-09-13T22:52:15.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.063+0000 7fd23bfff700 1 -- 172.21.15.2:0/519617499 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd22c004fa0 con 0x7fd244102720 2024-09-13T22:52:15.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.063+0000 7fd248d4d700 1 -- 172.21.15.2:0/519617499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24419b5b0 con 0x7fd244102720 2024-09-13T22:52:15.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.063+0000 7fd23bfff700 1 -- 172.21.15.2:0/519617499 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd22c00f460 con 0x7fd244102720 2024-09-13T22:52:15.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.063+0000 7fd248d4d700 1 -- 172.21.15.2:0/519617499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24419baa0 con 0x7fd244102720 2024-09-13T22:52:15.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.064+0000 7fd248d4d700 1 -- 172.21.15.2:0/519617499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd24410e160 con 0x7fd244102720 2024-09-13T22:52:15.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.065+0000 7fd23bfff700 1 -- 172.21.15.2:0/519617499 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fd22c022850 con 0x7fd244102720 2024-09-13T22:52:15.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.065+0000 7fd23bfff700 1 --2- 172.21.15.2:0/519617499 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd23006c4e0 0x7fd23006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:15.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.065+0000 7fd23bfff700 1 -- 172.21.15.2:0/519617499 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fd22c08d290 con 0x7fd244102720 2024-09-13T22:52:15.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.065+0000 7fd24259c700 1 --2- 172.21.15.2:0/519617499 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd23006c4e0 0x7fd23006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:15.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.065+0000 7fd23bfff700 1 --2- 172.21.15.2:0/519617499 >> [v2:172.21.15.2:6818/2103429173,v1:172.21.15.2:6819/2103429173] conn(0x7fd230072080 0x7fd2300744a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:15.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.065+0000 7fd23bfff700 1 -- 172.21.15.2:0/519617499 --> [v2:172.21.15.2:6818/2103429173,v1:172.21.15.2:6819/2103429173] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd230074b50 con 0x7fd230072080 2024-09-13T22:52:15.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.065+0000 7fd23bfff700 1 -- 172.21.15.2:0/519617499 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd22c08d650 con 0x7fd244102720 2024-09-13T22:52:15.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.066+0000 7fd242d9d700 1 --2- 172.21.15.2:0/519617499 >> [v2:172.21.15.2:6818/2103429173,v1:172.21.15.2:6819/2103429173] conn(0x7fd230072080 0x7fd2300744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:15.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.066+0000 7fd24259c700 1 --2- 172.21.15.2:0/519617499 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd23006c4e0 0x7fd23006e9a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd234007900 tx=0x7fd234008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:15.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.066+0000 7fd242d9d700 1 --2- 172.21.15.2:0/519617499 >> [v2:172.21.15.2:6818/2103429173,v1:172.21.15.2:6819/2103429173] conn(0x7fd230072080 0x7fd2300744a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:15.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.067+0000 7fd23bfff700 1 -- 172.21.15.2:0/519617499 <== osd.2 v2:172.21.15.2:6818/2103429173 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd230074b50 con 0x7fd230072080 2024-09-13T22:52:15.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.082+0000 7fd248d4d700 1 -- 172.21.15.2:0/519617499 --> [v2:172.21.15.2:6818/2103429173,v1:172.21.15.2:6819/2103429173] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd24404f2e0 con 0x7fd230072080 2024-09-13T22:52:15.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.082+0000 7fd23bfff700 1 -- 172.21.15.2:0/519617499 <== osd.2 v2:172.21.15.2:6818/2103429173 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd24404f2e0 con 0x7fd230072080 2024-09-13T22:52:15.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.083+0000 7fd248d4d700 1 -- 172.21.15.2:0/519617499 >> [v2:172.21.15.2:6818/2103429173,v1:172.21.15.2:6819/2103429173] conn(0x7fd230072080 msgr2=0x7fd2300744a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:15.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.083+0000 7fd248d4d700 1 --2- 172.21.15.2:0/519617499 >> [v2:172.21.15.2:6818/2103429173,v1:172.21.15.2:6819/2103429173] conn(0x7fd230072080 0x7fd2300744a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:15.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.083+0000 7fd248d4d700 1 -- 172.21.15.2:0/519617499 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd23006c4e0 msgr2=0x7fd23006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:15.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.083+0000 7fd248d4d700 1 --2- 172.21.15.2:0/519617499 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd23006c4e0 0x7fd23006e9a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd234007900 tx=0x7fd234008040 comp rx=0 tx=0).stop 2024-09-13T22:52:15.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.083+0000 7fd248d4d700 1 -- 172.21.15.2:0/519617499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd244102720 msgr2=0x7fd244196e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:15.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.083+0000 7fd248d4d700 1 --2- 172.21.15.2:0/519617499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd244102720 0x7fd244196e90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00bda0 tx=0x7fd22c00be80 comp rx=0 tx=0).stop 2024-09-13T22:52:15.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.083+0000 7fd248d4d700 1 -- 172.21.15.2:0/519617499 shutdown_connections 2024-09-13T22:52:15.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.083+0000 7fd248d4d700 1 --2- 172.21.15.2:0/519617499 >> [v2:172.21.15.2:6818/2103429173,v1:172.21.15.2:6819/2103429173] conn(0x7fd230072080 0x7fd2300744a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:15.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.083+0000 7fd248d4d700 1 --2- 172.21.15.2:0/519617499 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd23006c4e0 0x7fd23006e9a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:15.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.083+0000 7fd248d4d700 1 --2- 172.21.15.2:0/519617499 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd244101e00 0x7fd244196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:15.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.083+0000 7fd248d4d700 1 --2- 172.21.15.2:0/519617499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd244102720 0x7fd244196e90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:15.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.083+0000 7fd248d4d700 1 -- 172.21.15.2:0/519617499 >> 172.21.15.2:0/519617499 conn(0x7fd2440fb650 msgr2=0x7fd244105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:15.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.083+0000 7fd248d4d700 1 -- 172.21.15.2:0/519617499 shutdown_connections 2024-09-13T22:52:15.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.083+0000 7fd248d4d700 1 -- 172.21.15.2:0/519617499 wait complete. 2024-09-13T22:52:15.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:15 smithi047 ceph-mon[34560]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.714+0000 7f6d6513b700 1 -- 172.21.15.2:0/416372161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60100ea0 msgr2=0x7f6d60101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.714+0000 7f6d6513b700 1 --2- 172.21.15.2:0/416372161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60100ea0 0x7f6d60101280 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009910 tx=0x7f6d50009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.714+0000 7f6d6513b700 1 -- 172.21.15.2:0/416372161 shutdown_connections 2024-09-13T22:52:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.714+0000 7f6d6513b700 1 --2- 172.21.15.2:0/416372161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d60101850 0x7f6d601058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.714+0000 7f6d6513b700 1 --2- 172.21.15.2:0/416372161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60100ea0 0x7f6d60101280 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.714+0000 7f6d6513b700 1 -- 172.21.15.2:0/416372161 >> 172.21.15.2:0/416372161 conn(0x7f6d600fc750 msgr2=0x7f6d600feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.714+0000 7f6d6513b700 1 -- 172.21.15.2:0/416372161 shutdown_connections 2024-09-13T22:52:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.714+0000 7f6d6513b700 1 -- 172.21.15.2:0/416372161 wait complete. 2024-09-13T22:52:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.715+0000 7f6d6513b700 1 Processor -- start 2024-09-13T22:52:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.715+0000 7f6d6513b700 1 -- start start 2024-09-13T22:52:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.715+0000 7f6d6513b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60100ea0 0x7f6d60073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.715+0000 7f6d6513b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d60101850 0x7f6d600735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.715+0000 7f6d6513b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d60073b10 con 0x7f6d60100ea0 2024-09-13T22:52:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.715+0000 7f6d6513b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d60073c50 con 0x7f6d60101850 2024-09-13T22:52:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.715+0000 7f6d5ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60100ea0 0x7f6d60073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.715+0000 7f6d5ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60100ea0 0x7f6d60073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58290/0 (socket says 172.21.15.2:58290) 2024-09-13T22:52:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.715+0000 7f6d5ed9d700 1 -- 172.21.15.2:0/2811902266 learned_addr learned my addr 172.21.15.2:0/2811902266 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.715+0000 7f6d5e59c700 1 --2- 172.21.15.2:0/2811902266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d60101850 0x7f6d600735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.716+0000 7f6d5ed9d700 1 -- 172.21.15.2:0/2811902266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d60101850 msgr2=0x7f6d600735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.716+0000 7f6d5ed9d700 1 --2- 172.21.15.2:0/2811902266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d60101850 0x7f6d600735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.716+0000 7f6d5ed9d700 1 -- 172.21.15.2:0/2811902266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d500095f0 con 0x7f6d60100ea0 2024-09-13T22:52:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.716+0000 7f6d5e59c700 1 --2- 172.21.15.2:0/2811902266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d60101850 0x7f6d600735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:52:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.716+0000 7f6d5ed9d700 1 --2- 172.21.15.2:0/2811902266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60100ea0 0x7f6d60073090 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6d50006010 tx=0x7f6d5000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.716+0000 7f6d47fff700 1 -- 172.21.15.2:0/2811902266 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d5001d070 con 0x7f6d60100ea0 2024-09-13T22:52:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.716+0000 7f6d6513b700 1 -- 172.21.15.2:0/2811902266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d60073ed0 con 0x7f6d60100ea0 2024-09-13T22:52:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.716+0000 7f6d47fff700 1 -- 172.21.15.2:0/2811902266 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6d5000f460 con 0x7f6d60100ea0 2024-09-13T22:52:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.716+0000 7f6d47fff700 1 -- 172.21.15.2:0/2811902266 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d50021640 con 0x7f6d60100ea0 2024-09-13T22:52:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.716+0000 7f6d6513b700 1 -- 172.21.15.2:0/2811902266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d601a2df0 con 0x7f6d60100ea0 2024-09-13T22:52:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.717+0000 7f6d6513b700 1 -- 172.21.15.2:0/2811902266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6d6010e0b0 con 0x7f6d60100ea0 2024-09-13T22:52:15.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.718+0000 7f6d47fff700 1 -- 172.21.15.2:0/2811902266 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f6d5000fab0 con 0x7f6d60100ea0 2024-09-13T22:52:15.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.718+0000 7f6d47fff700 1 --2- 172.21.15.2:0/2811902266 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f6d4806c4e0 0x7f6d4806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:15.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.718+0000 7f6d47fff700 1 -- 172.21.15.2:0/2811902266 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f6d5008c730 con 0x7f6d60100ea0 2024-09-13T22:52:15.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.718+0000 7f6d5e59c700 1 --2- 172.21.15.2:0/2811902266 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f6d4806c4e0 0x7f6d4806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:15.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.718+0000 7f6d47fff700 1 --2- 172.21.15.2:0/2811902266 >> [v2:172.21.15.47:6816/1979123292,v1:172.21.15.47:6817/1979123292] conn(0x7f6d48072080 0x7f6d480744a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:15.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.718+0000 7f6d47fff700 1 -- 172.21.15.2:0/2811902266 --> [v2:172.21.15.47:6816/1979123292,v1:172.21.15.47:6817/1979123292] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d48074b50 con 0x7f6d48072080 2024-09-13T22:52:15.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.718+0000 7f6d47fff700 1 -- 172.21.15.2:0/2811902266 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d5008ee00 con 0x7f6d60100ea0 2024-09-13T22:52:15.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.719+0000 7f6d5e59c700 1 --2- 172.21.15.2:0/2811902266 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f6d4806c4e0 0x7f6d4806e9a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6d54005fd0 tx=0x7f6d54005e20 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:15.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.719+0000 7f6d5f59e700 1 --2- 172.21.15.2:0/2811902266 >> [v2:172.21.15.47:6816/1979123292,v1:172.21.15.47:6817/1979123292] conn(0x7f6d48072080 0x7f6d480744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:15.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.719+0000 7f6d5f59e700 1 --2- 172.21.15.2:0/2811902266 >> [v2:172.21.15.47:6816/1979123292,v1:172.21.15.47:6817/1979123292] conn(0x7f6d48072080 0x7f6d480744a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:15.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.720+0000 7f6d47fff700 1 -- 172.21.15.2:0/2811902266 <== osd.5 v2:172.21.15.47:6816/1979123292 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6d48074b50 con 0x7f6d48072080 2024-09-13T22:52:15.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.736+0000 7f6d6513b700 1 -- 172.21.15.2:0/2811902266 --> [v2:172.21.15.47:6816/1979123292,v1:172.21.15.47:6817/1979123292] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6d6004f2e0 con 0x7f6d48072080 2024-09-13T22:52:15.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.736+0000 7f6d47fff700 1 -- 172.21.15.2:0/2811902266 <== osd.5 v2:172.21.15.47:6816/1979123292 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6d6004f2e0 con 0x7f6d48072080 2024-09-13T22:52:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.736+0000 7f6d6513b700 1 -- 172.21.15.2:0/2811902266 >> [v2:172.21.15.47:6816/1979123292,v1:172.21.15.47:6817/1979123292] conn(0x7f6d48072080 msgr2=0x7f6d480744a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.736+0000 7f6d6513b700 1 --2- 172.21.15.2:0/2811902266 >> [v2:172.21.15.47:6816/1979123292,v1:172.21.15.47:6817/1979123292] conn(0x7f6d48072080 0x7f6d480744a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.736+0000 7f6d6513b700 1 -- 172.21.15.2:0/2811902266 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f6d4806c4e0 msgr2=0x7f6d4806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.736+0000 7f6d6513b700 1 --2- 172.21.15.2:0/2811902266 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f6d4806c4e0 0x7f6d4806e9a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6d54005fd0 tx=0x7f6d54005e20 comp rx=0 tx=0).stop 2024-09-13T22:52:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.736+0000 7f6d6513b700 1 -- 172.21.15.2:0/2811902266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60100ea0 msgr2=0x7f6d60073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.736+0000 7f6d6513b700 1 --2- 172.21.15.2:0/2811902266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60100ea0 0x7f6d60073090 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6d50006010 tx=0x7f6d5000be20 comp rx=0 tx=0).stop 2024-09-13T22:52:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.736+0000 7f6d6513b700 1 -- 172.21.15.2:0/2811902266 shutdown_connections 2024-09-13T22:52:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.736+0000 7f6d6513b700 1 --2- 172.21.15.2:0/2811902266 >> [v2:172.21.15.47:6816/1979123292,v1:172.21.15.47:6817/1979123292] conn(0x7f6d48072080 0x7f6d480744a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.736+0000 7f6d6513b700 1 --2- 172.21.15.2:0/2811902266 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f6d4806c4e0 0x7f6d4806e9a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.736+0000 7f6d6513b700 1 --2- 172.21.15.2:0/2811902266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d60100ea0 0x7f6d60073090 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.736+0000 7f6d6513b700 1 --2- 172.21.15.2:0/2811902266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d60101850 0x7f6d600735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:15.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.736+0000 7f6d6513b700 1 -- 172.21.15.2:0/2811902266 >> 172.21.15.2:0/2811902266 conn(0x7f6d600fc750 msgr2=0x7f6d600fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:15.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.737+0000 7f6d6513b700 1 -- 172.21.15.2:0/2811902266 shutdown_connections 2024-09-13T22:52:15.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:15.737+0000 7f6d6513b700 1 -- 172.21.15.2:0/2811902266 wait complete. 2024-09-13T22:52:16.219 INFO:teuthology.orchestra.run.smithi002.stdout:81604378648 2024-09-13T22:52:16.219 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-13T22:52:17.058 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:17 smithi002 ceph-mon[27637]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:17.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:17 smithi047 ceph-mon[34560]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:17.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.616+0000 7f2348105700 1 -- 172.21.15.2:0/2905177657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2340100ea0 msgr2=0x7f2340101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:17.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.616+0000 7f2348105700 1 --2- 172.21.15.2:0/2905177657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2340100ea0 0x7f2340101280 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f233c009910 tx=0x7f233c009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:17.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.616+0000 7f2348105700 1 -- 172.21.15.2:0/2905177657 shutdown_connections 2024-09-13T22:52:17.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.616+0000 7f2348105700 1 --2- 172.21.15.2:0/2905177657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2340101850 0x7f23401058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:17.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.616+0000 7f2348105700 1 --2- 172.21.15.2:0/2905177657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2340100ea0 0x7f2340101280 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:17.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.616+0000 7f2348105700 1 -- 172.21.15.2:0/2905177657 >> 172.21.15.2:0/2905177657 conn(0x7f23400fc750 msgr2=0x7f23400feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:17.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.616+0000 7f2348105700 1 -- 172.21.15.2:0/2905177657 shutdown_connections 2024-09-13T22:52:17.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.617+0000 7f2348105700 1 -- 172.21.15.2:0/2905177657 wait complete. 2024-09-13T22:52:17.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.617+0000 7f2348105700 1 Processor -- start 2024-09-13T22:52:17.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.617+0000 7f2348105700 1 -- start start 2024-09-13T22:52:17.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.618+0000 7f2348105700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2340100ea0 0x7f2340196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:17.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.618+0000 7f2348105700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2340101850 0x7f2340196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:17.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.618+0000 7f2348105700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2340197560 con 0x7f2340100ea0 2024-09-13T22:52:17.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.618+0000 7f2348105700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234019b370 con 0x7f2340101850 2024-09-13T22:52:17.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.618+0000 7f2345ea1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2340100ea0 0x7f2340196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:17.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.618+0000 7f2345ea1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2340100ea0 0x7f2340196990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58310/0 (socket says 172.21.15.2:58310) 2024-09-13T22:52:17.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.618+0000 7f2345ea1700 1 -- 172.21.15.2:0/1039452670 learned_addr learned my addr 172.21.15.2:0/1039452670 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:17.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.618+0000 7f23456a0700 1 --2- 172.21.15.2:0/1039452670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2340101850 0x7f2340196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.618+0000 7f2345ea1700 1 -- 172.21.15.2:0/1039452670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2340101850 msgr2=0x7f2340196ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.618+0000 7f2345ea1700 1 --2- 172.21.15.2:0/1039452670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2340101850 0x7f2340196ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.618+0000 7f2345ea1700 1 -- 172.21.15.2:0/1039452670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0095f0 con 0x7f2340100ea0 2024-09-13T22:52:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.618+0000 7f23456a0700 1 --2- 172.21.15.2:0/1039452670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2340101850 0x7f2340196ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:52:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.618+0000 7f2345ea1700 1 --2- 172.21.15.2:0/1039452670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2340100ea0 0x7f2340196990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f233c006010 tx=0x7f233c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.618+0000 7f2336ffd700 1 -- 172.21.15.2:0/1039452670 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f233c01d070 con 0x7f2340100ea0 2024-09-13T22:52:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.618+0000 7f2336ffd700 1 -- 172.21.15.2:0/1039452670 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f233c00f460 con 0x7f2340100ea0 2024-09-13T22:52:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.618+0000 7f2336ffd700 1 -- 172.21.15.2:0/1039452670 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f233c021640 con 0x7f2340100ea0 2024-09-13T22:52:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.618+0000 7f2348105700 1 -- 172.21.15.2:0/1039452670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234019b5f0 con 0x7f2340100ea0 2024-09-13T22:52:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.618+0000 7f2348105700 1 -- 172.21.15.2:0/1039452670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234019bae0 con 0x7f2340100ea0 2024-09-13T22:52:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.619+0000 7f2348105700 1 -- 172.21.15.2:0/1039452670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f234010e160 con 0x7f2340100ea0 2024-09-13T22:52:17.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.620+0000 7f2336ffd700 1 -- 172.21.15.2:0/1039452670 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f233c00faf0 con 0x7f2340100ea0 2024-09-13T22:52:17.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.620+0000 7f2336ffd700 1 --2- 172.21.15.2:0/1039452670 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f232c06c4e0 0x7f232c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:17.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.621+0000 7f2336ffd700 1 -- 172.21.15.2:0/1039452670 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f233c08c6e0 con 0x7f2340100ea0 2024-09-13T22:52:17.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.621+0000 7f23456a0700 1 --2- 172.21.15.2:0/1039452670 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f232c06c4e0 0x7f232c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:17.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.621+0000 7f2336ffd700 1 --2- 172.21.15.2:0/1039452670 >> [v2:172.21.15.2:6802/3953793391,v1:172.21.15.2:6803/3953793391] conn(0x7f232c072080 0x7f232c0744a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:17.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.621+0000 7f2336ffd700 1 -- 172.21.15.2:0/1039452670 --> [v2:172.21.15.2:6802/3953793391,v1:172.21.15.2:6803/3953793391] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f232c074b50 con 0x7f232c072080 2024-09-13T22:52:17.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.621+0000 7f2336ffd700 1 -- 172.21.15.2:0/1039452670 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f233c08edb0 con 0x7f2340100ea0 2024-09-13T22:52:17.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.621+0000 7f23466a2700 1 --2- 172.21.15.2:0/1039452670 >> [v2:172.21.15.2:6802/3953793391,v1:172.21.15.2:6803/3953793391] conn(0x7f232c072080 0x7f232c0744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:17.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.621+0000 7f23456a0700 1 --2- 172.21.15.2:0/1039452670 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f232c06c4e0 0x7f232c06e9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2340197fb0 tx=0x7f2330008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:17.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.621+0000 7f23466a2700 1 --2- 172.21.15.2:0/1039452670 >> [v2:172.21.15.2:6802/3953793391,v1:172.21.15.2:6803/3953793391] conn(0x7f232c072080 0x7f232c0744a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:17.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.622+0000 7f2336ffd700 1 -- 172.21.15.2:0/1039452670 <== osd.0 v2:172.21.15.2:6802/3953793391 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f232c074b50 con 0x7f232c072080 2024-09-13T22:52:17.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.638+0000 7f2348105700 1 -- 172.21.15.2:0/1039452670 --> [v2:172.21.15.2:6802/3953793391,v1:172.21.15.2:6803/3953793391] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f234004f2e0 con 0x7f232c072080 2024-09-13T22:52:17.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.638+0000 7f2336ffd700 1 -- 172.21.15.2:0/1039452670 <== osd.0 v2:172.21.15.2:6802/3953793391 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f234004f2e0 con 0x7f232c072080 2024-09-13T22:52:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.638+0000 7f2348105700 1 -- 172.21.15.2:0/1039452670 >> [v2:172.21.15.2:6802/3953793391,v1:172.21.15.2:6803/3953793391] conn(0x7f232c072080 msgr2=0x7f232c0744a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.638+0000 7f2348105700 1 --2- 172.21.15.2:0/1039452670 >> [v2:172.21.15.2:6802/3953793391,v1:172.21.15.2:6803/3953793391] conn(0x7f232c072080 0x7f232c0744a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.638+0000 7f2348105700 1 -- 172.21.15.2:0/1039452670 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f232c06c4e0 msgr2=0x7f232c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.638+0000 7f2348105700 1 --2- 172.21.15.2:0/1039452670 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f232c06c4e0 0x7f232c06e9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2340197fb0 tx=0x7f2330008040 comp rx=0 tx=0).stop 2024-09-13T22:52:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.638+0000 7f2348105700 1 -- 172.21.15.2:0/1039452670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2340100ea0 msgr2=0x7f2340196990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.638+0000 7f2348105700 1 --2- 172.21.15.2:0/1039452670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2340100ea0 0x7f2340196990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f233c006010 tx=0x7f233c00be20 comp rx=0 tx=0).stop 2024-09-13T22:52:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.638+0000 7f2348105700 1 -- 172.21.15.2:0/1039452670 shutdown_connections 2024-09-13T22:52:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.638+0000 7f2348105700 1 --2- 172.21.15.2:0/1039452670 >> [v2:172.21.15.2:6802/3953793391,v1:172.21.15.2:6803/3953793391] conn(0x7f232c072080 0x7f232c0744a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.638+0000 7f2348105700 1 --2- 172.21.15.2:0/1039452670 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f232c06c4e0 0x7f232c06e9a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.638+0000 7f2348105700 1 --2- 172.21.15.2:0/1039452670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2340100ea0 0x7f2340196990 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.638+0000 7f2348105700 1 --2- 172.21.15.2:0/1039452670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2340101850 0x7f2340196ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:17.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.638+0000 7f2348105700 1 -- 172.21.15.2:0/1039452670 >> 172.21.15.2:0/1039452670 conn(0x7f23400fc750 msgr2=0x7f23400fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:17.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.638+0000 7f2348105700 1 -- 172.21.15.2:0/1039452670 shutdown_connections 2024-09-13T22:52:17.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:17.638+0000 7f2348105700 1 -- 172.21.15.2:0/1039452670 wait complete. 2024-09-13T22:52:18.174 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:18 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:52:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.278+0000 7f41e4eee700 1 -- 172.21.15.2:0/2447670476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0100ea0 msgr2=0x7f41e0101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.278+0000 7f41e4eee700 1 --2- 172.21.15.2:0/2447670476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0100ea0 0x7f41e0101280 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f41d0009910 tx=0x7f41d0009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.279+0000 7f41e4eee700 1 -- 172.21.15.2:0/2447670476 shutdown_connections 2024-09-13T22:52:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.279+0000 7f41e4eee700 1 --2- 172.21.15.2:0/2447670476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41e0101850 0x7f41e01058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.279+0000 7f41e4eee700 1 --2- 172.21.15.2:0/2447670476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0100ea0 0x7f41e0101280 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.279+0000 7f41e4eee700 1 -- 172.21.15.2:0/2447670476 >> 172.21.15.2:0/2447670476 conn(0x7f41e00fc750 msgr2=0x7f41e00feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.279+0000 7f41e4eee700 1 -- 172.21.15.2:0/2447670476 shutdown_connections 2024-09-13T22:52:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.279+0000 7f41e4eee700 1 -- 172.21.15.2:0/2447670476 wait complete. 2024-09-13T22:52:18.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.279+0000 7f41e4eee700 1 Processor -- start 2024-09-13T22:52:18.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.279+0000 7f41e4eee700 1 -- start start 2024-09-13T22:52:18.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.280+0000 7f41e4eee700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0100ea0 0x7f41e019c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:18.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.280+0000 7f41e4eee700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41e0101850 0x7f41e019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:18.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.280+0000 7f41e4eee700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e019d230 con 0x7f41e0100ea0 2024-09-13T22:52:18.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.280+0000 7f41e4eee700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0196770 con 0x7f41e0101850 2024-09-13T22:52:18.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.280+0000 7f41de59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0100ea0 0x7f41e019c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:18.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.280+0000 7f41de59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0100ea0 0x7f41e019c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58328/0 (socket says 172.21.15.2:58328) 2024-09-13T22:52:18.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.280+0000 7f41de59c700 1 -- 172.21.15.2:0/143400011 learned_addr learned my addr 172.21.15.2:0/143400011 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:18.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.280+0000 7f41de59c700 1 -- 172.21.15.2:0/143400011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41e0101850 msgr2=0x7f41e019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:18.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.280+0000 7f41ddd9b700 1 --2- 172.21.15.2:0/143400011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41e0101850 0x7f41e019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:18.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.280+0000 7f41de59c700 1 --2- 172.21.15.2:0/143400011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41e0101850 0x7f41e019cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:18.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.280+0000 7f41de59c700 1 -- 172.21.15.2:0/143400011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d00095f0 con 0x7f41e0100ea0 2024-09-13T22:52:18.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.280+0000 7f41de59c700 1 --2- 172.21.15.2:0/143400011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0100ea0 0x7f41e019c6f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f41d0006010 tx=0x7f41d000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:18.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.280+0000 7f41cf7fe700 1 -- 172.21.15.2:0/143400011 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41d001d070 con 0x7f41e0100ea0 2024-09-13T22:52:18.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.280+0000 7f41e4eee700 1 -- 172.21.15.2:0/143400011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e01969f0 con 0x7f41e0100ea0 2024-09-13T22:52:18.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.280+0000 7f41cf7fe700 1 -- 172.21.15.2:0/143400011 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f41d000f460 con 0x7f41e0100ea0 2024-09-13T22:52:18.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.280+0000 7f41cf7fe700 1 -- 172.21.15.2:0/143400011 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41d0021640 con 0x7f41e0100ea0 2024-09-13T22:52:18.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.281+0000 7f41e4eee700 1 -- 172.21.15.2:0/143400011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e0196ee0 con 0x7f41e0100ea0 2024-09-13T22:52:18.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.281+0000 7f41e4eee700 1 -- 172.21.15.2:0/143400011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f41e010e0b0 con 0x7f41e0100ea0 2024-09-13T22:52:18.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.282+0000 7f41cf7fe700 1 -- 172.21.15.2:0/143400011 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f41d000faf0 con 0x7f41e0100ea0 2024-09-13T22:52:18.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.282+0000 7f41cf7fe700 1 --2- 172.21.15.2:0/143400011 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f41c806c4e0 0x7f41c806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:18.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.283+0000 7f41ddd9b700 1 --2- 172.21.15.2:0/143400011 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f41c806c4e0 0x7f41c806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:18.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.283+0000 7f41cf7fe700 1 -- 172.21.15.2:0/143400011 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f41d008c790 con 0x7f41e0100ea0 2024-09-13T22:52:18.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.283+0000 7f41cf7fe700 1 --2- 172.21.15.2:0/143400011 >> [v2:172.21.15.2:6810/182375359,v1:172.21.15.2:6811/182375359] conn(0x7f41c8072080 0x7f41c80744a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:18.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.283+0000 7f41cf7fe700 1 -- 172.21.15.2:0/143400011 --> [v2:172.21.15.2:6810/182375359,v1:172.21.15.2:6811/182375359] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41c8074b50 con 0x7f41c8072080 2024-09-13T22:52:18.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.283+0000 7f41cf7fe700 1 -- 172.21.15.2:0/143400011 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41d008ed60 con 0x7f41e0100ea0 2024-09-13T22:52:18.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.283+0000 7f41ded9d700 1 --2- 172.21.15.2:0/143400011 >> [v2:172.21.15.2:6810/182375359,v1:172.21.15.2:6811/182375359] conn(0x7f41c8072080 0x7f41c80744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:18.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.283+0000 7f41ddd9b700 1 --2- 172.21.15.2:0/143400011 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f41c806c4e0 0x7f41c806e9a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f41e0197be0 tx=0x7f41d4005d50 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:18.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.283+0000 7f41ded9d700 1 --2- 172.21.15.2:0/143400011 >> [v2:172.21.15.2:6810/182375359,v1:172.21.15.2:6811/182375359] conn(0x7f41c8072080 0x7f41c80744a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:18.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.284+0000 7f41cf7fe700 1 -- 172.21.15.2:0/143400011 <== osd.1 v2:172.21.15.2:6810/182375359 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f41c8074b50 con 0x7f41c8072080 2024-09-13T22:52:18.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.300+0000 7f41e4eee700 1 -- 172.21.15.2:0/143400011 --> [v2:172.21.15.2:6810/182375359,v1:172.21.15.2:6811/182375359] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f41e004f2e0 con 0x7f41c8072080 2024-09-13T22:52:18.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.300+0000 7f41cf7fe700 1 -- 172.21.15.2:0/143400011 <== osd.1 v2:172.21.15.2:6810/182375359 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f41e004f2e0 con 0x7f41c8072080 2024-09-13T22:52:18.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.301+0000 7f41e4eee700 1 -- 172.21.15.2:0/143400011 >> [v2:172.21.15.2:6810/182375359,v1:172.21.15.2:6811/182375359] conn(0x7f41c8072080 msgr2=0x7f41c80744a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:18.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.301+0000 7f41e4eee700 1 --2- 172.21.15.2:0/143400011 >> [v2:172.21.15.2:6810/182375359,v1:172.21.15.2:6811/182375359] conn(0x7f41c8072080 0x7f41c80744a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:18.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.301+0000 7f41e4eee700 1 -- 172.21.15.2:0/143400011 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f41c806c4e0 msgr2=0x7f41c806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:18.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.301+0000 7f41e4eee700 1 --2- 172.21.15.2:0/143400011 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f41c806c4e0 0x7f41c806e9a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f41e0197be0 tx=0x7f41d4005d50 comp rx=0 tx=0).stop 2024-09-13T22:52:18.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.301+0000 7f41e4eee700 1 -- 172.21.15.2:0/143400011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0100ea0 msgr2=0x7f41e019c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:18.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.301+0000 7f41e4eee700 1 --2- 172.21.15.2:0/143400011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0100ea0 0x7f41e019c6f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f41d0006010 tx=0x7f41d000be20 comp rx=0 tx=0).stop 2024-09-13T22:52:18.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.301+0000 7f41e4eee700 1 -- 172.21.15.2:0/143400011 shutdown_connections 2024-09-13T22:52:18.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.301+0000 7f41e4eee700 1 --2- 172.21.15.2:0/143400011 >> [v2:172.21.15.2:6810/182375359,v1:172.21.15.2:6811/182375359] conn(0x7f41c8072080 0x7f41c80744a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:18.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.301+0000 7f41e4eee700 1 --2- 172.21.15.2:0/143400011 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f41c806c4e0 0x7f41c806e9a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:18.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.301+0000 7f41e4eee700 1 --2- 172.21.15.2:0/143400011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0100ea0 0x7f41e019c6f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:18.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.301+0000 7f41e4eee700 1 --2- 172.21.15.2:0/143400011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41e0101850 0x7f41e019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:18.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.301+0000 7f41e4eee700 1 -- 172.21.15.2:0/143400011 >> 172.21.15.2:0/143400011 conn(0x7f41e00fc750 msgr2=0x7f41e00fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:18.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.301+0000 7f41e4eee700 1 -- 172.21.15.2:0/143400011 shutdown_connections 2024-09-13T22:52:18.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.301+0000 7f41e4eee700 1 -- 172.21.15.2:0/143400011 wait complete. 2024-09-13T22:52:18.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:18 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:52:18.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.520+0000 7fefd717f700 1 -- 172.21.15.2:0/3673246872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefd0105bf0 msgr2=0x7fefd0105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:18.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.520+0000 7fefd717f700 1 --2- 172.21.15.2:0/3673246872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefd0105bf0 0x7fefd0105fd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009910 tx=0x7fefc0009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:18.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.520+0000 7fefd717f700 1 -- 172.21.15.2:0/3673246872 shutdown_connections 2024-09-13T22:52:18.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.520+0000 7fefd717f700 1 --2- 172.21.15.2:0/3673246872 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefd00ffb40 0x7fefd00fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:18.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.520+0000 7fefd717f700 1 --2- 172.21.15.2:0/3673246872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefd0105bf0 0x7fefd0105fd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:18.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.520+0000 7fefd717f700 1 -- 172.21.15.2:0/3673246872 >> 172.21.15.2:0/3673246872 conn(0x7fefd00fb650 msgr2=0x7fefd00fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:18.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.520+0000 7fefd717f700 1 -- 172.21.15.2:0/3673246872 shutdown_connections 2024-09-13T22:52:18.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.520+0000 7fefd717f700 1 -- 172.21.15.2:0/3673246872 wait complete. 2024-09-13T22:52:18.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.521+0000 7fefd717f700 1 Processor -- start 2024-09-13T22:52:18.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.521+0000 7fefd717f700 1 -- start start 2024-09-13T22:52:18.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.521+0000 7fefd717f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefd00ffb40 0x7fefd01956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:18.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.521+0000 7fefd717f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefd0105bf0 0x7fefd0195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:18.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.521+0000 7fefd717f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd0196220 con 0x7fefd0105bf0 2024-09-13T22:52:18.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.521+0000 7fefd717f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd0196390 con 0x7fefd00ffb40 2024-09-13T22:52:18.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.521+0000 7fefcffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefd0105bf0 0x7fefd0195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:18.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.521+0000 7fefcffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefd0105bf0 0x7fefd0195c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58342/0 (socket says 172.21.15.2:58342) 2024-09-13T22:52:18.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.521+0000 7fefcffff700 1 -- 172.21.15.2:0/2426168668 learned_addr learned my addr 172.21.15.2:0/2426168668 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:18.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.521+0000 7fefd4f1b700 1 --2- 172.21.15.2:0/2426168668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefd00ffb40 0x7fefd01956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:18.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.521+0000 7fefcffff700 1 -- 172.21.15.2:0/2426168668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefd00ffb40 msgr2=0x7fefd01956e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:18.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.521+0000 7fefcffff700 1 --2- 172.21.15.2:0/2426168668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefd00ffb40 0x7fefd01956e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:18.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.521+0000 7fefcffff700 1 -- 172.21.15.2:0/2426168668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc00095f0 con 0x7fefd0105bf0 2024-09-13T22:52:18.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.521+0000 7fefd4f1b700 1 --2- 172.21.15.2:0/2426168668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefd00ffb40 0x7fefd01956e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:52:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.522+0000 7fefcffff700 1 --2- 172.21.15.2:0/2426168668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefd0105bf0 0x7fefd0195c20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fefb8007b50 tx=0x7fefb8007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.522+0000 7fefcdffb700 1 -- 172.21.15.2:0/2426168668 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefb8011070 con 0x7fefd0105bf0 2024-09-13T22:52:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.522+0000 7fefcdffb700 1 -- 172.21.15.2:0/2426168668 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fefb800c2e0 con 0x7fefd0105bf0 2024-09-13T22:52:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.522+0000 7fefcdffb700 1 -- 172.21.15.2:0/2426168668 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefb800acf0 con 0x7fefd0105bf0 2024-09-13T22:52:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.522+0000 7fefd717f700 1 -- 172.21.15.2:0/2426168668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd0199130 con 0x7fefd0105bf0 2024-09-13T22:52:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.522+0000 7fefd717f700 1 -- 172.21.15.2:0/2426168668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd0199680 con 0x7fefd0105bf0 2024-09-13T22:52:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.523+0000 7fefd717f700 1 -- 172.21.15.2:0/2426168668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fefd010cff0 con 0x7fefd0105bf0 2024-09-13T22:52:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.523+0000 7fefcdffb700 1 -- 172.21.15.2:0/2426168668 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fefb800e710 con 0x7fefd0105bf0 2024-09-13T22:52:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.524+0000 7fefcdffb700 1 --2- 172.21.15.2:0/2426168668 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fefbc06c530 0x7fefbc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.524+0000 7fefcdffb700 1 -- 172.21.15.2:0/2426168668 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fefb808c5b0 con 0x7fefd0105bf0 2024-09-13T22:52:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.524+0000 7fefd4f1b700 1 --2- 172.21.15.2:0/2426168668 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fefbc06c530 0x7fefbc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.524+0000 7fefcdffb700 1 --2- 172.21.15.2:0/2426168668 >> [v2:172.21.15.47:6808/2444218504,v1:172.21.15.47:6809/2444218504] conn(0x7fefbc0720d0 0x7fefbc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.524+0000 7fefcdffb700 1 -- 172.21.15.2:0/2426168668 --> [v2:172.21.15.47:6808/2444218504,v1:172.21.15.47:6809/2444218504] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fefbc074ba0 con 0x7fefbc0720d0 2024-09-13T22:52:18.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.524+0000 7fefcdffb700 1 -- 172.21.15.2:0/2426168668 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefb808eca0 con 0x7fefd0105bf0 2024-09-13T22:52:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.524+0000 7fefd571c700 1 --2- 172.21.15.2:0/2426168668 >> [v2:172.21.15.47:6808/2444218504,v1:172.21.15.47:6809/2444218504] conn(0x7fefbc0720d0 0x7fefbc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.524+0000 7fefd4f1b700 1 --2- 172.21.15.2:0/2426168668 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fefbc06c530 0x7fefbc06e9f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fefc000b5c0 tx=0x7fefc001a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.525+0000 7fefd571c700 1 --2- 172.21.15.2:0/2426168668 >> [v2:172.21.15.47:6808/2444218504,v1:172.21.15.47:6809/2444218504] conn(0x7fefbc0720d0 0x7fefbc0744f0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:18.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.526+0000 7fefcdffb700 1 -- 172.21.15.2:0/2426168668 <== osd.4 v2:172.21.15.47:6808/2444218504 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fefbc074ba0 con 0x7fefbc0720d0 2024-09-13T22:52:18.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.541+0000 7fefd717f700 1 -- 172.21.15.2:0/2426168668 --> [v2:172.21.15.47:6808/2444218504,v1:172.21.15.47:6809/2444218504] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fefd004f2e0 con 0x7fefbc0720d0 2024-09-13T22:52:18.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.542+0000 7fefcdffb700 1 -- 172.21.15.2:0/2426168668 <== osd.4 v2:172.21.15.47:6808/2444218504 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fefd004f2e0 con 0x7fefbc0720d0 2024-09-13T22:52:18.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.542+0000 7fefd717f700 1 -- 172.21.15.2:0/2426168668 >> [v2:172.21.15.47:6808/2444218504,v1:172.21.15.47:6809/2444218504] conn(0x7fefbc0720d0 msgr2=0x7fefbc0744f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:18.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.542+0000 7fefd717f700 1 --2- 172.21.15.2:0/2426168668 >> [v2:172.21.15.47:6808/2444218504,v1:172.21.15.47:6809/2444218504] conn(0x7fefbc0720d0 0x7fefbc0744f0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:18.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.542+0000 7fefd717f700 1 -- 172.21.15.2:0/2426168668 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fefbc06c530 msgr2=0x7fefbc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.542+0000 7fefd717f700 1 --2- 172.21.15.2:0/2426168668 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fefbc06c530 0x7fefbc06e9f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fefc000b5c0 tx=0x7fefc001a040 comp rx=0 tx=0).stop 2024-09-13T22:52:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.542+0000 7fefd717f700 1 -- 172.21.15.2:0/2426168668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefd0105bf0 msgr2=0x7fefd0195c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.542+0000 7fefd717f700 1 --2- 172.21.15.2:0/2426168668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefd0105bf0 0x7fefd0195c20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fefb8007b50 tx=0x7fefb8007f10 comp rx=0 tx=0).stop 2024-09-13T22:52:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.542+0000 7fefd717f700 1 -- 172.21.15.2:0/2426168668 shutdown_connections 2024-09-13T22:52:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.542+0000 7fefd717f700 1 --2- 172.21.15.2:0/2426168668 >> [v2:172.21.15.47:6808/2444218504,v1:172.21.15.47:6809/2444218504] conn(0x7fefbc0720d0 0x7fefbc0744f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.542+0000 7fefd717f700 1 --2- 172.21.15.2:0/2426168668 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fefbc06c530 0x7fefbc06e9f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.542+0000 7fefd717f700 1 --2- 172.21.15.2:0/2426168668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefd00ffb40 0x7fefd01956e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.542+0000 7fefd717f700 1 --2- 172.21.15.2:0/2426168668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefd0105bf0 0x7fefd0195c20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.542+0000 7fefd717f700 1 -- 172.21.15.2:0/2426168668 >> 172.21.15.2:0/2426168668 conn(0x7fefd00fb650 msgr2=0x7fefd00fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:18.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.543+0000 7fefd717f700 1 -- 172.21.15.2:0/2426168668 shutdown_connections 2024-09-13T22:52:18.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:18.543+0000 7fefd717f700 1 -- 172.21.15.2:0/2426168668 wait complete. 2024-09-13T22:52:19.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:19 smithi002 ceph-mon[27637]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:19.279 INFO:teuthology.orchestra.run.smithi002.stdout:60129542173 2024-09-13T22:52:19.279 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-13T22:52:19.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:19 smithi047 ceph-mon[34560]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:19.712 INFO:teuthology.orchestra.run.smithi002.stdout:171798691849 2024-09-13T22:52:19.713 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-13T22:52:20.147 INFO:teuthology.orchestra.run.smithi002.stdout:38654705700 2024-09-13T22:52:20.148 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-13T22:52:20.884 INFO:teuthology.orchestra.run.smithi002.stdout:150323855374 2024-09-13T22:52:20.885 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-13T22:52:20.897 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:21.139 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:21 smithi002 ceph-mon[27637]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:21.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:21 smithi047 ceph-mon[34560]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:21.479 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:22.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.171+0000 7fba450a7700 1 -- 172.21.15.2:0/4005198112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba400fff50 msgr2=0x7fba40105840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:22.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.171+0000 7fba450a7700 1 --2- 172.21.15.2:0/4005198112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba400fff50 0x7fba40105840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fba28009910 tx=0x7fba28009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:22.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.171+0000 7fba450a7700 1 -- 172.21.15.2:0/4005198112 shutdown_connections 2024-09-13T22:52:22.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.171+0000 7fba450a7700 1 --2- 172.21.15.2:0/4005198112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba400fff50 0x7fba40105840 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:22.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.171+0000 7fba450a7700 1 --2- 172.21.15.2:0/4005198112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba400ff5a0 0x7fba400ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:22.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.171+0000 7fba450a7700 1 -- 172.21.15.2:0/4005198112 >> 172.21.15.2:0/4005198112 conn(0x7fba40074e30 msgr2=0x7fba40075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:22.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.171+0000 7fba450a7700 1 -- 172.21.15.2:0/4005198112 shutdown_connections 2024-09-13T22:52:22.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.171+0000 7fba450a7700 1 -- 172.21.15.2:0/4005198112 wait complete. 2024-09-13T22:52:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.171+0000 7fba450a7700 1 Processor -- start 2024-09-13T22:52:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.172+0000 7fba450a7700 1 -- start start 2024-09-13T22:52:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.172+0000 7fba450a7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba400ff5a0 0x7fba4019c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.172+0000 7fba450a7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba400fff50 0x7fba4019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.172+0000 7fba450a7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4019d2a0 con 0x7fba400fff50 2024-09-13T22:52:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.172+0000 7fba450a7700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba40196750 con 0x7fba400ff5a0 2024-09-13T22:52:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.173+0000 7fba3e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba400fff50 0x7fba4019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.173+0000 7fba3e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba400fff50 0x7fba4019cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33276/0 (socket says 172.21.15.2:33276) 2024-09-13T22:52:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.173+0000 7fba3e59c700 1 -- 172.21.15.2:0/3973440664 learned_addr learned my addr 172.21.15.2:0/3973440664 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.173+0000 7fba3ed9d700 1 --2- 172.21.15.2:0/3973440664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba400ff5a0 0x7fba4019c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.173+0000 7fba3e59c700 1 -- 172.21.15.2:0/3973440664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba400ff5a0 msgr2=0x7fba4019c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:22.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.173+0000 7fba3e59c700 1 --2- 172.21.15.2:0/3973440664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba400ff5a0 0x7fba4019c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:22.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.173+0000 7fba3e59c700 1 -- 172.21.15.2:0/3973440664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba280095f0 con 0x7fba400fff50 2024-09-13T22:52:22.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.173+0000 7fba3e59c700 1 --2- 172.21.15.2:0/3973440664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba400fff50 0x7fba4019cc10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fba28005f50 tx=0x7fba2800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:22.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.173+0000 7fba37fff700 1 -- 172.21.15.2:0/3973440664 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba2801d070 con 0x7fba400fff50 2024-09-13T22:52:22.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.173+0000 7fba450a7700 1 -- 172.21.15.2:0/3973440664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba401969d0 con 0x7fba400fff50 2024-09-13T22:52:22.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.173+0000 7fba450a7700 1 -- 172.21.15.2:0/3973440664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba40196ec0 con 0x7fba400fff50 2024-09-13T22:52:22.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.173+0000 7fba37fff700 1 -- 172.21.15.2:0/3973440664 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fba2800f460 con 0x7fba400fff50 2024-09-13T22:52:22.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.173+0000 7fba37fff700 1 -- 172.21.15.2:0/3973440664 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba28017630 con 0x7fba400fff50 2024-09-13T22:52:22.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.174+0000 7fba450a7700 1 -- 172.21.15.2:0/3973440664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fba4010e130 con 0x7fba400fff50 2024-09-13T22:52:22.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.175+0000 7fba37fff700 1 -- 172.21.15.2:0/3973440664 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fba2800f5d0 con 0x7fba400fff50 2024-09-13T22:52:22.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.176+0000 7fba37fff700 1 --2- 172.21.15.2:0/3973440664 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fba2c06c4e0 0x7fba2c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:22.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.176+0000 7fba37fff700 1 -- 172.21.15.2:0/3973440664 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fba2808c8e0 con 0x7fba400fff50 2024-09-13T22:52:22.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.176+0000 7fba3ed9d700 1 --2- 172.21.15.2:0/3973440664 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fba2c06c4e0 0x7fba2c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:22.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.176+0000 7fba37fff700 1 --2- 172.21.15.2:0/3973440664 >> [v2:172.21.15.47:6800/4105215181,v1:172.21.15.47:6801/4105215181] conn(0x7fba2c072080 0x7fba2c0744a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:22.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.176+0000 7fba37fff700 1 -- 172.21.15.2:0/3973440664 --> [v2:172.21.15.47:6800/4105215181,v1:172.21.15.47:6801/4105215181] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba2c074b50 con 0x7fba2c072080 2024-09-13T22:52:22.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.176+0000 7fba37fff700 1 -- 172.21.15.2:0/3973440664 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba280912a0 con 0x7fba400fff50 2024-09-13T22:52:22.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.176+0000 7fba3ed9d700 1 --2- 172.21.15.2:0/3973440664 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fba2c06c4e0 0x7fba2c06e9a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba3000a400 tx=0x7fba3000d040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:22.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.176+0000 7fba3f59e700 1 --2- 172.21.15.2:0/3973440664 >> [v2:172.21.15.47:6800/4105215181,v1:172.21.15.47:6801/4105215181] conn(0x7fba2c072080 0x7fba2c0744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:22.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.177+0000 7fba3f59e700 1 --2- 172.21.15.2:0/3973440664 >> [v2:172.21.15.47:6800/4105215181,v1:172.21.15.47:6801/4105215181] conn(0x7fba2c072080 0x7fba2c0744a0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:22.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.177+0000 7fba37fff700 1 -- 172.21.15.2:0/3973440664 <== osd.3 v2:172.21.15.47:6800/4105215181 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fba2c074b50 con 0x7fba2c072080 2024-09-13T22:52:22.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.193+0000 7fba450a7700 1 -- 172.21.15.2:0/3973440664 --> [v2:172.21.15.47:6800/4105215181,v1:172.21.15.47:6801/4105215181] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fba4004f2e0 con 0x7fba2c072080 2024-09-13T22:52:22.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.194+0000 7fba37fff700 1 -- 172.21.15.2:0/3973440664 <== osd.3 v2:172.21.15.47:6800/4105215181 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fba4004f2e0 con 0x7fba2c072080 2024-09-13T22:52:22.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.194+0000 7fba450a7700 1 -- 172.21.15.2:0/3973440664 >> [v2:172.21.15.47:6800/4105215181,v1:172.21.15.47:6801/4105215181] conn(0x7fba2c072080 msgr2=0x7fba2c0744a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:22.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.194+0000 7fba450a7700 1 --2- 172.21.15.2:0/3973440664 >> [v2:172.21.15.47:6800/4105215181,v1:172.21.15.47:6801/4105215181] conn(0x7fba2c072080 0x7fba2c0744a0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:22.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.194+0000 7fba450a7700 1 -- 172.21.15.2:0/3973440664 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fba2c06c4e0 msgr2=0x7fba2c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:22.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.194+0000 7fba450a7700 1 --2- 172.21.15.2:0/3973440664 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fba2c06c4e0 0x7fba2c06e9a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba3000a400 tx=0x7fba3000d040 comp rx=0 tx=0).stop 2024-09-13T22:52:22.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.194+0000 7fba450a7700 1 -- 172.21.15.2:0/3973440664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba400fff50 msgr2=0x7fba4019cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:22.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.194+0000 7fba450a7700 1 --2- 172.21.15.2:0/3973440664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba400fff50 0x7fba4019cc10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fba28005f50 tx=0x7fba2800bd70 comp rx=0 tx=0).stop 2024-09-13T22:52:22.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.194+0000 7fba450a7700 1 -- 172.21.15.2:0/3973440664 shutdown_connections 2024-09-13T22:52:22.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.194+0000 7fba450a7700 1 --2- 172.21.15.2:0/3973440664 >> [v2:172.21.15.47:6800/4105215181,v1:172.21.15.47:6801/4105215181] conn(0x7fba2c072080 0x7fba2c0744a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:22.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.194+0000 7fba450a7700 1 --2- 172.21.15.2:0/3973440664 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fba2c06c4e0 0x7fba2c06e9a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:22.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.194+0000 7fba450a7700 1 --2- 172.21.15.2:0/3973440664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba400ff5a0 0x7fba4019c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:22.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.194+0000 7fba450a7700 1 --2- 172.21.15.2:0/3973440664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba400fff50 0x7fba4019cc10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:22.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.194+0000 7fba450a7700 1 -- 172.21.15.2:0/3973440664 >> 172.21.15.2:0/3973440664 conn(0x7fba40074e30 msgr2=0x7fba400fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:22.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.194+0000 7fba450a7700 1 -- 172.21.15.2:0/3973440664 shutdown_connections 2024-09-13T22:52:22.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:22.194+0000 7fba450a7700 1 -- 172.21.15.2:0/3973440664 wait complete. 2024-09-13T22:52:23.005 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:23.118 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:23 smithi002 ceph-mon[27637]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:23.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:23 smithi047 ceph-mon[34560]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:23.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.828+0000 7f90a0bb3700 1 -- 172.21.15.2:0/1091897051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f909c0ffb40 msgr2=0x7f909c0fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:23.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.828+0000 7f90a0bb3700 1 --2- 172.21.15.2:0/1091897051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f909c0ffb40 0x7f909c0fffc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9090009910 tx=0x7f9090009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.828+0000 7f90a0bb3700 1 -- 172.21.15.2:0/1091897051 shutdown_connections 2024-09-13T22:52:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.828+0000 7f90a0bb3700 1 --2- 172.21.15.2:0/1091897051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f909c0ffb40 0x7f909c0fffc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.828+0000 7f90a0bb3700 1 --2- 172.21.15.2:0/1091897051 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909c105bf0 0x7f909c105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.828+0000 7f90a0bb3700 1 -- 172.21.15.2:0/1091897051 >> 172.21.15.2:0/1091897051 conn(0x7f909c0fb650 msgr2=0x7f909c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.828+0000 7f90a0bb3700 1 -- 172.21.15.2:0/1091897051 shutdown_connections 2024-09-13T22:52:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.828+0000 7f90a0bb3700 1 -- 172.21.15.2:0/1091897051 wait complete. 2024-09-13T22:52:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.829+0000 7f90a0bb3700 1 Processor -- start 2024-09-13T22:52:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.829+0000 7f90a0bb3700 1 -- start start 2024-09-13T22:52:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.829+0000 7f90a0bb3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909c0ffb40 0x7f909c19c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.829+0000 7f90a0bb3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f909c105bf0 0x7f909c19cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.829+0000 7f90a0bb3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c19d170 con 0x7f909c105bf0 2024-09-13T22:52:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.829+0000 7f90a0bb3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c196620 con 0x7f909c0ffb40 2024-09-13T22:52:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.829+0000 7f9099d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f909c105bf0 0x7f909c19cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.829+0000 7f909a59c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909c0ffb40 0x7f909c19c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.829+0000 7f9099d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f909c105bf0 0x7f909c19cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33282/0 (socket says 172.21.15.2:33282) 2024-09-13T22:52:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.829+0000 7f9099d9b700 1 -- 172.21.15.2:0/3201961893 learned_addr learned my addr 172.21.15.2:0/3201961893 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.829+0000 7f909a59c700 1 -- 172.21.15.2:0/3201961893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f909c105bf0 msgr2=0x7f909c19cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.829+0000 7f909a59c700 1 --2- 172.21.15.2:0/3201961893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f909c105bf0 0x7f909c19cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.829+0000 7f909a59c700 1 -- 172.21.15.2:0/3201961893 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90900095f0 con 0x7f909c0ffb40 2024-09-13T22:52:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.829+0000 7f9099d9b700 1 --2- 172.21.15.2:0/3201961893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f909c105bf0 0x7f909c19cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T22:52:23.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.830+0000 7f909a59c700 1 --2- 172.21.15.2:0/3201961893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909c0ffb40 0x7f909c19c5a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f908c00e970 tx=0x7f908c00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:23.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.830+0000 7f908b7fe700 1 -- 172.21.15.2:0/3201961893 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f908c00c9d0 con 0x7f909c0ffb40 2024-09-13T22:52:23.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.830+0000 7f90a0bb3700 1 -- 172.21.15.2:0/3201961893 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909c196900 con 0x7f909c0ffb40 2024-09-13T22:52:23.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.830+0000 7f908b7fe700 1 -- 172.21.15.2:0/3201961893 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f908c010430 con 0x7f909c0ffb40 2024-09-13T22:52:23.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.830+0000 7f908b7fe700 1 -- 172.21.15.2:0/3201961893 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f908c018650 con 0x7f909c0ffb40 2024-09-13T22:52:23.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.830+0000 7f90a0bb3700 1 -- 172.21.15.2:0/3201961893 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909c196e50 con 0x7f909c0ffb40 2024-09-13T22:52:23.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.831+0000 7f90a0bb3700 1 -- 172.21.15.2:0/3201961893 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909c108020 con 0x7f909c0ffb40 2024-09-13T22:52:23.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.831+0000 7f908b7fe700 1 -- 172.21.15.2:0/3201961893 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f908c00cb30 con 0x7f909c0ffb40 2024-09-13T22:52:23.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.832+0000 7f908b7fe700 1 --2- 172.21.15.2:0/3201961893 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f908406c4e0 0x7f908406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:23.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.832+0000 7f908b7fe700 1 -- 172.21.15.2:0/3201961893 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f908c014070 con 0x7f909c0ffb40 2024-09-13T22:52:23.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.832+0000 7f9099d9b700 1 --2- 172.21.15.2:0/3201961893 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f908406c4e0 0x7f908406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:23.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.832+0000 7f9099d9b700 1 --2- 172.21.15.2:0/3201961893 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f908406c4e0 0x7f908406e9a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f909c0fca30 tx=0x7f9090005a90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:23.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:23.836+0000 7f908b7fe700 1 -- 172.21.15.2:0/3201961893 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f908c0520e0 con 0x7f909c0ffb40 2024-09-13T22:52:24.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:24.039+0000 7f90a0bb3700 1 -- 172.21.15.2:0/3201961893 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f909c197070 con 0x7f909c0ffb40 2024-09-13T22:52:24.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:24.039+0000 7f908b7fe700 1 -- 172.21.15.2:0/3201961893 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f908c059d40 con 0x7f909c0ffb40 2024-09-13T22:52:24.041 INFO:teuthology.orchestra.run.smithi002.stdout:60129542174 2024-09-13T22:52:24.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:24.042+0000 7f90a0bb3700 1 -- 172.21.15.2:0/3201961893 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f908406c4e0 msgr2=0x7f908406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:24.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:24.042+0000 7f90a0bb3700 1 --2- 172.21.15.2:0/3201961893 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f908406c4e0 0x7f908406e9a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f909c0fca30 tx=0x7f9090005a90 comp rx=0 tx=0).stop 2024-09-13T22:52:24.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:24.042+0000 7f90a0bb3700 1 -- 172.21.15.2:0/3201961893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909c0ffb40 msgr2=0x7f909c19c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:24.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:24.042+0000 7f90a0bb3700 1 --2- 172.21.15.2:0/3201961893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909c0ffb40 0x7f909c19c5a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f908c00e970 tx=0x7f908c00ec80 comp rx=0 tx=0).stop 2024-09-13T22:52:24.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:24.042+0000 7f90a0bb3700 1 -- 172.21.15.2:0/3201961893 shutdown_connections 2024-09-13T22:52:24.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:24.042+0000 7f90a0bb3700 1 --2- 172.21.15.2:0/3201961893 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f908406c4e0 0x7f908406e9a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:24.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:24.042+0000 7f90a0bb3700 1 --2- 172.21.15.2:0/3201961893 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909c0ffb40 0x7f909c19c5a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:24.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:24.042+0000 7f90a0bb3700 1 --2- 172.21.15.2:0/3201961893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f909c105bf0 0x7f909c19cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:24.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:24.042+0000 7f90a0bb3700 1 -- 172.21.15.2:0/3201961893 >> 172.21.15.2:0/3201961893 conn(0x7f909c0fb650 msgr2=0x7f909c0fd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:24.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:24.042+0000 7f90a0bb3700 1 -- 172.21.15.2:0/3201961893 shutdown_connections 2024-09-13T22:52:24.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:24.042+0000 7f90a0bb3700 1 -- 172.21.15.2:0/3201961893 wait complete. 2024-09-13T22:52:24.269 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:25.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:25 smithi047 ceph-mon[34560]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:25.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:25 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/3201961893' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T22:52:25.449 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:25 smithi002 ceph-mon[27637]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:25.449 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:25 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/3201961893' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T22:52:25.478 INFO:teuthology.orchestra.run.smithi002.stdout:115964117011 2024-09-13T22:52:25.479 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-13T22:52:26.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.139+0000 7fe783310700 1 -- 172.21.15.2:0/665572476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe77c105bf0 msgr2=0x7fe77c105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:26.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.139+0000 7fe783310700 1 --2- 172.21.15.2:0/665572476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe77c105bf0 0x7fe77c105fd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe778009910 tx=0x7fe778009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:26.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.139+0000 7fe783310700 1 -- 172.21.15.2:0/665572476 shutdown_connections 2024-09-13T22:52:26.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.139+0000 7fe783310700 1 --2- 172.21.15.2:0/665572476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe77c0ffb40 0x7fe77c0fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:26.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.139+0000 7fe783310700 1 --2- 172.21.15.2:0/665572476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe77c105bf0 0x7fe77c105fd0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:26.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.139+0000 7fe783310700 1 -- 172.21.15.2:0/665572476 >> 172.21.15.2:0/665572476 conn(0x7fe77c0fb610 msgr2=0x7fe77c0fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:26.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.139+0000 7fe783310700 1 -- 172.21.15.2:0/665572476 shutdown_connections 2024-09-13T22:52:26.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.139+0000 7fe783310700 1 -- 172.21.15.2:0/665572476 wait complete. 2024-09-13T22:52:26.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.140+0000 7fe783310700 1 Processor -- start 2024-09-13T22:52:26.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.140+0000 7fe783310700 1 -- start start 2024-09-13T22:52:26.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.140+0000 7fe783310700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe77c0ffb40 0x7fe77c1954e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:26.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.140+0000 7fe783310700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe77c105bf0 0x7fe77c195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:26.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.140+0000 7fe783310700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c195f60 con 0x7fe77c0ffb40 2024-09-13T22:52:26.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.140+0000 7fe783310700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c1960d0 con 0x7fe77c105bf0 2024-09-13T22:52:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.140+0000 7fe7810ac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe77c0ffb40 0x7fe77c1954e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.140+0000 7fe7810ac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe77c0ffb40 0x7fe77c1954e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33292/0 (socket says 172.21.15.2:33292) 2024-09-13T22:52:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.141+0000 7fe7810ac700 1 -- 172.21.15.2:0/1725138184 learned_addr learned my addr 172.21.15.2:0/1725138184 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.141+0000 7fe7808ab700 1 --2- 172.21.15.2:0/1725138184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe77c105bf0 0x7fe77c195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.141+0000 7fe7810ac700 1 -- 172.21.15.2:0/1725138184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe77c105bf0 msgr2=0x7fe77c195a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.141+0000 7fe7810ac700 1 --2- 172.21.15.2:0/1725138184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe77c105bf0 0x7fe77c195a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.141+0000 7fe7810ac700 1 -- 172.21.15.2:0/1725138184 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7780095f0 con 0x7fe77c0ffb40 2024-09-13T22:52:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.141+0000 7fe7810ac700 1 --2- 172.21.15.2:0/1725138184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe77c0ffb40 0x7fe77c1954e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe778006010 tx=0x7fe77800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.141+0000 7fe7727fc700 1 -- 172.21.15.2:0/1725138184 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe77801d070 con 0x7fe77c0ffb40 2024-09-13T22:52:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.141+0000 7fe7727fc700 1 -- 172.21.15.2:0/1725138184 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe778004fa0 con 0x7fe77c0ffb40 2024-09-13T22:52:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.141+0000 7fe783310700 1 -- 172.21.15.2:0/1725138184 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77c196350 con 0x7fe77c0ffb40 2024-09-13T22:52:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.141+0000 7fe7727fc700 1 -- 172.21.15.2:0/1725138184 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe77800f690 con 0x7fe77c0ffb40 2024-09-13T22:52:26.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.141+0000 7fe783310700 1 -- 172.21.15.2:0/1725138184 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77c1a2dd0 con 0x7fe77c0ffb40 2024-09-13T22:52:26.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.142+0000 7fe783310700 1 -- 172.21.15.2:0/1725138184 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77c108020 con 0x7fe77c0ffb40 2024-09-13T22:52:26.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.143+0000 7fe7727fc700 1 -- 172.21.15.2:0/1725138184 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fe778022470 con 0x7fe77c0ffb40 2024-09-13T22:52:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.143+0000 7fe7727fc700 1 --2- 172.21.15.2:0/1725138184 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe76806c4e0 0x7fe76806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.143+0000 7fe7727fc700 1 -- 172.21.15.2:0/1725138184 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fe77808c980 con 0x7fe77c0ffb40 2024-09-13T22:52:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.143+0000 7fe7808ab700 1 --2- 172.21.15.2:0/1725138184 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe76806c4e0 0x7fe76806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.144+0000 7fe7808ab700 1 --2- 172.21.15.2:0/1725138184 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe76806c4e0 0x7fe76806e9a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe77c069770 tx=0x7fe76c009190 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:26.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.148+0000 7fe7727fc700 1 -- 172.21.15.2:0/1725138184 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe77805b050 con 0x7fe77c0ffb40 2024-09-13T22:52:26.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.349+0000 7fe783310700 1 -- 172.21.15.2:0/1725138184 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe77c196350 con 0x7fe77c0ffb40 2024-09-13T22:52:26.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.349+0000 7fe7727fc700 1 -- 172.21.15.2:0/1725138184 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe77c196350 con 0x7fe77c0ffb40 2024-09-13T22:52:26.350 INFO:teuthology.orchestra.run.smithi002.stdout:81604378650 2024-09-13T22:52:26.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.351+0000 7fe783310700 1 -- 172.21.15.2:0/1725138184 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe76806c4e0 msgr2=0x7fe76806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:26.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.351+0000 7fe783310700 1 --2- 172.21.15.2:0/1725138184 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe76806c4e0 0x7fe76806e9a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe77c069770 tx=0x7fe76c009190 comp rx=0 tx=0).stop 2024-09-13T22:52:26.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.351+0000 7fe783310700 1 -- 172.21.15.2:0/1725138184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe77c0ffb40 msgr2=0x7fe77c1954e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:26.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.351+0000 7fe783310700 1 --2- 172.21.15.2:0/1725138184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe77c0ffb40 0x7fe77c1954e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe778006010 tx=0x7fe77800bd70 comp rx=0 tx=0).stop 2024-09-13T22:52:26.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.351+0000 7fe783310700 1 -- 172.21.15.2:0/1725138184 shutdown_connections 2024-09-13T22:52:26.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.351+0000 7fe783310700 1 --2- 172.21.15.2:0/1725138184 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe76806c4e0 0x7fe76806e9a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:26.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.351+0000 7fe783310700 1 --2- 172.21.15.2:0/1725138184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe77c0ffb40 0x7fe77c1954e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:26.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.351+0000 7fe783310700 1 --2- 172.21.15.2:0/1725138184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe77c105bf0 0x7fe77c195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:26.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.351+0000 7fe783310700 1 -- 172.21.15.2:0/1725138184 >> 172.21.15.2:0/1725138184 conn(0x7fe77c0fb610 msgr2=0x7fe77c0fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:26.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.352+0000 7fe783310700 1 -- 172.21.15.2:0/1725138184 shutdown_connections 2024-09-13T22:52:26.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:26.352+0000 7fe783310700 1 -- 172.21.15.2:0/1725138184 wait complete. 2024-09-13T22:52:26.665 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542174 for osd.1 2024-09-13T22:52:26.665 DEBUG:teuthology.parallel:result is None 2024-09-13T22:52:27.397 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:27 smithi002 ceph-mon[27637]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:27.398 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:27 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/1725138184' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T22:52:27.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:27 smithi047 ceph-mon[34560]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:27.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:27 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/1725138184' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T22:52:27.739 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:28.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.849+0000 7f0f62b31700 1 -- 172.21.15.2:0/1783213250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f5c105bd0 msgr2=0x7f0f5c105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:28.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.849+0000 7f0f62b31700 1 --2- 172.21.15.2:0/1783213250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f5c105bd0 0x7f0f5c105fb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009910 tx=0x7f0f4c009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:28.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.849+0000 7f0f62b31700 1 -- 172.21.15.2:0/1783213250 shutdown_connections 2024-09-13T22:52:28.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.849+0000 7f0f62b31700 1 --2- 172.21.15.2:0/1783213250 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0ffc20 0x7f0f5c100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:28.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.849+0000 7f0f62b31700 1 --2- 172.21.15.2:0/1783213250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f5c105bd0 0x7f0f5c105fb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:28.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.849+0000 7f0f62b31700 1 -- 172.21.15.2:0/1783213250 >> 172.21.15.2:0/1783213250 conn(0x7f0f5c075670 msgr2=0x7f0f5c075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:28.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.849+0000 7f0f62b31700 1 -- 172.21.15.2:0/1783213250 shutdown_connections 2024-09-13T22:52:28.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.849+0000 7f0f62b31700 1 -- 172.21.15.2:0/1783213250 wait complete. 2024-09-13T22:52:28.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.850+0000 7f0f62b31700 1 Processor -- start 2024-09-13T22:52:28.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.850+0000 7f0f62b31700 1 -- start start 2024-09-13T22:52:28.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.850+0000 7f0f62b31700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0ffc20 0x7f0f5c1954c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:28.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.850+0000 7f0f62b31700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f5c105bd0 0x7f0f5c195a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:28.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.850+0000 7f0f62b31700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c195f40 con 0x7f0f5c105bd0 2024-09-13T22:52:28.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.850+0000 7f0f62b31700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c1960b0 con 0x7f0f5c0ffc20 2024-09-13T22:52:28.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.850+0000 7f0f5bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f5c105bd0 0x7f0f5c195a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:28.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.850+0000 7f0f5bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f5c105bd0 0x7f0f5c195a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33306/0 (socket says 172.21.15.2:33306) 2024-09-13T22:52:28.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.850+0000 7f0f5bfff700 1 -- 172.21.15.2:0/3811934662 learned_addr learned my addr 172.21.15.2:0/3811934662 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:28.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.850+0000 7f0f608cd700 1 --2- 172.21.15.2:0/3811934662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0ffc20 0x7f0f5c1954c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:28.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.851+0000 7f0f5bfff700 1 -- 172.21.15.2:0/3811934662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0ffc20 msgr2=0x7f0f5c1954c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:28.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.851+0000 7f0f5bfff700 1 --2- 172.21.15.2:0/3811934662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0ffc20 0x7f0f5c1954c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:28.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.851+0000 7f0f5bfff700 1 -- 172.21.15.2:0/3811934662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c0095f0 con 0x7f0f5c105bd0 2024-09-13T22:52:28.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.851+0000 7f0f5bfff700 1 --2- 172.21.15.2:0/3811934662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f5c105bd0 0x7f0f5c195a00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400d8d0 tx=0x7f0f4400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:28.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.851+0000 7f0f59ffb700 1 -- 172.21.15.2:0/3811934662 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f440098a0 con 0x7f0f5c105bd0 2024-09-13T22:52:28.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.851+0000 7f0f59ffb700 1 -- 172.21.15.2:0/3811934662 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0f44010460 con 0x7f0f5c105bd0 2024-09-13T22:52:28.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.851+0000 7f0f62b31700 1 -- 172.21.15.2:0/3811934662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5c1a2b30 con 0x7f0f5c105bd0 2024-09-13T22:52:28.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.851+0000 7f0f59ffb700 1 -- 172.21.15.2:0/3811934662 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f4400f5f0 con 0x7f0f5c105bd0 2024-09-13T22:52:28.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.851+0000 7f0f62b31700 1 -- 172.21.15.2:0/3811934662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5c1a2e90 con 0x7f0f5c105bd0 2024-09-13T22:52:28.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.852+0000 7f0f62b31700 1 -- 172.21.15.2:0/3811934662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5c1080d0 con 0x7f0f5c105bd0 2024-09-13T22:52:28.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.853+0000 7f0f59ffb700 1 -- 172.21.15.2:0/3811934662 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f0f44009a00 con 0x7f0f5c105bd0 2024-09-13T22:52:28.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.853+0000 7f0f59ffb700 1 --2- 172.21.15.2:0/3811934662 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f0f4806c4e0 0x7f0f4806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:28.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.853+0000 7f0f59ffb700 1 -- 172.21.15.2:0/3811934662 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f0f4408b2b0 con 0x7f0f5c105bd0 2024-09-13T22:52:28.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.853+0000 7f0f608cd700 1 --2- 172.21.15.2:0/3811934662 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f0f4806c4e0 0x7f0f4806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:28.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.854+0000 7f0f608cd700 1 --2- 172.21.15.2:0/3811934662 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f0f4806c4e0 0x7f0f4806e9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c006010 tx=0x7f0f4c01a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:28.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:28.858+0000 7f0f59ffb700 1 -- 172.21.15.2:0/3811934662 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0f44055e70 con 0x7f0f5c105bd0 2024-09-13T22:52:29.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:29.063+0000 7f0f62b31700 1 -- 172.21.15.2:0/3811934662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0f5c107ab0 con 0x7f0f5c105bd0 2024-09-13T22:52:29.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:29.063+0000 7f0f59ffb700 1 -- 172.21.15.2:0/3811934662 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f44059490 con 0x7f0f5c105bd0 2024-09-13T22:52:29.065 INFO:teuthology.orchestra.run.smithi002.stdout:171798691851 2024-09-13T22:52:29.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:29.065+0000 7f0f62b31700 1 -- 172.21.15.2:0/3811934662 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f0f4806c4e0 msgr2=0x7f0f4806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:29.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:29.066+0000 7f0f62b31700 1 --2- 172.21.15.2:0/3811934662 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f0f4806c4e0 0x7f0f4806e9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c006010 tx=0x7f0f4c01a040 comp rx=0 tx=0).stop 2024-09-13T22:52:29.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:29.066+0000 7f0f62b31700 1 -- 172.21.15.2:0/3811934662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f5c105bd0 msgr2=0x7f0f5c195a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:29.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:29.066+0000 7f0f62b31700 1 --2- 172.21.15.2:0/3811934662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f5c105bd0 0x7f0f5c195a00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400d8d0 tx=0x7f0f4400dbe0 comp rx=0 tx=0).stop 2024-09-13T22:52:29.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:29.066+0000 7f0f62b31700 1 -- 172.21.15.2:0/3811934662 shutdown_connections 2024-09-13T22:52:29.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:29.066+0000 7f0f62b31700 1 --2- 172.21.15.2:0/3811934662 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f0f4806c4e0 0x7f0f4806e9a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:29.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:29.066+0000 7f0f62b31700 1 --2- 172.21.15.2:0/3811934662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0ffc20 0x7f0f5c1954c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:29.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:29.066+0000 7f0f62b31700 1 --2- 172.21.15.2:0/3811934662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f5c105bd0 0x7f0f5c195a00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:29.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:29.066+0000 7f0f62b31700 1 -- 172.21.15.2:0/3811934662 >> 172.21.15.2:0/3811934662 conn(0x7f0f5c075670 msgr2=0x7f0f5c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:29.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:29.066+0000 7f0f62b31700 1 -- 172.21.15.2:0/3811934662 shutdown_connections 2024-09-13T22:52:29.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:29.066+0000 7f0f62b31700 1 -- 172.21.15.2:0/3811934662 wait complete. 2024-09-13T22:52:29.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:29 smithi002 ceph-mon[27637]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:29.364 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378650 for osd.2 2024-09-13T22:52:29.364 DEBUG:teuthology.parallel:result is None 2024-09-13T22:52:29.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:29 smithi047 ceph-mon[34560]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:30.268 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:30.356 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:30 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/3811934662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T22:52:30.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:30 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/3811934662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T22:52:31.302 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:31 smithi002 ceph-mon[27637]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:31.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:31 smithi047 ceph-mon[34560]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:31.792 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691849 got 171798691851 for osd.5 2024-09-13T22:52:31.792 DEBUG:teuthology.parallel:result is None 2024-09-13T22:52:32.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.888+0000 7f19a1b96700 1 -- 172.21.15.2:0/3068363255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f199c102720 msgr2=0x7f199c10ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:32.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.888+0000 7f19a1b96700 1 --2- 172.21.15.2:0/3068363255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f199c102720 0x7f199c10ac10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1990009910 tx=0x7f1990009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.888+0000 7f19a1b96700 1 -- 172.21.15.2:0/3068363255 shutdown_connections 2024-09-13T22:52:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.888+0000 7f19a1b96700 1 --2- 172.21.15.2:0/3068363255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f199c102720 0x7f199c10ac10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.888+0000 7f19a1b96700 1 --2- 172.21.15.2:0/3068363255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f199c101e00 0x7f199c1021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.888+0000 7f19a1b96700 1 -- 172.21.15.2:0/3068363255 >> 172.21.15.2:0/3068363255 conn(0x7f199c0fb650 msgr2=0x7f199c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.888+0000 7f19a1b96700 1 -- 172.21.15.2:0/3068363255 shutdown_connections 2024-09-13T22:52:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.888+0000 7f19a1b96700 1 -- 172.21.15.2:0/3068363255 wait complete. 2024-09-13T22:52:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.889+0000 7f19a1b96700 1 Processor -- start 2024-09-13T22:52:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.889+0000 7f19a1b96700 1 -- start start 2024-09-13T22:52:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.889+0000 7f19a1b96700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f199c101e00 0x7f199c0ffa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.889+0000 7f19a1b96700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f199c102720 0x7f199c0fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.889+0000 7f19a1b96700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c1004e0 con 0x7f199c101e00 2024-09-13T22:52:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.889+0000 7f19a1b96700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c100620 con 0x7f199c102720 2024-09-13T22:52:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.889+0000 7f199b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f199c101e00 0x7f199c0ffa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.889+0000 7f199b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f199c101e00 0x7f199c0ffa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56206/0 (socket says 172.21.15.2:56206) 2024-09-13T22:52:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.889+0000 7f199b7fe700 1 -- 172.21.15.2:0/1455622093 learned_addr learned my addr 172.21.15.2:0/1455622093 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.889+0000 7f199affd700 1 --2- 172.21.15.2:0/1455622093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f199c102720 0x7f199c0fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.889+0000 7f199b7fe700 1 -- 172.21.15.2:0/1455622093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f199c102720 msgr2=0x7f199c0fffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.889+0000 7f199b7fe700 1 --2- 172.21.15.2:0/1455622093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f199c102720 0x7f199c0fffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.889+0000 7f199b7fe700 1 -- 172.21.15.2:0/1455622093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19900095f0 con 0x7f199c101e00 2024-09-13T22:52:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.890+0000 7f199b7fe700 1 --2- 172.21.15.2:0/1455622093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f199c101e00 0x7f199c0ffa60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f198c00d8d0 tx=0x7f198c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.890+0000 7f1998ff9700 1 -- 172.21.15.2:0/1455622093 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f198c0098a0 con 0x7f199c101e00 2024-09-13T22:52:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.890+0000 7f1998ff9700 1 -- 172.21.15.2:0/1455622093 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f198c010460 con 0x7f199c101e00 2024-09-13T22:52:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.890+0000 7f19a1b96700 1 -- 172.21.15.2:0/1455622093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c1a2a90 con 0x7f199c101e00 2024-09-13T22:52:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.890+0000 7f1998ff9700 1 -- 172.21.15.2:0/1455622093 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f198c00f5f0 con 0x7f199c101e00 2024-09-13T22:52:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.890+0000 7f19a1b96700 1 -- 172.21.15.2:0/1455622093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c1a2e40 con 0x7f199c101e00 2024-09-13T22:52:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.891+0000 7f19a1b96700 1 -- 172.21.15.2:0/1455622093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199c108310 con 0x7f199c101e00 2024-09-13T22:52:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.891+0000 7f1998ff9700 1 -- 172.21.15.2:0/1455622093 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f198c009a00 con 0x7f199c101e00 2024-09-13T22:52:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.892+0000 7f1998ff9700 1 --2- 172.21.15.2:0/1455622093 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f198406c4e0 0x7f198406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.892+0000 7f1998ff9700 1 -- 172.21.15.2:0/1455622093 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f198c08b240 con 0x7f199c101e00 2024-09-13T22:52:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.892+0000 7f199affd700 1 --2- 172.21.15.2:0/1455622093 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f198406c4e0 0x7f198406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.892+0000 7f199affd700 1 --2- 172.21.15.2:0/1455622093 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f198406c4e0 0x7f198406e9a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1990006010 tx=0x7f199001a040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:32.896+0000 7f1998ff9700 1 -- 172.21.15.2:0/1455622093 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f198c055e80 con 0x7f199c101e00 2024-09-13T22:52:33.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.099+0000 7f19a1b96700 1 -- 172.21.15.2:0/1455622093 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f199c107cf0 con 0x7f199c101e00 2024-09-13T22:52:33.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.099+0000 7f1998ff9700 1 -- 172.21.15.2:0/1455622093 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f198c0594a0 con 0x7f199c101e00 2024-09-13T22:52:33.100 INFO:teuthology.orchestra.run.smithi002.stdout:150323855376 2024-09-13T22:52:33.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.101+0000 7f19a1b96700 1 -- 172.21.15.2:0/1455622093 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f198406c4e0 msgr2=0x7f198406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:33.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.101+0000 7f19a1b96700 1 --2- 172.21.15.2:0/1455622093 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f198406c4e0 0x7f198406e9a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1990006010 tx=0x7f199001a040 comp rx=0 tx=0).stop 2024-09-13T22:52:33.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.101+0000 7f19a1b96700 1 -- 172.21.15.2:0/1455622093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f199c101e00 msgr2=0x7f199c0ffa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:33.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.101+0000 7f19a1b96700 1 --2- 172.21.15.2:0/1455622093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f199c101e00 0x7f199c0ffa60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f198c00d8d0 tx=0x7f198c00dbe0 comp rx=0 tx=0).stop 2024-09-13T22:52:33.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.101+0000 7f19a1b96700 1 -- 172.21.15.2:0/1455622093 shutdown_connections 2024-09-13T22:52:33.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.101+0000 7f19a1b96700 1 --2- 172.21.15.2:0/1455622093 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f198406c4e0 0x7f198406e9a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:33.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.101+0000 7f19a1b96700 1 --2- 172.21.15.2:0/1455622093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f199c101e00 0x7f199c0ffa60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:33.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.101+0000 7f19a1b96700 1 --2- 172.21.15.2:0/1455622093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f199c102720 0x7f199c0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:33.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.101+0000 7f19a1b96700 1 -- 172.21.15.2:0/1455622093 >> 172.21.15.2:0/1455622093 conn(0x7f199c0fb650 msgr2=0x7f199c105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:33.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.101+0000 7f19a1b96700 1 -- 172.21.15.2:0/1455622093 shutdown_connections 2024-09-13T22:52:33.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.101+0000 7f19a1b96700 1 -- 172.21.15.2:0/1455622093 wait complete. 2024-09-13T22:52:33.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.105+0000 7f65d4a0f700 1 -- 172.21.15.2:0/2231129461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65d01006b0 msgr2=0x7f65d0100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:33.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.105+0000 7f65d4a0f700 1 --2- 172.21.15.2:0/2231129461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65d01006b0 0x7f65d0100a90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f65c0009910 tx=0x7f65c0009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:33.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.105+0000 7f65d4a0f700 1 -- 172.21.15.2:0/2231129461 shutdown_connections 2024-09-13T22:52:33.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.105+0000 7f65d4a0f700 1 --2- 172.21.15.2:0/2231129461 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65d0101060 0x7f65d01047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:33.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.105+0000 7f65d4a0f700 1 --2- 172.21.15.2:0/2231129461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65d01006b0 0x7f65d0100a90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:33.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.105+0000 7f65d4a0f700 1 -- 172.21.15.2:0/2231129461 >> 172.21.15.2:0/2231129461 conn(0x7f65d0074e30 msgr2=0x7f65d0075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:33.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.105+0000 7f65d4a0f700 1 -- 172.21.15.2:0/2231129461 shutdown_connections 2024-09-13T22:52:33.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.105+0000 7f65d4a0f700 1 -- 172.21.15.2:0/2231129461 wait complete. 2024-09-13T22:52:33.107 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:33 smithi002 ceph-mon[27637]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:33.107 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:33 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:52:33.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.106+0000 7f65d4a0f700 1 Processor -- start 2024-09-13T22:52:33.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.106+0000 7f65d4a0f700 1 -- start start 2024-09-13T22:52:33.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.106+0000 7f65d4a0f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65d01006b0 0x7f65d0197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:33.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.106+0000 7f65d4a0f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65d0101060 0x7f65d0197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:33.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.106+0000 7f65d4a0f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d01982b0 con 0x7f65d01006b0 2024-09-13T22:52:33.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.107+0000 7f65d4a0f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d0198420 con 0x7f65d0101060 2024-09-13T22:52:33.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.107+0000 7f65ce59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65d01006b0 0x7f65d0197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:33.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.107+0000 7f65ce59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65d01006b0 0x7f65d0197750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56218/0 (socket says 172.21.15.2:56218) 2024-09-13T22:52:33.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.107+0000 7f65ce59c700 1 -- 172.21.15.2:0/4088070112 learned_addr learned my addr 172.21.15.2:0/4088070112 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:33.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.107+0000 7f65c7fff700 1 --2- 172.21.15.2:0/4088070112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65d0101060 0x7f65d0197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:33.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.107+0000 7f65ce59c700 1 -- 172.21.15.2:0/4088070112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65d0101060 msgr2=0x7f65d0197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:33.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.107+0000 7f65ce59c700 1 --2- 172.21.15.2:0/4088070112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65d0101060 0x7f65d0197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:33.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.107+0000 7f65ce59c700 1 -- 172.21.15.2:0/4088070112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c00095f0 con 0x7f65d01006b0 2024-09-13T22:52:33.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.107+0000 7f65ce59c700 1 --2- 172.21.15.2:0/4088070112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65d01006b0 0x7f65d0197750 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f65c0006010 tx=0x7f65c000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:33.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.108+0000 7f65c77fe700 1 -- 172.21.15.2:0/4088070112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65c001d070 con 0x7f65d01006b0 2024-09-13T22:52:33.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.108+0000 7f65d4a0f700 1 -- 172.21.15.2:0/4088070112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d01a07c0 con 0x7f65d01006b0 2024-09-13T22:52:33.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.108+0000 7f65c77fe700 1 -- 172.21.15.2:0/4088070112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f65c0004fa0 con 0x7f65d01006b0 2024-09-13T22:52:33.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.108+0000 7f65c77fe700 1 -- 172.21.15.2:0/4088070112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65c000f460 con 0x7f65d01006b0 2024-09-13T22:52:33.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.108+0000 7f65d4a0f700 1 -- 172.21.15.2:0/4088070112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d01a0c30 con 0x7f65d01006b0 2024-09-13T22:52:33.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.109+0000 7f65d4a0f700 1 -- 172.21.15.2:0/4088070112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d0108120 con 0x7f65d01006b0 2024-09-13T22:52:33.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.110+0000 7f65c77fe700 1 -- 172.21.15.2:0/4088070112 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f65c0004af0 con 0x7f65d01006b0 2024-09-13T22:52:33.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.110+0000 7f65c77fe700 1 --2- 172.21.15.2:0/4088070112 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f65bc06c4e0 0x7f65bc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:33.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.110+0000 7f65c77fe700 1 -- 172.21.15.2:0/4088070112 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f65c008c940 con 0x7f65d01006b0 2024-09-13T22:52:33.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.110+0000 7f65c7fff700 1 --2- 172.21.15.2:0/4088070112 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f65bc06c4e0 0x7f65bc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:33.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.111+0000 7f65c7fff700 1 --2- 172.21.15.2:0/4088070112 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f65bc06c4e0 0x7f65bc06e9a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f65d00ffc10 tx=0x7f65b8009190 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:33.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.115+0000 7f65c77fe700 1 -- 172.21.15.2:0/4088070112 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f65c0057630 con 0x7f65d01006b0 2024-09-13T22:52:33.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.315+0000 7f65d4a0f700 1 -- 172.21.15.2:0/4088070112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f65d0107b00 con 0x7f65d01006b0 2024-09-13T22:52:33.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.316+0000 7f65c77fe700 1 -- 172.21.15.2:0/4088070112 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f65c0027020 con 0x7f65d01006b0 2024-09-13T22:52:33.317 INFO:teuthology.orchestra.run.smithi002.stdout:38654705702 2024-09-13T22:52:33.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.318+0000 7f65d4a0f700 1 -- 172.21.15.2:0/4088070112 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f65bc06c4e0 msgr2=0x7f65bc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:33.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.318+0000 7f65d4a0f700 1 --2- 172.21.15.2:0/4088070112 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f65bc06c4e0 0x7f65bc06e9a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f65d00ffc10 tx=0x7f65b8009190 comp rx=0 tx=0).stop 2024-09-13T22:52:33.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.318+0000 7f65d4a0f700 1 -- 172.21.15.2:0/4088070112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65d01006b0 msgr2=0x7f65d0197750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:33.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.318+0000 7f65d4a0f700 1 --2- 172.21.15.2:0/4088070112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65d01006b0 0x7f65d0197750 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f65c0006010 tx=0x7f65c000bd70 comp rx=0 tx=0).stop 2024-09-13T22:52:33.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.318+0000 7f65d4a0f700 1 -- 172.21.15.2:0/4088070112 shutdown_connections 2024-09-13T22:52:33.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.318+0000 7f65d4a0f700 1 --2- 172.21.15.2:0/4088070112 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f65bc06c4e0 0x7f65bc06e9a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:33.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.318+0000 7f65d4a0f700 1 --2- 172.21.15.2:0/4088070112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65d01006b0 0x7f65d0197750 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:33.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.318+0000 7f65d4a0f700 1 --2- 172.21.15.2:0/4088070112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65d0101060 0x7f65d0197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:33.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.318+0000 7f65d4a0f700 1 -- 172.21.15.2:0/4088070112 >> 172.21.15.2:0/4088070112 conn(0x7f65d0074e30 msgr2=0x7f65d00fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:33.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.318+0000 7f65d4a0f700 1 -- 172.21.15.2:0/4088070112 shutdown_connections 2024-09-13T22:52:33.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:33.318+0000 7f65d4a0f700 1 -- 172.21.15.2:0/4088070112 wait complete. 2024-09-13T22:52:33.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:33 smithi047 ceph-mon[34560]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:33.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:33 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:52:33.939 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855374 got 150323855376 for osd.4 2024-09-13T22:52:33.939 DEBUG:teuthology.parallel:result is None 2024-09-13T22:52:34.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:34 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/1455622093' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T22:52:34.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:34 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/4088070112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T22:52:34.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:34 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/1455622093' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T22:52:34.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:34 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/4088070112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T22:52:34.922 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705702 for osd.0 2024-09-13T22:52:34.923 DEBUG:teuthology.parallel:result is None 2024-09-13T22:52:35.190 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:35 smithi002 ceph-mon[27637]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:35.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:35 smithi047 ceph-mon[34560]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:35.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.473+0000 7fc90f344700 1 -- 172.21.15.2:0/4040440518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc908073ae0 msgr2=0x7fc90810cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:35.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.473+0000 7fc90f344700 1 --2- 172.21.15.2:0/4040440518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc908073ae0 0x7fc90810cf40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc009910 tx=0x7fc8fc009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:35.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.473+0000 7fc90f344700 1 -- 172.21.15.2:0/4040440518 shutdown_connections 2024-09-13T22:52:35.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.473+0000 7fc90f344700 1 --2- 172.21.15.2:0/4040440518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc908073ae0 0x7fc90810cf40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:35.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.473+0000 7fc90f344700 1 --2- 172.21.15.2:0/4040440518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc9080731c0 0x7fc9080735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:35.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.473+0000 7fc90f344700 1 -- 172.21.15.2:0/4040440518 >> 172.21.15.2:0/4040440518 conn(0x7fc9080fc750 msgr2=0x7fc9080feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:35.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.473+0000 7fc90f344700 1 -- 172.21.15.2:0/4040440518 shutdown_connections 2024-09-13T22:52:35.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.473+0000 7fc90f344700 1 -- 172.21.15.2:0/4040440518 wait complete. 2024-09-13T22:52:35.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.474+0000 7fc90f344700 1 Processor -- start 2024-09-13T22:52:35.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.474+0000 7fc90f344700 1 -- start start 2024-09-13T22:52:35.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.474+0000 7fc90f344700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9080731c0 0x7fc90819e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:35.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.474+0000 7fc90f344700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc908073ae0 0x7fc90819ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:35.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.474+0000 7fc90f344700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90819f420 con 0x7fc9080731c0 2024-09-13T22:52:35.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.474+0000 7fc90f344700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9081988d0 con 0x7fc908073ae0 2024-09-13T22:52:35.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.474+0000 7fc90d0e0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9080731c0 0x7fc90819e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:35.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.474+0000 7fc90d0e0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9080731c0 0x7fc90819e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56244/0 (socket says 172.21.15.2:56244) 2024-09-13T22:52:35.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.474+0000 7fc90d0e0700 1 -- 172.21.15.2:0/694865148 learned_addr learned my addr 172.21.15.2:0/694865148 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:35.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.474+0000 7fc90c8df700 1 --2- 172.21.15.2:0/694865148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc908073ae0 0x7fc90819ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.474+0000 7fc90d0e0700 1 -- 172.21.15.2:0/694865148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc908073ae0 msgr2=0x7fc90819ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.474+0000 7fc90d0e0700 1 --2- 172.21.15.2:0/694865148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc908073ae0 0x7fc90819ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.474+0000 7fc90d0e0700 1 -- 172.21.15.2:0/694865148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8fc0095f0 con 0x7fc9080731c0 2024-09-13T22:52:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.474+0000 7fc90c8df700 1 --2- 172.21.15.2:0/694865148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc908073ae0 0x7fc90819ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:52:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.474+0000 7fc90d0e0700 1 --2- 172.21.15.2:0/694865148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9080731c0 0x7fc90819e850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc90000d900 tx=0x7fc90000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.475+0000 7fc9067fc700 1 -- 172.21.15.2:0/694865148 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9000041f0 con 0x7fc9080731c0 2024-09-13T22:52:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.475+0000 7fc90f344700 1 -- 172.21.15.2:0/694865148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc908198bb0 con 0x7fc9080731c0 2024-09-13T22:52:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.475+0000 7fc9067fc700 1 -- 172.21.15.2:0/694865148 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc900004ce0 con 0x7fc9080731c0 2024-09-13T22:52:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.475+0000 7fc9067fc700 1 -- 172.21.15.2:0/694865148 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc90000b750 con 0x7fc9080731c0 2024-09-13T22:52:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.475+0000 7fc90f344700 1 -- 172.21.15.2:0/694865148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc908199100 con 0x7fc9080731c0 2024-09-13T22:52:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.476+0000 7fc90f344700 1 -- 172.21.15.2:0/694865148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc90810a640 con 0x7fc9080731c0 2024-09-13T22:52:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.476+0000 7fc9067fc700 1 -- 172.21.15.2:0/694865148 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fc900004350 con 0x7fc9080731c0 2024-09-13T22:52:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.477+0000 7fc9067fc700 1 --2- 172.21.15.2:0/694865148 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc8f006c4e0 0x7fc8f006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.477+0000 7fc9067fc700 1 -- 172.21.15.2:0/694865148 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fc90008b4a0 con 0x7fc9080731c0 2024-09-13T22:52:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.477+0000 7fc90c8df700 1 --2- 172.21.15.2:0/694865148 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc8f006c4e0 0x7fc8f006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.477+0000 7fc90c8df700 1 --2- 172.21.15.2:0/694865148 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc8f006c4e0 0x7fc8f006e9a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc005f50 tx=0x7fc8fc005dc0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:35.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.481+0000 7fc9067fc700 1 -- 172.21.15.2:0/694865148 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc900059b70 con 0x7fc9080731c0 2024-09-13T22:52:35.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.679+0000 7fc90f344700 1 -- 172.21.15.2:0/694865148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc908199370 con 0x7fc9080731c0 2024-09-13T22:52:35.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.679+0000 7fc9067fc700 1 -- 172.21.15.2:0/694865148 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc900016090 con 0x7fc9080731c0 2024-09-13T22:52:35.682 INFO:teuthology.orchestra.run.smithi002.stdout:115964117013 2024-09-13T22:52:35.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.681+0000 7fc90f344700 1 -- 172.21.15.2:0/694865148 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc8f006c4e0 msgr2=0x7fc8f006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:35.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.681+0000 7fc90f344700 1 --2- 172.21.15.2:0/694865148 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc8f006c4e0 0x7fc8f006e9a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc005f50 tx=0x7fc8fc005dc0 comp rx=0 tx=0).stop 2024-09-13T22:52:35.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.681+0000 7fc90f344700 1 -- 172.21.15.2:0/694865148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9080731c0 msgr2=0x7fc90819e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:35.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.681+0000 7fc90f344700 1 --2- 172.21.15.2:0/694865148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9080731c0 0x7fc90819e850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc90000d900 tx=0x7fc90000dcc0 comp rx=0 tx=0).stop 2024-09-13T22:52:35.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.681+0000 7fc90f344700 1 -- 172.21.15.2:0/694865148 shutdown_connections 2024-09-13T22:52:35.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.682+0000 7fc90f344700 1 --2- 172.21.15.2:0/694865148 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc8f006c4e0 0x7fc8f006e9a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:35.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.682+0000 7fc90f344700 1 --2- 172.21.15.2:0/694865148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9080731c0 0x7fc90819e850 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:35.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.682+0000 7fc90f344700 1 --2- 172.21.15.2:0/694865148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc908073ae0 0x7fc90819ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:35.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.682+0000 7fc90f344700 1 -- 172.21.15.2:0/694865148 >> 172.21.15.2:0/694865148 conn(0x7fc9080fc750 msgr2=0x7fc908107780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:35.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.682+0000 7fc90f344700 1 -- 172.21.15.2:0/694865148 shutdown_connections 2024-09-13T22:52:35.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:35.682+0000 7fc90f344700 1 -- 172.21.15.2:0/694865148 wait complete. 2024-09-13T22:52:36.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:36 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/694865148' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T22:52:36.447 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:36 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/694865148' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T22:52:36.475 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117011 got 115964117013 for osd.3 2024-09-13T22:52:36.475 DEBUG:teuthology.parallel:result is None 2024-09-13T22:52:36.475 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-13T22:52:36.475 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T22:52:36.690 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:37.074 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:37 smithi002 ceph-mon[27637]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:37.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:37 smithi047 ceph-mon[34560]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:38.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.371+0000 7f410d2b2700 1 -- 172.21.15.2:0/2467636865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4108101e80 msgr2=0x7f4108102260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:38.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.371+0000 7f410d2b2700 1 --2- 172.21.15.2:0/2467636865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4108101e80 0x7f4108102260 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f40f8009910 tx=0x7f40f8009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:38.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.371+0000 7f410d2b2700 1 -- 172.21.15.2:0/2467636865 shutdown_connections 2024-09-13T22:52:38.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.371+0000 7f410d2b2700 1 --2- 172.21.15.2:0/2467636865 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41081027a0 0x7f410810ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:38.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.371+0000 7f410d2b2700 1 --2- 172.21.15.2:0/2467636865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4108101e80 0x7f4108102260 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:38.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.371+0000 7f410d2b2700 1 -- 172.21.15.2:0/2467636865 >> 172.21.15.2:0/2467636865 conn(0x7f41080fb650 msgr2=0x7f41080fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:38.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.371+0000 7f410d2b2700 1 -- 172.21.15.2:0/2467636865 shutdown_connections 2024-09-13T22:52:38.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.371+0000 7f410d2b2700 1 -- 172.21.15.2:0/2467636865 wait complete. 2024-09-13T22:52:38.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.371+0000 7f410d2b2700 1 Processor -- start 2024-09-13T22:52:38.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.372+0000 7f410d2b2700 1 -- start start 2024-09-13T22:52:38.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.372+0000 7f410d2b2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4108101e80 0x7f41080ffae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:38.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.372+0000 7f410d2b2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41081027a0 0x7f4108100020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:38.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.372+0000 7f410d2b2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4108100560 con 0x7f4108101e80 2024-09-13T22:52:38.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.372+0000 7f410d2b2700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41081006a0 con 0x7f41081027a0 2024-09-13T22:52:38.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.372+0000 7f4106ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4108101e80 0x7f41080ffae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:38.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.372+0000 7f4106ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4108101e80 0x7f41080ffae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56276/0 (socket says 172.21.15.2:56276) 2024-09-13T22:52:38.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.372+0000 7f4106ffd700 1 -- 172.21.15.2:0/278118172 learned_addr learned my addr 172.21.15.2:0/278118172 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:38.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.372+0000 7f4106ffd700 1 -- 172.21.15.2:0/278118172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41081027a0 msgr2=0x7f4108100020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:38.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.372+0000 7f41067fc700 1 --2- 172.21.15.2:0/278118172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41081027a0 0x7f4108100020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:38.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.372+0000 7f4106ffd700 1 --2- 172.21.15.2:0/278118172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41081027a0 0x7f4108100020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:38.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.372+0000 7f4106ffd700 1 -- 172.21.15.2:0/278118172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f80095f0 con 0x7f4108101e80 2024-09-13T22:52:38.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.372+0000 7f41067fc700 1 --2- 172.21.15.2:0/278118172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41081027a0 0x7f4108100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:52:38.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.372+0000 7f4106ffd700 1 --2- 172.21.15.2:0/278118172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4108101e80 0x7f41080ffae0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f40f800fa00 tx=0x7f40f800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:38.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.373+0000 7f40effff700 1 -- 172.21.15.2:0/278118172 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40f801d070 con 0x7f4108101e80 2024-09-13T22:52:38.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.373+0000 7f410d2b2700 1 -- 172.21.15.2:0/278118172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4108100920 con 0x7f4108101e80 2024-09-13T22:52:38.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.373+0000 7f40effff700 1 -- 172.21.15.2:0/278118172 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f40f8005640 con 0x7f4108101e80 2024-09-13T22:52:38.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.373+0000 7f40effff700 1 -- 172.21.15.2:0/278118172 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40f80226a0 con 0x7f4108101e80 2024-09-13T22:52:38.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.373+0000 7f410d2b2700 1 -- 172.21.15.2:0/278118172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41081a2d90 con 0x7f4108101e80 2024-09-13T22:52:38.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.374+0000 7f410d2b2700 1 -- 172.21.15.2:0/278118172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4108108330 con 0x7f4108101e80 2024-09-13T22:52:38.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.374+0000 7f40effff700 1 -- 172.21.15.2:0/278118172 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f40f8022800 con 0x7f4108101e80 2024-09-13T22:52:38.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.375+0000 7f40effff700 1 --2- 172.21.15.2:0/278118172 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f40f006c4e0 0x7f40f006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:38.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.375+0000 7f40effff700 1 -- 172.21.15.2:0/278118172 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f40f808c8f0 con 0x7f4108101e80 2024-09-13T22:52:38.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.375+0000 7f41067fc700 1 --2- 172.21.15.2:0/278118172 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f40f006c4e0 0x7f40f006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:38.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.375+0000 7f41067fc700 1 --2- 172.21.15.2:0/278118172 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f40f006c4e0 0x7f40f006e9a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f41081012d0 tx=0x7f40fc009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:38.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.379+0000 7f40effff700 1 -- 172.21.15.2:0/278118172 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f40f80574b0 con 0x7f4108101e80 2024-09-13T22:52:38.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.573+0000 7f410d2b2700 1 -- 172.21.15.2:0/278118172 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41080611d0 con 0x7f40f006c4e0 2024-09-13T22:52:38.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.574+0000 7f40effff700 1 -- 172.21.15.2:0/278118172 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27872 (secure 0 0 0) 0x7f41080611d0 con 0x7f40f006c4e0 2024-09-13T22:52:38.577 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:52:38.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.576+0000 7f410d2b2700 1 -- 172.21.15.2:0/278118172 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f40f006c4e0 msgr2=0x7f40f006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:38.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.576+0000 7f410d2b2700 1 --2- 172.21.15.2:0/278118172 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f40f006c4e0 0x7f40f006e9a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f41081012d0 tx=0x7f40fc009260 comp rx=0 tx=0).stop 2024-09-13T22:52:38.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.576+0000 7f410d2b2700 1 -- 172.21.15.2:0/278118172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4108101e80 msgr2=0x7f41080ffae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:38.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.576+0000 7f410d2b2700 1 --2- 172.21.15.2:0/278118172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4108101e80 0x7f41080ffae0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f40f800fa00 tx=0x7f40f800fae0 comp rx=0 tx=0).stop 2024-09-13T22:52:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.576+0000 7f410d2b2700 1 -- 172.21.15.2:0/278118172 shutdown_connections 2024-09-13T22:52:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.576+0000 7f410d2b2700 1 --2- 172.21.15.2:0/278118172 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f40f006c4e0 0x7f40f006e9a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.576+0000 7f410d2b2700 1 --2- 172.21.15.2:0/278118172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4108101e80 0x7f41080ffae0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.576+0000 7f410d2b2700 1 --2- 172.21.15.2:0/278118172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41081027a0 0x7f4108100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.576+0000 7f410d2b2700 1 -- 172.21.15.2:0/278118172 >> 172.21.15.2:0/278118172 conn(0x7f41080fb650 msgr2=0x7f4108105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.577+0000 7f410d2b2700 1 -- 172.21.15.2:0/278118172 shutdown_connections 2024-09-13T22:52:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:38.577+0000 7f410d2b2700 1 -- 172.21.15.2:0/278118172 wait complete. 2024-09-13T22:52:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-13T22:52:39.181 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:39 smithi047 ceph-mon[34560]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:39.353 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:39 smithi002 ceph-mon[27637]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:39.379 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-13T22:52:37.194300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2588226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002095"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":187,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T22:51:46.967225+0000","last_change":"2024-09-13T22:51:21.896303+0000","last_active":"2024-09-13T22:51:46.967225+0000","last_peered":"2024-09-13T22:51:46.967225+0000","last_clean":"2024-09-13T22:51:46.967225+0000","last_became_active":"2024-09-13T22:51:21.895851+0000","last_became_peered":"2024-09-13T22:51:21.895851+0000","last_unstale":"2024-09-13T22:51:46.967225+0000","last_undegraded":"2024-09-13T22:51:46.967225+0000","last_fullsized":"2024-09-13T22:51:46.967225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T22:50:33.888718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T22:50:33.888718+0000","last_clean_scrub_stamp":"2024-09-13T22:50:33.888718+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:46:41.391756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":4,"up_from":35,"seq":150323855378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 22:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.628},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.58599999999999997}]},{"osd":1,"last update":"Fri Sep 13 22:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri Sep 13 22:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.501},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Sep 13 22:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.372}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 22:51:58 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Sep 13 22:51:58 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Sep 13 22:51:58 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.53800000000000003}]},{"osd":4,"last update":"Fri Sep 13 22:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 22:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.442},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.46400000000000002}]},{"osd":1,"last update":"Fri Sep 13 22:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.5}]},{"osd":3,"last update":"Fri Sep 13 22:51:56 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.71699999999999997}]},{"osd":4,"last update":"Fri Sep 13 22:52:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":16.283000000000001,"5min":16.283000000000001,"15min":16.283000000000001},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 22:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.318,"15min":0.312},"min":{"1min":0.21299999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.49399999999999999,"5min":0.499,"15min":0.499},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.33500000000000002,"15min":0.33000000000000002},"min":{"1min":0.224,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.503,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.36299999999999999}]},{"osd":2,"last update":"Fri Sep 13 22:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.374},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.33600000000000002}]},{"osd":3,"last update":"Fri Sep 13 22:51:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.68300000000000005}]},{"osd":4,"last update":"Fri Sep 13 22:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 22:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34300000000000003,"15min":0.34399999999999997},"min":{"1min":0.22600000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.46999999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.378,"5min":0.371,"15min":0.37},"min":{"1min":0.26200000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.25800000000000001}]},{"osd":2,"last update":"Fri Sep 13 22:52:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38700000000000001,"15min":0.39300000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.47499999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.40699999999999997,"15min":0.41399999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.499,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.28000000000000003}]},{"osd":3,"last update":"Fri Sep 13 22:51:55 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.63100000000000001}]},{"osd":4,"last update":"Fri Sep 13 22:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T22:52:39.380 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T22:52:39.594 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:40.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:40 smithi002 ceph-mon[27637]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:52:40.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:40 smithi047 ceph-mon[34560]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:52:41.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.312+0000 7f938d9cd700 1 -- 172.21.15.2:0/2621803725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93880ffda0 msgr2=0x7f9388100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:41.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.312+0000 7f938d9cd700 1 --2- 172.21.15.2:0/2621803725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93880ffda0 0x7f9388100180 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9378009910 tx=0x7f9378009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:41.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.313+0000 7f938d9cd700 1 -- 172.21.15.2:0/2621803725 shutdown_connections 2024-09-13T22:52:41.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.313+0000 7f938d9cd700 1 --2- 172.21.15.2:0/2621803725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9388100750 0x7f93881047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:41.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.313+0000 7f938d9cd700 1 --2- 172.21.15.2:0/2621803725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93880ffda0 0x7f9388100180 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:41.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.313+0000 7f938d9cd700 1 -- 172.21.15.2:0/2621803725 >> 172.21.15.2:0/2621803725 conn(0x7f93880fb650 msgr2=0x7f93880fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:41.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.313+0000 7f938d9cd700 1 -- 172.21.15.2:0/2621803725 shutdown_connections 2024-09-13T22:52:41.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.313+0000 7f938d9cd700 1 -- 172.21.15.2:0/2621803725 wait complete. 2024-09-13T22:52:41.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.313+0000 7f938d9cd700 1 Processor -- start 2024-09-13T22:52:41.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.313+0000 7f938d9cd700 1 -- start start 2024-09-13T22:52:41.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.314+0000 7f938d9cd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93880ffda0 0x7f9388196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:41.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.314+0000 7f938d9cd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9388100750 0x7f9388196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:41.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.314+0000 7f938d9cd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9388197550 con 0x7f93880ffda0 2024-09-13T22:52:41.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.314+0000 7f938d9cd700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938819b360 con 0x7f9388100750 2024-09-13T22:52:41.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.314+0000 7f9386ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93880ffda0 0x7f9388196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:41.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.314+0000 7f9386ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93880ffda0 0x7f9388196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35874/0 (socket says 172.21.15.2:35874) 2024-09-13T22:52:41.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.314+0000 7f9386ffd700 1 -- 172.21.15.2:0/105451656 learned_addr learned my addr 172.21.15.2:0/105451656 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:41.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.314+0000 7f93867fc700 1 --2- 172.21.15.2:0/105451656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9388100750 0x7f9388196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:41.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.314+0000 7f9386ffd700 1 -- 172.21.15.2:0/105451656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9388100750 msgr2=0x7f9388196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:41.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.314+0000 7f9386ffd700 1 --2- 172.21.15.2:0/105451656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9388100750 0x7f9388196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:41.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.314+0000 7f9386ffd700 1 -- 172.21.15.2:0/105451656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93780095f0 con 0x7f93880ffda0 2024-09-13T22:52:41.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.314+0000 7f93867fc700 1 --2- 172.21.15.2:0/105451656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9388100750 0x7f9388196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:52:41.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.314+0000 7f9386ffd700 1 --2- 172.21.15.2:0/105451656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93880ffda0 0x7f9388196980 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9378006010 tx=0x7f937800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:41.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.314+0000 7f938c9cb700 1 -- 172.21.15.2:0/105451656 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f937801d070 con 0x7f93880ffda0 2024-09-13T22:52:41.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.314+0000 7f938c9cb700 1 -- 172.21.15.2:0/105451656 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f937800f460 con 0x7f93880ffda0 2024-09-13T22:52:41.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.314+0000 7f938d9cd700 1 -- 172.21.15.2:0/105451656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938819b5e0 con 0x7f93880ffda0 2024-09-13T22:52:41.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.314+0000 7f938c9cb700 1 -- 172.21.15.2:0/105451656 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9378021640 con 0x7f93880ffda0 2024-09-13T22:52:41.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.314+0000 7f938d9cd700 1 -- 172.21.15.2:0/105451656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938819bad0 con 0x7f93880ffda0 2024-09-13T22:52:41.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.315+0000 7f938d9cd700 1 -- 172.21.15.2:0/105451656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938804f2e0 con 0x7f93880ffda0 2024-09-13T22:52:41.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.316+0000 7f938c9cb700 1 -- 172.21.15.2:0/105451656 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f937800faf0 con 0x7f93880ffda0 2024-09-13T22:52:41.319 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:41 smithi002 ceph-mon[27637]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:41.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.316+0000 7f938c9cb700 1 --2- 172.21.15.2:0/105451656 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f937406c4e0 0x7f937406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:41.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.316+0000 7f938c9cb700 1 -- 172.21.15.2:0/105451656 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f937808c7d0 con 0x7f93880ffda0 2024-09-13T22:52:41.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.316+0000 7f93867fc700 1 --2- 172.21.15.2:0/105451656 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f937406c4e0 0x7f937406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:41.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.317+0000 7f93867fc700 1 --2- 172.21.15.2:0/105451656 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f937406c4e0 0x7f937406e9a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9388197fa0 tx=0x7f9370008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:41.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.321+0000 7f938c9cb700 1 -- 172.21.15.2:0/105451656 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f937805ae20 con 0x7f93880ffda0 2024-09-13T22:52:41.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:41 smithi047 ceph-mon[34560]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.515+0000 7f938d9cd700 1 -- 172.21.15.2:0/105451656 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f938819bcf0 con 0x7f937406c4e0 2024-09-13T22:52:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.516+0000 7f938c9cb700 1 -- 172.21.15.2:0/105451656 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27860 (secure 0 0 0) 0x7f938819bcf0 con 0x7f937406c4e0 2024-09-13T22:52:41.517 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:52:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.518+0000 7f938d9cd700 1 -- 172.21.15.2:0/105451656 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f937406c4e0 msgr2=0x7f937406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.518+0000 7f938d9cd700 1 --2- 172.21.15.2:0/105451656 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f937406c4e0 0x7f937406e9a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9388197fa0 tx=0x7f9370008040 comp rx=0 tx=0).stop 2024-09-13T22:52:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.518+0000 7f938d9cd700 1 -- 172.21.15.2:0/105451656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93880ffda0 msgr2=0x7f9388196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.518+0000 7f938d9cd700 1 --2- 172.21.15.2:0/105451656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93880ffda0 0x7f9388196980 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9378006010 tx=0x7f937800be20 comp rx=0 tx=0).stop 2024-09-13T22:52:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.518+0000 7f938d9cd700 1 -- 172.21.15.2:0/105451656 shutdown_connections 2024-09-13T22:52:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.518+0000 7f938d9cd700 1 --2- 172.21.15.2:0/105451656 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f937406c4e0 0x7f937406e9a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.518+0000 7f938d9cd700 1 --2- 172.21.15.2:0/105451656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93880ffda0 0x7f9388196980 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.518+0000 7f938d9cd700 1 --2- 172.21.15.2:0/105451656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9388100750 0x7f9388196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.518+0000 7f938d9cd700 1 -- 172.21.15.2:0/105451656 >> 172.21.15.2:0/105451656 conn(0x7f93880fb650 msgr2=0x7f9388104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.519+0000 7f938d9cd700 1 -- 172.21.15.2:0/105451656 shutdown_connections 2024-09-13T22:52:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:41.519+0000 7f938d9cd700 1 -- 172.21.15.2:0/105451656 wait complete. 2024-09-13T22:52:41.521 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-13T22:52:42.176 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-09-13T22:52:41.195264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2588226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002271"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":187,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T22:51:46.967225+0000","last_change":"2024-09-13T22:51:21.896303+0000","last_active":"2024-09-13T22:51:46.967225+0000","last_peered":"2024-09-13T22:51:46.967225+0000","last_clean":"2024-09-13T22:51:46.967225+0000","last_became_active":"2024-09-13T22:51:21.895851+0000","last_became_peered":"2024-09-13T22:51:21.895851+0000","last_unstale":"2024-09-13T22:51:46.967225+0000","last_undegraded":"2024-09-13T22:51:46.967225+0000","last_fullsized":"2024-09-13T22:51:46.967225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T22:50:33.888718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T22:50:33.888718+0000","last_clean_scrub_stamp":"2024-09-13T22:50:33.888718+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:46:41.391756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]}]},{"osd":4,"up_from":35,"seq":150323855378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 22:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.628},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.58599999999999997}]},{"osd":1,"last update":"Fri Sep 13 22:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.56799999999999995}]},{"osd":2,"last update":"Fri Sep 13 22:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.501},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Sep 13 22:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.372}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 22:51:58 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Sep 13 22:51:58 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Sep 13 22:51:58 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.53800000000000003}]},{"osd":4,"last update":"Fri Sep 13 22:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 22:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.38800000000000001}]},{"osd":1,"last update":"Fri Sep 13 22:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.373}]},{"osd":3,"last update":"Fri Sep 13 22:51:56 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.62},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.60999999999999999}]},{"osd":4,"last update":"Fri Sep 13 22:52:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":16.283000000000001,"5min":16.283000000000001,"15min":16.283000000000001},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 22:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.318,"15min":0.312},"min":{"1min":0.21299999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.49399999999999999,"5min":0.499,"15min":0.499},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.33500000000000002,"15min":0.33000000000000002},"min":{"1min":0.224,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.503,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.36299999999999999}]},{"osd":2,"last update":"Fri Sep 13 22:51:35 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"last":0.374},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.33600000000000002}]},{"osd":3,"last update":"Fri Sep 13 22:51:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.68300000000000005}]},{"osd":4,"last update":"Fri Sep 13 22:52:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 22:52:08 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34300000000000003,"15min":0.34399999999999997},"min":{"1min":0.22600000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.46999999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.308},{"interface":"front","average":{"1min":0.378,"5min":0.371,"15min":0.37},"min":{"1min":0.26200000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.27700000000000002}]},{"osd":2,"last update":"Fri Sep 13 22:52:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38700000000000001,"15min":0.39300000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.47499999999999998,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.40699999999999997,"15min":0.41399999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.499,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.34699999999999998}]},{"osd":3,"last update":"Fri Sep 13 22:51:55 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.55200000000000005}]},{"osd":4,"last update":"Fri Sep 13 22:52:23 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.502},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T22:52:42.177 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-13T22:52:42.177 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T22:52:42.177 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-13T22:52:42.177 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-13T22:52:42.387 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:43.071 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:43 smithi002 ceph-mon[27637]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:43.071 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:43 smithi002 ceph-mon[27637]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:52:43.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:43 smithi047 ceph-mon[34560]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:43.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:43 smithi047 ceph-mon[34560]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T22:52:44.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.089+0000 7f1c1fd2a700 1 -- 172.21.15.2:0/3523184788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18100750 msgr2=0x7f1c181047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.089+0000 7f1c1fd2a700 1 --2- 172.21.15.2:0/3523184788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18100750 0x7f1c181047a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009910 tx=0x7f1c0c009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.089+0000 7f1c1fd2a700 1 -- 172.21.15.2:0/3523184788 shutdown_connections 2024-09-13T22:52:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.089+0000 7f1c1fd2a700 1 --2- 172.21.15.2:0/3523184788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18100750 0x7f1c181047a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.089+0000 7f1c1fd2a700 1 --2- 172.21.15.2:0/3523184788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c180ffda0 0x7f1c18100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.089+0000 7f1c1fd2a700 1 -- 172.21.15.2:0/3523184788 >> 172.21.15.2:0/3523184788 conn(0x7f1c180fb650 msgr2=0x7f1c180fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.089+0000 7f1c1fd2a700 1 -- 172.21.15.2:0/3523184788 shutdown_connections 2024-09-13T22:52:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.090+0000 7f1c1fd2a700 1 -- 172.21.15.2:0/3523184788 wait complete. 2024-09-13T22:52:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.090+0000 7f1c1fd2a700 1 Processor -- start 2024-09-13T22:52:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.090+0000 7f1c1fd2a700 1 -- start start 2024-09-13T22:52:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.090+0000 7f1c1fd2a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c180ffda0 0x7f1c181955f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.090+0000 7f1c1fd2a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18100750 0x7f1c18195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.090+0000 7f1c1fd2a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c18196070 con 0x7f1c18100750 2024-09-13T22:52:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.090+0000 7f1c1fd2a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c181961e0 con 0x7f1c180ffda0 2024-09-13T22:52:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.091+0000 7f1c1d2c5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18100750 0x7f1c18195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.091+0000 7f1c1d2c5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18100750 0x7f1c18195b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35884/0 (socket says 172.21.15.2:35884) 2024-09-13T22:52:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.091+0000 7f1c1dac6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c180ffda0 0x7f1c181955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.091+0000 7f1c1d2c5700 1 -- 172.21.15.2:0/3436280031 learned_addr learned my addr 172.21.15.2:0/3436280031 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.091+0000 7f1c1d2c5700 1 -- 172.21.15.2:0/3436280031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c180ffda0 msgr2=0x7f1c181955f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.091+0000 7f1c1d2c5700 1 --2- 172.21.15.2:0/3436280031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c180ffda0 0x7f1c181955f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:44.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.091+0000 7f1c1d2c5700 1 -- 172.21.15.2:0/3436280031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c0095f0 con 0x7f1c18100750 2024-09-13T22:52:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.091+0000 7f1c1d2c5700 1 --2- 172.21.15.2:0/3436280031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18100750 0x7f1c18195b30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c005f50 tx=0x7f1c0c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.091+0000 7f1c16ffd700 1 -- 172.21.15.2:0/3436280031 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c0c01d070 con 0x7f1c18100750 2024-09-13T22:52:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.091+0000 7f1c16ffd700 1 -- 172.21.15.2:0/3436280031 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1c0c00f460 con 0x7f1c18100750 2024-09-13T22:52:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.091+0000 7f1c1fd2a700 1 -- 172.21.15.2:0/3436280031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c18196460 con 0x7f1c18100750 2024-09-13T22:52:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.091+0000 7f1c16ffd700 1 -- 172.21.15.2:0/3436280031 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c0c017630 con 0x7f1c18100750 2024-09-13T22:52:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.091+0000 7f1c1fd2a700 1 -- 172.21.15.2:0/3436280031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c181a2ee0 con 0x7f1c18100750 2024-09-13T22:52:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.092+0000 7f1c1fd2a700 1 -- 172.21.15.2:0/3436280031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c181080f0 con 0x7f1c18100750 2024-09-13T22:52:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.093+0000 7f1c16ffd700 1 -- 172.21.15.2:0/3436280031 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f1c0c00f5d0 con 0x7f1c18100750 2024-09-13T22:52:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.093+0000 7f1c16ffd700 1 --2- 172.21.15.2:0/3436280031 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1c0006c4e0 0x7f1c0006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.093+0000 7f1c1dac6700 1 --2- 172.21.15.2:0/3436280031 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1c0006c4e0 0x7f1c0006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.094+0000 7f1c16ffd700 1 -- 172.21.15.2:0/3436280031 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f1c0c08c780 con 0x7f1c18100750 2024-09-13T22:52:44.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.094+0000 7f1c1dac6700 1 --2- 172.21.15.2:0/3436280031 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1c0006c4e0 0x7f1c0006e9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800a400 tx=0x7f1c0800d040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.098+0000 7f1c16ffd700 1 -- 172.21.15.2:0/3436280031 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1c0c05ae50 con 0x7f1c18100750 2024-09-13T22:52:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.343+0000 7f1c1fd2a700 1 -- 172.21.15.2:0/3436280031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1c18196460 con 0x7f1c18100750 2024-09-13T22:52:44.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.343+0000 7f1c16ffd700 1 -- 172.21.15.2:0/3436280031 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1c18196460 con 0x7f1c18100750 2024-09-13T22:52:44.345 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:52:44.345 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T22:52:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.346+0000 7f1c1fd2a700 1 -- 172.21.15.2:0/3436280031 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1c0006c4e0 msgr2=0x7f1c0006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.346+0000 7f1c1fd2a700 1 --2- 172.21.15.2:0/3436280031 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1c0006c4e0 0x7f1c0006e9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800a400 tx=0x7f1c0800d040 comp rx=0 tx=0).stop 2024-09-13T22:52:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.346+0000 7f1c1fd2a700 1 -- 172.21.15.2:0/3436280031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18100750 msgr2=0x7f1c18195b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.346+0000 7f1c1fd2a700 1 --2- 172.21.15.2:0/3436280031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18100750 0x7f1c18195b30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c005f50 tx=0x7f1c0c00bd70 comp rx=0 tx=0).stop 2024-09-13T22:52:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.346+0000 7f1c1fd2a700 1 -- 172.21.15.2:0/3436280031 shutdown_connections 2024-09-13T22:52:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.346+0000 7f1c1fd2a700 1 --2- 172.21.15.2:0/3436280031 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1c0006c4e0 0x7f1c0006e9a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.346+0000 7f1c1fd2a700 1 --2- 172.21.15.2:0/3436280031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c180ffda0 0x7f1c181955f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.346+0000 7f1c1fd2a700 1 --2- 172.21.15.2:0/3436280031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c18100750 0x7f1c18195b30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.346+0000 7f1c1fd2a700 1 -- 172.21.15.2:0/3436280031 >> 172.21.15.2:0/3436280031 conn(0x7f1c180fb650 msgr2=0x7f1c180fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.346+0000 7f1c1fd2a700 1 -- 172.21.15.2:0/3436280031 shutdown_connections 2024-09-13T22:52:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:44.346+0000 7f1c1fd2a700 1 -- 172.21.15.2:0/3436280031 wait complete. 2024-09-13T22:52:45.043 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-13T22:52:45.044 INFO:tasks.cephadm:Setup complete, yielding 2024-09-13T22:52:45.044 INFO:teuthology.run_tasks:Running task print... 2024-09-13T22:52:45.056 INFO:teuthology.task.print:**** done end installing v18.2.1 cephadm ... 2024-09-13T22:52:45.056 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T22:52:45.072 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-13T22:52:45.072 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-13T22:52:45.279 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:45.401 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:45 smithi002 ceph-mon[27637]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:45.401 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:45 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/3436280031' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T22:52:45.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:45 smithi047 ceph-mon[34560]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:45.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:45 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/3436280031' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T22:52:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.960+0000 7f15895ab700 1 -- 172.21.15.2:0/2724150660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1584101eb0 msgr2=0x7f1584102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.960+0000 7f15895ab700 1 --2- 172.21.15.2:0/2724150660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1584101eb0 0x7f1584102310 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1578009910 tx=0x7f1578009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.960+0000 7f15895ab700 1 -- 172.21.15.2:0/2724150660 shutdown_connections 2024-09-13T22:52:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.960+0000 7f15895ab700 1 --2- 172.21.15.2:0/2724150660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1584101eb0 0x7f1584102310 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.960+0000 7f15895ab700 1 --2- 172.21.15.2:0/2724150660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1584100cb0 0x7f15841010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.960+0000 7f15895ab700 1 -- 172.21.15.2:0/2724150660 >> 172.21.15.2:0/2724150660 conn(0x7f15840fc230 msgr2=0x7f15840fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.960+0000 7f15895ab700 1 -- 172.21.15.2:0/2724150660 shutdown_connections 2024-09-13T22:52:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.960+0000 7f15895ab700 1 -- 172.21.15.2:0/2724150660 wait complete. 2024-09-13T22:52:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.961+0000 7f15895ab700 1 Processor -- start 2024-09-13T22:52:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.961+0000 7f15895ab700 1 -- start start 2024-09-13T22:52:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.961+0000 7f15895ab700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1584100cb0 0x7f1584074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.961+0000 7f15895ab700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1584101eb0 0x7f1584073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.961+0000 7f15895ab700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15840736c0 con 0x7f1584101eb0 2024-09-13T22:52:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.961+0000 7f15895ab700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1584073800 con 0x7f1584100cb0 2024-09-13T22:52:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.961+0000 7f15827fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1584101eb0 0x7f1584073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.961+0000 7f15827fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1584101eb0 0x7f1584073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35900/0 (socket says 172.21.15.2:35900) 2024-09-13T22:52:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.961+0000 7f15827fc700 1 -- 172.21.15.2:0/3963082020 learned_addr learned my addr 172.21.15.2:0/3963082020 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.962+0000 7f1582ffd700 1 --2- 172.21.15.2:0/3963082020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1584100cb0 0x7f1584074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.962+0000 7f15827fc700 1 -- 172.21.15.2:0/3963082020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1584100cb0 msgr2=0x7f1584074b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.962+0000 7f15827fc700 1 --2- 172.21.15.2:0/3963082020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1584100cb0 0x7f1584074b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.962+0000 7f15827fc700 1 -- 172.21.15.2:0/3963082020 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15780095f0 con 0x7f1584101eb0 2024-09-13T22:52:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.962+0000 7f15827fc700 1 --2- 172.21.15.2:0/3963082020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1584101eb0 0x7f1584073180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1578006010 tx=0x7f157800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.962+0000 7f156bfff700 1 -- 172.21.15.2:0/3963082020 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f157801d070 con 0x7f1584101eb0 2024-09-13T22:52:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.962+0000 7f15895ab700 1 -- 172.21.15.2:0/3963082020 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1584073a80 con 0x7f1584101eb0 2024-09-13T22:52:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.962+0000 7f156bfff700 1 -- 172.21.15.2:0/3963082020 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f157800f460 con 0x7f1584101eb0 2024-09-13T22:52:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.962+0000 7f156bfff700 1 -- 172.21.15.2:0/3963082020 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1578021640 con 0x7f1584101eb0 2024-09-13T22:52:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.962+0000 7f15895ab700 1 -- 172.21.15.2:0/3963082020 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1584073f70 con 0x7f1584101eb0 2024-09-13T22:52:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.963+0000 7f15895ab700 1 -- 172.21.15.2:0/3963082020 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15841098b0 con 0x7f1584101eb0 2024-09-13T22:52:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.964+0000 7f156bfff700 1 -- 172.21.15.2:0/3963082020 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f157800fab0 con 0x7f1584101eb0 2024-09-13T22:52:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.964+0000 7f156bfff700 1 --2- 172.21.15.2:0/3963082020 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f156c06c4e0 0x7f156c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.965+0000 7f156bfff700 1 -- 172.21.15.2:0/3963082020 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f157808c810 con 0x7f1584101eb0 2024-09-13T22:52:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.965+0000 7f1582ffd700 1 --2- 172.21.15.2:0/3963082020 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f156c06c4e0 0x7f156c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.965+0000 7f1582ffd700 1 --2- 172.21.15.2:0/3963082020 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f156c06c4e0 0x7f156c06e9a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1584101d10 tx=0x7f1574009190 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:46.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:46.969+0000 7f156bfff700 1 -- 172.21.15.2:0/3963082020 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f157805ae60 con 0x7f1584101eb0 2024-09-13T22:52:47.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:47.169+0000 7f15895ab700 1 -- 172.21.15.2:0/3963082020 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f158419eca0 con 0x7f1584101eb0 2024-09-13T22:52:47.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:47.173+0000 7f156bfff700 1 -- 172.21.15.2:0/3963082020 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f157805a9f0 con 0x7f1584101eb0 2024-09-13T22:52:47.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:47.175+0000 7f15895ab700 1 -- 172.21.15.2:0/3963082020 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f156c06c4e0 msgr2=0x7f156c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:47.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:47.175+0000 7f15895ab700 1 --2- 172.21.15.2:0/3963082020 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f156c06c4e0 0x7f156c06e9a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1584101d10 tx=0x7f1574009190 comp rx=0 tx=0).stop 2024-09-13T22:52:47.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:47.175+0000 7f15895ab700 1 -- 172.21.15.2:0/3963082020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1584101eb0 msgr2=0x7f1584073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:47.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:47.175+0000 7f15895ab700 1 --2- 172.21.15.2:0/3963082020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1584101eb0 0x7f1584073180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1578006010 tx=0x7f157800bd70 comp rx=0 tx=0).stop 2024-09-13T22:52:47.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:47.175+0000 7f15895ab700 1 -- 172.21.15.2:0/3963082020 shutdown_connections 2024-09-13T22:52:47.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:47.175+0000 7f15895ab700 1 --2- 172.21.15.2:0/3963082020 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f156c06c4e0 0x7f156c06e9a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:47.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:47.175+0000 7f15895ab700 1 --2- 172.21.15.2:0/3963082020 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1584100cb0 0x7f1584074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:47.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:47.175+0000 7f15895ab700 1 --2- 172.21.15.2:0/3963082020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1584101eb0 0x7f1584073180 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:47.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:47.175+0000 7f15895ab700 1 -- 172.21.15.2:0/3963082020 >> 172.21.15.2:0/3963082020 conn(0x7f15840fc230 msgr2=0x7f15841050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:47.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:47.176+0000 7f15895ab700 1 -- 172.21.15.2:0/3963082020 shutdown_connections 2024-09-13T22:52:47.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:47.176+0000 7f15895ab700 1 -- 172.21.15.2:0/3963082020 wait complete. 2024-09-13T22:52:47.220 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:47 smithi002 ceph-mon[27637]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:47.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:47 smithi047 ceph-mon[34560]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:47.859 INFO:teuthology.run_tasks:Running task print... 2024-09-13T22:52:47.869 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-13T22:52:47.869 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T22:52:47.877 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-13T22:52:47.877 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-13T22:52:48.082 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:48.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:48 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/3963082020' entity='client.admin' 2024-09-13T22:52:48.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:48 smithi002 ceph-mon[27637]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:48.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:48 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:52:48.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:48 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:52:48.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:48 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:52:48.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:48 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:52:48.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:48 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:52:48.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:48 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/3963082020' entity='client.admin' 2024-09-13T22:52:48.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:48 smithi047 ceph-mon[34560]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:48.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:48 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:52:48.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:48 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:52:48.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:48 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:52:48.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:48 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:52:48.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:48 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:52:49.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.781+0000 7f5a0518a700 1 -- 172.21.15.2:0/3519675441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a00101eb0 msgr2=0x7f5a00102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:49.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.781+0000 7f5a0518a700 1 --2- 172.21.15.2:0/3519675441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a00101eb0 0x7f5a00102310 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f59f4009910 tx=0x7f59f4009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:49.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.781+0000 7f5a0518a700 1 -- 172.21.15.2:0/3519675441 shutdown_connections 2024-09-13T22:52:49.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.781+0000 7f5a0518a700 1 --2- 172.21.15.2:0/3519675441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a00101eb0 0x7f5a00102310 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:49.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.781+0000 7f5a0518a700 1 --2- 172.21.15.2:0/3519675441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a00100cb0 0x7f5a001010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:49.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.781+0000 7f5a0518a700 1 -- 172.21.15.2:0/3519675441 >> 172.21.15.2:0/3519675441 conn(0x7f5a000fc230 msgr2=0x7f5a000fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:49.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.781+0000 7f5a0518a700 1 -- 172.21.15.2:0/3519675441 shutdown_connections 2024-09-13T22:52:49.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.781+0000 7f5a0518a700 1 -- 172.21.15.2:0/3519675441 wait complete. 2024-09-13T22:52:49.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.782+0000 7f5a0518a700 1 Processor -- start 2024-09-13T22:52:49.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.782+0000 7f5a0518a700 1 -- start start 2024-09-13T22:52:49.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.783+0000 7f5a0518a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a00100cb0 0x7f5a001964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:49.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.783+0000 7f5a0518a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a00101eb0 0x7f5a001969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:49.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.783+0000 7f5a0518a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a00197010 con 0x7f5a00101eb0 2024-09-13T22:52:49.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.783+0000 7f5a0518a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a00197150 con 0x7f5a00100cb0 2024-09-13T22:52:49.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.783+0000 7f59fe59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a00101eb0 0x7f5a001969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:49.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.783+0000 7f59fe59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a00101eb0 0x7f5a001969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35920/0 (socket says 172.21.15.2:35920) 2024-09-13T22:52:49.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.783+0000 7f59fe59c700 1 -- 172.21.15.2:0/1136159531 learned_addr learned my addr 172.21.15.2:0/1136159531 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:49.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.783+0000 7f59fed9d700 1 --2- 172.21.15.2:0/1136159531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a00100cb0 0x7f5a001964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:49.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.783+0000 7f59fe59c700 1 -- 172.21.15.2:0/1136159531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a00100cb0 msgr2=0x7f5a001964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:49.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.783+0000 7f59fe59c700 1 --2- 172.21.15.2:0/1136159531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a00100cb0 0x7f5a001964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:49.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.783+0000 7f59fe59c700 1 -- 172.21.15.2:0/1136159531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f40095f0 con 0x7f5a00101eb0 2024-09-13T22:52:49.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.783+0000 7f59fe59c700 1 --2- 172.21.15.2:0/1136159531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a00101eb0 0x7f5a001969f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f59f4006010 tx=0x7f59f400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:49.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.783+0000 7f59e7fff700 1 -- 172.21.15.2:0/1136159531 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59f401d070 con 0x7f5a00101eb0 2024-09-13T22:52:49.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.784+0000 7f59e7fff700 1 -- 172.21.15.2:0/1136159531 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f59f400f460 con 0x7f5a00101eb0 2024-09-13T22:52:49.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.784+0000 7f5a0518a700 1 -- 172.21.15.2:0/1136159531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0019bba0 con 0x7f5a00101eb0 2024-09-13T22:52:49.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.784+0000 7f59e7fff700 1 -- 172.21.15.2:0/1136159531 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59f4021640 con 0x7f5a00101eb0 2024-09-13T22:52:49.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.784+0000 7f5a0518a700 1 -- 172.21.15.2:0/1136159531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0019c090 con 0x7f5a00101eb0 2024-09-13T22:52:49.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.785+0000 7f5a0518a700 1 -- 172.21.15.2:0/1136159531 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a00109810 con 0x7f5a00101eb0 2024-09-13T22:52:49.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.785+0000 7f59e7fff700 1 -- 172.21.15.2:0/1136159531 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f59f400fab0 con 0x7f5a00101eb0 2024-09-13T22:52:49.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.786+0000 7f59e7fff700 1 --2- 172.21.15.2:0/1136159531 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f59e806c4e0 0x7f59e806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:49.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.786+0000 7f59e7fff700 1 -- 172.21.15.2:0/1136159531 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f59f408c580 con 0x7f5a00101eb0 2024-09-13T22:52:49.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.786+0000 7f59fed9d700 1 --2- 172.21.15.2:0/1136159531 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f59e806c4e0 0x7f59e806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:49.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.786+0000 7f59fed9d700 1 --2- 172.21.15.2:0/1136159531 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f59e806c4e0 0x7f59e806e9a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a00101d10 tx=0x7f59f000b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:49.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:49.790+0000 7f59e7fff700 1 -- 172.21.15.2:0/1136159531 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f59f405ac50 con 0x7f5a00101eb0 2024-09-13T22:52:50.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:50.005+0000 7f5a0518a700 1 -- 172.21.15.2:0/1136159531 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a00106800 con 0x7f59e806c4e0 2024-09-13T22:52:50.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:50.006+0000 7f59e7fff700 1 -- 172.21.15.2:0/1136159531 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f5a00106800 con 0x7f59e806c4e0 2024-09-13T22:52:50.007 INFO:teuthology.orchestra.run.smithi002.stdout:Backend: cephadm 2024-09-13T22:52:50.008 INFO:teuthology.orchestra.run.smithi002.stdout:Available: Yes 2024-09-13T22:52:50.008 INFO:teuthology.orchestra.run.smithi002.stdout:Paused: No 2024-09-13T22:52:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:50.008+0000 7f5a0518a700 1 -- 172.21.15.2:0/1136159531 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f59e806c4e0 msgr2=0x7f59e806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:50.008+0000 7f5a0518a700 1 --2- 172.21.15.2:0/1136159531 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f59e806c4e0 0x7f59e806e9a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a00101d10 tx=0x7f59f000b410 comp rx=0 tx=0).stop 2024-09-13T22:52:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:50.008+0000 7f5a0518a700 1 -- 172.21.15.2:0/1136159531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a00101eb0 msgr2=0x7f5a001969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:50.008+0000 7f5a0518a700 1 --2- 172.21.15.2:0/1136159531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a00101eb0 0x7f5a001969f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f59f4006010 tx=0x7f59f400bd70 comp rx=0 tx=0).stop 2024-09-13T22:52:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:50.009+0000 7f5a0518a700 1 -- 172.21.15.2:0/1136159531 shutdown_connections 2024-09-13T22:52:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:50.009+0000 7f5a0518a700 1 --2- 172.21.15.2:0/1136159531 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f59e806c4e0 0x7f59e806e9a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:50.009+0000 7f5a0518a700 1 --2- 172.21.15.2:0/1136159531 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5a00100cb0 0x7f5a001964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:50.009+0000 7f5a0518a700 1 --2- 172.21.15.2:0/1136159531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a00101eb0 0x7f5a001969f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:50.009+0000 7f5a0518a700 1 -- 172.21.15.2:0/1136159531 >> 172.21.15.2:0/1136159531 conn(0x7f5a000fc230 msgr2=0x7f5a001050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:50.009+0000 7f5a0518a700 1 -- 172.21.15.2:0/1136159531 shutdown_connections 2024-09-13T22:52:50.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:50.009+0000 7f5a0518a700 1 -- 172.21.15.2:0/1136159531 wait complete. 2024-09-13T22:52:50.361 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:50 smithi002 ceph-mon[27637]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:50.362 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:50 smithi002 ceph-mon[27637]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:50.653 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-13T22:52:50.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:50 smithi047 ceph-mon[34560]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:50.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:50 smithi047 ceph-mon[34560]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:50.866 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:52.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.583+0000 7fd3f34b5700 1 -- 172.21.15.2:0/4078749368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3ec1040d0 msgr2=0x7fd3ec1064c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:52.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.583+0000 7fd3f34b5700 1 --2- 172.21.15.2:0/4078749368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3ec1040d0 0x7fd3ec1064c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0009910 tx=0x7fd3e0009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:52.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.583+0000 7fd3f34b5700 1 -- 172.21.15.2:0/4078749368 shutdown_connections 2024-09-13T22:52:52.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.583+0000 7fd3f34b5700 1 --2- 172.21.15.2:0/4078749368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3ec1040d0 0x7fd3ec1064c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:52.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.583+0000 7fd3f34b5700 1 --2- 172.21.15.2:0/4078749368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3ec1017a0 0x7fd3ec103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:52.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.583+0000 7fd3f34b5700 1 -- 172.21.15.2:0/4078749368 >> 172.21.15.2:0/4078749368 conn(0x7fd3ec0fb190 msgr2=0x7fd3ec0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:52.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.583+0000 7fd3f34b5700 1 -- 172.21.15.2:0/4078749368 shutdown_connections 2024-09-13T22:52:52.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.583+0000 7fd3f34b5700 1 -- 172.21.15.2:0/4078749368 wait complete. 2024-09-13T22:52:52.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.584+0000 7fd3f34b5700 1 Processor -- start 2024-09-13T22:52:52.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.584+0000 7fd3f34b5700 1 -- start start 2024-09-13T22:52:52.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.584+0000 7fd3f34b5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3ec1017a0 0x7fd3ec196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:52.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.584+0000 7fd3f34b5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3ec1040d0 0x7fd3ec196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:52.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.584+0000 7fd3f34b5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec196fb0 con 0x7fd3ec1017a0 2024-09-13T22:52:52.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.584+0000 7fd3f34b5700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec1970f0 con 0x7fd3ec1040d0 2024-09-13T22:52:52.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.584+0000 7fd3f1251700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3ec1017a0 0x7fd3ec196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:52.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.584+0000 7fd3f1251700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3ec1017a0 0x7fd3ec196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47490/0 (socket says 172.21.15.2:47490) 2024-09-13T22:52:52.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.584+0000 7fd3f1251700 1 -- 172.21.15.2:0/2204066233 learned_addr learned my addr 172.21.15.2:0/2204066233 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:52.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.584+0000 7fd3f0a50700 1 --2- 172.21.15.2:0/2204066233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3ec1040d0 0x7fd3ec196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:52.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.585+0000 7fd3f1251700 1 -- 172.21.15.2:0/2204066233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3ec1040d0 msgr2=0x7fd3ec196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:52.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.585+0000 7fd3f1251700 1 --2- 172.21.15.2:0/2204066233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3ec1040d0 0x7fd3ec196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:52.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.585+0000 7fd3f1251700 1 -- 172.21.15.2:0/2204066233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e00095f0 con 0x7fd3ec1017a0 2024-09-13T22:52:52.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.585+0000 7fd3f1251700 1 --2- 172.21.15.2:0/2204066233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3ec1017a0 0x7fd3ec196450 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00d8d0 tx=0x7fd3dc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:52.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.585+0000 7fd3ea7fc700 1 -- 172.21.15.2:0/2204066233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3dc0098a0 con 0x7fd3ec1017a0 2024-09-13T22:52:52.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.585+0000 7fd3ea7fc700 1 -- 172.21.15.2:0/2204066233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd3dc010460 con 0x7fd3ec1017a0 2024-09-13T22:52:52.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.585+0000 7fd3f34b5700 1 -- 172.21.15.2:0/2204066233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ec19bba0 con 0x7fd3ec1017a0 2024-09-13T22:52:52.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.585+0000 7fd3ea7fc700 1 -- 172.21.15.2:0/2204066233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3dc00f5f0 con 0x7fd3ec1017a0 2024-09-13T22:52:52.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.585+0000 7fd3f34b5700 1 -- 172.21.15.2:0/2204066233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ec19c0f0 con 0x7fd3ec1017a0 2024-09-13T22:52:52.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.586+0000 7fd3f34b5700 1 -- 172.21.15.2:0/2204066233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ec190610 con 0x7fd3ec1017a0 2024-09-13T22:52:52.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.587+0000 7fd3ea7fc700 1 -- 172.21.15.2:0/2204066233 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fd3dc009a00 con 0x7fd3ec1017a0 2024-09-13T22:52:52.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.587+0000 7fd3ea7fc700 1 --2- 172.21.15.2:0/2204066233 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd3d406c4e0 0x7fd3d406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:52.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.587+0000 7fd3ea7fc700 1 -- 172.21.15.2:0/2204066233 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fd3dc08b2f0 con 0x7fd3ec1017a0 2024-09-13T22:52:52.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.587+0000 7fd3f0a50700 1 --2- 172.21.15.2:0/2204066233 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd3d406c4e0 0x7fd3d406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:52.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.587+0000 7fd3f0a50700 1 --2- 172.21.15.2:0/2204066233 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd3d406c4e0 0x7fd3d406e9a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0006010 tx=0x7fd3e000b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:52.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.592+0000 7fd3ea7fc700 1 -- 172.21.15.2:0/2204066233 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd3dc059940 con 0x7fd3ec1017a0 2024-09-13T22:52:52.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.802+0000 7fd3f34b5700 1 -- 172.21.15.2:0/2204066233 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3ec0611d0 con 0x7fd3d406c4e0 2024-09-13T22:52:52.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.811+0000 7fd3ea7fc700 1 -- 172.21.15.2:0/2204066233 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2820 (secure 0 0 0) 0x7fd3ec0611d0 con 0x7fd3d406c4e0 2024-09-13T22:52:52.812 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:52:52.812 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (3m) 2m ago 5m 25.7M - 0.25.0 c8568f914cd2 76a1576b4f53 2024-09-13T22:52:52.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (5m) 2m ago 5m 7017k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T22:52:52.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (4m) 67s ago 4m 6971k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T22:52:52.812 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (5m) 2m ago 5m 6665k - 18.2.1 5be31c24972a de910e0c5157 2024-09-13T22:52:52.812 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (4m) 67s ago 4m 6651k - 18.2.1 5be31c24972a 9f4bcfa66588 2024-09-13T22:52:52.812 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (3m) 2m ago 4m 79.7M - 9.4.7 954c08fa6188 39f4cfdc98d7 2024-09-13T22:52:52.812 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:9283,8765,8443 running (6m) 2m ago 6m 480M - 18.2.1 5be31c24972a 04da5b94f858 2024-09-13T22:52:52.812 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (4m) 67s ago 4m 440M - 18.2.1 5be31c24972a 53861b0f547e 2024-09-13T22:52:52.813 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (6m) 2m ago 6m 42.8M 2048M 18.2.1 5be31c24972a de11be74385d 2024-09-13T22:52:52.813 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (4m) 67s ago 4m 39.7M 2048M 18.2.1 5be31c24972a 5642284a23bf 2024-09-13T22:52:52.813 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (5m) 2m ago 5m 16.2M - 1.5.0 0da6a335fe13 427e04f7ded9 2024-09-13T22:52:52.813 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (4m) 67s ago 4m 16.4M - 1.5.0 0da6a335fe13 07935c82b1d6 2024-09-13T22:52:52.813 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (3m) 2m ago 3m 41.1M 3948M 18.2.1 5be31c24972a 1e1f6936c402 2024-09-13T22:52:52.813 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (2m) 2m ago 2m 40.6M 3948M 18.2.1 5be31c24972a f0ac78c34831 2024-09-13T22:52:52.813 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (2m) 2m ago 2m 42.1M 3948M 18.2.1 5be31c24972a 9a2f4f6decfb 2024-09-13T22:52:52.813 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (2m) 67s ago 2m 41.9M 4972M 18.2.1 5be31c24972a fb455cc4c571 2024-09-13T22:52:52.813 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (98s) 67s ago 97s 39.3M 4972M 18.2.1 5be31c24972a f1bdc2c50535 2024-09-13T22:52:52.813 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (72s) 67s ago 72s 13.8M 4972M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T22:52:52.813 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (3m) 2m ago 4m 38.1M - 2.43.0 a07b618ecd1d f0199b20cefc 2024-09-13T22:52:52.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.813+0000 7fd3f34b5700 1 -- 172.21.15.2:0/2204066233 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd3d406c4e0 msgr2=0x7fd3d406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:52.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.813+0000 7fd3f34b5700 1 --2- 172.21.15.2:0/2204066233 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd3d406c4e0 0x7fd3d406e9a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0006010 tx=0x7fd3e000b540 comp rx=0 tx=0).stop 2024-09-13T22:52:52.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.813+0000 7fd3f34b5700 1 -- 172.21.15.2:0/2204066233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3ec1017a0 msgr2=0x7fd3ec196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:52.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.813+0000 7fd3f34b5700 1 --2- 172.21.15.2:0/2204066233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3ec1017a0 0x7fd3ec196450 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00d8d0 tx=0x7fd3dc00dbe0 comp rx=0 tx=0).stop 2024-09-13T22:52:52.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.813+0000 7fd3f34b5700 1 -- 172.21.15.2:0/2204066233 shutdown_connections 2024-09-13T22:52:52.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.813+0000 7fd3f34b5700 1 --2- 172.21.15.2:0/2204066233 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd3d406c4e0 0x7fd3d406e9a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:52.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.813+0000 7fd3f34b5700 1 --2- 172.21.15.2:0/2204066233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3ec1017a0 0x7fd3ec196450 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:52.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.813+0000 7fd3f34b5700 1 --2- 172.21.15.2:0/2204066233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3ec1040d0 0x7fd3ec196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:52.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.813+0000 7fd3f34b5700 1 -- 172.21.15.2:0/2204066233 >> 172.21.15.2:0/2204066233 conn(0x7fd3ec0fb190 msgr2=0x7fd3ec0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:52.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.813+0000 7fd3f34b5700 1 -- 172.21.15.2:0/2204066233 shutdown_connections 2024-09-13T22:52:52.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:52.813+0000 7fd3f34b5700 1 -- 172.21.15.2:0/2204066233 wait complete. 2024-09-13T22:52:53.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:52 smithi002 ceph-mon[27637]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:53.365 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:52 smithi047 ceph-mon[34560]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:53.490 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-13T22:52:53.697 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:54.075 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:53 smithi002 ceph-mon[27637]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:54.297 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:53 smithi047 ceph-mon[34560]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:55.175 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:54 smithi002 ceph-mon[27637]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:55.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:54 smithi047 ceph-mon[34560]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:55.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.431+0000 7fd919597700 1 -- 172.21.15.2:0/1625742126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd914100cb0 msgr2=0x7fd9141010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:55.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.431+0000 7fd919597700 1 --2- 172.21.15.2:0/1625742126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd914100cb0 0x7fd9141010d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd904009910 tx=0x7fd904009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:55.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.431+0000 7fd919597700 1 -- 172.21.15.2:0/1625742126 shutdown_connections 2024-09-13T22:52:55.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.431+0000 7fd919597700 1 --2- 172.21.15.2:0/1625742126 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd914101eb0 0x7fd914102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:55.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.431+0000 7fd919597700 1 --2- 172.21.15.2:0/1625742126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd914100cb0 0x7fd9141010d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:55.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.431+0000 7fd919597700 1 -- 172.21.15.2:0/1625742126 >> 172.21.15.2:0/1625742126 conn(0x7fd9140fc230 msgr2=0x7fd9140fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:55.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.431+0000 7fd919597700 1 -- 172.21.15.2:0/1625742126 shutdown_connections 2024-09-13T22:52:55.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.431+0000 7fd919597700 1 -- 172.21.15.2:0/1625742126 wait complete. 2024-09-13T22:52:55.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.432+0000 7fd919597700 1 Processor -- start 2024-09-13T22:52:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.432+0000 7fd919597700 1 -- start start 2024-09-13T22:52:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.433+0000 7fd919597700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd914100cb0 0x7fd9141964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.433+0000 7fd919597700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd914101eb0 0x7fd914196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.433+0000 7fd919597700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd914196f90 con 0x7fd914100cb0 2024-09-13T22:52:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.433+0000 7fd919597700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9141970d0 con 0x7fd914101eb0 2024-09-13T22:52:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.433+0000 7fd912ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd914100cb0 0x7fd9141964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.433+0000 7fd912ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd914100cb0 0x7fd9141964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47508/0 (socket says 172.21.15.2:47508) 2024-09-13T22:52:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.433+0000 7fd912ffd700 1 -- 172.21.15.2:0/3699616379 learned_addr learned my addr 172.21.15.2:0/3699616379 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.433+0000 7fd912ffd700 1 -- 172.21.15.2:0/3699616379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd914101eb0 msgr2=0x7fd914196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.433+0000 7fd912ffd700 1 --2- 172.21.15.2:0/3699616379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd914101eb0 0x7fd914196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.433+0000 7fd912ffd700 1 -- 172.21.15.2:0/3699616379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9040095f0 con 0x7fd914100cb0 2024-09-13T22:52:55.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.433+0000 7fd912ffd700 1 --2- 172.21.15.2:0/3699616379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd914100cb0 0x7fd9141964c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd90400bda0 tx=0x7fd90400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:55.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.433+0000 7fd8fbfff700 1 -- 172.21.15.2:0/3699616379 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd90401d070 con 0x7fd914100cb0 2024-09-13T22:52:55.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.433+0000 7fd919597700 1 -- 172.21.15.2:0/3699616379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91419bb30 con 0x7fd914100cb0 2024-09-13T22:52:55.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.433+0000 7fd8fbfff700 1 -- 172.21.15.2:0/3699616379 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd904004c50 con 0x7fd914100cb0 2024-09-13T22:52:55.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.433+0000 7fd8fbfff700 1 -- 172.21.15.2:0/3699616379 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd90400f690 con 0x7fd914100cb0 2024-09-13T22:52:55.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.434+0000 7fd919597700 1 -- 172.21.15.2:0/3699616379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91419bff0 con 0x7fd914100cb0 2024-09-13T22:52:55.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.434+0000 7fd919597700 1 -- 172.21.15.2:0/3699616379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd914109810 con 0x7fd914100cb0 2024-09-13T22:52:55.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.435+0000 7fd8fbfff700 1 -- 172.21.15.2:0/3699616379 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fd904022a20 con 0x7fd914100cb0 2024-09-13T22:52:55.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.436+0000 7fd8fbfff700 1 --2- 172.21.15.2:0/3699616379 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd8fc06c4e0 0x7fd8fc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:55.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.436+0000 7fd8fbfff700 1 -- 172.21.15.2:0/3699616379 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fd90408cae0 con 0x7fd914100cb0 2024-09-13T22:52:55.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.436+0000 7fd9127fc700 1 --2- 172.21.15.2:0/3699616379 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd8fc06c4e0 0x7fd8fc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:55.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.436+0000 7fd9127fc700 1 --2- 172.21.15.2:0/3699616379 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd8fc06c4e0 0x7fd8fc06e9a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd908005fd0 tx=0x7fd908005d00 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:55.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.440+0000 7fd8fbfff700 1 -- 172.21.15.2:0/3699616379 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd90405b300 con 0x7fd914100cb0 2024-09-13T22:52:55.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.646+0000 7fd919597700 1 -- 172.21.15.2:0/3699616379 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd914106800 con 0x7fd8fc06c4e0 2024-09-13T22:52:55.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.650+0000 7fd8fbfff700 1 -- 172.21.15.2:0/3699616379 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1280 (secure 0 0 0) 0x7fd914106800 con 0x7fd8fc06c4e0 2024-09-13T22:52:55.651 INFO:teuthology.orchestra.run.smithi002.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-13T22:52:55.651 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-13T22:52:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter 2/2 2m ago 6m * 2024-09-13T22:52:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:crash 2/2 2m ago 6m * 2024-09-13T22:52:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-13T22:52:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:mgr 2/2 2m ago 6m count:2 2024-09-13T22:52:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:mon 2/2 2m ago 5m smithi002:172.21.15.2=smithi002;smithi047:172.21.15.47=smithi047;count:2 2024-09-13T22:52:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-13T22:52:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:osd 6 2m ago - 2024-09-13T22:52:55.652 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-13T22:52:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.652+0000 7fd919597700 1 -- 172.21.15.2:0/3699616379 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd8fc06c4e0 msgr2=0x7fd8fc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.652+0000 7fd919597700 1 --2- 172.21.15.2:0/3699616379 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd8fc06c4e0 0x7fd8fc06e9a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd908005fd0 tx=0x7fd908005d00 comp rx=0 tx=0).stop 2024-09-13T22:52:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.652+0000 7fd919597700 1 -- 172.21.15.2:0/3699616379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd914100cb0 msgr2=0x7fd9141964c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.652+0000 7fd919597700 1 --2- 172.21.15.2:0/3699616379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd914100cb0 0x7fd9141964c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd90400bda0 tx=0x7fd90400be80 comp rx=0 tx=0).stop 2024-09-13T22:52:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.652+0000 7fd919597700 1 -- 172.21.15.2:0/3699616379 shutdown_connections 2024-09-13T22:52:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.652+0000 7fd919597700 1 --2- 172.21.15.2:0/3699616379 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd8fc06c4e0 0x7fd8fc06e9a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.652+0000 7fd919597700 1 --2- 172.21.15.2:0/3699616379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd914100cb0 0x7fd9141964c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.652+0000 7fd919597700 1 --2- 172.21.15.2:0/3699616379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd914101eb0 0x7fd914196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.652+0000 7fd919597700 1 -- 172.21.15.2:0/3699616379 >> 172.21.15.2:0/3699616379 conn(0x7fd9140fc230 msgr2=0x7fd9141050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.653+0000 7fd919597700 1 -- 172.21.15.2:0/3699616379 shutdown_connections 2024-09-13T22:52:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:55.653+0000 7fd919597700 1 -- 172.21.15.2:0/3699616379 wait complete. 2024-09-13T22:52:56.432 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-13T22:52:56.643 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:57.066 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:56 smithi002 ceph-mon[27637]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:57.066 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:56 smithi002 ceph-mon[27637]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:57.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:56 smithi047 ceph-mon[34560]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:57.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:56 smithi047 ceph-mon[34560]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:52:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.264+0000 7fce24d2c700 1 -- 172.21.15.2:0/13786225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce200ffc10 msgr2=0x7fce20100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:58.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.264+0000 7fce24d2c700 1 --2- 172.21.15.2:0/13786225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce200ffc10 0x7fce20100030 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce10009910 tx=0x7fce10009c20 comp rx=0 tx=0).stop 2024-09-13T22:52:58.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.264+0000 7fce24d2c700 1 -- 172.21.15.2:0/13786225 shutdown_connections 2024-09-13T22:52:58.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.264+0000 7fce24d2c700 1 --2- 172.21.15.2:0/13786225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce20100e10 0x7fce20101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:58.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.264+0000 7fce24d2c700 1 --2- 172.21.15.2:0/13786225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce200ffc10 0x7fce20100030 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:58.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.264+0000 7fce24d2c700 1 -- 172.21.15.2:0/13786225 >> 172.21.15.2:0/13786225 conn(0x7fce200fb190 msgr2=0x7fce200fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:58.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.264+0000 7fce24d2c700 1 -- 172.21.15.2:0/13786225 shutdown_connections 2024-09-13T22:52:58.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.264+0000 7fce24d2c700 1 -- 172.21.15.2:0/13786225 wait complete. 2024-09-13T22:52:58.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.265+0000 7fce24d2c700 1 Processor -- start 2024-09-13T22:52:58.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.265+0000 7fce24d2c700 1 -- start start 2024-09-13T22:52:58.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.265+0000 7fce24d2c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce200ffc10 0x7fce20195450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:58.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.265+0000 7fce24d2c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce20100e10 0x7fce20195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.265+0000 7fce24d2c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce20195fb0 con 0x7fce200ffc10 2024-09-13T22:52:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.265+0000 7fce24d2c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce201960f0 con 0x7fce20100e10 2024-09-13T22:52:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.265+0000 7fce1e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce200ffc10 0x7fce20195450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.265+0000 7fce1e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce200ffc10 0x7fce20195450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47520/0 (socket says 172.21.15.2:47520) 2024-09-13T22:52:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.265+0000 7fce1e59c700 1 -- 172.21.15.2:0/2587613887 learned_addr learned my addr 172.21.15.2:0/2587613887 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:52:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.265+0000 7fce1dd9b700 1 --2- 172.21.15.2:0/2587613887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce20100e10 0x7fce20195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.265+0000 7fce1e59c700 1 -- 172.21.15.2:0/2587613887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce20100e10 msgr2=0x7fce20195990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.265+0000 7fce1e59c700 1 --2- 172.21.15.2:0/2587613887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce20100e10 0x7fce20195990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.265+0000 7fce1e59c700 1 -- 172.21.15.2:0/2587613887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce100095f0 con 0x7fce200ffc10 2024-09-13T22:52:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.265+0000 7fce1dd9b700 1 --2- 172.21.15.2:0/2587613887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce20100e10 0x7fce20195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:52:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.266+0000 7fce1e59c700 1 --2- 172.21.15.2:0/2587613887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce200ffc10 0x7fce20195450 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fce1000bda0 tx=0x7fce1000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:58.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.266+0000 7fce0f7fe700 1 -- 172.21.15.2:0/2587613887 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce1001d070 con 0x7fce200ffc10 2024-09-13T22:52:58.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.266+0000 7fce0f7fe700 1 -- 172.21.15.2:0/2587613887 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fce10004c50 con 0x7fce200ffc10 2024-09-13T22:52:58.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.266+0000 7fce24d2c700 1 -- 172.21.15.2:0/2587613887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce2019ab40 con 0x7fce200ffc10 2024-09-13T22:52:58.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.266+0000 7fce0f7fe700 1 -- 172.21.15.2:0/2587613887 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce1000f690 con 0x7fce200ffc10 2024-09-13T22:52:58.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.266+0000 7fce24d2c700 1 -- 172.21.15.2:0/2587613887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce2019b030 con 0x7fce200ffc10 2024-09-13T22:52:58.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.267+0000 7fce24d2c700 1 -- 172.21.15.2:0/2587613887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce20108780 con 0x7fce200ffc10 2024-09-13T22:52:58.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.267+0000 7fce0f7fe700 1 -- 172.21.15.2:0/2587613887 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fce1000f810 con 0x7fce200ffc10 2024-09-13T22:52:58.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.268+0000 7fce0f7fe700 1 --2- 172.21.15.2:0/2587613887 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fce0806c4e0 0x7fce0806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:52:58.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.268+0000 7fce0f7fe700 1 -- 172.21.15.2:0/2587613887 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fce1008cb10 con 0x7fce200ffc10 2024-09-13T22:52:58.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.268+0000 7fce1dd9b700 1 --2- 172.21.15.2:0/2587613887 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fce0806c4e0 0x7fce0806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:52:58.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.268+0000 7fce1dd9b700 1 --2- 172.21.15.2:0/2587613887 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fce0806c4e0 0x7fce0806e9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fce14007900 tx=0x7fce14008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:52:58.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.273+0000 7fce0f7fe700 1 -- 172.21.15.2:0/2587613887 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fce1005b280 con 0x7fce200ffc10 2024-09-13T22:52:58.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.477+0000 7fce24d2c700 1 -- 172.21.15.2:0/2587613887 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fce20105760 con 0x7fce0806c4e0 2024-09-13T22:52:58.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.479+0000 7fce0f7fe700 1 -- 172.21.15.2:0/2587613887 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+145 (secure 0 0 0) 0x7fce20105760 con 0x7fce0806c4e0 2024-09-13T22:52:58.480 INFO:teuthology.orchestra.run.smithi002.stdout:HOST ADDR LABELS STATUS 2024-09-13T22:52:58.480 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 172.21.15.2 2024-09-13T22:52:58.480 INFO:teuthology.orchestra.run.smithi002.stdout:smithi047 172.21.15.47 2024-09-13T22:52:58.480 INFO:teuthology.orchestra.run.smithi002.stdout:2 hosts in cluster 2024-09-13T22:52:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.481+0000 7fce24d2c700 1 -- 172.21.15.2:0/2587613887 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fce0806c4e0 msgr2=0x7fce0806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.481+0000 7fce24d2c700 1 --2- 172.21.15.2:0/2587613887 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fce0806c4e0 0x7fce0806e9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fce14007900 tx=0x7fce14008040 comp rx=0 tx=0).stop 2024-09-13T22:52:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.481+0000 7fce24d2c700 1 -- 172.21.15.2:0/2587613887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce200ffc10 msgr2=0x7fce20195450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:52:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.481+0000 7fce24d2c700 1 --2- 172.21.15.2:0/2587613887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce200ffc10 0x7fce20195450 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fce1000bda0 tx=0x7fce1000be80 comp rx=0 tx=0).stop 2024-09-13T22:52:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.481+0000 7fce24d2c700 1 -- 172.21.15.2:0/2587613887 shutdown_connections 2024-09-13T22:52:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.481+0000 7fce24d2c700 1 --2- 172.21.15.2:0/2587613887 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fce0806c4e0 0x7fce0806e9a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.481+0000 7fce24d2c700 1 --2- 172.21.15.2:0/2587613887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce200ffc10 0x7fce20195450 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.481+0000 7fce24d2c700 1 --2- 172.21.15.2:0/2587613887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce20100e10 0x7fce20195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:52:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.481+0000 7fce24d2c700 1 -- 172.21.15.2:0/2587613887 >> 172.21.15.2:0/2587613887 conn(0x7fce200fb190 msgr2=0x7fce20104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:52:58.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.481+0000 7fce24d2c700 1 -- 172.21.15.2:0/2587613887 shutdown_connections 2024-09-13T22:52:58.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:52:58.481+0000 7fce24d2c700 1 -- 172.21.15.2:0/2587613887 wait complete. 2024-09-13T22:52:59.069 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:58 smithi002 ceph-mon[27637]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:52:59.091 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-13T22:52:59.298 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:52:59.334 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:58 smithi047 ceph-mon[34560]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:53:00.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:52:59 smithi002 ceph-mon[27637]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:00.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:52:59 smithi047 ceph-mon[34560]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:00.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.893+0000 7f4719fa5700 1 -- 172.21.15.2:0/1082835004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47140ffbc0 msgr2=0x7f47140fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:00.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.893+0000 7f4719fa5700 1 --2- 172.21.15.2:0/1082835004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47140ffbc0 0x7f47140fffe0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4704009910 tx=0x7f4704009c20 comp rx=0 tx=0).stop 2024-09-13T22:53:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.893+0000 7f4719fa5700 1 -- 172.21.15.2:0/1082835004 shutdown_connections 2024-09-13T22:53:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.893+0000 7f4719fa5700 1 --2- 172.21.15.2:0/1082835004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4714100dc0 0x7f4714101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.893+0000 7f4719fa5700 1 --2- 172.21.15.2:0/1082835004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47140ffbc0 0x7f47140fffe0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.893+0000 7f4719fa5700 1 -- 172.21.15.2:0/1082835004 >> 172.21.15.2:0/1082835004 conn(0x7f47140fb160 msgr2=0x7f47140fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.893+0000 7f4719fa5700 1 -- 172.21.15.2:0/1082835004 shutdown_connections 2024-09-13T22:53:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.894+0000 7f4719fa5700 1 -- 172.21.15.2:0/1082835004 wait complete. 2024-09-13T22:53:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.894+0000 7f4719fa5700 1 Processor -- start 2024-09-13T22:53:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.894+0000 7f4719fa5700 1 -- start start 2024-09-13T22:53:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.894+0000 7f4719fa5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47140ffbc0 0x7f4714069970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.894+0000 7f4719fa5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4714100dc0 0x7f471419b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.894+0000 7f4719fa5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471419bb90 con 0x7f47140ffbc0 2024-09-13T22:53:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.894+0000 7f4719fa5700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471419bcd0 con 0x7f4714100dc0 2024-09-13T22:53:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.895+0000 7f47137fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47140ffbc0 0x7f4714069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:00.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.895+0000 7f47137fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47140ffbc0 0x7f4714069970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43660/0 (socket says 172.21.15.2:43660) 2024-09-13T22:53:00.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.895+0000 7f47137fe700 1 -- 172.21.15.2:0/1538340014 learned_addr learned my addr 172.21.15.2:0/1538340014 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:53:00.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.895+0000 7f4712ffd700 1 --2- 172.21.15.2:0/1538340014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4714100dc0 0x7f471419b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:00.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.895+0000 7f47137fe700 1 -- 172.21.15.2:0/1538340014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4714100dc0 msgr2=0x7f471419b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:00.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.895+0000 7f47137fe700 1 --2- 172.21.15.2:0/1538340014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4714100dc0 0x7f471419b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:00.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.895+0000 7f47137fe700 1 -- 172.21.15.2:0/1538340014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47040095f0 con 0x7f47140ffbc0 2024-09-13T22:53:00.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.895+0000 7f47137fe700 1 --2- 172.21.15.2:0/1538340014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47140ffbc0 0x7f4714069970 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f470400bda0 tx=0x7f470400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:00.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.895+0000 7f4710ff9700 1 -- 172.21.15.2:0/1538340014 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f470401d070 con 0x7f47140ffbc0 2024-09-13T22:53:00.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.895+0000 7f4710ff9700 1 -- 172.21.15.2:0/1538340014 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4704004c50 con 0x7f47140ffbc0 2024-09-13T22:53:00.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.895+0000 7f4719fa5700 1 -- 172.21.15.2:0/1538340014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f471419bf50 con 0x7f47140ffbc0 2024-09-13T22:53:00.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.895+0000 7f4710ff9700 1 -- 172.21.15.2:0/1538340014 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f470400f690 con 0x7f47140ffbc0 2024-09-13T22:53:00.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.895+0000 7f4719fa5700 1 -- 172.21.15.2:0/1538340014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471419c410 con 0x7f47140ffbc0 2024-09-13T22:53:00.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.896+0000 7f4719fa5700 1 -- 172.21.15.2:0/1538340014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471418f5b0 con 0x7f47140ffbc0 2024-09-13T22:53:00.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.897+0000 7f4710ff9700 1 -- 172.21.15.2:0/1538340014 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f47040229b0 con 0x7f47140ffbc0 2024-09-13T22:53:00.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.897+0000 7f4710ff9700 1 --2- 172.21.15.2:0/1538340014 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f46fc06c4e0 0x7f46fc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:00.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.898+0000 7f4710ff9700 1 -- 172.21.15.2:0/1538340014 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f470408cb00 con 0x7f47140ffbc0 2024-09-13T22:53:00.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.898+0000 7f4712ffd700 1 --2- 172.21.15.2:0/1538340014 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f46fc06c4e0 0x7f46fc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:00.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.898+0000 7f4712ffd700 1 --2- 172.21.15.2:0/1538340014 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f46fc06c4e0 0x7f46fc06e9a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4708006fd0 tx=0x7f4708008040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:00.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:00.902+0000 7f4710ff9700 1 -- 172.21.15.2:0/1538340014 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f470405b270 con 0x7f47140ffbc0 2024-09-13T22:53:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:01.111+0000 7f4719fa5700 1 -- 172.21.15.2:0/1538340014 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f47140611d0 con 0x7f46fc06c4e0 2024-09-13T22:53:01.112 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:00 smithi002 ceph-mon[27637]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:53:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:01.112+0000 7f4710ff9700 1 -- 172.21.15.2:0/1538340014 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f47140611d0 con 0x7f46fc06c4e0 2024-09-13T22:53:01.113 INFO:teuthology.orchestra.run.smithi002.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-13T22:53:01.113 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300EV480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-13T22:53:01.113 INFO:teuthology.orchestra.run.smithi002.stdout:smithi047 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75130022480DGN 447G No 72s ago Has a FileSystem, LVM detected 2024-09-13T22:53:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:01.115+0000 7f4719fa5700 1 -- 172.21.15.2:0/1538340014 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f46fc06c4e0 msgr2=0x7f46fc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:01.115+0000 7f4719fa5700 1 --2- 172.21.15.2:0/1538340014 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f46fc06c4e0 0x7f46fc06e9a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4708006fd0 tx=0x7f4708008040 comp rx=0 tx=0).stop 2024-09-13T22:53:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:01.115+0000 7f4719fa5700 1 -- 172.21.15.2:0/1538340014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47140ffbc0 msgr2=0x7f4714069970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:01.115+0000 7f4719fa5700 1 --2- 172.21.15.2:0/1538340014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47140ffbc0 0x7f4714069970 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f470400bda0 tx=0x7f470400be80 comp rx=0 tx=0).stop 2024-09-13T22:53:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:01.115+0000 7f4719fa5700 1 -- 172.21.15.2:0/1538340014 shutdown_connections 2024-09-13T22:53:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:01.115+0000 7f4719fa5700 1 --2- 172.21.15.2:0/1538340014 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f46fc06c4e0 0x7f46fc06e9a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:01.115+0000 7f4719fa5700 1 --2- 172.21.15.2:0/1538340014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47140ffbc0 0x7f4714069970 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:01.115+0000 7f4719fa5700 1 --2- 172.21.15.2:0/1538340014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4714100dc0 0x7f471419b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:01.115+0000 7f4719fa5700 1 -- 172.21.15.2:0/1538340014 >> 172.21.15.2:0/1538340014 conn(0x7f47140fb160 msgr2=0x7f47141040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:01.115+0000 7f4719fa5700 1 -- 172.21.15.2:0/1538340014 shutdown_connections 2024-09-13T22:53:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:01.115+0000 7f4719fa5700 1 -- 172.21.15.2:0/1538340014 wait complete. 2024-09-13T22:53:01.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:00 smithi047 ceph-mon[34560]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:53:01.825 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T22:53:01.835 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-13T22:53:01.836 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-13T22:53:02.048 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:53:02.169 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:01 smithi002 ceph-mon[27637]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:02.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:01 smithi047 ceph-mon[34560]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:03.189 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:02 smithi002 ceph-mon[27637]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:53:03.189 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:02 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:53:03.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:02 smithi047 ceph-mon[34560]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:53:03.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:02 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:53:03.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.721+0000 7fedb222e700 1 -- 172.21.15.2:0/657596568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedac100cb0 msgr2=0x7fedac1010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:03.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.721+0000 7fedb222e700 1 --2- 172.21.15.2:0/657596568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedac100cb0 0x7fedac1010d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fed9c009910 tx=0x7fed9c009c20 comp rx=0 tx=0).stop 2024-09-13T22:53:03.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.721+0000 7fedb222e700 1 -- 172.21.15.2:0/657596568 shutdown_connections 2024-09-13T22:53:03.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.721+0000 7fedb222e700 1 --2- 172.21.15.2:0/657596568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedac101eb0 0x7fedac102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:03.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.721+0000 7fedb222e700 1 --2- 172.21.15.2:0/657596568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedac100cb0 0x7fedac1010d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:03.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.721+0000 7fedb222e700 1 -- 172.21.15.2:0/657596568 >> 172.21.15.2:0/657596568 conn(0x7fedac0fc230 msgr2=0x7fedac0fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:03.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.721+0000 7fedb222e700 1 -- 172.21.15.2:0/657596568 shutdown_connections 2024-09-13T22:53:03.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.722+0000 7fedb222e700 1 -- 172.21.15.2:0/657596568 wait complete. 2024-09-13T22:53:03.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.722+0000 7fedb222e700 1 Processor -- start 2024-09-13T22:53:03.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.722+0000 7fedb222e700 1 -- start start 2024-09-13T22:53:03.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.722+0000 7fedb222e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedac100cb0 0x7fedac1964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:03.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.722+0000 7fedb222e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedac101eb0 0x7fedac196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:03.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.722+0000 7fedb222e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac196f90 con 0x7fedac100cb0 2024-09-13T22:53:03.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.722+0000 7fedb222e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac1970d0 con 0x7fedac101eb0 2024-09-13T22:53:03.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.722+0000 7fedab7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedac100cb0 0x7fedac1964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:03.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.722+0000 7fedab7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedac100cb0 0x7fedac1964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43676/0 (socket says 172.21.15.2:43676) 2024-09-13T22:53:03.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.722+0000 7fedab7fe700 1 -- 172.21.15.2:0/1750454493 learned_addr learned my addr 172.21.15.2:0/1750454493 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:53:03.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.723+0000 7feda3fff700 1 --2- 172.21.15.2:0/1750454493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedac101eb0 0x7fedac196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:03.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.723+0000 7fedab7fe700 1 -- 172.21.15.2:0/1750454493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedac101eb0 msgr2=0x7fedac196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:03.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.723+0000 7fedab7fe700 1 --2- 172.21.15.2:0/1750454493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedac101eb0 0x7fedac196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:03.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.723+0000 7fedab7fe700 1 -- 172.21.15.2:0/1750454493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c0095f0 con 0x7fedac100cb0 2024-09-13T22:53:03.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.723+0000 7fedab7fe700 1 --2- 172.21.15.2:0/1750454493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedac100cb0 0x7fedac1964c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00bda0 tx=0x7fed9c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:03.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.723+0000 7feda97fa700 1 -- 172.21.15.2:0/1750454493 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed9c01d070 con 0x7fedac100cb0 2024-09-13T22:53:03.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.723+0000 7feda97fa700 1 -- 172.21.15.2:0/1750454493 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fed9c004c50 con 0x7fedac100cb0 2024-09-13T22:53:03.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.723+0000 7fedb222e700 1 -- 172.21.15.2:0/1750454493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedac19bb30 con 0x7fedac100cb0 2024-09-13T22:53:03.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.723+0000 7feda97fa700 1 -- 172.21.15.2:0/1750454493 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed9c00f690 con 0x7fedac100cb0 2024-09-13T22:53:03.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.723+0000 7fedb222e700 1 -- 172.21.15.2:0/1750454493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedac19bff0 con 0x7fedac100cb0 2024-09-13T22:53:03.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.724+0000 7fedb222e700 1 -- 172.21.15.2:0/1750454493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedac109810 con 0x7fedac100cb0 2024-09-13T22:53:03.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.725+0000 7feda97fa700 1 -- 172.21.15.2:0/1750454493 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fed9c022a20 con 0x7fedac100cb0 2024-09-13T22:53:03.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.725+0000 7feda97fa700 1 --2- 172.21.15.2:0/1750454493 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fed9806c4e0 0x7fed9806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:03.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.725+0000 7feda97fa700 1 -- 172.21.15.2:0/1750454493 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fed9c08ca00 con 0x7fedac100cb0 2024-09-13T22:53:03.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.725+0000 7feda3fff700 1 --2- 172.21.15.2:0/1750454493 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fed9806c4e0 0x7fed9806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:03.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.726+0000 7feda3fff700 1 --2- 172.21.15.2:0/1750454493 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fed9806c4e0 0x7fed9806e9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fed94005ea0 tx=0x7fed94005e30 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:03.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.730+0000 7feda97fa700 1 -- 172.21.15.2:0/1750454493 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fed9c05b2a0 con 0x7fedac100cb0 2024-09-13T22:53:03.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:03.956+0000 7fedb222e700 1 -- 172.21.15.2:0/1750454493 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fedac19c680 con 0x7fed9806c4e0 2024-09-13T22:53:05.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:04 smithi047 ceph-mon[34560]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:53:05.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:04 smithi047 ceph-mon[34560]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:05.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:04 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T22:53:05.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:04 smithi002 ceph-mon[27637]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:53:05.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:04 smithi002 ceph-mon[27637]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:53:05.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:04 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T22:53:05.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:05.980+0000 7feda97fa700 1 -- 172.21.15.2:0/1750454493 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fedac19c680 con 0x7fed9806c4e0 2024-09-13T22:53:05.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:05.985+0000 7fedb222e700 1 -- 172.21.15.2:0/1750454493 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fed9806c4e0 msgr2=0x7fed9806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:05.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:05.985+0000 7fedb222e700 1 --2- 172.21.15.2:0/1750454493 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fed9806c4e0 0x7fed9806e9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fed94005ea0 tx=0x7fed94005e30 comp rx=0 tx=0).stop 2024-09-13T22:53:05.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:05.985+0000 7fedb222e700 1 -- 172.21.15.2:0/1750454493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedac100cb0 msgr2=0x7fedac1964c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:05.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:05.985+0000 7fedb222e700 1 --2- 172.21.15.2:0/1750454493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedac100cb0 0x7fedac1964c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00bda0 tx=0x7fed9c00be80 comp rx=0 tx=0).stop 2024-09-13T22:53:05.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:05.985+0000 7fedb222e700 1 -- 172.21.15.2:0/1750454493 shutdown_connections 2024-09-13T22:53:05.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:05.985+0000 7fedb222e700 1 --2- 172.21.15.2:0/1750454493 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fed9806c4e0 0x7fed9806e9a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:05.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:05.985+0000 7fedb222e700 1 --2- 172.21.15.2:0/1750454493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedac100cb0 0x7fedac1964c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:05.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:05.985+0000 7fedb222e700 1 --2- 172.21.15.2:0/1750454493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedac101eb0 0x7fedac196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:05.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:05.985+0000 7fedb222e700 1 -- 172.21.15.2:0/1750454493 >> 172.21.15.2:0/1750454493 conn(0x7fedac0fc230 msgr2=0x7fedac1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:05.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:05.985+0000 7fedb222e700 1 -- 172.21.15.2:0/1750454493 shutdown_connections 2024-09-13T22:53:05.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:05.985+0000 7fedb222e700 1 -- 172.21.15.2:0/1750454493 wait complete. 2024-09-13T22:53:06.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:05 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T22:53:06.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:05 smithi002 ceph-mon[27637]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T22:53:06.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:05 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T22:53:06.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:05 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002[27633]: 2024-09-13T22:53:05.962+0000 7fc7aa68b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T22:53:06.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:05 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T22:53:06.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:05 smithi047 ceph-mon[34560]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T22:53:06.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:05 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T22:53:06.711 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T22:53:06.928 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:53:07.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:06 smithi002 ceph-mon[27637]: pgmap v174: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:53:07.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:06 smithi002 ceph-mon[27637]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T22:53:07.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:06 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T22:53:07.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:06 smithi002 ceph-mon[27637]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T22:53:07.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:06 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T22:53:07.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:06 smithi002 ceph-mon[27637]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T22:53:07.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:06 smithi002 ceph-mon[27637]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T22:53:07.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:06 smithi002 ceph-mon[27637]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T22:53:07.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:06 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T22:53:07.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:06 smithi002 ceph-mon[27637]: fsmap cephfs:0 2024-09-13T22:53:07.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:06 smithi002 ceph-mon[27637]: Saving service mds.cephfs spec with placement count:4 2024-09-13T22:53:07.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:06 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:07.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:06 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:53:07.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:06 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:53:07.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:06 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:53:07.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:06 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:07.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:06 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.auedll", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:53:07.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:06 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.auedll", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T22:53:07.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:06 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:53:07.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:06 smithi047 ceph-mon[34560]: pgmap v174: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:53:07.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:06 smithi047 ceph-mon[34560]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T22:53:07.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:06 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T22:53:07.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:06 smithi047 ceph-mon[34560]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T22:53:07.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:06 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T22:53:07.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:06 smithi047 ceph-mon[34560]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T22:53:07.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:06 smithi047 ceph-mon[34560]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T22:53:07.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:06 smithi047 ceph-mon[34560]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T22:53:07.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:06 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T22:53:07.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:06 smithi047 ceph-mon[34560]: fsmap cephfs:0 2024-09-13T22:53:07.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:06 smithi047 ceph-mon[34560]: Saving service mds.cephfs spec with placement count:4 2024-09-13T22:53:07.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:06 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:07.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:06 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:53:07.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:06 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:53:07.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:06 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:53:07.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:06 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:07.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:06 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.auedll", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:53:07.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:06 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.auedll", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T22:53:07.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:06 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:53:08.170 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:07 smithi002 ceph-mon[27637]: Deploying daemon mds.cephfs.smithi002.auedll on smithi002 2024-09-13T22:53:08.170 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:07 smithi002 ceph-mon[27637]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T22:53:08.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:07 smithi047 ceph-mon[34560]: Deploying daemon mds.cephfs.smithi002.auedll on smithi002 2024-09-13T22:53:08.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:07 smithi047 ceph-mon[34560]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T22:53:09.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:08 smithi002 ceph-mon[27637]: pgmap v178: 65 pgs: 3 creating+activating, 6 creating+peering, 34 unknown, 22 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:53:09.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:08 smithi002 ceph-mon[27637]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T22:53:09.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:08 smithi002 ceph-mon[27637]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T22:53:09.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:08 smithi047 ceph-mon[34560]: pgmap v178: 65 pgs: 3 creating+activating, 6 creating+peering, 34 unknown, 22 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:53:09.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:08 smithi047 ceph-mon[34560]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T22:53:09.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:08 smithi047 ceph-mon[34560]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T22:53:09.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.946+0000 7f8b21914700 1 -- 172.21.15.2:0/4158272763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b1c1040d0 msgr2=0x7f8b1c1064c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:09.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.946+0000 7f8b21914700 1 --2- 172.21.15.2:0/4158272763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b1c1040d0 0x7f8b1c1064c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b10009910 tx=0x7f8b10009c20 comp rx=0 tx=0).stop 2024-09-13T22:53:09.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.946+0000 7f8b21914700 1 -- 172.21.15.2:0/4158272763 shutdown_connections 2024-09-13T22:53:09.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.946+0000 7f8b21914700 1 --2- 172.21.15.2:0/4158272763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b1c1040d0 0x7f8b1c1064c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:09.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.946+0000 7f8b21914700 1 --2- 172.21.15.2:0/4158272763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b1c1017a0 0x7f8b1c103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:09.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.946+0000 7f8b21914700 1 -- 172.21.15.2:0/4158272763 >> 172.21.15.2:0/4158272763 conn(0x7f8b1c0fb190 msgr2=0x7f8b1c0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:09.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.946+0000 7f8b21914700 1 -- 172.21.15.2:0/4158272763 shutdown_connections 2024-09-13T22:53:09.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.946+0000 7f8b21914700 1 -- 172.21.15.2:0/4158272763 wait complete. 2024-09-13T22:53:09.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.947+0000 7f8b21914700 1 Processor -- start 2024-09-13T22:53:09.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.947+0000 7f8b21914700 1 -- start start 2024-09-13T22:53:09.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.947+0000 7f8b21914700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b1c1017a0 0x7f8b1c196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:09.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.947+0000 7f8b21914700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b1c1040d0 0x7f8b1c196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.947+0000 7f8b21914700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c196fb0 con 0x7f8b1c1040d0 2024-09-13T22:53:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.947+0000 7f8b21914700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c1970f0 con 0x7f8b1c1017a0 2024-09-13T22:53:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.948+0000 7f8b1a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b1c1040d0 0x7f8b1c196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.948+0000 7f8b1a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b1c1040d0 0x7f8b1c196990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43688/0 (socket says 172.21.15.2:43688) 2024-09-13T22:53:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.948+0000 7f8b1a7fc700 1 -- 172.21.15.2:0/3328143320 learned_addr learned my addr 172.21.15.2:0/3328143320 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:53:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.948+0000 7f8b1affd700 1 --2- 172.21.15.2:0/3328143320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b1c1017a0 0x7f8b1c196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.948+0000 7f8b1a7fc700 1 -- 172.21.15.2:0/3328143320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b1c1017a0 msgr2=0x7f8b1c196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.948+0000 7f8b1a7fc700 1 --2- 172.21.15.2:0/3328143320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b1c1017a0 0x7f8b1c196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.948+0000 7f8b1a7fc700 1 -- 172.21.15.2:0/3328143320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b100095f0 con 0x7f8b1c1040d0 2024-09-13T22:53:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.948+0000 7f8b1a7fc700 1 --2- 172.21.15.2:0/3328143320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b1c1040d0 0x7f8b1c196990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8b10006010 tx=0x7f8b1000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.948+0000 7f8b20912700 1 -- 172.21.15.2:0/3328143320 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b1001d070 con 0x7f8b1c1040d0 2024-09-13T22:53:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.948+0000 7f8b20912700 1 -- 172.21.15.2:0/3328143320 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8b1000f460 con 0x7f8b1c1040d0 2024-09-13T22:53:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.948+0000 7f8b21914700 1 -- 172.21.15.2:0/3328143320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1c19bb40 con 0x7f8b1c1040d0 2024-09-13T22:53:09.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.949+0000 7f8b20912700 1 -- 172.21.15.2:0/3328143320 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b10021640 con 0x7f8b1c1040d0 2024-09-13T22:53:09.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.949+0000 7f8b21914700 1 -- 172.21.15.2:0/3328143320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1c19c030 con 0x7f8b1c1040d0 2024-09-13T22:53:09.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.950+0000 7f8b21914700 1 -- 172.21.15.2:0/3328143320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b1c190610 con 0x7f8b1c1040d0 2024-09-13T22:53:09.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.951+0000 7f8b20912700 1 -- 172.21.15.2:0/3328143320 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f8b1000fab0 con 0x7f8b1c1040d0 2024-09-13T22:53:09.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.951+0000 7f8b20912700 1 --2- 172.21.15.2:0/3328143320 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8b0406c4e0 0x7f8b0406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:09.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.951+0000 7f8b20912700 1 -- 172.21.15.2:0/3328143320 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8b1008c860 con 0x7f8b1c1040d0 2024-09-13T22:53:09.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.951+0000 7f8b1affd700 1 --2- 172.21.15.2:0/3328143320 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8b0406c4e0 0x7f8b0406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:09.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.952+0000 7f8b1affd700 1 --2- 172.21.15.2:0/3328143320 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8b0406c4e0 0x7f8b0406e9a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c005950 tx=0x7f8b0c00b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:09.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:09.956+0000 7f8b20912700 1 -- 172.21.15.2:0/3328143320 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8b1005ab80 con 0x7f8b1c1040d0 2024-09-13T22:53:10.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:10.240+0000 7f8b21914700 1 -- 172.21.15.2:0/3328143320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8b1c02cc70 con 0x7f8b1c1040d0 2024-09-13T22:53:10.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:10.240+0000 7f8b20912700 1 -- 172.21.15.2:0/3328143320 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1093 (secure 0 0 0) 0x7f8b1005a710 con 0x7f8b1c1040d0 2024-09-13T22:53:10.242 INFO:teuthology.orchestra.run.smithi002.stdout:e2 2024-09-13T22:53:10.242 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:53:10.242 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:53:10.242 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-13T22:53:10.242 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:53:10.242 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-13T22:53:10.242 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-13T22:53:10.242 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 2 2024-09-13T22:53:10.242 INFO:teuthology.orchestra.run.smithi002.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T22:53:10.243 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-13T22:53:05.963265+0000 2024-09-13T22:53:10.243 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-13T22:53:05.963336+0000 2024-09-13T22:53:10.243 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-13T22:53:10.243 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-13T22:53:10.243 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-13T22:53:10.243 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-13T22:53:10.243 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-13T22:53:10.243 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-13T22:53:10.243 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-13T22:53:10.243 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 0 2024-09-13T22:53:10.243 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:53:10.243 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 1 2024-09-13T22:53:10.243 INFO:teuthology.orchestra.run.smithi002.stdout:in 2024-09-13T22:53:10.244 INFO:teuthology.orchestra.run.smithi002.stdout:up {} 2024-09-13T22:53:10.244 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-13T22:53:10.244 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-13T22:53:10.244 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-13T22:53:10.244 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-13T22:53:10.244 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-13T22:53:10.244 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data disabled 2024-09-13T22:53:10.244 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-13T22:53:10.244 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-13T22:53:10.244 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 0 2024-09-13T22:53:10.244 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:53:10.244 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:53:10.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:10.243+0000 7f8b21914700 1 -- 172.21.15.2:0/3328143320 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8b0406c4e0 msgr2=0x7f8b0406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:10.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:10.243+0000 7f8b21914700 1 --2- 172.21.15.2:0/3328143320 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8b0406c4e0 0x7f8b0406e9a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c005950 tx=0x7f8b0c00b410 comp rx=0 tx=0).stop 2024-09-13T22:53:10.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:10.243+0000 7f8b21914700 1 -- 172.21.15.2:0/3328143320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b1c1040d0 msgr2=0x7f8b1c196990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:10.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:10.243+0000 7f8b21914700 1 --2- 172.21.15.2:0/3328143320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b1c1040d0 0x7f8b1c196990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8b10006010 tx=0x7f8b1000bd70 comp rx=0 tx=0).stop 2024-09-13T22:53:10.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:10.243+0000 7f8b21914700 1 -- 172.21.15.2:0/3328143320 shutdown_connections 2024-09-13T22:53:10.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:10.243+0000 7f8b21914700 1 --2- 172.21.15.2:0/3328143320 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f8b0406c4e0 0x7f8b0406e9a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:10.243+0000 7f8b21914700 1 --2- 172.21.15.2:0/3328143320 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b1c1017a0 0x7f8b1c196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:10.243+0000 7f8b21914700 1 --2- 172.21.15.2:0/3328143320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b1c1040d0 0x7f8b1c196990 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:10.243+0000 7f8b21914700 1 -- 172.21.15.2:0/3328143320 >> 172.21.15.2:0/3328143320 conn(0x7f8b1c0fb190 msgr2=0x7f8b1c0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:10.243+0000 7f8b21914700 1 -- 172.21.15.2:0/3328143320 shutdown_connections 2024-09-13T22:53:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:10.243+0000 7f8b21914700 1 -- 172.21.15.2:0/3328143320 wait complete. 2024-09-13T22:53:10.246 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 2 2024-09-13T22:53:10.954 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T22:53:10.964 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-13T22:53:10.965 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-13T22:53:11.214 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:10 smithi002 ceph-mon[27637]: pgmap v180: 65 pgs: 3 creating+activating, 6 creating+peering, 12 unknown, 44 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:53:11.214 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:10 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/3328143320' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:53:11.288 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:53:11.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:10 smithi047 ceph-mon[34560]: pgmap v180: 65 pgs: 3 creating+activating, 6 creating+peering, 12 unknown, 44 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:53:11.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:10 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/3328143320' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:53:12.340 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:12 smithi002 ceph-mon[27637]: pgmap v181: 65 pgs: 3 creating+activating, 6 creating+peering, 56 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:53:12.340 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:12 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:12.340 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:12 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:12.340 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:12 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:12.340 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:12 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.gxzkha", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:53:12.340 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:12 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.gxzkha", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T22:53:12.341 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:12 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:53:12.341 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:12 smithi002 ceph-mon[27637]: Deploying daemon mds.cephfs.smithi047.gxzkha on smithi047 2024-09-13T22:53:12.341 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:12 smithi002 ceph-mon[27637]: mds.? [v2:172.21.15.2:6826/2162770053,v1:172.21.15.2:6827/2162770053] up:boot 2024-09-13T22:53:12.341 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:12 smithi002 ceph-mon[27637]: daemon mds.cephfs.smithi002.auedll assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T22:53:12.341 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:12 smithi002 ceph-mon[27637]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T22:53:12.341 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:12 smithi002 ceph-mon[27637]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T22:53:12.341 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:12 smithi002 ceph-mon[27637]: Cluster is now healthy 2024-09-13T22:53:12.341 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:12 smithi002 ceph-mon[27637]: fsmap cephfs:0 1 up:standby 2024-09-13T22:53:12.341 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:12 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.auedll"}]: dispatch 2024-09-13T22:53:12.341 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:12 smithi002 ceph-mon[27637]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:creating} 2024-09-13T22:53:12.341 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:12 smithi002 ceph-mon[27637]: daemon mds.cephfs.smithi002.auedll is now active in filesystem cephfs as rank 0 2024-09-13T22:53:12.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:12 smithi047 ceph-mon[34560]: pgmap v181: 65 pgs: 3 creating+activating, 6 creating+peering, 56 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:53:12.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:12 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:12.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:12 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:12.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:12 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:12.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:12 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.gxzkha", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:53:12.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:12 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.gxzkha", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T22:53:12.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:12 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:53:12.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:12 smithi047 ceph-mon[34560]: Deploying daemon mds.cephfs.smithi047.gxzkha on smithi047 2024-09-13T22:53:12.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:12 smithi047 ceph-mon[34560]: mds.? [v2:172.21.15.2:6826/2162770053,v1:172.21.15.2:6827/2162770053] up:boot 2024-09-13T22:53:12.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:12 smithi047 ceph-mon[34560]: daemon mds.cephfs.smithi002.auedll assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T22:53:12.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:12 smithi047 ceph-mon[34560]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T22:53:12.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:12 smithi047 ceph-mon[34560]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T22:53:12.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:12 smithi047 ceph-mon[34560]: Cluster is now healthy 2024-09-13T22:53:12.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:12 smithi047 ceph-mon[34560]: fsmap cephfs:0 1 up:standby 2024-09-13T22:53:12.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:12 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.auedll"}]: dispatch 2024-09-13T22:53:12.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:12 smithi047 ceph-mon[34560]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:creating} 2024-09-13T22:53:12.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:12 smithi047 ceph-mon[34560]: daemon mds.cephfs.smithi002.auedll is now active in filesystem cephfs as rank 0 2024-09-13T22:53:12.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.873+0000 7f920a78c700 1 -- 172.21.15.2:0/1317989322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9204100cb0 msgr2=0x7f92041010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:12.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.873+0000 7f920a78c700 1 --2- 172.21.15.2:0/1317989322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9204100cb0 0x7f92041010d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009910 tx=0x7f91f4009c20 comp rx=0 tx=0).stop 2024-09-13T22:53:12.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.873+0000 7f920a78c700 1 -- 172.21.15.2:0/1317989322 shutdown_connections 2024-09-13T22:53:12.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.873+0000 7f920a78c700 1 --2- 172.21.15.2:0/1317989322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9204101eb0 0x7f9204102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:12.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.873+0000 7f920a78c700 1 --2- 172.21.15.2:0/1317989322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9204100cb0 0x7f92041010d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:12.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.873+0000 7f920a78c700 1 -- 172.21.15.2:0/1317989322 >> 172.21.15.2:0/1317989322 conn(0x7f92040fc230 msgr2=0x7f92040fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:12.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.873+0000 7f920a78c700 1 -- 172.21.15.2:0/1317989322 shutdown_connections 2024-09-13T22:53:12.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.873+0000 7f920a78c700 1 -- 172.21.15.2:0/1317989322 wait complete. 2024-09-13T22:53:12.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.874+0000 7f920a78c700 1 Processor -- start 2024-09-13T22:53:12.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.874+0000 7f920a78c700 1 -- start start 2024-09-13T22:53:12.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.874+0000 7f920a78c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9204100cb0 0x7f92041964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:12.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.874+0000 7f920a78c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9204101eb0 0x7f9204196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:12.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.874+0000 7f920a78c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9204197020 con 0x7f9204101eb0 2024-09-13T22:53:12.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.874+0000 7f920a78c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9204197160 con 0x7f9204100cb0 2024-09-13T22:53:12.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.874+0000 7f92037fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9204101eb0 0x7f9204196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:12.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.874+0000 7f92037fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9204101eb0 0x7f9204196a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33386/0 (socket says 172.21.15.2:33386) 2024-09-13T22:53:12.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.874+0000 7f92037fe700 1 -- 172.21.15.2:0/203374994 learned_addr learned my addr 172.21.15.2:0/203374994 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:53:12.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.874+0000 7f9203fff700 1 --2- 172.21.15.2:0/203374994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9204100cb0 0x7f92041964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:12.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.875+0000 7f92037fe700 1 -- 172.21.15.2:0/203374994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9204100cb0 msgr2=0x7f92041964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:12.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.875+0000 7f92037fe700 1 --2- 172.21.15.2:0/203374994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9204100cb0 0x7f92041964c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:12.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.875+0000 7f92037fe700 1 -- 172.21.15.2:0/203374994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f40095f0 con 0x7f9204101eb0 2024-09-13T22:53:12.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.875+0000 7f92037fe700 1 --2- 172.21.15.2:0/203374994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9204101eb0 0x7f9204196a00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f91f800c8a0 tx=0x7f91f800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:12.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.875+0000 7f92017fa700 1 -- 172.21.15.2:0/203374994 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91f80078e0 con 0x7f9204101eb0 2024-09-13T22:53:12.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.875+0000 7f92017fa700 1 -- 172.21.15.2:0/203374994 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f91f800f450 con 0x7f9204101eb0 2024-09-13T22:53:12.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.875+0000 7f920a78c700 1 -- 172.21.15.2:0/203374994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f920419bc10 con 0x7f9204101eb0 2024-09-13T22:53:12.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.875+0000 7f92017fa700 1 -- 172.21.15.2:0/203374994 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91f800e5e0 con 0x7f9204101eb0 2024-09-13T22:53:12.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.875+0000 7f920a78c700 1 -- 172.21.15.2:0/203374994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920419c160 con 0x7f9204101eb0 2024-09-13T22:53:12.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.876+0000 7f920a78c700 1 -- 172.21.15.2:0/203374994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9204109810 con 0x7f9204101eb0 2024-09-13T22:53:12.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.877+0000 7f92017fa700 1 -- 172.21.15.2:0/203374994 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f91f800f5c0 con 0x7f9204101eb0 2024-09-13T22:53:12.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.877+0000 7f92017fa700 1 --2- 172.21.15.2:0/203374994 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f91ec06c4e0 0x7f91ec06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:12.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.877+0000 7f92017fa700 1 -- 172.21.15.2:0/203374994 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f91f808b5d0 con 0x7f9204101eb0 2024-09-13T22:53:12.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.877+0000 7f9203fff700 1 --2- 172.21.15.2:0/203374994 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f91ec06c4e0 0x7f91ec06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:12.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.878+0000 7f9203fff700 1 --2- 172.21.15.2:0/203374994 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f91ec06c4e0 0x7f91ec06e9a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f91f4006010 tx=0x7f91f400b560 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:12.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:12.882+0000 7f92017fa700 1 -- 172.21.15.2:0/203374994 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f91f8059970 con 0x7f9204101eb0 2024-09-13T22:53:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:13.130+0000 7f920a78c700 1 -- 172.21.15.2:0/203374994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f920419c880 con 0x7f9204101eb0 2024-09-13T22:53:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:13.987+0000 7f92017fa700 1 -- 172.21.15.2:0/203374994 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f91f8059500 con 0x7f9204101eb0 2024-09-13T22:53:13.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:13.990+0000 7f920a78c700 1 -- 172.21.15.2:0/203374994 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f91ec06c4e0 msgr2=0x7f91ec06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:13.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:13.990+0000 7f920a78c700 1 --2- 172.21.15.2:0/203374994 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f91ec06c4e0 0x7f91ec06e9a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f91f4006010 tx=0x7f91f400b560 comp rx=0 tx=0).stop 2024-09-13T22:53:13.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:13.990+0000 7f920a78c700 1 -- 172.21.15.2:0/203374994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9204101eb0 msgr2=0x7f9204196a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:13.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:13.990+0000 7f920a78c700 1 --2- 172.21.15.2:0/203374994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9204101eb0 0x7f9204196a00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f91f800c8a0 tx=0x7f91f800cbb0 comp rx=0 tx=0).stop 2024-09-13T22:53:13.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:13.990+0000 7f920a78c700 1 -- 172.21.15.2:0/203374994 shutdown_connections 2024-09-13T22:53:13.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:13.990+0000 7f920a78c700 1 --2- 172.21.15.2:0/203374994 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f91ec06c4e0 0x7f91ec06e9a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:13.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:13.990+0000 7f920a78c700 1 --2- 172.21.15.2:0/203374994 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9204100cb0 0x7f92041964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:13.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:13.990+0000 7f920a78c700 1 --2- 172.21.15.2:0/203374994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9204101eb0 0x7f9204196a00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:13.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:13.990+0000 7f920a78c700 1 -- 172.21.15.2:0/203374994 >> 172.21.15.2:0/203374994 conn(0x7f92040fc230 msgr2=0x7f92041050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:13.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:13.990+0000 7f920a78c700 1 -- 172.21.15.2:0/203374994 shutdown_connections 2024-09-13T22:53:13.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:13.990+0000 7f920a78c700 1 -- 172.21.15.2:0/203374994 wait complete. 2024-09-13T22:53:14.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:13 smithi002 ceph-mon[27637]: mds.? [v2:172.21.15.2:6826/2162770053,v1:172.21.15.2:6827/2162770053] up:active 2024-09-13T22:53:14.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:13 smithi002 ceph-mon[27637]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 2024-09-13T22:53:14.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:13 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/203374994' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-13T22:53:14.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:13 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:14.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:13 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:14.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:13 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:14.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:13 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.gglyyr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:53:14.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:13 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.gglyyr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T22:53:14.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:13 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:53:14.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:13 smithi047 ceph-mon[34560]: mds.? [v2:172.21.15.2:6826/2162770053,v1:172.21.15.2:6827/2162770053] up:active 2024-09-13T22:53:14.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:13 smithi047 ceph-mon[34560]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 2024-09-13T22:53:14.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:13 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/203374994' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-13T22:53:14.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:13 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:14.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:13 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:14.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:13 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:14.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:13 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.gglyyr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:53:14.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:13 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.gglyyr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T22:53:14.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:13 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:53:14.557 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T22:53:14.566 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-13T22:53:14.566 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-13T22:53:15.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:14 smithi002 ceph-mon[27637]: pgmap v182: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-13T22:53:15.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:14 smithi002 ceph-mon[27637]: Deploying daemon mds.cephfs.smithi002.gglyyr on smithi002 2024-09-13T22:53:15.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:14 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/203374994' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-13T22:53:15.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:14 smithi002 ceph-mon[27637]: mds.? [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] up:boot 2024-09-13T22:53:15.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:14 smithi002 ceph-mon[27637]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 1 up:standby 2024-09-13T22:53:15.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:14 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.gxzkha"}]: dispatch 2024-09-13T22:53:15.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:14 smithi002 ceph-mon[27637]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 1 up:standby 2024-09-13T22:53:15.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:14 smithi047 ceph-mon[34560]: pgmap v182: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-13T22:53:15.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:14 smithi047 ceph-mon[34560]: Deploying daemon mds.cephfs.smithi002.gglyyr on smithi002 2024-09-13T22:53:15.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:14 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/203374994' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-13T22:53:15.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:14 smithi047 ceph-mon[34560]: mds.? [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] up:boot 2024-09-13T22:53:15.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:14 smithi047 ceph-mon[34560]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 1 up:standby 2024-09-13T22:53:15.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:14 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.gxzkha"}]: dispatch 2024-09-13T22:53:15.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:14 smithi047 ceph-mon[34560]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 1 up:standby 2024-09-13T22:53:15.773 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:53:17.170 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:16 smithi002 ceph-mon[27637]: pgmap v183: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-13T22:53:17.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:16 smithi047 ceph-mon[34560]: pgmap v183: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-13T22:53:17.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.452+0000 7f107877b700 1 -- 172.21.15.2:0/2476135151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1070100ca0 msgr2=0x7f10701010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:17.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.452+0000 7f107877b700 1 --2- 172.21.15.2:0/2476135151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1070100ca0 0x7f10701010c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f106c009910 tx=0x7f106c009c20 comp rx=0 tx=0).stop 2024-09-13T22:53:17.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.453+0000 7f107877b700 1 -- 172.21.15.2:0/2476135151 shutdown_connections 2024-09-13T22:53:17.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.453+0000 7f107877b700 1 --2- 172.21.15.2:0/2476135151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1070101ea0 0x7f1070102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:17.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.453+0000 7f107877b700 1 --2- 172.21.15.2:0/2476135151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1070100ca0 0x7f10701010c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:17.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.453+0000 7f107877b700 1 -- 172.21.15.2:0/2476135151 >> 172.21.15.2:0/2476135151 conn(0x7f10700fc260 msgr2=0x7f10700fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:17.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.453+0000 7f107877b700 1 -- 172.21.15.2:0/2476135151 shutdown_connections 2024-09-13T22:53:17.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.453+0000 7f107877b700 1 -- 172.21.15.2:0/2476135151 wait complete. 2024-09-13T22:53:17.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.453+0000 7f107877b700 1 Processor -- start 2024-09-13T22:53:17.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.453+0000 7f107877b700 1 -- start start 2024-09-13T22:53:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.453+0000 7f107877b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1070100ca0 0x7f10701964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.453+0000 7f107877b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1070101ea0 0x7f1070196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.453+0000 7f107877b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1070197030 con 0x7f1070101ea0 2024-09-13T22:53:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.453+0000 7f107877b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1070197170 con 0x7f1070100ca0 2024-09-13T22:53:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.454+0000 7f1075d16700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1070101ea0 0x7f1070196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:17.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.454+0000 7f1075d16700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1070101ea0 0x7f1070196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33410/0 (socket says 172.21.15.2:33410) 2024-09-13T22:53:17.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.454+0000 7f1075d16700 1 -- 172.21.15.2:0/2653693693 learned_addr learned my addr 172.21.15.2:0/2653693693 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:53:17.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.454+0000 7f1076517700 1 --2- 172.21.15.2:0/2653693693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1070100ca0 0x7f10701964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:17.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.454+0000 7f1075d16700 1 -- 172.21.15.2:0/2653693693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1070100ca0 msgr2=0x7f10701964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:17.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.454+0000 7f1075d16700 1 --2- 172.21.15.2:0/2653693693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1070100ca0 0x7f10701964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:17.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.454+0000 7f1075d16700 1 -- 172.21.15.2:0/2653693693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c0095f0 con 0x7f1070101ea0 2024-09-13T22:53:17.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.454+0000 7f1075d16700 1 --2- 172.21.15.2:0/2653693693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1070101ea0 0x7f1070196a10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f106000e920 tx=0x7f106000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:17.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.454+0000 7f10677fe700 1 -- 172.21.15.2:0/2653693693 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f106000c9d0 con 0x7f1070101ea0 2024-09-13T22:53:17.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.454+0000 7f10677fe700 1 -- 172.21.15.2:0/2653693693 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1060010430 con 0x7f1070101ea0 2024-09-13T22:53:17.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.454+0000 7f10677fe700 1 -- 172.21.15.2:0/2653693693 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1060018650 con 0x7f1070101ea0 2024-09-13T22:53:17.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.454+0000 7f107877b700 1 -- 172.21.15.2:0/2653693693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107019bc20 con 0x7f1070101ea0 2024-09-13T22:53:17.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.454+0000 7f107877b700 1 -- 172.21.15.2:0/2653693693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107019c170 con 0x7f1070101ea0 2024-09-13T22:53:17.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.455+0000 7f107877b700 1 -- 172.21.15.2:0/2653693693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1070109800 con 0x7f1070101ea0 2024-09-13T22:53:17.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.456+0000 7f10677fe700 1 -- 172.21.15.2:0/2653693693 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f10600105a0 con 0x7f1070101ea0 2024-09-13T22:53:17.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.456+0000 7f10677fe700 1 --2- 172.21.15.2:0/2653693693 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f105c06c4e0 0x7f105c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:17.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.456+0000 7f10677fe700 1 -- 172.21.15.2:0/2653693693 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1060014070 con 0x7f1070101ea0 2024-09-13T22:53:17.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.456+0000 7f1076517700 1 --2- 172.21.15.2:0/2653693693 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f105c06c4e0 0x7f105c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:17.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.457+0000 7f1076517700 1 --2- 172.21.15.2:0/2653693693 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f105c06c4e0 0x7f105c06e9a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f106c00b6f0 tx=0x7f106c005940 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:17.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.461+0000 7f10677fe700 1 -- 172.21.15.2:0/2653693693 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f10600520e0 con 0x7f1070101ea0 2024-09-13T22:53:17.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:17.705+0000 7f107877b700 1 -- 172.21.15.2:0/2653693693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f10701099f0 con 0x7f1070101ea0 2024-09-13T22:53:18.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:18.225+0000 7f10677fe700 1 -- 172.21.15.2:0/2653693693 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v8) v1 ==== 121+0+0 (secure 0 0 0) 0x7f1060059d90 con 0x7f1070101ea0 2024-09-13T22:53:18.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:18.227+0000 7f107877b700 1 -- 172.21.15.2:0/2653693693 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f105c06c4e0 msgr2=0x7f105c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:18.227+0000 7f107877b700 1 --2- 172.21.15.2:0/2653693693 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f105c06c4e0 0x7f105c06e9a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f106c00b6f0 tx=0x7f106c005940 comp rx=0 tx=0).stop 2024-09-13T22:53:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:18.227+0000 7f107877b700 1 -- 172.21.15.2:0/2653693693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1070101ea0 msgr2=0x7f1070196a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:18.227+0000 7f107877b700 1 --2- 172.21.15.2:0/2653693693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1070101ea0 0x7f1070196a10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f106000e920 tx=0x7f106000ec30 comp rx=0 tx=0).stop 2024-09-13T22:53:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:18.227+0000 7f107877b700 1 -- 172.21.15.2:0/2653693693 shutdown_connections 2024-09-13T22:53:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:18.227+0000 7f107877b700 1 --2- 172.21.15.2:0/2653693693 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f105c06c4e0 0x7f105c06e9a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:18.227+0000 7f107877b700 1 --2- 172.21.15.2:0/2653693693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1070100ca0 0x7f10701964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:18.227+0000 7f107877b700 1 --2- 172.21.15.2:0/2653693693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1070101ea0 0x7f1070196a10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:18.227+0000 7f107877b700 1 -- 172.21.15.2:0/2653693693 >> 172.21.15.2:0/2653693693 conn(0x7f10700fc260 msgr2=0x7f10701050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:18.227+0000 7f107877b700 1 -- 172.21.15.2:0/2653693693 shutdown_connections 2024-09-13T22:53:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:18.227+0000 7f107877b700 1 -- 172.21.15.2:0/2653693693 wait complete. 2024-09-13T22:53:18.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:17 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:53:18.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:17 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:18.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:17 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2653693693' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T22:53:18.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:17 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:53:18.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:17 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:18.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:17 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/2653693693' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T22:53:18.882 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T22:53:18.892 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-13T22:53:18.893 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-13T22:53:19.114 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:53:19.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:19 smithi047 ceph-mon[34560]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-13T22:53:19.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:19 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:19.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:19 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:19.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:19 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:19.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:19 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.nqvveh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:53:19.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:19 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.nqvveh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T22:53:19.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:19 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:53:19.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:19 smithi047 ceph-mon[34560]: Deploying daemon mds.cephfs.smithi047.nqvveh on smithi047 2024-09-13T22:53:19.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:19 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/2653693693' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T22:53:19.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:19 smithi047 ceph-mon[34560]: mds.? [v2:172.21.15.2:6828/2123560657,v1:172.21.15.2:6829/2123560657] up:boot 2024-09-13T22:53:19.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:19 smithi047 ceph-mon[34560]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 2 up:standby 2024-09-13T22:53:19.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:19 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.gglyyr"}]: dispatch 2024-09-13T22:53:19.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:19 smithi047 ceph-mon[34560]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T22:53:19.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:19 smithi002 ceph-mon[27637]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-13T22:53:19.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:19 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:19.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:19 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:19.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:19 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:19.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:19 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.nqvveh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T22:53:19.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:19 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.nqvveh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T22:53:19.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:19 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:53:19.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:19 smithi002 ceph-mon[27637]: Deploying daemon mds.cephfs.smithi047.nqvveh on smithi047 2024-09-13T22:53:19.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:19 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2653693693' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T22:53:19.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:19 smithi002 ceph-mon[27637]: mds.? [v2:172.21.15.2:6828/2123560657,v1:172.21.15.2:6829/2123560657] up:boot 2024-09-13T22:53:19.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:19 smithi002 ceph-mon[27637]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 2 up:standby 2024-09-13T22:53:19.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:19 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.gglyyr"}]: dispatch 2024-09-13T22:53:19.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:19 smithi002 ceph-mon[27637]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T22:53:20.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.672+0000 7fc6ed4b4700 1 -- 172.21.15.2:0/1491101082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6e81022a0 msgr2=0x7fc6e81026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.672+0000 7fc6ed4b4700 1 --2- 172.21.15.2:0/1491101082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6e81022a0 0x7fc6e81026c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009910 tx=0x7fc6d8009c20 comp rx=0 tx=0).stop 2024-09-13T22:53:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.672+0000 7fc6ed4b4700 1 -- 172.21.15.2:0/1491101082 shutdown_connections 2024-09-13T22:53:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.672+0000 7fc6ed4b4700 1 --2- 172.21.15.2:0/1491101082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6e80fed20 0x7fc6e80ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.672+0000 7fc6ed4b4700 1 --2- 172.21.15.2:0/1491101082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6e81022a0 0x7fc6e81026c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.672+0000 7fc6ed4b4700 1 -- 172.21.15.2:0/1491101082 >> 172.21.15.2:0/1491101082 conn(0x7fc6e80fa8c0 msgr2=0x7fc6e80fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.672+0000 7fc6ed4b4700 1 -- 172.21.15.2:0/1491101082 shutdown_connections 2024-09-13T22:53:20.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.672+0000 7fc6ed4b4700 1 -- 172.21.15.2:0/1491101082 wait complete. 2024-09-13T22:53:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.673+0000 7fc6ed4b4700 1 Processor -- start 2024-09-13T22:53:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.673+0000 7fc6ed4b4700 1 -- start start 2024-09-13T22:53:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.674+0000 7fc6ed4b4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6e80fed20 0x7fc6e81964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.674+0000 7fc6ed4b4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6e81022a0 0x7fc6e8196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.674+0000 7fc6ed4b4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8197040 con 0x7fc6e81022a0 2024-09-13T22:53:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.674+0000 7fc6ed4b4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8197180 con 0x7fc6e80fed20 2024-09-13T22:53:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.674+0000 7fc6e67fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6e81022a0 0x7fc6e8196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.674+0000 7fc6e67fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6e81022a0 0x7fc6e8196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57610/0 (socket says 172.21.15.2:57610) 2024-09-13T22:53:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.674+0000 7fc6e67fc700 1 -- 172.21.15.2:0/923559161 learned_addr learned my addr 172.21.15.2:0/923559161 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:53:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.674+0000 7fc6e6ffd700 1 --2- 172.21.15.2:0/923559161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6e80fed20 0x7fc6e81964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.674+0000 7fc6e67fc700 1 -- 172.21.15.2:0/923559161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6e80fed20 msgr2=0x7fc6e81964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.674+0000 7fc6e67fc700 1 --2- 172.21.15.2:0/923559161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6e80fed20 0x7fc6e81964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.674+0000 7fc6e67fc700 1 -- 172.21.15.2:0/923559161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d80095f0 con 0x7fc6e81022a0 2024-09-13T22:53:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.674+0000 7fc6e67fc700 1 --2- 172.21.15.2:0/923559161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6e81022a0 0x7fc6e8196a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00e8f0 tx=0x7fc6dc00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.674+0000 7fc6cffff700 1 -- 172.21.15.2:0/923559161 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6dc009790 con 0x7fc6e81022a0 2024-09-13T22:53:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.675+0000 7fc6ed4b4700 1 -- 172.21.15.2:0/923559161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e819bc30 con 0x7fc6e81022a0 2024-09-13T22:53:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.675+0000 7fc6cffff700 1 -- 172.21.15.2:0/923559161 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc6dc00c810 con 0x7fc6e81022a0 2024-09-13T22:53:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.675+0000 7fc6cffff700 1 -- 172.21.15.2:0/923559161 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6dc003d20 con 0x7fc6e81022a0 2024-09-13T22:53:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.675+0000 7fc6ed4b4700 1 -- 172.21.15.2:0/923559161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e819c180 con 0x7fc6e81022a0 2024-09-13T22:53:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.676+0000 7fc6ed4b4700 1 -- 172.21.15.2:0/923559161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e8109820 con 0x7fc6e81022a0 2024-09-13T22:53:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.676+0000 7fc6cffff700 1 -- 172.21.15.2:0/923559161 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fc6dc0041f0 con 0x7fc6e81022a0 2024-09-13T22:53:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.677+0000 7fc6cffff700 1 --2- 172.21.15.2:0/923559161 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc6d006c4e0 0x7fc6d006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.677+0000 7fc6cffff700 1 -- 172.21.15.2:0/923559161 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc6dc014070 con 0x7fc6e81022a0 2024-09-13T22:53:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.677+0000 7fc6e6ffd700 1 --2- 172.21.15.2:0/923559161 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc6d006c4e0 0x7fc6d006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.677+0000 7fc6e6ffd700 1 --2- 172.21.15.2:0/923559161 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc6d006c4e0 0x7fc6d006e9a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800b6f0 tx=0x7fc6d8005940 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:20.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.681+0000 7fc6cffff700 1 -- 172.21.15.2:0/923559161 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc6dc059d20 con 0x7fc6e81022a0 2024-09-13T22:53:20.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:20.958+0000 7fc6ed4b4700 1 -- 172.21.15.2:0/923559161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc6e8109a10 con 0x7fc6e81022a0 2024-09-13T22:53:21.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:21.048+0000 7fc6cffff700 1 -- 172.21.15.2:0/923559161 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v10) v1 ==== 168+0+0 (secure 0 0 0) 0x7fc6dc0598b0 con 0x7fc6e81022a0 2024-09-13T22:53:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:21.050+0000 7fc6ed4b4700 1 -- 172.21.15.2:0/923559161 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc6d006c4e0 msgr2=0x7fc6d006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:21.050+0000 7fc6ed4b4700 1 --2- 172.21.15.2:0/923559161 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc6d006c4e0 0x7fc6d006e9a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800b6f0 tx=0x7fc6d8005940 comp rx=0 tx=0).stop 2024-09-13T22:53:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:21.050+0000 7fc6ed4b4700 1 -- 172.21.15.2:0/923559161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6e81022a0 msgr2=0x7fc6e8196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:21.050+0000 7fc6ed4b4700 1 --2- 172.21.15.2:0/923559161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6e81022a0 0x7fc6e8196a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00e8f0 tx=0x7fc6dc00ec00 comp rx=0 tx=0).stop 2024-09-13T22:53:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:21.051+0000 7fc6ed4b4700 1 -- 172.21.15.2:0/923559161 shutdown_connections 2024-09-13T22:53:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:21.051+0000 7fc6ed4b4700 1 --2- 172.21.15.2:0/923559161 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc6d006c4e0 0x7fc6d006e9a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:21.051+0000 7fc6ed4b4700 1 --2- 172.21.15.2:0/923559161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6e80fed20 0x7fc6e81964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:21.051+0000 7fc6ed4b4700 1 --2- 172.21.15.2:0/923559161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6e81022a0 0x7fc6e8196a20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:21.051+0000 7fc6ed4b4700 1 -- 172.21.15.2:0/923559161 >> 172.21.15.2:0/923559161 conn(0x7fc6e80fa8c0 msgr2=0x7fc6e8105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:21.051+0000 7fc6ed4b4700 1 -- 172.21.15.2:0/923559161 shutdown_connections 2024-09-13T22:53:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:21.051+0000 7fc6ed4b4700 1 -- 172.21.15.2:0/923559161 wait complete. 2024-09-13T22:53:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:inline data enabled 2024-09-13T22:53:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:21 smithi002 ceph-mon[27637]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-13T22:53:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:21 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:21 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:21 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:21 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:21 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:21 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:53:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:21 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/923559161' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T22:53:21.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:21 smithi047 ceph-mon[34560]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-13T22:53:21.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:21 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:21.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:21 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:21.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:21 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:21.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:21 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:21.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:21 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:21.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:21 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:53:21.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:21 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/923559161' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T22:53:21.640 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T22:53:21.650 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-13T22:53:21.651 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T22:53:22.316 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:22 smithi047 ceph-mon[34560]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-13T22:53:22.316 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:22 smithi047 ceph-mon[34560]: mds.? [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] up:boot 2024-09-13T22:53:22.316 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:22 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/923559161' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T22:53:22.316 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:22 smithi047 ceph-mon[34560]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T22:53:22.316 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:22 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.nqvveh"}]: dispatch 2024-09-13T22:53:22.320 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:22 smithi002 ceph-mon[27637]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-13T22:53:22.320 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:22 smithi002 ceph-mon[27637]: mds.? [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] up:boot 2024-09-13T22:53:22.320 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:22 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/923559161' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T22:53:22.320 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:22 smithi002 ceph-mon[27637]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T22:53:22.320 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:22 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.nqvveh"}]: dispatch 2024-09-13T22:53:22.591 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:53:23.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:23 smithi047 ceph-mon[34560]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-13T22:53:23.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:23 smithi047 ceph-mon[34560]: mds.? [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] up:standby-replay 2024-09-13T22:53:23.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:23 smithi047 ceph-mon[34560]: mds.? [v2:172.21.15.2:6828/2123560657,v1:172.21.15.2:6829/2123560657] up:standby 2024-09-13T22:53:23.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:23 smithi047 ceph-mon[34560]: Dropping low affinity active daemon mds.cephfs.smithi002.auedll in favor of higher affinity standby. 2024-09-13T22:53:23.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:23 smithi047 ceph-mon[34560]: Replacing daemon mds.cephfs.smithi002.auedll as rank 0 with standby daemon mds.cephfs.smithi047.gxzkha 2024-09-13T22:53:23.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:23 smithi047 ceph-mon[34560]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T22:53:23.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:23 smithi047 ceph-mon[34560]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T22:53:23.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:23 smithi047 ceph-mon[34560]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T22:53:23.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:23 smithi047 ceph-mon[34560]: fsmap cephfs:1/1 {0=cephfs.smithi047.gxzkha=up:replay} 2 up:standby 2024-09-13T22:53:23.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:23 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:23.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:23 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:23.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:23 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:23.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:23 smithi002 ceph-mon[27637]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 85 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-13T22:53:23.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:23 smithi002 ceph-mon[27637]: mds.? [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] up:standby-replay 2024-09-13T22:53:23.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:23 smithi002 ceph-mon[27637]: mds.? [v2:172.21.15.2:6828/2123560657,v1:172.21.15.2:6829/2123560657] up:standby 2024-09-13T22:53:23.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:23 smithi002 ceph-mon[27637]: Dropping low affinity active daemon mds.cephfs.smithi002.auedll in favor of higher affinity standby. 2024-09-13T22:53:23.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:23 smithi002 ceph-mon[27637]: Replacing daemon mds.cephfs.smithi002.auedll as rank 0 with standby daemon mds.cephfs.smithi047.gxzkha 2024-09-13T22:53:23.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:23 smithi002 ceph-mon[27637]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T22:53:23.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:23 smithi002 ceph-mon[27637]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T22:53:23.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:23 smithi002 ceph-mon[27637]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T22:53:23.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:23 smithi002 ceph-mon[27637]: fsmap cephfs:1/1 {0=cephfs.smithi047.gxzkha=up:replay} 2 up:standby 2024-09-13T22:53:23.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:23 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:23.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:23 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:23.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:23 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:24.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.153+0000 7fcff2e61700 1 -- 172.21.15.2:0/153039761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec1017a0 msgr2=0x7fcfec103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:24.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.153+0000 7fcff2e61700 1 --2- 172.21.15.2:0/153039761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec1017a0 0x7fcfec103b90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009910 tx=0x7fcfe0009c20 comp rx=0 tx=0).stop 2024-09-13T22:53:24.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.154+0000 7fcff2e61700 1 -- 172.21.15.2:0/153039761 shutdown_connections 2024-09-13T22:53:24.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.154+0000 7fcff2e61700 1 --2- 172.21.15.2:0/153039761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfec1040d0 0x7fcfec1064c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:24.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.154+0000 7fcff2e61700 1 --2- 172.21.15.2:0/153039761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec1017a0 0x7fcfec103b90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.154+0000 7fcff2e61700 1 -- 172.21.15.2:0/153039761 >> 172.21.15.2:0/153039761 conn(0x7fcfec0fb190 msgr2=0x7fcfec0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.154+0000 7fcff2e61700 1 -- 172.21.15.2:0/153039761 shutdown_connections 2024-09-13T22:53:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.154+0000 7fcff2e61700 1 -- 172.21.15.2:0/153039761 wait complete. 2024-09-13T22:53:24.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:24 smithi002 ceph-mon[27637]: mds.? [v2:172.21.15.2:6826/1577962179,v1:172.21.15.2:6827/1577962179] up:boot 2024-09-13T22:53:24.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:24 smithi002 ceph-mon[27637]: mds.? [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] up:reconnect 2024-09-13T22:53:24.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:24 smithi002 ceph-mon[27637]: fsmap cephfs:1/1 {0=cephfs.smithi047.gxzkha=up:reconnect} 3 up:standby 2024-09-13T22:53:24.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.auedll"}]: dispatch 2024-09-13T22:53:24.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.154+0000 7fcff2e61700 1 Processor -- start 2024-09-13T22:53:24.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.154+0000 7fcff2e61700 1 -- start start 2024-09-13T22:53:24.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.155+0000 7fcff2e61700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfec1017a0 0x7fcfec196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:24.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.155+0000 7fcff2e61700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec1040d0 0x7fcfec1969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:24.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.155+0000 7fcff2e61700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec196fc0 con 0x7fcfec1040d0 2024-09-13T22:53:24.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.155+0000 7fcff2e61700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec197100 con 0x7fcfec1017a0 2024-09-13T22:53:24.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.155+0000 7fcfebfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec1040d0 0x7fcfec1969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:24.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.155+0000 7fcfebfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec1040d0 0x7fcfec1969a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57640/0 (socket says 172.21.15.2:57640) 2024-09-13T22:53:24.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.155+0000 7fcfebfff700 1 -- 172.21.15.2:0/1905426820 learned_addr learned my addr 172.21.15.2:0/1905426820 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:53:24.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.155+0000 7fcff0bfd700 1 --2- 172.21.15.2:0/1905426820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfec1017a0 0x7fcfec196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:24.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.155+0000 7fcfebfff700 1 -- 172.21.15.2:0/1905426820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfec1017a0 msgr2=0x7fcfec196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:24.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.155+0000 7fcfebfff700 1 --2- 172.21.15.2:0/1905426820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfec1017a0 0x7fcfec196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:24.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.155+0000 7fcfebfff700 1 -- 172.21.15.2:0/1905426820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe00095f0 con 0x7fcfec1040d0 2024-09-13T22:53:24.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.156+0000 7fcfebfff700 1 --2- 172.21.15.2:0/1905426820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec1040d0 0x7fcfec1969a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800d8d0 tx=0x7fcfd800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:24.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.156+0000 7fcfe9ffb700 1 -- 172.21.15.2:0/1905426820 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfd8009940 con 0x7fcfec1040d0 2024-09-13T22:53:24.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.156+0000 7fcff2e61700 1 -- 172.21.15.2:0/1905426820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfec19bbb0 con 0x7fcfec1040d0 2024-09-13T22:53:24.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.156+0000 7fcfe9ffb700 1 -- 172.21.15.2:0/1905426820 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcfd8010460 con 0x7fcfec1040d0 2024-09-13T22:53:24.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.156+0000 7fcff2e61700 1 -- 172.21.15.2:0/1905426820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec19c100 con 0x7fcfec1040d0 2024-09-13T22:53:24.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.156+0000 7fcfe9ffb700 1 -- 172.21.15.2:0/1905426820 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfd800f5f0 con 0x7fcfec1040d0 2024-09-13T22:53:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.158+0000 7fcfe9ffb700 1 -- 172.21.15.2:0/1905426820 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fcfd800f7e0 con 0x7fcfec1040d0 2024-09-13T22:53:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.158+0000 7fcff2e61700 1 -- 172.21.15.2:0/1905426820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd0005320 con 0x7fcfec1040d0 2024-09-13T22:53:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.159+0000 7fcfe9ffb700 1 --2- 172.21.15.2:0/1905426820 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fcfdc06c4e0 0x7fcfdc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.159+0000 7fcfe9ffb700 1 -- 172.21.15.2:0/1905426820 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fcfd808b650 con 0x7fcfec1040d0 2024-09-13T22:53:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.159+0000 7fcff0bfd700 1 --2- 172.21.15.2:0/1905426820 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fcfdc06c4e0 0x7fcfdc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.159+0000 7fcff0bfd700 1 --2- 172.21.15.2:0/1905426820 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fcfdc06c4e0 0x7fcfdc06e9a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0006010 tx=0x7fcfe000b580 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:24.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.168+0000 7fcfe9ffb700 1 -- 172.21.15.2:0/1905426820 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fcfd8059700 con 0x7fcfec1040d0 2024-09-13T22:53:24.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.410+0000 7fcff2e61700 1 -- 172.21.15.2:0/1905426820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcfd0006200 con 0x7fcfec1040d0 2024-09-13T22:53:24.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:24 smithi047 ceph-mon[34560]: mds.? [v2:172.21.15.2:6826/1577962179,v1:172.21.15.2:6827/1577962179] up:boot 2024-09-13T22:53:24.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:24 smithi047 ceph-mon[34560]: mds.? [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] up:reconnect 2024-09-13T22:53:24.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:24 smithi047 ceph-mon[34560]: fsmap cephfs:1/1 {0=cephfs.smithi047.gxzkha=up:reconnect} 3 up:standby 2024-09-13T22:53:24.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:24 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.auedll"}]: dispatch 2024-09-13T22:53:24.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.411+0000 7fcfe9ffb700 1 -- 172.21.15.2:0/1905426820 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1828 (secure 0 0 0) 0x7fcfd8016740 con 0x7fcfec1040d0 2024-09-13T22:53:24.414 INFO:teuthology.orchestra.run.smithi002.stdout:e14 2024-09-13T22:53:24.414 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:53:24.414 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:53:24.414 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-13T22:53:24.414 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:53:24.414 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-13T22:53:24.414 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-13T22:53:24.414 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 14 2024-09-13T22:53:24.414 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T22:53:24.414 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-13T22:53:05.963265+0000 2024-09-13T22:53:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-13T22:53:24.063289+0000 2024-09-13T22:53:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-13T22:53:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-13T22:53:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-13T22:53:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-13T22:53:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-13T22:53:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-13T22:53:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-13T22:53:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 47 2024-09-13T22:53:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:53:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 1 2024-09-13T22:53:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:in 0 2024-09-13T22:53:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24267} 2024-09-13T22:53:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-13T22:53:24.415 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-13T22:53:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-13T22:53:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-13T22:53:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-13T22:53:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-13T22:53:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-13T22:53:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-13T22:53:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-13T22:53:24.416 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.gxzkha{0:24267} state up:rejoin seq 5 join_fscid=1 addr [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:53:24.416 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:53:24.416 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:53:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-13T22:53:24.417 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:53:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.gglyyr{-1:14488} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.2:6828/2123560657,v1:172.21.15.2:6829/2123560657] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:53:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.auedll{-1:14500} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/1577962179,v1:172.21.15.2:6827/1577962179] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:53:24.417 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.nqvveh{-1:24277} state up:standby seq 1 addr [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:53:24.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.413+0000 7fcff2e61700 1 -- 172.21.15.2:0/1905426820 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fcfdc06c4e0 msgr2=0x7fcfdc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:24.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.413+0000 7fcff2e61700 1 --2- 172.21.15.2:0/1905426820 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fcfdc06c4e0 0x7fcfdc06e9a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0006010 tx=0x7fcfe000b580 comp rx=0 tx=0).stop 2024-09-13T22:53:24.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.413+0000 7fcff2e61700 1 -- 172.21.15.2:0/1905426820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec1040d0 msgr2=0x7fcfec1969a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:24.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.413+0000 7fcff2e61700 1 --2- 172.21.15.2:0/1905426820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec1040d0 0x7fcfec1969a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800d8d0 tx=0x7fcfd800dc90 comp rx=0 tx=0).stop 2024-09-13T22:53:24.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.413+0000 7fcff2e61700 1 -- 172.21.15.2:0/1905426820 shutdown_connections 2024-09-13T22:53:24.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.413+0000 7fcff2e61700 1 --2- 172.21.15.2:0/1905426820 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fcfdc06c4e0 0x7fcfdc06e9a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:24.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.413+0000 7fcff2e61700 1 --2- 172.21.15.2:0/1905426820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfec1017a0 0x7fcfec196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:24.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.413+0000 7fcff2e61700 1 --2- 172.21.15.2:0/1905426820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfec1040d0 0x7fcfec1969a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:24.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.413+0000 7fcff2e61700 1 -- 172.21.15.2:0/1905426820 >> 172.21.15.2:0/1905426820 conn(0x7fcfec0fb190 msgr2=0x7fcfec0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:24.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.413+0000 7fcff2e61700 1 -- 172.21.15.2:0/1905426820 shutdown_connections 2024-09-13T22:53:24.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:24.413+0000 7fcff2e61700 1 -- 172.21.15.2:0/1905426820 wait complete. 2024-09-13T22:53:24.419 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 14 2024-09-13T22:53:25.186 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:25 smithi002 ceph-mon[27637]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 614 B/s wr, 3 op/s 2024-09-13T22:53:25.186 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:25 smithi002 ceph-mon[27637]: mds.? [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] up:rejoin 2024-09-13T22:53:25.186 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:25 smithi002 ceph-mon[27637]: fsmap cephfs:1/1 {0=cephfs.smithi047.gxzkha=up:rejoin} 3 up:standby 2024-09-13T22:53:25.186 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:25 smithi002 ceph-mon[27637]: daemon mds.cephfs.smithi047.gxzkha is now active in filesystem cephfs as rank 0 2024-09-13T22:53:25.186 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:25 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/1905426820' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:53:25.218 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-13T22:53:25.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:25 smithi047 ceph-mon[34560]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 614 B/s wr, 3 op/s 2024-09-13T22:53:25.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:25 smithi047 ceph-mon[34560]: mds.? [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] up:rejoin 2024-09-13T22:53:25.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:25 smithi047 ceph-mon[34560]: fsmap cephfs:1/1 {0=cephfs.smithi047.gxzkha=up:rejoin} 3 up:standby 2024-09-13T22:53:25.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:25 smithi047 ceph-mon[34560]: daemon mds.cephfs.smithi047.gxzkha is now active in filesystem cephfs as rank 0 2024-09-13T22:53:25.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:25 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/1905426820' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:53:25.575 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:53:26.384 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:26 smithi002 ceph-mon[27637]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T22:53:26.384 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:26 smithi002 ceph-mon[27637]: mds.? [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] up:active 2024-09-13T22:53:26.384 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:26 smithi002 ceph-mon[27637]: mds.? [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] up:standby 2024-09-13T22:53:26.384 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:26 smithi002 ceph-mon[27637]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 3 up:standby 2024-09-13T22:53:26.384 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:26 smithi002 ceph-mon[27637]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T22:53:26.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:26 smithi047 ceph-mon[34560]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T22:53:26.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:26 smithi047 ceph-mon[34560]: mds.? [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] up:active 2024-09-13T22:53:26.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:26 smithi047 ceph-mon[34560]: mds.? [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] up:standby 2024-09-13T22:53:26.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:26 smithi047 ceph-mon[34560]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 3 up:standby 2024-09-13T22:53:26.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:26 smithi047 ceph-mon[34560]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T22:53:27.381 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:27 smithi002 ceph-mon[27637]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 409 B/s wr, 3 op/s 2024-09-13T22:53:27.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:27 smithi047 ceph-mon[34560]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 409 B/s wr, 3 op/s 2024-09-13T22:53:28.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.729+0000 7f1806e70700 1 -- 172.21.15.2:0/4153814305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1800101ea0 msgr2=0x7f1800102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:28.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.729+0000 7f1806e70700 1 --2- 172.21.15.2:0/4153814305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1800101ea0 0x7f1800102300 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f17f0009910 tx=0x7f17f0009c20 comp rx=0 tx=0).stop 2024-09-13T22:53:28.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.729+0000 7f1806e70700 1 -- 172.21.15.2:0/4153814305 shutdown_connections 2024-09-13T22:53:28.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.729+0000 7f1806e70700 1 --2- 172.21.15.2:0/4153814305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1800101ea0 0x7f1800102300 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:28.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.729+0000 7f1806e70700 1 --2- 172.21.15.2:0/4153814305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1800100ca0 0x7f18001010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:28.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.729+0000 7f1806e70700 1 -- 172.21.15.2:0/4153814305 >> 172.21.15.2:0/4153814305 conn(0x7f18000fc260 msgr2=0x7f18000fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:28.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.729+0000 7f1806e70700 1 -- 172.21.15.2:0/4153814305 shutdown_connections 2024-09-13T22:53:28.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.729+0000 7f1806e70700 1 -- 172.21.15.2:0/4153814305 wait complete. 2024-09-13T22:53:28.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.730+0000 7f1806e70700 1 Processor -- start 2024-09-13T22:53:28.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.730+0000 7f1806e70700 1 -- start start 2024-09-13T22:53:28.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.730+0000 7f1806e70700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1800100ca0 0x7f1800074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:28.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.730+0000 7f1806e70700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1800101ea0 0x7f1800073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:28.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.730+0000 7f1806e70700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18000736c0 con 0x7f1800100ca0 2024-09-13T22:53:28.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.730+0000 7f1806e70700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1800073800 con 0x7f1800101ea0 2024-09-13T22:53:28.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.730+0000 7f1804c0c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1800100ca0 0x7f1800074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:28.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.730+0000 7f1804c0c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1800100ca0 0x7f1800074b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57654/0 (socket says 172.21.15.2:57654) 2024-09-13T22:53:28.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.730+0000 7f1804c0c700 1 -- 172.21.15.2:0/2674565760 learned_addr learned my addr 172.21.15.2:0/2674565760 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:53:28.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.730+0000 7f1804c0c700 1 -- 172.21.15.2:0/2674565760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1800101ea0 msgr2=0x7f1800073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:28.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.730+0000 7f1804c0c700 1 --2- 172.21.15.2:0/2674565760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1800101ea0 0x7f1800073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:28.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.730+0000 7f1804c0c700 1 -- 172.21.15.2:0/2674565760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f00095f0 con 0x7f1800100ca0 2024-09-13T22:53:28.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.730+0000 7f1804c0c700 1 --2- 172.21.15.2:0/2674565760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1800100ca0 0x7f1800074b30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00b9c0 tx=0x7f17fc00bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:28.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.731+0000 7f17f5ffb700 1 -- 172.21.15.2:0/2674565760 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17fc00c980 con 0x7f1800100ca0 2024-09-13T22:53:28.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.731+0000 7f1806e70700 1 -- 172.21.15.2:0/2674565760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1800073ae0 con 0x7f1800100ca0 2024-09-13T22:53:28.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.731+0000 7f17f5ffb700 1 -- 172.21.15.2:0/2674565760 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f17fc014440 con 0x7f1800100ca0 2024-09-13T22:53:28.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.731+0000 7f17f5ffb700 1 -- 172.21.15.2:0/2674565760 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17fc012550 con 0x7f1800100ca0 2024-09-13T22:53:28.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.731+0000 7f1806e70700 1 -- 172.21.15.2:0/2674565760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180019e580 con 0x7f1800100ca0 2024-09-13T22:53:28.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.732+0000 7f1806e70700 1 -- 172.21.15.2:0/2674565760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18001098a0 con 0x7f1800100ca0 2024-09-13T22:53:28.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.732+0000 7f17f5ffb700 1 -- 172.21.15.2:0/2674565760 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f17fc0145b0 con 0x7f1800100ca0 2024-09-13T22:53:28.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.733+0000 7f17f5ffb700 1 --2- 172.21.15.2:0/2674565760 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f17e806c4e0 0x7f17e806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:28.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.733+0000 7f17f7fff700 1 --2- 172.21.15.2:0/2674565760 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f17e806c4e0 0x7f17e806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:28.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.733+0000 7f17f5ffb700 1 -- 172.21.15.2:0/2674565760 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f17fc006e40 con 0x7f1800100ca0 2024-09-13T22:53:28.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.733+0000 7f17f7fff700 1 --2- 172.21.15.2:0/2674565760 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f17e806c4e0 0x7f17e806e9a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f17f000b5c0 tx=0x7f17f0005960 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:28.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.740+0000 7f17f5ffb700 1 -- 172.21.15.2:0/2674565760 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f17fc059270 con 0x7f1800100ca0 2024-09-13T22:53:28.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.984+0000 7f1806e70700 1 -- 172.21.15.2:0/2674565760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f180019eb30 con 0x7f1800100ca0 2024-09-13T22:53:28.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.984+0000 7f17f5ffb700 1 -- 172.21.15.2:0/2674565760 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4741 (secure 0 0 0) 0x7f17fc058e00 con 0x7f1800100ca0 2024-09-13T22:53:28.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.986+0000 7f1806e70700 1 -- 172.21.15.2:0/2674565760 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f17e806c4e0 msgr2=0x7f17e806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:28.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.986+0000 7f1806e70700 1 --2- 172.21.15.2:0/2674565760 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f17e806c4e0 0x7f17e806e9a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f17f000b5c0 tx=0x7f17f0005960 comp rx=0 tx=0).stop 2024-09-13T22:53:28.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.986+0000 7f1806e70700 1 -- 172.21.15.2:0/2674565760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1800100ca0 msgr2=0x7f1800074b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:28.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.986+0000 7f1806e70700 1 --2- 172.21.15.2:0/2674565760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1800100ca0 0x7f1800074b30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00b9c0 tx=0x7f17fc00bd80 comp rx=0 tx=0).stop 2024-09-13T22:53:28.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.986+0000 7f1806e70700 1 -- 172.21.15.2:0/2674565760 shutdown_connections 2024-09-13T22:53:28.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.986+0000 7f1806e70700 1 --2- 172.21.15.2:0/2674565760 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f17e806c4e0 0x7f17e806e9a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:28.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.987+0000 7f1806e70700 1 --2- 172.21.15.2:0/2674565760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1800100ca0 0x7f1800074b30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:28.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.987+0000 7f1806e70700 1 --2- 172.21.15.2:0/2674565760 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1800101ea0 0x7f1800073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:28.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.987+0000 7f1806e70700 1 -- 172.21.15.2:0/2674565760 >> 172.21.15.2:0/2674565760 conn(0x7f18000fc260 msgr2=0x7f18001050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:28.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.987+0000 7f1806e70700 1 -- 172.21.15.2:0/2674565760 shutdown_connections 2024-09-13T22:53:28.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:28.987+0000 7f1806e70700 1 -- 172.21.15.2:0/2674565760 wait complete. 2024-09-13T22:53:28.988 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2024-09-13T22:53:28.998 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T22:53:29.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:29 smithi002 ceph-mon[27637]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.0 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-13T22:53:29.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:29 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2674565760' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T22:53:29.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:29 smithi047 ceph-mon[34560]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.0 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-13T22:53:29.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:29 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/2674565760' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T22:53:29.670 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-13T22:53:29.911 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:53:31.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:30 smithi047 ceph-mon[34560]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 9.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T22:53:31.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:30 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:31.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:30 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:31.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:30 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:53:31.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:30 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:53:31.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:30 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:31.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:30 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:53:31.193 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:30 smithi002 ceph-mon[27637]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 9.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T22:53:31.194 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:30 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:31.194 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:30 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:31.194 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:30 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:53:31.194 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:30 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:53:31.194 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:30 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:31.194 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:30 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:53:31.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.546+0000 7f1ca83d0700 1 -- 172.21.15.2:0/4294951469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ca0100e10 msgr2=0x7f1ca0101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:31.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.546+0000 7f1ca83d0700 1 --2- 172.21.15.2:0/4294951469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ca0100e10 0x7f1ca0101270 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009910 tx=0x7f1c90009c20 comp rx=0 tx=0).stop 2024-09-13T22:53:31.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.546+0000 7f1ca83d0700 1 -- 172.21.15.2:0/4294951469 shutdown_connections 2024-09-13T22:53:31.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.546+0000 7f1ca83d0700 1 --2- 172.21.15.2:0/4294951469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ca0100e10 0x7f1ca0101270 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:31.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.546+0000 7f1ca83d0700 1 --2- 172.21.15.2:0/4294951469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ca00ffc10 0x7f1ca0100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:31.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.546+0000 7f1ca83d0700 1 -- 172.21.15.2:0/4294951469 >> 172.21.15.2:0/4294951469 conn(0x7f1ca00fb190 msgr2=0x7f1ca00fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:31.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.546+0000 7f1ca83d0700 1 -- 172.21.15.2:0/4294951469 shutdown_connections 2024-09-13T22:53:31.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.546+0000 7f1ca83d0700 1 -- 172.21.15.2:0/4294951469 wait complete. 2024-09-13T22:53:31.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.546+0000 7f1ca83d0700 1 Processor -- start 2024-09-13T22:53:31.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.546+0000 7f1ca83d0700 1 -- start start 2024-09-13T22:53:31.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.547+0000 7f1ca83d0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ca00ffc10 0x7f1ca0107bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:31.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.547+0000 7f1ca83d0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ca0100e10 0x7f1ca0106210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:31.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.547+0000 7f1ca83d0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca0106750 con 0x7f1ca00ffc10 2024-09-13T22:53:31.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.547+0000 7f1ca83d0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca0106890 con 0x7f1ca0100e10 2024-09-13T22:53:31.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.547+0000 7f1ca616c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ca00ffc10 0x7f1ca0107bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:31.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.547+0000 7f1ca616c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ca00ffc10 0x7f1ca0107bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53578/0 (socket says 172.21.15.2:53578) 2024-09-13T22:53:31.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.547+0000 7f1ca596b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ca0100e10 0x7f1ca0106210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:31.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.547+0000 7f1ca616c700 1 -- 172.21.15.2:0/2746546325 learned_addr learned my addr 172.21.15.2:0/2746546325 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:53:31.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.547+0000 7f1ca616c700 1 -- 172.21.15.2:0/2746546325 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ca0100e10 msgr2=0x7f1ca0106210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:31.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.547+0000 7f1ca616c700 1 --2- 172.21.15.2:0/2746546325 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ca0100e10 0x7f1ca0106210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:31.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.547+0000 7f1ca616c700 1 -- 172.21.15.2:0/2746546325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c900095f0 con 0x7f1ca00ffc10 2024-09-13T22:53:31.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.547+0000 7f1ca596b700 1 --2- 172.21.15.2:0/2746546325 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ca0100e10 0x7f1ca0106210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T22:53:31.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.547+0000 7f1ca616c700 1 --2- 172.21.15.2:0/2746546325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ca00ffc10 0x7f1ca0107bc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00e8f0 tx=0x7f1c9c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:31.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.547+0000 7f1c977fe700 1 -- 172.21.15.2:0/2746546325 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c9c009790 con 0x7f1ca00ffc10 2024-09-13T22:53:31.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.547+0000 7f1ca83d0700 1 -- 172.21.15.2:0/2746546325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca0106b70 con 0x7f1ca00ffc10 2024-09-13T22:53:31.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.547+0000 7f1c977fe700 1 -- 172.21.15.2:0/2746546325 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1c9c00c810 con 0x7f1ca00ffc10 2024-09-13T22:53:31.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.547+0000 7f1c977fe700 1 -- 172.21.15.2:0/2746546325 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c9c003d20 con 0x7f1ca00ffc10 2024-09-13T22:53:31.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.548+0000 7f1ca83d0700 1 -- 172.21.15.2:0/2746546325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca019e500 con 0x7f1ca00ffc10 2024-09-13T22:53:31.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.548+0000 7f1c957fa700 1 -- 172.21.15.2:0/2746546325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c880052f0 con 0x7f1ca00ffc10 2024-09-13T22:53:31.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.549+0000 7f1c977fe700 1 -- 172.21.15.2:0/2746546325 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f1c9c0041f0 con 0x7f1ca00ffc10 2024-09-13T22:53:31.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.550+0000 7f1c977fe700 1 --2- 172.21.15.2:0/2746546325 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1c8c06c4e0 0x7f1c8c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:31.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.550+0000 7f1c977fe700 1 -- 172.21.15.2:0/2746546325 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f1c9c014070 con 0x7f1ca00ffc10 2024-09-13T22:53:31.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.550+0000 7f1ca596b700 1 --2- 172.21.15.2:0/2746546325 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1c8c06c4e0 0x7f1c8c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:31.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.550+0000 7f1ca596b700 1 --2- 172.21.15.2:0/2746546325 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1c8c06c4e0 0x7f1c8c06e9a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009fd0 tx=0x7f1c90005940 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:31.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.554+0000 7f1c977fe700 1 -- 172.21.15.2:0/2746546325 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1c9c059d90 con 0x7f1ca00ffc10 2024-09-13T22:53:31.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.840+0000 7f1c957fa700 1 -- 172.21.15.2:0/2746546325 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f1c88005160 con 0x7f1ca00ffc10 2024-09-13T22:53:31.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.840+0000 7f1c977fe700 1 -- 172.21.15.2:0/2746546325 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v16) v1 ==== 78+0+83 (secure 0 0 0) 0x7f1c9c059920 con 0x7f1ca00ffc10 2024-09-13T22:53:31.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.842+0000 7f1c957fa700 1 -- 172.21.15.2:0/2746546325 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1c8c06c4e0 msgr2=0x7f1c8c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:31.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.842+0000 7f1c957fa700 1 --2- 172.21.15.2:0/2746546325 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1c8c06c4e0 0x7f1c8c06e9a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009fd0 tx=0x7f1c90005940 comp rx=0 tx=0).stop 2024-09-13T22:53:31.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.842+0000 7f1c957fa700 1 -- 172.21.15.2:0/2746546325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ca00ffc10 msgr2=0x7f1ca0107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:31.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.842+0000 7f1c957fa700 1 --2- 172.21.15.2:0/2746546325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ca00ffc10 0x7f1ca0107bc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00e8f0 tx=0x7f1c9c00ec00 comp rx=0 tx=0).stop 2024-09-13T22:53:31.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.842+0000 7f1c957fa700 1 -- 172.21.15.2:0/2746546325 shutdown_connections 2024-09-13T22:53:31.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.842+0000 7f1c957fa700 1 --2- 172.21.15.2:0/2746546325 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f1c8c06c4e0 0x7f1c8c06e9a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:31.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.842+0000 7f1c957fa700 1 --2- 172.21.15.2:0/2746546325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ca00ffc10 0x7f1ca0107bc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:31.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.842+0000 7f1c957fa700 1 --2- 172.21.15.2:0/2746546325 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ca0100e10 0x7f1ca0106210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:31.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.842+0000 7f1c957fa700 1 -- 172.21.15.2:0/2746546325 >> 172.21.15.2:0/2746546325 conn(0x7f1ca00fb190 msgr2=0x7f1ca0104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:31.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.843+0000 7f1c957fa700 1 -- 172.21.15.2:0/2746546325 shutdown_connections 2024-09-13T22:53:31.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:31.843+0000 7f1c957fa700 1 -- 172.21.15.2:0/2746546325 wait complete. 2024-09-13T22:53:31.855 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T22:53:32.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:31 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2746546325' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T22:53:32.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:31 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/2746546325' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T22:53:32.923 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-13T22:53:32.936 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-13T22:53:33.466 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:33 smithi047 ceph-mon[34560]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 9.6 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-13T22:53:33.466 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:33 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:33.466 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:33 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:33.467 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:33 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:33.467 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:33 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:53:33.494 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:33 smithi002 ceph-mon[27637]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 9.6 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-13T22:53:33.494 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:33 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:33.494 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:33 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:33.494 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:33 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:33.494 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:33 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:53:33.805 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:53:35.446 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:35 smithi002 ceph-mon[27637]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T22:53:35.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:35 smithi047 ceph-mon[34560]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T22:53:37.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:36 smithi002 ceph-mon[27637]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.5 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-13T22:53:37.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:36 smithi047 ceph-mon[34560]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.5 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-13T22:53:37.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.442+0000 7f48f3587700 1 -- 172.21.15.2:0/2847017500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48ec0ff5a0 msgr2=0x7f48ec0ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:37.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.442+0000 7f48f3587700 1 --2- 172.21.15.2:0/2847017500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48ec0ff5a0 0x7f48ec0ff980 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009910 tx=0x7f48e8009c20 comp rx=0 tx=0).stop 2024-09-13T22:53:37.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.442+0000 7f48f3587700 1 -- 172.21.15.2:0/2847017500 shutdown_connections 2024-09-13T22:53:37.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.442+0000 7f48f3587700 1 --2- 172.21.15.2:0/2847017500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48ec0fff50 0x7f48ec105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:37.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.442+0000 7f48f3587700 1 --2- 172.21.15.2:0/2847017500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48ec0ff5a0 0x7f48ec0ff980 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:37.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.442+0000 7f48f3587700 1 -- 172.21.15.2:0/2847017500 >> 172.21.15.2:0/2847017500 conn(0x7f48ec074e30 msgr2=0x7f48ec075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:37.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.442+0000 7f48f3587700 1 -- 172.21.15.2:0/2847017500 shutdown_connections 2024-09-13T22:53:37.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.442+0000 7f48f3587700 1 -- 172.21.15.2:0/2847017500 wait complete. 2024-09-13T22:53:37.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.443+0000 7f48f3587700 1 Processor -- start 2024-09-13T22:53:37.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.443+0000 7f48f3587700 1 -- start start 2024-09-13T22:53:37.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.443+0000 7f48f3587700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48ec0ff5a0 0x7f48ec19c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:37.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.443+0000 7f48f3587700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48ec0fff50 0x7f48ec19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:37.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.443+0000 7f48f3587700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec19d250 con 0x7f48ec0fff50 2024-09-13T22:53:37.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.443+0000 7f48f3587700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec196700 con 0x7f48ec0ff5a0 2024-09-13T22:53:37.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.443+0000 7f48f0b22700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48ec0fff50 0x7f48ec19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:37.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.443+0000 7f48f0b22700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48ec0fff50 0x7f48ec19cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53602/0 (socket says 172.21.15.2:53602) 2024-09-13T22:53:37.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.443+0000 7f48f1323700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48ec0ff5a0 0x7f48ec19c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:37.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.443+0000 7f48f0b22700 1 -- 172.21.15.2:0/2453493762 learned_addr learned my addr 172.21.15.2:0/2453493762 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:53:37.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.444+0000 7f48f1323700 1 -- 172.21.15.2:0/2453493762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48ec0fff50 msgr2=0x7f48ec19cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:37.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.444+0000 7f48f1323700 1 --2- 172.21.15.2:0/2453493762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48ec0fff50 0x7f48ec19cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:37.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.444+0000 7f48f1323700 1 -- 172.21.15.2:0/2453493762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e80095f0 con 0x7f48ec0ff5a0 2024-09-13T22:53:37.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.444+0000 7f48f0b22700 1 --2- 172.21.15.2:0/2453493762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48ec0fff50 0x7f48ec19cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T22:53:37.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.444+0000 7f48f1323700 1 --2- 172.21.15.2:0/2453493762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48ec0ff5a0 0x7f48ec19c680 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009fd0 tx=0x7f48e800fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:37.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.444+0000 7f48e27fc700 1 -- 172.21.15.2:0/2453493762 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48e801d070 con 0x7f48ec0ff5a0 2024-09-13T22:53:37.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.444+0000 7f48f3587700 1 -- 172.21.15.2:0/2453493762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ec196980 con 0x7f48ec0ff5a0 2024-09-13T22:53:37.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.444+0000 7f48e27fc700 1 -- 172.21.15.2:0/2453493762 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f48e8005640 con 0x7f48ec0ff5a0 2024-09-13T22:53:37.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.444+0000 7f48e27fc700 1 -- 172.21.15.2:0/2453493762 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48e8022470 con 0x7f48ec0ff5a0 2024-09-13T22:53:37.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.444+0000 7f48f3587700 1 -- 172.21.15.2:0/2453493762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ec196e70 con 0x7f48ec0ff5a0 2024-09-13T22:53:37.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.445+0000 7f48f3587700 1 -- 172.21.15.2:0/2453493762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ec109270 con 0x7f48ec0ff5a0 2024-09-13T22:53:37.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.446+0000 7f48e27fc700 1 -- 172.21.15.2:0/2453493762 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f48e8003680 con 0x7f48ec0ff5a0 2024-09-13T22:53:37.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.446+0000 7f48e27fc700 1 --2- 172.21.15.2:0/2453493762 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f48d806c4e0 0x7f48d806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:37.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.446+0000 7f48e27fc700 1 -- 172.21.15.2:0/2453493762 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f48e808cbd0 con 0x7f48ec0ff5a0 2024-09-13T22:53:37.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.447+0000 7f48f0b22700 1 --2- 172.21.15.2:0/2453493762 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f48d806c4e0 0x7f48d806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:37.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.447+0000 7f48f0b22700 1 --2- 172.21.15.2:0/2453493762 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f48d806c4e0 0x7f48d806e9a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f48ec197b70 tx=0x7f48dc009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:37.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.452+0000 7f48e27fc700 1 -- 172.21.15.2:0/2453493762 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f48e805af10 con 0x7f48ec0ff5a0 2024-09-13T22:53:37.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.727+0000 7f48f3587700 1 -- 172.21.15.2:0/2453493762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48ec04f2e0 con 0x7f48ec0ff5a0 2024-09-13T22:53:37.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.728+0000 7f48e27fc700 1 -- 172.21.15.2:0/2453493762 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4741 (secure 0 0 0) 0x7f48e805aaa0 con 0x7f48ec0ff5a0 2024-09-13T22:53:37.729 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:53:37.730 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14500,"name":"cephfs.smithi002.auedll","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/1577962179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1577962179},{"type":"v1","addr":"172.21.15.2:6827","nonce":1577962179}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24277,"name":"cephfs.smithi047.nqvveh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.47:6827/2007272492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2007272492},{"type":"v1","addr":"172.21.15.47:6827","nonce":2007272492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":16,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T22:53:25.072026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14488":{"gid":14488,"name":"cephfs.smithi002.gglyyr","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.2:6829/2123560657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2123560657},{"type":"v1","addr":"172.21.15.2:6829","nonce":2123560657}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24267":{"gid":24267,"name":"cephfs.smithi047.gxzkha","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.47:6825/2157973647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2157973647},{"type":"v1","addr":"172.21.15.47:6825","nonce":2157973647}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T22:53:37.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.732+0000 7f48f3587700 1 -- 172.21.15.2:0/2453493762 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f48d806c4e0 msgr2=0x7f48d806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:37.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.732+0000 7f48f3587700 1 --2- 172.21.15.2:0/2453493762 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f48d806c4e0 0x7f48d806e9a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f48ec197b70 tx=0x7f48dc009260 comp rx=0 tx=0).stop 2024-09-13T22:53:37.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.732+0000 7f48f3587700 1 -- 172.21.15.2:0/2453493762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48ec0ff5a0 msgr2=0x7f48ec19c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:37.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.732+0000 7f48f3587700 1 --2- 172.21.15.2:0/2453493762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48ec0ff5a0 0x7f48ec19c680 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009fd0 tx=0x7f48e800fa00 comp rx=0 tx=0).stop 2024-09-13T22:53:37.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.732+0000 7f48f3587700 1 -- 172.21.15.2:0/2453493762 shutdown_connections 2024-09-13T22:53:37.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.732+0000 7f48f3587700 1 --2- 172.21.15.2:0/2453493762 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f48d806c4e0 0x7f48d806e9a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:37.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.732+0000 7f48f3587700 1 --2- 172.21.15.2:0/2453493762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48ec0ff5a0 0x7f48ec19c680 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:37.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.732+0000 7f48f3587700 1 --2- 172.21.15.2:0/2453493762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48ec0fff50 0x7f48ec19cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:37.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.732+0000 7f48f3587700 1 -- 172.21.15.2:0/2453493762 >> 172.21.15.2:0/2453493762 conn(0x7f48ec074e30 msgr2=0x7f48ec0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:37.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.732+0000 7f48f3587700 1 -- 172.21.15.2:0/2453493762 shutdown_connections 2024-09-13T22:53:37.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:37.732+0000 7f48f3587700 1 -- 172.21.15.2:0/2453493762 wait complete. 2024-09-13T22:53:37.734 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2024-09-13T22:53:38.352 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 1, 'flags': 50} 2024-09-13T22:53:38.352 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-13T22:53:38.383 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-13T22:53:38.384 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-13T22:53:38.384 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-13T22:53:38.384 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T22:53:38.384 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T22:53:38.384 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-13T22:53:38.384 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T22:53:38.384 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T22:53:38.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:38.385 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-09-13T22:53:38.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:38.406 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-09-13T22:53:38.482 INFO:teuthology.orchestra.run.smithi047.stderr:Cannot find device "ceph-brx" 2024-09-13T22:53:38.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:53:38.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:38.483 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-13T22:53:38.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:38.501 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-09-13T22:53:38.571 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2024-09-13T22:53:38.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T22:53:38.573 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-13T22:53:38.573 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T22:53:38.573 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T22:53:38.822 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:53:38.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:38 smithi047 ceph-mon[34560]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T22:53:38.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:38 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:38.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:38 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:38.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:38 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:53:38.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:38 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:53:38.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:38 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:38.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:38 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/2453493762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T22:53:38.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:38 smithi002 ceph-mon[27637]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T22:53:38.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:38 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:38.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:38 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:38.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:38 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:53:38.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:38 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:53:38.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:38 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:53:38.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:38 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2453493762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T22:53:40.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.548+0000 7f497861e700 1 -- 172.21.15.2:0/1249985117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4970100310 msgr2=0x7f497010d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:40.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.548+0000 7f497861e700 1 --2- 172.21.15.2:0/1249985117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4970100310 0x7f497010d060 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4960009910 tx=0x7f4960009c20 comp rx=0 tx=0).stop 2024-09-13T22:53:40.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.548+0000 7f497861e700 1 -- 172.21.15.2:0/1249985117 shutdown_connections 2024-09-13T22:53:40.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.548+0000 7f497861e700 1 --2- 172.21.15.2:0/1249985117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4970100310 0x7f497010d060 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:40.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.548+0000 7f497861e700 1 --2- 172.21.15.2:0/1249985117 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49700ff9f0 0x7f49700ffdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:40.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.548+0000 7f497861e700 1 -- 172.21.15.2:0/1249985117 >> 172.21.15.2:0/1249985117 conn(0x7f49700fb650 msgr2=0x7f49700fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:40.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.549+0000 7f497861e700 1 -- 172.21.15.2:0/1249985117 shutdown_connections 2024-09-13T22:53:40.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.549+0000 7f497861e700 1 -- 172.21.15.2:0/1249985117 wait complete. 2024-09-13T22:53:40.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.549+0000 7f497861e700 1 Processor -- start 2024-09-13T22:53:40.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.549+0000 7f497861e700 1 -- start start 2024-09-13T22:53:40.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.550+0000 7f497861e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49700ff9f0 0x7f497019e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:40.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.550+0000 7f497861e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4970100310 0x7f497019ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:40.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.550+0000 7f497861e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497019f520 con 0x7f4970100310 2024-09-13T22:53:40.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.550+0000 7f497861e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49701989d0 con 0x7f49700ff9f0 2024-09-13T22:53:40.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.550+0000 7f4975bb9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4970100310 0x7f497019ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:40.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.550+0000 7f4975bb9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4970100310 0x7f497019ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43942/0 (socket says 172.21.15.2:43942) 2024-09-13T22:53:40.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.550+0000 7f4975bb9700 1 -- 172.21.15.2:0/3347005015 learned_addr learned my addr 172.21.15.2:0/3347005015 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:53:40.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.550+0000 7f49763ba700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49700ff9f0 0x7f497019e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:40.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.550+0000 7f4975bb9700 1 -- 172.21.15.2:0/3347005015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49700ff9f0 msgr2=0x7f497019e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:40.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.550+0000 7f4975bb9700 1 --2- 172.21.15.2:0/3347005015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49700ff9f0 0x7f497019e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:40.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.550+0000 7f4975bb9700 1 -- 172.21.15.2:0/3347005015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49600095f0 con 0x7f4970100310 2024-09-13T22:53:40.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.550+0000 7f4975bb9700 1 --2- 172.21.15.2:0/3347005015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4970100310 0x7f497019ee90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f496000b850 tx=0x7f49600055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:40.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.550+0000 7f49677fe700 1 -- 172.21.15.2:0/3347005015 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f496001d070 con 0x7f4970100310 2024-09-13T22:53:40.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.551+0000 7f49677fe700 1 -- 172.21.15.2:0/3347005015 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f496000f460 con 0x7f4970100310 2024-09-13T22:53:40.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.551+0000 7f497861e700 1 -- 172.21.15.2:0/3347005015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4970198c50 con 0x7f4970100310 2024-09-13T22:53:40.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.551+0000 7f49677fe700 1 -- 172.21.15.2:0/3347005015 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4960021640 con 0x7f4970100310 2024-09-13T22:53:40.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.551+0000 7f497861e700 1 -- 172.21.15.2:0/3347005015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49701991a0 con 0x7f4970100310 2024-09-13T22:53:40.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.552+0000 7f497861e700 1 -- 172.21.15.2:0/3347005015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497010a7d0 con 0x7f4970100310 2024-09-13T22:53:40.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.552+0000 7f49677fe700 1 -- 172.21.15.2:0/3347005015 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f496000f5d0 con 0x7f4970100310 2024-09-13T22:53:40.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.553+0000 7f49677fe700 1 --2- 172.21.15.2:0/3347005015 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f495c06c4e0 0x7f495c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:40.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.553+0000 7f49677fe700 1 -- 172.21.15.2:0/3347005015 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f496008cac0 con 0x7f4970100310 2024-09-13T22:53:40.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.553+0000 7f49763ba700 1 --2- 172.21.15.2:0/3347005015 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f495c06c4e0 0x7f495c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:40.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.553+0000 7f49763ba700 1 --2- 172.21.15.2:0/3347005015 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f495c06c4e0 0x7f495c06e9a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f496c00a400 tx=0x7f496c00d040 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:40.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.558+0000 7f49677fe700 1 -- 172.21.15.2:0/3347005015 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f496005ad80 con 0x7f4970100310 2024-09-13T22:53:40.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.801+0000 7f497861e700 1 -- 172.21.15.2:0/3347005015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4970199ee0 con 0x7f4970100310 2024-09-13T22:53:40.802 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:40 smithi002 ceph-mon[27637]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T22:53:40.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.801+0000 7f49677fe700 1 -- 172.21.15.2:0/3347005015 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7f496005a910 con 0x7f4970100310 2024-09-13T22:53:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T22:53:40.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.803+0000 7f497861e700 1 -- 172.21.15.2:0/3347005015 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f495c06c4e0 msgr2=0x7f495c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:40.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.803+0000 7f497861e700 1 --2- 172.21.15.2:0/3347005015 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f495c06c4e0 0x7f495c06e9a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f496c00a400 tx=0x7f496c00d040 comp rx=0 tx=0).stop 2024-09-13T22:53:40.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.803+0000 7f497861e700 1 -- 172.21.15.2:0/3347005015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4970100310 msgr2=0x7f497019ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:40.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.803+0000 7f497861e700 1 --2- 172.21.15.2:0/3347005015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4970100310 0x7f497019ee90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f496000b850 tx=0x7f49600055f0 comp rx=0 tx=0).stop 2024-09-13T22:53:40.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.804+0000 7f497861e700 1 -- 172.21.15.2:0/3347005015 shutdown_connections 2024-09-13T22:53:40.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.804+0000 7f497861e700 1 --2- 172.21.15.2:0/3347005015 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f495c06c4e0 0x7f495c06e9a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:40.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.804+0000 7f497861e700 1 --2- 172.21.15.2:0/3347005015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49700ff9f0 0x7f497019e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:40.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.804+0000 7f497861e700 1 --2- 172.21.15.2:0/3347005015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4970100310 0x7f497019ee90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:40.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.804+0000 7f497861e700 1 -- 172.21.15.2:0/3347005015 >> 172.21.15.2:0/3347005015 conn(0x7f49700fb650 msgr2=0x7f49700fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:40.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.804+0000 7f497861e700 1 -- 172.21.15.2:0/3347005015 shutdown_connections 2024-09-13T22:53:40.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:40.804+0000 7f497861e700 1 -- 172.21.15.2:0/3347005015 wait complete. 2024-09-13T22:53:41.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:40 smithi047 ceph-mon[34560]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-13T22:53:41.459 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T22:53:41.460 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T22:53:41.460 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-09-13T22:53:41.460 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T22:53:41.461 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T22:53:41.461 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T22:53:41.461 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T22:53:41.461 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T22:53:41.461 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T22:53:41.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:41.461 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-09-13T22:53:41.480 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T22:53:41.480 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T22:53:41.480 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T22:53:41.480 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-13T22:53:41.480 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-09-13T22:53:41.480 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-13T22:53:41.480 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T22:53:41.480 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-09-13T22:53:41.480 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-09-13T22:53:41.481 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T22:53:41.481 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-09-13T22:53:41.481 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-09-13T22:53:41.481 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T22:53:41.481 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-09-13T22:53:41.481 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-09-13T22:53:41.481 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T22:53:41.481 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42308sec preferred_lft 42308sec 2024-09-13T22:53:41.481 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2024-09-13T22:53:41.481 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-13T22:53:41.481 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T22:53:41.482 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-09-13T22:53:41.482 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-09-13T22:53:41.482 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T22:53:41.482 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:53:41.482 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-13T22:53:41.482 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2024-09-13T22:53:41.483 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2024-09-13T22:53:41.483 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2024-09-13T22:53:41.483 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T22:53:41.483 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-13T22:53:41.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:53:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:53:41.687 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:41 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/3347005015' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T22:53:41.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:41.693 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T22:53:41.719 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-09-13T22:53:41.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:41.721 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-09-13T22:53:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-09-13T22:53:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T22:53:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T22:53:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T22:53:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T22:53:41.795 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:53:41.795 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-13T22:53:41.795 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T22:53:41.795 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T22:53:41.795 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T22:53:41.795 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-13T22:53:41.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:53:42.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:53:42.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:42.118 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-13T22:53:42.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:42.135 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-09-13T22:53:42.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:41 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/3347005015' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T22:53:42.190 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:53:42.191 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-13T22:53:42.191 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T22:53:42.191 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T22:53:42.191 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-13T22:53:42.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:53:42.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:53:42.311 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T22:53:42.311 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:53:42.311 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-13T22:53:42.311 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T22:53:42.311 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T22:53:42.311 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T22:53:42.311 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T22:53:42.311 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T22:53:42.311 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-13T22:53:42.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:53:42.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:53:42.441 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:53:42.441 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-13T22:53:42.441 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-09-13T22:53:42.441 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T22:53:42.441 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-13T22:53:42.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:53:42.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:53:42.520 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T22:53:42.520 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T22:53:42.521 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T22:53:42.537 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T22:53:42.537 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T22:53:42.537 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T22:53:42.593 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-09-13T22:53:42.661 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-09-13T22:53:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-09-13T22:53:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-09-13T22:53:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-09-13T22:53:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-09-13T22:53:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-09-13T22:53:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-09-13T22:53:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-09-13T22:53:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-09-13T22:53:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-09-13T22:53:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-09-13T22:53:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-09-13T22:53:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-09-13T22:53:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T22:53:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-09-13T22:53:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-09-13T22:53:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-09-13T22:53:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-09-13T22:53:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-09-13T22:53:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-09-13T22:53:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-09-13T22:53:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-13T22:53:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-13T22:53:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-09-13T22:53:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-09-13T22:53:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-09-13T22:53:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-09-13T22:53:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/00451959ef6bf27e487ba23ddfa6733d088eabdc050daf480efff40266381735/merged 2024-09-13T22:53:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/777f4038358244140587352739ccbbd619fe88f0c8c69c2a04e525ec6a133817/merged 2024-09-13T22:53:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-09-13T22:53:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T22:53:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/8c8fdacbbaac3f96fcaf8ac426d14128b50bec2b3d0d98d081ba81a8756541cd/merged 2024-09-13T22:53:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/41002e8aa056379f6505dfd9c82b2530924e216a39a481a6c6da3d69bcb82b59/merged 2024-09-13T22:53:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/fa10d740ac9d3f791fbd1320809f2ae963ffa3d51eeb020a51602865f25f19f8/merged 2024-09-13T22:53:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/7d292187f544b8a346fbc543b5a6f8e6b48f4d666b30dd3601322b5cad651fb2/merged 2024-09-13T22:53:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/0ae82bdeeef3a216303ec685ddf246618115cd1a8579bd0f59db428b1c9219e4/merged 2024-09-13T22:53:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/a841fa6026b0b48b511f7547e31e75cf5abd4f56bc29790e4f45efcf93195286/merged 2024-09-13T22:53:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/418aec259039e426802aed735d6dbe3680117af0b4a6d09541adf6415a61c45b/merged 2024-09-13T22:53:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/c5b1b0f4e179041eed77a9ba485f0d59c9edb4a91e4d9f6b0e62cc42854ce4d5/merged 2024-09-13T22:53:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/97937024c1c9352d484f2b1a894d36c2386d344c60be4179f71b5f4f0068b583/merged 2024-09-13T22:53:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/a96bd0ca24d868b062a3e463fdb2df1c2bd6e5b0b39f260d7c0a3ad98f0a0cf5/merged 2024-09-13T22:53:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/11840c0564cdc2ae20c962eb757e605b9315059c949e0b48a6e6c697931192b7/merged 2024-09-13T22:53:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-09-13T22:53:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T22:53:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T22:53:42.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:42.722 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-09-13T22:53:42.778 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T22:53:42.779 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T22:53:42.821 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-09-13T22:53:42.847 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-09-13T22:53:42.905 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-09-13T22:53:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-09-13T22:53:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-09-13T22:53:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-09-13T22:53:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-09-13T22:53:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-09-13T22:53:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-09-13T22:53:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-09-13T22:53:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-09-13T22:53:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-09-13T22:53:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-09-13T22:53:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-09-13T22:53:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T22:53:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-09-13T22:53:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-09-13T22:53:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-09-13T22:53:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-09-13T22:53:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-09-13T22:53:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-09-13T22:53:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-09-13T22:53:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-13T22:53:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-13T22:53:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-09-13T22:53:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-09-13T22:53:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-09-13T22:53:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-09-13T22:53:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/00451959ef6bf27e487ba23ddfa6733d088eabdc050daf480efff40266381735/merged 2024-09-13T22:53:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/777f4038358244140587352739ccbbd619fe88f0c8c69c2a04e525ec6a133817/merged 2024-09-13T22:53:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-09-13T22:53:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T22:53:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/8c8fdacbbaac3f96fcaf8ac426d14128b50bec2b3d0d98d081ba81a8756541cd/merged 2024-09-13T22:53:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/41002e8aa056379f6505dfd9c82b2530924e216a39a481a6c6da3d69bcb82b59/merged 2024-09-13T22:53:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/fa10d740ac9d3f791fbd1320809f2ae963ffa3d51eeb020a51602865f25f19f8/merged 2024-09-13T22:53:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/7d292187f544b8a346fbc543b5a6f8e6b48f4d666b30dd3601322b5cad651fb2/merged 2024-09-13T22:53:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/0ae82bdeeef3a216303ec685ddf246618115cd1a8579bd0f59db428b1c9219e4/merged 2024-09-13T22:53:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/a841fa6026b0b48b511f7547e31e75cf5abd4f56bc29790e4f45efcf93195286/merged 2024-09-13T22:53:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/418aec259039e426802aed735d6dbe3680117af0b4a6d09541adf6415a61c45b/merged 2024-09-13T22:53:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/c5b1b0f4e179041eed77a9ba485f0d59c9edb4a91e4d9f6b0e62cc42854ce4d5/merged 2024-09-13T22:53:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/97937024c1c9352d484f2b1a894d36c2386d344c60be4179f71b5f4f0068b583/merged 2024-09-13T22:53:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/a96bd0ca24d868b062a3e463fdb2df1c2bd6e5b0b39f260d7c0a3ad98f0a0cf5/merged 2024-09-13T22:53:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/11840c0564cdc2ae20c962eb757e605b9315059c949e0b48a6e6c697931192b7/merged 2024-09-13T22:53:42.909 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-09-13T22:53:42.909 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T22:53:42.909 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T22:53:42.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:42.909 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-09-13T22:53:42.954 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2024-09-13T22:53:42.953+0000 7f5c2451f480 -1 init, newargv = 0x559c25874d00 newargc=15 2024-09-13T22:53:42.954 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[75498]: starting ceph client 2024-09-13T22:53:42.961 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[75498]: starting fuse 2024-09-13T22:53:42.962 INFO:teuthology.orchestra.run.smithi002.stdout:141 2024-09-13T22:53:42.963 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [141] 2024-09-13T22:53:42.963 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2024-09-13T22:53:42.963 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2024-09-13T22:53:42.963 DEBUG:teuthology.orchestra.run.smithi002:> import re 2024-09-13T22:53:42.963 DEBUG:teuthology.orchestra.run.smithi002:> import os 2024-09-13T22:53:42.963 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2024-09-13T22:53:42.963 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-13T22:53:42.963 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2024-09-13T22:53:42.963 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T22:53:42.963 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2024-09-13T22:53:42.963 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T22:53:42.964 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-13T22:53:42.964 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2024-09-13T22:53:42.964 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2024-09-13T22:53:42.964 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2024-09-13T22:53:42.964 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2024-09-13T22:53:42.964 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-13T22:53:42.964 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2024-09-13T22:53:42.964 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T22:53:42.964 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T22:53:42.964 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T22:53:42.965 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2024-09-13T22:53:42.965 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2024-09-13T22:53:42.965 DEBUG:teuthology.orchestra.run.smithi002:> return f 2024-09-13T22:53:42.965 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T22:53:42.965 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-13T22:53:42.965 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.0")) 2024-09-13T22:53:42.965 DEBUG:teuthology.orchestra.run.smithi002:> ' 2024-09-13T22:53:43.082 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.0.75498.asok 2024-09-13T22:53:43.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:53:43.093 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.75498.asok 2024-09-13T22:53:43.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:43.093 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.75498.asok status 2024-09-13T22:53:43.230 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:53:43.230 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2024-09-13T22:53:43.230 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "7fe91d5d5842e04be3b4f514d6dd990c54b29c76", 2024-09-13T22:53:43.230 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)", 2024-09-13T22:53:43.230 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "0", 2024-09-13T22:53:43.230 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2024-09-13T22:53:43.230 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T22:53:43.230 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "75498", 2024-09-13T22:53:43.231 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2024-09-13T22:53:43.231 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:53:43.231 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2024-09-13T22:53:43.231 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2024-09-13T22:53:43.231 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 14524, 2024-09-13T22:53:43.231 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2024-09-13T22:53:43.231 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2024-09-13T22:53:43.231 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2024-09-13T22:53:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 14524 2024-09-13T22:53:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:53:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-09-13T22:53:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-09-13T22:53:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2024-09-13T22:53:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 4269068546 2024-09-13T22:53:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T22:53:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:53:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-09-13T22:53:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-09-13T22:53:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2024-09-13T22:53:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 4269068546 2024-09-13T22:53:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:53:43.232 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.14524 192.168.0.1:0/4269068546", 2024-09-13T22:53:43.233 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/4269068546", 2024-09-13T22:53:43.233 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2024-09-13T22:53:43.233 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 16, 2024-09-13T22:53:43.233 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 47, 2024-09-13T22:53:43.233 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2024-09-13T22:53:43.233 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2024-09-13T22:53:43.233 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2024-09-13T22:53:43.233 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:53:43.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:42 smithi002 ceph-mon[27637]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-13T22:53:43.238 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T22:53:43.238 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T22:53:43.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:42 smithi047 ceph-mon[34560]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-13T22:53:43.446 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:53:45.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.066+0000 7f266a992700 1 -- 172.21.15.2:0/1699386025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26640ff5a0 msgr2=0x7f26640ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:45.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.066+0000 7f266a992700 1 --2- 172.21.15.2:0/1699386025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26640ff5a0 0x7f26640ff980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2654009910 tx=0x7f2654009c20 comp rx=0 tx=0).stop 2024-09-13T22:53:45.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.066+0000 7f266a992700 1 -- 172.21.15.2:0/1699386025 shutdown_connections 2024-09-13T22:53:45.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.066+0000 7f266a992700 1 --2- 172.21.15.2:0/1699386025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26640fff50 0x7f2664105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:45.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.066+0000 7f266a992700 1 --2- 172.21.15.2:0/1699386025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26640ff5a0 0x7f26640ff980 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:45.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.066+0000 7f266a992700 1 -- 172.21.15.2:0/1699386025 >> 172.21.15.2:0/1699386025 conn(0x7f2664074e30 msgr2=0x7f2664075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:45.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.066+0000 7f266a992700 1 -- 172.21.15.2:0/1699386025 shutdown_connections 2024-09-13T22:53:45.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.066+0000 7f266a992700 1 -- 172.21.15.2:0/1699386025 wait complete. 2024-09-13T22:53:45.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.066+0000 7f266a992700 1 Processor -- start 2024-09-13T22:53:45.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.066+0000 7f266a992700 1 -- start start 2024-09-13T22:53:45.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.067+0000 7f266a992700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26640ff5a0 0x7f266419c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:45.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.067+0000 7f266a992700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26640fff50 0x7f266419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:45.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.067+0000 7f266a992700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266419d2d0 con 0x7f26640ff5a0 2024-09-13T22:53:45.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.067+0000 7f266a992700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2664196780 con 0x7f26640fff50 2024-09-13T22:53:45.070 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:44 smithi002 ceph-mon[27637]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:53:45.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.067+0000 7f2663fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26640ff5a0 0x7f266419c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:45.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.067+0000 7f2663fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26640ff5a0 0x7f266419c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43962/0 (socket says 172.21.15.2:43962) 2024-09-13T22:53:45.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.067+0000 7f2663fff700 1 -- 172.21.15.2:0/3001771054 learned_addr learned my addr 172.21.15.2:0/3001771054 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:53:45.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.067+0000 7f26637fe700 1 --2- 172.21.15.2:0/3001771054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26640fff50 0x7f266419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:45.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.067+0000 7f2663fff700 1 -- 172.21.15.2:0/3001771054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26640fff50 msgr2=0x7f266419cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:45.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.067+0000 7f2663fff700 1 --2- 172.21.15.2:0/3001771054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26640fff50 0x7f266419cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:45.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.067+0000 7f2663fff700 1 -- 172.21.15.2:0/3001771054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26540095f0 con 0x7f26640ff5a0 2024-09-13T22:53:45.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.068+0000 7f2663fff700 1 --2- 172.21.15.2:0/3001771054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26640ff5a0 0x7f266419c700 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2654006010 tx=0x7f265400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:45.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.068+0000 7f26617fa700 1 -- 172.21.15.2:0/3001771054 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f265401d070 con 0x7f26640ff5a0 2024-09-13T22:53:45.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.068+0000 7f266a992700 1 -- 172.21.15.2:0/3001771054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2664196a00 con 0x7f26640ff5a0 2024-09-13T22:53:45.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.068+0000 7f266a992700 1 -- 172.21.15.2:0/3001771054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2664196ef0 con 0x7f26640ff5a0 2024-09-13T22:53:45.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.068+0000 7f26617fa700 1 -- 172.21.15.2:0/3001771054 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2654004f50 con 0x7f26640ff5a0 2024-09-13T22:53:45.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.068+0000 7f26617fa700 1 -- 172.21.15.2:0/3001771054 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2654021640 con 0x7f26640ff5a0 2024-09-13T22:53:45.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.069+0000 7f266a992700 1 -- 172.21.15.2:0/3001771054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2664109270 con 0x7f26640ff5a0 2024-09-13T22:53:45.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.070+0000 7f26617fa700 1 -- 172.21.15.2:0/3001771054 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f265400f460 con 0x7f26640ff5a0 2024-09-13T22:53:45.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.070+0000 7f26617fa700 1 --2- 172.21.15.2:0/3001771054 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f264c06c4e0 0x7f264c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:45.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.070+0000 7f26617fa700 1 -- 172.21.15.2:0/3001771054 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f265408c900 con 0x7f26640ff5a0 2024-09-13T22:53:45.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.070+0000 7f26637fe700 1 --2- 172.21.15.2:0/3001771054 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f264c06c4e0 0x7f264c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:45.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.071+0000 7f26637fe700 1 --2- 172.21.15.2:0/3001771054 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f264c06c4e0 0x7f264c06e9a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2658005950 tx=0x7f26580058e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:45.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.075+0000 7f26617fa700 1 -- 172.21.15.2:0/3001771054 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f265405ac40 con 0x7f26640ff5a0 2024-09-13T22:53:45.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:44 smithi047 ceph-mon[34560]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:53:45.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.320+0000 7f266a992700 1 -- 172.21.15.2:0/3001771054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f266404f2e0 con 0x7f26640ff5a0 2024-09-13T22:53:45.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.320+0000 7f26617fa700 1 -- 172.21.15.2:0/3001771054 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7f2654026070 con 0x7f26640ff5a0 2024-09-13T22:53:45.322 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T22:53:45.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.322+0000 7f266a992700 1 -- 172.21.15.2:0/3001771054 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f264c06c4e0 msgr2=0x7f264c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:45.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.322+0000 7f266a992700 1 --2- 172.21.15.2:0/3001771054 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f264c06c4e0 0x7f264c06e9a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2658005950 tx=0x7f26580058e0 comp rx=0 tx=0).stop 2024-09-13T22:53:45.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.322+0000 7f266a992700 1 -- 172.21.15.2:0/3001771054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26640ff5a0 msgr2=0x7f266419c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:45.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.322+0000 7f266a992700 1 --2- 172.21.15.2:0/3001771054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26640ff5a0 0x7f266419c700 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2654006010 tx=0x7f265400be20 comp rx=0 tx=0).stop 2024-09-13T22:53:45.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.323+0000 7f266a992700 1 -- 172.21.15.2:0/3001771054 shutdown_connections 2024-09-13T22:53:45.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.323+0000 7f266a992700 1 --2- 172.21.15.2:0/3001771054 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f264c06c4e0 0x7f264c06e9a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:45.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.323+0000 7f266a992700 1 --2- 172.21.15.2:0/3001771054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26640ff5a0 0x7f266419c700 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:45.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.323+0000 7f266a992700 1 --2- 172.21.15.2:0/3001771054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26640fff50 0x7f266419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:45.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.323+0000 7f266a992700 1 -- 172.21.15.2:0/3001771054 >> 172.21.15.2:0/3001771054 conn(0x7f2664074e30 msgr2=0x7f26640fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:45.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.323+0000 7f266a992700 1 -- 172.21.15.2:0/3001771054 shutdown_connections 2024-09-13T22:53:45.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:45.323+0000 7f266a992700 1 -- 172.21.15.2:0/3001771054 wait complete. 2024-09-13T22:53:45.901 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T22:53:45.901 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T22:53:45.901 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-09-13T22:53:45.901 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T22:53:45.901 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T22:53:45.901 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T22:53:45.901 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T22:53:45.901 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T22:53:45.901 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T22:53:45.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:45.902 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-09-13T22:53:45.922 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T22:53:45.922 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T22:53:45.922 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T22:53:45.922 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-09-13T22:53:45.922 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-09-13T22:53:45.922 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-09-13T22:53:45.922 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T22:53:45.922 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-09-13T22:53:45.923 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-09-13T22:53:45.923 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T22:53:45.923 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-09-13T22:53:45.923 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-09-13T22:53:45.923 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T22:53:45.923 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-09-13T22:53:45.923 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-09-13T22:53:45.923 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T22:53:45.923 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42302sec preferred_lft 42302sec 2024-09-13T22:53:45.923 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link 2024-09-13T22:53:45.923 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-09-13T22:53:45.923 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T22:53:45.923 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-09-13T22:53:45.923 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-09-13T22:53:45.924 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T22:53:45.924 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:53:45.924 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-09-13T22:53:45.924 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add name ceph-brx type bridge 2024-09-13T22:53:45.924 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr flush dev ceph-brx 2024-09-13T22:53:45.924 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set ceph-brx up 2024-09-13T22:53:45.924 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T22:53:45.924 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-09-13T22:53:46.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:53:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:53:46.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:53:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:53:46.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:46.140 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T22:53:46.166 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-09-13T22:53:46.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:46.168 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-09-13T22:53:46.238 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-09-13T22:53:46.239 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T22:53:46.239 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T22:53:46.239 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T22:53:46.239 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T22:53:46.239 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:53:46.239 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-09-13T22:53:46.239 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T22:53:46.239 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T22:53:46.239 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T22:53:46.239 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-09-13T22:53:46.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:45 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/3001771054' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T22:53:46.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:53:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:53:46.337 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:45 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/3001771054' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T22:53:46.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:53:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:53:46.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:46.539 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-09-13T22:53:46.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:46.555 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-09-13T22:53:46.612 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:53:46.612 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-09-13T22:53:46.612 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T22:53:46.612 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T22:53:46.612 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-09-13T22:53:46.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:53:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:53:46.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:53:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:53:46.732 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T22:53:46.732 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:53:46.732 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-09-13T22:53:46.732 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T22:53:46.732 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T22:53:46.732 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T22:53:46.732 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T22:53:46.732 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T22:53:46.732 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-09-13T22:53:46.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:53:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:53:46.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:53:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:53:46.879 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T22:53:46.879 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-09-13T22:53:46.879 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-09-13T22:53:46.879 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T22:53:46.879 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-09-13T22:53:46.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:53:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T22:53:46.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:53:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:53:46.962 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-13T22:53:46.962 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T22:53:46.962 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T22:53:46.979 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T22:53:46.979 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T22:53:46.979 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T22:53:47.035 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-09-13T22:53:47.104 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-09-13T22:53:47.161 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-09-13T22:53:47.161 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-09-13T22:53:47.161 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-09-13T22:53:47.161 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-09-13T22:53:47.161 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-09-13T22:53:47.161 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-09-13T22:53:47.161 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-09-13T22:53:47.161 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-09-13T22:53:47.162 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-09-13T22:53:47.162 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-09-13T22:53:47.162 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-09-13T22:53:47.162 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-09-13T22:53:47.162 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T22:53:47.162 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-09-13T22:53:47.162 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-09-13T22:53:47.162 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-09-13T22:53:47.162 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-09-13T22:53:47.162 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-09-13T22:53:47.162 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-09-13T22:53:47.162 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-09-13T22:53:47.162 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-13T22:53:47.162 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-13T22:53:47.163 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-09-13T22:53:47.163 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-09-13T22:53:47.163 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-09-13T22:53:47.163 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/0 2024-09-13T22:53:47.163 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T22:53:47.163 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay 2024-09-13T22:53:47.163 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/98074db466173cb4c775142cdd83d78103dd5a6c47298501a259b7195ba8a4d7/merged 2024-09-13T22:53:47.163 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/8421cfe6e38b4ec4b1c7da13f3396d5a62a0e5632df413fa262a51074b0c00ab/merged 2024-09-13T22:53:47.163 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/64d1c7bcec084d0f7400f178348b60c2421e818c71b6a7f87b5b6926f6bc9d3a/merged 2024-09-13T22:53:47.163 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/3e820b83aac9aaf1f51e7a71ce5b0fbebf586ef4702c241a4808155b27c6abce/merged 2024-09-13T22:53:47.163 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/55663d033444a526c63962669e2f768ffec197931f33c7c7a472a4f227027b83/merged 2024-09-13T22:53:47.163 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/3eaba6f859a0837787ab3d9fc0cd930cda8e3583b400179b2180a8ba46115ada/merged 2024-09-13T22:53:47.163 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/64279cb341ada7cf19aadcd89404fab986db25e7ed64e695c5565b18188207ae/merged 2024-09-13T22:53:47.163 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/96bb2a8a73e69e9ec49c684284b1865870051b275e921d095657749c0724fc3b/merged 2024-09-13T22:53:47.164 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/26bf5900df4be4fbe640de3f277a0c59caf16f703a0f3c02262a819d51f38f61/merged 2024-09-13T22:53:47.164 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/5ae96d41bb2702bed64aee980f53f1e6f631eac88aae191e94815e979153c462/merged 2024-09-13T22:53:47.164 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-09-13T22:53:47.164 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T22:53:47.164 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T22:53:47.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:47.164 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-09-13T22:53:47.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:46 smithi047 ceph-mon[34560]: pgmap v199: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:53:47.180 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T22:53:47.180 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-13T22:53:47.222 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-09-13T22:53:47.248 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-09-13T22:53:47.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:46 smithi002 ceph-mon[27637]: pgmap v199: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:53:47.305 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-09-13T22:53:47.305 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-09-13T22:53:47.305 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-09-13T22:53:47.305 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-09-13T22:53:47.305 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-09-13T22:53:47.306 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-09-13T22:53:47.306 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-09-13T22:53:47.306 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-09-13T22:53:47.306 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-09-13T22:53:47.306 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-09-13T22:53:47.306 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-09-13T22:53:47.306 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/selinux 2024-09-13T22:53:47.306 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T22:53:47.306 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-09-13T22:53:47.306 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-09-13T22:53:47.306 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-09-13T22:53:47.306 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-09-13T22:53:47.306 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-09-13T22:53:47.306 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-09-13T22:53:47.307 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysctl.service 2024-09-13T22:53:47.307 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-13T22:53:47.307 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-13T22:53:47.307 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/nfs/rpc_pipefs 2024-09-13T22:53:47.307 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-09-13T22:53:47.307 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-09-13T22:53:47.307 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/0 2024-09-13T22:53:47.307 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-09-13T22:53:47.307 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay 2024-09-13T22:53:47.307 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/98074db466173cb4c775142cdd83d78103dd5a6c47298501a259b7195ba8a4d7/merged 2024-09-13T22:53:47.307 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/8421cfe6e38b4ec4b1c7da13f3396d5a62a0e5632df413fa262a51074b0c00ab/merged 2024-09-13T22:53:47.307 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/64d1c7bcec084d0f7400f178348b60c2421e818c71b6a7f87b5b6926f6bc9d3a/merged 2024-09-13T22:53:47.307 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/3e820b83aac9aaf1f51e7a71ce5b0fbebf586ef4702c241a4808155b27c6abce/merged 2024-09-13T22:53:47.307 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/55663d033444a526c63962669e2f768ffec197931f33c7c7a472a4f227027b83/merged 2024-09-13T22:53:47.308 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/3eaba6f859a0837787ab3d9fc0cd930cda8e3583b400179b2180a8ba46115ada/merged 2024-09-13T22:53:47.308 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/64279cb341ada7cf19aadcd89404fab986db25e7ed64e695c5565b18188207ae/merged 2024-09-13T22:53:47.308 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/96bb2a8a73e69e9ec49c684284b1865870051b275e921d095657749c0724fc3b/merged 2024-09-13T22:53:47.308 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/26bf5900df4be4fbe640de3f277a0c59caf16f703a0f3c02262a819d51f38f61/merged 2024-09-13T22:53:47.308 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/containers/storage/overlay/5ae96d41bb2702bed64aee980f53f1e6f631eac88aae191e94815e979153c462/merged 2024-09-13T22:53:47.308 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-09-13T22:53:47.308 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T22:53:47.308 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T22:53:47.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:47.308 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-09-13T22:53:47.351 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi047.stderr:2024-09-13T22:53:47.351+0000 7f403dd58480 -1 init, newargv = 0x55cf6ee8dc10 newargc=15 2024-09-13T22:53:47.352 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi047.stderr:ceph-fuse[60132]: starting ceph client 2024-09-13T22:53:47.356 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi047.stderr:ceph-fuse[60132]: starting fuse 2024-09-13T22:53:47.366 INFO:teuthology.orchestra.run.smithi047.stdout:129 2024-09-13T22:53:47.366 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [129] 2024-09-13T22:53:47.367 DEBUG:teuthology.orchestra.run.smithi047:> sudo stdin-killer -- python3 -c ' 2024-09-13T22:53:47.367 DEBUG:teuthology.orchestra.run.smithi047:> import glob 2024-09-13T22:53:47.367 DEBUG:teuthology.orchestra.run.smithi047:> import re 2024-09-13T22:53:47.367 DEBUG:teuthology.orchestra.run.smithi047:> import os 2024-09-13T22:53:47.367 DEBUG:teuthology.orchestra.run.smithi047:> import subprocess 2024-09-13T22:53:47.367 DEBUG:teuthology.orchestra.run.smithi047:> 2024-09-13T22:53:47.367 DEBUG:teuthology.orchestra.run.smithi047:> def _find_admin_socket(client_name): 2024-09-13T22:53:47.367 DEBUG:teuthology.orchestra.run.smithi047:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T22:53:47.367 DEBUG:teuthology.orchestra.run.smithi047:> files = glob.glob(asok_path) 2024-09-13T22:53:47.367 DEBUG:teuthology.orchestra.run.smithi047:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T22:53:47.368 DEBUG:teuthology.orchestra.run.smithi047:> 2024-09-13T22:53:47.368 DEBUG:teuthology.orchestra.run.smithi047:> # Given a non-glob path, it better be there 2024-09-13T22:53:47.368 DEBUG:teuthology.orchestra.run.smithi047:> if "*" not in asok_path: 2024-09-13T22:53:47.368 DEBUG:teuthology.orchestra.run.smithi047:> assert(len(files) == 1) 2024-09-13T22:53:47.368 DEBUG:teuthology.orchestra.run.smithi047:> return files[0] 2024-09-13T22:53:47.368 DEBUG:teuthology.orchestra.run.smithi047:> 2024-09-13T22:53:47.368 DEBUG:teuthology.orchestra.run.smithi047:> for f in files: 2024-09-13T22:53:47.368 DEBUG:teuthology.orchestra.run.smithi047:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T22:53:47.368 DEBUG:teuthology.orchestra.run.smithi047:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T22:53:47.368 DEBUG:teuthology.orchestra.run.smithi047:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T22:53:47.369 DEBUG:teuthology.orchestra.run.smithi047:> contents = proc_f.read() 2024-09-13T22:53:47.369 DEBUG:teuthology.orchestra.run.smithi047:> if mountpoint in contents: 2024-09-13T22:53:47.369 DEBUG:teuthology.orchestra.run.smithi047:> return f 2024-09-13T22:53:47.369 DEBUG:teuthology.orchestra.run.smithi047:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T22:53:47.369 DEBUG:teuthology.orchestra.run.smithi047:> 2024-09-13T22:53:47.369 DEBUG:teuthology.orchestra.run.smithi047:> print(_find_admin_socket("client.1")) 2024-09-13T22:53:47.369 DEBUG:teuthology.orchestra.run.smithi047:> ' 2024-09-13T22:53:47.486 INFO:teuthology.orchestra.run.smithi047.stdout:/var/run/ceph/ceph-client.1.60132.asok 2024-09-13T22:53:47.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-13T22:53:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T22:53:47.497 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.60132.asok 2024-09-13T22:53:47.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:47.497 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.60132.asok status 2024-09-13T22:53:47.634 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-13T22:53:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "metadata": { 2024-09-13T22:53:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_sha1": "7fe91d5d5842e04be3b4f514d6dd990c54b29c76", 2024-09-13T22:53:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)", 2024-09-13T22:53:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "entity_id": "1", 2024-09-13T22:53:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": "smithi047", 2024-09-13T22:53:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T22:53:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "pid": "60132", 2024-09-13T22:53:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "root": "/" 2024-09-13T22:53:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-13T22:53:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_count": 0, 2024-09-13T22:53:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_pinned_count": 0, 2024-09-13T22:53:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 24309, 2024-09-13T22:53:47.635 INFO:teuthology.orchestra.run.smithi047.stdout: "inst": { 2024-09-13T22:53:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: "name": { 2024-09-13T22:53:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "client", 2024-09-13T22:53:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: "num": 24309 2024-09-13T22:53:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-13T22:53:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-09-13T22:53:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-09-13T22:53:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-09-13T22:53:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 3679635712 2024-09-13T22:53:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-13T22:53:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-13T22:53:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-09-13T22:53:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-09-13T22:53:47.636 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-09-13T22:53:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 3679635712 2024-09-13T22:53:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-13T22:53:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "inst_str": "client.24309 192.168.0.1:0/3679635712", 2024-09-13T22:53:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "addr_str": "192.168.0.1:0/3679635712", 2024-09-13T22:53:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "inode_count": 1, 2024-09-13T22:53:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_epoch": 16, 2024-09-13T22:53:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch": 47, 2024-09-13T22:53:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch_barrier": 0, 2024-09-13T22:53:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "blocklisted": false, 2024-09-13T22:53:47.637 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs" 2024-09-13T22:53:47.637 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-13T22:53:47.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:47.644 DEBUG:teuthology.orchestra.run.smithi002:> stat --file-system '--printf=%T 2024-09-13T22:53:47.644 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T22:53:47.666 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2024-09-13T22:53:47.666 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T22:53:47.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:47.667 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T22:53:47.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:47.743 DEBUG:teuthology.orchestra.run.smithi047:> stat --file-system '--printf=%T 2024-09-13T22:53:47.743 DEBUG:teuthology.orchestra.run.smithi047:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T22:53:47.760 INFO:teuthology.orchestra.run.smithi047.stdout:fuseblk 2024-09-13T22:53:47.761 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T22:53:47.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T22:53:47.761 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T22:53:47.830 INFO:teuthology.run_tasks:Running task print... 2024-09-13T22:53:47.841 INFO:teuthology.task.print:**** done client 2024-09-13T22:53:47.842 INFO:teuthology.run_tasks:Running task parallel... 2024-09-13T22:53:47.861 INFO:teuthology.task.parallel:starting parallel... 2024-09-13T22:53:47.861 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T22:53:47.862 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T22:53:47.862 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-13T22:53:47.862 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-13T22:53:47.863 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T22:53:47.863 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-13T22:53:47.867 INFO:tasks.workunit:Pulling workunits from ref ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:53:47.868 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T22:53:47.868 INFO:tasks.workunit:timeout=3h 2024-09-13T22:53:47.868 INFO:tasks.workunit:cleanup=True 2024-09-13T22:53:47.868 DEBUG:teuthology.orchestra.run.smithi002:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T22:53:47.890 INFO:teuthology.orchestra.run.smithi002.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T22:53:47.891 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-13T22:53:47.891 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 8dh/141d Inode: 1 Links: 2 2024-09-13T22:53:47.891 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:53:47.891 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-13T22:53:47.891 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T22:53:47.891 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-13 22:53:11.982578496 +0000 2024-09-13T22:53:47.891 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-13 22:53:47.740195910 +0000 2024-09-13T22:53:47.891 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2024-09-13T22:53:47.891 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T22:53:47.892 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T22:53:47.965 DEBUG:teuthology.orchestra.run.smithi047:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-13T22:53:47.983 INFO:teuthology.orchestra.run.smithi047.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-13T22:53:47.983 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-13T22:53:47.983 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-13T22:53:47.983 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T22:53:47.984 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-13T22:53:47.984 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T22:53:47.984 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-13 22:53:47.960172003 +0000 2024-09-13T22:53:47.984 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-13 22:53:47.960172003 +0000 2024-09-13T22:53:47.984 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-09-13T22:53:47.984 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-13T22:53:47.984 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-13T22:53:47.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:47 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:53:48.054 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:53:48.055 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:53:48.072 INFO:tasks.workunit.client.0.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T22:53:48.096 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:53:48.111 INFO:tasks.workunit.client.1.smithi047.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-13T22:53:48.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:47 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:53:49.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:48 smithi002 ceph-mon[27637]: pgmap v200: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T22:53:49.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:48 smithi047 ceph-mon[34560]: pgmap v200: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T22:53:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.705+0000 7f6d371ae700 1 -- 172.21.15.2:0/1809189196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30101750 msgr2=0x7f6d30103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.705+0000 7f6d371ae700 1 --2- 172.21.15.2:0/1809189196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30101750 0x7f6d30103b40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009910 tx=0x7f6d24009c20 comp rx=0 tx=0).stop 2024-09-13T22:53:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.705+0000 7f6d371ae700 1 -- 172.21.15.2:0/1809189196 shutdown_connections 2024-09-13T22:53:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.705+0000 7f6d371ae700 1 --2- 172.21.15.2:0/1809189196 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d30104080 0x7f6d30106470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.705+0000 7f6d371ae700 1 --2- 172.21.15.2:0/1809189196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30101750 0x7f6d30103b40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.705+0000 7f6d371ae700 1 -- 172.21.15.2:0/1809189196 >> 172.21.15.2:0/1809189196 conn(0x7f6d300fb160 msgr2=0x7f6d300fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.705+0000 7f6d371ae700 1 -- 172.21.15.2:0/1809189196 shutdown_connections 2024-09-13T22:53:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.705+0000 7f6d371ae700 1 -- 172.21.15.2:0/1809189196 wait complete. 2024-09-13T22:53:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.705+0000 7f6d371ae700 1 Processor -- start 2024-09-13T22:53:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.706+0000 7f6d371ae700 1 -- start start 2024-09-13T22:53:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.706+0000 7f6d371ae700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d30101750 0x7f6d301967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.706+0000 7f6d371ae700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30104080 0x7f6d30196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.706+0000 7f6d371ae700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d30197340 con 0x7f6d30104080 2024-09-13T22:53:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.706+0000 7f6d371ae700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d30197480 con 0x7f6d30101750 2024-09-13T22:53:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.706+0000 7f6d2ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30104080 0x7f6d30196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.706+0000 7f6d2ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30104080 0x7f6d30196d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43976/0 (socket says 172.21.15.2:43976) 2024-09-13T22:53:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.706+0000 7f6d2ffff700 1 -- 172.21.15.2:0/1716483468 learned_addr learned my addr 172.21.15.2:0/1716483468 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:53:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.706+0000 7f6d34f4a700 1 --2- 172.21.15.2:0/1716483468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d30101750 0x7f6d301967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.706+0000 7f6d2ffff700 1 -- 172.21.15.2:0/1716483468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d30101750 msgr2=0x7f6d301967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.706+0000 7f6d2ffff700 1 --2- 172.21.15.2:0/1716483468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d30101750 0x7f6d301967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.706+0000 7f6d2ffff700 1 -- 172.21.15.2:0/1716483468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d240095f0 con 0x7f6d30104080 2024-09-13T22:53:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.706+0000 7f6d2ffff700 1 --2- 172.21.15.2:0/1716483468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30104080 0x7f6d30196d20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00d8d0 tx=0x7f6d1c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.706+0000 7f6d2dffb700 1 -- 172.21.15.2:0/1716483468 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d1c0098a0 con 0x7f6d30104080 2024-09-13T22:53:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.707+0000 7f6d2dffb700 1 -- 172.21.15.2:0/1716483468 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6d1c010460 con 0x7f6d30104080 2024-09-13T22:53:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.707+0000 7f6d371ae700 1 -- 172.21.15.2:0/1716483468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d3019bf30 con 0x7f6d30104080 2024-09-13T22:53:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.707+0000 7f6d2dffb700 1 -- 172.21.15.2:0/1716483468 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d1c00f5f0 con 0x7f6d30104080 2024-09-13T22:53:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.707+0000 7f6d371ae700 1 -- 172.21.15.2:0/1716483468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3019c450 con 0x7f6d30104080 2024-09-13T22:53:49.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.708+0000 7f6d371ae700 1 -- 172.21.15.2:0/1716483468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d30190630 con 0x7f6d30104080 2024-09-13T22:53:49.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.708+0000 7f6d2dffb700 1 -- 172.21.15.2:0/1716483468 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f6d1c009a00 con 0x7f6d30104080 2024-09-13T22:53:49.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.709+0000 7f6d2dffb700 1 --2- 172.21.15.2:0/1716483468 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f6d2006c4e0 0x7f6d2006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:49.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.709+0000 7f6d2dffb700 1 -- 172.21.15.2:0/1716483468 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f6d1c08b5e0 con 0x7f6d30104080 2024-09-13T22:53:49.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.709+0000 7f6d34f4a700 1 --2- 172.21.15.2:0/1716483468 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f6d2006c4e0 0x7f6d2006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:49.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.709+0000 7f6d34f4a700 1 --2- 172.21.15.2:0/1716483468 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f6d2006c4e0 0x7f6d2006e9a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6d24006010 tx=0x7f6d2400b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:49.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.713+0000 7f6d2dffb700 1 -- 172.21.15.2:0/1716483468 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f6d1c059920 con 0x7f6d30104080 2024-09-13T22:53:49.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.910+0000 7f6d371ae700 1 -- 172.21.15.2:0/1716483468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f6d30068af0 con 0x7f6d30104080 2024-09-13T22:53:49.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.910+0000 7f6d2dffb700 1 -- 172.21.15.2:0/1716483468 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f6d1c0594b0 con 0x7f6d30104080 2024-09-13T22:53:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.912+0000 7f6d371ae700 1 -- 172.21.15.2:0/1716483468 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f6d2006c4e0 msgr2=0x7f6d2006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.912+0000 7f6d371ae700 1 --2- 172.21.15.2:0/1716483468 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f6d2006c4e0 0x7f6d2006e9a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6d24006010 tx=0x7f6d2400b540 comp rx=0 tx=0).stop 2024-09-13T22:53:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.912+0000 7f6d371ae700 1 -- 172.21.15.2:0/1716483468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30104080 msgr2=0x7f6d30196d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.912+0000 7f6d371ae700 1 --2- 172.21.15.2:0/1716483468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30104080 0x7f6d30196d20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00d8d0 tx=0x7f6d1c00dbe0 comp rx=0 tx=0).stop 2024-09-13T22:53:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.912+0000 7f6d371ae700 1 -- 172.21.15.2:0/1716483468 shutdown_connections 2024-09-13T22:53:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.912+0000 7f6d371ae700 1 --2- 172.21.15.2:0/1716483468 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f6d2006c4e0 0x7f6d2006e9a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.912+0000 7f6d371ae700 1 --2- 172.21.15.2:0/1716483468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d30101750 0x7f6d301967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.912+0000 7f6d371ae700 1 --2- 172.21.15.2:0/1716483468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d30104080 0x7f6d30196d20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.912+0000 7f6d371ae700 1 -- 172.21.15.2:0/1716483468 >> 172.21.15.2:0/1716483468 conn(0x7f6d300fb160 msgr2=0x7f6d300fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.913+0000 7f6d371ae700 1 -- 172.21.15.2:0/1716483468 shutdown_connections 2024-09-13T22:53:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:49.913+0000 7f6d371ae700 1 -- 172.21.15.2:0/1716483468 wait complete. 2024-09-13T22:53:50.607 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-13T22:53:50.862 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:53:51.220 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:50 smithi002 ceph-mon[27637]: pgmap v201: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-13T22:53:51.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:50 smithi047 ceph-mon[34560]: pgmap v201: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-13T22:53:52.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.527+0000 7fe009288700 1 -- 172.21.15.2:0/1889191049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe004100cb0 msgr2=0x7fe0041010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:52.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.527+0000 7fe009288700 1 --2- 172.21.15.2:0/1889191049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe004100cb0 0x7fe0041010d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdff4009910 tx=0x7fdff4009c20 comp rx=0 tx=0).stop 2024-09-13T22:53:52.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.527+0000 7fe009288700 1 -- 172.21.15.2:0/1889191049 shutdown_connections 2024-09-13T22:53:52.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.527+0000 7fe009288700 1 --2- 172.21.15.2:0/1889191049 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe004101eb0 0x7fe004102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:52.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.527+0000 7fe009288700 1 --2- 172.21.15.2:0/1889191049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe004100cb0 0x7fe0041010d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:52.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.527+0000 7fe009288700 1 -- 172.21.15.2:0/1889191049 >> 172.21.15.2:0/1889191049 conn(0x7fe0040fc230 msgr2=0x7fe0040fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:52.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.528+0000 7fe009288700 1 -- 172.21.15.2:0/1889191049 shutdown_connections 2024-09-13T22:53:52.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.528+0000 7fe009288700 1 -- 172.21.15.2:0/1889191049 wait complete. 2024-09-13T22:53:52.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.528+0000 7fe009288700 1 Processor -- start 2024-09-13T22:53:52.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.528+0000 7fe009288700 1 -- start start 2024-09-13T22:53:52.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.528+0000 7fe009288700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe004100cb0 0x7fe004074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:52.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.528+0000 7fe009288700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe004101eb0 0x7fe004073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:52.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.529+0000 7fe009288700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0040736c0 con 0x7fe004100cb0 2024-09-13T22:53:52.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.529+0000 7fe009288700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe004073800 con 0x7fe004101eb0 2024-09-13T22:53:52.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.529+0000 7fe002ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe004100cb0 0x7fe004074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:52.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.529+0000 7fe002ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe004100cb0 0x7fe004074b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46654/0 (socket says 172.21.15.2:46654) 2024-09-13T22:53:52.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.529+0000 7fe002ffd700 1 -- 172.21.15.2:0/1119324964 learned_addr learned my addr 172.21.15.2:0/1119324964 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:53:52.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.529+0000 7fe0027fc700 1 --2- 172.21.15.2:0/1119324964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe004101eb0 0x7fe004073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:52.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.529+0000 7fe002ffd700 1 -- 172.21.15.2:0/1119324964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe004101eb0 msgr2=0x7fe004073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:52.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.529+0000 7fe002ffd700 1 --2- 172.21.15.2:0/1119324964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe004101eb0 0x7fe004073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:52.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.529+0000 7fe002ffd700 1 -- 172.21.15.2:0/1119324964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff40095f0 con 0x7fe004100cb0 2024-09-13T22:53:52.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.529+0000 7fe0027fc700 1 --2- 172.21.15.2:0/1119324964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe004101eb0 0x7fe004073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:53:52.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.529+0000 7fe002ffd700 1 --2- 172.21.15.2:0/1119324964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe004100cb0 0x7fe004074b30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdff400bda0 tx=0x7fdff400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:52.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.529+0000 7fdfebfff700 1 -- 172.21.15.2:0/1119324964 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdff401d070 con 0x7fe004100cb0 2024-09-13T22:53:52.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.529+0000 7fe009288700 1 -- 172.21.15.2:0/1119324964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe004073a80 con 0x7fe004100cb0 2024-09-13T22:53:52.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.529+0000 7fdfebfff700 1 -- 172.21.15.2:0/1119324964 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdff400f460 con 0x7fe004100cb0 2024-09-13T22:53:52.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.529+0000 7fdfebfff700 1 -- 172.21.15.2:0/1119324964 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdff4021640 con 0x7fe004100cb0 2024-09-13T22:53:52.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.529+0000 7fe009288700 1 -- 172.21.15.2:0/1119324964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe004073f70 con 0x7fe004100cb0 2024-09-13T22:53:52.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.530+0000 7fe009288700 1 -- 172.21.15.2:0/1119324964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe004109810 con 0x7fe004100cb0 2024-09-13T22:53:52.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.531+0000 7fdfebfff700 1 -- 172.21.15.2:0/1119324964 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fdff400fa00 con 0x7fe004100cb0 2024-09-13T22:53:52.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.531+0000 7fdfebfff700 1 --2- 172.21.15.2:0/1119324964 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fdfec06c4e0 0x7fdfec06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:52.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.532+0000 7fdfebfff700 1 -- 172.21.15.2:0/1119324964 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fdff408caa0 con 0x7fe004100cb0 2024-09-13T22:53:52.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.532+0000 7fe0027fc700 1 --2- 172.21.15.2:0/1119324964 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fdfec06c4e0 0x7fdfec06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:52.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.532+0000 7fe0027fc700 1 --2- 172.21.15.2:0/1119324964 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fdfec06c4e0 0x7fdfec06e9a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdff8005950 tx=0x7fdff80058e0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:52.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.536+0000 7fdfebfff700 1 -- 172.21.15.2:0/1119324964 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fdff405ad60 con 0x7fe004100cb0 2024-09-13T22:53:52.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.736+0000 7fe009288700 1 -- 172.21.15.2:0/1119324964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fe00419e9a0 con 0x7fe004100cb0 2024-09-13T22:53:52.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.736+0000 7fdfebfff700 1 -- 172.21.15.2:0/1119324964 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fdff405a8f0 con 0x7fe004100cb0 2024-09-13T22:53:52.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.738+0000 7fe009288700 1 -- 172.21.15.2:0/1119324964 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fdfec06c4e0 msgr2=0x7fdfec06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:52.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.738+0000 7fe009288700 1 --2- 172.21.15.2:0/1119324964 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fdfec06c4e0 0x7fdfec06e9a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdff8005950 tx=0x7fdff80058e0 comp rx=0 tx=0).stop 2024-09-13T22:53:52.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.738+0000 7fe009288700 1 -- 172.21.15.2:0/1119324964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe004100cb0 msgr2=0x7fe004074b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.738+0000 7fe009288700 1 --2- 172.21.15.2:0/1119324964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe004100cb0 0x7fe004074b30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdff400bda0 tx=0x7fdff400be80 comp rx=0 tx=0).stop 2024-09-13T22:53:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.738+0000 7fe009288700 1 -- 172.21.15.2:0/1119324964 shutdown_connections 2024-09-13T22:53:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.738+0000 7fe009288700 1 --2- 172.21.15.2:0/1119324964 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fdfec06c4e0 0x7fdfec06e9a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.738+0000 7fe009288700 1 --2- 172.21.15.2:0/1119324964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe004100cb0 0x7fe004074b30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.738+0000 7fe009288700 1 --2- 172.21.15.2:0/1119324964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe004101eb0 0x7fe004073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.738+0000 7fe009288700 1 -- 172.21.15.2:0/1119324964 >> 172.21.15.2:0/1119324964 conn(0x7fe0040fc230 msgr2=0x7fe0041050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.738+0000 7fe009288700 1 -- 172.21.15.2:0/1119324964 shutdown_connections 2024-09-13T22:53:52.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:52.739+0000 7fe009288700 1 -- 172.21.15.2:0/1119324964 wait complete. 2024-09-13T22:53:53.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:52 smithi002 ceph-mon[27637]: pgmap v202: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-13T22:53:53.215 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:52 smithi047 ceph-mon[34560]: pgmap v202: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-13T22:53:53.516 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-13T22:53:53.730 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:53:55.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:54 smithi002 ceph-mon[27637]: pgmap v203: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-13T22:53:55.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:54 smithi047 ceph-mon[34560]: pgmap v203: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-13T22:53:55.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.333+0000 7fdcbd734700 1 -- 172.21.15.2:0/2021806490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb80fff70 msgr2=0x7fdcb81003f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:55.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.333+0000 7fdcbd734700 1 --2- 172.21.15.2:0/2021806490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb80fff70 0x7fdcb81003f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009910 tx=0x7fdcac009c20 comp rx=0 tx=0).stop 2024-09-13T22:53:55.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.333+0000 7fdcbd734700 1 -- 172.21.15.2:0/2021806490 shutdown_connections 2024-09-13T22:53:55.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.333+0000 7fdcbd734700 1 --2- 172.21.15.2:0/2021806490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb80fff70 0x7fdcb81003f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:55.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.333+0000 7fdcbd734700 1 --2- 172.21.15.2:0/2021806490 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdcb80ff610 0x7fdcb80ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:55.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.333+0000 7fdcbd734700 1 -- 172.21.15.2:0/2021806490 >> 172.21.15.2:0/2021806490 conn(0x7fdcb80fb190 msgr2=0x7fdcb80fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:55.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.333+0000 7fdcbd734700 1 -- 172.21.15.2:0/2021806490 shutdown_connections 2024-09-13T22:53:55.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.333+0000 7fdcbd734700 1 -- 172.21.15.2:0/2021806490 wait complete. 2024-09-13T22:53:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.333+0000 7fdcbd734700 1 Processor -- start 2024-09-13T22:53:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.334+0000 7fdcbd734700 1 -- start start 2024-09-13T22:53:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.334+0000 7fdcbd734700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb80ff610 0x7fdcb81986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.334+0000 7fdcbd734700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdcb80fff70 0x7fdcb8198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.334+0000 7fdcbd734700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb8199250 con 0x7fdcb80ff610 2024-09-13T22:53:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.334+0000 7fdcbd734700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb8199390 con 0x7fdcb80fff70 2024-09-13T22:53:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.334+0000 7fdcb6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb80ff610 0x7fdcb81986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.334+0000 7fdcb6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb80ff610 0x7fdcb81986f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46670/0 (socket says 172.21.15.2:46670) 2024-09-13T22:53:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.334+0000 7fdcb6ffd700 1 -- 172.21.15.2:0/1629569213 learned_addr learned my addr 172.21.15.2:0/1629569213 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:53:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.334+0000 7fdcb6ffd700 1 -- 172.21.15.2:0/1629569213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdcb80fff70 msgr2=0x7fdcb8198c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.334+0000 7fdcb6ffd700 1 --2- 172.21.15.2:0/1629569213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdcb80fff70 0x7fdcb8198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.334+0000 7fdcb6ffd700 1 -- 172.21.15.2:0/1629569213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac0095f0 con 0x7fdcb80ff610 2024-09-13T22:53:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.335+0000 7fdcb6ffd700 1 --2- 172.21.15.2:0/1629569213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb80ff610 0x7fdcb81986f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdca800b4b0 tx=0x7fdca800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.335+0000 7fdc9ffff700 1 -- 172.21.15.2:0/1629569213 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdca8011800 con 0x7fdcb80ff610 2024-09-13T22:53:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.335+0000 7fdc9ffff700 1 -- 172.21.15.2:0/1629569213 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdca8011e10 con 0x7fdcb80ff610 2024-09-13T22:53:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.335+0000 7fdcbd734700 1 -- 172.21.15.2:0/1629569213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb819de40 con 0x7fdcb80ff610 2024-09-13T22:53:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.335+0000 7fdc9ffff700 1 -- 172.21.15.2:0/1629569213 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdca800f2e0 con 0x7fdcb80ff610 2024-09-13T22:53:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.335+0000 7fdcbd734700 1 -- 172.21.15.2:0/1629569213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb819e330 con 0x7fdcb80ff610 2024-09-13T22:53:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.336+0000 7fdcbd734700 1 -- 172.21.15.2:0/1629569213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb810ba70 con 0x7fdcb80ff610 2024-09-13T22:53:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.336+0000 7fdc9ffff700 1 -- 172.21.15.2:0/1629569213 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fdca8010380 con 0x7fdcb80ff610 2024-09-13T22:53:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.337+0000 7fdc9ffff700 1 --2- 172.21.15.2:0/1629569213 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fdca006c4e0 0x7fdca006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.337+0000 7fdc9ffff700 1 -- 172.21.15.2:0/1629569213 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fdca808b460 con 0x7fdcb80ff610 2024-09-13T22:53:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.337+0000 7fdcb67fc700 1 --2- 172.21.15.2:0/1629569213 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fdca006c4e0 0x7fdca006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.337+0000 7fdcb67fc700 1 --2- 172.21.15.2:0/1629569213 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fdca006c4e0 0x7fdca006e9a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00b5c0 tx=0x7fdcac005960 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.341+0000 7fdc9ffff700 1 -- 172.21.15.2:0/1629569213 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fdca8059720 con 0x7fdcb80ff610 2024-09-13T22:53:55.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.536+0000 7fdcbd734700 1 -- 172.21.15.2:0/1629569213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fdcb810bc60 con 0x7fdcb80ff610 2024-09-13T22:53:55.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.537+0000 7fdc9ffff700 1 -- 172.21.15.2:0/1629569213 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7fdca80592b0 con 0x7fdcb80ff610 2024-09-13T22:53:55.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.538+0000 7fdcbd734700 1 -- 172.21.15.2:0/1629569213 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fdca006c4e0 msgr2=0x7fdca006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:55.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.538+0000 7fdcbd734700 1 --2- 172.21.15.2:0/1629569213 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fdca006c4e0 0x7fdca006e9a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00b5c0 tx=0x7fdcac005960 comp rx=0 tx=0).stop 2024-09-13T22:53:55.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.538+0000 7fdcbd734700 1 -- 172.21.15.2:0/1629569213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb80ff610 msgr2=0x7fdcb81986f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:55.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.538+0000 7fdcbd734700 1 --2- 172.21.15.2:0/1629569213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb80ff610 0x7fdcb81986f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdca800b4b0 tx=0x7fdca800b870 comp rx=0 tx=0).stop 2024-09-13T22:53:55.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.539+0000 7fdcbd734700 1 -- 172.21.15.2:0/1629569213 shutdown_connections 2024-09-13T22:53:55.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.539+0000 7fdcbd734700 1 --2- 172.21.15.2:0/1629569213 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fdca006c4e0 0x7fdca006e9a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:55.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.539+0000 7fdcbd734700 1 --2- 172.21.15.2:0/1629569213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb80ff610 0x7fdcb81986f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:55.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.539+0000 7fdcbd734700 1 --2- 172.21.15.2:0/1629569213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdcb80fff70 0x7fdcb8198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:55.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.539+0000 7fdcbd734700 1 -- 172.21.15.2:0/1629569213 >> 172.21.15.2:0/1629569213 conn(0x7fdcb80fb190 msgr2=0x7fdcb8107c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:55.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.539+0000 7fdcbd734700 1 -- 172.21.15.2:0/1629569213 shutdown_connections 2024-09-13T22:53:55.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:55.539+0000 7fdcbd734700 1 -- 172.21.15.2:0/1629569213 wait complete. 2024-09-13T22:53:56.276 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-13T22:53:56.483 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:53:57.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:56 smithi002 ceph-mon[27637]: pgmap v204: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-13T22:53:57.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:56 smithi047 ceph-mon[34560]: pgmap v204: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-13T22:53:58.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.150+0000 7f4d79272700 1 -- 172.21.15.2:0/1568517801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d74101eb0 msgr2=0x7f4d74102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:58.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.150+0000 7f4d79272700 1 --2- 172.21.15.2:0/1568517801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d74101eb0 0x7f4d74102310 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4d68009910 tx=0x7f4d68009c20 comp rx=0 tx=0).stop 2024-09-13T22:53:58.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.150+0000 7f4d79272700 1 -- 172.21.15.2:0/1568517801 shutdown_connections 2024-09-13T22:53:58.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.150+0000 7f4d79272700 1 --2- 172.21.15.2:0/1568517801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d74101eb0 0x7f4d74102310 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:58.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.150+0000 7f4d79272700 1 --2- 172.21.15.2:0/1568517801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d74100cb0 0x7f4d741010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:58.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.150+0000 7f4d79272700 1 -- 172.21.15.2:0/1568517801 >> 172.21.15.2:0/1568517801 conn(0x7f4d740fc230 msgr2=0x7f4d740fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:53:58.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.150+0000 7f4d79272700 1 -- 172.21.15.2:0/1568517801 shutdown_connections 2024-09-13T22:53:58.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.150+0000 7f4d79272700 1 -- 172.21.15.2:0/1568517801 wait complete. 2024-09-13T22:53:58.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.151+0000 7f4d79272700 1 Processor -- start 2024-09-13T22:53:58.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.151+0000 7f4d79272700 1 -- start start 2024-09-13T22:53:58.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.151+0000 7f4d79272700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d74100cb0 0x7f4d7419cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:58.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.151+0000 7f4d79272700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d74101eb0 0x7f4d7419d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:58.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.151+0000 7f4d79272700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7419d630 con 0x7f4d74101eb0 2024-09-13T22:53:58.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.151+0000 7f4d79272700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7419d770 con 0x7f4d74100cb0 2024-09-13T22:53:58.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.152+0000 7f4d727fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d74101eb0 0x7f4d7419d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:58.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.152+0000 7f4d727fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d74101eb0 0x7f4d7419d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46684/0 (socket says 172.21.15.2:46684) 2024-09-13T22:53:58.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.152+0000 7f4d727fc700 1 -- 172.21.15.2:0/3993499419 learned_addr learned my addr 172.21.15.2:0/3993499419 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:53:58.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.152+0000 7f4d72ffd700 1 --2- 172.21.15.2:0/3993499419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d74100cb0 0x7f4d7419cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:58.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.152+0000 7f4d727fc700 1 -- 172.21.15.2:0/3993499419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d74100cb0 msgr2=0x7f4d7419cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:53:58.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.152+0000 7f4d727fc700 1 --2- 172.21.15.2:0/3993499419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d74100cb0 0x7f4d7419cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:53:58.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.152+0000 7f4d727fc700 1 -- 172.21.15.2:0/3993499419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d680095f0 con 0x7f4d74101eb0 2024-09-13T22:53:58.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.152+0000 7f4d72ffd700 1 --2- 172.21.15.2:0/3993499419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d74100cb0 0x7f4d7419cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:53:58.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.152+0000 7f4d727fc700 1 --2- 172.21.15.2:0/3993499419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d74101eb0 0x7f4d7419d010 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800bd70 tx=0x7f4d6800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:58.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.152+0000 7f4d5bfff700 1 -- 172.21.15.2:0/3993499419 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d6801d070 con 0x7f4d74101eb0 2024-09-13T22:53:58.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.152+0000 7f4d79272700 1 -- 172.21.15.2:0/3993499419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d741a21c0 con 0x7f4d74101eb0 2024-09-13T22:53:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.152+0000 7f4d79272700 1 -- 172.21.15.2:0/3993499419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d741a26b0 con 0x7f4d74101eb0 2024-09-13T22:53:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.152+0000 7f4d5bfff700 1 -- 172.21.15.2:0/3993499419 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4d68022470 con 0x7f4d74101eb0 2024-09-13T22:53:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.152+0000 7f4d5bfff700 1 -- 172.21.15.2:0/3993499419 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d6800f670 con 0x7f4d74101eb0 2024-09-13T22:53:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.154+0000 7f4d79272700 1 -- 172.21.15.2:0/3993499419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d74105f90 con 0x7f4d74101eb0 2024-09-13T22:53:58.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.154+0000 7f4d5bfff700 1 -- 172.21.15.2:0/3993499419 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f4d68022a50 con 0x7f4d74101eb0 2024-09-13T22:53:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.155+0000 7f4d5bfff700 1 --2- 172.21.15.2:0/3993499419 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f4d5c06c4e0 0x7f4d5c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:53:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.155+0000 7f4d5bfff700 1 -- 172.21.15.2:0/3993499419 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f4d6808cf70 con 0x7f4d74101eb0 2024-09-13T22:53:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.155+0000 7f4d72ffd700 1 --2- 172.21.15.2:0/3993499419 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f4d5c06c4e0 0x7f4d5c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:53:58.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.155+0000 7f4d72ffd700 1 --2- 172.21.15.2:0/3993499419 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f4d5c06c4e0 0x7f4d5c06e9a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4d74101d10 tx=0x7f4d64005f90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:53:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.159+0000 7f4d5bfff700 1 -- 172.21.15.2:0/3993499419 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f4d680c00e0 con 0x7f4d74101eb0 2024-09-13T22:53:58.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:53:58.375+0000 7f4d79272700 1 -- 172.21.15.2:0/3993499419 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d74061340 con 0x7f4d5c06c4e0 2024-09-13T22:53:59.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:58 smithi002 ceph-mon[27637]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 1023 B/s wr, 3 op/s 2024-09-13T22:53:59.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:58 smithi047 ceph-mon[34560]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 1023 B/s wr, 3 op/s 2024-09-13T22:54:00.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:53:59 smithi047 ceph-mon[34560]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:00.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:53:59 smithi002 ceph-mon[27637]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:01.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:00 smithi002 ceph-mon[27637]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-13T22:54:01.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:00 smithi047 ceph-mon[34560]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-13T22:54:03.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:02 smithi002 ceph-mon[27637]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-13T22:54:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:02 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:54:03.270 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:02 smithi047 ceph-mon[34560]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-13T22:54:03.270 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:02 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:54:05.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:04 smithi002 ceph-mon[27637]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-13T22:54:05.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:04 smithi047 ceph-mon[34560]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-13T22:54:07.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:06 smithi002 ceph-mon[27637]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-13T22:54:07.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:06 smithi047 ceph-mon[34560]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-13T22:54:09.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:08 smithi002 ceph-mon[27637]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T22:54:09.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:08 smithi047 ceph-mon[34560]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T22:54:11.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:10 smithi002 ceph-mon[27637]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-09-13T22:54:11.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:10 smithi047 ceph-mon[34560]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-09-13T22:54:13.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:12 smithi002 ceph-mon[27637]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-09-13T22:54:13.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:12 smithi047 ceph-mon[34560]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 341 B/s wr, 2 op/s 2024-09-13T22:54:15.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:14 smithi002 ceph-mon[27637]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T22:54:15.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:14 smithi047 ceph-mon[34560]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-13T22:54:17.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:16 smithi002 ceph-mon[27637]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:17.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:16 smithi047 ceph-mon[34560]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:18.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:17 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:54:18.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:17 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:54:19.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:18 smithi002 ceph-mon[27637]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:54:19.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:18 smithi047 ceph-mon[34560]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:54:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:20 smithi002 ceph-mon[27637]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:21.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:20 smithi047 ceph-mon[34560]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:23.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:22 smithi002 ceph-mon[27637]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:23.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:22 smithi047 ceph-mon[34560]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:25.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:24 smithi002 ceph-mon[27637]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:54:25.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:24 smithi047 ceph-mon[34560]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:54:27.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:26 smithi002 ceph-mon[27637]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:27.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:26 smithi047 ceph-mon[34560]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:27.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:27.485+0000 7f4d5bfff700 1 -- 172.21.15.2:0/3993499419 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f4d74061340 con 0x7f4d5c06c4e0 2024-09-13T22:54:27.487 INFO:teuthology.orchestra.run.smithi002.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:54:27.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:27.488+0000 7f4d79272700 1 -- 172.21.15.2:0/3993499419 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f4d5c06c4e0 msgr2=0x7f4d5c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:27.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:27.488+0000 7f4d79272700 1 --2- 172.21.15.2:0/3993499419 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f4d5c06c4e0 0x7f4d5c06e9a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4d74101d10 tx=0x7f4d64005f90 comp rx=0 tx=0).stop 2024-09-13T22:54:27.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:27.488+0000 7f4d79272700 1 -- 172.21.15.2:0/3993499419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d74101eb0 msgr2=0x7f4d7419d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:27.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:27.488+0000 7f4d79272700 1 --2- 172.21.15.2:0/3993499419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d74101eb0 0x7f4d7419d010 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800bd70 tx=0x7f4d6800be50 comp rx=0 tx=0).stop 2024-09-13T22:54:27.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:27.488+0000 7f4d79272700 1 -- 172.21.15.2:0/3993499419 shutdown_connections 2024-09-13T22:54:27.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:27.488+0000 7f4d79272700 1 --2- 172.21.15.2:0/3993499419 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f4d5c06c4e0 0x7f4d5c06e9a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:27.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:27.488+0000 7f4d79272700 1 --2- 172.21.15.2:0/3993499419 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d74100cb0 0x7f4d7419cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:27.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:27.488+0000 7f4d79272700 1 --2- 172.21.15.2:0/3993499419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d74101eb0 0x7f4d7419d010 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:27.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:27.488+0000 7f4d79272700 1 -- 172.21.15.2:0/3993499419 >> 172.21.15.2:0/3993499419 conn(0x7f4d740fc230 msgr2=0x7f4d741030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:54:27.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:27.488+0000 7f4d79272700 1 -- 172.21.15.2:0/3993499419 shutdown_connections 2024-09-13T22:54:27.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:27.488+0000 7f4d79272700 1 -- 172.21.15.2:0/3993499419 wait complete. 2024-09-13T22:54:28.130 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-13T22:54:28.403 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:54:28.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:28 smithi002 ceph-mon[27637]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:54:28.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:28 smithi002 ceph-mon[27637]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:54:28.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:28 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:54:28.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:28 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:54:28.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:28 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:54:28.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:28 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:54:28.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:28 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:54:28.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:28 smithi047 ceph-mon[34560]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:54:28.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:28 smithi047 ceph-mon[34560]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:54:28.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:28 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:54:28.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:28 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:54:28.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:28 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:54:28.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:28 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:54:28.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:28 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:54:29.577 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:29 smithi002 ceph-mon[27637]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:54:29.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:29 smithi047 ceph-mon[34560]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:54:30.490 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:30 smithi047 ceph-mon[34560]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.594+0000 7f64f759e700 1 -- 172.21.15.2:0/2777925954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64f0095c70 msgr2=0x7f64f00960d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.594+0000 7f64f759e700 1 --2- 172.21.15.2:0/2777925954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64f0095c70 0x7f64f00960d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f64ec009910 tx=0x7f64ec009c20 comp rx=0 tx=0).stop 2024-09-13T22:54:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.594+0000 7f64f759e700 1 -- 172.21.15.2:0/2777925954 shutdown_connections 2024-09-13T22:54:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.594+0000 7f64f759e700 1 --2- 172.21.15.2:0/2777925954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64f0095c70 0x7f64f00960d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.594+0000 7f64f759e700 1 --2- 172.21.15.2:0/2777925954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f0094a70 0x7f64f0094e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.594+0000 7f64f759e700 1 -- 172.21.15.2:0/2777925954 >> 172.21.15.2:0/2777925954 conn(0x7f64f0090030 msgr2=0x7f64f0092450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:54:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.594+0000 7f64f759e700 1 -- 172.21.15.2:0/2777925954 shutdown_connections 2024-09-13T22:54:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.594+0000 7f64f759e700 1 -- 172.21.15.2:0/2777925954 wait complete. 2024-09-13T22:54:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.595+0000 7f64f759e700 1 Processor -- start 2024-09-13T22:54:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.596+0000 7f64f759e700 1 -- start start 2024-09-13T22:54:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.596+0000 7f64f759e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64f0094a70 0x7f64f012b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:54:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.596+0000 7f64f759e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f0095c70 0x7f64f012b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:54:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.596+0000 7f64f759e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f012be80 con 0x7f64f0094a70 2024-09-13T22:54:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.596+0000 7f64f759e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f012bfc0 con 0x7f64f0095c70 2024-09-13T22:54:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.596+0000 7f64f5d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f0095c70 0x7f64f012b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:54:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.597+0000 7f64f5d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f0095c70 0x7f64f012b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.2:47178/0 (socket says 172.21.15.2:47178) 2024-09-13T22:54:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.597+0000 7f64f5d9b700 1 -- 172.21.15.2:0/2613225170 learned_addr learned my addr 172.21.15.2:0/2613225170 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:54:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.597+0000 7f64f659c700 1 --2- 172.21.15.2:0/2613225170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64f0094a70 0x7f64f012b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:54:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.597+0000 7f64f5d9b700 1 -- 172.21.15.2:0/2613225170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64f0094a70 msgr2=0x7f64f012b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.597+0000 7f64f5d9b700 1 --2- 172.21.15.2:0/2613225170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64f0094a70 0x7f64f012b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.597+0000 7f64f5d9b700 1 -- 172.21.15.2:0/2613225170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec0095f0 con 0x7f64f0095c70 2024-09-13T22:54:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.597+0000 7f64f5d9b700 1 --2- 172.21.15.2:0/2613225170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f0095c70 0x7f64f012b860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0092e0 tx=0x7f64ec00f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:54:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.597+0000 7f64e77fe700 1 -- 172.21.15.2:0/2613225170 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64ec01d070 con 0x7f64f0095c70 2024-09-13T22:54:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.597+0000 7f64e77fe700 1 -- 172.21.15.2:0/2613225170 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f64ec0052a0 con 0x7f64f0095c70 2024-09-13T22:54:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.597+0000 7f64e77fe700 1 -- 172.21.15.2:0/2613225170 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64ec017630 con 0x7f64f0095c70 2024-09-13T22:54:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.598+0000 7f64f759e700 1 -- 172.21.15.2:0/2613225170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f0130a10 con 0x7f64f0095c70 2024-09-13T22:54:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.598+0000 7f64f759e700 1 -- 172.21.15.2:0/2613225170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f0130e40 con 0x7f64f0095c70 2024-09-13T22:54:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.599+0000 7f64f759e700 1 -- 172.21.15.2:0/2613225170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f009d5d0 con 0x7f64f0095c70 2024-09-13T22:54:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.600+0000 7f64e77fe700 1 -- 172.21.15.2:0/2613225170 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f64ec00fba0 con 0x7f64f0095c70 2024-09-13T22:54:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.601+0000 7f64e77fe700 1 --2- 172.21.15.2:0/2613225170 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f64e006c4f0 0x7f64e006e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:54:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.601+0000 7f64e77fe700 1 -- 172.21.15.2:0/2613225170 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f64ec08cda0 con 0x7f64f0095c70 2024-09-13T22:54:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.601+0000 7f64f659c700 1 --2- 172.21.15.2:0/2613225170 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f64e006c4f0 0x7f64e006e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:54:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.601+0000 7f64f659c700 1 --2- 172.21.15.2:0/2613225170 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f64e006c4f0 0x7f64e006e9b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f64f0095ad0 tx=0x7f64e8009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:54:30.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:30.609+0000 7f64e77fe700 1 -- 172.21.15.2:0/2613225170 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f64ec05afc0 con 0x7f64f0095c70 2024-09-13T22:54:30.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:30 smithi002 ceph-mon[27637]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:31.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.047+0000 7f64f759e700 1 -- 172.21.15.2:0/2613225170 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f64f0123c50 con 0x7f64e006c4f0 2024-09-13T22:54:31.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.049+0000 7f64e77fe700 1 -- 172.21.15.2:0/2613225170 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f64f0123c50 con 0x7f64e006c4f0 2024-09-13T22:54:31.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.052+0000 7f64f759e700 1 -- 172.21.15.2:0/2613225170 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f64e006c4f0 msgr2=0x7f64e006e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:31.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.052+0000 7f64f759e700 1 --2- 172.21.15.2:0/2613225170 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f64e006c4f0 0x7f64e006e9b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f64f0095ad0 tx=0x7f64e8009260 comp rx=0 tx=0).stop 2024-09-13T22:54:31.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.052+0000 7f64f759e700 1 -- 172.21.15.2:0/2613225170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f0095c70 msgr2=0x7f64f012b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:31.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.052+0000 7f64f759e700 1 --2- 172.21.15.2:0/2613225170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f0095c70 0x7f64f012b860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0092e0 tx=0x7f64ec00f740 comp rx=0 tx=0).stop 2024-09-13T22:54:31.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.052+0000 7f64f759e700 1 -- 172.21.15.2:0/2613225170 shutdown_connections 2024-09-13T22:54:31.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.052+0000 7f64f759e700 1 --2- 172.21.15.2:0/2613225170 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f64e006c4f0 0x7f64e006e9b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:31.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.052+0000 7f64f759e700 1 --2- 172.21.15.2:0/2613225170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64f0094a70 0x7f64f012b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:31.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.052+0000 7f64f759e700 1 --2- 172.21.15.2:0/2613225170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64f0095c70 0x7f64f012b860 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0092e0 tx=0x7f64ec00f740 comp rx=0 tx=0).stop 2024-09-13T22:54:31.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.052+0000 7f64f759e700 1 -- 172.21.15.2:0/2613225170 >> 172.21.15.2:0/2613225170 conn(0x7f64f0090030 msgr2=0x7f64f0092420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:54:31.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.052+0000 7f64f759e700 1 -- 172.21.15.2:0/2613225170 shutdown_connections 2024-09-13T22:54:31.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.052+0000 7f64f759e700 1 -- 172.21.15.2:0/2613225170 wait complete. 2024-09-13T22:54:31.069 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T22:54:31.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.209+0000 7f023f72b700 1 -- 172.21.15.2:0/4164038442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0238101750 msgr2=0x7f0238103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:31.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.209+0000 7f023f72b700 1 --2- 172.21.15.2:0/4164038442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0238101750 0x7f0238103b40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0234009910 tx=0x7f0234009c20 comp rx=0 tx=0).stop 2024-09-13T22:54:31.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.209+0000 7f023f72b700 1 -- 172.21.15.2:0/4164038442 shutdown_connections 2024-09-13T22:54:31.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.209+0000 7f023f72b700 1 --2- 172.21.15.2:0/4164038442 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0238104080 0x7f0238106470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:31.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.209+0000 7f023f72b700 1 --2- 172.21.15.2:0/4164038442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0238101750 0x7f0238103b40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:31.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.209+0000 7f023f72b700 1 -- 172.21.15.2:0/4164038442 >> 172.21.15.2:0/4164038442 conn(0x7f02380fb120 msgr2=0x7f02380fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:54:31.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.210+0000 7f023f72b700 1 -- 172.21.15.2:0/4164038442 shutdown_connections 2024-09-13T22:54:31.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.210+0000 7f023f72b700 1 -- 172.21.15.2:0/4164038442 wait complete. 2024-09-13T22:54:31.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.211+0000 7f023f72b700 1 Processor -- start 2024-09-13T22:54:31.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.211+0000 7f023f72b700 1 -- start start 2024-09-13T22:54:31.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.211+0000 7f023f72b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0238101750 0x7f02381964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:54:31.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.211+0000 7f023f72b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0238104080 0x7f0238196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:54:31.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.211+0000 7f023d4c7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0238101750 0x7f02381964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:54:31.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.212+0000 7f023d4c7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0238101750 0x7f02381964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.2:47208/0 (socket says 172.21.15.2:47208) 2024-09-13T22:54:31.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.212+0000 7f023d4c7700 1 -- 172.21.15.2:0/1143857851 learned_addr learned my addr 172.21.15.2:0/1143857851 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:54:31.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.212+0000 7f023ccc6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0238104080 0x7f0238196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:54:31.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.212+0000 7f023f72b700 1 -- 172.21.15.2:0/1143857851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0238197030 con 0x7f0238104080 2024-09-13T22:54:31.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.212+0000 7f023f72b700 1 -- 172.21.15.2:0/1143857851 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0238197170 con 0x7f0238101750 2024-09-13T22:54:31.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.212+0000 7f023ccc6700 1 -- 172.21.15.2:0/1143857851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0238101750 msgr2=0x7f02381964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:31.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.212+0000 7f023ccc6700 1 --2- 172.21.15.2:0/1143857851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0238101750 0x7f02381964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.212+0000 7f023ccc6700 1 -- 172.21.15.2:0/1143857851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0228009520 con 0x7f0238104080 2024-09-13T22:54:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.212+0000 7f023ccc6700 1 --2- 172.21.15.2:0/1143857851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0238104080 0x7f0238196a10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0228009fa0 tx=0x7f022800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:54:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.213+0000 7f022e7fc700 1 -- 172.21.15.2:0/1143857851 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0228013bb0 con 0x7f0238104080 2024-09-13T22:54:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.213+0000 7f023f72b700 1 -- 172.21.15.2:0/1143857851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02340095f0 con 0x7f0238104080 2024-09-13T22:54:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.213+0000 7f022e7fc700 1 -- 172.21.15.2:0/1143857851 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f022800ee90 con 0x7f0238104080 2024-09-13T22:54:31.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.213+0000 7f023f72b700 1 -- 172.21.15.2:0/1143857851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02380ff8a0 con 0x7f0238104080 2024-09-13T22:54:31.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.214+0000 7f022e7fc700 1 -- 172.21.15.2:0/1143857851 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0228003680 con 0x7f0238104080 2024-09-13T22:54:31.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.215+0000 7f023f72b700 1 -- 172.21.15.2:0/1143857851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0238190610 con 0x7f0238104080 2024-09-13T22:54:31.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.216+0000 7f022e7fc700 1 -- 172.21.15.2:0/1143857851 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f02280038f0 con 0x7f0238104080 2024-09-13T22:54:31.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.217+0000 7f022e7fc700 1 --2- 172.21.15.2:0/1143857851 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f022406c4e0 0x7f022406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:54:31.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.217+0000 7f022e7fc700 1 -- 172.21.15.2:0/1143857851 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f022808fb90 con 0x7f0238104080 2024-09-13T22:54:31.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.217+0000 7f023d4c7700 1 --2- 172.21.15.2:0/1143857851 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f022406c4e0 0x7f022406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:54:31.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.218+0000 7f023d4c7700 1 --2- 172.21.15.2:0/1143857851 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f022406c4e0 0x7f022406e9a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0234006010 tx=0x7f0234005940 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:54:31.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.226+0000 7f022e7fc700 1 -- 172.21.15.2:0/1143857851 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0228013d10 con 0x7f0238104080 2024-09-13T22:54:31.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.574+0000 7f023f72b700 1 -- 172.21.15.2:0/1143857851 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02380611d0 con 0x7f022406c4e0 2024-09-13T22:54:31.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.575+0000 7f022e7fc700 1 -- 172.21.15.2:0/1143857851 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f02380611d0 con 0x7f022406c4e0 2024-09-13T22:54:31.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.578+0000 7f023f72b700 1 -- 172.21.15.2:0/1143857851 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f022406c4e0 msgr2=0x7f022406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:31.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.578+0000 7f023f72b700 1 --2- 172.21.15.2:0/1143857851 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f022406c4e0 0x7f022406e9a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0234006010 tx=0x7f0234005940 comp rx=0 tx=0).stop 2024-09-13T22:54:31.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.578+0000 7f023f72b700 1 -- 172.21.15.2:0/1143857851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0238104080 msgr2=0x7f0238196a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:31.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.578+0000 7f023f72b700 1 --2- 172.21.15.2:0/1143857851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0238104080 0x7f0238196a10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0228009fa0 tx=0x7f022800ec50 comp rx=0 tx=0).stop 2024-09-13T22:54:31.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.578+0000 7f023f72b700 1 -- 172.21.15.2:0/1143857851 shutdown_connections 2024-09-13T22:54:31.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.578+0000 7f023f72b700 1 --2- 172.21.15.2:0/1143857851 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f022406c4e0 0x7f022406e9a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:31.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.578+0000 7f023f72b700 1 --2- 172.21.15.2:0/1143857851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0238101750 0x7f02381964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:31.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.578+0000 7f023f72b700 1 --2- 172.21.15.2:0/1143857851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0238104080 0x7f0238196a10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:31.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.578+0000 7f023f72b700 1 -- 172.21.15.2:0/1143857851 >> 172.21.15.2:0/1143857851 conn(0x7f02380fb120 msgr2=0x7f02380fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:54:31.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.579+0000 7f023f72b700 1 -- 172.21.15.2:0/1143857851 shutdown_connections 2024-09-13T22:54:31.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.579+0000 7f023f72b700 1 -- 172.21.15.2:0/1143857851 wait complete. 2024-09-13T22:54:31.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.752+0000 7fe05656f700 1 -- 172.21.15.2:0/2554680130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe050100dc0 msgr2=0x7fe050101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:31.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.752+0000 7fe05656f700 1 --2- 172.21.15.2:0/2554680130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe050100dc0 0x7fe050101220 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe044009910 tx=0x7fe044009c20 comp rx=0 tx=0).stop 2024-09-13T22:54:31.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.752+0000 7fe05656f700 1 -- 172.21.15.2:0/2554680130 shutdown_connections 2024-09-13T22:54:31.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.752+0000 7fe05656f700 1 --2- 172.21.15.2:0/2554680130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe050100dc0 0x7fe050101220 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:31.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.752+0000 7fe05656f700 1 --2- 172.21.15.2:0/2554680130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0500ffbc0 0x7fe0500fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:31.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.752+0000 7fe05656f700 1 -- 172.21.15.2:0/2554680130 >> 172.21.15.2:0/2554680130 conn(0x7fe0500fb160 msgr2=0x7fe0500fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:54:31.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.752+0000 7fe05656f700 1 -- 172.21.15.2:0/2554680130 shutdown_connections 2024-09-13T22:54:31.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.752+0000 7fe05656f700 1 -- 172.21.15.2:0/2554680130 wait complete. 2024-09-13T22:54:31.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.754+0000 7fe05656f700 1 Processor -- start 2024-09-13T22:54:31.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.754+0000 7fe05656f700 1 -- start start 2024-09-13T22:54:31.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.754+0000 7fe05656f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0500ffbc0 0x7fe0501956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:54:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.755+0000 7fe05656f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe050100dc0 0x7fe050195c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:54:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.755+0000 7fe04ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0500ffbc0 0x7fe0501956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:54:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.755+0000 7fe04ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0500ffbc0 0x7fe0501956c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33950/0 (socket says 172.21.15.2:33950) 2024-09-13T22:54:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.755+0000 7fe04ffff700 1 -- 172.21.15.2:0/2577554704 learned_addr learned my addr 172.21.15.2:0/2577554704 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:54:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.755+0000 7fe05656f700 1 -- 172.21.15.2:0/2577554704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe050196220 con 0x7fe0500ffbc0 2024-09-13T22:54:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.755+0000 7fe04f7fe700 1 --2- 172.21.15.2:0/2577554704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe050100dc0 0x7fe050195c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:54:31.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.755+0000 7fe05656f700 1 -- 172.21.15.2:0/2577554704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe050196360 con 0x7fe050100dc0 2024-09-13T22:54:31.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.756+0000 7fe04ffff700 1 -- 172.21.15.2:0/2577554704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe050100dc0 msgr2=0x7fe050195c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:31.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.756+0000 7fe04ffff700 1 --2- 172.21.15.2:0/2577554704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe050100dc0 0x7fe050195c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:31.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.756+0000 7fe04ffff700 1 -- 172.21.15.2:0/2577554704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0440095f0 con 0x7fe0500ffbc0 2024-09-13T22:54:31.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.756+0000 7fe04ffff700 1 --2- 172.21.15.2:0/2577554704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0500ffbc0 0x7fe0501956c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe04000e8f0 tx=0x7fe04000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:54:31.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.756+0000 7fe04d7fa700 1 -- 172.21.15.2:0/2577554704 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe040009790 con 0x7fe0500ffbc0 2024-09-13T22:54:31.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.756+0000 7fe04d7fa700 1 -- 172.21.15.2:0/2577554704 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe04000c810 con 0x7fe0500ffbc0 2024-09-13T22:54:31.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.757+0000 7fe04d7fa700 1 -- 172.21.15.2:0/2577554704 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe040003d20 con 0x7fe0500ffbc0 2024-09-13T22:54:31.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.757+0000 7fe05656f700 1 -- 172.21.15.2:0/2577554704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe050068e70 con 0x7fe0500ffbc0 2024-09-13T22:54:31.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.757+0000 7fe05656f700 1 -- 172.21.15.2:0/2577554704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe050069390 con 0x7fe0500ffbc0 2024-09-13T22:54:31.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.759+0000 7fe05656f700 1 -- 172.21.15.2:0/2577554704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05004f2e0 con 0x7fe0500ffbc0 2024-09-13T22:54:31.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.760+0000 7fe04d7fa700 1 -- 172.21.15.2:0/2577554704 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fe0400041f0 con 0x7fe0500ffbc0 2024-09-13T22:54:31.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.761+0000 7fe04d7fa700 1 --2- 172.21.15.2:0/2577554704 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe03806c320 0x7fe03806e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:54:31.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.761+0000 7fe04d7fa700 1 -- 172.21.15.2:0/2577554704 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fe040014070 con 0x7fe0500ffbc0 2024-09-13T22:54:31.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.761+0000 7fe04f7fe700 1 --2- 172.21.15.2:0/2577554704 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe03806c320 0x7fe03806e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:54:31.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.762+0000 7fe04f7fe700 1 --2- 172.21.15.2:0/2577554704 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe03806c320 0x7fe03806e7e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe04400b6f0 tx=0x7fe044005a90 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:54:31.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:31.769+0000 7fe04d7fa700 1 -- 172.21.15.2:0/2577554704 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe040059db0 con 0x7fe0500ffbc0 2024-09-13T22:54:32.196 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:31 smithi002 ceph-mon[27637]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:32.196 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:31 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:54:32.196 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:31 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:54:32.196 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:31 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:54:32.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.194+0000 7fe05656f700 1 -- 172.21.15.2:0/2577554704 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe05018f2f0 con 0x7fe03806c320 2024-09-13T22:54:32.209 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:54:32.209 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (5m) 54s ago 6m 26.5M - 0.25.0 c8568f914cd2 76a1576b4f53 2024-09-13T22:54:32.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (7m) 54s ago 7m 7448k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T22:54:32.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (6m) 60s ago 6m 7390k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T22:54:32.210 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (7m) 54s ago 7m 6665k - 18.2.1 5be31c24972a de910e0c5157 2024-09-13T22:54:32.210 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (6m) 60s ago 6m 6651k - 18.2.1 5be31c24972a 9f4bcfa66588 2024-09-13T22:54:32.210 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (5m) 54s ago 6m 84.3M - 9.4.7 954c08fa6188 39f4cfdc98d7 2024-09-13T22:54:32.210 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (82s) 54s ago 80s 11.5M - 18.2.1 5be31c24972a 59e9c88c31ca 2024-09-13T22:54:32.210 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (74s) 54s ago 74s 14.6M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T22:54:32.210 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (78s) 60s ago 78s 17.9M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T22:54:32.210 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (72s) 60s ago 71s 14.6M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T22:54:32.210 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:9283,8765,8443 running (8m) 54s ago 8m 487M - 18.2.1 5be31c24972a 04da5b94f858 2024-09-13T22:54:32.210 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (5m) 60s ago 5m 441M - 18.2.1 5be31c24972a 53861b0f547e 2024-09-13T22:54:32.210 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (8m) 54s ago 8m 44.7M 2048M 18.2.1 5be31c24972a de11be74385d 2024-09-13T22:54:32.210 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (5m) 60s ago 5m 35.1M 2048M 18.2.1 5be31c24972a 5642284a23bf 2024-09-13T22:54:32.211 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (6m) 54s ago 6m 15.7M - 1.5.0 0da6a335fe13 427e04f7ded9 2024-09-13T22:54:32.211 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (5m) 60s ago 5m 16.2M - 1.5.0 0da6a335fe13 07935c82b1d6 2024-09-13T22:54:32.211 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (5m) 54s ago 5m 47.6M 3948M 18.2.1 5be31c24972a 1e1f6936c402 2024-09-13T22:54:32.211 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (4m) 54s ago 4m 48.3M 3948M 18.2.1 5be31c24972a f0ac78c34831 2024-09-13T22:54:32.211 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (4m) 54s ago 4m 49.3M 3948M 18.2.1 5be31c24972a 9a2f4f6decfb 2024-09-13T22:54:32.211 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (3m) 60s ago 3m 46.5M 4972M 18.2.1 5be31c24972a fb455cc4c571 2024-09-13T22:54:32.211 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (3m) 60s ago 3m 44.4M 4972M 18.2.1 5be31c24972a f1bdc2c50535 2024-09-13T22:54:32.211 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (2m) 60s ago 2m 46.3M 4972M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T22:54:32.211 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (5m) 54s ago 6m 54.5M - 2.43.0 a07b618ecd1d f0199b20cefc 2024-09-13T22:54:32.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.208+0000 7fe04d7fa700 1 -- 172.21.15.2:0/2577554704 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7fe05018f2f0 con 0x7fe03806c320 2024-09-13T22:54:32.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.211+0000 7fe05656f700 1 -- 172.21.15.2:0/2577554704 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe03806c320 msgr2=0x7fe03806e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:32.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.211+0000 7fe05656f700 1 --2- 172.21.15.2:0/2577554704 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe03806c320 0x7fe03806e7e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe04400b6f0 tx=0x7fe044005a90 comp rx=0 tx=0).stop 2024-09-13T22:54:32.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.211+0000 7fe05656f700 1 -- 172.21.15.2:0/2577554704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0500ffbc0 msgr2=0x7fe0501956c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:32.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.211+0000 7fe05656f700 1 --2- 172.21.15.2:0/2577554704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0500ffbc0 0x7fe0501956c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe04000e8f0 tx=0x7fe04000ec00 comp rx=0 tx=0).stop 2024-09-13T22:54:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.212+0000 7fe05656f700 1 -- 172.21.15.2:0/2577554704 shutdown_connections 2024-09-13T22:54:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.212+0000 7fe05656f700 1 --2- 172.21.15.2:0/2577554704 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe03806c320 0x7fe03806e7e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.212+0000 7fe05656f700 1 --2- 172.21.15.2:0/2577554704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0500ffbc0 0x7fe0501956c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.212+0000 7fe05656f700 1 --2- 172.21.15.2:0/2577554704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe050100dc0 0x7fe050195c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.212+0000 7fe05656f700 1 -- 172.21.15.2:0/2577554704 >> 172.21.15.2:0/2577554704 conn(0x7fe0500fb160 msgr2=0x7fe050104110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:54:32.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.213+0000 7fe05656f700 1 -- 172.21.15.2:0/2577554704 shutdown_connections 2024-09-13T22:54:32.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.213+0000 7fe05656f700 1 -- 172.21.15.2:0/2577554704 wait complete. 2024-09-13T22:54:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.343+0000 7fc86faae700 1 -- 172.21.15.2:0/4064385401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8680ffc10 msgr2=0x7fc868100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.343+0000 7fc86faae700 1 --2- 172.21.15.2:0/4064385401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8680ffc10 0x7fc868100030 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc864009910 tx=0x7fc864009c20 comp rx=0 tx=0).stop 2024-09-13T22:54:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.343+0000 7fc86faae700 1 -- 172.21.15.2:0/4064385401 shutdown_connections 2024-09-13T22:54:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.343+0000 7fc86faae700 1 --2- 172.21.15.2:0/4064385401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc868100e10 0x7fc868101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.343+0000 7fc86faae700 1 --2- 172.21.15.2:0/4064385401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8680ffc10 0x7fc868100030 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.343+0000 7fc86faae700 1 -- 172.21.15.2:0/4064385401 >> 172.21.15.2:0/4064385401 conn(0x7fc8680fb190 msgr2=0x7fc8680fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:54:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.344+0000 7fc86faae700 1 -- 172.21.15.2:0/4064385401 shutdown_connections 2024-09-13T22:54:32.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.344+0000 7fc86faae700 1 -- 172.21.15.2:0/4064385401 wait complete. 2024-09-13T22:54:32.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.345+0000 7fc86faae700 1 Processor -- start 2024-09-13T22:54:32.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.345+0000 7fc86faae700 1 -- start start 2024-09-13T22:54:32.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.346+0000 7fc86faae700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8680ffc10 0x7fc8681953e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:54:32.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.346+0000 7fc86faae700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc868100e10 0x7fc868195920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:54:32.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.346+0000 7fc86d84a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8680ffc10 0x7fc8681953e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:54:32.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.346+0000 7fc86d049700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc868100e10 0x7fc868195920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:54:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.346+0000 7fc86d84a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8680ffc10 0x7fc8681953e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.2:47240/0 (socket says 172.21.15.2:47240) 2024-09-13T22:54:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.346+0000 7fc86d84a700 1 -- 172.21.15.2:0/3011956944 learned_addr learned my addr 172.21.15.2:0/3011956944 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:54:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.346+0000 7fc86faae700 1 -- 172.21.15.2:0/3011956944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc868195f40 con 0x7fc868100e10 2024-09-13T22:54:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.347+0000 7fc86faae700 1 -- 172.21.15.2:0/3011956944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc868196080 con 0x7fc8680ffc10 2024-09-13T22:54:32.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.347+0000 7fc86d84a700 1 -- 172.21.15.2:0/3011956944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc868100e10 msgr2=0x7fc868195920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.347+0000 7fc86d84a700 1 --2- 172.21.15.2:0/3011956944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc868100e10 0x7fc868195920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.347+0000 7fc86d84a700 1 -- 172.21.15.2:0/3011956944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc858009520 con 0x7fc8680ffc10 2024-09-13T22:54:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.347+0000 7fc86d84a700 1 --2- 172.21.15.2:0/3011956944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8680ffc10 0x7fc8681953e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc864005b40 tx=0x7fc86400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:54:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.348+0000 7fc85effd700 1 -- 172.21.15.2:0/3011956944 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc86401d070 con 0x7fc8680ffc10 2024-09-13T22:54:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.348+0000 7fc85effd700 1 -- 172.21.15.2:0/3011956944 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc864005dc0 con 0x7fc8680ffc10 2024-09-13T22:54:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.348+0000 7fc85effd700 1 -- 172.21.15.2:0/3011956944 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc864022470 con 0x7fc8680ffc10 2024-09-13T22:54:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.348+0000 7fc86faae700 1 -- 172.21.15.2:0/3011956944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8640095f0 con 0x7fc8680ffc10 2024-09-13T22:54:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.348+0000 7fc86faae700 1 -- 172.21.15.2:0/3011956944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc868068820 con 0x7fc8680ffc10 2024-09-13T22:54:32.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.350+0000 7fc86faae700 1 -- 172.21.15.2:0/3011956944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc868108700 con 0x7fc8680ffc10 2024-09-13T22:54:32.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.350+0000 7fc85effd700 1 -- 172.21.15.2:0/3011956944 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fc864003680 con 0x7fc8680ffc10 2024-09-13T22:54:32.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.351+0000 7fc85effd700 1 --2- 172.21.15.2:0/3011956944 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc85406c4e0 0x7fc85406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:54:32.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.352+0000 7fc85effd700 1 -- 172.21.15.2:0/3011956944 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fc86408ccf0 con 0x7fc8680ffc10 2024-09-13T22:54:32.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.352+0000 7fc86d049700 1 --2- 172.21.15.2:0/3011956944 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc85406c4e0 0x7fc85406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:54:32.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.352+0000 7fc86d049700 1 --2- 172.21.15.2:0/3011956944 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc85406c4e0 0x7fc85406e9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc858009e40 tx=0x7fc858009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:54:32.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.360+0000 7fc85effd700 1 -- 172.21.15.2:0/3011956944 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc86405af90 con 0x7fc8680ffc10 2024-09-13T22:54:32.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:31 smithi047 ceph-mon[34560]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:32.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:31 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:54:32.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:31 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:54:32.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:31 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:54:32.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.933+0000 7fc86faae700 1 -- 172.21.15.2:0/3011956944 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc8681088f0 con 0x7fc8680ffc10 2024-09-13T22:54:32.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.934+0000 7fc85effd700 1 -- 172.21.15.2:0/3011956944 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7fc86405ab20 con 0x7fc8680ffc10 2024-09-13T22:54:32.935 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:54:32.936 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T22:54:32.936 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-13T22:54:32.936 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:54:32.936 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T22:54:32.936 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-13T22:54:32.936 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:54:32.936 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T22:54:32.937 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-13T22:54:32.937 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:54:32.937 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T22:54:32.937 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-13T22:54:32.937 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:54:32.937 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T22:54:32.937 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 14 2024-09-13T22:54:32.937 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T22:54:32.938 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:54:32.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.937+0000 7fc86faae700 1 -- 172.21.15.2:0/3011956944 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc85406c4e0 msgr2=0x7fc85406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:32.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.937+0000 7fc86faae700 1 --2- 172.21.15.2:0/3011956944 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc85406c4e0 0x7fc85406e9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc858009e40 tx=0x7fc858009260 comp rx=0 tx=0).stop 2024-09-13T22:54:32.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.937+0000 7fc86faae700 1 -- 172.21.15.2:0/3011956944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8680ffc10 msgr2=0x7fc8681953e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:32.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.937+0000 7fc86faae700 1 --2- 172.21.15.2:0/3011956944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8680ffc10 0x7fc8681953e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc864005b40 tx=0x7fc86400fa00 comp rx=0 tx=0).stop 2024-09-13T22:54:32.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.937+0000 7fc86faae700 1 -- 172.21.15.2:0/3011956944 shutdown_connections 2024-09-13T22:54:32.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.937+0000 7fc86faae700 1 --2- 172.21.15.2:0/3011956944 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fc85406c4e0 0x7fc85406e9a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:32.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.937+0000 7fc86faae700 1 --2- 172.21.15.2:0/3011956944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8680ffc10 0x7fc8681953e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:32.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.937+0000 7fc86faae700 1 --2- 172.21.15.2:0/3011956944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc868100e10 0x7fc868195920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:32.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.937+0000 7fc86faae700 1 -- 172.21.15.2:0/3011956944 >> 172.21.15.2:0/3011956944 conn(0x7fc8680fb190 msgr2=0x7fc868104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:54:32.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.937+0000 7fc86faae700 1 -- 172.21.15.2:0/3011956944 shutdown_connections 2024-09-13T22:54:32.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:32.937+0000 7fc86faae700 1 -- 172.21.15.2:0/3011956944 wait complete. 2024-09-13T22:54:33.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.111+0000 7fd941528700 1 -- 172.21.15.2:0/3121758166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd93c101740 msgr2=0x7fd93c103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:33.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.111+0000 7fd941528700 1 --2- 172.21.15.2:0/3121758166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd93c101740 0x7fd93c103b30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd92c009910 tx=0x7fd92c009c20 comp rx=0 tx=0).stop 2024-09-13T22:54:33.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.111+0000 7fd941528700 1 -- 172.21.15.2:0/3121758166 shutdown_connections 2024-09-13T22:54:33.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.111+0000 7fd941528700 1 --2- 172.21.15.2:0/3121758166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd93c104070 0x7fd93c106460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:33.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.111+0000 7fd941528700 1 --2- 172.21.15.2:0/3121758166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd93c101740 0x7fd93c103b30 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:33.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.111+0000 7fd941528700 1 -- 172.21.15.2:0/3121758166 >> 172.21.15.2:0/3121758166 conn(0x7fd93c0fb150 msgr2=0x7fd93c0fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:54:33.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.111+0000 7fd941528700 1 -- 172.21.15.2:0/3121758166 shutdown_connections 2024-09-13T22:54:33.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.111+0000 7fd941528700 1 -- 172.21.15.2:0/3121758166 wait complete. 2024-09-13T22:54:33.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.112+0000 7fd941528700 1 Processor -- start 2024-09-13T22:54:33.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.112+0000 7fd941528700 1 -- start start 2024-09-13T22:54:33.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.113+0000 7fd941528700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd93c101740 0x7fd93c1964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:54:33.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.113+0000 7fd941528700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd93c104070 0x7fd93c1969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:54:33.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.113+0000 7fd941528700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c197010 con 0x7fd93c104070 2024-09-13T22:54:33.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.113+0000 7fd941528700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c197150 con 0x7fd93c101740 2024-09-13T22:54:33.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.113+0000 7fd93a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd93c104070 0x7fd93c1969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:54:33.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.113+0000 7fd93a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd93c104070 0x7fd93c1969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33982/0 (socket says 172.21.15.2:33982) 2024-09-13T22:54:33.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.113+0000 7fd93a7fc700 1 -- 172.21.15.2:0/1095127860 learned_addr learned my addr 172.21.15.2:0/1095127860 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:54:33.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.113+0000 7fd93affd700 1 --2- 172.21.15.2:0/1095127860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd93c101740 0x7fd93c1964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:54:33.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.113+0000 7fd93a7fc700 1 -- 172.21.15.2:0/1095127860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd93c101740 msgr2=0x7fd93c1964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:33.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.113+0000 7fd93a7fc700 1 --2- 172.21.15.2:0/1095127860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd93c101740 0x7fd93c1964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:33.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.113+0000 7fd93a7fc700 1 -- 172.21.15.2:0/1095127860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd92c0095f0 con 0x7fd93c104070 2024-09-13T22:54:33.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.113+0000 7fd93affd700 1 --2- 172.21.15.2:0/1095127860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd93c101740 0x7fd93c1964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:54:33.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.113+0000 7fd93a7fc700 1 --2- 172.21.15.2:0/1095127860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd93c104070 0x7fd93c1969f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd93000e940 tx=0x7fd93000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:54:33.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.114+0000 7fd923fff700 1 -- 172.21.15.2:0/1095127860 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9300097b0 con 0x7fd93c104070 2024-09-13T22:54:33.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.114+0000 7fd923fff700 1 -- 172.21.15.2:0/1095127860 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd930004ce0 con 0x7fd93c104070 2024-09-13T22:54:33.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.114+0000 7fd923fff700 1 -- 172.21.15.2:0/1095127860 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd930005700 con 0x7fd93c104070 2024-09-13T22:54:33.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.114+0000 7fd941528700 1 -- 172.21.15.2:0/1095127860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd93c0ff590 con 0x7fd93c104070 2024-09-13T22:54:33.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.114+0000 7fd941528700 1 -- 172.21.15.2:0/1095127860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93c0ffae0 con 0x7fd93c104070 2024-09-13T22:54:33.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.115+0000 7fd941528700 1 -- 172.21.15.2:0/1095127860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd93c190640 con 0x7fd93c104070 2024-09-13T22:54:33.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.116+0000 7fd923fff700 1 -- 172.21.15.2:0/1095127860 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fd9300104c0 con 0x7fd93c104070 2024-09-13T22:54:33.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.117+0000 7fd923fff700 1 --2- 172.21.15.2:0/1095127860 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd9240708f0 0x7fd924072db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:54:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.117+0000 7fd923fff700 1 -- 172.21.15.2:0/1095127860 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd930014070 con 0x7fd93c104070 2024-09-13T22:54:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.118+0000 7fd93affd700 1 --2- 172.21.15.2:0/1095127860 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd9240708f0 0x7fd924072db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:54:33.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.118+0000 7fd93affd700 1 --2- 172.21.15.2:0/1095127860 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd9240708f0 0x7fd924072db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd92c000c00 tx=0x7fd92c009f70 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:54:33.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.126+0000 7fd923fff700 1 -- 172.21.15.2:0/1095127860 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd930059e90 con 0x7fd93c104070 2024-09-13T22:54:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:32 smithi002 ceph-mon[27637]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:32 smithi002 ceph-mon[27637]: Upgrade: Target is version 19.1.1-324-gecab7be5 (unknown) 2024-09-13T22:54:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:32 smithi002 ceph-mon[27637]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, digests ['quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808'] 2024-09-13T22:54:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:32 smithi002 ceph-mon[27637]: Upgrade: Need to upgrade myself (mgr.smithi002.yumtzz) 2024-09-13T22:54:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:32 smithi002 ceph-mon[27637]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:32 smithi002 ceph-mon[27637]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 on smithi047 2024-09-13T22:54:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:32 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:54:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:32 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/3011956944' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:54:33.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:32 smithi047 ceph-mon[34560]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:33.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:32 smithi047 ceph-mon[34560]: Upgrade: Target is version 19.1.1-324-gecab7be5 (unknown) 2024-09-13T22:54:33.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:32 smithi047 ceph-mon[34560]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, digests ['quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808'] 2024-09-13T22:54:33.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:32 smithi047 ceph-mon[34560]: Upgrade: Need to upgrade myself (mgr.smithi002.yumtzz) 2024-09-13T22:54:33.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:32 smithi047 ceph-mon[34560]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:33.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:32 smithi047 ceph-mon[34560]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 on smithi047 2024-09-13T22:54:33.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:32 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:54:33.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:32 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/3011956944' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:54:33.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.558+0000 7fd941528700 1 -- 172.21.15.2:0/1095127860 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd93c100f50 con 0x7fd9240708f0 2024-09-13T22:54:33.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.560+0000 7fd923fff700 1 -- 172.21.15.2:0/1095127860 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fd93c100f50 con 0x7fd9240708f0 2024-09-13T22:54:33.561 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:54:33.561 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:54:33.561 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T22:54:33.561 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T22:54:33.561 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [], 2024-09-13T22:54:33.561 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "0/2 daemons upgraded", 2024-09-13T22:54:33.561 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 image on host smithi047", 2024-09-13T22:54:33.561 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T22:54:33.561 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:54:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.563+0000 7fd941528700 1 -- 172.21.15.2:0/1095127860 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd9240708f0 msgr2=0x7fd924072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.563+0000 7fd941528700 1 --2- 172.21.15.2:0/1095127860 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd9240708f0 0x7fd924072db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd92c000c00 tx=0x7fd92c009f70 comp rx=0 tx=0).stop 2024-09-13T22:54:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.563+0000 7fd941528700 1 -- 172.21.15.2:0/1095127860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd93c104070 msgr2=0x7fd93c1969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:54:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.563+0000 7fd941528700 1 --2- 172.21.15.2:0/1095127860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd93c104070 0x7fd93c1969f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd93000e940 tx=0x7fd93000ed00 comp rx=0 tx=0).stop 2024-09-13T22:54:33.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.563+0000 7fd941528700 1 -- 172.21.15.2:0/1095127860 shutdown_connections 2024-09-13T22:54:33.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.563+0000 7fd941528700 1 --2- 172.21.15.2:0/1095127860 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd9240708f0 0x7fd924072db0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:33.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.563+0000 7fd941528700 1 --2- 172.21.15.2:0/1095127860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd93c101740 0x7fd93c1964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:33.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.563+0000 7fd941528700 1 --2- 172.21.15.2:0/1095127860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd93c104070 0x7fd93c1969f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:54:33.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.563+0000 7fd941528700 1 -- 172.21.15.2:0/1095127860 >> 172.21.15.2:0/1095127860 conn(0x7fd93c0fb150 msgr2=0x7fd93c0fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:54:33.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.563+0000 7fd941528700 1 -- 172.21.15.2:0/1095127860 shutdown_connections 2024-09-13T22:54:33.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:54:33.563+0000 7fd941528700 1 -- 172.21.15.2:0/1095127860 wait complete. 2024-09-13T22:54:33.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:33 smithi002 ceph-mon[27637]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:34.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:33 smithi047 ceph-mon[34560]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:35.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:34 smithi002 ceph-mon[27637]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:54:35.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:34 smithi002 ceph-mon[27637]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:35.301 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:34 smithi047 ceph-mon[34560]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:54:35.301 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:34 smithi047 ceph-mon[34560]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:54:37.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:36 smithi002 ceph-mon[27637]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:37.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:36 smithi047 ceph-mon[34560]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:38 smithi002 ceph-mon[27637]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:54:39.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:38 smithi047 ceph-mon[34560]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:54:41.246 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:40 smithi002 ceph-mon[27637]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:41.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:40 smithi047 ceph-mon[34560]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:43.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:42 smithi002 ceph-mon[27637]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:43.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:42 smithi047 ceph-mon[34560]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:45.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:44 smithi002 ceph-mon[27637]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:54:45.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:44 smithi047 ceph-mon[34560]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:54:47.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:46 smithi002 ceph-mon[27637]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:47.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:46 smithi047 ceph-mon[34560]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:48.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:47 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:54:48.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:47 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:54:49.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:48 smithi002 ceph-mon[27637]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:54:49.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:48 smithi047 ceph-mon[34560]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:54:50.206 INFO:tasks.workunit.client.0.smithi002.stderr:Updating files: 94% (12208/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-13T22:54:50.814 INFO:tasks.workunit.client.0.smithi002.stderr:Note: switching to 'ecab7be58963a5bd03910cd73eef66405d7fdd50'. 2024-09-13T22:54:50.814 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-13T22:54:50.814 INFO:tasks.workunit.client.0.smithi002.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T22:54:50.814 INFO:tasks.workunit.client.0.smithi002.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T22:54:50.814 INFO:tasks.workunit.client.0.smithi002.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T22:54:50.814 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-13T22:54:50.814 INFO:tasks.workunit.client.0.smithi002.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T22:54:50.814 INFO:tasks.workunit.client.0.smithi002.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T22:54:50.815 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-13T22:54:50.815 INFO:tasks.workunit.client.0.smithi002.stderr: git switch -c 2024-09-13T22:54:50.815 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-13T22:54:50.815 INFO:tasks.workunit.client.0.smithi002.stderr:Or undo this operation with: 2024-09-13T22:54:50.815 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-13T22:54:50.815 INFO:tasks.workunit.client.0.smithi002.stderr: git switch - 2024-09-13T22:54:50.815 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-13T22:54:50.815 INFO:tasks.workunit.client.0.smithi002.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T22:54:50.815 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-13T22:54:50.815 INFO:tasks.workunit.client.0.smithi002.stderr:HEAD is now at ecab7be5896 Merge pull request #59767 from zdover23/wip-doc-2024-09-13-backport-59438-to-squid 2024-09-13T22:54:50.820 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T22:54:51.024 INFO:tasks.workunit.client.0.smithi002.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T22:54:51.026 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T22:54:51.027 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T22:54:51.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:50 smithi002 ceph-mon[27637]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:51.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:50 smithi047 ceph-mon[34560]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:51.521 INFO:tasks.workunit.client.1.smithi047.stderr:Updating files: 83% (10716/12889) Updating files: 84% (10827/12889) Updating files: 85% (10956/12889) Updating files: 86% (11085/12889) Updating files: 87% (11214/12889) Updating files: 88% (11343/12889) Updating files: 89% (11472/12889) Updating files: 90% (11601/12889) Updating files: 91% (11729/12889) Updating files: 92% (11858/12889) Updating files: 93% (11987/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-13T22:54:52.386 INFO:tasks.workunit.client.1.smithi047.stderr:Note: switching to 'ecab7be58963a5bd03910cd73eef66405d7fdd50'. 2024-09-13T22:54:52.387 INFO:tasks.workunit.client.1.smithi047.stderr: 2024-09-13T22:54:52.387 INFO:tasks.workunit.client.1.smithi047.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T22:54:52.387 INFO:tasks.workunit.client.1.smithi047.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T22:54:52.387 INFO:tasks.workunit.client.1.smithi047.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T22:54:52.387 INFO:tasks.workunit.client.1.smithi047.stderr: 2024-09-13T22:54:52.387 INFO:tasks.workunit.client.1.smithi047.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T22:54:52.387 INFO:tasks.workunit.client.1.smithi047.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T22:54:52.387 INFO:tasks.workunit.client.1.smithi047.stderr: 2024-09-13T22:54:52.387 INFO:tasks.workunit.client.1.smithi047.stderr: git switch -c 2024-09-13T22:54:52.387 INFO:tasks.workunit.client.1.smithi047.stderr: 2024-09-13T22:54:52.387 INFO:tasks.workunit.client.1.smithi047.stderr:Or undo this operation with: 2024-09-13T22:54:52.387 INFO:tasks.workunit.client.1.smithi047.stderr: 2024-09-13T22:54:52.388 INFO:tasks.workunit.client.1.smithi047.stderr: git switch - 2024-09-13T22:54:52.388 INFO:tasks.workunit.client.1.smithi047.stderr: 2024-09-13T22:54:52.388 INFO:tasks.workunit.client.1.smithi047.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T22:54:52.388 INFO:tasks.workunit.client.1.smithi047.stderr: 2024-09-13T22:54:52.388 INFO:tasks.workunit.client.1.smithi047.stderr:HEAD is now at ecab7be5896 Merge pull request #59767 from zdover23/wip-doc-2024-09-13-backport-59438-to-squid 2024-09-13T22:54:52.393 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-13T22:54:52.460 INFO:tasks.workunit.client.1.smithi047.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T22:54:52.463 INFO:tasks.workunit.client.1.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T22:54:52.463 INFO:tasks.workunit.client.1.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T22:54:53.196 INFO:tasks.workunit.client.1.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T22:54:53.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:52 smithi002 ceph-mon[27637]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:53.290 INFO:tasks.workunit.client.1.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T22:54:53.338 INFO:tasks.workunit.client.1.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T22:54:53.341 INFO:tasks.workunit.client.1.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T22:54:53.341 INFO:tasks.workunit.client.1.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T22:54:53.391 INFO:tasks.workunit.client.1.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T22:54:53.395 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-13T22:54:53.395 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-13T22:54:53.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:52 smithi047 ceph-mon[34560]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:54:53.430 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-13T22:54:53.432 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T22:54:53.432 DEBUG:teuthology.orchestra.run.smithi047:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ecab7be58963a5bd03910cd73eef66405d7fdd50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-13T22:54:53.502 INFO:tasks.workunit.client.1.smithi047.stderr:+ mkdir -p fsstress 2024-09-13T22:54:53.505 INFO:tasks.workunit.client.1.smithi047.stderr:+ pushd fsstress 2024-09-13T22:54:53.506 INFO:tasks.workunit.client.1.smithi047.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T22:54:53.506 INFO:tasks.workunit.client.1.smithi047.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T22:54:54.140 INFO:tasks.workunit.client.1.smithi047.stderr:+ tar xzf ltp-full.tgz 2024-09-13T22:54:55.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:54 smithi002 ceph-mon[27637]: pgmap v233: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:54:55.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:54 smithi047 ceph-mon[34560]: pgmap v233: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:54:57.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:56 smithi002 ceph-mon[27637]: pgmap v234: 65 pgs: 65 active+clean; 6.9 MiB data, 173 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 543 KiB/s wr, 4 op/s 2024-09-13T22:54:57.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:56 smithi047 ceph-mon[34560]: pgmap v234: 65 pgs: 65 active+clean; 6.9 MiB data, 173 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 543 KiB/s wr, 4 op/s 2024-09-13T22:54:57.929 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T22:54:58.357 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T22:54:58.454 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T22:54:58.456 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T22:54:58.456 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T22:54:58.638 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T22:54:58.643 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-13T22:54:58.643 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T22:54:58.662 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-13T22:54:58.663 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T22:54:58.663 DEBUG:teuthology.orchestra.run.smithi002:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ecab7be58963a5bd03910cd73eef66405d7fdd50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-13T22:54:58.731 INFO:tasks.workunit.client.0.smithi002.stderr:+ mkdir -p fsstress 2024-09-13T22:54:58.734 INFO:tasks.workunit.client.0.smithi002.stderr:+ pushd fsstress 2024-09-13T22:54:58.736 INFO:tasks.workunit.client.0.smithi002.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T22:54:58.736 INFO:tasks.workunit.client.0.smithi002.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T22:54:59.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:54:58 smithi047 ceph-mon[34560]: pgmap v235: 65 pgs: 65 active+clean; 8.9 MiB data, 188 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s rd, 713 KiB/s wr, 15 op/s 2024-09-13T22:54:59.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:54:58 smithi002 ceph-mon[27637]: pgmap v235: 65 pgs: 65 active+clean; 8.9 MiB data, 188 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s rd, 713 KiB/s wr, 15 op/s 2024-09-13T22:54:59.885 INFO:tasks.workunit.client.0.smithi002.stderr:+ tar xzf ltp-full.tgz 2024-09-13T22:55:00.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:00 smithi047 ceph-mon[34560]: pgmap v236: 65 pgs: 65 active+clean; 14 MiB data, 202 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s rd, 1.1 MiB/s wr, 29 op/s 2024-09-13T22:55:00.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:00 smithi047 ceph-mon[34560]: Upgrade: Updating mgr.smithi047.gcymvd 2024-09-13T22:55:00.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:00 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:00.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:00 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.gcymvd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:55:00.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:00 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:55:00.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:00 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:55:00.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:00 smithi047 ceph-mon[34560]: Deploying daemon mgr.smithi047.gcymvd on smithi047 2024-09-13T22:55:01.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:00 smithi002 ceph-mon[27637]: pgmap v236: 65 pgs: 65 active+clean; 14 MiB data, 202 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s rd, 1.1 MiB/s wr, 29 op/s 2024-09-13T22:55:01.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:00 smithi002 ceph-mon[27637]: Upgrade: Updating mgr.smithi047.gcymvd 2024-09-13T22:55:01.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:00 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:01.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:00 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.gcymvd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:55:01.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:00 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:55:01.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:00 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:55:01.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:00 smithi002 ceph-mon[27637]: Deploying daemon mgr.smithi047.gcymvd on smithi047 2024-09-13T22:55:03.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:02 smithi047 ceph-mon[34560]: pgmap v237: 65 pgs: 65 active+clean; 14 MiB data, 204 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s rd, 1.1 MiB/s wr, 38 op/s 2024-09-13T22:55:03.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:02 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:55:03.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:02 smithi002 ceph-mon[27637]: pgmap v237: 65 pgs: 65 active+clean; 14 MiB data, 204 MiB used, 536 GiB / 536 GiB avail; 83 KiB/s rd, 1.1 MiB/s wr, 38 op/s 2024-09-13T22:55:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:02 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:55:03.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.681+0000 7f819351f700 1 -- 172.21.15.2:0/3912800055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c100e10 msgr2=0x7f818c101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.681+0000 7f819351f700 1 --2- 172.21.15.2:0/3912800055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c100e10 0x7f818c101270 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f817c009910 tx=0x7f817c009c20 comp rx=0 tx=0).stop 2024-09-13T22:55:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.681+0000 7f819351f700 1 -- 172.21.15.2:0/3912800055 shutdown_connections 2024-09-13T22:55:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.681+0000 7f819351f700 1 --2- 172.21.15.2:0/3912800055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c100e10 0x7f818c101270 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.681+0000 7f819351f700 1 --2- 172.21.15.2:0/3912800055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f818c0ffc10 0x7f818c100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.681+0000 7f819351f700 1 -- 172.21.15.2:0/3912800055 >> 172.21.15.2:0/3912800055 conn(0x7f818c0fb190 msgr2=0x7f818c0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.681+0000 7f819351f700 1 -- 172.21.15.2:0/3912800055 shutdown_connections 2024-09-13T22:55:03.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.681+0000 7f819351f700 1 -- 172.21.15.2:0/3912800055 wait complete. 2024-09-13T22:55:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.682+0000 7f819351f700 1 Processor -- start 2024-09-13T22:55:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.682+0000 7f819351f700 1 -- start start 2024-09-13T22:55:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.682+0000 7f819351f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f818c0ffc10 0x7f818c069140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.682+0000 7f819351f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c100e10 0x7f818c19b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.683+0000 7f819351f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c19b7c0 con 0x7f818c100e10 2024-09-13T22:55:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.683+0000 7f819351f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c19b900 con 0x7f818c0ffc10 2024-09-13T22:55:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.683+0000 7f8190aba700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c100e10 0x7f818c19b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.683+0000 7f8190aba700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c100e10 0x7f818c19b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34820/0 (socket says 172.21.15.2:34820) 2024-09-13T22:55:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.683+0000 7f8190aba700 1 -- 172.21.15.2:0/4195713783 learned_addr learned my addr 172.21.15.2:0/4195713783 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:55:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.683+0000 7f81912bb700 1 --2- 172.21.15.2:0/4195713783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f818c0ffc10 0x7f818c069140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.683+0000 7f8190aba700 1 -- 172.21.15.2:0/4195713783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f818c0ffc10 msgr2=0x7f818c069140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:03.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.683+0000 7f8190aba700 1 --2- 172.21.15.2:0/4195713783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f818c0ffc10 0x7f818c069140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.683+0000 7f8190aba700 1 -- 172.21.15.2:0/4195713783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c0095f0 con 0x7f818c100e10 2024-09-13T22:55:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.683+0000 7f8190aba700 1 --2- 172.21.15.2:0/4195713783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c100e10 0x7f818c19b1a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f817c006010 tx=0x7f817c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.683+0000 7f81827fc700 1 -- 172.21.15.2:0/4195713783 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f817c01d070 con 0x7f818c100e10 2024-09-13T22:55:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.683+0000 7f81827fc700 1 -- 172.21.15.2:0/4195713783 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f817c00f460 con 0x7f818c100e10 2024-09-13T22:55:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.683+0000 7f819351f700 1 -- 172.21.15.2:0/4195713783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818c19bb80 con 0x7f818c100e10 2024-09-13T22:55:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.684+0000 7f81827fc700 1 -- 172.21.15.2:0/4195713783 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f817c021640 con 0x7f818c100e10 2024-09-13T22:55:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.684+0000 7f819351f700 1 -- 172.21.15.2:0/4195713783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818c19c070 con 0x7f818c100e10 2024-09-13T22:55:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.685+0000 7f819351f700 1 -- 172.21.15.2:0/4195713783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818c108700 con 0x7f818c100e10 2024-09-13T22:55:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.685+0000 7f81827fc700 1 -- 172.21.15.2:0/4195713783 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f817c00fab0 con 0x7f818c100e10 2024-09-13T22:55:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.686+0000 7f81827fc700 1 --2- 172.21.15.2:0/4195713783 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f817806c4e0 0x7f817806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.686+0000 7f81827fc700 1 -- 172.21.15.2:0/4195713783 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f817c08c950 con 0x7f818c100e10 2024-09-13T22:55:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.686+0000 7f81912bb700 1 --2- 172.21.15.2:0/4195713783 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f817806c4e0 0x7f817806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:03.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.686+0000 7f81912bb700 1 --2- 172.21.15.2:0/4195713783 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f817806c4e0 0x7f817806e9a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f818c100c70 tx=0x7f818800b410 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:03.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.691+0000 7f81827fc700 1 -- 172.21.15.2:0/4195713783 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f817c05ac90 con 0x7f818c100e10 2024-09-13T22:55:03.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.906+0000 7f819351f700 1 -- 172.21.15.2:0/4195713783 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f818c105760 con 0x7f817806c4e0 2024-09-13T22:55:03.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.907+0000 7f81827fc700 1 -- 172.21.15.2:0/4195713783 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f818c105760 con 0x7f817806c4e0 2024-09-13T22:55:03.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.909+0000 7f819351f700 1 -- 172.21.15.2:0/4195713783 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f817806c4e0 msgr2=0x7f817806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:03.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.909+0000 7f819351f700 1 --2- 172.21.15.2:0/4195713783 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f817806c4e0 0x7f817806e9a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f818c100c70 tx=0x7f818800b410 comp rx=0 tx=0).stop 2024-09-13T22:55:03.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.909+0000 7f819351f700 1 -- 172.21.15.2:0/4195713783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c100e10 msgr2=0x7f818c19b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.909+0000 7f819351f700 1 --2- 172.21.15.2:0/4195713783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c100e10 0x7f818c19b1a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f817c006010 tx=0x7f817c00bd70 comp rx=0 tx=0).stop 2024-09-13T22:55:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.909+0000 7f819351f700 1 -- 172.21.15.2:0/4195713783 shutdown_connections 2024-09-13T22:55:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.909+0000 7f819351f700 1 --2- 172.21.15.2:0/4195713783 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f817806c4e0 0x7f817806e9a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.909+0000 7f819351f700 1 --2- 172.21.15.2:0/4195713783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f818c0ffc10 0x7f818c069140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.909+0000 7f819351f700 1 --2- 172.21.15.2:0/4195713783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c100e10 0x7f818c19b1a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.909+0000 7f819351f700 1 -- 172.21.15.2:0/4195713783 >> 172.21.15.2:0/4195713783 conn(0x7f818c0fb190 msgr2=0x7f818c104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.909+0000 7f819351f700 1 -- 172.21.15.2:0/4195713783 shutdown_connections 2024-09-13T22:55:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:03.909+0000 7f819351f700 1 -- 172.21.15.2:0/4195713783 wait complete. 2024-09-13T22:55:03.920 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T22:55:04.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.021+0000 7fd085f9e700 1 -- 172.21.15.2:0/1935421824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd080100be0 msgr2=0x7fd080101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.021+0000 7fd085f9e700 1 --2- 172.21.15.2:0/1935421824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd080100be0 0x7fd080101040 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd068009910 tx=0x7fd068009c20 comp rx=0 tx=0).stop 2024-09-13T22:55:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.021+0000 7fd085f9e700 1 -- 172.21.15.2:0/1935421824 shutdown_connections 2024-09-13T22:55:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.021+0000 7fd085f9e700 1 --2- 172.21.15.2:0/1935421824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd080100be0 0x7fd080101040 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.021+0000 7fd085f9e700 1 --2- 172.21.15.2:0/1935421824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0800ff9e0 0x7fd0800ffe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.021+0000 7fd085f9e700 1 -- 172.21.15.2:0/1935421824 >> 172.21.15.2:0/1935421824 conn(0x7fd0800faf80 msgr2=0x7fd0800fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.021+0000 7fd085f9e700 1 -- 172.21.15.2:0/1935421824 shutdown_connections 2024-09-13T22:55:04.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.021+0000 7fd085f9e700 1 -- 172.21.15.2:0/1935421824 wait complete. 2024-09-13T22:55:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.022+0000 7fd085f9e700 1 Processor -- start 2024-09-13T22:55:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.022+0000 7fd085f9e700 1 -- start start 2024-09-13T22:55:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.022+0000 7fd085f9e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0800ff9e0 0x7fd080196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.022+0000 7fd085f9e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd080100be0 0x7fd080196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.022+0000 7fd085f9e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd080196d90 con 0x7fd080100be0 2024-09-13T22:55:04.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.022+0000 7fd085f9e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd080196ed0 con 0x7fd0800ff9e0 2024-09-13T22:55:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.023+0000 7fd07ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd080100be0 0x7fd080196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.023+0000 7fd07ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd080100be0 0x7fd080196770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34838/0 (socket says 172.21.15.2:34838) 2024-09-13T22:55:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.023+0000 7fd07ffff700 1 -- 172.21.15.2:0/801412906 learned_addr learned my addr 172.21.15.2:0/801412906 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:55:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.023+0000 7fd084f9c700 1 --2- 172.21.15.2:0/801412906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0800ff9e0 0x7fd080196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.023+0000 7fd07ffff700 1 -- 172.21.15.2:0/801412906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0800ff9e0 msgr2=0x7fd080196230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.023+0000 7fd07ffff700 1 --2- 172.21.15.2:0/801412906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0800ff9e0 0x7fd080196230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.023+0000 7fd07ffff700 1 -- 172.21.15.2:0/801412906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0680095f0 con 0x7fd080100be0 2024-09-13T22:55:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.023+0000 7fd07ffff700 1 --2- 172.21.15.2:0/801412906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd080100be0 0x7fd080196770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd068000c00 tx=0x7fd06800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.023+0000 7fd07dffb700 1 -- 172.21.15.2:0/801412906 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd06801d070 con 0x7fd080100be0 2024-09-13T22:55:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.023+0000 7fd07dffb700 1 -- 172.21.15.2:0/801412906 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd068005dc0 con 0x7fd080100be0 2024-09-13T22:55:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.023+0000 7fd085f9e700 1 -- 172.21.15.2:0/801412906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08019b920 con 0x7fd080100be0 2024-09-13T22:55:04.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.023+0000 7fd07dffb700 1 -- 172.21.15.2:0/801412906 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0680226a0 con 0x7fd080100be0 2024-09-13T22:55:04.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.024+0000 7fd085f9e700 1 -- 172.21.15.2:0/801412906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08019be10 con 0x7fd080100be0 2024-09-13T22:55:04.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.025+0000 7fd085f9e700 1 -- 172.21.15.2:0/801412906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd080108540 con 0x7fd080100be0 2024-09-13T22:55:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.025+0000 7fd07dffb700 1 -- 172.21.15.2:0/801412906 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fd0680038f0 con 0x7fd080100be0 2024-09-13T22:55:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.026+0000 7fd07dffb700 1 --2- 172.21.15.2:0/801412906 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd06c06c4e0 0x7fd06c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.026+0000 7fd07dffb700 1 -- 172.21.15.2:0/801412906 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd06808cd10 con 0x7fd080100be0 2024-09-13T22:55:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.026+0000 7fd084f9c700 1 --2- 172.21.15.2:0/801412906 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd06c06c4e0 0x7fd06c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:04.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.026+0000 7fd084f9c700 1 --2- 172.21.15.2:0/801412906 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd06c06c4e0 0x7fd06c06e9a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd080100a40 tx=0x7fd070009260 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:04.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.030+0000 7fd07dffb700 1 -- 172.21.15.2:0/801412906 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd06805afd0 con 0x7fd080100be0 2024-09-13T22:55:04.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.268+0000 7fd085f9e700 1 -- 172.21.15.2:0/801412906 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd080069520 con 0x7fd06c06c4e0 2024-09-13T22:55:04.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.269+0000 7fd07dffb700 1 -- 172.21.15.2:0/801412906 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fd080069520 con 0x7fd06c06c4e0 2024-09-13T22:55:04.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.271+0000 7fd085f9e700 1 -- 172.21.15.2:0/801412906 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd06c06c4e0 msgr2=0x7fd06c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:04.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.271+0000 7fd085f9e700 1 --2- 172.21.15.2:0/801412906 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd06c06c4e0 0x7fd06c06e9a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd080100a40 tx=0x7fd070009260 comp rx=0 tx=0).stop 2024-09-13T22:55:04.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.271+0000 7fd085f9e700 1 -- 172.21.15.2:0/801412906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd080100be0 msgr2=0x7fd080196770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:04.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.271+0000 7fd085f9e700 1 --2- 172.21.15.2:0/801412906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd080100be0 0x7fd080196770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd068000c00 tx=0x7fd06800f690 comp rx=0 tx=0).stop 2024-09-13T22:55:04.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.271+0000 7fd085f9e700 1 -- 172.21.15.2:0/801412906 shutdown_connections 2024-09-13T22:55:04.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.271+0000 7fd085f9e700 1 --2- 172.21.15.2:0/801412906 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fd06c06c4e0 0x7fd06c06e9a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:04.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.271+0000 7fd085f9e700 1 --2- 172.21.15.2:0/801412906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0800ff9e0 0x7fd080196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:04.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.271+0000 7fd085f9e700 1 --2- 172.21.15.2:0/801412906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd080100be0 0x7fd080196770 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:04.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.271+0000 7fd085f9e700 1 -- 172.21.15.2:0/801412906 >> 172.21.15.2:0/801412906 conn(0x7fd0800faf80 msgr2=0x7fd080068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:04.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.271+0000 7fd085f9e700 1 -- 172.21.15.2:0/801412906 shutdown_connections 2024-09-13T22:55:04.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.271+0000 7fd085f9e700 1 -- 172.21.15.2:0/801412906 wait complete. 2024-09-13T22:55:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.383+0000 7f7cccaa3700 1 -- 172.21.15.2:0/1947134946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cc8100cb0 msgr2=0x7f7cc81010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.383+0000 7f7cccaa3700 1 --2- 172.21.15.2:0/1947134946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cc8100cb0 0x7f7cc81010d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8009910 tx=0x7f7cb8009c20 comp rx=0 tx=0).stop 2024-09-13T22:55:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.383+0000 7f7cccaa3700 1 -- 172.21.15.2:0/1947134946 shutdown_connections 2024-09-13T22:55:04.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.383+0000 7f7cccaa3700 1 --2- 172.21.15.2:0/1947134946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7cc8101eb0 0x7f7cc8102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.383+0000 7f7cccaa3700 1 --2- 172.21.15.2:0/1947134946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cc8100cb0 0x7f7cc81010d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.383+0000 7f7cccaa3700 1 -- 172.21.15.2:0/1947134946 >> 172.21.15.2:0/1947134946 conn(0x7f7cc80fc230 msgr2=0x7f7cc80fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.383+0000 7f7cccaa3700 1 -- 172.21.15.2:0/1947134946 shutdown_connections 2024-09-13T22:55:04.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.383+0000 7f7cccaa3700 1 -- 172.21.15.2:0/1947134946 wait complete. 2024-09-13T22:55:04.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.384+0000 7f7cccaa3700 1 Processor -- start 2024-09-13T22:55:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.384+0000 7f7cccaa3700 1 -- start start 2024-09-13T22:55:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.384+0000 7f7cccaa3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7cc8100cb0 0x7f7cc8074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.384+0000 7f7cccaa3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cc8101eb0 0x7f7cc8073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.384+0000 7f7cccaa3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc80736c0 con 0x7f7cc8101eb0 2024-09-13T22:55:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.384+0000 7f7cccaa3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc8073800 con 0x7f7cc8100cb0 2024-09-13T22:55:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.384+0000 7f7cc5d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cc8101eb0 0x7f7cc8073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.384+0000 7f7cc659c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7cc8100cb0 0x7f7cc8074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.384+0000 7f7cc5d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cc8101eb0 0x7f7cc8073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34848/0 (socket says 172.21.15.2:34848) 2024-09-13T22:55:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.384+0000 7f7cc5d9b700 1 -- 172.21.15.2:0/4166765468 learned_addr learned my addr 172.21.15.2:0/4166765468 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:55:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.384+0000 7f7cc5d9b700 1 -- 172.21.15.2:0/4166765468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7cc8100cb0 msgr2=0x7f7cc8074b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.384+0000 7f7cc5d9b700 1 --2- 172.21.15.2:0/4166765468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7cc8100cb0 0x7f7cc8074b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:04.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.384+0000 7f7cc5d9b700 1 -- 172.21.15.2:0/4166765468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb80095f0 con 0x7f7cc8101eb0 2024-09-13T22:55:04.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.385+0000 7f7cc5d9b700 1 --2- 172.21.15.2:0/4166765468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cc8101eb0 0x7f7cc8073180 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc00d8d0 tx=0x7f7cbc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:04.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.385+0000 7f7cb77fe700 1 -- 172.21.15.2:0/4166765468 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cbc0098a0 con 0x7f7cc8101eb0 2024-09-13T22:55:04.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.385+0000 7f7cb77fe700 1 -- 172.21.15.2:0/4166765468 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7cbc010460 con 0x7f7cc8101eb0 2024-09-13T22:55:04.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.385+0000 7f7cccaa3700 1 -- 172.21.15.2:0/4166765468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc8073ae0 con 0x7f7cc8101eb0 2024-09-13T22:55:04.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.385+0000 7f7cb77fe700 1 -- 172.21.15.2:0/4166765468 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cbc00f5f0 con 0x7f7cc8101eb0 2024-09-13T22:55:04.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.385+0000 7f7cccaa3700 1 -- 172.21.15.2:0/4166765468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc819e520 con 0x7f7cc8101eb0 2024-09-13T22:55:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.386+0000 7f7cccaa3700 1 -- 172.21.15.2:0/4166765468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc8109810 con 0x7f7cc8101eb0 2024-09-13T22:55:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.386+0000 7f7cb77fe700 1 -- 172.21.15.2:0/4166765468 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7f7cbc009a00 con 0x7f7cc8101eb0 2024-09-13T22:55:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.387+0000 7f7cb77fe700 1 --2- 172.21.15.2:0/4166765468 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f7cb006c4e0 0x7f7cb006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.387+0000 7f7cc659c700 1 --2- 172.21.15.2:0/4166765468 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f7cb006c4e0 0x7f7cb006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.387+0000 7f7cb77fe700 1 -- 172.21.15.2:0/4166765468 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f7cbc08b6b0 con 0x7f7cc8101eb0 2024-09-13T22:55:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.388+0000 7f7cc659c700 1 --2- 172.21.15.2:0/4166765468 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f7cb006c4e0 0x7f7cb006e9a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8006010 tx=0x7f7cb800b540 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.392+0000 7f7cb77fe700 1 -- 172.21.15.2:0/4166765468 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7cbc059970 con 0x7f7cc8101eb0 2024-09-13T22:55:04.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.627+0000 7f7cccaa3700 1 -- 172.21.15.2:0/4166765468 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cc8106800 con 0x7f7cb006c4e0 2024-09-13T22:55:04.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.639+0000 7f7cb77fe700 1 -- 172.21.15.2:0/4166765468 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3528 (secure 0 0 0) 0x7f7cc8106800 con 0x7f7cb006c4e0 2024-09-13T22:55:04.640 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:55:04.640 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (5m) 86s ago 7m 26.5M - 0.25.0 c8568f914cd2 76a1576b4f53 2024-09-13T22:55:04.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (7m) 86s ago 7m 7448k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T22:55:04.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (6m) 92s ago 6m 7390k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T22:55:04.640 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (7m) 86s ago 7m 6665k - 18.2.1 5be31c24972a de910e0c5157 2024-09-13T22:55:04.640 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (6m) 92s ago 6m 6651k - 18.2.1 5be31c24972a 9f4bcfa66588 2024-09-13T22:55:04.640 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (5m) 86s ago 7m 84.3M - 9.4.7 954c08fa6188 39f4cfdc98d7 2024-09-13T22:55:04.640 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (114s) 86s ago 113s 11.5M - 18.2.1 5be31c24972a 59e9c88c31ca 2024-09-13T22:55:04.640 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (107s) 86s ago 106s 14.6M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T22:55:04.640 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (111s) 92s ago 110s 17.9M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T22:55:04.641 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (104s) 92s ago 104s 14.6M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T22:55:04.641 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:9283,8765,8443 running (8m) 86s ago 8m 487M - 18.2.1 5be31c24972a 04da5b94f858 2024-09-13T22:55:04.641 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (6m) 92s ago 6m 441M - 18.2.1 5be31c24972a 53861b0f547e 2024-09-13T22:55:04.641 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (8m) 86s ago 8m 44.7M 2048M 18.2.1 5be31c24972a de11be74385d 2024-09-13T22:55:04.641 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (6m) 92s ago 6m 35.1M 2048M 18.2.1 5be31c24972a 5642284a23bf 2024-09-13T22:55:04.641 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (7m) 86s ago 7m 15.7M - 1.5.0 0da6a335fe13 427e04f7ded9 2024-09-13T22:55:04.641 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (6m) 92s ago 6m 16.2M - 1.5.0 0da6a335fe13 07935c82b1d6 2024-09-13T22:55:04.641 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (5m) 86s ago 5m 47.6M 3948M 18.2.1 5be31c24972a 1e1f6936c402 2024-09-13T22:55:04.641 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (5m) 86s ago 5m 48.3M 3948M 18.2.1 5be31c24972a f0ac78c34831 2024-09-13T22:55:04.641 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (4m) 86s ago 4m 49.3M 3948M 18.2.1 5be31c24972a 9a2f4f6decfb 2024-09-13T22:55:04.641 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (4m) 92s ago 4m 46.5M 4972M 18.2.1 5be31c24972a fb455cc4c571 2024-09-13T22:55:04.641 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (3m) 92s ago 3m 44.4M 4972M 18.2.1 5be31c24972a f1bdc2c50535 2024-09-13T22:55:04.641 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (3m) 92s ago 3m 46.3M 4972M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T22:55:04.642 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (5m) 86s ago 6m 54.5M - 2.43.0 a07b618ecd1d f0199b20cefc 2024-09-13T22:55:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.641+0000 7f7cccaa3700 1 -- 172.21.15.2:0/4166765468 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f7cb006c4e0 msgr2=0x7f7cb006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:04.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.641+0000 7f7cccaa3700 1 --2- 172.21.15.2:0/4166765468 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f7cb006c4e0 0x7f7cb006e9a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8006010 tx=0x7f7cb800b540 comp rx=0 tx=0).stop 2024-09-13T22:55:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.641+0000 7f7cccaa3700 1 -- 172.21.15.2:0/4166765468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cc8101eb0 msgr2=0x7f7cc8073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.641+0000 7f7cccaa3700 1 --2- 172.21.15.2:0/4166765468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cc8101eb0 0x7f7cc8073180 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc00d8d0 tx=0x7f7cbc00dbe0 comp rx=0 tx=0).stop 2024-09-13T22:55:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.641+0000 7f7cccaa3700 1 -- 172.21.15.2:0/4166765468 shutdown_connections 2024-09-13T22:55:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.641+0000 7f7cccaa3700 1 --2- 172.21.15.2:0/4166765468 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f7cb006c4e0 0x7f7cb006e9a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.641+0000 7f7cccaa3700 1 --2- 172.21.15.2:0/4166765468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7cc8100cb0 0x7f7cc8074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.641+0000 7f7cccaa3700 1 --2- 172.21.15.2:0/4166765468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cc8101eb0 0x7f7cc8073180 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.641+0000 7f7cccaa3700 1 -- 172.21.15.2:0/4166765468 >> 172.21.15.2:0/4166765468 conn(0x7f7cc80fc230 msgr2=0x7f7cc81050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.641+0000 7f7cccaa3700 1 -- 172.21.15.2:0/4166765468 shutdown_connections 2024-09-13T22:55:04.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.641+0000 7f7cccaa3700 1 -- 172.21.15.2:0/4166765468 wait complete. 2024-09-13T22:55:04.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.765+0000 7efd583e4700 1 -- 172.21.15.2:0/1914403676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd50101800 msgr2=0x7efd50103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:04.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.765+0000 7efd583e4700 1 --2- 172.21.15.2:0/1914403676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd50101800 0x7efd50103bf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efd4c009910 tx=0x7efd4c009c20 comp rx=0 tx=0).stop 2024-09-13T22:55:04.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.765+0000 7efd583e4700 1 -- 172.21.15.2:0/1914403676 shutdown_connections 2024-09-13T22:55:04.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.765+0000 7efd583e4700 1 --2- 172.21.15.2:0/1914403676 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd50104130 0x7efd50106520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:04.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.765+0000 7efd583e4700 1 --2- 172.21.15.2:0/1914403676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd50101800 0x7efd50103bf0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:04.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.765+0000 7efd583e4700 1 -- 172.21.15.2:0/1914403676 >> 172.21.15.2:0/1914403676 conn(0x7efd500fb190 msgr2=0x7efd500fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:04.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.765+0000 7efd583e4700 1 -- 172.21.15.2:0/1914403676 shutdown_connections 2024-09-13T22:55:04.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.765+0000 7efd583e4700 1 -- 172.21.15.2:0/1914403676 wait complete. 2024-09-13T22:55:04.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.766+0000 7efd583e4700 1 Processor -- start 2024-09-13T22:55:04.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.766+0000 7efd583e4700 1 -- start start 2024-09-13T22:55:04.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.766+0000 7efd583e4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd50101800 0x7efd50196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:04.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.766+0000 7efd583e4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd50104130 0x7efd501969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:04.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.766+0000 7efd583e4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd50196fe0 con 0x7efd50104130 2024-09-13T22:55:04.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.766+0000 7efd583e4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd50197120 con 0x7efd50101800 2024-09-13T22:55:04.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.766+0000 7efd5597f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd50104130 0x7efd501969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:04.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.766+0000 7efd56180700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd50101800 0x7efd50196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:04.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.766+0000 7efd56180700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd50101800 0x7efd50196480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.2:34622/0 (socket says 172.21.15.2:34622) 2024-09-13T22:55:04.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.766+0000 7efd5597f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd50104130 0x7efd501969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34880/0 (socket says 172.21.15.2:34880) 2024-09-13T22:55:04.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.766+0000 7efd56180700 1 -- 172.21.15.2:0/1197475665 learned_addr learned my addr 172.21.15.2:0/1197475665 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:55:04.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.767+0000 7efd5597f700 1 -- 172.21.15.2:0/1197475665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd50101800 msgr2=0x7efd50196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:04.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.767+0000 7efd5597f700 1 --2- 172.21.15.2:0/1197475665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd50101800 0x7efd50196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:04.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.767+0000 7efd5597f700 1 -- 172.21.15.2:0/1197475665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c0095f0 con 0x7efd50104130 2024-09-13T22:55:04.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.767+0000 7efd56180700 1 --2- 172.21.15.2:0/1197475665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd50101800 0x7efd50196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T22:55:04.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.767+0000 7efd5597f700 1 --2- 172.21.15.2:0/1197475665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd50104130 0x7efd501969c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efd4000e970 tx=0x7efd4000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:04.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.767+0000 7efd477fe700 1 -- 172.21.15.2:0/1197475665 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd4000c9d0 con 0x7efd50104130 2024-09-13T22:55:04.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.767+0000 7efd583e4700 1 -- 172.21.15.2:0/1197475665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5019bbd0 con 0x7efd50104130 2024-09-13T22:55:04.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.767+0000 7efd477fe700 1 -- 172.21.15.2:0/1197475665 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efd40010430 con 0x7efd50104130 2024-09-13T22:55:04.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.767+0000 7efd477fe700 1 -- 172.21.15.2:0/1197475665 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd40018650 con 0x7efd50104130 2024-09-13T22:55:04.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.767+0000 7efd583e4700 1 -- 172.21.15.2:0/1197475665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5019c120 con 0x7efd50104130 2024-09-13T22:55:04.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.768+0000 7efd583e4700 1 -- 172.21.15.2:0/1197475665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd50190610 con 0x7efd50104130 2024-09-13T22:55:04.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.769+0000 7efd477fe700 1 -- 172.21.15.2:0/1197475665 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7efd400105a0 con 0x7efd50104130 2024-09-13T22:55:04.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.769+0000 7efd477fe700 1 --2- 172.21.15.2:0/1197475665 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7efd3c06c4e0 0x7efd3c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:04.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.770+0000 7efd477fe700 1 -- 172.21.15.2:0/1197475665 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7efd40014070 con 0x7efd50104130 2024-09-13T22:55:04.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.770+0000 7efd56180700 1 --2- 172.21.15.2:0/1197475665 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7efd3c06c4e0 0x7efd3c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:04.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.770+0000 7efd56180700 1 --2- 172.21.15.2:0/1197475665 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7efd3c06c4e0 0x7efd3c06e9a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efd4c009fd0 tx=0x7efd4c005940 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:04.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:04.774+0000 7efd477fe700 1 -- 172.21.15.2:0/1197475665 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7efd400520e0 con 0x7efd50104130 2024-09-13T22:55:05.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.108+0000 7efd583e4700 1 -- 172.21.15.2:0/1197475665 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efd500619a0 con 0x7efd50104130 2024-09-13T22:55:05.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.109+0000 7efd477fe700 1 -- 172.21.15.2:0/1197475665 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7efd40059d20 con 0x7efd50104130 2024-09-13T22:55:05.110 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:55:05.110 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T22:55:05.110 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-13T22:55:05.110 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:55:05.110 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T22:55:05.110 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-13T22:55:05.110 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:55:05.110 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T22:55:05.111 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-13T22:55:05.111 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:55:05.111 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T22:55:05.111 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-13T22:55:05.111 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:55:05.111 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T22:55:05.111 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 14 2024-09-13T22:55:05.111 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T22:55:05.111 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:55:05.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.111+0000 7efd583e4700 1 -- 172.21.15.2:0/1197475665 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7efd3c06c4e0 msgr2=0x7efd3c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:05.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.111+0000 7efd583e4700 1 --2- 172.21.15.2:0/1197475665 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7efd3c06c4e0 0x7efd3c06e9a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efd4c009fd0 tx=0x7efd4c005940 comp rx=0 tx=0).stop 2024-09-13T22:55:05.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.111+0000 7efd583e4700 1 -- 172.21.15.2:0/1197475665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd50104130 msgr2=0x7efd501969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:05.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.111+0000 7efd583e4700 1 --2- 172.21.15.2:0/1197475665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd50104130 0x7efd501969c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efd4000e970 tx=0x7efd4000ec80 comp rx=0 tx=0).stop 2024-09-13T22:55:05.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.111+0000 7efd583e4700 1 -- 172.21.15.2:0/1197475665 shutdown_connections 2024-09-13T22:55:05.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.111+0000 7efd583e4700 1 --2- 172.21.15.2:0/1197475665 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7efd3c06c4e0 0x7efd3c06e9a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:05.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.111+0000 7efd583e4700 1 --2- 172.21.15.2:0/1197475665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd50101800 0x7efd50196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:05.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.111+0000 7efd583e4700 1 --2- 172.21.15.2:0/1197475665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd50104130 0x7efd501969c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:05.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.111+0000 7efd583e4700 1 -- 172.21.15.2:0/1197475665 >> 172.21.15.2:0/1197475665 conn(0x7efd500fb190 msgr2=0x7efd500fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:05.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.111+0000 7efd583e4700 1 -- 172.21.15.2:0/1197475665 shutdown_connections 2024-09-13T22:55:05.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.111+0000 7efd583e4700 1 -- 172.21.15.2:0/1197475665 wait complete. 2024-09-13T22:55:05.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.231+0000 7fe724953700 1 -- 172.21.15.2:0/2434822322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe720100cb0 msgr2=0x7fe7201010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:05.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.231+0000 7fe724953700 1 --2- 172.21.15.2:0/2434822322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe720100cb0 0x7fe7201010d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe710009910 tx=0x7fe710009c20 comp rx=0 tx=0).stop 2024-09-13T22:55:05.233 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:04 smithi002 ceph-mon[27637]: pgmap v238: 65 pgs: 65 active+clean; 32 MiB data, 250 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 2.6 MiB/s wr, 96 op/s 2024-09-13T22:55:05.233 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:04 smithi002 ceph-mon[27637]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.231+0000 7fe724953700 1 -- 172.21.15.2:0/2434822322 shutdown_connections 2024-09-13T22:55:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.231+0000 7fe724953700 1 --2- 172.21.15.2:0/2434822322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe720101eb0 0x7fe720102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.231+0000 7fe724953700 1 --2- 172.21.15.2:0/2434822322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe720100cb0 0x7fe7201010d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.231+0000 7fe724953700 1 -- 172.21.15.2:0/2434822322 >> 172.21.15.2:0/2434822322 conn(0x7fe7200fc230 msgr2=0x7fe7200fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.231+0000 7fe724953700 1 -- 172.21.15.2:0/2434822322 shutdown_connections 2024-09-13T22:55:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.232+0000 7fe724953700 1 -- 172.21.15.2:0/2434822322 wait complete. 2024-09-13T22:55:05.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.233+0000 7fe724953700 1 Processor -- start 2024-09-13T22:55:05.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.233+0000 7fe724953700 1 -- start start 2024-09-13T22:55:05.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.233+0000 7fe724953700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe720100cb0 0x7fe720074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:05.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.233+0000 7fe724953700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe720101eb0 0x7fe720073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:05.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.233+0000 7fe724953700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7200736c0 con 0x7fe720100cb0 2024-09-13T22:55:05.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.233+0000 7fe724953700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe720073800 con 0x7fe720101eb0 2024-09-13T22:55:05.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.233+0000 7fe71e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe720100cb0 0x7fe720074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:05.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.233+0000 7fe71dd9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe720101eb0 0x7fe720073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:05.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.233+0000 7fe71dd9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe720101eb0 0x7fe720073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.2:34642/0 (socket says 172.21.15.2:34642) 2024-09-13T22:55:05.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.233+0000 7fe71dd9b700 1 -- 172.21.15.2:0/3272753120 learned_addr learned my addr 172.21.15.2:0/3272753120 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:55:05.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.234+0000 7fe71dd9b700 1 -- 172.21.15.2:0/3272753120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe720100cb0 msgr2=0x7fe720074b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:05.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.234+0000 7fe71dd9b700 1 --2- 172.21.15.2:0/3272753120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe720100cb0 0x7fe720074b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:05.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.234+0000 7fe71dd9b700 1 -- 172.21.15.2:0/3272753120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7100095f0 con 0x7fe720101eb0 2024-09-13T22:55:05.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.234+0000 7fe71e59c700 1 --2- 172.21.15.2:0/3272753120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe720100cb0 0x7fe720074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T22:55:05.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.234+0000 7fe71dd9b700 1 --2- 172.21.15.2:0/3272753120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe720101eb0 0x7fe720073180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe71400d8d0 tx=0x7fe71400dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:05.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.234+0000 7fe70f7fe700 1 -- 172.21.15.2:0/3272753120 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7140098a0 con 0x7fe720101eb0 2024-09-13T22:55:05.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.234+0000 7fe724953700 1 -- 172.21.15.2:0/3272753120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe720073ae0 con 0x7fe720101eb0 2024-09-13T22:55:05.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.234+0000 7fe70f7fe700 1 -- 172.21.15.2:0/3272753120 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe714010460 con 0x7fe720101eb0 2024-09-13T22:55:05.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.234+0000 7fe70f7fe700 1 -- 172.21.15.2:0/3272753120 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe71400f5f0 con 0x7fe720101eb0 2024-09-13T22:55:05.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.234+0000 7fe724953700 1 -- 172.21.15.2:0/3272753120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72019e550 con 0x7fe720101eb0 2024-09-13T22:55:05.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.235+0000 7fe724953700 1 -- 172.21.15.2:0/3272753120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe720109810 con 0x7fe720101eb0 2024-09-13T22:55:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.236+0000 7fe70f7fe700 1 -- 172.21.15.2:0/3272753120 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 19) v1 ==== 90310+0+0 (secure 0 0 0) 0x7fe714009a00 con 0x7fe720101eb0 2024-09-13T22:55:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.237+0000 7fe70f7fe700 1 --2- 172.21.15.2:0/3272753120 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe70806c4e0 0x7fe70806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.237+0000 7fe70f7fe700 1 -- 172.21.15.2:0/3272753120 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fe71408b6b0 con 0x7fe720101eb0 2024-09-13T22:55:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.237+0000 7fe71e59c700 1 --2- 172.21.15.2:0/3272753120 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe70806c4e0 0x7fe70806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.237+0000 7fe71e59c700 1 --2- 172.21.15.2:0/3272753120 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe70806c4e0 0x7fe70806e9a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe710006010 tx=0x7fe71000b930 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:05.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.243+0000 7fe70f7fe700 1 -- 172.21.15.2:0/3272753120 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe714059970 con 0x7fe720101eb0 2024-09-13T22:55:05.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:04 smithi047 ceph-mon[34560]: pgmap v238: 65 pgs: 65 active+clean; 32 MiB data, 250 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 2.6 MiB/s wr, 96 op/s 2024-09-13T22:55:05.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:04 smithi047 ceph-mon[34560]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:05.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.510+0000 7fe724953700 1 -- 172.21.15.2:0/3272753120 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe720106800 con 0x7fe70806c4e0 2024-09-13T22:55:05.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.511+0000 7fe70f7fe700 1 -- 172.21.15.2:0/3272753120 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fe720106800 con 0x7fe70806c4e0 2024-09-13T22:55:05.512 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:55:05.512 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:55:05.512 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T22:55:05.512 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T22:55:05.512 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [], 2024-09-13T22:55:05.512 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "0/2 daemons upgraded", 2024-09-13T22:55:05.512 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T22:55:05.512 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T22:55:05.512 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:55:05.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.513+0000 7fe724953700 1 -- 172.21.15.2:0/3272753120 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe70806c4e0 msgr2=0x7fe70806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:05.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.513+0000 7fe724953700 1 --2- 172.21.15.2:0/3272753120 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe70806c4e0 0x7fe70806e9a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe710006010 tx=0x7fe71000b930 comp rx=0 tx=0).stop 2024-09-13T22:55:05.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.513+0000 7fe724953700 1 -- 172.21.15.2:0/3272753120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe720101eb0 msgr2=0x7fe720073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:05.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.513+0000 7fe724953700 1 --2- 172.21.15.2:0/3272753120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe720101eb0 0x7fe720073180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe71400d8d0 tx=0x7fe71400dbe0 comp rx=0 tx=0).stop 2024-09-13T22:55:05.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.513+0000 7fe724953700 1 -- 172.21.15.2:0/3272753120 shutdown_connections 2024-09-13T22:55:05.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.513+0000 7fe724953700 1 --2- 172.21.15.2:0/3272753120 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7fe70806c4e0 0x7fe70806e9a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:05.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.513+0000 7fe724953700 1 --2- 172.21.15.2:0/3272753120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe720100cb0 0x7fe720074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:05.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.513+0000 7fe724953700 1 --2- 172.21.15.2:0/3272753120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe720101eb0 0x7fe720073180 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:05.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.513+0000 7fe724953700 1 -- 172.21.15.2:0/3272753120 >> 172.21.15.2:0/3272753120 conn(0x7fe7200fc230 msgr2=0x7fe7201050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:05.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.513+0000 7fe724953700 1 -- 172.21.15.2:0/3272753120 shutdown_connections 2024-09-13T22:55:05.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:05.513+0000 7fe724953700 1 -- 172.21.15.2:0/3272753120 wait complete. 2024-09-13T22:55:06.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:05 smithi047 ceph-mon[34560]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:06.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:05 smithi047 ceph-mon[34560]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:06.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:05 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/1197475665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:55:06.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:05 smithi002 ceph-mon[27637]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:06.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:05 smithi002 ceph-mon[27637]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:06.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:05 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/1197475665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:55:07.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:06 smithi002 ceph-mon[27637]: pgmap v239: 65 pgs: 65 active+clean; 37 MiB data, 270 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s rd, 3.0 MiB/s wr, 106 op/s 2024-09-13T22:55:07.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:06 smithi002 ceph-mon[27637]: from='client.24357 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:07.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:06 smithi047 ceph-mon[34560]: pgmap v239: 65 pgs: 65 active+clean; 37 MiB data, 270 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s rd, 3.0 MiB/s wr, 106 op/s 2024-09-13T22:55:07.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:06 smithi047 ceph-mon[34560]: from='client.24357 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:09.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:08 smithi002 ceph-mon[27637]: pgmap v240: 65 pgs: 65 active+clean; 47 MiB data, 316 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 135 op/s 2024-09-13T22:55:09.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:08 smithi047 ceph-mon[34560]: pgmap v240: 65 pgs: 65 active+clean; 47 MiB data, 316 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.4 MiB/s wr, 135 op/s 2024-09-13T22:55:11.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:10 smithi047 ceph-mon[34560]: pgmap v241: 65 pgs: 65 active+clean; 51 MiB data, 341 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 144 op/s 2024-09-13T22:55:11.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:10 smithi002 ceph-mon[27637]: pgmap v241: 65 pgs: 65 active+clean; 51 MiB data, 341 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 144 op/s 2024-09-13T22:55:13.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:12 smithi002 ceph-mon[27637]: pgmap v242: 65 pgs: 65 active+clean; 53 MiB data, 349 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 143 op/s 2024-09-13T22:55:13.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:12 smithi047 ceph-mon[34560]: pgmap v242: 65 pgs: 65 active+clean; 53 MiB data, 349 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 143 op/s 2024-09-13T22:55:15.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:14 smithi002 ceph-mon[27637]: pgmap v243: 65 pgs: 65 active+clean; 71 MiB data, 408 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 203 op/s 2024-09-13T22:55:15.314 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:14 smithi047 ceph-mon[34560]: pgmap v243: 65 pgs: 65 active+clean; 71 MiB data, 408 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.8 MiB/s wr, 203 op/s 2024-09-13T22:55:17.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:16 smithi002 ceph-mon[27637]: pgmap v244: 65 pgs: 65 active+clean; 72 MiB data, 415 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.4 MiB/s wr, 152 op/s 2024-09-13T22:55:17.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:16 smithi047 ceph-mon[34560]: pgmap v244: 65 pgs: 65 active+clean; 72 MiB data, 415 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.4 MiB/s wr, 152 op/s 2024-09-13T22:55:18.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:17 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:55:18.341 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:17 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:55:19.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:18 smithi002 ceph-mon[27637]: pgmap v245: 65 pgs: 65 active+clean; 89 MiB data, 457 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.4 MiB/s wr, 183 op/s 2024-09-13T22:55:19.328 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:18 smithi047 ceph-mon[34560]: pgmap v245: 65 pgs: 65 active+clean; 89 MiB data, 457 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.4 MiB/s wr, 183 op/s 2024-09-13T22:55:21.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:20 smithi047 ceph-mon[34560]: pgmap v246: 65 pgs: 65 active+clean; 96 MiB data, 474 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 185 op/s 2024-09-13T22:55:21.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:20 smithi002 ceph-mon[27637]: pgmap v246: 65 pgs: 65 active+clean; 96 MiB data, 474 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 185 op/s 2024-09-13T22:55:23.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:22 smithi002 ceph-mon[27637]: pgmap v247: 65 pgs: 65 active+clean; 98 MiB data, 493 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.0 MiB/s wr, 174 op/s 2024-09-13T22:55:23.385 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:22 smithi047 ceph-mon[34560]: pgmap v247: 65 pgs: 65 active+clean; 98 MiB data, 493 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.0 MiB/s wr, 174 op/s 2024-09-13T22:55:25.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:24 smithi047 ceph-mon[34560]: pgmap v248: 65 pgs: 65 active+clean; 112 MiB data, 545 MiB used, 536 GiB / 536 GiB avail; 3.3 MiB/s rd, 5.0 MiB/s wr, 213 op/s 2024-09-13T22:55:25.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:24 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:25.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:24 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:25.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:24 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:55:25.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:24 smithi002 ceph-mon[27637]: pgmap v248: 65 pgs: 65 active+clean; 112 MiB data, 545 MiB used, 536 GiB / 536 GiB avail; 3.3 MiB/s rd, 5.0 MiB/s wr, 213 op/s 2024-09-13T22:55:25.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:25.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:25.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:24 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:55:27.160 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:26 smithi047 ceph-mon[34560]: pgmap v249: 65 pgs: 65 active+clean; 115 MiB data, 549 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 3.7 MiB/s wr, 157 op/s 2024-09-13T22:55:27.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:26 smithi002 ceph-mon[27637]: pgmap v249: 65 pgs: 65 active+clean; 115 MiB data, 549 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 3.7 MiB/s wr, 157 op/s 2024-09-13T22:55:29.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:28 smithi002 ceph-mon[27637]: pgmap v250: 65 pgs: 65 active+clean; 121 MiB data, 577 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 4.2 MiB/s wr, 178 op/s 2024-09-13T22:55:29.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:28 smithi047 ceph-mon[34560]: pgmap v250: 65 pgs: 65 active+clean; 121 MiB data, 577 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 4.2 MiB/s wr, 178 op/s 2024-09-13T22:55:30.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:29 smithi002 ceph-mon[27637]: Standby manager daemon smithi047.gcymvd restarted 2024-09-13T22:55:30.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:29 smithi002 ceph-mon[27637]: Standby manager daemon smithi047.gcymvd started 2024-09-13T22:55:30.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:29 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/crt"}]: dispatch 2024-09-13T22:55:30.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:29 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:55:30.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:29 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/key"}]: dispatch 2024-09-13T22:55:30.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:29 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:55:30.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:29 smithi047 ceph-mon[34560]: Standby manager daemon smithi047.gcymvd restarted 2024-09-13T22:55:30.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:29 smithi047 ceph-mon[34560]: Standby manager daemon smithi047.gcymvd started 2024-09-13T22:55:30.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:29 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/crt"}]: dispatch 2024-09-13T22:55:30.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:29 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:55:30.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:29 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/key"}]: dispatch 2024-09-13T22:55:30.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:29 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:55:31.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:30 smithi002 ceph-mon[27637]: pgmap v251: 65 pgs: 65 active+clean; 127 MiB data, 594 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 160 op/s 2024-09-13T22:55:31.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:30 smithi002 ceph-mon[27637]: mgrmap e20: smithi002.yumtzz(active, since 7m), standbys: smithi047.gcymvd 2024-09-13T22:55:31.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:30 smithi047 ceph-mon[34560]: pgmap v251: 65 pgs: 65 active+clean; 127 MiB data, 594 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 160 op/s 2024-09-13T22:55:31.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:30 smithi047 ceph-mon[34560]: mgrmap e20: smithi002.yumtzz(active, since 7m), standbys: smithi047.gcymvd 2024-09-13T22:55:33.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:32 smithi047 ceph-mon[34560]: pgmap v252: 65 pgs: 65 active+clean; 129 MiB data, 610 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 141 op/s 2024-09-13T22:55:33.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:32 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:55:33.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:32 smithi002 ceph-mon[27637]: pgmap v252: 65 pgs: 65 active+clean; 129 MiB data, 610 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 141 op/s 2024-09-13T22:55:33.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:32 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:55:35.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:34 smithi002 ceph-mon[27637]: pgmap v253: 65 pgs: 65 active+clean; 143 MiB data, 663 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 3.9 MiB/s wr, 229 op/s 2024-09-13T22:55:35.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:34 smithi047 ceph-mon[34560]: pgmap v253: 65 pgs: 65 active+clean; 143 MiB data, 663 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 3.9 MiB/s wr, 229 op/s 2024-09-13T22:55:35.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.628+0000 7f2662d35700 1 -- 172.21.15.2:0/1931046207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c100e10 msgr2=0x7f265c101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:35.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.628+0000 7f2662d35700 1 --2- 172.21.15.2:0/1931046207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c100e10 0x7f265c101270 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f264c009910 tx=0x7f264c009c20 comp rx=0 tx=0).stop 2024-09-13T22:55:35.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.628+0000 7f2662d35700 1 -- 172.21.15.2:0/1931046207 shutdown_connections 2024-09-13T22:55:35.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.628+0000 7f2662d35700 1 --2- 172.21.15.2:0/1931046207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c100e10 0x7f265c101270 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:35.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.628+0000 7f2662d35700 1 --2- 172.21.15.2:0/1931046207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265c0ffc10 0x7f265c100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.628+0000 7f2662d35700 1 -- 172.21.15.2:0/1931046207 >> 172.21.15.2:0/1931046207 conn(0x7f265c0fb190 msgr2=0x7f265c0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.628+0000 7f2662d35700 1 -- 172.21.15.2:0/1931046207 shutdown_connections 2024-09-13T22:55:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.628+0000 7f2662d35700 1 -- 172.21.15.2:0/1931046207 wait complete. 2024-09-13T22:55:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.629+0000 7f2662d35700 1 Processor -- start 2024-09-13T22:55:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.629+0000 7f2662d35700 1 -- start start 2024-09-13T22:55:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.629+0000 7f2662d35700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c0ffc10 0x7f265c0690e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.629+0000 7f2662d35700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265c100e10 0x7f265c19b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:35.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.629+0000 7f2662d35700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c19b7d0 con 0x7f265c0ffc10 2024-09-13T22:55:35.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.629+0000 7f2662d35700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c19b910 con 0x7f265c100e10 2024-09-13T22:55:35.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.630+0000 7f2660ad1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c0ffc10 0x7f265c0690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:35.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.630+0000 7f2660ad1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c0ffc10 0x7f265c0690e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47694/0 (socket says 172.21.15.2:47694) 2024-09-13T22:55:35.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.630+0000 7f2660ad1700 1 -- 172.21.15.2:0/2205743403 learned_addr learned my addr 172.21.15.2:0/2205743403 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:55:35.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.630+0000 7f2653fff700 1 --2- 172.21.15.2:0/2205743403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265c100e10 0x7f265c19b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:35.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.630+0000 7f2660ad1700 1 -- 172.21.15.2:0/2205743403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265c100e10 msgr2=0x7f265c19b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:35.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.630+0000 7f2660ad1700 1 --2- 172.21.15.2:0/2205743403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265c100e10 0x7f265c19b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:35.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.630+0000 7f2660ad1700 1 -- 172.21.15.2:0/2205743403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c0095f0 con 0x7f265c0ffc10 2024-09-13T22:55:35.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.630+0000 7f2660ad1700 1 --2- 172.21.15.2:0/2205743403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c0ffc10 0x7f265c0690e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f265800efc0 tx=0x7f265800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:35.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.630+0000 7f2651ffb700 1 -- 172.21.15.2:0/2205743403 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2658018070 con 0x7f265c0ffc10 2024-09-13T22:55:35.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.630+0000 7f2662d35700 1 -- 172.21.15.2:0/2205743403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265c19bb90 con 0x7f265c0ffc10 2024-09-13T22:55:35.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.630+0000 7f2651ffb700 1 -- 172.21.15.2:0/2205743403 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f265800f040 con 0x7f265c0ffc10 2024-09-13T22:55:35.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.630+0000 7f2651ffb700 1 -- 172.21.15.2:0/2205743403 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2658004490 con 0x7f265c0ffc10 2024-09-13T22:55:35.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.631+0000 7f2662d35700 1 -- 172.21.15.2:0/2205743403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265c19c0e0 con 0x7f265c0ffc10 2024-09-13T22:55:35.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.631+0000 7f2662d35700 1 -- 172.21.15.2:0/2205743403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265c108700 con 0x7f265c0ffc10 2024-09-13T22:55:35.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.632+0000 7f2651ffb700 1 -- 172.21.15.2:0/2205743403 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) v1 ==== 91356+0+0 (secure 0 0 0) 0x7f2658004710 con 0x7f265c0ffc10 2024-09-13T22:55:35.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.632+0000 7f2651ffb700 1 --2- 172.21.15.2:0/2205743403 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f264406d3f0 0x7f264406f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:35.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.633+0000 7f2651ffb700 1 -- 172.21.15.2:0/2205743403 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f265808cdb0 con 0x7f265c0ffc10 2024-09-13T22:55:35.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.633+0000 7f2653fff700 1 --2- 172.21.15.2:0/2205743403 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f264406d3f0 0x7f264406f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:35.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.633+0000 7f2653fff700 1 --2- 172.21.15.2:0/2205743403 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f264406d3f0 0x7f264406f8b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f265c069660 tx=0x7f264c005fd0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:35.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.638+0000 7f2651ffb700 1 -- 172.21.15.2:0/2205743403 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f265805b070 con 0x7f265c0ffc10 2024-09-13T22:55:35.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.903+0000 7f2662d35700 1 -- 172.21.15.2:0/2205743403 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f265c105760 con 0x7f264406d3f0 2024-09-13T22:55:35.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.904+0000 7f2651ffb700 1 -- 172.21.15.2:0/2205743403 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f265c105760 con 0x7f264406d3f0 2024-09-13T22:55:35.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.907+0000 7f2662d35700 1 -- 172.21.15.2:0/2205743403 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f264406d3f0 msgr2=0x7f264406f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:35.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.907+0000 7f2662d35700 1 --2- 172.21.15.2:0/2205743403 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f264406d3f0 0x7f264406f8b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f265c069660 tx=0x7f264c005fd0 comp rx=0 tx=0).stop 2024-09-13T22:55:35.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.907+0000 7f2662d35700 1 -- 172.21.15.2:0/2205743403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c0ffc10 msgr2=0x7f265c0690e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:35.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.907+0000 7f2662d35700 1 --2- 172.21.15.2:0/2205743403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c0ffc10 0x7f265c0690e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f265800efc0 tx=0x7f265800c3a0 comp rx=0 tx=0).stop 2024-09-13T22:55:35.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.907+0000 7f2662d35700 1 -- 172.21.15.2:0/2205743403 shutdown_connections 2024-09-13T22:55:35.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.907+0000 7f2662d35700 1 --2- 172.21.15.2:0/2205743403 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f264406d3f0 0x7f264406f8b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:35.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.907+0000 7f2662d35700 1 --2- 172.21.15.2:0/2205743403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c0ffc10 0x7f265c0690e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:35.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.907+0000 7f2662d35700 1 --2- 172.21.15.2:0/2205743403 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f265c100e10 0x7f265c19b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:35.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.907+0000 7f2662d35700 1 -- 172.21.15.2:0/2205743403 >> 172.21.15.2:0/2205743403 conn(0x7f265c0fb190 msgr2=0x7f265c104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:35.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.907+0000 7f2662d35700 1 -- 172.21.15.2:0/2205743403 shutdown_connections 2024-09-13T22:55:35.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:35.907+0000 7f2662d35700 1 -- 172.21.15.2:0/2205743403 wait complete. 2024-09-13T22:55:35.921 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T22:55:36.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.028+0000 7f3cc102f700 1 -- 172.21.15.2:0/1104502972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cbc104190 msgr2=0x7f3cbc106580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:36.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.028+0000 7f3cc102f700 1 --2- 172.21.15.2:0/1104502972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cbc104190 0x7f3cbc106580 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009910 tx=0x7f3cb0009c20 comp rx=0 tx=0).stop 2024-09-13T22:55:36.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.028+0000 7f3cc102f700 1 -- 172.21.15.2:0/1104502972 shutdown_connections 2024-09-13T22:55:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.028+0000 7f3cc102f700 1 --2- 172.21.15.2:0/1104502972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cbc104190 0x7f3cbc106580 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.028+0000 7f3cc102f700 1 --2- 172.21.15.2:0/1104502972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cbc101860 0x7f3cbc103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.028+0000 7f3cc102f700 1 -- 172.21.15.2:0/1104502972 >> 172.21.15.2:0/1104502972 conn(0x7f3cbc0fb190 msgr2=0x7f3cbc0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.028+0000 7f3cc102f700 1 -- 172.21.15.2:0/1104502972 shutdown_connections 2024-09-13T22:55:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.028+0000 7f3cc102f700 1 -- 172.21.15.2:0/1104502972 wait complete. 2024-09-13T22:55:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.029+0000 7f3cc102f700 1 Processor -- start 2024-09-13T22:55:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.029+0000 7f3cc102f700 1 -- start start 2024-09-13T22:55:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.029+0000 7f3cc102f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cbc101860 0x7f3cbc196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.029+0000 7f3cc102f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cbc104190 0x7f3cbc1969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.029+0000 7f3cc102f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc196fc0 con 0x7f3cbc101860 2024-09-13T22:55:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.029+0000 7f3cc102f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc197100 con 0x7f3cbc104190 2024-09-13T22:55:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.029+0000 7f3cbad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cbc101860 0x7f3cbc196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:36.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.029+0000 7f3cbad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cbc101860 0x7f3cbc196460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47714/0 (socket says 172.21.15.2:47714) 2024-09-13T22:55:36.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.029+0000 7f3cbad9d700 1 -- 172.21.15.2:0/527003560 learned_addr learned my addr 172.21.15.2:0/527003560 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:55:36.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.029+0000 7f3cba59c700 1 --2- 172.21.15.2:0/527003560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cbc104190 0x7f3cbc1969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:36.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.029+0000 7f3cbad9d700 1 -- 172.21.15.2:0/527003560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cbc104190 msgr2=0x7f3cbc1969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:36.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.030+0000 7f3cbad9d700 1 --2- 172.21.15.2:0/527003560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cbc104190 0x7f3cbc1969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:36.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.030+0000 7f3cbad9d700 1 -- 172.21.15.2:0/527003560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb00095f0 con 0x7f3cbc101860 2024-09-13T22:55:36.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.030+0000 7f3cbad9d700 1 --2- 172.21.15.2:0/527003560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cbc101860 0x7f3cbc196460 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00ef10 tx=0x7f3cac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:36.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.030+0000 7f3ca3fff700 1 -- 172.21.15.2:0/527003560 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cac00ca50 con 0x7f3cbc101860 2024-09-13T22:55:36.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.030+0000 7f3cc102f700 1 -- 172.21.15.2:0/527003560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cbc19bb50 con 0x7f3cbc101860 2024-09-13T22:55:36.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.030+0000 7f3ca3fff700 1 -- 172.21.15.2:0/527003560 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3cac00f040 con 0x7f3cbc101860 2024-09-13T22:55:36.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.030+0000 7f3ca3fff700 1 -- 172.21.15.2:0/527003560 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cac0146b0 con 0x7f3cbc101860 2024-09-13T22:55:36.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.030+0000 7f3cc102f700 1 -- 172.21.15.2:0/527003560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cbc19c0a0 con 0x7f3cbc101860 2024-09-13T22:55:36.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.031+0000 7f3cc102f700 1 -- 172.21.15.2:0/527003560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cbc190610 con 0x7f3cbc101860 2024-09-13T22:55:36.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.031+0000 7f3ca3fff700 1 -- 172.21.15.2:0/527003560 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) v1 ==== 91356+0+0 (secure 0 0 0) 0x7f3cac00cbb0 con 0x7f3cbc101860 2024-09-13T22:55:36.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.032+0000 7f3ca3fff700 1 --2- 172.21.15.2:0/527003560 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f3ca406d3f0 0x7f3ca406f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:36.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.032+0000 7f3ca3fff700 1 -- 172.21.15.2:0/527003560 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f3cac08cf00 con 0x7f3cbc101860 2024-09-13T22:55:36.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.032+0000 7f3cba59c700 1 --2- 172.21.15.2:0/527003560 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f3ca406d3f0 0x7f3ca406f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:36.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.033+0000 7f3cba59c700 1 --2- 172.21.15.2:0/527003560 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f3ca406d3f0 0x7f3ca406f8b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00059d0 tx=0x7f3cb0005940 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:36.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.037+0000 7f3ca3fff700 1 -- 172.21.15.2:0/527003560 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3cac05b1c0 con 0x7f3cbc101860 2024-09-13T22:55:36.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.282+0000 7f3cc102f700 1 -- 172.21.15.2:0/527003560 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3cbc0611d0 con 0x7f3ca406d3f0 2024-09-13T22:55:36.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.283+0000 7f3ca3fff700 1 -- 172.21.15.2:0/527003560 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f3cbc0611d0 con 0x7f3ca406d3f0 2024-09-13T22:55:36.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.285+0000 7f3cc102f700 1 -- 172.21.15.2:0/527003560 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f3ca406d3f0 msgr2=0x7f3ca406f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:36.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.285+0000 7f3cc102f700 1 --2- 172.21.15.2:0/527003560 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f3ca406d3f0 0x7f3ca406f8b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00059d0 tx=0x7f3cb0005940 comp rx=0 tx=0).stop 2024-09-13T22:55:36.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.285+0000 7f3cc102f700 1 -- 172.21.15.2:0/527003560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cbc101860 msgr2=0x7f3cbc196460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:36.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.285+0000 7f3cc102f700 1 --2- 172.21.15.2:0/527003560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cbc101860 0x7f3cbc196460 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00ef10 tx=0x7f3cac00c3a0 comp rx=0 tx=0).stop 2024-09-13T22:55:36.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.285+0000 7f3cc102f700 1 -- 172.21.15.2:0/527003560 shutdown_connections 2024-09-13T22:55:36.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.285+0000 7f3cc102f700 1 --2- 172.21.15.2:0/527003560 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f3ca406d3f0 0x7f3ca406f8b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:36.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.285+0000 7f3cc102f700 1 --2- 172.21.15.2:0/527003560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cbc101860 0x7f3cbc196460 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:36.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.285+0000 7f3cc102f700 1 --2- 172.21.15.2:0/527003560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cbc104190 0x7f3cbc1969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:36.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.285+0000 7f3cc102f700 1 -- 172.21.15.2:0/527003560 >> 172.21.15.2:0/527003560 conn(0x7f3cbc0fb190 msgr2=0x7f3cbc0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:36.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.286+0000 7f3cc102f700 1 -- 172.21.15.2:0/527003560 shutdown_connections 2024-09-13T22:55:36.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.286+0000 7f3cc102f700 1 -- 172.21.15.2:0/527003560 wait complete. 2024-09-13T22:55:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.404+0000 7ff5ad330700 1 -- 172.21.15.2:0/1339822519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5a81017b0 msgr2=0x7ff5a8103ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.404+0000 7ff5ad330700 1 --2- 172.21.15.2:0/1339822519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5a81017b0 0x7ff5a8103ba0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff598009910 tx=0x7ff598009c20 comp rx=0 tx=0).stop 2024-09-13T22:55:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.404+0000 7ff5ad330700 1 -- 172.21.15.2:0/1339822519 shutdown_connections 2024-09-13T22:55:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.404+0000 7ff5ad330700 1 --2- 172.21.15.2:0/1339822519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5a81040e0 0x7ff5a81064d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.404+0000 7ff5ad330700 1 --2- 172.21.15.2:0/1339822519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5a81017b0 0x7ff5a8103ba0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.404+0000 7ff5ad330700 1 -- 172.21.15.2:0/1339822519 >> 172.21.15.2:0/1339822519 conn(0x7ff5a80fb160 msgr2=0x7ff5a80fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.405+0000 7ff5ad330700 1 -- 172.21.15.2:0/1339822519 shutdown_connections 2024-09-13T22:55:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.405+0000 7ff5ad330700 1 -- 172.21.15.2:0/1339822519 wait complete. 2024-09-13T22:55:36.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.405+0000 7ff5ad330700 1 Processor -- start 2024-09-13T22:55:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.405+0000 7ff5ad330700 1 -- start start 2024-09-13T22:55:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.406+0000 7ff5ad330700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5a81017b0 0x7ff5a8196730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.406+0000 7ff5ad330700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5a81040e0 0x7ff5a8196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.406+0000 7ff5ad330700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a8197290 con 0x7ff5a81040e0 2024-09-13T22:55:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.406+0000 7ff5ad330700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a81973d0 con 0x7ff5a81017b0 2024-09-13T22:55:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.406+0000 7ff5a67fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5a81040e0 0x7ff5a8196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.406+0000 7ff5a67fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5a81040e0 0x7ff5a8196c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47740/0 (socket says 172.21.15.2:47740) 2024-09-13T22:55:36.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.406+0000 7ff5a67fc700 1 -- 172.21.15.2:0/3429752169 learned_addr learned my addr 172.21.15.2:0/3429752169 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:55:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.406+0000 7ff5a6ffd700 1 --2- 172.21.15.2:0/3429752169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5a81017b0 0x7ff5a8196730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.406+0000 7ff5a67fc700 1 -- 172.21.15.2:0/3429752169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5a81017b0 msgr2=0x7ff5a8196730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.406+0000 7ff5a67fc700 1 --2- 172.21.15.2:0/3429752169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5a81017b0 0x7ff5a8196730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.406+0000 7ff5a67fc700 1 -- 172.21.15.2:0/3429752169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5980095f0 con 0x7ff5a81040e0 2024-09-13T22:55:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.406+0000 7ff5a67fc700 1 --2- 172.21.15.2:0/3429752169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5a81040e0 0x7ff5a8196c70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00d900 tx=0x7ff59c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.406+0000 7ff58ffff700 1 -- 172.21.15.2:0/3429752169 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff59c0041f0 con 0x7ff5a81040e0 2024-09-13T22:55:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.406+0000 7ff58ffff700 1 -- 172.21.15.2:0/3429752169 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff59c004ce0 con 0x7ff5a81040e0 2024-09-13T22:55:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.406+0000 7ff5ad330700 1 -- 172.21.15.2:0/3429752169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a819be80 con 0x7ff5a81040e0 2024-09-13T22:55:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.406+0000 7ff58ffff700 1 -- 172.21.15.2:0/3429752169 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff59c00b750 con 0x7ff5a81040e0 2024-09-13T22:55:36.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.406+0000 7ff5ad330700 1 -- 172.21.15.2:0/3429752169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a819c3a0 con 0x7ff5a81040e0 2024-09-13T22:55:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.407+0000 7ff5ad330700 1 -- 172.21.15.2:0/3429752169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a8190630 con 0x7ff5a81040e0 2024-09-13T22:55:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.408+0000 7ff58ffff700 1 -- 172.21.15.2:0/3429752169 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) v1 ==== 91356+0+0 (secure 0 0 0) 0x7ff59c004e50 con 0x7ff5a81040e0 2024-09-13T22:55:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.408+0000 7ff58ffff700 1 --2- 172.21.15.2:0/3429752169 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff59006d3f0 0x7ff59006f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.409+0000 7ff5a6ffd700 1 --2- 172.21.15.2:0/3429752169 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff59006d3f0 0x7ff59006f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.409+0000 7ff58ffff700 1 -- 172.21.15.2:0/3429752169 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7ff59c08ca90 con 0x7ff5a81040e0 2024-09-13T22:55:36.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.409+0000 7ff5a6ffd700 1 --2- 172.21.15.2:0/3429752169 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff59006d3f0 0x7ff59006f8b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff59800b5c0 tx=0x7ff598005ee0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:36.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.413+0000 7ff58ffff700 1 -- 172.21.15.2:0/3429752169 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff59c05acb0 con 0x7ff5a81040e0 2024-09-13T22:55:36.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.629+0000 7ff5ad330700 1 -- 172.21.15.2:0/3429752169 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5a802d050 con 0x7ff59006d3f0 2024-09-13T22:55:36.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.642+0000 7ff58ffff700 1 -- 172.21.15.2:0/3429752169 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3504 (secure 0 0 0) 0x7ff5a802d050 con 0x7ff59006d3f0 2024-09-13T22:55:36.645 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:55:36.645 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (6m) 118s ago 7m 26.5M - 0.25.0 c8568f914cd2 76a1576b4f53 2024-09-13T22:55:36.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (8m) 118s ago 8m 7448k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T22:55:36.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (7m) 2m ago 7m 7390k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T22:55:36.645 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (8m) 118s ago 8m 6665k - 18.2.1 5be31c24972a de910e0c5157 2024-09-13T22:55:36.645 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (7m) 2m ago 7m 6651k - 18.2.1 5be31c24972a 9f4bcfa66588 2024-09-13T22:55:36.645 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (6m) 118s ago 7m 84.3M - 9.4.7 954c08fa6188 39f4cfdc98d7 2024-09-13T22:55:36.645 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (2m) 118s ago 2m 11.5M - 18.2.1 5be31c24972a 59e9c88c31ca 2024-09-13T22:55:36.645 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (2m) 118s ago 2m 14.6M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T22:55:36.645 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (2m) 2m ago 2m 17.9M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T22:55:36.645 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (2m) 2m ago 2m 14.6M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T22:55:36.645 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:9283,8765,8443 running (9m) 118s ago 9m 487M - 18.2.1 5be31c24972a 04da5b94f858 2024-09-13T22:55:36.646 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 starting - - - - 2024-09-13T22:55:36.646 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (9m) 118s ago 9m 44.7M 2048M 18.2.1 5be31c24972a de11be74385d 2024-09-13T22:55:36.646 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (6m) 2m ago 6m 35.1M 2048M 18.2.1 5be31c24972a 5642284a23bf 2024-09-13T22:55:36.646 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (8m) 118s ago 8m 15.7M - 1.5.0 0da6a335fe13 427e04f7ded9 2024-09-13T22:55:36.646 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (7m) 2m ago 7m 16.2M - 1.5.0 0da6a335fe13 07935c82b1d6 2024-09-13T22:55:36.646 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (6m) 118s ago 6m 47.6M 3948M 18.2.1 5be31c24972a 1e1f6936c402 2024-09-13T22:55:36.646 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (5m) 118s ago 5m 48.3M 3948M 18.2.1 5be31c24972a f0ac78c34831 2024-09-13T22:55:36.646 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (5m) 118s ago 5m 49.3M 3948M 18.2.1 5be31c24972a 9a2f4f6decfb 2024-09-13T22:55:36.646 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (4m) 2m ago 4m 46.5M 4972M 18.2.1 5be31c24972a fb455cc4c571 2024-09-13T22:55:36.646 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (4m) 2m ago 4m 44.4M 4972M 18.2.1 5be31c24972a f1bdc2c50535 2024-09-13T22:55:36.646 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (3m) 2m ago 3m 46.3M 4972M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T22:55:36.646 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (6m) 118s ago 7m 54.5M - 2.43.0 a07b618ecd1d f0199b20cefc 2024-09-13T22:55:36.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.644+0000 7ff5ad330700 1 -- 172.21.15.2:0/3429752169 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff59006d3f0 msgr2=0x7ff59006f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:36.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.644+0000 7ff5ad330700 1 --2- 172.21.15.2:0/3429752169 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff59006d3f0 0x7ff59006f8b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff59800b5c0 tx=0x7ff598005ee0 comp rx=0 tx=0).stop 2024-09-13T22:55:36.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.644+0000 7ff5ad330700 1 -- 172.21.15.2:0/3429752169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5a81040e0 msgr2=0x7ff5a8196c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:36.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.644+0000 7ff5ad330700 1 --2- 172.21.15.2:0/3429752169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5a81040e0 0x7ff5a8196c70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00d900 tx=0x7ff59c00dc10 comp rx=0 tx=0).stop 2024-09-13T22:55:36.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.644+0000 7ff5ad330700 1 -- 172.21.15.2:0/3429752169 shutdown_connections 2024-09-13T22:55:36.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.644+0000 7ff5ad330700 1 --2- 172.21.15.2:0/3429752169 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7ff59006d3f0 0x7ff59006f8b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:36.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.644+0000 7ff5ad330700 1 --2- 172.21.15.2:0/3429752169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5a81017b0 0x7ff5a8196730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:36.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.644+0000 7ff5ad330700 1 --2- 172.21.15.2:0/3429752169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5a81040e0 0x7ff5a8196c70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:36.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.644+0000 7ff5ad330700 1 -- 172.21.15.2:0/3429752169 >> 172.21.15.2:0/3429752169 conn(0x7ff5a80fb160 msgr2=0x7ff5a80fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:36.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.645+0000 7ff5ad330700 1 -- 172.21.15.2:0/3429752169 shutdown_connections 2024-09-13T22:55:36.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.645+0000 7ff5ad330700 1 -- 172.21.15.2:0/3429752169 wait complete. 2024-09-13T22:55:36.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.763+0000 7f72eb7f1700 1 -- 172.21.15.2:0/2848650856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72e41040d0 msgr2=0x7f72e41064c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:36.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.763+0000 7f72eb7f1700 1 --2- 172.21.15.2:0/2848650856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72e41040d0 0x7f72e41064c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f72d4009910 tx=0x7f72d4009c20 comp rx=0 tx=0).stop 2024-09-13T22:55:36.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.763+0000 7f72eb7f1700 1 -- 172.21.15.2:0/2848650856 shutdown_connections 2024-09-13T22:55:36.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.763+0000 7f72eb7f1700 1 --2- 172.21.15.2:0/2848650856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72e41040d0 0x7f72e41064c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:36.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.763+0000 7f72eb7f1700 1 --2- 172.21.15.2:0/2848650856 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72e41017a0 0x7f72e4103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:36.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.763+0000 7f72eb7f1700 1 -- 172.21.15.2:0/2848650856 >> 172.21.15.2:0/2848650856 conn(0x7f72e40fb190 msgr2=0x7f72e40fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:36.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.763+0000 7f72eb7f1700 1 -- 172.21.15.2:0/2848650856 shutdown_connections 2024-09-13T22:55:36.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.763+0000 7f72eb7f1700 1 -- 172.21.15.2:0/2848650856 wait complete. 2024-09-13T22:55:36.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.764+0000 7f72eb7f1700 1 Processor -- start 2024-09-13T22:55:36.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.764+0000 7f72eb7f1700 1 -- start start 2024-09-13T22:55:36.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.764+0000 7f72eb7f1700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72e41017a0 0x7f72e4196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:36.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.764+0000 7f72eb7f1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72e41040d0 0x7f72e4196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:36.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.764+0000 7f72eb7f1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e4196fb0 con 0x7f72e41040d0 2024-09-13T22:55:36.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.764+0000 7f72eb7f1700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e41970f0 con 0x7f72e41017a0 2024-09-13T22:55:36.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.765+0000 7f72e8d8c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72e41040d0 0x7f72e4196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:36.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.765+0000 7f72e958d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72e41017a0 0x7f72e4196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:36.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.765+0000 7f72e958d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72e41017a0 0x7f72e4196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.2:51426/0 (socket says 172.21.15.2:51426) 2024-09-13T22:55:36.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.765+0000 7f72e958d700 1 -- 172.21.15.2:0/720277335 learned_addr learned my addr 172.21.15.2:0/720277335 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:55:36.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.765+0000 7f72e958d700 1 -- 172.21.15.2:0/720277335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72e41040d0 msgr2=0x7f72e4196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:36.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.765+0000 7f72e958d700 1 --2- 172.21.15.2:0/720277335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72e41040d0 0x7f72e4196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:36.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.765+0000 7f72e958d700 1 -- 172.21.15.2:0/720277335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d40095f0 con 0x7f72e41017a0 2024-09-13T22:55:36.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.765+0000 7f72e958d700 1 --2- 172.21.15.2:0/720277335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72e41017a0 0x7f72e4196450 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f72e000e920 tx=0x7f72e000ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:36.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.765+0000 7f72da7fc700 1 -- 172.21.15.2:0/720277335 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72e000c9d0 con 0x7f72e41017a0 2024-09-13T22:55:36.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.766+0000 7f72eb7f1700 1 -- 172.21.15.2:0/720277335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e419bba0 con 0x7f72e41017a0 2024-09-13T22:55:36.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.766+0000 7f72eb7f1700 1 -- 172.21.15.2:0/720277335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e419c0f0 con 0x7f72e41017a0 2024-09-13T22:55:36.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.766+0000 7f72da7fc700 1 -- 172.21.15.2:0/720277335 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f72e0010430 con 0x7f72e41017a0 2024-09-13T22:55:36.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.766+0000 7f72da7fc700 1 -- 172.21.15.2:0/720277335 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72e0018650 con 0x7f72e41017a0 2024-09-13T22:55:36.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.767+0000 7f72eb7f1700 1 -- 172.21.15.2:0/720277335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e4190610 con 0x7f72e41017a0 2024-09-13T22:55:36.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.768+0000 7f72da7fc700 1 -- 172.21.15.2:0/720277335 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 20) v1 ==== 91356+0+0 (secure 0 0 0) 0x7f72e00105a0 con 0x7f72e41017a0 2024-09-13T22:55:36.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.768+0000 7f72da7fc700 1 --2- 172.21.15.2:0/720277335 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f72d006d3f0 0x7f72d006f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:36.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.768+0000 7f72da7fc700 1 -- 172.21.15.2:0/720277335 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f72e0014070 con 0x7f72e41017a0 2024-09-13T22:55:36.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.768+0000 7f72e8d8c700 1 --2- 172.21.15.2:0/720277335 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f72d006d3f0 0x7f72d006f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:36.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.769+0000 7f72e8d8c700 1 --2- 172.21.15.2:0/720277335 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f72d006d3f0 0x7f72d006f8b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f72d4009fd0 tx=0x7f72d4005fd0 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:36.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:36.776+0000 7f72da7fc700 1 -- 172.21.15.2:0/720277335 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f72e00520e0 con 0x7f72e41017a0 2024-09-13T22:55:37.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.139+0000 7f72eb7f1700 1 -- 172.21.15.2:0/720277335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f72e4061a70 con 0x7f72e41017a0 2024-09-13T22:55:37.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.139+0000 7f72da7fc700 1 -- 172.21.15.2:0/720277335 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+770 (secure 0 0 0) 0x7f72e005b060 con 0x7f72e41017a0 2024-09-13T22:55:37.141 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:55:37.141 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T22:55:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-13T22:55:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:55:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T22:55:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-09-13T22:55:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T22:55:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:55:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T22:55:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-13T22:55:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:55:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T22:55:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-13T22:55:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:55:37.143 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T22:55:37.143 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 13, 2024-09-13T22:55:37.143 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T22:55:37.143 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T22:55:37.143 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:55:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.142+0000 7f72eb7f1700 1 -- 172.21.15.2:0/720277335 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f72d006d3f0 msgr2=0x7f72d006f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.142+0000 7f72eb7f1700 1 --2- 172.21.15.2:0/720277335 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f72d006d3f0 0x7f72d006f8b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f72d4009fd0 tx=0x7f72d4005fd0 comp rx=0 tx=0).stop 2024-09-13T22:55:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.142+0000 7f72eb7f1700 1 -- 172.21.15.2:0/720277335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72e41017a0 msgr2=0x7f72e4196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.142+0000 7f72eb7f1700 1 --2- 172.21.15.2:0/720277335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72e41017a0 0x7f72e4196450 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f72e000e920 tx=0x7f72e000ec30 comp rx=0 tx=0).stop 2024-09-13T22:55:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.142+0000 7f72eb7f1700 1 -- 172.21.15.2:0/720277335 shutdown_connections 2024-09-13T22:55:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.142+0000 7f72eb7f1700 1 --2- 172.21.15.2:0/720277335 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f72d006d3f0 0x7f72d006f8b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.142+0000 7f72eb7f1700 1 --2- 172.21.15.2:0/720277335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72e41017a0 0x7f72e4196450 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.142+0000 7f72eb7f1700 1 --2- 172.21.15.2:0/720277335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72e41040d0 0x7f72e4196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:37.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.142+0000 7f72eb7f1700 1 -- 172.21.15.2:0/720277335 >> 172.21.15.2:0/720277335 conn(0x7f72e40fb190 msgr2=0x7f72e40fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:37.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.142+0000 7f72eb7f1700 1 -- 172.21.15.2:0/720277335 shutdown_connections 2024-09-13T22:55:37.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.142+0000 7f72eb7f1700 1 -- 172.21.15.2:0/720277335 wait complete. 2024-09-13T22:55:37.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:36 smithi002 ceph-mon[27637]: pgmap v254: 65 pgs: 65 active+clean; 145 MiB data, 669 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 197 op/s 2024-09-13T22:55:37.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:36 smithi002 ceph-mon[27637]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:37.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.266+0000 7f10626d4700 1 -- 172.21.15.2:0/3336304572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f105c100cb0 msgr2=0x7f105c1010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:37.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.266+0000 7f10626d4700 1 --2- 172.21.15.2:0/3336304572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f105c100cb0 0x7f105c1010d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f104c009910 tx=0x7f104c009c20 comp rx=0 tx=0).stop 2024-09-13T22:55:37.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.266+0000 7f10626d4700 1 -- 172.21.15.2:0/3336304572 shutdown_connections 2024-09-13T22:55:37.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.266+0000 7f10626d4700 1 --2- 172.21.15.2:0/3336304572 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f105c101eb0 0x7f105c102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:37.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.266+0000 7f10626d4700 1 --2- 172.21.15.2:0/3336304572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f105c100cb0 0x7f105c1010d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:37.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.266+0000 7f10626d4700 1 -- 172.21.15.2:0/3336304572 >> 172.21.15.2:0/3336304572 conn(0x7f105c0fc230 msgr2=0x7f105c0fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:37.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.266+0000 7f10626d4700 1 -- 172.21.15.2:0/3336304572 shutdown_connections 2024-09-13T22:55:37.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.266+0000 7f10626d4700 1 -- 172.21.15.2:0/3336304572 wait complete. 2024-09-13T22:55:37.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.267+0000 7f10626d4700 1 Processor -- start 2024-09-13T22:55:37.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.267+0000 7f10626d4700 1 -- start start 2024-09-13T22:55:37.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.267+0000 7f10626d4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f105c100cb0 0x7f105c1964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:37.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.267+0000 7f10626d4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f105c101eb0 0x7f105c196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:37.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.267+0000 7f10626d4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c197050 con 0x7f105c101eb0 2024-09-13T22:55:37.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.267+0000 7f10626d4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c197190 con 0x7f105c100cb0 2024-09-13T22:55:37.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.267+0000 7f105b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f105c101eb0 0x7f105c196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:37.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.267+0000 7f105b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f105c101eb0 0x7f105c196a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47790/0 (socket says 172.21.15.2:47790) 2024-09-13T22:55:37.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.267+0000 7f105b7fe700 1 -- 172.21.15.2:0/3196202836 learned_addr learned my addr 172.21.15.2:0/3196202836 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:55:37.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.267+0000 7f105bfff700 1 --2- 172.21.15.2:0/3196202836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f105c100cb0 0x7f105c1964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:37.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.267+0000 7f105b7fe700 1 -- 172.21.15.2:0/3196202836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f105c100cb0 msgr2=0x7f105c1964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:37.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.267+0000 7f105b7fe700 1 --2- 172.21.15.2:0/3196202836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f105c100cb0 0x7f105c1964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:37.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.268+0000 7f105b7fe700 1 -- 172.21.15.2:0/3196202836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104c0095f0 con 0x7f105c101eb0 2024-09-13T22:55:37.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.268+0000 7f105bfff700 1 --2- 172.21.15.2:0/3196202836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f105c100cb0 0x7f105c1964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T22:55:37.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.268+0000 7f105b7fe700 1 --2- 172.21.15.2:0/3196202836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f105c101eb0 0x7f105c196a30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f105000e920 tx=0x7f105000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:37.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.268+0000 7f10597fa700 1 -- 172.21.15.2:0/3196202836 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f105000c9d0 con 0x7f105c101eb0 2024-09-13T22:55:37.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.268+0000 7f10626d4700 1 -- 172.21.15.2:0/3196202836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105c19bc40 con 0x7f105c101eb0 2024-09-13T22:55:37.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.268+0000 7f10597fa700 1 -- 172.21.15.2:0/3196202836 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1050010430 con 0x7f105c101eb0 2024-09-13T22:55:37.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.268+0000 7f10597fa700 1 -- 172.21.15.2:0/3196202836 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1050018650 con 0x7f105c101eb0 2024-09-13T22:55:37.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.268+0000 7f10626d4700 1 -- 172.21.15.2:0/3196202836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105c19c190 con 0x7f105c101eb0 2024-09-13T22:55:37.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.269+0000 7f10626d4700 1 -- 172.21.15.2:0/3196202836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105c109810 con 0x7f105c101eb0 2024-09-13T22:55:37.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.270+0000 7f10597fa700 1 -- 172.21.15.2:0/3196202836 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 20) v1 ==== 91356+0+0 (secure 0 0 0) 0x7f10500105a0 con 0x7f105c101eb0 2024-09-13T22:55:37.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.270+0000 7f10597fa700 1 --2- 172.21.15.2:0/3196202836 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f104406d3f0 0x7f104406f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:55:37.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.270+0000 7f10597fa700 1 -- 172.21.15.2:0/3196202836 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f1050014070 con 0x7f105c101eb0 2024-09-13T22:55:37.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.270+0000 7f105bfff700 1 --2- 172.21.15.2:0/3196202836 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f104406d3f0 0x7f104406f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:55:37.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.271+0000 7f105bfff700 1 --2- 172.21.15.2:0/3196202836 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f104406d3f0 0x7f104406f8b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f104c00b6f0 tx=0x7f104c005940 comp rx=0 tx=0).ready entity=mgr.14211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:55:37.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.275+0000 7f10597fa700 1 -- 172.21.15.2:0/3196202836 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f10500520e0 con 0x7f105c101eb0 2024-09-13T22:55:37.385 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:36 smithi047 ceph-mon[34560]: pgmap v254: 65 pgs: 65 active+clean; 145 MiB data, 669 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 197 op/s 2024-09-13T22:55:37.385 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:36 smithi047 ceph-mon[34560]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.545+0000 7f10626d4700 1 -- 172.21.15.2:0/3196202836 --> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f105c19c860 con 0x7f104406d3f0 2024-09-13T22:55:37.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.546+0000 7f10597fa700 1 -- 172.21.15.2:0/3196202836 <== mgr.14211 v2:172.21.15.2:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f105c19c860 con 0x7f104406d3f0 2024-09-13T22:55:37.548 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:55:37.548 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:55:37.548 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T22:55:37.548 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T22:55:37.548 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [], 2024-09-13T22:55:37.548 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "", 2024-09-13T22:55:37.549 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T22:55:37.549 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T22:55:37.549 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:55:37.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.549+0000 7f10626d4700 1 -- 172.21.15.2:0/3196202836 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f104406d3f0 msgr2=0x7f104406f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:37.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.549+0000 7f10626d4700 1 --2- 172.21.15.2:0/3196202836 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f104406d3f0 0x7f104406f8b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f104c00b6f0 tx=0x7f104c005940 comp rx=0 tx=0).stop 2024-09-13T22:55:37.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.549+0000 7f10626d4700 1 -- 172.21.15.2:0/3196202836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f105c101eb0 msgr2=0x7f105c196a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:55:37.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.549+0000 7f10626d4700 1 --2- 172.21.15.2:0/3196202836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f105c101eb0 0x7f105c196a30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f105000e920 tx=0x7f105000ec30 comp rx=0 tx=0).stop 2024-09-13T22:55:37.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.549+0000 7f10626d4700 1 -- 172.21.15.2:0/3196202836 shutdown_connections 2024-09-13T22:55:37.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.549+0000 7f10626d4700 1 --2- 172.21.15.2:0/3196202836 >> [v2:172.21.15.2:6800/2,v1:172.21.15.2:6801/2] conn(0x7f104406d3f0 0x7f104406f8b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:37.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.549+0000 7f10626d4700 1 --2- 172.21.15.2:0/3196202836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f105c100cb0 0x7f105c1964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:37.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.549+0000 7f10626d4700 1 --2- 172.21.15.2:0/3196202836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f105c101eb0 0x7f105c196a30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:55:37.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.549+0000 7f10626d4700 1 -- 172.21.15.2:0/3196202836 >> 172.21.15.2:0/3196202836 conn(0x7f105c0fc230 msgr2=0x7f105c1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:55:37.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.549+0000 7f10626d4700 1 -- 172.21.15.2:0/3196202836 shutdown_connections 2024-09-13T22:55:37.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:55:37.549+0000 7f10626d4700 1 -- 172.21.15.2:0/3196202836 wait complete. 2024-09-13T22:55:38.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:37 smithi047 ceph-mon[34560]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:38.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:37 smithi047 ceph-mon[34560]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:38.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:37 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/720277335' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:55:38.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:37 smithi002 ceph-mon[27637]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:38.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:37 smithi002 ceph-mon[27637]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:38.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:37 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/720277335' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:55:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:38 smithi002 ceph-mon[27637]: pgmap v255: 65 pgs: 65 active+clean; 159 MiB data, 715 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 261 op/s 2024-09-13T22:55:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:38 smithi002 ceph-mon[27637]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:38 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:38 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:39.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:38 smithi047 ceph-mon[34560]: pgmap v255: 65 pgs: 65 active+clean; 159 MiB data, 715 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 261 op/s 2024-09-13T22:55:39.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:38 smithi047 ceph-mon[34560]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:55:39.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:38 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:39.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:38 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:40.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:40 smithi047 ceph-mon[34560]: pgmap v256: 65 pgs: 65 active+clean; 162 MiB data, 749 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 288 op/s 2024-09-13T22:55:40.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:40 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:40.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:40 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:40.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:40 smithi002 ceph-mon[27637]: pgmap v256: 65 pgs: 65 active+clean; 162 MiB data, 749 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 288 op/s 2024-09-13T22:55:40.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:40 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:40.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:40 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:43.199 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:42 smithi047 ceph-mon[34560]: pgmap v257: 65 pgs: 65 active+clean; 167 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 285 op/s 2024-09-13T22:55:43.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:42 smithi002 ceph-mon[27637]: pgmap v257: 65 pgs: 65 active+clean; 167 MiB data, 747 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 285 op/s 2024-09-13T22:55:45.049 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:44 smithi047 ceph-mon[34560]: pgmap v258: 65 pgs: 65 active+clean; 181 MiB data, 773 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 382 op/s 2024-09-13T22:55:45.049 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:45.049 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:45.049 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:55:45.049 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:55:45.049 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:44 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:45.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:44 smithi002 ceph-mon[27637]: pgmap v258: 65 pgs: 65 active+clean; 181 MiB data, 773 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 382 op/s 2024-09-13T22:55:45.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:44 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:45.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:44 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:45.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:44 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:55:45.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:44 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:55:45.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:44 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' 2024-09-13T22:55:45.942 INFO:tasks.workunit.client.1.smithi047.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T22:55:45.949 INFO:tasks.workunit.client.1.smithi047.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T22:55:45.950 INFO:tasks.workunit.client.1.smithi047.stderr:+ make 2024-09-13T22:55:46.122 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:55:46.123 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr fail", "who": "smithi002.yumtzz"}]: dispatch 2024-09-13T22:55:46.123 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T22:55:46.123 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "mgr fail", "who": "smithi002.yumtzz"}]': finished 2024-09-13T22:55:46.123 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: mgrmap e21: smithi047.gcymvd(active, starting, since 0.00830913s) 2024-09-13T22:55:46.123 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T22:55:46.123 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:55:46.123 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.gglyyr"}]: dispatch 2024-09-13T22:55:46.123 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.auedll"}]: dispatch 2024-09-13T22:55:46.123 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.gxzkha"}]: dispatch 2024-09-13T22:55:46.123 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.nqvveh"}]: dispatch 2024-09-13T22:55:46.123 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mgr metadata", "who": "smithi047.gcymvd", "id": "smithi047.gcymvd"}]: dispatch 2024-09-13T22:55:46.123 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:55:46.124 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:55:46.124 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:55:46.124 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:55:46.124 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:55:46.124 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:55:46.124 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:55:46.124 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:55:46.124 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:55:46.124 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: Manager daemon smithi047.gcymvd is now available 2024-09-13T22:55:46.124 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: Migrating agent root cert to cert store 2024-09-13T22:55:46.124 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:46.124 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: Migrating agent root key to cert store 2024-09-13T22:55:46.124 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:46.125 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: Checking for cert/key for grafana.smithi002 2024-09-13T22:55:46.125 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: Migrating grafana.smithi002 cert to cert store 2024-09-13T22:55:46.125 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:46.125 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: Migrating grafana.smithi002 key to cert store 2024-09-13T22:55:46.125 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:46.125 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:46.125 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:55:46.125 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:55:46.125 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.gcymvd/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:55:46.125 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.gcymvd/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:55:46.125 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.gcymvd/trash_purge_schedule"}]: dispatch 2024-09-13T22:55:46.125 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:45 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.gcymvd/trash_purge_schedule"}]: dispatch 2024-09-13T22:55:46.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:55:46.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr fail", "who": "smithi002.yumtzz"}]: dispatch 2024-09-13T22:55:46.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T22:55:46.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14211 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "mgr fail", "who": "smithi002.yumtzz"}]': finished 2024-09-13T22:55:46.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: mgrmap e21: smithi047.gcymvd(active, starting, since 0.00830913s) 2024-09-13T22:55:46.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T22:55:46.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:55:46.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.gglyyr"}]: dispatch 2024-09-13T22:55:46.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.auedll"}]: dispatch 2024-09-13T22:55:46.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.gxzkha"}]: dispatch 2024-09-13T22:55:46.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.nqvveh"}]: dispatch 2024-09-13T22:55:46.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mgr metadata", "who": "smithi047.gcymvd", "id": "smithi047.gcymvd"}]: dispatch 2024-09-13T22:55:46.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:55:46.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:55:46.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:55:46.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:55:46.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:55:46.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:55:46.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:55:46.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:55:46.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:55:46.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: Manager daemon smithi047.gcymvd is now available 2024-09-13T22:55:46.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: Migrating agent root cert to cert store 2024-09-13T22:55:46.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:46.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: Migrating agent root key to cert store 2024-09-13T22:55:46.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:46.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: Checking for cert/key for grafana.smithi002 2024-09-13T22:55:46.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: Migrating grafana.smithi002 cert to cert store 2024-09-13T22:55:46.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:46.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: Migrating grafana.smithi002 key to cert store 2024-09-13T22:55:46.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:46.167 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:46.167 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:55:46.167 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:55:46.167 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.gcymvd/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:55:46.167 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.gcymvd/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:55:46.167 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.gcymvd/trash_purge_schedule"}]: dispatch 2024-09-13T22:55:46.167 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:45 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi047.gcymvd/trash_purge_schedule"}]: dispatch 2024-09-13T22:55:46.364 INFO:tasks.workunit.client.1.smithi047.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T22:55:46.825 INFO:tasks.workunit.client.1.smithi047.stderr:++ readlink -f fsstress 2024-09-13T22:55:46.827 INFO:tasks.workunit.client.1.smithi047.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T22:55:46.827 INFO:tasks.workunit.client.1.smithi047.stderr:+ popd 2024-09-13T22:55:46.828 INFO:tasks.workunit.client.1.smithi047.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T22:55:46.829 INFO:tasks.workunit.client.1.smithi047.stderr:+ popd 2024-09-13T22:55:46.829 INFO:tasks.workunit.client.1.smithi047.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-13T22:55:46.829 INFO:tasks.workunit.client.1.smithi047.stderr:++ mktemp -d -p . 2024-09-13T22:55:46.832 INFO:tasks.workunit.client.1.smithi047.stderr:+ T=./tmp.hzKCkHtREU 2024-09-13T22:55:46.832 INFO:tasks.workunit.client.1.smithi047.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.hzKCkHtREU -l 1 -n 1000 -p 10 -v 2024-09-13T22:55:46.837 INFO:tasks.workunit.client.1.smithi047.stdout:seed = 1726481843 2024-09-13T22:55:46.842 INFO:tasks.workunit.client.1.smithi047.stdout:0/0: chown . 952713125 1 2024-09-13T22:55:46.842 INFO:tasks.workunit.client.1.smithi047.stdout:0/1: fdatasync - no filename 2024-09-13T22:55:46.844 INFO:tasks.workunit.client.1.smithi047.stdout:1/0: truncate - no filename 2024-09-13T22:55:46.844 INFO:tasks.workunit.client.1.smithi047.stdout:1/1: readlink - no filename 2024-09-13T22:55:46.844 INFO:tasks.workunit.client.1.smithi047.stdout:1/2: dwrite - no filename 2024-09-13T22:55:46.845 INFO:tasks.workunit.client.1.smithi047.stdout:1/3: chown . 116859099 1 2024-09-13T22:55:46.845 INFO:tasks.workunit.client.1.smithi047.stdout:1/4: dread - no filename 2024-09-13T22:55:46.847 INFO:tasks.workunit.client.1.smithi047.stdout:1/5: mkdir d0 0 2024-09-13T22:55:46.848 INFO:tasks.workunit.client.1.smithi047.stdout:1/6: stat d0 0 2024-09-13T22:55:46.848 INFO:tasks.workunit.client.1.smithi047.stdout:1/7: dread - no filename 2024-09-13T22:55:46.848 INFO:tasks.workunit.client.1.smithi047.stdout:1/8: write - no filename 2024-09-13T22:55:46.848 INFO:tasks.workunit.client.1.smithi047.stdout:1/9: truncate - no filename 2024-09-13T22:55:46.851 INFO:tasks.workunit.client.1.smithi047.stdout:2/0: creat f0 x:0 0 0 2024-09-13T22:55:46.852 INFO:tasks.workunit.client.1.smithi047.stdout:4/0: dwrite - no filename 2024-09-13T22:55:46.852 INFO:tasks.workunit.client.1.smithi047.stdout:4/1: stat - no entries 2024-09-13T22:55:46.852 INFO:tasks.workunit.client.1.smithi047.stdout:4/2: dwrite - no filename 2024-09-13T22:55:46.853 INFO:tasks.workunit.client.1.smithi047.stdout:4/3: fsync - no filename 2024-09-13T22:55:46.853 INFO:tasks.workunit.client.1.smithi047.stdout:4/4: chown . 16702666 1 2024-09-13T22:55:46.853 INFO:tasks.workunit.client.1.smithi047.stdout:4/5: read - no filename 2024-09-13T22:55:46.853 INFO:tasks.workunit.client.1.smithi047.stdout:4/6: write - no filename 2024-09-13T22:55:46.854 INFO:tasks.workunit.client.1.smithi047.stdout:1/10: creat d0/f1 x:0 0 0 2024-09-13T22:55:46.854 INFO:tasks.workunit.client.1.smithi047.stdout:1/11: write d0/f1 [713297,119013] 0 2024-09-13T22:55:46.856 INFO:tasks.workunit.client.1.smithi047.stdout:2/1: mkdir d1 0 2024-09-13T22:55:46.856 INFO:tasks.workunit.client.1.smithi047.stdout:1/12: chown d0/f1 218095 1 2024-09-13T22:55:46.856 INFO:tasks.workunit.client.1.smithi047.stdout:2/2: stat d1 0 2024-09-13T22:55:46.857 INFO:tasks.workunit.client.1.smithi047.stdout:2/3: truncate f0 278155 0 2024-09-13T22:55:46.858 INFO:tasks.workunit.client.1.smithi047.stdout:5/0: write - no filename 2024-09-13T22:55:46.858 INFO:tasks.workunit.client.1.smithi047.stdout:2/4: rename d1 to d1/d2 22 2024-09-13T22:55:46.859 INFO:tasks.workunit.client.1.smithi047.stdout:3/0: mkdir d0 0 2024-09-13T22:55:46.861 INFO:tasks.workunit.client.1.smithi047.stdout:4/7: creat f0 x:0 0 0 2024-09-13T22:55:46.861 INFO:tasks.workunit.client.1.smithi047.stdout:1/13: creat d0/f2 x:0 0 0 2024-09-13T22:55:46.862 INFO:tasks.workunit.client.1.smithi047.stdout:6/0: dwrite - no filename 2024-09-13T22:55:46.862 INFO:tasks.workunit.client.1.smithi047.stdout:6/1: dread - no filename 2024-09-13T22:55:46.862 INFO:tasks.workunit.client.1.smithi047.stdout:1/14: fdatasync d0/f1 0 2024-09-13T22:55:46.863 INFO:tasks.workunit.client.1.smithi047.stdout:1/15: readlink - no filename 2024-09-13T22:55:46.864 INFO:tasks.workunit.client.1.smithi047.stdout:4/8: creat f1 x:0 0 0 2024-09-13T22:55:46.865 INFO:tasks.workunit.client.1.smithi047.stdout:5/1: symlink l0 0 2024-09-13T22:55:46.865 INFO:tasks.workunit.client.1.smithi047.stdout:2/5: creat d1/f3 x:0 0 0 2024-09-13T22:55:46.866 INFO:tasks.workunit.client.1.smithi047.stdout:4/9: dread - f1 zero size 2024-09-13T22:55:46.866 INFO:tasks.workunit.client.1.smithi047.stdout:4/10: rmdir - no directory 2024-09-13T22:55:46.866 INFO:tasks.workunit.client.1.smithi047.stdout:5/2: chown l0 3 1 2024-09-13T22:55:46.866 INFO:tasks.workunit.client.1.smithi047.stdout:4/11: truncate f1 1027334 0 2024-09-13T22:55:46.868 INFO:tasks.workunit.client.1.smithi047.stdout:3/1: creat d0/f1 x:0 0 0 2024-09-13T22:55:46.871 INFO:tasks.workunit.client.1.smithi047.stdout:1/16: creat d0/f3 x:0 0 0 2024-09-13T22:55:46.873 INFO:tasks.workunit.client.1.smithi047.stdout:2/6: mknod d1/c4 0 2024-09-13T22:55:46.875 INFO:tasks.workunit.client.1.smithi047.stdout:4/12: rename f0 to f2 0 2024-09-13T22:55:46.876 INFO:tasks.workunit.client.1.smithi047.stdout:5/3: mknod c1 0 2024-09-13T22:55:46.876 INFO:tasks.workunit.client.1.smithi047.stdout:5/4: dwrite - no filename 2024-09-13T22:55:46.880 INFO:tasks.workunit.client.1.smithi047.stdout:4/13: chown f2 230 1 2024-09-13T22:55:46.880 INFO:tasks.workunit.client.1.smithi047.stdout:6/2: creat f0 x:0 0 0 2024-09-13T22:55:46.882 INFO:tasks.workunit.client.1.smithi047.stdout:6/3: dread - f0 zero size 2024-09-13T22:55:46.885 INFO:tasks.workunit.client.1.smithi047.stdout:3/2: dwrite d0/f1 [0,4194304] 0 2024-09-13T22:55:46.885 INFO:tasks.workunit.client.1.smithi047.stdout:8/0: chown . 18189 1 2024-09-13T22:55:46.885 INFO:tasks.workunit.client.1.smithi047.stdout:8/1: dread - no filename 2024-09-13T22:55:46.885 INFO:tasks.workunit.client.1.smithi047.stdout:8/2: truncate - no filename 2024-09-13T22:55:46.886 INFO:tasks.workunit.client.1.smithi047.stdout:8/3: stat - no entries 2024-09-13T22:55:46.886 INFO:tasks.workunit.client.1.smithi047.stdout:8/4: stat - no entries 2024-09-13T22:55:46.886 INFO:tasks.workunit.client.1.smithi047.stdout:6/4: write f0 [139029,97571] 0 2024-09-13T22:55:46.887 INFO:tasks.workunit.client.1.smithi047.stdout:5/5: rename c1 to c2 0 2024-09-13T22:55:46.887 INFO:tasks.workunit.client.1.smithi047.stdout:7/0: mkdir d0 0 2024-09-13T22:55:46.890 INFO:tasks.workunit.client.1.smithi047.stdout:2/7: rename d1/c4 to d1/c5 0 2024-09-13T22:55:46.898 INFO:tasks.workunit.client.1.smithi047.stdout:6/5: creat f1 x:0 0 0 2024-09-13T22:55:46.898 INFO:tasks.workunit.client.1.smithi047.stdout:9/0: rename - no filename 2024-09-13T22:55:46.899 INFO:tasks.workunit.client.1.smithi047.stdout:2/8: creat d1/f6 x:0 0 0 2024-09-13T22:55:46.899 INFO:tasks.workunit.client.1.smithi047.stdout:2/9: readlink - no filename 2024-09-13T22:55:46.899 INFO:tasks.workunit.client.1.smithi047.stdout:2/10: readlink - no filename 2024-09-13T22:55:46.900 INFO:tasks.workunit.client.1.smithi047.stdout:1/17: dwrite d0/f1 [0,4194304] 0 2024-09-13T22:55:46.900 INFO:tasks.workunit.client.1.smithi047.stdout:5/6: symlink l3 0 2024-09-13T22:55:46.900 INFO:tasks.workunit.client.1.smithi047.stdout:5/7: truncate - no filename 2024-09-13T22:55:46.901 INFO:tasks.workunit.client.1.smithi047.stdout:5/8: dwrite - no filename 2024-09-13T22:55:46.904 INFO:tasks.workunit.client.1.smithi047.stdout:8/5: creat f0 x:0 0 0 2024-09-13T22:55:46.905 INFO:tasks.workunit.client.1.smithi047.stdout:2/11: unlink f0 0 2024-09-13T22:55:46.907 INFO:tasks.workunit.client.1.smithi047.stdout:8/6: truncate f0 689888 0 2024-09-13T22:55:46.909 INFO:tasks.workunit.client.1.smithi047.stdout:2/12: read - d1/f3 zero size 2024-09-13T22:55:46.911 INFO:tasks.workunit.client.1.smithi047.stdout:7/1: creat d0/f1 x:0 0 0 2024-09-13T22:55:46.914 INFO:tasks.workunit.client.1.smithi047.stdout:3/3: dwrite d0/f1 [0,4194304] 0 2024-09-13T22:55:46.914 INFO:tasks.workunit.client.1.smithi047.stdout:1/18: unlink d0/f3 0 2024-09-13T22:55:46.918 INFO:tasks.workunit.client.1.smithi047.stdout:9/1: getdents . 0 2024-09-13T22:55:46.920 INFO:tasks.workunit.client.1.smithi047.stdout:6/6: dwrite f1 [0,4194304] 0 2024-09-13T22:55:46.921 INFO:tasks.workunit.client.1.smithi047.stdout:7/2: creat d0/f2 x:0 0 0 2024-09-13T22:55:46.926 INFO:tasks.workunit.client.1.smithi047.stdout:3/4: mknod d0/c2 0 2024-09-13T22:55:46.935 INFO:tasks.workunit.client.1.smithi047.stdout:8/7: link f0 f1 0 2024-09-13T22:55:46.936 INFO:tasks.workunit.client.1.smithi047.stdout:6/7: symlink l2 0 2024-09-13T22:55:46.939 INFO:tasks.workunit.client.1.smithi047.stdout:7/3: mknod d0/c3 0 2024-09-13T22:55:46.941 INFO:tasks.workunit.client.1.smithi047.stdout:2/13: link d1/f3 d1/f7 0 2024-09-13T22:55:46.942 INFO:tasks.workunit.client.1.smithi047.stdout:2/14: chown d1/f3 250 1 2024-09-13T22:55:46.943 INFO:tasks.workunit.client.1.smithi047.stdout:3/5: mkdir d0/d3 0 2024-09-13T22:55:46.944 INFO:tasks.workunit.client.1.smithi047.stdout:3/6: truncate d0/f1 4485725 0 2024-09-13T22:55:46.947 INFO:tasks.workunit.client.1.smithi047.stdout:8/8: creat f2 x:0 0 0 2024-09-13T22:55:46.948 INFO:tasks.workunit.client.1.smithi047.stdout:6/8: mkdir d3 0 2024-09-13T22:55:46.949 INFO:tasks.workunit.client.1.smithi047.stdout:6/9: write f0 [767907,127558] 0 2024-09-13T22:55:46.951 INFO:tasks.workunit.client.1.smithi047.stdout:7/4: mkdir d0/d4 0 2024-09-13T22:55:46.954 INFO:tasks.workunit.client.1.smithi047.stdout:2/15: creat d1/f8 x:0 0 0 2024-09-13T22:55:46.956 INFO:tasks.workunit.client.1.smithi047.stdout:8/9: creat f3 x:0 0 0 2024-09-13T22:55:46.960 INFO:tasks.workunit.client.1.smithi047.stdout:6/10: rename f0 to d3/f4 0 2024-09-13T22:55:46.962 INFO:tasks.workunit.client.1.smithi047.stdout:7/5: rename d0/f1 to d0/f5 0 2024-09-13T22:55:46.965 INFO:tasks.workunit.client.1.smithi047.stdout:8/10: dwrite f2 [0,4194304] 0 2024-09-13T22:55:46.966 INFO:tasks.workunit.client.1.smithi047.stdout:8/11: dread - f3 zero size 2024-09-13T22:55:46.968 INFO:tasks.workunit.client.1.smithi047.stdout:8/12: dread f1 [0,4194304] 0 2024-09-13T22:55:46.968 INFO:tasks.workunit.client.1.smithi047.stdout:8/13: chown f0 2083111 1 2024-09-13T22:55:46.978 INFO:tasks.workunit.client.1.smithi047.stdout:8/14: creat f4 x:0 0 0 2024-09-13T22:55:46.988 INFO:tasks.workunit.client.1.smithi047.stdout:8/15: dwrite f4 [0,4194304] 0 2024-09-13T22:55:46.993 INFO:tasks.workunit.client.1.smithi047.stdout:8/16: rename f2 to f5 0 2024-09-13T22:55:46.996 INFO:tasks.workunit.client.1.smithi047.stdout:8/17: creat f6 x:0 0 0 2024-09-13T22:55:46.999 INFO:tasks.workunit.client.1.smithi047.stdout:8/18: mknod c7 0 2024-09-13T22:55:47.002 INFO:tasks.workunit.client.1.smithi047.stdout:8/19: mkdir d8 0 2024-09-13T22:55:47.004 INFO:tasks.workunit.client.1.smithi047.stdout:8/20: creat d8/f9 x:0 0 0 2024-09-13T22:55:47.005 INFO:tasks.workunit.client.1.smithi047.stdout:8/21: read f1 [261787,57674] 0 2024-09-13T22:55:47.007 INFO:tasks.workunit.client.1.smithi047.stdout:8/22: rename c7 to d8/ca 0 2024-09-13T22:55:47.016 INFO:tasks.workunit.client.1.smithi047.stdout:8/23: dwrite f5 [0,4194304] 0 2024-09-13T22:55:47.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:47 smithi002 ceph-mon[27637]: mgrmap e22: smithi047.gcymvd(active, since 1.00973s) 2024-09-13T22:55:47.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:47 smithi002 ceph-mon[27637]: pgmap v3: 65 pgs: 65 active+clean; 201 MiB data, 797 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:55:47.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:47 smithi002 ceph-mon[27637]: Deploying cephadm binary to smithi002 2024-09-13T22:55:47.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:47 smithi002 ceph-mon[27637]: Deploying cephadm binary to smithi047 2024-09-13T22:55:47.294 INFO:tasks.workunit.client.1.smithi047.stdout:4/14: getdents . 0 2024-09-13T22:55:47.295 INFO:tasks.workunit.client.1.smithi047.stdout:4/15: write f1 [809570,66929] 0 2024-09-13T22:55:47.325 INFO:tasks.workunit.client.1.smithi047.stdout:1/19: write d0/f1 [4211606,15469] 0 2024-09-13T22:55:47.344 INFO:tasks.workunit.client.1.smithi047.stdout:2/16: getdents d1 0 2024-09-13T22:55:47.348 INFO:tasks.workunit.client.1.smithi047.stdout:6/11: unlink d3/f4 0 2024-09-13T22:55:47.351 INFO:tasks.workunit.client.1.smithi047.stdout:6/12: dread f1 [0,4194304] 0 2024-09-13T22:55:47.352 INFO:tasks.workunit.client.1.smithi047.stdout:6/13: write f1 [1565191,27601] 0 2024-09-13T22:55:47.353 INFO:tasks.workunit.client.1.smithi047.stdout:3/7: truncate d0/f1 1293887 0 2024-09-13T22:55:47.375 INFO:tasks.workunit.client.1.smithi047.stdout:8/24: getdents d8 0 2024-09-13T22:55:47.376 INFO:tasks.workunit.client.1.smithi047.stdout:8/25: write f6 [848317,107713] 0 2024-09-13T22:55:47.377 INFO:tasks.workunit.client.1.smithi047.stdout:8/26: chown d8/ca 0 1 2024-09-13T22:55:47.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:47 smithi047 ceph-mon[34560]: mgrmap e22: smithi047.gcymvd(active, since 1.00973s) 2024-09-13T22:55:47.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:47 smithi047 ceph-mon[34560]: pgmap v3: 65 pgs: 65 active+clean; 201 MiB data, 797 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:55:47.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:47 smithi047 ceph-mon[34560]: Deploying cephadm binary to smithi002 2024-09-13T22:55:47.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:47 smithi047 ceph-mon[34560]: Deploying cephadm binary to smithi047 2024-09-13T22:55:47.532 INFO:tasks.workunit.client.1.smithi047.stdout:4/16: mknod c3 0 2024-09-13T22:55:47.534 INFO:tasks.workunit.client.1.smithi047.stdout:2/17: unlink d1/f6 0 2024-09-13T22:55:47.536 INFO:tasks.workunit.client.1.smithi047.stdout:4/17: dread f1 [0,4194304] 0 2024-09-13T22:55:47.537 INFO:tasks.workunit.client.1.smithi047.stdout:4/18: chown f2 4107 1 2024-09-13T22:55:47.538 INFO:tasks.workunit.client.1.smithi047.stdout:4/19: chown f1 166361241 1 2024-09-13T22:55:47.546 INFO:tasks.workunit.client.1.smithi047.stdout:2/18: creat d1/f9 x:0 0 0 2024-09-13T22:55:47.557 INFO:tasks.workunit.client.1.smithi047.stdout:2/19: rename d1/f9 to d1/fa 0 2024-09-13T22:55:47.558 INFO:tasks.workunit.client.1.smithi047.stdout:2/20: chown d1/c5 0 1 2024-09-13T22:55:47.848 INFO:tasks.workunit.client.1.smithi047.stdout:8/27: write f1 [260380,33647] 0 2024-09-13T22:55:47.850 INFO:tasks.workunit.client.1.smithi047.stdout:8/28: write f3 [737834,61334] 0 2024-09-13T22:55:47.852 INFO:tasks.workunit.client.1.smithi047.stdout:8/29: mknod d8/cb 0 2024-09-13T22:55:47.855 INFO:tasks.workunit.client.1.smithi047.stdout:8/30: creat d8/fc x:0 0 0 2024-09-13T22:55:47.858 INFO:tasks.workunit.client.1.smithi047.stdout:6/14: truncate f1 1254793 0 2024-09-13T22:55:47.862 INFO:tasks.workunit.client.1.smithi047.stdout:6/15: symlink d3/l5 0 2024-09-13T22:55:47.865 INFO:tasks.workunit.client.1.smithi047.stdout:6/16: creat d3/f6 x:0 0 0 2024-09-13T22:55:47.871 INFO:tasks.workunit.client.1.smithi047.stdout:2/21: write d1/f3 [533039,80860] 0 2024-09-13T22:55:47.875 INFO:tasks.workunit.client.1.smithi047.stdout:2/22: creat d1/fb x:0 0 0 2024-09-13T22:55:47.876 INFO:tasks.workunit.client.1.smithi047.stdout:2/23: write d1/f8 [557839,117342] 0 2024-09-13T22:55:47.879 INFO:tasks.workunit.client.1.smithi047.stdout:2/24: creat d1/fc x:0 0 0 2024-09-13T22:55:47.881 INFO:tasks.workunit.client.1.smithi047.stdout:2/25: mkdir d1/dd 0 2024-09-13T22:55:47.885 INFO:tasks.workunit.client.1.smithi047.stdout:2/26: rename d1/dd to d1/de 0 2024-09-13T22:55:47.888 INFO:tasks.workunit.client.1.smithi047.stdout:2/27: mkdir d1/df 0 2024-09-13T22:55:47.945 INFO:tasks.workunit.client.1.smithi047.stdout:3/8: write d0/f1 [404804,79255] 0 2024-09-13T22:55:47.946 INFO:tasks.workunit.client.1.smithi047.stdout:3/9: readlink - no filename 2024-09-13T22:55:47.946 INFO:tasks.workunit.client.1.smithi047.stdout:3/10: read d0/f1 [1080395,93920] 0 2024-09-13T22:55:47.950 INFO:tasks.workunit.client.1.smithi047.stdout:3/11: rmdir d0 39 2024-09-13T22:55:47.962 INFO:tasks.workunit.client.1.smithi047.stdout:3/12: dwrite d0/f1 [0,4194304] 0 2024-09-13T22:55:47.966 INFO:tasks.workunit.client.1.smithi047.stdout:3/13: mkdir d0/d3/d4 0 2024-09-13T22:55:47.971 INFO:tasks.workunit.client.1.smithi047.stdout:3/14: rename d0/c2 to d0/d3/d4/c5 0 2024-09-13T22:55:47.979 INFO:tasks.workunit.client.1.smithi047.stdout:3/15: dwrite d0/f1 [0,4194304] 0 2024-09-13T22:55:47.980 INFO:tasks.workunit.client.1.smithi047.stdout:3/16: stat d0 0 2024-09-13T22:55:48.005 INFO:tasks.workunit.client.1.smithi047.stdout:8/31: getdents d8 0 2024-09-13T22:55:48.009 INFO:tasks.workunit.client.1.smithi047.stdout:8/32: mkdir d8/dd 0 2024-09-13T22:55:48.010 INFO:tasks.workunit.client.1.smithi047.stdout:6/17: dread f1 [0,4194304] 0 2024-09-13T22:55:48.014 INFO:tasks.workunit.client.1.smithi047.stdout:6/18: creat d3/f7 x:0 0 0 2024-09-13T22:55:48.014 INFO:tasks.workunit.client.1.smithi047.stdout:6/19: chown d3/f6 4808 1 2024-09-13T22:55:48.018 INFO:tasks.workunit.client.1.smithi047.stdout:6/20: creat d3/f8 x:0 0 0 2024-09-13T22:55:48.019 INFO:tasks.workunit.client.1.smithi047.stdout:8/33: rmdir d8/dd 0 2024-09-13T22:55:48.021 INFO:tasks.workunit.client.1.smithi047.stdout:8/34: write d8/fc [678620,84534] 0 2024-09-13T22:55:48.021 INFO:tasks.workunit.client.1.smithi047.stdout:8/35: chown d8/fc 6 1 2024-09-13T22:55:48.022 INFO:tasks.workunit.client.1.smithi047.stdout:8/36: truncate f0 798875 0 2024-09-13T22:55:48.025 INFO:tasks.workunit.client.1.smithi047.stdout:6/21: fdatasync f1 0 2024-09-13T22:55:48.026 INFO:tasks.workunit.client.1.smithi047.stdout:6/22: read - d3/f8 zero size 2024-09-13T22:55:48.030 INFO:tasks.workunit.client.1.smithi047.stdout:2/28: rmdir d1 39 2024-09-13T22:55:48.033 INFO:tasks.workunit.client.1.smithi047.stdout:6/23: dwrite d3/f7 [0,4194304] 0 2024-09-13T22:55:48.040 INFO:tasks.workunit.client.1.smithi047.stdout:6/24: creat d3/f9 x:0 0 0 2024-09-13T22:55:48.042 INFO:tasks.workunit.client.1.smithi047.stdout:2/29: creat d1/f10 x:0 0 0 2024-09-13T22:55:48.043 INFO:tasks.workunit.client.1.smithi047.stdout:2/30: chown d1/fa 211655444 1 2024-09-13T22:55:48.045 INFO:tasks.workunit.client.1.smithi047.stdout:6/25: symlink d3/la 0 2024-09-13T22:55:48.047 INFO:tasks.workunit.client.1.smithi047.stdout:2/31: creat d1/f11 x:0 0 0 2024-09-13T22:55:48.048 INFO:tasks.workunit.client.1.smithi047.stdout:2/32: dread - d1/f11 zero size 2024-09-13T22:55:48.048 INFO:tasks.workunit.client.1.smithi047.stdout:2/33: chown d1/fb 33418754 1 2024-09-13T22:55:48.051 INFO:tasks.workunit.client.1.smithi047.stdout:6/26: link d3/f6 d3/fb 0 2024-09-13T22:55:48.051 INFO:tasks.workunit.client.1.smithi047.stdout:6/27: chown d3/f6 1076871 1 2024-09-13T22:55:48.052 INFO:tasks.workunit.client.1.smithi047.stdout:2/34: creat d1/de/f12 x:0 0 0 2024-09-13T22:55:48.055 INFO:tasks.workunit.client.1.smithi047.stdout:6/28: rename d3/l5 to d3/lc 0 2024-09-13T22:55:48.057 INFO:tasks.workunit.client.1.smithi047.stdout:6/29: symlink d3/ld 0 2024-09-13T22:55:48.058 INFO:tasks.workunit.client.1.smithi047.stdout:6/30: dread - d3/f9 zero size 2024-09-13T22:55:48.058 INFO:tasks.workunit.client.1.smithi047.stdout:6/31: chown d3 0 1 2024-09-13T22:55:48.059 INFO:tasks.workunit.client.1.smithi047.stdout:6/32: dread - d3/f8 zero size 2024-09-13T22:55:48.068 INFO:tasks.workunit.client.1.smithi047.stdout:6/33: link d3/ld d3/le 0 2024-09-13T22:55:48.069 INFO:tasks.workunit.client.1.smithi047.stdout:3/17: truncate d0/f1 1045088 0 2024-09-13T22:55:48.070 INFO:tasks.workunit.client.1.smithi047.stdout:6/34: fdatasync d3/fb 0 2024-09-13T22:55:48.076 INFO:tasks.workunit.client.1.smithi047.stdout:6/35: stat d3/ld 0 2024-09-13T22:55:48.077 INFO:tasks.workunit.client.1.smithi047.stdout:6/36: read d3/f7 [2203212,42196] 0 2024-09-13T22:55:48.081 INFO:tasks.workunit.client.1.smithi047.stdout:6/37: creat d3/ff x:0 0 0 2024-09-13T22:55:48.087 INFO:tasks.workunit.client.1.smithi047.stdout:8/37: truncate f5 2104391 0 2024-09-13T22:55:48.096 INFO:tasks.workunit.client.1.smithi047.stdout:2/35: getdents d1/de 0 2024-09-13T22:55:48.097 INFO:tasks.workunit.client.1.smithi047.stdout:2/36: chown d1/f10 856 1 2024-09-13T22:55:48.099 INFO:tasks.workunit.client.1.smithi047.stdout:2/37: creat d1/de/f13 x:0 0 0 2024-09-13T22:55:48.100 INFO:tasks.workunit.client.1.smithi047.stdout:2/38: chown d1/c5 1678199 1 2024-09-13T22:55:48.101 INFO:tasks.workunit.client.1.smithi047.stdout:2/39: creat d1/f14 x:0 0 0 2024-09-13T22:55:48.102 INFO:tasks.workunit.client.1.smithi047.stdout:2/40: truncate d1/f3 1503038 0 2024-09-13T22:55:48.103 INFO:tasks.workunit.client.1.smithi047.stdout:2/41: stat d1/f8 0 2024-09-13T22:55:48.108 INFO:tasks.workunit.client.1.smithi047.stdout:3/18: unlink d0/f1 0 2024-09-13T22:55:48.109 INFO:tasks.workunit.client.1.smithi047.stdout:3/19: chown d0 1706 1 2024-09-13T22:55:48.109 INFO:tasks.workunit.client.1.smithi047.stdout:2/42: unlink d1/f8 0 2024-09-13T22:55:48.109 INFO:tasks.workunit.client.1.smithi047.stdout:2/43: write d1/f14 [373194,130638] 0 2024-09-13T22:55:48.109 INFO:tasks.workunit.client.1.smithi047.stdout:2/44: dread - d1/fc zero size 2024-09-13T22:55:48.112 INFO:tasks.workunit.client.1.smithi047.stdout:3/20: mkdir d0/d3/d4/d6 0 2024-09-13T22:55:48.113 INFO:tasks.workunit.client.1.smithi047.stdout:2/45: creat d1/f15 x:0 0 0 2024-09-13T22:55:48.113 INFO:tasks.workunit.client.1.smithi047.stdout:6/38: rmdir d3 39 2024-09-13T22:55:48.114 INFO:tasks.workunit.client.1.smithi047.stdout:2/46: truncate d1/f14 733743 0 2024-09-13T22:55:48.116 INFO:tasks.workunit.client.1.smithi047.stdout:3/21: stat d0/d3/d4/c5 0 2024-09-13T22:55:48.119 INFO:tasks.workunit.client.1.smithi047.stdout:8/38: dread f5 [0,4194304] 0 2024-09-13T22:55:48.120 INFO:tasks.workunit.client.1.smithi047.stdout:2/47: mkdir d1/d16 0 2024-09-13T22:55:48.123 INFO:tasks.workunit.client.1.smithi047.stdout:3/22: symlink d0/d3/d4/l7 0 2024-09-13T22:55:48.123 INFO:tasks.workunit.client.1.smithi047.stdout:3/23: dread - no filename 2024-09-13T22:55:48.127 INFO:tasks.workunit.client.1.smithi047.stdout:8/39: unlink f3 0 2024-09-13T22:55:48.127 INFO:tasks.workunit.client.1.smithi047.stdout:8/40: stat d8/ca 0 2024-09-13T22:55:48.127 INFO:tasks.workunit.client.1.smithi047.stdout:6/39: mknod d3/c10 0 2024-09-13T22:55:48.128 INFO:tasks.workunit.client.1.smithi047.stdout:8/41: chown d8/ca 1403818 1 2024-09-13T22:55:48.129 INFO:tasks.workunit.client.1.smithi047.stdout:2/48: mkdir d1/de/d17 0 2024-09-13T22:55:48.135 INFO:tasks.workunit.client.1.smithi047.stdout:8/42: symlink d8/le 0 2024-09-13T22:55:48.136 INFO:tasks.workunit.client.1.smithi047.stdout:2/49: dwrite d1/f3 [0,4194304] 0 2024-09-13T22:55:48.137 INFO:tasks.workunit.client.1.smithi047.stdout:2/50: dread - d1/f15 zero size 2024-09-13T22:55:48.140 INFO:tasks.workunit.client.1.smithi047.stdout:8/43: dread f4 [0,4194304] 0 2024-09-13T22:55:48.141 INFO:tasks.workunit.client.1.smithi047.stdout:8/44: chown f1 26836020 1 2024-09-13T22:55:48.144 INFO:tasks.workunit.client.1.smithi047.stdout:2/51: unlink d1/fc 0 2024-09-13T22:55:48.145 INFO:tasks.workunit.client.1.smithi047.stdout:2/52: rename d1/de/d17 to d1/de/d17/d18 22 2024-09-13T22:55:48.146 INFO:tasks.workunit.client.1.smithi047.stdout:8/45: rmdir d8 39 2024-09-13T22:55:48.151 INFO:tasks.workunit.client.1.smithi047.stdout:2/53: mknod d1/c19 0 2024-09-13T22:55:48.152 INFO:tasks.workunit.client.1.smithi047.stdout:2/54: chown d1/df 35 1 2024-09-13T22:55:48.152 INFO:tasks.workunit.client.1.smithi047.stdout:3/24: getdents d0/d3/d4 0 2024-09-13T22:55:48.153 INFO:tasks.workunit.client.1.smithi047.stdout:2/55: chown d1/de/f12 52439818 1 2024-09-13T22:55:48.159 INFO:tasks.workunit.client.1.smithi047.stdout:2/56: dread d1/f3 [0,4194304] 0 2024-09-13T22:55:48.162 INFO:tasks.workunit.client.1.smithi047.stdout:8/46: dwrite f4 [0,4194304] 0 2024-09-13T22:55:48.164 INFO:tasks.workunit.client.1.smithi047.stdout:2/57: creat d1/f1a x:0 0 0 2024-09-13T22:55:48.167 INFO:tasks.workunit.client.1.smithi047.stdout:3/25: mknod d0/d3/d4/d6/c8 0 2024-09-13T22:55:48.167 INFO:tasks.workunit.client.1.smithi047.stdout:3/26: dwrite - no filename 2024-09-13T22:55:48.167 INFO:tasks.workunit.client.1.smithi047.stdout:3/27: write - no filename 2024-09-13T22:55:48.170 INFO:tasks.workunit.client.1.smithi047.stdout:2/58: rename d1/f15 to d1/df/f1b 0 2024-09-13T22:55:48.171 INFO:tasks.workunit.client.1.smithi047.stdout:2/59: fsync d1/fb 0 2024-09-13T22:55:48.171 INFO:tasks.workunit.client.1.smithi047.stdout:2/60: dread - d1/f1a zero size 2024-09-13T22:55:48.178 INFO:tasks.workunit.client.1.smithi047.stdout:2/61: creat d1/de/d17/f1c x:0 0 0 2024-09-13T22:55:48.214 INFO:tasks.workunit.client.1.smithi047.stdout:2/62: write d1/fa [785808,32004] 0 2024-09-13T22:55:48.216 INFO:tasks.workunit.client.1.smithi047.stdout:2/63: mkdir d1/df/d1d 0 2024-09-13T22:55:48.218 INFO:tasks.workunit.client.1.smithi047.stdout:2/64: creat d1/de/d17/f1e x:0 0 0 2024-09-13T22:55:48.220 INFO:tasks.workunit.client.1.smithi047.stdout:2/65: symlink d1/df/d1d/l1f 0 2024-09-13T22:55:48.223 INFO:tasks.workunit.client.1.smithi047.stdout:2/66: unlink d1/f7 0 2024-09-13T22:55:48.226 INFO:tasks.workunit.client.1.smithi047.stdout:2/67: mkdir d1/df/d1d/d20 0 2024-09-13T22:55:48.233 INFO:tasks.workunit.client.1.smithi047.stdout:2/68: dwrite d1/de/f12 [0,4194304] 0 2024-09-13T22:55:48.283 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:48 smithi002 ceph-mon[27637]: pgmap v4: 65 pgs: 65 active+clean; 201 MiB data, 797 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:55:48.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:48 smithi047 ceph-mon[34560]: pgmap v4: 65 pgs: 65 active+clean; 201 MiB data, 797 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:55:49.281 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:49 smithi002 ceph-mon[27637]: mgrmap e23: smithi047.gcymvd(active, since 3s) 2024-09-13T22:55:49.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:49 smithi047 ceph-mon[34560]: mgrmap e23: smithi047.gcymvd(active, since 3s) 2024-09-13T22:55:50.198 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:50 smithi002 ceph-mon[27637]: [13/Sep/2024:22:55:48] ENGINE Bus STARTING 2024-09-13T22:55:50.198 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:50 smithi002 ceph-mon[27637]: pgmap v5: 65 pgs: 65 active+clean; 201 MiB data, 797 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:55:50.198 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:50 smithi002 ceph-mon[27637]: [13/Sep/2024:22:55:49] ENGINE Serving on https://172.21.15.47:7150 2024-09-13T22:55:50.198 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:50 smithi002 ceph-mon[27637]: [13/Sep/2024:22:55:49] ENGINE Error in HTTPServer.serve 2024-09-13T22:55:50.198 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Traceback (most recent call last): 2024-09-13T22:55:50.199 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:55:50.199 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-13T22:55:50.199 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:55:50.199 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._run(expiration_interval) 2024-09-13T22:55:50.199 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:55:50.199 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:55:50.200 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:55:50.200 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:55:50.200 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:55:50.200 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: s = self.context.wrap_socket( 2024-09-13T22:55:50.200 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:55:50.201 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: return self.sslsocket_class._create( 2024-09-13T22:55:50.201 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:55:50.201 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self.do_handshake() 2024-09-13T22:55:50.201 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:55:50.201 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._sslobj.do_handshake() 2024-09-13T22:55:50.201 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:55:50.201 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:50 smithi002 ceph-mon[27637]: [13/Sep/2024:22:55:49] ENGINE Serving on http://172.21.15.47:8765 2024-09-13T22:55:50.201 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:50 smithi002 ceph-mon[27637]: [13/Sep/2024:22:55:49] ENGINE Bus STARTED 2024-09-13T22:55:50.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:50 smithi047 ceph-mon[34560]: [13/Sep/2024:22:55:48] ENGINE Bus STARTING 2024-09-13T22:55:50.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:50 smithi047 ceph-mon[34560]: pgmap v5: 65 pgs: 65 active+clean; 201 MiB data, 797 MiB used, 536 GiB / 536 GiB avail 2024-09-13T22:55:50.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:50 smithi047 ceph-mon[34560]: [13/Sep/2024:22:55:49] ENGINE Serving on https://172.21.15.47:7150 2024-09-13T22:55:50.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:50 smithi047 ceph-mon[34560]: [13/Sep/2024:22:55:49] ENGINE Error in HTTPServer.serve 2024-09-13T22:55:50.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Traceback (most recent call last): 2024-09-13T22:55:50.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:55:50.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: self._connections.run(self.expiration_interval) 2024-09-13T22:55:50.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:55:50.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: self._run(expiration_interval) 2024-09-13T22:55:50.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:55:50.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:55:50.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:55:50.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:55:50.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:55:50.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: s = self.context.wrap_socket( 2024-09-13T22:55:50.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:55:50.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: return self.sslsocket_class._create( 2024-09-13T22:55:50.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:55:50.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: self.do_handshake() 2024-09-13T22:55:50.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:55:50.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: self._sslobj.do_handshake() 2024-09-13T22:55:50.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:55:50.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:50 smithi047 ceph-mon[34560]: [13/Sep/2024:22:55:49] ENGINE Serving on http://172.21.15.47:8765 2024-09-13T22:55:50.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:50 smithi047 ceph-mon[34560]: [13/Sep/2024:22:55:49] ENGINE Bus STARTED 2024-09-13T22:55:52.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:51 smithi002 ceph-mon[27637]: pgmap v6: 65 pgs: 65 active+clean; 221 MiB data, 859 MiB used, 536 GiB / 536 GiB avail; 821 KiB/s rd, 6.1 MiB/s wr, 87 op/s 2024-09-13T22:55:52.290 INFO:tasks.workunit.client.0.smithi002.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T22:55:52.294 INFO:tasks.workunit.client.0.smithi002.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T22:55:52.295 INFO:tasks.workunit.client.0.smithi002.stderr:+ make 2024-09-13T22:55:52.395 INFO:tasks.workunit.client.1.smithi047.stdout:9/2: sync 2024-09-13T22:55:52.395 INFO:tasks.workunit.client.1.smithi047.stdout:7/6: sync 2024-09-13T22:55:52.395 INFO:tasks.workunit.client.1.smithi047.stdout:6/40: sync 2024-09-13T22:55:52.395 INFO:tasks.workunit.client.1.smithi047.stdout:9/3: fsync - no filename 2024-09-13T22:55:52.395 INFO:tasks.workunit.client.1.smithi047.stdout:2/69: sync 2024-09-13T22:55:52.395 INFO:tasks.workunit.client.1.smithi047.stdout:4/20: sync 2024-09-13T22:55:52.395 INFO:tasks.workunit.client.1.smithi047.stdout:3/28: sync 2024-09-13T22:55:52.395 INFO:tasks.workunit.client.1.smithi047.stdout:1/20: sync 2024-09-13T22:55:52.395 INFO:tasks.workunit.client.1.smithi047.stdout:8/47: sync 2024-09-13T22:55:52.396 INFO:tasks.workunit.client.1.smithi047.stdout:5/9: sync 2024-09-13T22:55:52.396 INFO:tasks.workunit.client.1.smithi047.stdout:5/10: dread - no filename 2024-09-13T22:55:52.396 INFO:tasks.workunit.client.1.smithi047.stdout:5/11: rmdir - no directory 2024-09-13T22:55:52.396 INFO:tasks.workunit.client.1.smithi047.stdout:0/2: sync 2024-09-13T22:55:52.397 INFO:tasks.workunit.client.1.smithi047.stdout:1/21: write d0/f1 [3010488,17529] 0 2024-09-13T22:55:52.397 INFO:tasks.workunit.client.1.smithi047.stdout:8/48: rename d8 to d8/df 22 2024-09-13T22:55:52.399 INFO:tasks.workunit.client.1.smithi047.stdout:6/41: mkdir d3/d11 0 2024-09-13T22:55:52.401 INFO:tasks.workunit.client.1.smithi047.stdout:5/12: rename l3 to l4 0 2024-09-13T22:55:52.401 INFO:tasks.workunit.client.1.smithi047.stdout:5/13: dwrite - no filename 2024-09-13T22:55:52.401 INFO:tasks.workunit.client.1.smithi047.stdout:5/14: dread - no filename 2024-09-13T22:55:52.402 INFO:tasks.workunit.client.1.smithi047.stdout:8/49: dread f6 [0,4194304] 0 2024-09-13T22:55:52.402 INFO:tasks.workunit.client.1.smithi047.stdout:8/50: chown d8/le 273 1 2024-09-13T22:55:52.404 INFO:tasks.workunit.client.1.smithi047.stdout:4/21: dread - f2 zero size 2024-09-13T22:55:52.405 INFO:tasks.workunit.client.1.smithi047.stdout:2/70: write d1/fa [1800983,21083] 0 2024-09-13T22:55:52.408 INFO:tasks.workunit.client.1.smithi047.stdout:3/29: creat d0/d3/d4/f9 x:0 0 0 2024-09-13T22:55:52.412 INFO:tasks.workunit.client.1.smithi047.stdout:0/3: symlink l0 0 2024-09-13T22:55:52.412 INFO:tasks.workunit.client.1.smithi047.stdout:0/4: write - no filename 2024-09-13T22:55:52.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:51 smithi047 ceph-mon[34560]: pgmap v6: 65 pgs: 65 active+clean; 221 MiB data, 859 MiB used, 536 GiB / 536 GiB avail; 821 KiB/s rd, 6.1 MiB/s wr, 87 op/s 2024-09-13T22:55:52.413 INFO:tasks.workunit.client.1.smithi047.stdout:0/5: readlink l0 0 2024-09-13T22:55:52.413 INFO:tasks.workunit.client.1.smithi047.stdout:0/6: dwrite - no filename 2024-09-13T22:55:52.414 INFO:tasks.workunit.client.1.smithi047.stdout:9/4: mknod c0 0 2024-09-13T22:55:52.417 INFO:tasks.workunit.client.1.smithi047.stdout:8/51: rename f0 to d8/f10 0 2024-09-13T22:55:52.418 INFO:tasks.workunit.client.1.smithi047.stdout:2/71: dwrite d1/f1a [0,4194304] 0 2024-09-13T22:55:52.418 INFO:tasks.workunit.client.1.smithi047.stdout:7/7: getdents d0/d4 0 2024-09-13T22:55:52.421 INFO:tasks.workunit.client.1.smithi047.stdout:3/30: rmdir d0/d3/d4/d6 39 2024-09-13T22:55:52.422 INFO:tasks.workunit.client.1.smithi047.stdout:2/72: chown d1/f10 8223 1 2024-09-13T22:55:52.422 INFO:tasks.workunit.client.1.smithi047.stdout:4/22: write f2 [1016904,118502] 0 2024-09-13T22:55:52.423 INFO:tasks.workunit.client.1.smithi047.stdout:1/22: dwrite d0/f2 [0,4194304] 0 2024-09-13T22:55:52.426 INFO:tasks.workunit.client.1.smithi047.stdout:6/42: symlink d3/d11/l12 0 2024-09-13T22:55:52.428 INFO:tasks.workunit.client.1.smithi047.stdout:0/7: mkdir d1 0 2024-09-13T22:55:52.429 INFO:tasks.workunit.client.1.smithi047.stdout:0/8: write - no filename 2024-09-13T22:55:52.429 INFO:tasks.workunit.client.1.smithi047.stdout:0/9: dwrite - no filename 2024-09-13T22:55:52.429 INFO:tasks.workunit.client.1.smithi047.stdout:0/10: fdatasync - no filename 2024-09-13T22:55:52.429 INFO:tasks.workunit.client.1.smithi047.stdout:0/11: truncate - no filename 2024-09-13T22:55:52.429 INFO:tasks.workunit.client.1.smithi047.stdout:0/12: dwrite - no filename 2024-09-13T22:55:52.432 INFO:tasks.workunit.client.1.smithi047.stdout:9/5: mkdir d1 0 2024-09-13T22:55:52.433 INFO:tasks.workunit.client.1.smithi047.stdout:9/6: stat c0 0 2024-09-13T22:55:52.433 INFO:tasks.workunit.client.1.smithi047.stdout:9/7: stat d1 0 2024-09-13T22:55:52.433 INFO:tasks.workunit.client.1.smithi047.stdout:9/8: stat c0 0 2024-09-13T22:55:52.435 INFO:tasks.workunit.client.1.smithi047.stdout:8/52: mknod d8/c11 0 2024-09-13T22:55:52.437 INFO:tasks.workunit.client.1.smithi047.stdout:4/23: fsync f1 0 2024-09-13T22:55:52.439 INFO:tasks.workunit.client.1.smithi047.stdout:1/23: mknod d0/c4 0 2024-09-13T22:55:52.439 INFO:tasks.workunit.client.1.smithi047.stdout:1/24: stat d0/c4 0 2024-09-13T22:55:52.440 INFO:tasks.workunit.client.1.smithi047.stdout:1/25: read d0/f2 [296592,126325] 0 2024-09-13T22:55:52.440 INFO:tasks.workunit.client.1.smithi047.stdout:1/26: readlink - no filename 2024-09-13T22:55:52.443 INFO:tasks.workunit.client.1.smithi047.stdout:6/43: mkdir d3/d13 0 2024-09-13T22:55:52.443 INFO:tasks.workunit.client.1.smithi047.stdout:6/44: truncate d3/ff 576480 0 2024-09-13T22:55:52.445 INFO:tasks.workunit.client.1.smithi047.stdout:8/53: creat d8/f12 x:0 0 0 2024-09-13T22:55:52.446 INFO:tasks.workunit.client.1.smithi047.stdout:7/8: creat d0/d4/f6 x:0 0 0 2024-09-13T22:55:52.447 INFO:tasks.workunit.client.1.smithi047.stdout:7/9: dread - d0/f5 zero size 2024-09-13T22:55:52.449 INFO:tasks.workunit.client.1.smithi047.stdout:4/24: unlink f2 0 2024-09-13T22:55:52.449 INFO:tasks.workunit.client.1.smithi047.stdout:4/25: readlink - no filename 2024-09-13T22:55:52.450 INFO:tasks.workunit.client.1.smithi047.stdout:2/73: symlink d1/df/d1d/d20/l21 0 2024-09-13T22:55:52.453 INFO:tasks.workunit.client.1.smithi047.stdout:1/27: creat d0/f5 x:0 0 0 2024-09-13T22:55:52.454 INFO:tasks.workunit.client.1.smithi047.stdout:3/31: creat d0/d3/d4/d6/fa x:0 0 0 2024-09-13T22:55:52.455 INFO:tasks.workunit.client.1.smithi047.stdout:0/13: creat d1/f2 x:0 0 0 2024-09-13T22:55:52.456 INFO:tasks.workunit.client.1.smithi047.stdout:9/9: mkdir d1/d2 0 2024-09-13T22:55:52.457 INFO:tasks.workunit.client.1.smithi047.stdout:9/10: rename d1 to d1/d2/d3 22 2024-09-13T22:55:52.458 INFO:tasks.workunit.client.1.smithi047.stdout:6/45: creat d3/f14 x:0 0 0 2024-09-13T22:55:52.460 INFO:tasks.workunit.client.1.smithi047.stdout:7/10: fsync d0/f2 0 2024-09-13T22:55:52.462 INFO:tasks.workunit.client.1.smithi047.stdout:4/26: creat f4 x:0 0 0 2024-09-13T22:55:52.463 INFO:tasks.workunit.client.1.smithi047.stdout:2/74: mknod d1/de/c22 0 2024-09-13T22:55:52.463 INFO:tasks.workunit.client.1.smithi047.stdout:2/75: dread - d1/f11 zero size 2024-09-13T22:55:52.465 INFO:tasks.workunit.client.1.smithi047.stdout:2/76: write d1/f11 [806224,112716] 0 2024-09-13T22:55:52.466 INFO:tasks.workunit.client.1.smithi047.stdout:1/28: unlink d0/f1 0 2024-09-13T22:55:52.467 INFO:tasks.workunit.client.1.smithi047.stdout:1/29: chown d0/f2 6 1 2024-09-13T22:55:52.469 INFO:tasks.workunit.client.1.smithi047.stdout:0/14: symlink d1/l3 0 2024-09-13T22:55:52.473 INFO:tasks.workunit.client.1.smithi047.stdout:4/27: mknod c5 0 2024-09-13T22:55:52.473 INFO:tasks.workunit.client.1.smithi047.stdout:2/77: dwrite d1/de/d17/f1c [0,4194304] 0 2024-09-13T22:55:52.478 INFO:tasks.workunit.client.1.smithi047.stdout:2/78: dread d1/de/f12 [0,4194304] 0 2024-09-13T22:55:52.480 INFO:tasks.workunit.client.1.smithi047.stdout:2/79: fdatasync d1/de/f13 0 2024-09-13T22:55:52.480 INFO:tasks.workunit.client.1.smithi047.stdout:0/15: creat d1/f4 x:0 0 0 2024-09-13T22:55:52.483 INFO:tasks.workunit.client.1.smithi047.stdout:6/46: getdents d3/d13 0 2024-09-13T22:55:52.484 INFO:tasks.workunit.client.1.smithi047.stdout:4/28: creat f6 x:0 0 0 2024-09-13T22:55:52.487 INFO:tasks.workunit.client.1.smithi047.stdout:3/32: creat d0/d3/d4/fb x:0 0 0 2024-09-13T22:55:52.489 INFO:tasks.workunit.client.1.smithi047.stdout:9/11: rmdir d1/d2 0 2024-09-13T22:55:52.491 INFO:tasks.workunit.client.1.smithi047.stdout:3/33: write d0/d3/d4/fb [348695,27631] 0 2024-09-13T22:55:52.491 INFO:tasks.workunit.client.1.smithi047.stdout:0/16: mkdir d1/d5 0 2024-09-13T22:55:52.493 INFO:tasks.workunit.client.1.smithi047.stdout:2/80: write d1/df/f1b [396910,57784] 0 2024-09-13T22:55:52.494 INFO:tasks.workunit.client.1.smithi047.stdout:4/29: rename c3 to c7 0 2024-09-13T22:55:52.495 INFO:tasks.workunit.client.1.smithi047.stdout:6/47: dwrite d3/f6 [0,4194304] 0 2024-09-13T22:55:52.496 INFO:tasks.workunit.client.1.smithi047.stdout:4/30: chown f1 1208907 1 2024-09-13T22:55:52.496 INFO:tasks.workunit.client.1.smithi047.stdout:6/48: fsync d3/f8 0 2024-09-13T22:55:52.497 INFO:tasks.workunit.client.1.smithi047.stdout:4/31: write f6 [740036,69765] 0 2024-09-13T22:55:52.500 INFO:tasks.workunit.client.1.smithi047.stdout:3/34: symlink d0/d3/d4/d6/lc 0 2024-09-13T22:55:52.502 INFO:tasks.workunit.client.1.smithi047.stdout:2/81: unlink d1/fb 0 2024-09-13T22:55:52.506 INFO:tasks.workunit.client.1.smithi047.stdout:0/17: rename d1/l3 to d1/d5/l6 0 2024-09-13T22:55:52.509 INFO:tasks.workunit.client.1.smithi047.stdout:0/18: dread - d1/f4 zero size 2024-09-13T22:55:52.509 INFO:tasks.workunit.client.1.smithi047.stdout:3/35: mknod d0/d3/cd 0 2024-09-13T22:55:52.513 INFO:tasks.workunit.client.1.smithi047.stdout:6/49: dwrite d3/f14 [0,4194304] 0 2024-09-13T22:55:52.513 INFO:tasks.workunit.client.1.smithi047.stdout:3/36: fdatasync d0/d3/d4/fb 0 2024-09-13T22:55:52.514 INFO:tasks.workunit.client.1.smithi047.stdout:4/32: dwrite f4 [0,4194304] 0 2024-09-13T22:55:52.516 INFO:tasks.workunit.client.1.smithi047.stdout:4/33: stat f1 0 2024-09-13T22:55:52.516 INFO:tasks.workunit.client.1.smithi047.stdout:3/37: dread - d0/d3/d4/f9 zero size 2024-09-13T22:55:52.516 INFO:tasks.workunit.client.1.smithi047.stdout:9/12: link c0 d1/c4 0 2024-09-13T22:55:52.517 INFO:tasks.workunit.client.1.smithi047.stdout:9/13: dwrite - no filename 2024-09-13T22:55:52.517 INFO:tasks.workunit.client.1.smithi047.stdout:9/14: dread - no filename 2024-09-13T22:55:52.519 INFO:tasks.workunit.client.1.smithi047.stdout:3/38: readlink d0/d3/d4/d6/lc 0 2024-09-13T22:55:52.522 INFO:tasks.workunit.client.1.smithi047.stdout:6/50: mkdir d3/d15 0 2024-09-13T22:55:52.523 INFO:tasks.workunit.client.1.smithi047.stdout:4/34: dread f4 [0,4194304] 0 2024-09-13T22:55:52.523 INFO:tasks.workunit.client.1.smithi047.stdout:6/51: write d3/ff [498287,126863] 0 2024-09-13T22:55:52.526 INFO:tasks.workunit.client.1.smithi047.stdout:9/15: creat d1/f5 x:0 0 0 2024-09-13T22:55:52.527 INFO:tasks.workunit.client.1.smithi047.stdout:9/16: chown d1/f5 1412 1 2024-09-13T22:55:52.528 INFO:tasks.workunit.client.1.smithi047.stdout:3/39: mkdir d0/d3/d4/d6/de 0 2024-09-13T22:55:52.532 INFO:tasks.workunit.client.1.smithi047.stdout:6/52: mknod d3/d11/c16 0 2024-09-13T22:55:52.533 INFO:tasks.workunit.client.1.smithi047.stdout:9/17: mkdir d1/d6 0 2024-09-13T22:55:52.534 INFO:tasks.workunit.client.1.smithi047.stdout:6/53: read d3/ff [306789,32684] 0 2024-09-13T22:55:52.535 INFO:tasks.workunit.client.1.smithi047.stdout:9/18: fdatasync d1/f5 0 2024-09-13T22:55:52.538 INFO:tasks.workunit.client.1.smithi047.stdout:6/54: write d3/f8 [312232,127289] 0 2024-09-13T22:55:52.539 INFO:tasks.workunit.client.1.smithi047.stdout:9/19: creat d1/f7 x:0 0 0 2024-09-13T22:55:52.539 INFO:tasks.workunit.client.1.smithi047.stdout:3/40: dwrite d0/d3/d4/d6/fa [0,4194304] 0 2024-09-13T22:55:52.540 INFO:tasks.workunit.client.1.smithi047.stdout:6/55: read d3/f7 [634421,25798] 0 2024-09-13T22:55:52.543 INFO:tasks.workunit.client.1.smithi047.stdout:6/56: symlink d3/d11/l17 0 2024-09-13T22:55:52.546 INFO:tasks.workunit.client.1.smithi047.stdout:3/41: creat d0/d3/d4/ff x:0 0 0 2024-09-13T22:55:52.547 INFO:tasks.workunit.client.1.smithi047.stdout:6/57: symlink d3/d15/l18 0 2024-09-13T22:55:52.548 INFO:tasks.workunit.client.1.smithi047.stdout:3/42: write d0/d3/d4/fb [449100,92049] 0 2024-09-13T22:55:52.548 INFO:tasks.workunit.client.1.smithi047.stdout:6/58: write d3/f6 [1273809,39824] 0 2024-09-13T22:55:52.553 INFO:tasks.workunit.client.1.smithi047.stdout:6/59: unlink d3/fb 0 2024-09-13T22:55:52.555 INFO:tasks.workunit.client.1.smithi047.stdout:6/60: write d3/f9 [776492,97624] 0 2024-09-13T22:55:52.559 INFO:tasks.workunit.client.1.smithi047.stdout:3/43: dwrite d0/d3/d4/ff [0,4194304] 0 2024-09-13T22:55:52.561 INFO:tasks.workunit.client.1.smithi047.stdout:3/44: write d0/d3/d4/d6/fa [1213600,37712] 0 2024-09-13T22:55:52.563 INFO:tasks.workunit.client.1.smithi047.stdout:3/45: write d0/d3/d4/fb [921284,119351] 0 2024-09-13T22:55:52.563 INFO:tasks.workunit.client.1.smithi047.stdout:6/61: link d3/d15/l18 d3/d13/l19 0 2024-09-13T22:55:52.564 INFO:tasks.workunit.client.1.smithi047.stdout:6/62: fsync d3/f8 0 2024-09-13T22:55:52.571 INFO:tasks.workunit.client.1.smithi047.stdout:3/46: creat d0/d3/d4/d6/de/f10 x:0 0 0 2024-09-13T22:55:52.576 INFO:tasks.workunit.client.1.smithi047.stdout:3/47: dread d0/d3/d4/d6/fa [0,4194304] 0 2024-09-13T22:55:52.584 INFO:tasks.workunit.client.1.smithi047.stdout:3/48: unlink d0/d3/d4/ff 0 2024-09-13T22:55:52.585 INFO:tasks.workunit.client.1.smithi047.stdout:3/49: write d0/d3/d4/d6/de/f10 [616979,11984] 0 2024-09-13T22:55:52.590 INFO:tasks.workunit.client.1.smithi047.stdout:3/50: creat d0/d3/d4/d6/de/f11 x:0 0 0 2024-09-13T22:55:52.590 INFO:tasks.workunit.client.1.smithi047.stdout:3/51: stat d0/d3/d4/d6/de 0 2024-09-13T22:55:52.599 INFO:tasks.workunit.client.1.smithi047.stdout:3/52: dwrite d0/d3/d4/d6/de/f10 [0,4194304] 0 2024-09-13T22:55:52.848 INFO:tasks.workunit.client.1.smithi047.stdout:9/20: sync 2024-09-13T22:55:52.848 INFO:tasks.workunit.client.1.smithi047.stdout:9/21: dread - d1/f5 zero size 2024-09-13T22:55:52.850 INFO:tasks.workunit.client.1.smithi047.stdout:9/22: chown d1/c4 330773 1 2024-09-13T22:55:52.852 INFO:tasks.workunit.client.1.smithi047.stdout:9/23: mkdir d1/d6/d8 0 2024-09-13T22:55:52.854 INFO:tasks.workunit.client.1.smithi047.stdout:9/24: creat d1/d6/d8/f9 x:0 0 0 2024-09-13T22:55:52.855 INFO:tasks.workunit.client.1.smithi047.stdout:9/25: symlink d1/la 0 2024-09-13T22:55:52.857 INFO:tasks.workunit.client.1.smithi047.stdout:9/26: creat d1/d6/fb x:0 0 0 2024-09-13T22:55:52.859 INFO:tasks.workunit.client.1.smithi047.stdout:9/27: write d1/f7 [815705,126131] 0 2024-09-13T22:55:52.859 INFO:tasks.workunit.client.1.smithi047.stdout:9/28: stat d1/d6/d8/f9 0 2024-09-13T22:55:52.861 INFO:tasks.workunit.client.1.smithi047.stdout:9/29: chown d1/c4 1913 1 2024-09-13T22:55:52.862 INFO:tasks.workunit.client.1.smithi047.stdout:9/30: dread - d1/f5 zero size 2024-09-13T22:55:52.865 INFO:tasks.workunit.client.1.smithi047.stdout:9/31: dread d1/f7 [0,4194304] 0 2024-09-13T22:55:52.868 INFO:tasks.workunit.client.1.smithi047.stdout:9/32: chown c0 539 1 2024-09-13T22:55:52.872 INFO:tasks.workunit.client.1.smithi047.stdout:5/15: chown l4 1410732917 1 2024-09-13T22:55:52.874 INFO:tasks.workunit.client.1.smithi047.stdout:5/16: creat f5 x:0 0 0 2024-09-13T22:55:52.878 INFO:tasks.workunit.client.0.smithi002.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T22:55:52.882 INFO:tasks.workunit.client.1.smithi047.stdout:8/54: fsync d8/f12 0 2024-09-13T22:55:52.883 INFO:tasks.workunit.client.1.smithi047.stdout:7/11: rename d0/d4 to d0/d7 0 2024-09-13T22:55:52.886 INFO:tasks.workunit.client.1.smithi047.stdout:5/17: dwrite f5 [0,4194304] 0 2024-09-13T22:55:52.887 INFO:tasks.workunit.client.1.smithi047.stdout:8/55: creat d8/f13 x:0 0 0 2024-09-13T22:55:52.890 INFO:tasks.workunit.client.1.smithi047.stdout:7/12: creat d0/f8 x:0 0 0 2024-09-13T22:55:52.890 INFO:tasks.workunit.client.1.smithi047.stdout:1/30: dwrite d0/f2 [4194304,4194304] 0 2024-09-13T22:55:52.896 INFO:tasks.workunit.client.1.smithi047.stdout:1/31: unlink d0/f2 0 2024-09-13T22:55:52.897 INFO:tasks.workunit.client.1.smithi047.stdout:2/82: rmdir d1/de 39 2024-09-13T22:55:52.897 INFO:tasks.workunit.client.1.smithi047.stdout:1/32: write d0/f5 [402933,66285] 0 2024-09-13T22:55:52.899 INFO:tasks.workunit.client.1.smithi047.stdout:7/13: rename d0/f5 to d0/f9 0 2024-09-13T22:55:52.905 INFO:tasks.workunit.client.1.smithi047.stdout:0/19: fsync d1/f4 0 2024-09-13T22:55:52.907 INFO:tasks.workunit.client.1.smithi047.stdout:2/83: dread - d1/de/d17/f1e zero size 2024-09-13T22:55:52.907 INFO:tasks.workunit.client.1.smithi047.stdout:1/33: dwrite d0/f5 [0,4194304] 0 2024-09-13T22:55:52.911 INFO:tasks.workunit.client.1.smithi047.stdout:0/20: mkdir d1/d7 0 2024-09-13T22:55:52.914 INFO:tasks.workunit.client.1.smithi047.stdout:1/34: mkdir d0/d6 0 2024-09-13T22:55:52.920 INFO:tasks.workunit.client.1.smithi047.stdout:2/84: dwrite d1/fa [0,4194304] 0 2024-09-13T22:55:52.927 INFO:tasks.workunit.client.1.smithi047.stdout:0/21: dwrite d1/f4 [0,4194304] 0 2024-09-13T22:55:52.934 INFO:tasks.workunit.client.1.smithi047.stdout:0/22: creat d1/d5/f8 x:0 0 0 2024-09-13T22:55:52.936 INFO:tasks.workunit.client.1.smithi047.stdout:6/63: getdents d3 0 2024-09-13T22:55:52.940 INFO:tasks.workunit.client.1.smithi047.stdout:2/85: dwrite d1/f1a [4194304,4194304] 0 2024-09-13T22:55:52.944 INFO:tasks.workunit.client.1.smithi047.stdout:0/23: creat d1/d5/f9 x:0 0 0 2024-09-13T22:55:52.945 INFO:tasks.workunit.client.1.smithi047.stdout:6/64: truncate d3/f8 1468479 0 2024-09-13T22:55:52.945 INFO:tasks.workunit.client.1.smithi047.stdout:4/35: dwrite f1 [0,4194304] 0 2024-09-13T22:55:52.950 INFO:tasks.workunit.client.1.smithi047.stdout:3/53: dwrite d0/d3/d4/d6/fa [4194304,4194304] 0 2024-09-13T22:55:52.959 INFO:tasks.workunit.client.1.smithi047.stdout:6/65: write d3/f6 [3696851,98832] 0 2024-09-13T22:55:52.960 INFO:tasks.workunit.client.1.smithi047.stdout:0/24: rename d1/d5/l6 to d1/la 0 2024-09-13T22:55:52.961 INFO:tasks.workunit.client.1.smithi047.stdout:2/86: dwrite d1/f14 [0,4194304] 0 2024-09-13T22:55:52.961 INFO:tasks.workunit.client.1.smithi047.stdout:0/25: stat d1/f2 0 2024-09-13T22:55:52.962 INFO:tasks.workunit.client.1.smithi047.stdout:6/66: rmdir d3/d13 39 2024-09-13T22:55:52.963 INFO:tasks.workunit.client.1.smithi047.stdout:6/67: write d3/f6 [4864993,109125] 0 2024-09-13T22:55:52.964 INFO:tasks.workunit.client.1.smithi047.stdout:2/87: chown d1/f3 99 1 2024-09-13T22:55:52.967 INFO:tasks.workunit.client.1.smithi047.stdout:0/26: creat d1/d7/fb x:0 0 0 2024-09-13T22:55:52.968 INFO:tasks.workunit.client.1.smithi047.stdout:6/68: truncate d3/ff 967553 0 2024-09-13T22:55:52.970 INFO:tasks.workunit.client.1.smithi047.stdout:0/27: creat d1/d5/fc x:0 0 0 2024-09-13T22:55:52.971 INFO:tasks.workunit.client.1.smithi047.stdout:2/88: creat d1/d16/f23 x:0 0 0 2024-09-13T22:55:52.973 INFO:tasks.workunit.client.1.smithi047.stdout:6/69: mknod d3/d15/c1a 0 2024-09-13T22:55:52.979 INFO:tasks.workunit.client.1.smithi047.stdout:6/70: chown d3/ff 158764613 1 2024-09-13T22:55:52.979 INFO:tasks.workunit.client.1.smithi047.stdout:0/28: dwrite d1/d5/f9 [0,4194304] 0 2024-09-13T22:55:52.980 INFO:tasks.workunit.client.1.smithi047.stdout:2/89: link d1/d16/f23 d1/f24 0 2024-09-13T22:55:52.980 INFO:tasks.workunit.client.1.smithi047.stdout:0/29: chown d1/d5/fc 4831532 1 2024-09-13T22:55:52.981 INFO:tasks.workunit.client.1.smithi047.stdout:2/90: fsync d1/f10 0 2024-09-13T22:55:52.981 INFO:tasks.workunit.client.1.smithi047.stdout:2/91: chown d1/f1a 16 1 2024-09-13T22:55:52.982 INFO:tasks.workunit.client.1.smithi047.stdout:0/30: write d1/f4 [3204801,56681] 0 2024-09-13T22:55:52.983 INFO:tasks.workunit.client.1.smithi047.stdout:0/31: read - d1/d7/fb zero size 2024-09-13T22:55:52.985 INFO:tasks.workunit.client.1.smithi047.stdout:0/32: write d1/f4 [3123530,112914] 0 2024-09-13T22:55:52.986 INFO:tasks.workunit.client.1.smithi047.stdout:2/92: creat d1/de/f25 x:0 0 0 2024-09-13T22:55:52.987 INFO:tasks.workunit.client.1.smithi047.stdout:2/93: chown d1/f24 690 1 2024-09-13T22:55:52.991 INFO:tasks.workunit.client.1.smithi047.stdout:2/94: mkdir d1/df/d26 0 2024-09-13T22:55:52.993 INFO:tasks.workunit.client.1.smithi047.stdout:2/95: write d1/f11 [1696965,57620] 0 2024-09-13T22:55:52.995 INFO:tasks.workunit.client.1.smithi047.stdout:0/33: dwrite d1/d5/f9 [0,4194304] 0 2024-09-13T22:55:52.998 INFO:tasks.workunit.client.1.smithi047.stdout:2/96: getdents d1/df/d26 0 2024-09-13T22:55:53.000 INFO:tasks.workunit.client.1.smithi047.stdout:0/34: dread d1/f4 [0,4194304] 0 2024-09-13T22:55:53.007 INFO:tasks.workunit.client.1.smithi047.stdout:0/35: dread d1/f4 [0,4194304] 0 2024-09-13T22:55:53.008 INFO:tasks.workunit.client.1.smithi047.stdout:2/97: dwrite d1/d16/f23 [0,4194304] 0 2024-09-13T22:55:53.012 INFO:tasks.workunit.client.1.smithi047.stdout:0/36: rename l0 to d1/ld 0 2024-09-13T22:55:53.014 INFO:tasks.workunit.client.1.smithi047.stdout:0/37: creat d1/d7/fe x:0 0 0 2024-09-13T22:55:53.016 INFO:tasks.workunit.client.1.smithi047.stdout:2/98: link d1/df/d1d/d20/l21 d1/df/l27 0 2024-09-13T22:55:53.018 INFO:tasks.workunit.client.1.smithi047.stdout:2/99: chown d1/de/c22 696979970 1 2024-09-13T22:55:53.022 INFO:tasks.workunit.client.1.smithi047.stdout:2/100: unlink d1/fa 0 2024-09-13T22:55:53.023 INFO:tasks.workunit.client.1.smithi047.stdout:0/38: dwrite d1/d5/fc [0,4194304] 0 2024-09-13T22:55:53.035 INFO:tasks.workunit.client.1.smithi047.stdout:2/101: dwrite d1/de/f13 [0,4194304] 0 2024-09-13T22:55:53.037 INFO:tasks.workunit.client.1.smithi047.stdout:0/39: dwrite d1/f4 [0,4194304] 0 2024-09-13T22:55:53.041 INFO:tasks.workunit.client.1.smithi047.stdout:2/102: getdents d1/df/d1d 0 2024-09-13T22:55:53.045 INFO:tasks.workunit.client.1.smithi047.stdout:2/103: dread d1/f14 [0,4194304] 0 2024-09-13T22:55:53.058 INFO:tasks.workunit.client.1.smithi047.stdout:9/33: fsync d1/d6/d8/f9 0 2024-09-13T22:55:53.061 INFO:tasks.workunit.client.1.smithi047.stdout:5/18: getdents . 0 2024-09-13T22:55:53.181 INFO:tasks.workunit.client.1.smithi047.stdout:5/19: getdents . 0 2024-09-13T22:55:53.182 INFO:tasks.workunit.client.1.smithi047.stdout:7/14: unlink d0/f9 0 2024-09-13T22:55:53.185 INFO:tasks.workunit.client.1.smithi047.stdout:9/34: dwrite d1/d6/d8/f9 [0,4194304] 0 2024-09-13T22:55:53.186 INFO:tasks.workunit.client.1.smithi047.stdout:7/15: write d0/f8 [666509,4452] 0 2024-09-13T22:55:53.191 INFO:tasks.workunit.client.1.smithi047.stdout:7/16: write d0/f8 [289680,56060] 0 2024-09-13T22:55:53.191 INFO:tasks.workunit.client.1.smithi047.stdout:9/35: write d1/f5 [207934,47907] 0 2024-09-13T22:55:53.194 INFO:tasks.workunit.client.1.smithi047.stdout:2/104: rmdir d1/de 39 2024-09-13T22:55:53.195 INFO:tasks.workunit.client.1.smithi047.stdout:8/56: dwrite f5 [0,4194304] 0 2024-09-13T22:55:53.197 INFO:tasks.workunit.client.1.smithi047.stdout:8/57: stat f6 0 2024-09-13T22:55:53.197 INFO:tasks.workunit.client.1.smithi047.stdout:2/105: chown d1/f11 512 1 2024-09-13T22:55:53.199 INFO:tasks.workunit.client.1.smithi047.stdout:1/35: dwrite d0/f5 [4194304,4194304] 0 2024-09-13T22:55:53.202 INFO:tasks.workunit.client.1.smithi047.stdout:6/71: write d3/ff [37506,75894] 0 2024-09-13T22:55:53.202 INFO:tasks.workunit.client.1.smithi047.stdout:5/20: symlink l6 0 2024-09-13T22:55:53.203 INFO:tasks.workunit.client.1.smithi047.stdout:9/36: unlink d1/f7 0 2024-09-13T22:55:53.206 INFO:tasks.workunit.client.1.smithi047.stdout:8/58: mknod d8/c14 0 2024-09-13T22:55:53.206 INFO:tasks.workunit.client.1.smithi047.stdout:2/106: chown d1/f3 0 1 2024-09-13T22:55:53.208 INFO:tasks.workunit.client.1.smithi047.stdout:5/21: mknod c7 0 2024-09-13T22:55:53.209 INFO:tasks.workunit.client.1.smithi047.stdout:9/37: mkdir d1/dc 0 2024-09-13T22:55:53.213 INFO:tasks.workunit.client.1.smithi047.stdout:7/17: dwrite d0/f2 [0,4194304] 0 2024-09-13T22:55:53.214 INFO:tasks.workunit.client.1.smithi047.stdout:2/107: write d1/de/f13 [2220470,50089] 0 2024-09-13T22:55:53.214 INFO:tasks.workunit.client.1.smithi047.stdout:5/22: unlink c7 0 2024-09-13T22:55:53.216 INFO:tasks.workunit.client.1.smithi047.stdout:1/36: fdatasync d0/f5 0 2024-09-13T22:55:53.218 INFO:tasks.workunit.client.1.smithi047.stdout:9/38: dread d1/f5 [0,4194304] 0 2024-09-13T22:55:53.218 INFO:tasks.workunit.client.1.smithi047.stdout:5/23: write f5 [4124341,42302] 0 2024-09-13T22:55:53.220 INFO:tasks.workunit.client.1.smithi047.stdout:7/18: write d0/d7/f6 [311399,40737] 0 2024-09-13T22:55:53.221 INFO:tasks.workunit.client.1.smithi047.stdout:9/39: fdatasync d1/d6/fb 0 2024-09-13T22:55:53.222 INFO:tasks.workunit.client.1.smithi047.stdout:6/72: dwrite d3/f14 [0,4194304] 0 2024-09-13T22:55:53.222 INFO:tasks.workunit.client.1.smithi047.stdout:5/24: symlink l8 0 2024-09-13T22:55:53.225 INFO:tasks.workunit.client.1.smithi047.stdout:1/37: rename d0/d6 to d0/d7 0 2024-09-13T22:55:53.228 INFO:tasks.workunit.client.1.smithi047.stdout:7/19: mkdir d0/d7/da 0 2024-09-13T22:55:53.228 INFO:tasks.workunit.client.1.smithi047.stdout:2/108: dread d1/f14 [0,4194304] 0 2024-09-13T22:55:53.228 INFO:tasks.workunit.client.1.smithi047.stdout:1/38: write d0/f5 [3666207,2045] 0 2024-09-13T22:55:53.233 INFO:tasks.workunit.client.1.smithi047.stdout:5/25: rename l0 to l9 0 2024-09-13T22:55:53.233 INFO:tasks.workunit.client.1.smithi047.stdout:7/20: write d0/f2 [1002454,57777] 0 2024-09-13T22:55:53.233 INFO:tasks.workunit.client.1.smithi047.stdout:1/39: write d0/f5 [1811612,80332] 0 2024-09-13T22:55:53.234 INFO:tasks.workunit.client.1.smithi047.stdout:8/59: write d8/f9 [534524,121136] 0 2024-09-13T22:55:53.234 INFO:tasks.workunit.client.1.smithi047.stdout:7/21: write d0/f2 [860786,43300] 0 2024-09-13T22:55:53.234 INFO:tasks.workunit.client.1.smithi047.stdout:9/40: dread d1/d6/d8/f9 [0,4194304] 0 2024-09-13T22:55:53.235 INFO:tasks.workunit.client.1.smithi047.stdout:1/40: chown d0/f5 1 1 2024-09-13T22:55:53.238 INFO:tasks.workunit.client.1.smithi047.stdout:1/41: write d0/f5 [671725,57404] 0 2024-09-13T22:55:53.238 INFO:tasks.workunit.client.1.smithi047.stdout:5/26: mknod ca 0 2024-09-13T22:55:53.240 INFO:tasks.workunit.client.1.smithi047.stdout:2/109: dread d1/de/f13 [0,4194304] 0 2024-09-13T22:55:53.241 INFO:tasks.workunit.client.1.smithi047.stdout:2/110: chown d1/f10 100713 1 2024-09-13T22:55:53.243 INFO:tasks.workunit.client.1.smithi047.stdout:6/73: link d3/f6 d3/d15/f1b 0 2024-09-13T22:55:53.244 INFO:tasks.workunit.client.1.smithi047.stdout:7/22: dwrite d0/f2 [0,4194304] 0 2024-09-13T22:55:53.245 INFO:tasks.workunit.client.1.smithi047.stdout:6/74: write d3/f9 [1717685,19280] 0 2024-09-13T22:55:53.246 INFO:tasks.workunit.client.1.smithi047.stdout:7/23: truncate d0/d7/f6 1331736 0 2024-09-13T22:55:53.247 INFO:tasks.workunit.client.1.smithi047.stdout:6/75: truncate d3/ff 1992011 0 2024-09-13T22:55:53.250 INFO:tasks.workunit.client.1.smithi047.stdout:9/41: rename d1/d6/d8 to d1/d6/dd 0 2024-09-13T22:55:53.252 INFO:tasks.workunit.client.1.smithi047.stdout:9/42: truncate d1/d6/fb 664124 0 2024-09-13T22:55:53.252 INFO:tasks.workunit.client.1.smithi047.stdout:1/42: symlink d0/d7/l8 0 2024-09-13T22:55:53.256 INFO:tasks.workunit.client.1.smithi047.stdout:7/24: mkdir d0/db 0 2024-09-13T22:55:53.259 INFO:tasks.workunit.client.1.smithi047.stdout:6/76: truncate f1 803380 0 2024-09-13T22:55:53.259 INFO:tasks.workunit.client.1.smithi047.stdout:8/60: write f6 [1054606,18176] 0 2024-09-13T22:55:53.260 INFO:tasks.workunit.client.1.smithi047.stdout:9/43: dread d1/d6/dd/f9 [0,4194304] 0 2024-09-13T22:55:53.261 INFO:tasks.workunit.client.1.smithi047.stdout:6/77: write d3/f9 [1108098,39433] 0 2024-09-13T22:55:53.262 INFO:tasks.workunit.client.1.smithi047.stdout:9/44: rename d1 to d1/d6/de 22 2024-09-13T22:55:53.262 INFO:tasks.workunit.client.1.smithi047.stdout:5/27: rename l9 to lb 0 2024-09-13T22:55:53.263 INFO:tasks.workunit.client.1.smithi047.stdout:2/111: dwrite d1/f14 [0,4194304] 0 2024-09-13T22:55:53.264 INFO:tasks.workunit.client.1.smithi047.stdout:8/61: rename d8/c14 to d8/c15 0 2024-09-13T22:55:53.265 INFO:tasks.workunit.client.1.smithi047.stdout:5/28: write f5 [2134524,42213] 0 2024-09-13T22:55:53.267 INFO:tasks.workunit.client.1.smithi047.stdout:7/25: creat d0/db/fc x:0 0 0 2024-09-13T22:55:53.268 INFO:tasks.workunit.client.1.smithi047.stdout:7/26: readlink - no filename 2024-09-13T22:55:53.270 INFO:tasks.workunit.client.1.smithi047.stdout:5/29: dread f5 [0,4194304] 0 2024-09-13T22:55:53.271 INFO:tasks.workunit.client.1.smithi047.stdout:8/62: mknod d8/c16 0 2024-09-13T22:55:53.272 INFO:tasks.workunit.client.1.smithi047.stdout:2/112: mkdir d1/df/d28 0 2024-09-13T22:55:53.273 INFO:tasks.workunit.client.1.smithi047.stdout:5/30: truncate f5 5210384 0 2024-09-13T22:55:53.274 INFO:tasks.workunit.client.1.smithi047.stdout:7/27: dread d0/d7/f6 [0,4194304] 0 2024-09-13T22:55:53.275 INFO:tasks.workunit.client.1.smithi047.stdout:9/45: mknod d1/dc/cf 0 2024-09-13T22:55:53.276 INFO:tasks.workunit.client.1.smithi047.stdout:9/46: readlink d1/la 0 2024-09-13T22:55:53.277 INFO:tasks.workunit.client.1.smithi047.stdout:9/47: stat d1/dc 0 2024-09-13T22:55:53.280 INFO:tasks.workunit.client.1.smithi047.stdout:7/28: dread d0/f8 [0,4194304] 0 2024-09-13T22:55:53.281 INFO:tasks.workunit.client.1.smithi047.stdout:7/29: dread - d0/db/fc zero size 2024-09-13T22:55:53.282 INFO:tasks.workunit.client.1.smithi047.stdout:5/31: dwrite f5 [0,4194304] 0 2024-09-13T22:55:53.283 INFO:tasks.workunit.client.1.smithi047.stdout:1/43: truncate d0/f5 4758761 0 2024-09-13T22:55:53.287 INFO:tasks.workunit.client.1.smithi047.stdout:7/30: mknod d0/db/cd 0 2024-09-13T22:55:53.291 INFO:tasks.workunit.client.1.smithi047.stdout:5/32: rename ca to cc 0 2024-09-13T22:55:53.293 INFO:tasks.workunit.client.1.smithi047.stdout:6/78: truncate d3/f14 1990041 0 2024-09-13T22:55:53.296 INFO:tasks.workunit.client.1.smithi047.stdout:5/33: mknod cd 0 2024-09-13T22:55:53.297 INFO:tasks.workunit.client.1.smithi047.stdout:6/79: unlink d3/d15/f1b 0 2024-09-13T22:55:53.299 INFO:tasks.workunit.client.1.smithi047.stdout:5/34: mknod ce 0 2024-09-13T22:55:53.300 INFO:tasks.workunit.client.1.smithi047.stdout:9/48: getdents d1/d6/dd 0 2024-09-13T22:55:53.301 INFO:tasks.workunit.client.1.smithi047.stdout:9/49: dread d1/f5 [0,4194304] 0 2024-09-13T22:55:53.302 INFO:tasks.workunit.client.1.smithi047.stdout:1/44: getdents d0 0 2024-09-13T22:55:53.303 INFO:tasks.workunit.client.1.smithi047.stdout:9/50: truncate d1/f5 1230554 0 2024-09-13T22:55:53.304 INFO:tasks.workunit.client.1.smithi047.stdout:9/51: truncate d1/d6/fb 1034750 0 2024-09-13T22:55:53.305 INFO:tasks.workunit.client.1.smithi047.stdout:9/52: chown d1/f5 153288 1 2024-09-13T22:55:53.305 INFO:tasks.workunit.client.1.smithi047.stdout:1/45: creat d0/f9 x:0 0 0 2024-09-13T22:55:53.307 INFO:tasks.workunit.client.1.smithi047.stdout:9/53: rmdir d1 39 2024-09-13T22:55:53.309 INFO:tasks.workunit.client.1.smithi047.stdout:5/35: link c2 cf 0 2024-09-13T22:55:53.314 INFO:tasks.workunit.client.1.smithi047.stdout:9/54: fsync d1/d6/dd/f9 0 2024-09-13T22:55:53.315 INFO:tasks.workunit.client.1.smithi047.stdout:9/55: fdatasync d1/f5 0 2024-09-13T22:55:53.315 INFO:tasks.workunit.client.1.smithi047.stdout:9/56: rename d1 to d1/d6/d10 22 2024-09-13T22:55:53.325 INFO:tasks.workunit.client.1.smithi047.stdout:9/57: truncate d1/f5 1055052 0 2024-09-13T22:55:53.325 INFO:tasks.workunit.client.1.smithi047.stdout:1/46: write d0/f5 [3725470,94547] 0 2024-09-13T22:55:53.327 INFO:tasks.workunit.client.1.smithi047.stdout:1/47: write d0/f9 [881707,108288] 0 2024-09-13T22:55:53.329 INFO:tasks.workunit.client.1.smithi047.stdout:9/58: fsync d1/f5 0 2024-09-13T22:55:53.332 INFO:tasks.workunit.client.1.smithi047.stdout:9/59: mknod d1/c11 0 2024-09-13T22:55:53.337 INFO:tasks.workunit.client.1.smithi047.stdout:9/60: dwrite d1/d6/fb [0,4194304] 0 2024-09-13T22:55:53.342 INFO:tasks.workunit.client.1.smithi047.stdout:9/61: dread d1/d6/fb [0,4194304] 0 2024-09-13T22:55:53.345 INFO:tasks.workunit.client.1.smithi047.stdout:9/62: mknod d1/d6/c12 0 2024-09-13T22:55:53.346 INFO:tasks.workunit.client.1.smithi047.stdout:9/63: creat d1/d6/f13 x:0 0 0 2024-09-13T22:55:53.350 INFO:tasks.workunit.client.1.smithi047.stdout:9/64: dread d1/f5 [0,4194304] 0 2024-09-13T22:55:53.351 INFO:tasks.workunit.client.1.smithi047.stdout:9/65: chown d1/d6/c12 934898 1 2024-09-13T22:55:53.352 INFO:tasks.workunit.client.1.smithi047.stdout:9/66: dread - d1/d6/f13 zero size 2024-09-13T22:55:53.391 INFO:tasks.workunit.client.0.smithi002.stderr:++ readlink -f fsstress 2024-09-13T22:55:53.393 INFO:tasks.workunit.client.0.smithi002.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T22:55:53.393 INFO:tasks.workunit.client.0.smithi002.stderr:+ popd 2024-09-13T22:55:53.394 INFO:tasks.workunit.client.0.smithi002.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T22:55:53.394 INFO:tasks.workunit.client.0.smithi002.stderr:+ popd 2024-09-13T22:55:53.394 INFO:tasks.workunit.client.0.smithi002.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-13T22:55:53.395 INFO:tasks.workunit.client.0.smithi002.stderr:++ mktemp -d -p . 2024-09-13T22:55:53.397 INFO:tasks.workunit.client.0.smithi002.stderr:+ T=./tmp.aZ5cjkQ7kR 2024-09-13T22:55:53.397 INFO:tasks.workunit.client.0.smithi002.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.aZ5cjkQ7kR -l 1 -n 1000 -p 10 -v 2024-09-13T22:55:53.400 INFO:tasks.workunit.client.0.smithi002.stdout:seed = 1726143671 2024-09-13T22:55:53.404 INFO:tasks.workunit.client.0.smithi002.stdout:0/0: chown . 3 1 2024-09-13T22:55:53.404 INFO:tasks.workunit.client.0.smithi002.stdout:0/1: dwrite - no filename 2024-09-13T22:55:53.404 INFO:tasks.workunit.client.0.smithi002.stdout:0/2: stat - no entries 2024-09-13T22:55:53.404 INFO:tasks.workunit.client.0.smithi002.stdout:0/3: chown . 324328425 1 2024-09-13T22:55:53.404 INFO:tasks.workunit.client.0.smithi002.stdout:0/4: fdatasync - no filename 2024-09-13T22:55:53.405 INFO:tasks.workunit.client.0.smithi002.stdout:0/5: dwrite - no filename 2024-09-13T22:55:53.405 INFO:tasks.workunit.client.0.smithi002.stdout:0/6: truncate - no filename 2024-09-13T22:55:53.405 INFO:tasks.workunit.client.0.smithi002.stdout:0/7: dread - no filename 2024-09-13T22:55:53.405 INFO:tasks.workunit.client.0.smithi002.stdout:0/8: write - no filename 2024-09-13T22:55:53.405 INFO:tasks.workunit.client.0.smithi002.stdout:0/9: rename - no filename 2024-09-13T22:55:53.405 INFO:tasks.workunit.client.0.smithi002.stdout:1/0: dwrite - no filename 2024-09-13T22:55:53.406 INFO:tasks.workunit.client.0.smithi002.stdout:1/1: chown . 2886 1 2024-09-13T22:55:53.406 INFO:tasks.workunit.client.0.smithi002.stdout:0/10: creat f0 x:0 0 0 2024-09-13T22:55:53.407 INFO:tasks.workunit.client.0.smithi002.stdout:0/11: mkdir d1 0 2024-09-13T22:55:53.407 INFO:tasks.workunit.client.0.smithi002.stdout:2/0: rmdir - no directory 2024-09-13T22:55:53.407 INFO:tasks.workunit.client.0.smithi002.stdout:2/1: rmdir - no directory 2024-09-13T22:55:53.407 INFO:tasks.workunit.client.0.smithi002.stdout:2/2: dread - no filename 2024-09-13T22:55:53.407 INFO:tasks.workunit.client.0.smithi002.stdout:2/3: dwrite - no filename 2024-09-13T22:55:53.408 INFO:tasks.workunit.client.0.smithi002.stdout:1/2: creat f0 x:0 0 0 2024-09-13T22:55:53.409 INFO:tasks.workunit.client.0.smithi002.stdout:1/3: mkdir d1 0 2024-09-13T22:55:53.410 INFO:tasks.workunit.client.0.smithi002.stdout:0/12: mkdir d1/d2 0 2024-09-13T22:55:53.410 INFO:tasks.workunit.client.0.smithi002.stdout:2/4: symlink l0 0 2024-09-13T22:55:53.410 INFO:tasks.workunit.client.0.smithi002.stdout:1/4: truncate f0 286879 0 2024-09-13T22:55:53.412 INFO:tasks.workunit.client.0.smithi002.stdout:2/5: mkdir d1 0 2024-09-13T22:55:53.412 INFO:tasks.workunit.client.0.smithi002.stdout:2/6: dwrite - no filename 2024-09-13T22:55:53.412 INFO:tasks.workunit.client.0.smithi002.stdout:2/7: write - no filename 2024-09-13T22:55:53.413 INFO:tasks.workunit.client.0.smithi002.stdout:3/0: creat f0 x:0 0 0 2024-09-13T22:55:53.413 INFO:tasks.workunit.client.0.smithi002.stdout:0/13: symlink d1/d2/l3 0 2024-09-13T22:55:53.413 INFO:tasks.workunit.client.0.smithi002.stdout:0/14: dread - f0 zero size 2024-09-13T22:55:53.414 INFO:tasks.workunit.client.0.smithi002.stdout:5/0: write - no filename 2024-09-13T22:55:53.414 INFO:tasks.workunit.client.0.smithi002.stdout:1/5: mkdir d1/d2 0 2024-09-13T22:55:53.414 INFO:tasks.workunit.client.0.smithi002.stdout:0/15: fdatasync f0 0 2024-09-13T22:55:53.415 INFO:tasks.workunit.client.0.smithi002.stdout:3/1: mknod c1 0 2024-09-13T22:55:53.416 INFO:tasks.workunit.client.0.smithi002.stdout:0/16: readlink d1/d2/l3 0 2024-09-13T22:55:53.417 INFO:tasks.workunit.client.0.smithi002.stdout:2/8: creat d1/f2 x:0 0 0 2024-09-13T22:55:53.418 INFO:tasks.workunit.client.0.smithi002.stdout:6/0: fdatasync - no filename 2024-09-13T22:55:53.418 INFO:tasks.workunit.client.0.smithi002.stdout:6/1: readlink - no filename 2024-09-13T22:55:53.418 INFO:tasks.workunit.client.0.smithi002.stdout:4/0: creat f0 x:0 0 0 2024-09-13T22:55:53.418 INFO:tasks.workunit.client.0.smithi002.stdout:5/1: mknod c0 0 2024-09-13T22:55:53.418 INFO:tasks.workunit.client.0.smithi002.stdout:5/2: dread - no filename 2024-09-13T22:55:53.419 INFO:tasks.workunit.client.0.smithi002.stdout:5/3: write - no filename 2024-09-13T22:55:53.419 INFO:tasks.workunit.client.0.smithi002.stdout:5/4: dread - no filename 2024-09-13T22:55:53.420 INFO:tasks.workunit.client.0.smithi002.stdout:2/9: dread - d1/f2 zero size 2024-09-13T22:55:53.420 INFO:tasks.workunit.client.0.smithi002.stdout:7/0: write - no filename 2024-09-13T22:55:53.420 INFO:tasks.workunit.client.0.smithi002.stdout:7/1: unlink - no file 2024-09-13T22:55:53.421 INFO:tasks.workunit.client.0.smithi002.stdout:0/17: mkdir d1/d4 0 2024-09-13T22:55:53.421 INFO:tasks.workunit.client.0.smithi002.stdout:5/5: chown c0 138903392 1 2024-09-13T22:55:53.421 INFO:tasks.workunit.client.0.smithi002.stdout:4/1: truncate f0 533580 0 2024-09-13T22:55:53.422 INFO:tasks.workunit.client.0.smithi002.stdout:2/10: chown d1/f2 1 1 2024-09-13T22:55:53.423 INFO:tasks.workunit.client.0.smithi002.stdout:6/2: symlink l0 0 2024-09-13T22:55:53.423 INFO:tasks.workunit.client.0.smithi002.stdout:6/3: dread - no filename 2024-09-13T22:55:53.423 INFO:tasks.workunit.client.0.smithi002.stdout:1/6: rmdir d1/d2 0 2024-09-13T22:55:53.423 INFO:tasks.workunit.client.0.smithi002.stdout:8/0: dread - no filename 2024-09-13T22:55:53.423 INFO:tasks.workunit.client.0.smithi002.stdout:8/1: unlink - no file 2024-09-13T22:55:53.424 INFO:tasks.workunit.client.0.smithi002.stdout:5/6: mkdir d1 0 2024-09-13T22:55:53.424 INFO:tasks.workunit.client.0.smithi002.stdout:5/7: truncate - no filename 2024-09-13T22:55:53.424 INFO:tasks.workunit.client.0.smithi002.stdout:5/8: write - no filename 2024-09-13T22:55:53.424 INFO:tasks.workunit.client.0.smithi002.stdout:4/2: write f0 [828318,97710] 0 2024-09-13T22:55:53.424 INFO:tasks.workunit.client.0.smithi002.stdout:1/7: chown d1 8095710 1 2024-09-13T22:55:53.425 INFO:tasks.workunit.client.0.smithi002.stdout:0/18: mknod d1/d2/c5 0 2024-09-13T22:55:53.425 INFO:tasks.workunit.client.0.smithi002.stdout:5/9: chown c0 357899971 1 2024-09-13T22:55:53.425 INFO:tasks.workunit.client.0.smithi002.stdout:9/0: dwrite - no filename 2024-09-13T22:55:53.427 INFO:tasks.workunit.client.0.smithi002.stdout:6/4: creat f1 x:0 0 0 2024-09-13T22:55:53.427 INFO:tasks.workunit.client.0.smithi002.stdout:6/5: rmdir - no directory 2024-09-13T22:55:53.429 INFO:tasks.workunit.client.0.smithi002.stdout:0/19: symlink d1/l6 0 2024-09-13T22:55:53.430 INFO:tasks.workunit.client.0.smithi002.stdout:1/8: dread f0 [0,4194304] 0 2024-09-13T22:55:53.430 INFO:tasks.workunit.client.0.smithi002.stdout:2/11: truncate d1/f2 733817 0 2024-09-13T22:55:53.430 INFO:tasks.workunit.client.0.smithi002.stdout:8/2: creat f0 x:0 0 0 2024-09-13T22:55:53.431 INFO:tasks.workunit.client.0.smithi002.stdout:0/20: stat d1/d2/l3 0 2024-09-13T22:55:53.432 INFO:tasks.workunit.client.0.smithi002.stdout:8/3: dread - f0 zero size 2024-09-13T22:55:53.434 INFO:tasks.workunit.client.0.smithi002.stdout:3/2: dwrite f0 [0,4194304] 0 2024-09-13T22:55:53.434 INFO:tasks.workunit.client.0.smithi002.stdout:6/6: creat f2 x:0 0 0 2024-09-13T22:55:53.434 INFO:tasks.workunit.client.0.smithi002.stdout:4/3: link f0 f1 0 2024-09-13T22:55:53.434 INFO:tasks.workunit.client.0.smithi002.stdout:2/12: write d1/f2 [1168510,57824] 0 2024-09-13T22:55:53.436 INFO:tasks.workunit.client.0.smithi002.stdout:5/10: getdents d1 0 2024-09-13T22:55:53.438 INFO:tasks.workunit.client.0.smithi002.stdout:9/1: creat f0 x:0 0 0 2024-09-13T22:55:53.439 INFO:tasks.workunit.client.0.smithi002.stdout:4/4: read f1 [110772,65377] 0 2024-09-13T22:55:53.440 INFO:tasks.workunit.client.0.smithi002.stdout:8/4: mkdir d1 0 2024-09-13T22:55:53.440 INFO:tasks.workunit.client.0.smithi002.stdout:3/3: symlink l2 0 2024-09-13T22:55:53.441 INFO:tasks.workunit.client.0.smithi002.stdout:6/7: symlink l3 0 2024-09-13T22:55:53.443 INFO:tasks.workunit.client.0.smithi002.stdout:8/5: write f0 [262022,108015] 0 2024-09-13T22:55:53.446 INFO:tasks.workunit.client.0.smithi002.stdout:9/2: creat f1 x:0 0 0 2024-09-13T22:55:53.446 INFO:tasks.workunit.client.0.smithi002.stdout:9/3: readlink - no filename 2024-09-13T22:55:53.447 INFO:tasks.workunit.client.0.smithi002.stdout:3/4: rename f0 to f3 0 2024-09-13T22:55:53.451 INFO:tasks.workunit.client.0.smithi002.stdout:0/21: rename f0 to d1/d4/f7 0 2024-09-13T22:55:53.451 INFO:tasks.workunit.client.0.smithi002.stdout:3/5: truncate f3 4591527 0 2024-09-13T22:55:53.453 INFO:tasks.workunit.client.0.smithi002.stdout:1/9: dwrite f0 [0,4194304] 0 2024-09-13T22:55:53.455 INFO:tasks.workunit.client.0.smithi002.stdout:9/4: symlink l2 0 2024-09-13T22:55:53.456 INFO:tasks.workunit.client.0.smithi002.stdout:5/11: rename d1 to d1/d2 22 2024-09-13T22:55:53.456 INFO:tasks.workunit.client.0.smithi002.stdout:5/12: fdatasync - no filename 2024-09-13T22:55:53.456 INFO:tasks.workunit.client.0.smithi002.stdout:5/13: write - no filename 2024-09-13T22:55:53.458 INFO:tasks.workunit.client.0.smithi002.stdout:5/14: stat c0 0 2024-09-13T22:55:53.459 INFO:tasks.workunit.client.0.smithi002.stdout:5/15: chown d1 185902797 1 2024-09-13T22:55:53.459 INFO:tasks.workunit.client.0.smithi002.stdout:5/16: dwrite - no filename 2024-09-13T22:55:53.459 INFO:tasks.workunit.client.0.smithi002.stdout:9/5: readlink l2 0 2024-09-13T22:55:53.460 INFO:tasks.workunit.client.0.smithi002.stdout:8/6: dwrite f0 [0,4194304] 0 2024-09-13T22:55:53.462 INFO:tasks.workunit.client.0.smithi002.stdout:3/6: mknod c4 0 2024-09-13T22:55:53.462 INFO:tasks.workunit.client.0.smithi002.stdout:0/22: mknod d1/d2/c8 0 2024-09-13T22:55:53.463 INFO:tasks.workunit.client.0.smithi002.stdout:9/6: mknod c3 0 2024-09-13T22:55:53.465 INFO:tasks.workunit.client.0.smithi002.stdout:9/7: chown l2 20838738 1 2024-09-13T22:55:53.467 INFO:tasks.workunit.client.0.smithi002.stdout:3/7: write f3 [3459899,91569] 0 2024-09-13T22:55:53.468 INFO:tasks.workunit.client.0.smithi002.stdout:5/17: creat d1/f3 x:0 0 0 2024-09-13T22:55:53.469 INFO:tasks.workunit.client.0.smithi002.stdout:5/18: readlink - no filename 2024-09-13T22:55:53.469 INFO:tasks.workunit.client.0.smithi002.stdout:1/10: dwrite f0 [0,4194304] 0 2024-09-13T22:55:53.469 INFO:tasks.workunit.client.0.smithi002.stdout:1/11: readlink - no filename 2024-09-13T22:55:53.472 INFO:tasks.workunit.client.0.smithi002.stdout:0/23: write d1/d4/f7 [987649,48856] 0 2024-09-13T22:55:53.473 INFO:tasks.workunit.client.0.smithi002.stdout:8/7: getdents d1 0 2024-09-13T22:55:53.473 INFO:tasks.workunit.client.0.smithi002.stdout:5/19: creat d1/f4 x:0 0 0 2024-09-13T22:55:53.475 INFO:tasks.workunit.client.0.smithi002.stdout:8/8: chown f0 2 1 2024-09-13T22:55:53.476 INFO:tasks.workunit.client.0.smithi002.stdout:3/8: creat f5 x:0 0 0 2024-09-13T22:55:53.481 INFO:tasks.workunit.client.0.smithi002.stdout:3/9: creat f6 x:0 0 0 2024-09-13T22:55:53.483 INFO:tasks.workunit.client.0.smithi002.stdout:6/8: getdents . 0 2024-09-13T22:55:53.484 INFO:tasks.workunit.client.0.smithi002.stdout:0/24: fsync d1/d4/f7 0 2024-09-13T22:55:53.484 INFO:tasks.workunit.client.0.smithi002.stdout:1/12: fdatasync f0 0 2024-09-13T22:55:53.486 INFO:tasks.workunit.client.0.smithi002.stdout:3/10: write f5 [520241,84191] 0 2024-09-13T22:55:53.487 INFO:tasks.workunit.client.0.smithi002.stdout:9/8: dwrite f0 [0,4194304] 0 2024-09-13T22:55:53.490 INFO:tasks.workunit.client.0.smithi002.stdout:6/9: write f1 [430927,90191] 0 2024-09-13T22:55:53.495 INFO:tasks.workunit.client.0.smithi002.stdout:5/20: dwrite d1/f3 [0,4194304] 0 2024-09-13T22:55:53.496 INFO:tasks.workunit.client.0.smithi002.stdout:8/9: dwrite f0 [0,4194304] 0 2024-09-13T22:55:53.504 INFO:tasks.workunit.client.0.smithi002.stdout:0/25: rename d1/d2/c5 to d1/d2/c9 0 2024-09-13T22:55:53.505 INFO:tasks.workunit.client.0.smithi002.stdout:6/10: rename l0 to l4 0 2024-09-13T22:55:53.506 INFO:tasks.workunit.client.0.smithi002.stdout:0/26: stat d1/d2 0 2024-09-13T22:55:53.509 INFO:tasks.workunit.client.0.smithi002.stdout:5/21: unlink d1/f4 0 2024-09-13T22:55:53.510 INFO:tasks.workunit.client.0.smithi002.stdout:3/11: dread f5 [0,4194304] 0 2024-09-13T22:55:53.513 INFO:tasks.workunit.client.0.smithi002.stdout:3/12: readlink l2 0 2024-09-13T22:55:53.513 INFO:tasks.workunit.client.0.smithi002.stdout:8/10: getdents d1 0 2024-09-13T22:55:53.515 INFO:tasks.workunit.client.0.smithi002.stdout:0/27: creat d1/fa x:0 0 0 2024-09-13T22:55:53.515 INFO:tasks.workunit.client.0.smithi002.stdout:5/22: mknod d1/c5 0 2024-09-13T22:55:53.517 INFO:tasks.workunit.client.0.smithi002.stdout:6/11: dread f1 [0,4194304] 0 2024-09-13T22:55:53.517 INFO:tasks.workunit.client.0.smithi002.stdout:1/13: dwrite f0 [4194304,4194304] 0 2024-09-13T22:55:53.517 INFO:tasks.workunit.client.0.smithi002.stdout:3/13: mknod c7 0 2024-09-13T22:55:53.517 INFO:tasks.workunit.client.0.smithi002.stdout:9/9: dwrite f1 [0,4194304] 0 2024-09-13T22:55:53.519 INFO:tasks.workunit.client.0.smithi002.stdout:8/11: unlink f0 0 2024-09-13T22:55:53.519 INFO:tasks.workunit.client.0.smithi002.stdout:0/28: read - d1/fa zero size 2024-09-13T22:55:53.520 INFO:tasks.workunit.client.0.smithi002.stdout:3/14: mknod c8 0 2024-09-13T22:55:53.521 INFO:tasks.workunit.client.0.smithi002.stdout:6/12: dread - f2 zero size 2024-09-13T22:55:53.521 INFO:tasks.workunit.client.0.smithi002.stdout:9/10: read f1 [592011,131031] 0 2024-09-13T22:55:53.522 INFO:tasks.workunit.client.0.smithi002.stdout:9/11: fdatasync f0 0 2024-09-13T22:55:53.523 INFO:tasks.workunit.client.0.smithi002.stdout:0/29: write d1/d4/f7 [274256,11051] 0 2024-09-13T22:55:53.524 INFO:tasks.workunit.client.0.smithi002.stdout:9/12: readlink l2 0 2024-09-13T22:55:53.524 INFO:tasks.workunit.client.0.smithi002.stdout:6/13: truncate f2 804632 0 2024-09-13T22:55:53.524 INFO:tasks.workunit.client.0.smithi002.stdout:1/14: mknod d1/c3 0 2024-09-13T22:55:53.528 INFO:tasks.workunit.client.0.smithi002.stdout:3/15: unlink c1 0 2024-09-13T22:55:53.528 INFO:tasks.workunit.client.0.smithi002.stdout:6/14: dread f1 [0,4194304] 0 2024-09-13T22:55:53.532 INFO:tasks.workunit.client.0.smithi002.stdout:5/23: dread d1/f3 [0,4194304] 0 2024-09-13T22:55:53.532 INFO:tasks.workunit.client.0.smithi002.stdout:9/13: creat f4 x:0 0 0 2024-09-13T22:55:53.535 INFO:tasks.workunit.client.0.smithi002.stdout:5/24: rename d1 to d1/d6 22 2024-09-13T22:55:53.539 INFO:tasks.workunit.client.0.smithi002.stdout:8/12: rmdir d1 0 2024-09-13T22:55:53.542 INFO:tasks.workunit.client.0.smithi002.stdout:1/15: dwrite f0 [4194304,4194304] 0 2024-09-13T22:55:53.544 INFO:tasks.workunit.client.0.smithi002.stdout:5/25: fdatasync d1/f3 0 2024-09-13T22:55:53.545 INFO:tasks.workunit.client.0.smithi002.stdout:0/30: dwrite d1/d4/f7 [0,4194304] 0 2024-09-13T22:55:53.547 INFO:tasks.workunit.client.0.smithi002.stdout:8/13: creat f2 x:0 0 0 2024-09-13T22:55:53.551 INFO:tasks.workunit.client.0.smithi002.stdout:9/14: dwrite f4 [0,4194304] 0 2024-09-13T22:55:53.552 INFO:tasks.workunit.client.0.smithi002.stdout:6/15: truncate f2 721440 0 2024-09-13T22:55:53.553 INFO:tasks.workunit.client.0.smithi002.stdout:3/16: getdents . 0 2024-09-13T22:55:53.553 INFO:tasks.workunit.client.0.smithi002.stdout:3/17: rmdir - no directory 2024-09-13T22:55:53.553 INFO:tasks.workunit.client.1.smithi047.stdout:8/63: sync 2024-09-13T22:55:53.553 INFO:tasks.workunit.client.1.smithi047.stdout:4/36: sync 2024-09-13T22:55:53.553 INFO:tasks.workunit.client.1.smithi047.stdout:3/54: sync 2024-09-13T22:55:53.554 INFO:tasks.workunit.client.1.smithi047.stdout:0/40: sync 2024-09-13T22:55:53.554 INFO:tasks.workunit.client.0.smithi002.stdout:1/16: rename f0 to d1/f4 0 2024-09-13T22:55:53.554 INFO:tasks.workunit.client.0.smithi002.stdout:5/26: symlink d1/l7 0 2024-09-13T22:55:53.555 INFO:tasks.workunit.client.1.smithi047.stdout:3/55: dread - d0/d3/d4/f9 zero size 2024-09-13T22:55:53.555 INFO:tasks.workunit.client.1.smithi047.stdout:0/41: write d1/d5/f9 [4204052,73501] 0 2024-09-13T22:55:53.555 INFO:tasks.workunit.client.0.smithi002.stdout:1/17: read d1/f4 [4760838,18655] 0 2024-09-13T22:55:53.556 INFO:tasks.workunit.client.0.smithi002.stdout:8/14: mkdir d3 0 2024-09-13T22:55:53.556 INFO:tasks.workunit.client.0.smithi002.stdout:9/15: creat f5 x:0 0 0 2024-09-13T22:55:53.557 INFO:tasks.workunit.client.1.smithi047.stdout:4/37: creat f8 x:0 0 0 2024-09-13T22:55:53.558 INFO:tasks.workunit.client.1.smithi047.stdout:4/38: write f6 [691513,123337] 0 2024-09-13T22:55:53.559 INFO:tasks.workunit.client.0.smithi002.stdout:8/15: truncate f2 759008 0 2024-09-13T22:55:53.564 INFO:tasks.workunit.client.0.smithi002.stdout:0/31: dwrite d1/d4/f7 [0,4194304] 0 2024-09-13T22:55:53.565 INFO:tasks.workunit.client.1.smithi047.stdout:8/64: rename d8/f12 to d8/f17 0 2024-09-13T22:55:53.567 INFO:tasks.workunit.client.0.smithi002.stdout:3/18: mkdir d9 0 2024-09-13T22:55:53.569 INFO:tasks.workunit.client.0.smithi002.stdout:5/27: creat d1/f8 x:0 0 0 2024-09-13T22:55:53.570 INFO:tasks.workunit.client.0.smithi002.stdout:1/18: rename d1/c3 to d1/c5 0 2024-09-13T22:55:53.570 INFO:tasks.workunit.client.0.smithi002.stdout:1/19: readlink - no filename 2024-09-13T22:55:53.571 INFO:tasks.workunit.client.1.smithi047.stdout:4/39: mknod c9 0 2024-09-13T22:55:53.571 INFO:tasks.workunit.client.1.smithi047.stdout:4/40: chown f1 3 1 2024-09-13T22:55:53.572 INFO:tasks.workunit.client.0.smithi002.stdout:9/16: dwrite f5 [0,4194304] 0 2024-09-13T22:55:53.573 INFO:tasks.workunit.client.0.smithi002.stdout:9/17: chown f0 1748189353 1 2024-09-13T22:55:53.574 INFO:tasks.workunit.client.1.smithi047.stdout:8/65: symlink d8/l18 0 2024-09-13T22:55:53.575 INFO:tasks.workunit.client.1.smithi047.stdout:0/42: link d1/f2 d1/d7/ff 0 2024-09-13T22:55:53.579 INFO:tasks.workunit.client.0.smithi002.stdout:3/19: rename c8 to d9/ca 0 2024-09-13T22:55:53.580 INFO:tasks.workunit.client.1.smithi047.stdout:4/41: mknod ca 0 2024-09-13T22:55:53.584 INFO:tasks.workunit.client.1.smithi047.stdout:0/43: dwrite d1/f4 [0,4194304] 0 2024-09-13T22:55:53.587 INFO:tasks.workunit.client.1.smithi047.stdout:4/42: dread f6 [0,4194304] 0 2024-09-13T22:55:53.588 INFO:tasks.workunit.client.1.smithi047.stdout:4/43: chown f8 625022 1 2024-09-13T22:55:53.588 INFO:tasks.workunit.client.1.smithi047.stdout:8/66: write d8/f17 [15060,69518] 0 2024-09-13T22:55:53.590 INFO:tasks.workunit.client.1.smithi047.stdout:4/44: truncate f6 1602402 0 2024-09-13T22:55:53.590 INFO:tasks.workunit.client.1.smithi047.stdout:4/45: rmdir - no directory 2024-09-13T22:55:53.590 INFO:tasks.workunit.client.1.smithi047.stdout:8/67: chown d8/f9 78690 1 2024-09-13T22:55:53.590 INFO:tasks.workunit.client.1.smithi047.stdout:8/68: readlink d8/l18 0 2024-09-13T22:55:53.594 INFO:tasks.workunit.client.1.smithi047.stdout:0/44: unlink d1/d5/fc 0 2024-09-13T22:55:53.598 INFO:tasks.workunit.client.0.smithi002.stdout:0/32: link d1/d4/f7 d1/d4/fb 0 2024-09-13T22:55:53.599 INFO:tasks.workunit.client.1.smithi047.stdout:8/69: mknod d8/c19 0 2024-09-13T22:55:53.600 INFO:tasks.workunit.client.0.smithi002.stdout:0/33: write d1/fa [966093,130028] 0 2024-09-13T22:55:53.600 INFO:tasks.workunit.client.1.smithi047.stdout:8/70: read - d8/f13 zero size 2024-09-13T22:55:53.600 INFO:tasks.workunit.client.1.smithi047.stdout:3/56: truncate d0/d3/d4/d6/de/f10 542138 0 2024-09-13T22:55:53.601 INFO:tasks.workunit.client.1.smithi047.stdout:8/71: fsync d8/f13 0 2024-09-13T22:55:53.601 INFO:tasks.workunit.client.1.smithi047.stdout:3/57: readlink d0/d3/d4/l7 0 2024-09-13T22:55:53.602 INFO:tasks.workunit.client.1.smithi047.stdout:3/58: fsync d0/d3/d4/d6/de/f11 0 2024-09-13T22:55:53.603 INFO:tasks.workunit.client.0.smithi002.stdout:1/20: dwrite d1/f4 [0,4194304] 0 2024-09-13T22:55:53.603 INFO:tasks.workunit.client.1.smithi047.stdout:3/59: dread - d0/d3/d4/f9 zero size 2024-09-13T22:55:53.604 INFO:tasks.workunit.client.1.smithi047.stdout:3/60: stat d0/d3/d4/c5 0 2024-09-13T22:55:53.605 INFO:tasks.workunit.client.0.smithi002.stdout:8/16: truncate f2 751263 0 2024-09-13T22:55:53.605 INFO:tasks.workunit.client.1.smithi047.stdout:3/61: write d0/d3/d4/fb [13391,49620] 0 2024-09-13T22:55:53.616 INFO:tasks.workunit.client.0.smithi002.stdout:1/21: fsync d1/f4 0 2024-09-13T22:55:53.617 INFO:tasks.workunit.client.0.smithi002.stdout:1/22: write d1/f4 [764768,38403] 0 2024-09-13T22:55:53.621 INFO:tasks.workunit.client.0.smithi002.stdout:1/23: dread d1/f4 [4194304,4194304] 0 2024-09-13T22:55:53.621 INFO:tasks.workunit.client.0.smithi002.stdout:1/24: fsync d1/f4 0 2024-09-13T22:55:53.622 INFO:tasks.workunit.client.1.smithi047.stdout:3/62: creat d0/f12 x:0 0 0 2024-09-13T22:55:53.628 INFO:tasks.workunit.client.1.smithi047.stdout:3/63: dwrite d0/d3/d4/d6/fa [0,4194304] 0 2024-09-13T22:55:53.630 INFO:tasks.workunit.client.1.smithi047.stdout:4/46: truncate f6 690666 0 2024-09-13T22:55:53.631 INFO:tasks.workunit.client.1.smithi047.stdout:4/47: fsync f1 0 2024-09-13T22:55:53.633 INFO:tasks.workunit.client.1.smithi047.stdout:0/45: dwrite d1/f2 [0,4194304] 0 2024-09-13T22:55:53.642 INFO:tasks.workunit.client.1.smithi047.stdout:8/72: getdents d8 0 2024-09-13T22:55:53.644 INFO:tasks.workunit.client.1.smithi047.stdout:4/48: creat fb x:0 0 0 2024-09-13T22:55:53.645 INFO:tasks.workunit.client.1.smithi047.stdout:4/49: truncate f1 4677038 0 2024-09-13T22:55:53.647 INFO:tasks.workunit.client.1.smithi047.stdout:3/64: rename d0/d3/d4/d6/fa to d0/f13 0 2024-09-13T22:55:53.649 INFO:tasks.workunit.client.1.smithi047.stdout:3/65: dread - d0/f12 zero size 2024-09-13T22:55:53.652 INFO:tasks.workunit.client.1.smithi047.stdout:4/50: dwrite f8 [0,4194304] 0 2024-09-13T22:55:53.654 INFO:tasks.workunit.client.1.smithi047.stdout:0/46: rmdir d1/d5 39 2024-09-13T22:55:53.656 INFO:tasks.workunit.client.1.smithi047.stdout:8/73: rmdir d8 39 2024-09-13T22:55:53.660 INFO:tasks.workunit.client.1.smithi047.stdout:0/47: dwrite d1/f4 [0,4194304] 0 2024-09-13T22:55:53.668 INFO:tasks.workunit.client.1.smithi047.stdout:4/51: mkdir dc 0 2024-09-13T22:55:53.670 INFO:tasks.workunit.client.1.smithi047.stdout:0/48: dwrite d1/f4 [0,4194304] 0 2024-09-13T22:55:53.670 INFO:tasks.workunit.client.1.smithi047.stdout:4/52: write f1 [1820554,4081] 0 2024-09-13T22:55:53.712 INFO:tasks.workunit.client.1.smithi047.stdout:8/74: dwrite f1 [0,4194304] 0 2024-09-13T22:55:53.728 INFO:tasks.workunit.client.1.smithi047.stdout:4/53: creat dc/fd x:0 0 0 2024-09-13T22:55:53.734 INFO:tasks.workunit.client.1.smithi047.stdout:8/75: unlink d8/c16 0 2024-09-13T22:55:53.736 INFO:tasks.workunit.client.1.smithi047.stdout:4/54: mkdir dc/de 0 2024-09-13T22:55:53.765 INFO:tasks.workunit.client.1.smithi047.stdout:3/66: dwrite d0/d3/d4/d6/de/f10 [0,4194304] 0 2024-09-13T22:55:53.770 INFO:tasks.workunit.client.1.smithi047.stdout:4/55: fsync f6 0 2024-09-13T22:55:53.770 INFO:tasks.workunit.client.1.smithi047.stdout:4/56: read - fb zero size 2024-09-13T22:55:53.786 INFO:tasks.workunit.client.1.smithi047.stdout:4/57: link ca dc/cf 0 2024-09-13T22:55:53.786 INFO:tasks.workunit.client.1.smithi047.stdout:4/58: readlink - no filename 2024-09-13T22:55:53.787 INFO:tasks.workunit.client.1.smithi047.stdout:4/59: dread - dc/fd zero size 2024-09-13T22:55:53.787 INFO:tasks.workunit.client.1.smithi047.stdout:3/67: getdents d0/d3/d4/d6 0 2024-09-13T22:55:53.788 INFO:tasks.workunit.client.1.smithi047.stdout:0/49: truncate d1/d5/f9 1618968 0 2024-09-13T22:55:53.792 INFO:tasks.workunit.client.1.smithi047.stdout:3/68: dread d0/d3/d4/d6/de/f10 [0,4194304] 0 2024-09-13T22:55:53.793 INFO:tasks.workunit.client.1.smithi047.stdout:3/69: write d0/f12 [539336,110402] 0 2024-09-13T22:55:53.795 INFO:tasks.workunit.client.1.smithi047.stdout:0/50: creat d1/d5/f10 x:0 0 0 2024-09-13T22:55:53.797 INFO:tasks.workunit.client.1.smithi047.stdout:8/76: truncate f6 677143 0 2024-09-13T22:55:53.798 INFO:tasks.workunit.client.1.smithi047.stdout:4/60: symlink dc/de/l10 0 2024-09-13T22:55:53.802 INFO:tasks.workunit.client.1.smithi047.stdout:3/70: mknod d0/d3/d4/d6/de/c14 0 2024-09-13T22:55:53.803 INFO:tasks.workunit.client.1.smithi047.stdout:4/61: dwrite f1 [4194304,4194304] 0 2024-09-13T22:55:53.803 INFO:tasks.workunit.client.1.smithi047.stdout:4/62: read - fb zero size 2024-09-13T22:55:53.804 INFO:tasks.workunit.client.1.smithi047.stdout:3/71: write d0/d3/d4/fb [642580,13673] 0 2024-09-13T22:55:53.805 INFO:tasks.workunit.client.1.smithi047.stdout:0/51: mkdir d1/d5/d11 0 2024-09-13T22:55:53.805 INFO:tasks.workunit.client.1.smithi047.stdout:0/52: fdatasync d1/d5/f8 0 2024-09-13T22:55:53.815 INFO:tasks.workunit.client.1.smithi047.stdout:3/72: rename d0/d3/d4/fb to d0/d3/f15 0 2024-09-13T22:55:53.817 INFO:tasks.workunit.client.1.smithi047.stdout:8/77: link d8/f9 d8/f1a 0 2024-09-13T22:55:53.818 INFO:tasks.workunit.client.1.smithi047.stdout:8/78: chown d8/c19 747819 1 2024-09-13T22:55:53.826 INFO:tasks.workunit.client.1.smithi047.stdout:0/53: symlink d1/d5/d11/l12 0 2024-09-13T22:55:53.827 INFO:tasks.workunit.client.1.smithi047.stdout:0/54: fdatasync d1/d5/f10 0 2024-09-13T22:55:53.829 INFO:tasks.workunit.client.1.smithi047.stdout:4/63: dwrite f6 [0,4194304] 0 2024-09-13T22:55:53.839 INFO:tasks.workunit.client.1.smithi047.stdout:0/55: mknod d1/d5/c13 0 2024-09-13T22:55:53.840 INFO:tasks.workunit.client.1.smithi047.stdout:2/113: sync 2024-09-13T22:55:53.840 INFO:tasks.workunit.client.1.smithi047.stdout:0/56: stat d1/d7/fe 0 2024-09-13T22:55:53.845 INFO:tasks.workunit.client.1.smithi047.stdout:4/64: chown c7 16 1 2024-09-13T22:55:53.846 INFO:tasks.workunit.client.1.smithi047.stdout:0/57: mknod d1/d5/c14 0 2024-09-13T22:55:53.847 INFO:tasks.workunit.client.1.smithi047.stdout:0/58: chown d1/d5/d11/l12 601997951 1 2024-09-13T22:55:53.857 INFO:tasks.workunit.client.1.smithi047.stdout:7/31: sync 2024-09-13T22:55:53.858 INFO:tasks.workunit.client.1.smithi047.stdout:7/32: chown d0 22 1 2024-09-13T22:55:53.858 INFO:tasks.workunit.client.1.smithi047.stdout:7/33: write d0/db/fc [180890,130700] 0 2024-09-13T22:55:53.867 INFO:tasks.workunit.client.1.smithi047.stdout:4/65: link dc/cf dc/c11 0 2024-09-13T22:55:53.868 INFO:tasks.workunit.client.1.smithi047.stdout:4/66: chown f6 1017258385 1 2024-09-13T22:55:53.868 INFO:tasks.workunit.client.1.smithi047.stdout:4/67: fdatasync fb 0 2024-09-13T22:55:53.875 INFO:tasks.workunit.client.1.smithi047.stdout:3/73: truncate d0/f13 7223185 0 2024-09-13T22:55:53.877 INFO:tasks.workunit.client.1.smithi047.stdout:8/79: truncate d8/f17 43150 0 2024-09-13T22:55:53.878 INFO:tasks.workunit.client.1.smithi047.stdout:4/68: getdents dc/de 0 2024-09-13T22:55:53.882 INFO:tasks.workunit.client.1.smithi047.stdout:8/80: symlink d8/l1b 0 2024-09-13T22:55:53.886 INFO:tasks.workunit.client.1.smithi047.stdout:3/74: mkdir d0/d3/d4/d16 0 2024-09-13T22:55:53.888 INFO:tasks.workunit.client.1.smithi047.stdout:8/81: creat d8/f1c x:0 0 0 2024-09-13T22:55:53.890 INFO:tasks.workunit.client.1.smithi047.stdout:4/69: dwrite f4 [0,4194304] 0 2024-09-13T22:55:53.890 INFO:tasks.workunit.client.1.smithi047.stdout:4/70: fdatasync dc/fd 0 2024-09-13T22:55:53.896 INFO:tasks.workunit.client.1.smithi047.stdout:8/82: creat d8/f1d x:0 0 0 2024-09-13T22:55:53.898 INFO:tasks.workunit.client.1.smithi047.stdout:2/114: truncate d1/de/f13 1964254 0 2024-09-13T22:55:53.902 INFO:tasks.workunit.client.1.smithi047.stdout:2/115: dread d1/d16/f23 [0,4194304] 0 2024-09-13T22:55:53.904 INFO:tasks.workunit.client.1.smithi047.stdout:0/59: truncate d1/f2 3046451 0 2024-09-13T22:55:53.908 INFO:tasks.workunit.client.1.smithi047.stdout:4/71: rmdir dc 39 2024-09-13T22:55:53.914 INFO:tasks.workunit.client.1.smithi047.stdout:2/116: dwrite d1/df/f1b [0,4194304] 0 2024-09-13T22:55:53.916 INFO:tasks.workunit.client.1.smithi047.stdout:0/60: dwrite d1/d7/fe [0,4194304] 0 2024-09-13T22:55:53.917 INFO:tasks.workunit.client.1.smithi047.stdout:0/61: chown d1/d5 1182819183 1 2024-09-13T22:55:53.925 INFO:tasks.workunit.client.1.smithi047.stdout:2/117: mkdir d1/df/d1d/d20/d29 0 2024-09-13T22:55:53.929 INFO:tasks.workunit.client.1.smithi047.stdout:4/72: rename c7 to dc/de/c12 0 2024-09-13T22:55:53.930 INFO:tasks.workunit.client.1.smithi047.stdout:4/73: rename dc/de to dc/de/d13 22 2024-09-13T22:55:53.936 INFO:tasks.workunit.client.1.smithi047.stdout:4/74: creat dc/de/f14 x:0 0 0 2024-09-13T22:55:53.940 INFO:tasks.workunit.client.1.smithi047.stdout:4/75: dread f8 [0,4194304] 0 2024-09-13T22:55:53.943 INFO:tasks.workunit.client.1.smithi047.stdout:2/118: creat d1/f2a x:0 0 0 2024-09-13T22:55:53.945 INFO:tasks.workunit.client.1.smithi047.stdout:0/62: fdatasync d1/d5/f9 0 2024-09-13T22:55:53.950 INFO:tasks.workunit.client.1.smithi047.stdout:4/76: symlink dc/de/l15 0 2024-09-13T22:55:53.951 INFO:tasks.workunit.client.1.smithi047.stdout:8/83: chown f6 364978 1 2024-09-13T22:55:53.953 INFO:tasks.workunit.client.1.smithi047.stdout:2/119: rmdir d1/df/d1d/d20 39 2024-09-13T22:55:53.953 INFO:tasks.workunit.client.1.smithi047.stdout:2/120: dread - d1/f10 zero size 2024-09-13T22:55:53.962 INFO:tasks.workunit.client.1.smithi047.stdout:2/121: unlink d1/df/d1d/l1f 0 2024-09-13T22:55:53.967 INFO:tasks.workunit.client.1.smithi047.stdout:2/122: readlink d1/df/l27 0 2024-09-13T22:55:53.971 INFO:tasks.workunit.client.1.smithi047.stdout:3/75: dwrite d0/f13 [0,4194304] 0 2024-09-13T22:55:53.976 INFO:tasks.workunit.client.1.smithi047.stdout:2/123: dwrite d1/de/d17/f1e [0,4194304] 0 2024-09-13T22:55:53.990 INFO:tasks.workunit.client.1.smithi047.stdout:3/76: link d0/f13 d0/d3/d4/d6/de/f17 0 2024-09-13T22:55:53.994 INFO:tasks.workunit.client.1.smithi047.stdout:3/77: rename d0/d3 to d0/d3/d4/d18 22 2024-09-13T22:55:53.999 INFO:tasks.workunit.client.1.smithi047.stdout:3/78: mknod d0/d3/d4/c19 0 2024-09-13T22:55:54.000 INFO:tasks.workunit.client.1.smithi047.stdout:3/79: write d0/d3/d4/f9 [483075,129816] 0 2024-09-13T22:55:54.003 INFO:tasks.workunit.client.1.smithi047.stdout:8/84: write d8/fc [356812,3937] 0 2024-09-13T22:55:54.006 INFO:tasks.workunit.client.1.smithi047.stdout:2/124: rmdir d1 39 2024-09-13T22:55:54.012 INFO:tasks.workunit.client.1.smithi047.stdout:3/80: mkdir d0/d3/d4/d1a 0 2024-09-13T22:55:54.012 INFO:tasks.workunit.client.1.smithi047.stdout:3/81: chown d0/d3/cd 0 1 2024-09-13T22:55:54.022 INFO:tasks.workunit.client.1.smithi047.stdout:3/82: dwrite d0/d3/f15 [0,4194304] 0 2024-09-13T22:55:54.025 INFO:tasks.workunit.client.1.smithi047.stdout:2/125: rmdir d1/df/d28 0 2024-09-13T22:55:54.027 INFO:tasks.workunit.client.1.smithi047.stdout:3/83: symlink d0/d3/d4/d6/l1b 0 2024-09-13T22:55:54.035 INFO:tasks.workunit.client.1.smithi047.stdout:9/67: sync 2024-09-13T22:55:54.035 INFO:tasks.workunit.client.1.smithi047.stdout:1/48: sync 2024-09-13T22:55:54.035 INFO:tasks.workunit.client.1.smithi047.stdout:6/80: sync 2024-09-13T22:55:54.036 INFO:tasks.workunit.client.1.smithi047.stdout:5/36: sync 2024-09-13T22:55:54.037 INFO:tasks.workunit.client.1.smithi047.stdout:3/84: mkdir d0/d3/d4/d16/d1c 0 2024-09-13T22:55:54.038 INFO:tasks.workunit.client.1.smithi047.stdout:3/85: chown d0/f12 0 1 2024-09-13T22:55:54.039 INFO:tasks.workunit.client.1.smithi047.stdout:5/37: creat f10 x:0 0 0 2024-09-13T22:55:54.040 INFO:tasks.workunit.client.1.smithi047.stdout:5/38: truncate f10 350979 0 2024-09-13T22:55:54.043 INFO:tasks.workunit.client.1.smithi047.stdout:6/81: write d3/f7 [5080669,44407] 0 2024-09-13T22:55:54.044 INFO:tasks.workunit.client.1.smithi047.stdout:1/49: symlink d0/d7/la 0 2024-09-13T22:55:54.050 INFO:tasks.workunit.client.1.smithi047.stdout:1/50: fsync d0/f9 0 2024-09-13T22:55:54.050 INFO:tasks.workunit.client.1.smithi047.stdout:9/68: rename d1/d6 to d1/dc/d14 0 2024-09-13T22:55:54.050 INFO:tasks.workunit.client.1.smithi047.stdout:3/86: dread d0/d3/f15 [0,4194304] 0 2024-09-13T22:55:54.050 INFO:tasks.workunit.client.1.smithi047.stdout:8/85: dwrite d8/f1a [0,4194304] 0 2024-09-13T22:55:54.050 INFO:tasks.workunit.client.1.smithi047.stdout:8/86: dread - d8/f13 zero size 2024-09-13T22:55:54.055 INFO:tasks.workunit.client.1.smithi047.stdout:5/39: rename l4 to l11 0 2024-09-13T22:55:54.055 INFO:tasks.workunit.client.0.smithi002.stdout:6/16: dwrite f2 [0,4194304] 0 2024-09-13T22:55:54.056 INFO:tasks.workunit.client.1.smithi047.stdout:6/82: dread d3/ff [0,4194304] 0 2024-09-13T22:55:54.057 INFO:tasks.workunit.client.0.smithi002.stdout:9/18: truncate f0 1801190 0 2024-09-13T22:55:54.058 INFO:tasks.workunit.client.1.smithi047.stdout:1/51: dread d0/f5 [0,4194304] 0 2024-09-13T22:55:54.058 INFO:tasks.workunit.client.0.smithi002.stdout:9/19: truncate f1 4626885 0 2024-09-13T22:55:54.058 INFO:tasks.workunit.client.0.smithi002.stdout:9/20: chown c3 397 1 2024-09-13T22:55:54.059 INFO:tasks.workunit.client.0.smithi002.stdout:9/21: readlink l2 0 2024-09-13T22:55:54.065 INFO:tasks.workunit.client.1.smithi047.stdout:6/83: dread d3/f8 [0,4194304] 0 2024-09-13T22:55:54.065 INFO:tasks.workunit.client.1.smithi047.stdout:5/40: dread f5 [0,4194304] 0 2024-09-13T22:55:54.070 INFO:tasks.workunit.client.1.smithi047.stdout:0/63: write d1/d7/ff [2248610,28049] 0 2024-09-13T22:55:54.073 INFO:tasks.workunit.client.0.smithi002.stdout:1/25: mkdir d1/d6 0 2024-09-13T22:55:54.073 INFO:tasks.workunit.client.1.smithi047.stdout:1/52: dwrite d0/f9 [0,4194304] 0 2024-09-13T22:55:54.073 INFO:tasks.workunit.client.1.smithi047.stdout:0/64: fsync d1/d7/fb 0 2024-09-13T22:55:54.073 INFO:tasks.workunit.client.1.smithi047.stdout:8/87: rename d8/f1d to d8/f1e 0 2024-09-13T22:55:54.075 INFO:tasks.workunit.client.1.smithi047.stdout:2/126: dwrite d1/d16/f23 [0,4194304] 0 2024-09-13T22:55:54.085 INFO:tasks.workunit.client.1.smithi047.stdout:1/53: dwrite d0/f9 [0,4194304] 0 2024-09-13T22:55:54.089 INFO:tasks.workunit.client.0.smithi002.stdout:9/22: symlink l6 0 2024-09-13T22:55:54.089 INFO:tasks.workunit.client.1.smithi047.stdout:9/69: unlink c0 0 2024-09-13T22:55:54.090 INFO:tasks.workunit.client.1.smithi047.stdout:9/70: chown d1/dc/d14/c12 181294080 1 2024-09-13T22:55:54.091 INFO:tasks.workunit.client.1.smithi047.stdout:5/41: mknod c12 0 2024-09-13T22:55:54.095 INFO:tasks.workunit.client.1.smithi047.stdout:6/84: mkdir d3/d13/d1c 0 2024-09-13T22:55:54.097 INFO:tasks.workunit.client.0.smithi002.stdout:1/26: rename d1/f4 to d1/f7 0 2024-09-13T22:55:54.099 INFO:tasks.workunit.client.1.smithi047.stdout:1/54: fdatasync d0/f9 0 2024-09-13T22:55:54.102 INFO:tasks.workunit.client.0.smithi002.stdout:6/17: link f1 f5 0 2024-09-13T22:55:54.104 INFO:tasks.workunit.client.1.smithi047.stdout:8/88: creat d8/f1f x:0 0 0 2024-09-13T22:55:54.104 INFO:tasks.workunit.client.1.smithi047.stdout:8/89: dread - d8/f13 zero size 2024-09-13T22:55:54.105 INFO:tasks.workunit.client.0.smithi002.stdout:9/23: mknod c7 0 2024-09-13T22:55:54.105 INFO:tasks.workunit.client.1.smithi047.stdout:8/90: chown f4 236 1 2024-09-13T22:55:54.106 INFO:tasks.workunit.client.1.smithi047.stdout:3/87: creat d0/d3/d4/d16/d1c/f1d x:0 0 0 2024-09-13T22:55:54.113 INFO:tasks.workunit.client.0.smithi002.stdout:3/20: getdents d9 0 2024-09-13T22:55:54.115 INFO:tasks.workunit.client.1.smithi047.stdout:9/71: creat d1/dc/f15 x:0 0 0 2024-09-13T22:55:54.117 INFO:tasks.workunit.client.1.smithi047.stdout:5/42: mknod c13 0 2024-09-13T22:55:54.118 INFO:tasks.workunit.client.0.smithi002.stdout:0/34: getdents d1 0 2024-09-13T22:55:54.118 INFO:tasks.workunit.client.0.smithi002.stdout:9/24: dread f0 [0,4194304] 0 2024-09-13T22:55:54.119 INFO:tasks.workunit.client.1.smithi047.stdout:1/55: mkdir d0/d7/db 0 2024-09-13T22:55:54.119 INFO:tasks.workunit.client.0.smithi002.stdout:0/35: write d1/fa [325765,130346] 0 2024-09-13T22:55:54.119 INFO:tasks.workunit.client.0.smithi002.stdout:8/17: link f2 d3/f4 0 2024-09-13T22:55:54.119 INFO:tasks.workunit.client.0.smithi002.stdout:9/25: fdatasync f4 0 2024-09-13T22:55:54.120 INFO:tasks.workunit.client.0.smithi002.stdout:0/36: readlink d1/l6 0 2024-09-13T22:55:54.121 INFO:tasks.workunit.client.0.smithi002.stdout:1/27: unlink d1/c5 0 2024-09-13T22:55:54.122 INFO:tasks.workunit.client.0.smithi002.stdout:3/21: creat d9/fb x:0 0 0 2024-09-13T22:55:54.123 INFO:tasks.workunit.client.1.smithi047.stdout:8/91: creat d8/f20 x:0 0 0 2024-09-13T22:55:54.125 INFO:tasks.workunit.client.1.smithi047.stdout:2/127: mkdir d1/df/d1d/d20/d2b 0 2024-09-13T22:55:54.126 INFO:tasks.workunit.client.0.smithi002.stdout:9/26: dwrite f5 [0,4194304] 0 2024-09-13T22:55:54.126 INFO:tasks.workunit.client.0.smithi002.stdout:1/28: dread d1/f7 [4194304,4194304] 0 2024-09-13T22:55:54.131 INFO:tasks.workunit.client.1.smithi047.stdout:5/43: symlink l14 0 2024-09-13T22:55:54.132 INFO:tasks.workunit.client.0.smithi002.stdout:8/18: dread d3/f4 [0,4194304] 0 2024-09-13T22:55:54.135 INFO:tasks.workunit.client.0.smithi002.stdout:0/37: fsync d1/d4/fb 0 2024-09-13T22:55:54.137 INFO:tasks.workunit.client.0.smithi002.stdout:6/18: truncate f2 2975871 0 2024-09-13T22:55:54.138 INFO:tasks.workunit.client.0.smithi002.stdout:6/19: dread f5 [0,4194304] 0 2024-09-13T22:55:54.140 INFO:tasks.workunit.client.1.smithi047.stdout:0/65: creat d1/f15 x:0 0 0 2024-09-13T22:55:54.140 INFO:tasks.workunit.client.1.smithi047.stdout:1/56: dread d0/f5 [0,4194304] 0 2024-09-13T22:55:54.141 INFO:tasks.workunit.client.0.smithi002.stdout:3/22: mkdir d9/dc 0 2024-09-13T22:55:54.144 INFO:tasks.workunit.client.1.smithi047.stdout:8/92: unlink f6 0 2024-09-13T22:55:54.145 INFO:tasks.workunit.client.1.smithi047.stdout:1/57: dread d0/f9 [0,4194304] 0 2024-09-13T22:55:54.145 INFO:tasks.workunit.client.0.smithi002.stdout:9/27: mkdir d8 0 2024-09-13T22:55:54.147 INFO:tasks.workunit.client.1.smithi047.stdout:3/88: creat d0/d3/d4/d1a/f1e x:0 0 0 2024-09-13T22:55:54.148 INFO:tasks.workunit.client.1.smithi047.stdout:6/85: write d3/f14 [317223,69544] 0 2024-09-13T22:55:54.149 INFO:tasks.workunit.client.1.smithi047.stdout:2/128: creat d1/df/d1d/d20/f2c x:0 0 0 2024-09-13T22:55:54.149 INFO:tasks.workunit.client.1.smithi047.stdout:8/93: dread d8/f1a [0,4194304] 0 2024-09-13T22:55:54.150 INFO:tasks.workunit.client.1.smithi047.stdout:8/94: write d8/f1a [3979070,24429] 0 2024-09-13T22:55:54.156 INFO:tasks.workunit.client.1.smithi047.stdout:0/66: mkdir d1/d5/d16 0 2024-09-13T22:55:54.158 INFO:tasks.workunit.client.0.smithi002.stdout:0/38: rename d1/l6 to d1/d2/lc 0 2024-09-13T22:55:54.159 INFO:tasks.workunit.client.0.smithi002.stdout:9/28: rename d8 to d8/d9 22 2024-09-13T22:55:54.163 INFO:tasks.workunit.client.1.smithi047.stdout:5/44: write f5 [3557337,100612] 0 2024-09-13T22:55:54.164 INFO:tasks.workunit.client.0.smithi002.stdout:6/20: mkdir d6 0 2024-09-13T22:55:54.165 INFO:tasks.workunit.client.0.smithi002.stdout:8/19: write d3/f4 [992174,110178] 0 2024-09-13T22:55:54.165 INFO:tasks.workunit.client.1.smithi047.stdout:1/58: fsync d0/f5 0 2024-09-13T22:55:54.167 INFO:tasks.workunit.client.0.smithi002.stdout:3/23: write f5 [1229678,127703] 0 2024-09-13T22:55:54.169 INFO:tasks.workunit.client.1.smithi047.stdout:3/89: mkdir d0/d3/d4/d6/de/d1f 0 2024-09-13T22:55:54.171 INFO:tasks.workunit.client.0.smithi002.stdout:8/20: dread f2 [0,4194304] 0 2024-09-13T22:55:54.172 INFO:tasks.workunit.client.0.smithi002.stdout:8/21: fdatasync f2 0 2024-09-13T22:55:54.175 INFO:tasks.workunit.client.0.smithi002.stdout:0/39: creat d1/d2/fd x:0 0 0 2024-09-13T22:55:54.175 INFO:tasks.workunit.client.0.smithi002.stdout:0/40: chown d1/d4 12173010 1 2024-09-13T22:55:54.181 INFO:tasks.workunit.client.0.smithi002.stdout:6/21: truncate f1 265907 0 2024-09-13T22:55:54.181 INFO:tasks.workunit.client.0.smithi002.stdout:3/24: creat d9/fd x:0 0 0 2024-09-13T22:55:54.182 INFO:tasks.workunit.client.0.smithi002.stdout:1/29: link d1/f7 d1/f8 0 2024-09-13T22:55:54.182 INFO:tasks.workunit.client.0.smithi002.stdout:3/25: write f6 [363029,10253] 0 2024-09-13T22:55:54.183 INFO:tasks.workunit.client.0.smithi002.stdout:9/29: creat d8/fa x:0 0 0 2024-09-13T22:55:54.183 INFO:tasks.workunit.client.0.smithi002.stdout:3/26: truncate d9/fd 94035 0 2024-09-13T22:55:54.184 INFO:tasks.workunit.client.0.smithi002.stdout:0/41: creat d1/d4/fe x:0 0 0 2024-09-13T22:55:54.186 INFO:tasks.workunit.client.0.smithi002.stdout:8/22: creat d3/f5 x:0 0 0 2024-09-13T22:55:54.188 INFO:tasks.workunit.client.0.smithi002.stdout:9/30: symlink d8/lb 0 2024-09-13T22:55:54.188 INFO:tasks.workunit.client.0.smithi002.stdout:3/27: creat d9/fe x:0 0 0 2024-09-13T22:55:54.189 INFO:tasks.workunit.client.0.smithi002.stdout:8/23: unlink f2 0 2024-09-13T22:55:54.192 INFO:tasks.workunit.client.0.smithi002.stdout:9/31: creat d8/fc x:0 0 0 2024-09-13T22:55:54.197 INFO:tasks.workunit.client.0.smithi002.stdout:3/28: dwrite d9/fb [0,4194304] 0 2024-09-13T22:55:54.197 INFO:tasks.workunit.client.0.smithi002.stdout:1/30: dread d1/f7 [4194304,4194304] 0 2024-09-13T22:55:54.199 INFO:tasks.workunit.client.0.smithi002.stdout:8/24: dwrite d3/f5 [0,4194304] 0 2024-09-13T22:55:54.199 INFO:tasks.workunit.client.0.smithi002.stdout:6/22: truncate f5 979533 0 2024-09-13T22:55:54.200 INFO:tasks.workunit.client.0.smithi002.stdout:3/29: mkdir d9/df 0 2024-09-13T22:55:54.202 INFO:tasks.workunit.client.0.smithi002.stdout:3/30: write f5 [2153567,130729] 0 2024-09-13T22:55:54.203 INFO:tasks.workunit.client.1.smithi047.stdout:8/95: rename f5 to d8/f21 0 2024-09-13T22:55:54.205 INFO:tasks.workunit.client.1.smithi047.stdout:9/72: creat d1/dc/d14/f16 x:0 0 0 2024-09-13T22:55:54.205 INFO:tasks.workunit.client.1.smithi047.stdout:5/45: symlink l15 0 2024-09-13T22:55:54.207 INFO:tasks.workunit.client.1.smithi047.stdout:3/90: creat d0/d3/d4/d6/f20 x:0 0 0 2024-09-13T22:55:54.208 INFO:tasks.workunit.client.1.smithi047.stdout:3/91: write d0/f12 [1384850,38716] 0 2024-09-13T22:55:54.210 INFO:tasks.workunit.client.1.smithi047.stdout:2/129: creat d1/df/d1d/d20/d29/f2d x:0 0 0 2024-09-13T22:55:54.211 INFO:tasks.workunit.client.1.smithi047.stdout:3/92: write d0/d3/d4/d16/d1c/f1d [873619,90017] 0 2024-09-13T22:55:54.211 INFO:tasks.workunit.client.0.smithi002.stdout:3/31: dwrite f3 [0,4194304] 0 2024-09-13T22:55:54.213 INFO:tasks.workunit.client.0.smithi002.stdout:3/32: write d9/fe [972463,126987] 0 2024-09-13T22:55:54.215 INFO:tasks.workunit.client.0.smithi002.stdout:9/32: fsync f1 0 2024-09-13T22:55:54.215 INFO:tasks.workunit.client.0.smithi002.stdout:9/33: chown c7 504 1 2024-09-13T22:55:54.217 INFO:tasks.workunit.client.0.smithi002.stdout:6/23: write f1 [1360098,15864] 0 2024-09-13T22:55:54.218 INFO:tasks.workunit.client.0.smithi002.stdout:9/34: write d8/fa [932165,86928] 0 2024-09-13T22:55:54.218 INFO:tasks.workunit.client.0.smithi002.stdout:6/24: chown d6 6016 1 2024-09-13T22:55:54.218 INFO:tasks.workunit.client.1.smithi047.stdout:8/96: mknod d8/c22 0 2024-09-13T22:55:54.220 INFO:tasks.workunit.client.0.smithi002.stdout:9/35: dread f0 [0,4194304] 0 2024-09-13T22:55:54.224 INFO:tasks.workunit.client.0.smithi002.stdout:9/36: dread f5 [0,4194304] 0 2024-09-13T22:55:54.226 INFO:tasks.workunit.client.0.smithi002.stdout:3/33: mkdir d9/df/d10 0 2024-09-13T22:55:54.227 INFO:tasks.workunit.client.0.smithi002.stdout:3/34: truncate f6 1018968 0 2024-09-13T22:55:54.227 INFO:tasks.workunit.client.0.smithi002.stdout:3/35: stat d9/df/d10 0 2024-09-13T22:55:54.228 INFO:tasks.workunit.client.0.smithi002.stdout:1/31: dwrite d1/f7 [4194304,4194304] 0 2024-09-13T22:55:54.230 INFO:tasks.workunit.client.1.smithi047.stdout:5/46: mknod c16 0 2024-09-13T22:55:54.233 INFO:tasks.workunit.client.0.smithi002.stdout:1/32: dread d1/f7 [0,4194304] 0 2024-09-13T22:55:54.234 INFO:tasks.workunit.client.0.smithi002.stdout:9/37: mknod d8/cd 0 2024-09-13T22:55:54.239 INFO:tasks.workunit.client.1.smithi047.stdout:0/67: creat d1/f17 x:0 0 0 2024-09-13T22:55:54.240 INFO:tasks.workunit.client.1.smithi047.stdout:0/68: truncate d1/f2 3242675 0 2024-09-13T22:55:54.241 INFO:tasks.workunit.client.1.smithi047.stdout:9/73: creat d1/dc/d14/f17 x:0 0 0 2024-09-13T22:55:54.243 INFO:tasks.workunit.client.0.smithi002.stdout:1/33: fsync d1/f7 0 2024-09-13T22:55:54.243 INFO:tasks.workunit.client.0.smithi002.stdout:1/34: readlink - no filename 2024-09-13T22:55:54.243 INFO:tasks.workunit.client.0.smithi002.stdout:9/38: rename f1 to d8/fe 0 2024-09-13T22:55:54.244 INFO:tasks.workunit.client.1.smithi047.stdout:1/59: link d0/d7/l8 d0/d7/lc 0 2024-09-13T22:55:54.245 INFO:tasks.workunit.client.0.smithi002.stdout:6/25: rmdir d6 0 2024-09-13T22:55:54.246 INFO:tasks.workunit.client.1.smithi047.stdout:5/47: creat f17 x:0 0 0 2024-09-13T22:55:54.246 INFO:tasks.workunit.client.0.smithi002.stdout:3/36: mknod d9/dc/c11 0 2024-09-13T22:55:54.246 INFO:tasks.workunit.client.1.smithi047.stdout:8/97: dwrite d8/f21 [0,4194304] 0 2024-09-13T22:55:54.247 INFO:tasks.workunit.client.1.smithi047.stdout:8/98: truncate d8/f1e 1043291 0 2024-09-13T22:55:54.248 INFO:tasks.workunit.client.1.smithi047.stdout:2/130: mkdir d1/df/d1d/d2e 0 2024-09-13T22:55:54.248 INFO:tasks.workunit.client.1.smithi047.stdout:3/93: symlink d0/d3/d4/d6/de/d1f/l21 0 2024-09-13T22:55:54.254 INFO:tasks.workunit.client.0.smithi002.stdout:1/35: creat d1/f9 x:0 0 0 2024-09-13T22:55:54.254 INFO:tasks.workunit.client.0.smithi002.stdout:1/36: fdatasync d1/f8 0 2024-09-13T22:55:54.254 INFO:tasks.workunit.client.1.smithi047.stdout:9/74: rmdir d1/dc/d14/dd 39 2024-09-13T22:55:54.255 INFO:tasks.workunit.client.1.smithi047.stdout:2/131: dread d1/f14 [0,4194304] 0 2024-09-13T22:55:54.255 INFO:tasks.workunit.client.1.smithi047.stdout:7/34: sync 2024-09-13T22:55:54.255 INFO:tasks.workunit.client.1.smithi047.stdout:7/35: readlink - no filename 2024-09-13T22:55:54.255 INFO:tasks.workunit.client.1.smithi047.stdout:2/132: chown d1/df/d1d/d20 1 1 2024-09-13T22:55:54.256 INFO:tasks.workunit.client.0.smithi002.stdout:9/39: creat d8/ff x:0 0 0 2024-09-13T22:55:54.256 INFO:tasks.workunit.client.1.smithi047.stdout:1/60: fsync d0/f5 0 2024-09-13T22:55:54.256 INFO:tasks.workunit.client.1.smithi047.stdout:1/61: fdatasync d0/f9 0 2024-09-13T22:55:54.257 INFO:tasks.workunit.client.1.smithi047.stdout:5/48: mknod c18 0 2024-09-13T22:55:54.259 INFO:tasks.workunit.client.1.smithi047.stdout:8/99: rename d8/f20 to d8/f23 0 2024-09-13T22:55:54.262 INFO:tasks.workunit.client.0.smithi002.stdout:9/40: mkdir d8/d10 0 2024-09-13T22:55:54.265 INFO:tasks.workunit.client.0.smithi002.stdout:3/37: creat d9/df/d10/f12 x:0 0 0 2024-09-13T22:55:54.265 INFO:tasks.workunit.client.0.smithi002.stdout:3/38: chown d9/fe 20956 1 2024-09-13T22:55:54.266 INFO:tasks.workunit.client.0.smithi002.stdout:3/39: write f3 [2626576,27100] 0 2024-09-13T22:55:54.266 INFO:tasks.workunit.client.1.smithi047.stdout:9/75: mkdir d1/dc/d18 0 2024-09-13T22:55:54.267 INFO:tasks.workunit.client.0.smithi002.stdout:1/37: creat d1/d6/fa x:0 0 0 2024-09-13T22:55:54.268 INFO:tasks.workunit.client.0.smithi002.stdout:1/38: write d1/f9 [1003758,880] 0 2024-09-13T22:55:54.269 INFO:tasks.workunit.client.0.smithi002.stdout:9/41: mkdir d8/d11 0 2024-09-13T22:55:54.270 INFO:tasks.workunit.client.1.smithi047.stdout:0/69: dwrite d1/d5/f9 [0,4194304] 0 2024-09-13T22:55:54.270 INFO:tasks.workunit.client.1.smithi047.stdout:7/36: symlink d0/d7/le 0 2024-09-13T22:55:54.271 INFO:tasks.workunit.client.1.smithi047.stdout:7/37: chown d0/db/cd 15086413 1 2024-09-13T22:55:54.272 INFO:tasks.workunit.client.1.smithi047.stdout:1/62: creat d0/fd x:0 0 0 2024-09-13T22:55:54.277 INFO:tasks.workunit.client.1.smithi047.stdout:8/100: symlink d8/l24 0 2024-09-13T22:55:54.278 INFO:tasks.workunit.client.1.smithi047.stdout:9/76: unlink d1/dc/d14/fb 0 2024-09-13T22:55:54.279 INFO:tasks.workunit.client.1.smithi047.stdout:9/77: stat d1/dc/d14 0 2024-09-13T22:55:54.281 INFO:tasks.workunit.client.1.smithi047.stdout:2/133: unlink d1/f14 0 2024-09-13T22:55:54.282 INFO:tasks.workunit.client.1.smithi047.stdout:0/70: creat d1/d7/f18 x:0 0 0 2024-09-13T22:55:54.285 INFO:tasks.workunit.client.1.smithi047.stdout:1/63: rename d0/d7/lc to d0/le 0 2024-09-13T22:55:54.285 INFO:tasks.workunit.client.1.smithi047.stdout:1/64: dread - d0/fd zero size 2024-09-13T22:55:54.289 INFO:tasks.workunit.client.1.smithi047.stdout:8/101: mknod d8/c25 0 2024-09-13T22:55:54.289 INFO:tasks.workunit.client.1.smithi047.stdout:3/94: link d0/d3/d4/d6/de/f17 d0/d3/d4/d16/f22 0 2024-09-13T22:55:54.290 INFO:tasks.workunit.client.1.smithi047.stdout:1/65: dread d0/f9 [0,4194304] 0 2024-09-13T22:55:54.290 INFO:tasks.workunit.client.1.smithi047.stdout:3/95: readlink d0/d3/d4/d6/de/d1f/l21 0 2024-09-13T22:55:54.290 INFO:tasks.workunit.client.1.smithi047.stdout:0/71: mknod d1/d5/d11/c19 0 2024-09-13T22:55:54.292 INFO:tasks.workunit.client.1.smithi047.stdout:7/38: symlink d0/d7/da/lf 0 2024-09-13T22:55:54.293 INFO:tasks.workunit.client.1.smithi047.stdout:0/72: dread - d1/d7/fb zero size 2024-09-13T22:55:54.293 INFO:tasks.workunit.client.1.smithi047.stdout:2/134: rename d1/df/l27 to d1/df/d1d/d2e/l2f 0 2024-09-13T22:55:54.295 INFO:tasks.workunit.client.1.smithi047.stdout:8/102: creat d8/f26 x:0 0 0 2024-09-13T22:55:54.299 INFO:tasks.workunit.client.1.smithi047.stdout:0/73: dwrite d1/f2 [0,4194304] 0 2024-09-13T22:55:54.300 INFO:tasks.workunit.client.1.smithi047.stdout:0/74: dread - d1/f15 zero size 2024-09-13T22:55:54.301 INFO:tasks.workunit.client.1.smithi047.stdout:3/96: creat d0/d3/d4/d6/f23 x:0 0 0 2024-09-13T22:55:54.302 INFO:tasks.workunit.client.1.smithi047.stdout:3/97: stat d0/d3/d4/d6/de/d1f 0 2024-09-13T22:55:54.303 INFO:tasks.workunit.client.1.smithi047.stdout:7/39: creat d0/d7/f10 x:0 0 0 2024-09-13T22:55:54.310 INFO:tasks.workunit.client.1.smithi047.stdout:1/66: readlink d0/le 0 2024-09-13T22:55:54.311 INFO:tasks.workunit.client.1.smithi047.stdout:5/49: truncate f10 298288 0 2024-09-13T22:55:54.313 INFO:tasks.workunit.client.1.smithi047.stdout:2/135: creat d1/df/d26/f30 x:0 0 0 2024-09-13T22:55:54.313 INFO:tasks.workunit.client.1.smithi047.stdout:7/40: dwrite d0/db/fc [0,4194304] 0 2024-09-13T22:55:54.317 INFO:tasks.workunit.client.1.smithi047.stdout:5/50: mkdir d19 0 2024-09-13T22:55:54.318 INFO:tasks.workunit.client.1.smithi047.stdout:8/103: dwrite d8/f23 [0,4194304] 0 2024-09-13T22:55:54.320 INFO:tasks.workunit.client.1.smithi047.stdout:8/104: write f1 [2239479,32368] 0 2024-09-13T22:55:54.325 INFO:tasks.workunit.client.1.smithi047.stdout:7/41: creat d0/d7/da/f11 x:0 0 0 2024-09-13T22:55:54.326 INFO:tasks.workunit.client.1.smithi047.stdout:1/67: mknod d0/d7/db/cf 0 2024-09-13T22:55:54.329 INFO:tasks.workunit.client.1.smithi047.stdout:8/105: creat d8/f27 x:0 0 0 2024-09-13T22:55:54.333 INFO:tasks.workunit.client.1.smithi047.stdout:2/136: truncate d1/de/f13 1407497 0 2024-09-13T22:55:54.334 INFO:tasks.workunit.client.1.smithi047.stdout:2/137: dread - d1/f10 zero size 2024-09-13T22:55:54.334 INFO:tasks.workunit.client.1.smithi047.stdout:3/98: write d0/d3/d4/d16/f22 [6548889,13389] 0 2024-09-13T22:55:54.336 INFO:tasks.workunit.client.1.smithi047.stdout:3/99: write d0/d3/d4/f9 [487718,100203] 0 2024-09-13T22:55:54.336 INFO:tasks.workunit.client.1.smithi047.stdout:1/68: unlink d0/d7/db/cf 0 2024-09-13T22:55:54.338 INFO:tasks.workunit.client.1.smithi047.stdout:5/51: mkdir d19/d1a 0 2024-09-13T22:55:54.340 INFO:tasks.workunit.client.1.smithi047.stdout:8/106: mknod d8/c28 0 2024-09-13T22:55:54.341 INFO:tasks.workunit.client.1.smithi047.stdout:0/75: link d1/la d1/l1a 0 2024-09-13T22:55:54.346 INFO:tasks.workunit.client.1.smithi047.stdout:8/107: symlink d8/l29 0 2024-09-13T22:55:54.347 INFO:tasks.workunit.client.1.smithi047.stdout:5/52: dwrite f5 [0,4194304] 0 2024-09-13T22:55:54.349 INFO:tasks.workunit.client.1.smithi047.stdout:0/76: dread d1/d7/fe [0,4194304] 0 2024-09-13T22:55:54.351 INFO:tasks.workunit.client.1.smithi047.stdout:2/138: link d1/f10 d1/de/d17/f31 0 2024-09-13T22:55:54.358 INFO:tasks.workunit.client.1.smithi047.stdout:7/42: getdents d0/d7/da 0 2024-09-13T22:55:54.360 INFO:tasks.workunit.client.1.smithi047.stdout:8/108: dwrite d8/f27 [0,4194304] 0 2024-09-13T22:55:54.363 INFO:tasks.workunit.client.1.smithi047.stdout:5/53: dwrite f17 [0,4194304] 0 2024-09-13T22:55:54.365 INFO:tasks.workunit.client.1.smithi047.stdout:8/109: write d8/f10 [4006034,53471] 0 2024-09-13T22:55:54.371 INFO:tasks.workunit.client.1.smithi047.stdout:0/77: unlink d1/la 0 2024-09-13T22:55:54.374 INFO:tasks.workunit.client.1.smithi047.stdout:7/43: truncate d0/d7/f6 1232120 0 2024-09-13T22:55:54.375 INFO:tasks.workunit.client.1.smithi047.stdout:3/100: truncate d0/d3/d4/d6/de/f17 2751981 0 2024-09-13T22:55:54.376 INFO:tasks.workunit.client.1.smithi047.stdout:8/110: rmdir d8 39 2024-09-13T22:55:54.382 INFO:tasks.workunit.client.1.smithi047.stdout:7/44: rename d0/d7/f10 to d0/d7/f12 0 2024-09-13T22:55:54.382 INFO:tasks.workunit.client.0.smithi002.stdout:3/40: symlink d9/df/l13 0 2024-09-13T22:55:54.383 INFO:tasks.workunit.client.0.smithi002.stdout:1/39: dwrite d1/f8 [4194304,4194304] 0 2024-09-13T22:55:54.385 INFO:tasks.workunit.client.1.smithi047.stdout:2/139: dwrite d1/df/f1b [4194304,4194304] 0 2024-09-13T22:55:54.385 INFO:tasks.workunit.client.0.smithi002.stdout:6/26: getdents . 0 2024-09-13T22:55:54.385 INFO:tasks.workunit.client.0.smithi002.stdout:6/27: rmdir - no directory 2024-09-13T22:55:54.386 INFO:tasks.workunit.client.1.smithi047.stdout:5/54: rmdir d19/d1a 0 2024-09-13T22:55:54.387 INFO:tasks.workunit.client.0.smithi002.stdout:9/42: rename d8/fc to d8/d11/f12 0 2024-09-13T22:55:54.388 INFO:tasks.workunit.client.0.smithi002.stdout:9/43: chown c3 1773 1 2024-09-13T22:55:54.391 INFO:tasks.workunit.client.0.smithi002.stdout:1/40: creat d1/fb x:0 0 0 2024-09-13T22:55:54.396 INFO:tasks.workunit.client.1.smithi047.stdout:3/101: dread d0/d3/d4/d6/de/f17 [0,4194304] 0 2024-09-13T22:55:54.400 INFO:tasks.workunit.client.0.smithi002.stdout:6/28: dwrite f5 [0,4194304] 0 2024-09-13T22:55:54.401 INFO:tasks.workunit.client.1.smithi047.stdout:8/111: creat d8/f2a x:0 0 0 2024-09-13T22:55:54.403 INFO:tasks.workunit.client.1.smithi047.stdout:0/78: truncate d1/d5/f9 1437504 0 2024-09-13T22:55:54.407 INFO:tasks.workunit.client.0.smithi002.stdout:3/41: rename f6 to d9/dc/f14 0 2024-09-13T22:55:54.410 INFO:tasks.workunit.client.1.smithi047.stdout:2/140: symlink d1/de/l32 0 2024-09-13T22:55:54.411 INFO:tasks.workunit.client.1.smithi047.stdout:2/141: write d1/df/d26/f30 [460346,94920] 0 2024-09-13T22:55:54.412 INFO:tasks.workunit.client.1.smithi047.stdout:5/55: symlink d19/l1b 0 2024-09-13T22:55:54.413 INFO:tasks.workunit.client.0.smithi002.stdout:1/41: creat d1/d6/fc x:0 0 0 2024-09-13T22:55:54.417 INFO:tasks.workunit.client.0.smithi002.stdout:6/29: mknod c7 0 2024-09-13T22:55:54.418 INFO:tasks.workunit.client.1.smithi047.stdout:3/102: creat d0/d3/d4/d6/f24 x:0 0 0 2024-09-13T22:55:54.419 INFO:tasks.workunit.client.1.smithi047.stdout:4/77: sync 2024-09-13T22:55:54.419 INFO:tasks.workunit.client.1.smithi047.stdout:4/78: readlink dc/de/l15 0 2024-09-13T22:55:54.423 INFO:tasks.workunit.client.1.smithi047.stdout:2/142: fsync d1/df/f1b 0 2024-09-13T22:55:54.424 INFO:tasks.workunit.client.0.smithi002.stdout:3/42: rename d9/dc to d9/d15 0 2024-09-13T22:55:54.424 INFO:tasks.workunit.client.1.smithi047.stdout:8/112: creat d8/f2b x:0 0 0 2024-09-13T22:55:54.425 INFO:tasks.workunit.client.0.smithi002.stdout:9/44: getdents d8/d10 0 2024-09-13T22:55:54.428 INFO:tasks.workunit.client.1.smithi047.stdout:3/103: dwrite d0/d3/d4/d6/f23 [0,4194304] 0 2024-09-13T22:55:54.430 INFO:tasks.workunit.client.0.smithi002.stdout:6/30: creat f8 x:0 0 0 2024-09-13T22:55:54.432 INFO:tasks.workunit.client.1.smithi047.stdout:3/104: dread d0/d3/d4/d16/f22 [0,4194304] 0 2024-09-13T22:55:54.434 INFO:tasks.workunit.client.1.smithi047.stdout:5/56: rename f5 to d19/f1c 0 2024-09-13T22:55:54.438 INFO:tasks.workunit.client.1.smithi047.stdout:4/79: creat dc/de/f16 x:0 0 0 2024-09-13T22:55:54.439 INFO:tasks.workunit.client.0.smithi002.stdout:9/45: dread f5 [0,4194304] 0 2024-09-13T22:55:54.441 INFO:tasks.workunit.client.0.smithi002.stdout:1/42: link d1/f7 d1/fd 0 2024-09-13T22:55:54.442 INFO:tasks.workunit.client.0.smithi002.stdout:1/43: truncate d1/d6/fa 508102 0 2024-09-13T22:55:54.443 INFO:tasks.workunit.client.1.smithi047.stdout:5/57: dwrite f17 [4194304,4194304] 0 2024-09-13T22:55:54.444 INFO:tasks.workunit.client.0.smithi002.stdout:6/31: symlink l9 0 2024-09-13T22:55:54.446 INFO:tasks.workunit.client.1.smithi047.stdout:2/143: creat d1/de/f33 x:0 0 0 2024-09-13T22:55:54.447 INFO:tasks.workunit.client.1.smithi047.stdout:2/144: dread - d1/de/d17/f31 zero size 2024-09-13T22:55:54.451 INFO:tasks.workunit.client.0.smithi002.stdout:1/44: rename d1/f8 to d1/fe 0 2024-09-13T22:55:54.453 INFO:tasks.workunit.client.1.smithi047.stdout:0/79: write d1/d7/f18 [128806,56057] 0 2024-09-13T22:55:54.454 INFO:tasks.workunit.client.0.smithi002.stdout:9/46: symlink d8/d10/l13 0 2024-09-13T22:55:54.455 INFO:tasks.workunit.client.1.smithi047.stdout:3/105: mkdir d0/d25 0 2024-09-13T22:55:54.456 INFO:tasks.workunit.client.0.smithi002.stdout:9/47: write d8/fa [1289161,43628] 0 2024-09-13T22:55:54.456 INFO:tasks.workunit.client.1.smithi047.stdout:3/106: dread - d0/d3/d4/d6/f24 zero size 2024-09-13T22:55:54.457 INFO:tasks.workunit.client.1.smithi047.stdout:3/107: fsync d0/d3/d4/d6/f23 0 2024-09-13T22:55:54.458 INFO:tasks.workunit.client.1.smithi047.stdout:3/108: stat d0/d3/cd 0 2024-09-13T22:55:54.461 INFO:tasks.workunit.client.0.smithi002.stdout:9/48: mknod d8/c14 0 2024-09-13T22:55:54.462 INFO:tasks.workunit.client.1.smithi047.stdout:3/109: dread d0/f13 [0,4194304] 0 2024-09-13T22:55:54.465 INFO:tasks.workunit.client.0.smithi002.stdout:9/49: rename f4 to d8/d11/f15 0 2024-09-13T22:55:54.470 INFO:tasks.workunit.client.0.smithi002.stdout:9/50: unlink d8/d10/l13 0 2024-09-13T22:55:54.478 INFO:tasks.workunit.client.0.smithi002.stdout:1/45: getdents d1 0 2024-09-13T22:55:54.480 INFO:tasks.workunit.client.0.smithi002.stdout:1/46: creat d1/ff x:0 0 0 2024-09-13T22:55:54.482 INFO:tasks.workunit.client.0.smithi002.stdout:1/47: write d1/d6/fc [472922,10068] 0 2024-09-13T22:55:54.483 INFO:tasks.workunit.client.0.smithi002.stdout:6/32: dwrite f2 [0,4194304] 0 2024-09-13T22:55:54.485 INFO:tasks.workunit.client.0.smithi002.stdout:1/48: mknod d1/c10 0 2024-09-13T22:55:54.486 INFO:tasks.workunit.client.0.smithi002.stdout:1/49: stat d1/d6/fa 0 2024-09-13T22:55:54.489 INFO:tasks.workunit.client.0.smithi002.stdout:9/51: truncate d8/d11/f15 1209227 0 2024-09-13T22:55:54.491 INFO:tasks.workunit.client.0.smithi002.stdout:1/50: mknod d1/d6/c11 0 2024-09-13T22:55:54.492 INFO:tasks.workunit.client.0.smithi002.stdout:9/52: write d8/d11/f12 [657764,123687] 0 2024-09-13T22:55:54.497 INFO:tasks.workunit.client.0.smithi002.stdout:6/33: truncate f1 3413304 0 2024-09-13T22:55:54.498 INFO:tasks.workunit.client.0.smithi002.stdout:6/34: chown l3 256093368 1 2024-09-13T22:55:54.499 INFO:tasks.workunit.client.0.smithi002.stdout:6/35: chown f2 253149736 1 2024-09-13T22:55:54.499 INFO:tasks.workunit.client.0.smithi002.stdout:9/53: dwrite d8/ff [0,4194304] 0 2024-09-13T22:55:54.502 INFO:tasks.workunit.client.0.smithi002.stdout:9/54: symlink d8/d10/l16 0 2024-09-13T22:55:54.505 INFO:tasks.workunit.client.0.smithi002.stdout:9/55: creat d8/d10/f17 x:0 0 0 2024-09-13T22:55:54.506 INFO:tasks.workunit.client.0.smithi002.stdout:6/36: fsync f5 0 2024-09-13T22:55:54.507 INFO:tasks.workunit.client.0.smithi002.stdout:1/51: dwrite d1/fe [4194304,4194304] 0 2024-09-13T22:55:54.509 INFO:tasks.workunit.client.0.smithi002.stdout:9/56: mknod d8/c18 0 2024-09-13T22:55:54.513 INFO:tasks.workunit.client.0.smithi002.stdout:6/37: rename f8 to fa 0 2024-09-13T22:55:54.514 INFO:tasks.workunit.client.0.smithi002.stdout:1/52: mknod d1/d6/c12 0 2024-09-13T22:55:54.516 INFO:tasks.workunit.client.0.smithi002.stdout:6/38: dread f1 [0,4194304] 0 2024-09-13T22:55:54.516 INFO:tasks.workunit.client.0.smithi002.stdout:6/39: dread - fa zero size 2024-09-13T22:55:54.516 INFO:tasks.workunit.client.0.smithi002.stdout:1/53: mkdir d1/d13 0 2024-09-13T22:55:54.518 INFO:tasks.workunit.client.0.smithi002.stdout:6/40: mknod cb 0 2024-09-13T22:55:54.519 INFO:tasks.workunit.client.0.smithi002.stdout:6/41: chown cb 107 1 2024-09-13T22:55:54.520 INFO:tasks.workunit.client.0.smithi002.stdout:1/54: unlink d1/fd 0 2024-09-13T22:55:54.522 INFO:tasks.workunit.client.0.smithi002.stdout:6/42: rename l9 to lc 0 2024-09-13T22:55:54.522 INFO:tasks.workunit.client.0.smithi002.stdout:6/43: chown f1 195227141 1 2024-09-13T22:55:54.526 INFO:tasks.workunit.client.1.smithi047.stdout:0/80: mknod d1/d7/c1b 0 2024-09-13T22:55:54.526 INFO:tasks.workunit.client.1.smithi047.stdout:2/145: truncate d1/de/d17/f31 813579 0 2024-09-13T22:55:54.527 INFO:tasks.workunit.client.1.smithi047.stdout:5/58: truncate f17 1945763 0 2024-09-13T22:55:54.530 INFO:tasks.workunit.client.1.smithi047.stdout:8/113: getdents d8 0 2024-09-13T22:55:54.533 INFO:tasks.workunit.client.1.smithi047.stdout:8/114: write d8/f13 [557556,105680] 0 2024-09-13T22:55:54.533 INFO:tasks.workunit.client.1.smithi047.stdout:0/81: fsync d1/d5/f8 0 2024-09-13T22:55:54.533 INFO:tasks.workunit.client.0.smithi002.stdout:1/55: getdents d1 0 2024-09-13T22:55:54.534 INFO:tasks.workunit.client.0.smithi002.stdout:1/56: chown d1/d6/c12 160193 1 2024-09-13T22:55:54.534 INFO:tasks.workunit.client.0.smithi002.stdout:6/44: write f5 [2171582,31051] 0 2024-09-13T22:55:54.537 INFO:tasks.workunit.client.0.smithi002.stdout:1/57: write d1/ff [731914,71535] 0 2024-09-13T22:55:54.537 INFO:tasks.workunit.client.1.smithi047.stdout:8/115: dread d8/f17 [0,4194304] 0 2024-09-13T22:55:54.537 INFO:tasks.workunit.client.1.smithi047.stdout:3/110: dwrite d0/f13 [0,4194304] 0 2024-09-13T22:55:54.537 INFO:tasks.workunit.client.1.smithi047.stdout:5/59: creat d19/f1d x:0 0 0 2024-09-13T22:55:54.539 INFO:tasks.workunit.client.0.smithi002.stdout:1/58: chown d1/ff 212673 1 2024-09-13T22:55:54.539 INFO:tasks.workunit.client.0.smithi002.stdout:6/45: fsync fa 0 2024-09-13T22:55:54.540 INFO:tasks.workunit.client.0.smithi002.stdout:9/57: dwrite d8/d11/f15 [0,4194304] 0 2024-09-13T22:55:54.541 INFO:tasks.workunit.client.1.smithi047.stdout:2/146: dwrite d1/de/d17/f1e [0,4194304] 0 2024-09-13T22:55:54.543 INFO:tasks.workunit.client.1.smithi047.stdout:3/111: read d0/d3/d4/d16/d1c/f1d [349487,122912] 0 2024-09-13T22:55:54.543 INFO:tasks.workunit.client.1.smithi047.stdout:5/60: creat d19/f1e x:0 0 0 2024-09-13T22:55:54.544 INFO:tasks.workunit.client.0.smithi002.stdout:9/58: dread f0 [0,4194304] 0 2024-09-13T22:55:54.544 INFO:tasks.workunit.client.1.smithi047.stdout:2/147: stat d1/df/f1b 0 2024-09-13T22:55:54.548 INFO:tasks.workunit.client.0.smithi002.stdout:1/59: symlink d1/d13/l14 0 2024-09-13T22:55:54.549 INFO:tasks.workunit.client.0.smithi002.stdout:6/46: dwrite f1 [0,4194304] 0 2024-09-13T22:55:54.549 INFO:tasks.workunit.client.0.smithi002.stdout:1/60: chown d1/f9 872275 1 2024-09-13T22:55:54.550 INFO:tasks.workunit.client.0.smithi002.stdout:1/61: stat d1/d6/fa 0 2024-09-13T22:55:54.551 INFO:tasks.workunit.client.1.smithi047.stdout:3/112: mknod d0/d3/d4/d16/c26 0 2024-09-13T22:55:54.553 INFO:tasks.workunit.client.1.smithi047.stdout:0/82: dread d1/f2 [0,4194304] 0 2024-09-13T22:55:54.556 INFO:tasks.workunit.client.0.smithi002.stdout:1/62: stat d1/fe 0 2024-09-13T22:55:54.559 INFO:tasks.workunit.client.1.smithi047.stdout:8/116: dread d8/f27 [0,4194304] 0 2024-09-13T22:55:54.561 INFO:tasks.workunit.client.0.smithi002.stdout:1/63: unlink d1/d6/c11 0 2024-09-13T22:55:54.562 INFO:tasks.workunit.client.1.smithi047.stdout:5/61: dwrite d19/f1d [0,4194304] 0 2024-09-13T22:55:54.563 INFO:tasks.workunit.client.1.smithi047.stdout:0/83: fdatasync d1/f2 0 2024-09-13T22:55:54.564 INFO:tasks.workunit.client.1.smithi047.stdout:2/148: dwrite d1/f2a [0,4194304] 0 2024-09-13T22:55:54.566 INFO:tasks.workunit.client.1.smithi047.stdout:8/117: chown f1 15061798 1 2024-09-13T22:55:54.566 INFO:tasks.workunit.client.1.smithi047.stdout:3/113: creat d0/d3/d4/d1a/f27 x:0 0 0 2024-09-13T22:55:54.568 INFO:tasks.workunit.client.0.smithi002.stdout:6/47: fdatasync f1 0 2024-09-13T22:55:54.569 INFO:tasks.workunit.client.0.smithi002.stdout:1/64: creat d1/f15 x:0 0 0 2024-09-13T22:55:54.569 INFO:tasks.workunit.client.0.smithi002.stdout:6/48: dread - fa zero size 2024-09-13T22:55:54.571 INFO:tasks.workunit.client.0.smithi002.stdout:1/65: readlink d1/d13/l14 0 2024-09-13T22:55:54.571 INFO:tasks.workunit.client.0.smithi002.stdout:6/49: stat f1 0 2024-09-13T22:55:54.571 INFO:tasks.workunit.client.0.smithi002.stdout:1/66: chown d1/d13/l14 6969198 1 2024-09-13T22:55:54.571 INFO:tasks.workunit.client.0.smithi002.stdout:6/50: write f2 [209606,71621] 0 2024-09-13T22:55:54.571 INFO:tasks.workunit.client.1.smithi047.stdout:5/62: rename ce to d19/c1f 0 2024-09-13T22:55:54.572 INFO:tasks.workunit.client.0.smithi002.stdout:1/67: write d1/d6/fc [485152,56968] 0 2024-09-13T22:55:54.573 INFO:tasks.workunit.client.0.smithi002.stdout:1/68: read d1/d6/fa [369567,102568] 0 2024-09-13T22:55:54.574 INFO:tasks.workunit.client.0.smithi002.stdout:1/69: chown d1 79 1 2024-09-13T22:55:54.575 INFO:tasks.workunit.client.1.smithi047.stdout:0/84: dwrite d1/f2 [0,4194304] 0 2024-09-13T22:55:54.576 INFO:tasks.workunit.client.0.smithi002.stdout:9/59: write f0 [1820017,37480] 0 2024-09-13T22:55:54.577 INFO:tasks.workunit.client.1.smithi047.stdout:2/149: dread d1/de/d17/f31 [0,4194304] 0 2024-09-13T22:55:54.577 INFO:tasks.workunit.client.0.smithi002.stdout:9/60: chown d8/d10 170956 1 2024-09-13T22:55:54.579 INFO:tasks.workunit.client.1.smithi047.stdout:5/63: fsync d19/f1c 0 2024-09-13T22:55:54.581 INFO:tasks.workunit.client.1.smithi047.stdout:5/64: fsync d19/f1e 0 2024-09-13T22:55:54.582 INFO:tasks.workunit.client.0.smithi002.stdout:6/51: rename f2 to fd 0 2024-09-13T22:55:54.582 INFO:tasks.workunit.client.1.smithi047.stdout:2/150: read d1/f11 [1068141,103404] 0 2024-09-13T22:55:54.583 INFO:tasks.workunit.client.0.smithi002.stdout:6/52: chown fd 2388 1 2024-09-13T22:55:54.584 INFO:tasks.workunit.client.0.smithi002.stdout:1/70: dwrite d1/f9 [0,4194304] 0 2024-09-13T22:55:54.584 INFO:tasks.workunit.client.1.smithi047.stdout:3/114: rename d0/f13 to d0/d3/d4/d6/de/f28 0 2024-09-13T22:55:54.585 INFO:tasks.workunit.client.1.smithi047.stdout:2/151: write d1/de/d17/f1e [3789694,71419] 0 2024-09-13T22:55:54.586 INFO:tasks.workunit.client.1.smithi047.stdout:8/118: dwrite d8/f9 [4194304,4194304] 0 2024-09-13T22:55:54.587 INFO:tasks.workunit.client.1.smithi047.stdout:2/152: chown d1/de/l32 4731 1 2024-09-13T22:55:54.593 INFO:tasks.workunit.client.1.smithi047.stdout:5/65: stat l11 0 2024-09-13T22:55:54.595 INFO:tasks.workunit.client.0.smithi002.stdout:1/71: dwrite d1/ff [0,4194304] 0 2024-09-13T22:55:54.596 INFO:tasks.workunit.client.1.smithi047.stdout:2/153: dwrite d1/df/d26/f30 [0,4194304] 0 2024-09-13T22:55:54.598 INFO:tasks.workunit.client.1.smithi047.stdout:6/86: sync 2024-09-13T22:55:54.607 INFO:tasks.workunit.client.1.smithi047.stdout:8/119: creat d8/f2c x:0 0 0 2024-09-13T22:55:54.608 INFO:tasks.workunit.client.1.smithi047.stdout:3/115: fdatasync d0/d3/d4/d16/f22 0 2024-09-13T22:55:54.610 INFO:tasks.workunit.client.0.smithi002.stdout:6/53: symlink le 0 2024-09-13T22:55:54.611 INFO:tasks.workunit.client.0.smithi002.stdout:9/61: write f5 [4016818,17995] 0 2024-09-13T22:55:54.612 INFO:tasks.workunit.client.1.smithi047.stdout:0/85: creat d1/d5/d16/f1c x:0 0 0 2024-09-13T22:55:54.614 INFO:tasks.workunit.client.0.smithi002.stdout:1/72: dread d1/fe [0,4194304] 0 2024-09-13T22:55:54.614 INFO:tasks.workunit.client.1.smithi047.stdout:5/66: symlink d19/l20 0 2024-09-13T22:55:54.616 INFO:tasks.workunit.client.0.smithi002.stdout:9/62: dread d8/fa [0,4194304] 0 2024-09-13T22:55:54.618 INFO:tasks.workunit.client.1.smithi047.stdout:8/120: creat d8/f2d x:0 0 0 2024-09-13T22:55:54.619 INFO:tasks.workunit.client.1.smithi047.stdout:3/116: fdatasync d0/d3/d4/d6/de/f10 0 2024-09-13T22:55:54.620 INFO:tasks.workunit.client.1.smithi047.stdout:3/117: dread - d0/d3/d4/d6/de/f11 zero size 2024-09-13T22:55:54.622 INFO:tasks.workunit.client.1.smithi047.stdout:2/154: creat d1/df/d1d/d20/d2b/f34 x:0 0 0 2024-09-13T22:55:54.625 INFO:tasks.workunit.client.1.smithi047.stdout:6/87: dread d3/f6 [0,4194304] 0 2024-09-13T22:55:54.628 INFO:tasks.workunit.client.1.smithi047.stdout:0/86: link d1/d7/ff d1/d7/f1d 0 2024-09-13T22:55:54.629 INFO:tasks.workunit.client.1.smithi047.stdout:6/88: chown l2 23063 1 2024-09-13T22:55:54.631 INFO:tasks.workunit.client.1.smithi047.stdout:2/155: mkdir d1/df/d35 0 2024-09-13T22:55:54.633 INFO:tasks.workunit.client.1.smithi047.stdout:8/121: dwrite d8/f2d [0,4194304] 0 2024-09-13T22:55:54.639 INFO:tasks.workunit.client.1.smithi047.stdout:3/118: dwrite d0/d3/d4/d1a/f27 [0,4194304] 0 2024-09-13T22:55:54.643 INFO:tasks.workunit.client.1.smithi047.stdout:0/87: write d1/d5/f9 [1668471,73117] 0 2024-09-13T22:55:54.648 INFO:tasks.workunit.client.1.smithi047.stdout:6/89: dread d3/f9 [0,4194304] 0 2024-09-13T22:55:54.650 INFO:tasks.workunit.client.1.smithi047.stdout:8/122: dwrite d8/f26 [0,4194304] 0 2024-09-13T22:55:54.654 INFO:tasks.workunit.client.1.smithi047.stdout:3/119: unlink d0/d3/cd 0 2024-09-13T22:55:54.660 INFO:tasks.workunit.client.1.smithi047.stdout:5/67: write f17 [1101815,130982] 0 2024-09-13T22:55:54.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:54 smithi047 ceph-mon[34560]: pgmap v7: 65 pgs: 65 active+clean; 244 MiB data, 939 MiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 9.9 MiB/s wr, 161 op/s 2024-09-13T22:55:54.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:54 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:54.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:54 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:54.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:54 smithi047 ceph-mon[34560]: Standby manager daemon smithi002.yumtzz started 2024-09-13T22:55:54.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:54 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.yumtzz/crt"}]: dispatch 2024-09-13T22:55:54.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:54 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:55:54.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:54 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.yumtzz/key"}]: dispatch 2024-09-13T22:55:54.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:54 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:55:54.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:54 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:54.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:54 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:54.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:54 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:55:54.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:54 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:55:54.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:54 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:55:54.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:54 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:55:54.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:54 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:55:54.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:54 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:55:54.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:54 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:54.664 INFO:tasks.workunit.client.1.smithi047.stdout:6/90: creat d3/d15/f1d x:0 0 0 2024-09-13T22:55:54.668 INFO:tasks.workunit.client.1.smithi047.stdout:9/78: sync 2024-09-13T22:55:54.669 INFO:tasks.workunit.client.1.smithi047.stdout:8/123: creat d8/f2e x:0 0 0 2024-09-13T22:55:54.674 INFO:tasks.workunit.client.1.smithi047.stdout:3/120: dread d0/d3/d4/d16/d1c/f1d [0,4194304] 0 2024-09-13T22:55:54.676 INFO:tasks.workunit.client.1.smithi047.stdout:3/121: write d0/d3/d4/d6/de/f10 [324183,6094] 0 2024-09-13T22:55:54.681 INFO:tasks.workunit.client.1.smithi047.stdout:8/124: symlink d8/l2f 0 2024-09-13T22:55:54.684 INFO:tasks.workunit.client.1.smithi047.stdout:5/68: truncate d19/f1c 663953 0 2024-09-13T22:55:54.685 INFO:tasks.workunit.client.1.smithi047.stdout:5/69: chown c16 0 1 2024-09-13T22:55:54.686 INFO:tasks.workunit.client.1.smithi047.stdout:2/156: dwrite d1/de/f13 [0,4194304] 0 2024-09-13T22:55:54.687 INFO:tasks.workunit.client.1.smithi047.stdout:0/88: rename d1/d5/c13 to d1/c1e 0 2024-09-13T22:55:54.689 INFO:tasks.workunit.client.1.smithi047.stdout:0/89: chown d1/d5/d11/c19 83 1 2024-09-13T22:55:54.695 INFO:tasks.workunit.client.1.smithi047.stdout:9/79: unlink d1/c4 0 2024-09-13T22:55:54.706 INFO:tasks.workunit.client.1.smithi047.stdout:9/80: dwrite d1/dc/d14/f16 [0,4194304] 0 2024-09-13T22:55:54.709 INFO:tasks.workunit.client.1.smithi047.stdout:3/122: rename d0/d3/d4/c5 to d0/c29 0 2024-09-13T22:55:54.709 INFO:tasks.workunit.client.1.smithi047.stdout:8/125: dwrite d8/f1e [0,4194304] 0 2024-09-13T22:55:54.712 INFO:tasks.workunit.client.1.smithi047.stdout:0/90: mknod d1/d5/c1f 0 2024-09-13T22:55:54.723 INFO:tasks.workunit.client.1.smithi047.stdout:6/91: dwrite f1 [0,4194304] 0 2024-09-13T22:55:54.726 INFO:tasks.workunit.client.1.smithi047.stdout:2/157: creat d1/df/d35/f36 x:0 0 0 2024-09-13T22:55:54.735 INFO:tasks.workunit.client.1.smithi047.stdout:1/69: sync 2024-09-13T22:55:54.735 INFO:tasks.workunit.client.1.smithi047.stdout:4/80: sync 2024-09-13T22:55:54.735 INFO:tasks.workunit.client.1.smithi047.stdout:7/45: sync 2024-09-13T22:55:54.736 INFO:tasks.workunit.client.1.smithi047.stdout:1/70: chown d0 506832195 1 2024-09-13T22:55:54.736 INFO:tasks.workunit.client.1.smithi047.stdout:8/126: creat d8/f30 x:0 0 0 2024-09-13T22:55:54.737 INFO:tasks.workunit.client.1.smithi047.stdout:2/158: dwrite d1/df/d1d/d20/d2b/f34 [0,4194304] 0 2024-09-13T22:55:54.740 INFO:tasks.workunit.client.1.smithi047.stdout:3/123: mkdir d0/d3/d4/d1a/d2a 0 2024-09-13T22:55:54.747 INFO:tasks.workunit.client.1.smithi047.stdout:5/70: link l14 d19/l21 0 2024-09-13T22:55:54.747 INFO:tasks.workunit.client.1.smithi047.stdout:0/91: dread d1/f4 [0,4194304] 0 2024-09-13T22:55:54.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:54 smithi002 ceph-mon[27637]: pgmap v7: 65 pgs: 65 active+clean; 244 MiB data, 939 MiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 9.9 MiB/s wr, 161 op/s 2024-09-13T22:55:54.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:54 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:54.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:54 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:54.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:54 smithi002 ceph-mon[27637]: Standby manager daemon smithi002.yumtzz started 2024-09-13T22:55:54.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:54 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.yumtzz/crt"}]: dispatch 2024-09-13T22:55:54.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:54 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:55:54.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:54 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.yumtzz/key"}]: dispatch 2024-09-13T22:55:54.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:54 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.2:0/2' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:55:54.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:54 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:54.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:54 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:54.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:54 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:55:54.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:54 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:55:54.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:54 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:55:54.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:54 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:55:54.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:54 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:55:54.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:54 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:55:54.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:54 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:55:54.751 INFO:tasks.workunit.client.1.smithi047.stdout:6/92: unlink d3/f14 0 2024-09-13T22:55:54.756 INFO:tasks.workunit.client.1.smithi047.stdout:9/81: creat d1/dc/d18/f19 x:0 0 0 2024-09-13T22:55:54.756 INFO:tasks.workunit.client.1.smithi047.stdout:9/82: fsync d1/dc/d14/f17 0 2024-09-13T22:55:54.758 INFO:tasks.workunit.client.1.smithi047.stdout:4/81: mkdir dc/de/d17 0 2024-09-13T22:55:54.762 INFO:tasks.workunit.client.1.smithi047.stdout:7/46: creat d0/d7/da/f13 x:0 0 0 2024-09-13T22:55:54.764 INFO:tasks.workunit.client.1.smithi047.stdout:1/71: mkdir d0/d7/d10 0 2024-09-13T22:55:54.764 INFO:tasks.workunit.client.1.smithi047.stdout:1/72: fdatasync d0/f9 0 2024-09-13T22:55:54.766 INFO:tasks.workunit.client.1.smithi047.stdout:8/127: mknod d8/c31 0 2024-09-13T22:55:54.768 INFO:tasks.workunit.client.1.smithi047.stdout:2/159: mkdir d1/df/d1d/d20/d37 0 2024-09-13T22:55:54.771 INFO:tasks.workunit.client.1.smithi047.stdout:5/71: chown cf 1219 1 2024-09-13T22:55:54.772 INFO:tasks.workunit.client.1.smithi047.stdout:0/92: unlink d1/d5/d16/f1c 0 2024-09-13T22:55:54.777 INFO:tasks.workunit.client.1.smithi047.stdout:4/82: creat dc/de/f18 x:0 0 0 2024-09-13T22:55:54.783 INFO:tasks.workunit.client.1.smithi047.stdout:8/128: unlink d8/f17 0 2024-09-13T22:55:54.787 INFO:tasks.workunit.client.1.smithi047.stdout:7/47: rmdir d0/d7 39 2024-09-13T22:55:54.788 INFO:tasks.workunit.client.1.smithi047.stdout:1/73: rmdir d0 39 2024-09-13T22:55:54.789 INFO:tasks.workunit.client.1.smithi047.stdout:5/72: rmdir d19 39 2024-09-13T22:55:54.797 INFO:tasks.workunit.client.1.smithi047.stdout:6/93: creat d3/d13/d1c/f1e x:0 0 0 2024-09-13T22:55:54.804 INFO:tasks.workunit.client.1.smithi047.stdout:8/129: rename d8/f2a to d8/f32 0 2024-09-13T22:55:54.807 INFO:tasks.workunit.client.1.smithi047.stdout:3/124: creat d0/d3/d4/f2b x:0 0 0 2024-09-13T22:55:54.809 INFO:tasks.workunit.client.1.smithi047.stdout:3/125: dread d0/d3/d4/d16/d1c/f1d [0,4194304] 0 2024-09-13T22:55:54.811 INFO:tasks.workunit.client.1.smithi047.stdout:7/48: read - d0/d7/f12 zero size 2024-09-13T22:55:54.817 INFO:tasks.workunit.client.1.smithi047.stdout:5/73: truncate d19/f1e 969964 0 2024-09-13T22:55:54.820 INFO:tasks.workunit.client.1.smithi047.stdout:1/74: dwrite d0/fd [0,4194304] 0 2024-09-13T22:55:54.824 INFO:tasks.workunit.client.1.smithi047.stdout:9/83: creat d1/f1a x:0 0 0 2024-09-13T22:55:54.825 INFO:tasks.workunit.client.1.smithi047.stdout:0/93: write d1/d7/f1d [2086436,45960] 0 2024-09-13T22:55:54.825 INFO:tasks.workunit.client.1.smithi047.stdout:9/84: fdatasync d1/dc/f15 0 2024-09-13T22:55:54.837 INFO:tasks.workunit.client.1.smithi047.stdout:2/160: rename d1/c5 to d1/df/d1d/c38 0 2024-09-13T22:55:54.838 INFO:tasks.workunit.client.1.smithi047.stdout:2/161: write d1/df/d35/f36 [691565,12281] 0 2024-09-13T22:55:54.838 INFO:tasks.workunit.client.1.smithi047.stdout:2/162: read - d1/df/d1d/d20/f2c zero size 2024-09-13T22:55:54.840 INFO:tasks.workunit.client.1.smithi047.stdout:7/49: rmdir d0/db 39 2024-09-13T22:55:54.842 INFO:tasks.workunit.client.1.smithi047.stdout:6/94: write d3/f8 [1135176,81887] 0 2024-09-13T22:55:54.847 INFO:tasks.workunit.client.1.smithi047.stdout:4/83: truncate f8 851858 0 2024-09-13T22:55:54.847 INFO:tasks.workunit.client.1.smithi047.stdout:4/84: fdatasync dc/de/f16 0 2024-09-13T22:55:54.848 INFO:tasks.workunit.client.1.smithi047.stdout:4/85: truncate fb 591401 0 2024-09-13T22:55:54.851 INFO:tasks.workunit.client.1.smithi047.stdout:0/94: creat d1/d5/d11/f20 x:0 0 0 2024-09-13T22:55:54.854 INFO:tasks.workunit.client.1.smithi047.stdout:0/95: dread d1/d5/f9 [0,4194304] 0 2024-09-13T22:55:54.855 INFO:tasks.workunit.client.1.smithi047.stdout:0/96: fsync d1/d7/f18 0 2024-09-13T22:55:54.856 INFO:tasks.workunit.client.1.smithi047.stdout:0/97: fsync d1/d7/ff 0 2024-09-13T22:55:54.858 INFO:tasks.workunit.client.1.smithi047.stdout:3/126: rename d0/d3/d4/d6 to d0/d3/d4/d16/d2c 0 2024-09-13T22:55:54.865 INFO:tasks.workunit.client.1.smithi047.stdout:2/163: rmdir d1/df/d26 39 2024-09-13T22:55:54.868 INFO:tasks.workunit.client.1.smithi047.stdout:3/127: dwrite d0/d3/d4/d1a/f27 [0,4194304] 0 2024-09-13T22:55:54.869 INFO:tasks.workunit.client.1.smithi047.stdout:7/50: fsync d0/db/fc 0 2024-09-13T22:55:54.871 INFO:tasks.workunit.client.1.smithi047.stdout:6/95: creat d3/d15/f1f x:0 0 0 2024-09-13T22:55:54.878 INFO:tasks.workunit.client.1.smithi047.stdout:1/75: mknod d0/d7/d10/c11 0 2024-09-13T22:55:54.883 INFO:tasks.workunit.client.1.smithi047.stdout:4/86: creat dc/f19 x:0 0 0 2024-09-13T22:55:54.884 INFO:tasks.workunit.client.1.smithi047.stdout:4/87: read - dc/de/f18 zero size 2024-09-13T22:55:54.887 INFO:tasks.workunit.client.1.smithi047.stdout:9/85: mkdir d1/dc/d14/d1b 0 2024-09-13T22:55:54.887 INFO:tasks.workunit.client.1.smithi047.stdout:9/86: dread - d1/f1a zero size 2024-09-13T22:55:54.888 INFO:tasks.workunit.client.1.smithi047.stdout:5/74: truncate f17 1717541 0 2024-09-13T22:55:54.889 INFO:tasks.workunit.client.1.smithi047.stdout:9/87: write d1/dc/d14/f13 [291469,41981] 0 2024-09-13T22:55:54.890 INFO:tasks.workunit.client.1.smithi047.stdout:8/130: link d8/l29 d8/l33 0 2024-09-13T22:55:54.894 INFO:tasks.workunit.client.1.smithi047.stdout:0/98: dread - d1/f15 zero size 2024-09-13T22:55:54.899 INFO:tasks.workunit.client.1.smithi047.stdout:2/164: rename d1/df/d35/f36 to d1/df/d1d/d20/d37/f39 0 2024-09-13T22:55:54.899 INFO:tasks.workunit.client.1.smithi047.stdout:4/88: rename dc to dc/d1a 22 2024-09-13T22:55:54.903 INFO:tasks.workunit.client.1.smithi047.stdout:4/89: dread f4 [0,4194304] 0 2024-09-13T22:55:54.904 INFO:tasks.workunit.client.1.smithi047.stdout:4/90: fsync fb 0 2024-09-13T22:55:54.904 INFO:tasks.workunit.client.1.smithi047.stdout:4/91: stat dc 0 2024-09-13T22:55:54.905 INFO:tasks.workunit.client.1.smithi047.stdout:3/128: creat d0/d3/d4/d16/d1c/f2d x:0 0 0 2024-09-13T22:55:54.911 INFO:tasks.workunit.client.1.smithi047.stdout:6/96: rmdir d3 39 2024-09-13T22:55:54.926 INFO:tasks.workunit.client.1.smithi047.stdout:8/131: rmdir d8 39 2024-09-13T22:55:54.929 INFO:tasks.workunit.client.1.smithi047.stdout:0/99: truncate d1/f4 3704888 0 2024-09-13T22:55:54.930 INFO:tasks.workunit.client.1.smithi047.stdout:0/100: readlink d1/d5/d11/l12 0 2024-09-13T22:55:54.938 INFO:tasks.workunit.client.1.smithi047.stdout:2/165: unlink d1/de/d17/f1e 0 2024-09-13T22:55:54.945 INFO:tasks.workunit.client.1.smithi047.stdout:3/129: mkdir d0/d3/d4/d16/d2c/de/d1f/d2e 0 2024-09-13T22:55:54.946 INFO:tasks.workunit.client.1.smithi047.stdout:3/130: read d0/f12 [953838,123] 0 2024-09-13T22:55:54.947 INFO:tasks.workunit.client.1.smithi047.stdout:3/131: chown d0/d3/d4/f2b 34194 1 2024-09-13T22:55:54.953 INFO:tasks.workunit.client.1.smithi047.stdout:0/101: symlink d1/d5/d16/l21 0 2024-09-13T22:55:54.957 INFO:tasks.workunit.client.1.smithi047.stdout:6/97: dwrite d3/d15/f1d [0,4194304] 0 2024-09-13T22:55:54.959 INFO:tasks.workunit.client.1.smithi047.stdout:3/132: dwrite d0/d3/d4/f9 [0,4194304] 0 2024-09-13T22:55:54.960 INFO:tasks.workunit.client.1.smithi047.stdout:3/133: dread - d0/d3/d4/d16/d1c/f2d zero size 2024-09-13T22:55:54.962 INFO:tasks.workunit.client.1.smithi047.stdout:4/92: creat dc/de/d17/f1b x:0 0 0 2024-09-13T22:55:54.962 INFO:tasks.workunit.client.1.smithi047.stdout:4/93: chown f4 51399205 1 2024-09-13T22:55:54.963 INFO:tasks.workunit.client.1.smithi047.stdout:4/94: stat dc/de/f14 0 2024-09-13T22:55:54.986 INFO:tasks.workunit.client.1.smithi047.stdout:0/102: write d1/f17 [874425,122149] 0 2024-09-13T22:55:54.992 INFO:tasks.workunit.client.1.smithi047.stdout:3/134: creat d0/d3/d4/d16/f2f x:0 0 0 2024-09-13T22:55:54.993 INFO:tasks.workunit.client.1.smithi047.stdout:6/98: dwrite d3/f9 [0,4194304] 0 2024-09-13T22:55:54.994 INFO:tasks.workunit.client.1.smithi047.stdout:6/99: chown d3/d11/l17 0 1 2024-09-13T22:55:54.994 INFO:tasks.workunit.client.1.smithi047.stdout:2/166: write d1/de/f12 [2648083,29005] 0 2024-09-13T22:55:55.000 INFO:tasks.workunit.client.1.smithi047.stdout:4/95: symlink dc/de/l1c 0 2024-09-13T22:55:55.003 INFO:tasks.workunit.client.1.smithi047.stdout:7/51: getdents d0/d7 0 2024-09-13T22:55:55.007 INFO:tasks.workunit.client.1.smithi047.stdout:9/88: getdents d1 0 2024-09-13T22:55:55.010 INFO:tasks.workunit.client.1.smithi047.stdout:4/96: dwrite dc/fd [0,4194304] 0 2024-09-13T22:55:55.016 INFO:tasks.workunit.client.1.smithi047.stdout:3/135: unlink d0/d3/d4/c19 0 2024-09-13T22:55:55.017 INFO:tasks.workunit.client.1.smithi047.stdout:3/136: chown d0/d3/d4/d16/d2c/f24 301468 1 2024-09-13T22:55:55.019 INFO:tasks.workunit.client.1.smithi047.stdout:3/137: write d0/d3/d4/d16/d2c/de/f11 [994589,106080] 0 2024-09-13T22:55:55.023 INFO:tasks.workunit.client.1.smithi047.stdout:6/100: creat d3/d13/d1c/f20 x:0 0 0 2024-09-13T22:55:55.024 INFO:tasks.workunit.client.1.smithi047.stdout:7/52: rmdir d0/d7 39 2024-09-13T22:55:55.026 INFO:tasks.workunit.client.1.smithi047.stdout:6/101: dread d3/f8 [0,4194304] 0 2024-09-13T22:55:55.026 INFO:tasks.workunit.client.1.smithi047.stdout:6/102: read d3/f9 [2324536,80226] 0 2024-09-13T22:55:55.028 INFO:tasks.workunit.client.1.smithi047.stdout:6/103: write d3/d15/f1f [318007,30324] 0 2024-09-13T22:55:55.029 INFO:tasks.workunit.client.1.smithi047.stdout:5/75: dread f17 [0,4194304] 0 2024-09-13T22:55:55.034 INFO:tasks.workunit.client.1.smithi047.stdout:9/89: mknod d1/c1c 0 2024-09-13T22:55:55.040 INFO:tasks.workunit.client.1.smithi047.stdout:4/97: rmdir dc/de 39 2024-09-13T22:55:55.053 INFO:tasks.workunit.client.1.smithi047.stdout:6/104: mknod d3/d15/c21 0 2024-09-13T22:55:55.054 INFO:tasks.workunit.client.1.smithi047.stdout:5/76: rmdir d19 39 2024-09-13T22:55:55.070 INFO:tasks.workunit.client.1.smithi047.stdout:3/138: creat d0/d3/d4/d1a/d2a/f30 x:0 0 0 2024-09-13T22:55:55.070 INFO:tasks.workunit.client.1.smithi047.stdout:3/139: write d0/d3/d4/d16/f22 [3343938,130925] 0 2024-09-13T22:55:55.071 INFO:tasks.workunit.client.1.smithi047.stdout:0/103: dwrite d1/f4 [0,4194304] 0 2024-09-13T22:55:55.073 INFO:tasks.workunit.client.1.smithi047.stdout:6/105: fdatasync d3/ff 0 2024-09-13T22:55:55.074 INFO:tasks.workunit.client.1.smithi047.stdout:6/106: readlink d3/d11/l12 0 2024-09-13T22:55:55.074 INFO:tasks.workunit.client.1.smithi047.stdout:6/107: chown d3/la 1426043300 1 2024-09-13T22:55:55.074 INFO:tasks.workunit.client.1.smithi047.stdout:0/104: read d1/d7/f18 [36842,30962] 0 2024-09-13T22:55:55.077 INFO:tasks.workunit.client.1.smithi047.stdout:6/108: write d3/d15/f1f [1173338,30350] 0 2024-09-13T22:55:55.082 INFO:tasks.workunit.client.1.smithi047.stdout:2/167: getdents d1/df/d1d/d20/d2b 0 2024-09-13T22:55:55.084 INFO:tasks.workunit.client.1.smithi047.stdout:3/140: creat d0/f31 x:0 0 0 2024-09-13T22:55:55.088 INFO:tasks.workunit.client.1.smithi047.stdout:9/90: creat d1/dc/d14/dd/f1d x:0 0 0 2024-09-13T22:55:55.095 INFO:tasks.workunit.client.1.smithi047.stdout:9/91: dwrite d1/dc/d18/f19 [0,4194304] 0 2024-09-13T22:55:55.228 INFO:tasks.workunit.client.1.smithi047.stdout:3/141: mkdir d0/d3/d4/d16/d32 0 2024-09-13T22:55:55.236 INFO:tasks.workunit.client.1.smithi047.stdout:4/98: rename dc/de/l15 to dc/l1d 0 2024-09-13T22:55:55.242 INFO:tasks.workunit.client.1.smithi047.stdout:9/92: dread d1/f5 [0,4194304] 0 2024-09-13T22:55:55.243 INFO:tasks.workunit.client.1.smithi047.stdout:5/77: link cd d19/c22 0 2024-09-13T22:55:55.244 INFO:tasks.workunit.client.1.smithi047.stdout:2/168: write d1/f3 [3735881,36754] 0 2024-09-13T22:55:55.246 INFO:tasks.workunit.client.1.smithi047.stdout:6/109: creat d3/f22 x:0 0 0 2024-09-13T22:55:55.247 INFO:tasks.workunit.client.1.smithi047.stdout:6/110: dread - d3/f22 zero size 2024-09-13T22:55:55.249 INFO:tasks.workunit.client.1.smithi047.stdout:6/111: chown d3/f9 12 1 2024-09-13T22:55:55.250 INFO:tasks.workunit.client.1.smithi047.stdout:5/78: dread d19/f1d [0,4194304] 0 2024-09-13T22:55:55.250 INFO:tasks.workunit.client.1.smithi047.stdout:6/112: readlink d3/d11/l12 0 2024-09-13T22:55:55.250 INFO:tasks.workunit.client.1.smithi047.stdout:6/113: dread - d3/d13/d1c/f20 zero size 2024-09-13T22:55:55.251 INFO:tasks.workunit.client.1.smithi047.stdout:3/142: rename d0/d3/d4/d16/f22 to d0/d3/f33 0 2024-09-13T22:55:55.253 INFO:tasks.workunit.client.1.smithi047.stdout:4/99: truncate f4 760145 0 2024-09-13T22:55:55.260 INFO:tasks.workunit.client.1.smithi047.stdout:2/169: mknod d1/d16/c3a 0 2024-09-13T22:55:55.268 INFO:tasks.workunit.client.1.smithi047.stdout:6/114: mkdir d3/d13/d1c/d23 0 2024-09-13T22:55:55.272 INFO:tasks.workunit.client.1.smithi047.stdout:2/170: dread d1/de/f12 [0,4194304] 0 2024-09-13T22:55:55.273 INFO:tasks.workunit.client.1.smithi047.stdout:4/100: creat dc/de/d17/f1e x:0 0 0 2024-09-13T22:55:55.275 INFO:tasks.workunit.client.1.smithi047.stdout:4/101: write dc/de/d17/f1e [450779,89706] 0 2024-09-13T22:55:55.284 INFO:tasks.workunit.client.1.smithi047.stdout:9/93: truncate d1/dc/d14/dd/f9 199295 0 2024-09-13T22:55:55.288 INFO:tasks.workunit.client.1.smithi047.stdout:6/115: rmdir d3 39 2024-09-13T22:55:55.290 INFO:tasks.workunit.client.1.smithi047.stdout:3/143: write d0/f12 [1765307,51586] 0 2024-09-13T22:55:55.292 INFO:tasks.workunit.client.1.smithi047.stdout:9/94: dwrite d1/dc/d14/dd/f1d [0,4194304] 0 2024-09-13T22:55:55.294 INFO:tasks.workunit.client.1.smithi047.stdout:9/95: stat d1/dc 0 2024-09-13T22:55:55.314 INFO:tasks.workunit.client.0.smithi002.stdout:1/73: mkdir d1/d16 0 2024-09-13T22:55:55.317 INFO:tasks.workunit.client.0.smithi002.stdout:1/74: unlink d1/d13/l14 0 2024-09-13T22:55:55.318 INFO:tasks.workunit.client.0.smithi002.stdout:1/75: fsync d1/d6/fc 0 2024-09-13T22:55:55.319 INFO:tasks.workunit.client.0.smithi002.stdout:1/76: write d1/d6/fc [1147432,75401] 0 2024-09-13T22:55:55.320 INFO:tasks.workunit.client.0.smithi002.stdout:6/54: truncate fd 3063763 0 2024-09-13T22:55:55.320 INFO:tasks.workunit.client.0.smithi002.stdout:6/55: dread - fa zero size 2024-09-13T22:55:55.325 INFO:tasks.workunit.client.0.smithi002.stdout:1/77: dwrite d1/ff [0,4194304] 0 2024-09-13T22:55:55.326 INFO:tasks.workunit.client.0.smithi002.stdout:1/78: chown d1/f9 5 1 2024-09-13T22:55:55.328 INFO:tasks.workunit.client.0.smithi002.stdout:1/79: dread d1/d6/fa [0,4194304] 0 2024-09-13T22:55:55.336 INFO:tasks.workunit.client.0.smithi002.stdout:1/80: dwrite d1/d6/fc [0,4194304] 0 2024-09-13T22:55:55.342 INFO:tasks.workunit.client.0.smithi002.stdout:1/81: symlink d1/d13/l17 0 2024-09-13T22:55:55.342 INFO:tasks.workunit.client.0.smithi002.stdout:1/82: fdatasync d1/d6/fa 0 2024-09-13T22:55:55.343 INFO:tasks.workunit.client.0.smithi002.stdout:1/83: dread - d1/fb zero size 2024-09-13T22:55:55.346 INFO:tasks.workunit.client.0.smithi002.stdout:1/84: creat d1/d6/f18 x:0 0 0 2024-09-13T22:55:55.350 INFO:tasks.workunit.client.0.smithi002.stdout:1/85: dread d1/d6/fc [0,4194304] 0 2024-09-13T22:55:55.352 INFO:tasks.workunit.client.0.smithi002.stdout:1/86: write d1/f7 [824140,94882] 0 2024-09-13T22:55:55.355 INFO:tasks.workunit.client.0.smithi002.stdout:1/87: getdents d1 0 2024-09-13T22:55:55.358 INFO:tasks.workunit.client.0.smithi002.stdout:1/88: write d1/d6/fa [105556,86336] 0 2024-09-13T22:55:55.360 INFO:tasks.workunit.client.0.smithi002.stdout:1/89: creat d1/d13/f19 x:0 0 0 2024-09-13T22:55:55.363 INFO:tasks.workunit.client.0.smithi002.stdout:1/90: dread d1/ff [0,4194304] 0 2024-09-13T22:55:55.364 INFO:tasks.workunit.client.0.smithi002.stdout:1/91: chown d1/c10 1411 1 2024-09-13T22:55:55.413 INFO:tasks.workunit.client.1.smithi047.stdout:6/116: symlink d3/d15/l24 0 2024-09-13T22:55:55.413 INFO:tasks.workunit.client.1.smithi047.stdout:9/96: dwrite d1/dc/d18/f19 [4194304,4194304] 0 2024-09-13T22:55:55.418 INFO:tasks.workunit.client.1.smithi047.stdout:2/171: getdents d1/df/d1d/d20/d29 0 2024-09-13T22:55:55.420 INFO:tasks.workunit.client.1.smithi047.stdout:2/172: fsync d1/f2a 0 2024-09-13T22:55:55.420 INFO:tasks.workunit.client.1.smithi047.stdout:3/144: truncate d0/d3/d4/d1a/f27 1466967 0 2024-09-13T22:55:55.425 INFO:tasks.workunit.client.1.smithi047.stdout:6/117: dwrite d3/d13/d1c/f1e [0,4194304] 0 2024-09-13T22:55:55.426 INFO:tasks.workunit.client.1.smithi047.stdout:9/97: dwrite d1/dc/d18/f19 [0,4194304] 0 2024-09-13T22:55:55.427 INFO:tasks.workunit.client.1.smithi047.stdout:6/118: fdatasync f1 0 2024-09-13T22:55:55.429 INFO:tasks.workunit.client.1.smithi047.stdout:2/173: fsync d1/df/d1d/d20/d37/f39 0 2024-09-13T22:55:55.435 INFO:tasks.workunit.client.1.smithi047.stdout:6/119: rmdir d3/d15 39 2024-09-13T22:55:55.435 INFO:tasks.workunit.client.1.smithi047.stdout:2/174: write d1/df/d1d/d20/d37/f39 [359567,31468] 0 2024-09-13T22:55:55.435 INFO:tasks.workunit.client.1.smithi047.stdout:3/145: dwrite d0/d3/d4/d16/d2c/f20 [0,4194304] 0 2024-09-13T22:55:55.437 INFO:tasks.workunit.client.1.smithi047.stdout:2/175: chown d1/df/d1d/d20/d37 19105 1 2024-09-13T22:55:55.438 INFO:tasks.workunit.client.1.smithi047.stdout:6/120: truncate d3/f22 309162 0 2024-09-13T22:55:55.440 INFO:tasks.workunit.client.1.smithi047.stdout:9/98: creat d1/dc/d14/d1b/f1e x:0 0 0 2024-09-13T22:55:55.440 INFO:tasks.workunit.client.1.smithi047.stdout:2/176: dread - d1/df/d1d/d20/d29/f2d zero size 2024-09-13T22:55:55.441 INFO:tasks.workunit.client.1.smithi047.stdout:3/146: fsync d0/d3/d4/d16/d2c/de/f28 0 2024-09-13T22:55:55.441 INFO:tasks.workunit.client.1.smithi047.stdout:6/121: chown d3/d13/d1c/f1e 922744510 1 2024-09-13T22:55:55.443 INFO:tasks.workunit.client.1.smithi047.stdout:9/99: symlink d1/dc/d18/l1f 0 2024-09-13T22:55:55.444 INFO:tasks.workunit.client.1.smithi047.stdout:3/147: read d0/d3/d4/d16/d2c/f20 [2362559,113516] 0 2024-09-13T22:55:55.446 INFO:tasks.workunit.client.1.smithi047.stdout:2/177: truncate d1/df/d1d/d20/d37/f39 804930 0 2024-09-13T22:55:55.449 INFO:tasks.workunit.client.1.smithi047.stdout:2/178: read - d1/de/f25 zero size 2024-09-13T22:55:55.450 INFO:tasks.workunit.client.1.smithi047.stdout:3/148: fsync d0/d3/d4/d16/d2c/de/f28 0 2024-09-13T22:55:55.453 INFO:tasks.workunit.client.1.smithi047.stdout:6/122: dwrite d3/f6 [0,4194304] 0 2024-09-13T22:55:55.455 INFO:tasks.workunit.client.1.smithi047.stdout:2/179: chown d1/df/d1d/d2e/l2f 744224137 1 2024-09-13T22:55:55.455 INFO:tasks.workunit.client.1.smithi047.stdout:6/123: fsync d3/d13/d1c/f1e 0 2024-09-13T22:55:55.456 INFO:tasks.workunit.client.1.smithi047.stdout:2/180: chown d1/df/d1d/d20/d37/f39 3992 1 2024-09-13T22:55:55.461 INFO:tasks.workunit.client.1.smithi047.stdout:9/100: rename d1/dc/d14/d1b to d1/dc/d14/d20 0 2024-09-13T22:55:55.461 INFO:tasks.workunit.client.1.smithi047.stdout:9/101: chown d1/dc/d14/dd 8121314 1 2024-09-13T22:55:55.463 INFO:tasks.workunit.client.1.smithi047.stdout:3/149: mkdir d0/d25/d34 0 2024-09-13T22:55:55.464 INFO:tasks.workunit.client.1.smithi047.stdout:9/102: truncate d1/dc/d14/d20/f1e 2045 0 2024-09-13T22:55:55.465 INFO:tasks.workunit.client.1.smithi047.stdout:2/181: mknod d1/d16/c3b 0 2024-09-13T22:55:55.466 INFO:tasks.workunit.client.1.smithi047.stdout:6/124: unlink d3/d15/f1f 0 2024-09-13T22:55:55.471 INFO:tasks.workunit.client.1.smithi047.stdout:2/182: dread d1/df/d1d/d20/d37/f39 [0,4194304] 0 2024-09-13T22:55:55.471 INFO:tasks.workunit.client.1.smithi047.stdout:6/125: rename d3/f6 to d3/d11/f25 0 2024-09-13T22:55:55.476 INFO:tasks.workunit.client.1.smithi047.stdout:3/150: dwrite d0/d3/d4/d16/d2c/de/f17 [4194304,4194304] 0 2024-09-13T22:55:55.478 INFO:tasks.workunit.client.1.smithi047.stdout:9/103: getdents d1/dc/d14/dd 0 2024-09-13T22:55:55.479 INFO:tasks.workunit.client.1.smithi047.stdout:9/104: stat d1/dc/d18/f19 0 2024-09-13T22:55:55.480 INFO:tasks.workunit.client.1.smithi047.stdout:6/126: unlink d3/d13/l19 0 2024-09-13T22:55:55.481 INFO:tasks.workunit.client.1.smithi047.stdout:6/127: readlink d3/d15/l24 0 2024-09-13T22:55:55.484 INFO:tasks.workunit.client.1.smithi047.stdout:3/151: stat d0/c29 0 2024-09-13T22:55:55.484 INFO:tasks.workunit.client.1.smithi047.stdout:2/183: dwrite d1/df/d1d/d20/d29/f2d [0,4194304] 0 2024-09-13T22:55:55.486 INFO:tasks.workunit.client.1.smithi047.stdout:6/128: write d3/d13/d1c/f1e [2521844,20017] 0 2024-09-13T22:55:55.493 INFO:tasks.workunit.client.1.smithi047.stdout:3/152: unlink d0/d3/d4/f2b 0 2024-09-13T22:55:55.493 INFO:tasks.workunit.client.1.smithi047.stdout:9/105: dwrite d1/dc/d18/f19 [0,4194304] 0 2024-09-13T22:55:55.496 INFO:tasks.workunit.client.1.smithi047.stdout:1/76: sync 2024-09-13T22:55:55.497 INFO:tasks.workunit.client.1.smithi047.stdout:9/106: readlink d1/dc/d18/l1f 0 2024-09-13T22:55:55.500 INFO:tasks.workunit.client.1.smithi047.stdout:2/184: dwrite d1/de/f25 [0,4194304] 0 2024-09-13T22:55:55.502 INFO:tasks.workunit.client.1.smithi047.stdout:9/107: readlink d1/la 0 2024-09-13T22:55:55.505 INFO:tasks.workunit.client.1.smithi047.stdout:3/153: symlink d0/d3/d4/l35 0 2024-09-13T22:55:55.508 INFO:tasks.workunit.client.1.smithi047.stdout:6/129: rename d3/d11/f25 to d3/f26 0 2024-09-13T22:55:55.511 INFO:tasks.workunit.client.1.smithi047.stdout:1/77: dwrite d0/f9 [0,4194304] 0 2024-09-13T22:55:55.511 INFO:tasks.workunit.client.1.smithi047.stdout:2/185: mkdir d1/df/d1d/d3c 0 2024-09-13T22:55:55.511 INFO:tasks.workunit.client.1.smithi047.stdout:9/108: mknod d1/dc/d14/c21 0 2024-09-13T22:55:55.513 INFO:tasks.workunit.client.1.smithi047.stdout:6/130: creat d3/d13/d1c/f27 x:0 0 0 2024-09-13T22:55:55.514 INFO:tasks.workunit.client.1.smithi047.stdout:2/186: symlink d1/d16/l3d 0 2024-09-13T22:55:55.514 INFO:tasks.workunit.client.1.smithi047.stdout:1/78: write d0/f9 [1489185,7107] 0 2024-09-13T22:55:55.515 INFO:tasks.workunit.client.1.smithi047.stdout:6/131: creat d3/d13/f28 x:0 0 0 2024-09-13T22:55:55.516 INFO:tasks.workunit.client.1.smithi047.stdout:9/109: mknod d1/c22 0 2024-09-13T22:55:55.517 INFO:tasks.workunit.client.1.smithi047.stdout:1/79: truncate d0/f5 2875407 0 2024-09-13T22:55:55.518 INFO:tasks.workunit.client.1.smithi047.stdout:1/80: chown d0/d7/d10 1 1 2024-09-13T22:55:55.519 INFO:tasks.workunit.client.1.smithi047.stdout:2/187: mknod d1/df/c3e 0 2024-09-13T22:55:55.520 INFO:tasks.workunit.client.1.smithi047.stdout:1/81: chown d0/d7/d10/c11 1 1 2024-09-13T22:55:55.520 INFO:tasks.workunit.client.1.smithi047.stdout:2/188: write d1/de/f33 [8500,64265] 0 2024-09-13T22:55:55.521 INFO:tasks.workunit.client.1.smithi047.stdout:1/82: chown d0/c4 0 1 2024-09-13T22:55:55.521 INFO:tasks.workunit.client.1.smithi047.stdout:6/132: rename d3/le to d3/d11/l29 0 2024-09-13T22:55:55.522 INFO:tasks.workunit.client.1.smithi047.stdout:1/83: fsync d0/fd 0 2024-09-13T22:55:55.523 INFO:tasks.workunit.client.1.smithi047.stdout:9/110: mknod d1/c23 0 2024-09-13T22:55:55.526 INFO:tasks.workunit.client.1.smithi047.stdout:9/111: fsync d1/dc/d14/dd/f1d 0 2024-09-13T22:55:55.528 INFO:tasks.workunit.client.1.smithi047.stdout:6/133: rename d3/d11/l12 to d3/d15/l2a 0 2024-09-13T22:55:55.529 INFO:tasks.workunit.client.1.smithi047.stdout:9/112: read d1/dc/d14/f16 [2915115,124492] 0 2024-09-13T22:55:55.530 INFO:tasks.workunit.client.1.smithi047.stdout:9/113: readlink d1/la 0 2024-09-13T22:55:55.533 INFO:tasks.workunit.client.1.smithi047.stdout:6/134: read d3/f22 [250580,29037] 0 2024-09-13T22:55:55.534 INFO:tasks.workunit.client.1.smithi047.stdout:1/84: dwrite d0/fd [0,4194304] 0 2024-09-13T22:55:55.534 INFO:tasks.workunit.client.1.smithi047.stdout:2/189: dwrite d1/f3 [0,4194304] 0 2024-09-13T22:55:55.545 INFO:tasks.workunit.client.1.smithi047.stdout:5/79: sync 2024-09-13T22:55:55.545 INFO:tasks.workunit.client.1.smithi047.stdout:4/102: sync 2024-09-13T22:55:55.546 INFO:tasks.workunit.client.1.smithi047.stdout:0/105: sync 2024-09-13T22:55:55.546 INFO:tasks.workunit.client.1.smithi047.stdout:7/53: sync 2024-09-13T22:55:55.546 INFO:tasks.workunit.client.1.smithi047.stdout:8/132: sync 2024-09-13T22:55:55.546 INFO:tasks.workunit.client.1.smithi047.stdout:6/135: dread d3/d13/d1c/f1e [0,4194304] 0 2024-09-13T22:55:55.547 INFO:tasks.workunit.client.1.smithi047.stdout:4/103: chown dc/de/f18 815394 1 2024-09-13T22:55:55.548 INFO:tasks.workunit.client.1.smithi047.stdout:0/106: chown d1/f17 31285168 1 2024-09-13T22:55:55.554 INFO:tasks.workunit.client.1.smithi047.stdout:5/80: mkdir d19/d23 0 2024-09-13T22:55:55.554 INFO:tasks.workunit.client.1.smithi047.stdout:7/54: truncate d0/d7/da/f11 683289 0 2024-09-13T22:55:55.556 INFO:tasks.workunit.client.1.smithi047.stdout:7/55: write d0/d7/da/f11 [1500081,92342] 0 2024-09-13T22:55:55.556 INFO:tasks.workunit.client.1.smithi047.stdout:4/104: unlink dc/de/l1c 0 2024-09-13T22:55:55.560 INFO:tasks.workunit.client.1.smithi047.stdout:6/136: rename d3/d13 to d3/d11/d2b 0 2024-09-13T22:55:55.561 INFO:tasks.workunit.client.1.smithi047.stdout:7/56: dread d0/d7/f6 [0,4194304] 0 2024-09-13T22:55:55.562 INFO:tasks.workunit.client.1.smithi047.stdout:6/137: read d3/d15/f1d [2992534,127758] 0 2024-09-13T22:55:55.562 INFO:tasks.workunit.client.1.smithi047.stdout:0/107: fsync d1/d7/fe 0 2024-09-13T22:55:55.564 INFO:tasks.workunit.client.1.smithi047.stdout:2/190: creat d1/df/f3f x:0 0 0 2024-09-13T22:55:55.567 INFO:tasks.workunit.client.1.smithi047.stdout:1/85: truncate d0/f9 2443238 0 2024-09-13T22:55:55.570 INFO:tasks.workunit.client.1.smithi047.stdout:9/114: truncate d1/dc/d14/dd/f1d 3541805 0 2024-09-13T22:55:55.571 INFO:tasks.workunit.client.1.smithi047.stdout:7/57: dwrite d0/f2 [0,4194304] 0 2024-09-13T22:55:55.572 INFO:tasks.workunit.client.1.smithi047.stdout:5/81: dread d19/f1c [0,4194304] 0 2024-09-13T22:55:55.574 INFO:tasks.workunit.client.1.smithi047.stdout:0/108: dwrite d1/d5/f8 [0,4194304] 0 2024-09-13T22:55:55.575 INFO:tasks.workunit.client.1.smithi047.stdout:7/58: dread - d0/d7/f12 zero size 2024-09-13T22:55:55.577 INFO:tasks.workunit.client.1.smithi047.stdout:7/59: write d0/d7/da/f11 [1932264,42635] 0 2024-09-13T22:55:55.578 INFO:tasks.workunit.client.1.smithi047.stdout:7/60: chown d0/d7/f6 0 1 2024-09-13T22:55:55.580 INFO:tasks.workunit.client.1.smithi047.stdout:2/191: dread d1/df/d1d/d20/d37/f39 [0,4194304] 0 2024-09-13T22:55:55.583 INFO:tasks.workunit.client.1.smithi047.stdout:1/86: creat d0/d7/f12 x:0 0 0 2024-09-13T22:55:55.584 INFO:tasks.workunit.client.1.smithi047.stdout:4/105: truncate fb 237409 0 2024-09-13T22:55:55.587 INFO:tasks.workunit.client.1.smithi047.stdout:2/192: read d1/de/d17/f1c [2920209,37574] 0 2024-09-13T22:55:55.588 INFO:tasks.workunit.client.1.smithi047.stdout:0/109: mknod d1/d7/c22 0 2024-09-13T22:55:55.589 INFO:tasks.workunit.client.1.smithi047.stdout:7/61: dwrite d0/db/fc [0,4194304] 0 2024-09-13T22:55:55.594 INFO:tasks.workunit.client.1.smithi047.stdout:6/138: mkdir d3/d2c 0 2024-09-13T22:55:55.599 INFO:tasks.workunit.client.1.smithi047.stdout:4/106: dwrite dc/f19 [0,4194304] 0 2024-09-13T22:55:55.602 INFO:tasks.workunit.client.1.smithi047.stdout:1/87: readlink d0/le 0 2024-09-13T22:55:55.602 INFO:tasks.workunit.client.1.smithi047.stdout:5/82: mknod d19/d23/c24 0 2024-09-13T22:55:55.602 INFO:tasks.workunit.client.1.smithi047.stdout:8/133: truncate d8/f13 147081 0 2024-09-13T22:55:55.605 INFO:tasks.workunit.client.1.smithi047.stdout:0/110: mkdir d1/d5/d16/d23 0 2024-09-13T22:55:55.605 INFO:tasks.workunit.client.1.smithi047.stdout:5/83: dread f17 [0,4194304] 0 2024-09-13T22:55:55.606 INFO:tasks.workunit.client.1.smithi047.stdout:0/111: write d1/f4 [4450968,20944] 0 2024-09-13T22:55:55.607 INFO:tasks.workunit.client.1.smithi047.stdout:6/139: unlink f1 0 2024-09-13T22:55:55.609 INFO:tasks.workunit.client.1.smithi047.stdout:6/140: write d3/d11/d2b/d1c/f20 [767820,103064] 0 2024-09-13T22:55:55.609 INFO:tasks.workunit.client.1.smithi047.stdout:7/62: creat d0/d7/f14 x:0 0 0 2024-09-13T22:55:55.615 INFO:tasks.workunit.client.1.smithi047.stdout:4/107: symlink dc/de/d17/l1f 0 2024-09-13T22:55:55.631 INFO:tasks.workunit.client.1.smithi047.stdout:6/141: symlink d3/d11/l2d 0 2024-09-13T22:55:55.633 INFO:tasks.workunit.client.1.smithi047.stdout:7/63: creat d0/d7/f15 x:0 0 0 2024-09-13T22:55:55.635 INFO:tasks.workunit.client.1.smithi047.stdout:6/142: dread d3/f26 [0,4194304] 0 2024-09-13T22:55:55.639 INFO:tasks.workunit.client.1.smithi047.stdout:4/108: mknod dc/de/d17/c20 0 2024-09-13T22:55:55.639 INFO:tasks.workunit.client.1.smithi047.stdout:6/143: dread d3/f26 [0,4194304] 0 2024-09-13T22:55:55.647 INFO:tasks.workunit.client.1.smithi047.stdout:8/134: link d8/f10 d8/f34 0 2024-09-13T22:55:55.649 INFO:tasks.workunit.client.1.smithi047.stdout:5/84: dwrite d19/f1c [0,4194304] 0 2024-09-13T22:55:55.651 INFO:tasks.workunit.client.1.smithi047.stdout:8/135: write d8/f2c [670408,88932] 0 2024-09-13T22:55:55.653 INFO:tasks.workunit.client.1.smithi047.stdout:0/112: dwrite d1/d5/f9 [0,4194304] 0 2024-09-13T22:55:55.655 INFO:tasks.workunit.client.1.smithi047.stdout:7/64: rmdir d0 39 2024-09-13T22:55:55.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:55 smithi047 ceph-mon[34560]: Adjusting osd_memory_target on smithi002 to 1217M 2024-09-13T22:55:55.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:55 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mgr metadata", "who": "smithi002.yumtzz", "id": "smithi002.yumtzz"}]: dispatch 2024-09-13T22:55:55.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:55 smithi047 ceph-mon[34560]: mgrmap e24: smithi047.gcymvd(active, since 9s), standbys: smithi002.yumtzz 2024-09-13T22:55:55.666 INFO:tasks.workunit.client.1.smithi047.stdout:1/88: dwrite d0/f5 [0,4194304] 0 2024-09-13T22:55:55.667 INFO:tasks.workunit.client.1.smithi047.stdout:6/144: dread d3/f8 [0,4194304] 0 2024-09-13T22:55:55.669 INFO:tasks.workunit.client.1.smithi047.stdout:6/145: write d3/d11/d2b/f28 [423785,44642] 0 2024-09-13T22:55:55.673 INFO:tasks.workunit.client.1.smithi047.stdout:1/89: dread d0/f5 [0,4194304] 0 2024-09-13T22:55:55.677 INFO:tasks.workunit.client.1.smithi047.stdout:8/136: mknod d8/c35 0 2024-09-13T22:55:55.680 INFO:tasks.workunit.client.1.smithi047.stdout:0/113: creat d1/d5/f24 x:0 0 0 2024-09-13T22:55:55.680 INFO:tasks.workunit.client.1.smithi047.stdout:0/114: chown d1/d5/d11 603935 1 2024-09-13T22:55:55.681 INFO:tasks.workunit.client.1.smithi047.stdout:0/115: chown d1/d5/d16 0 1 2024-09-13T22:55:55.686 INFO:tasks.workunit.client.1.smithi047.stdout:6/146: creat d3/d11/d2b/d1c/f2e x:0 0 0 2024-09-13T22:55:55.688 INFO:tasks.workunit.client.1.smithi047.stdout:6/147: write d3/d11/d2b/d1c/f2e [274129,5529] 0 2024-09-13T22:55:55.694 INFO:tasks.workunit.client.1.smithi047.stdout:0/116: readlink d1/l1a 0 2024-09-13T22:55:55.697 INFO:tasks.workunit.client.1.smithi047.stdout:7/65: rename d0/f8 to d0/db/f16 0 2024-09-13T22:55:55.700 INFO:tasks.workunit.client.1.smithi047.stdout:4/109: creat dc/f21 x:0 0 0 2024-09-13T22:55:55.700 INFO:tasks.workunit.client.1.smithi047.stdout:5/85: truncate d19/f1c 1525568 0 2024-09-13T22:55:55.702 INFO:tasks.workunit.client.1.smithi047.stdout:0/117: dwrite d1/d7/f18 [0,4194304] 0 2024-09-13T22:55:55.702 INFO:tasks.workunit.client.1.smithi047.stdout:4/110: write dc/fd [520951,130436] 0 2024-09-13T22:55:55.705 INFO:tasks.workunit.client.1.smithi047.stdout:8/137: truncate d8/f10 3270299 0 2024-09-13T22:55:55.712 INFO:tasks.workunit.client.1.smithi047.stdout:8/138: dwrite d8/f26 [0,4194304] 0 2024-09-13T22:55:55.717 INFO:tasks.workunit.client.1.smithi047.stdout:5/86: dread f10 [0,4194304] 0 2024-09-13T22:55:55.723 INFO:tasks.workunit.client.1.smithi047.stdout:6/148: write d3/f8 [668168,6358] 0 2024-09-13T22:55:55.725 INFO:tasks.workunit.client.1.smithi047.stdout:6/149: dread d3/f26 [4194304,4194304] 0 2024-09-13T22:55:55.730 INFO:tasks.workunit.client.1.smithi047.stdout:7/66: write d0/d7/f6 [1494754,90444] 0 2024-09-13T22:55:55.732 INFO:tasks.workunit.client.1.smithi047.stdout:8/139: mkdir d8/d36 0 2024-09-13T22:55:55.739 INFO:tasks.workunit.client.1.smithi047.stdout:8/140: dwrite d8/f21 [4194304,4194304] 0 2024-09-13T22:55:55.742 INFO:tasks.workunit.client.1.smithi047.stdout:0/118: creat d1/d5/d16/d23/f25 x:0 0 0 2024-09-13T22:55:55.748 INFO:tasks.workunit.client.1.smithi047.stdout:7/67: rename d0/d7/da/f13 to d0/d7/f17 0 2024-09-13T22:55:55.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:55 smithi002 ceph-mon[27637]: Adjusting osd_memory_target on smithi002 to 1217M 2024-09-13T22:55:55.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:55 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mgr metadata", "who": "smithi002.yumtzz", "id": "smithi002.yumtzz"}]: dispatch 2024-09-13T22:55:55.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:55 smithi002 ceph-mon[27637]: mgrmap e24: smithi047.gcymvd(active, since 9s), standbys: smithi002.yumtzz 2024-09-13T22:55:55.752 INFO:tasks.workunit.client.1.smithi047.stdout:8/141: fsync f4 0 2024-09-13T22:55:55.758 INFO:tasks.workunit.client.1.smithi047.stdout:4/111: dwrite f4 [0,4194304] 0 2024-09-13T22:55:55.765 INFO:tasks.workunit.client.1.smithi047.stdout:7/68: rename d0/d7/le to d0/d7/l18 0 2024-09-13T22:55:55.771 INFO:tasks.workunit.client.1.smithi047.stdout:6/150: truncate d3/d11/d2b/d1c/f2e 229688 0 2024-09-13T22:55:55.775 INFO:tasks.workunit.client.1.smithi047.stdout:0/119: link d1/d5/d16/d23/f25 d1/d7/f26 0 2024-09-13T22:55:55.778 INFO:tasks.workunit.client.1.smithi047.stdout:5/87: getdents d19/d23 0 2024-09-13T22:55:55.868 INFO:tasks.workunit.client.1.smithi047.stdout:8/142: mknod d8/d36/c37 0 2024-09-13T22:55:55.868 INFO:tasks.workunit.client.1.smithi047.stdout:8/143: read d8/f23 [4093503,46149] 0 2024-09-13T22:55:55.872 INFO:tasks.workunit.client.1.smithi047.stdout:0/120: creat d1/d5/d16/d23/f27 x:0 0 0 2024-09-13T22:55:55.875 INFO:tasks.workunit.client.1.smithi047.stdout:7/69: mkdir d0/d19 0 2024-09-13T22:55:55.877 INFO:tasks.workunit.client.1.smithi047.stdout:5/88: mkdir d19/d25 0 2024-09-13T22:55:55.881 INFO:tasks.workunit.client.1.smithi047.stdout:8/144: rmdir d8/d36 39 2024-09-13T22:55:55.882 INFO:tasks.workunit.client.1.smithi047.stdout:8/145: chown d8/c22 0 1 2024-09-13T22:55:55.884 INFO:tasks.workunit.client.1.smithi047.stdout:0/121: rename d1/d5/c1f to d1/d5/d11/c28 0 2024-09-13T22:55:55.889 INFO:tasks.workunit.client.1.smithi047.stdout:4/112: rename dc/f21 to dc/f22 0 2024-09-13T22:55:55.890 INFO:tasks.workunit.client.1.smithi047.stdout:7/70: mknod d0/db/c1a 0 2024-09-13T22:55:55.890 INFO:tasks.workunit.client.1.smithi047.stdout:7/71: readlink d0/d7/da/lf 0 2024-09-13T22:55:55.890 INFO:tasks.workunit.client.1.smithi047.stdout:7/72: fsync d0/d7/f15 0 2024-09-13T22:55:55.891 INFO:tasks.workunit.client.1.smithi047.stdout:7/73: dread - d0/d7/f12 zero size 2024-09-13T22:55:55.891 INFO:tasks.workunit.client.1.smithi047.stdout:5/89: mknod d19/d23/c26 0 2024-09-13T22:55:55.895 INFO:tasks.workunit.client.1.smithi047.stdout:6/151: truncate d3/f26 1435162 0 2024-09-13T22:55:55.896 INFO:tasks.workunit.client.1.smithi047.stdout:0/122: creat d1/d5/f29 x:0 0 0 2024-09-13T22:55:55.897 INFO:tasks.workunit.client.1.smithi047.stdout:3/154: sync 2024-09-13T22:55:55.898 INFO:tasks.workunit.client.1.smithi047.stdout:4/113: mkdir dc/de/d23 0 2024-09-13T22:55:55.898 INFO:tasks.workunit.client.1.smithi047.stdout:4/114: chown dc/de/d17/l1f 115 1 2024-09-13T22:55:55.899 INFO:tasks.workunit.client.1.smithi047.stdout:7/74: chown d0/d7/l18 417 1 2024-09-13T22:55:55.901 INFO:tasks.workunit.client.1.smithi047.stdout:5/90: read d19/f1c [719420,38767] 0 2024-09-13T22:55:55.906 INFO:tasks.workunit.client.1.smithi047.stdout:0/123: creat d1/d5/d16/d23/f2a x:0 0 0 2024-09-13T22:55:55.906 INFO:tasks.workunit.client.1.smithi047.stdout:0/124: readlink d1/d5/d11/l12 0 2024-09-13T22:55:55.907 INFO:tasks.workunit.client.1.smithi047.stdout:0/125: read - d1/d5/f10 zero size 2024-09-13T22:55:55.909 INFO:tasks.workunit.client.1.smithi047.stdout:3/155: dread d0/d3/d4/d1a/f27 [0,4194304] 0 2024-09-13T22:55:55.916 INFO:tasks.workunit.client.1.smithi047.stdout:7/75: dread d0/db/f16 [0,4194304] 0 2024-09-13T22:55:55.919 INFO:tasks.workunit.client.1.smithi047.stdout:0/126: readlink d1/ld 0 2024-09-13T22:55:55.923 INFO:tasks.workunit.client.1.smithi047.stdout:3/156: creat d0/d3/d4/d16/d2c/f36 x:0 0 0 2024-09-13T22:55:55.926 INFO:tasks.workunit.client.1.smithi047.stdout:0/127: dwrite d1/d7/ff [0,4194304] 0 2024-09-13T22:55:55.929 INFO:tasks.workunit.client.1.smithi047.stdout:4/115: rename dc/cf to dc/de/d23/c24 0 2024-09-13T22:55:55.933 INFO:tasks.workunit.client.1.smithi047.stdout:3/157: dwrite d0/d3/d4/d1a/f1e [0,4194304] 0 2024-09-13T22:55:55.936 INFO:tasks.workunit.client.1.smithi047.stdout:3/158: readlink d0/d3/d4/d16/d2c/de/d1f/l21 0 2024-09-13T22:55:55.938 INFO:tasks.workunit.client.1.smithi047.stdout:3/159: stat d0/d3/d4/d16/d2c/de/d1f 0 2024-09-13T22:55:55.938 INFO:tasks.workunit.client.1.smithi047.stdout:6/152: creat d3/f2f x:0 0 0 2024-09-13T22:55:55.941 INFO:tasks.workunit.client.1.smithi047.stdout:8/146: dwrite f1 [0,4194304] 0 2024-09-13T22:55:55.942 INFO:tasks.workunit.client.1.smithi047.stdout:3/160: read d0/d3/d4/d16/d2c/f20 [4070847,79208] 0 2024-09-13T22:55:55.945 INFO:tasks.workunit.client.1.smithi047.stdout:3/161: write d0/d3/d4/d16/d2c/f23 [926272,117912] 0 2024-09-13T22:55:55.946 INFO:tasks.workunit.client.1.smithi047.stdout:0/128: rename d1/f15 to d1/d5/d11/f2b 0 2024-09-13T22:55:55.947 INFO:tasks.workunit.client.1.smithi047.stdout:5/91: write d19/f1c [1436261,65248] 0 2024-09-13T22:55:55.950 INFO:tasks.workunit.client.1.smithi047.stdout:0/129: write d1/d7/fb [519693,86921] 0 2024-09-13T22:55:55.951 INFO:tasks.workunit.client.1.smithi047.stdout:5/92: dread f10 [0,4194304] 0 2024-09-13T22:55:55.952 INFO:tasks.workunit.client.1.smithi047.stdout:3/162: read d0/d3/f15 [2501429,93131] 0 2024-09-13T22:55:55.953 INFO:tasks.workunit.client.1.smithi047.stdout:4/116: dwrite dc/f22 [0,4194304] 0 2024-09-13T22:55:55.955 INFO:tasks.workunit.client.1.smithi047.stdout:5/93: truncate d19/f1e 1232044 0 2024-09-13T22:55:55.955 INFO:tasks.workunit.client.1.smithi047.stdout:8/147: unlink d8/c22 0 2024-09-13T22:55:55.955 INFO:tasks.workunit.client.1.smithi047.stdout:3/163: write d0/d3/d4/d16/d2c/de/f11 [673159,49135] 0 2024-09-13T22:55:55.957 INFO:tasks.workunit.client.1.smithi047.stdout:5/94: dread f10 [0,4194304] 0 2024-09-13T22:55:55.958 INFO:tasks.workunit.client.1.smithi047.stdout:3/164: write d0/d3/d4/d1a/f1e [2944191,70732] 0 2024-09-13T22:55:55.965 INFO:tasks.workunit.client.1.smithi047.stdout:0/130: mknod d1/d5/d16/d23/c2c 0 2024-09-13T22:55:55.977 INFO:tasks.workunit.client.1.smithi047.stdout:5/95: symlink d19/l27 0 2024-09-13T22:55:55.978 INFO:tasks.workunit.client.1.smithi047.stdout:5/96: dread f17 [0,4194304] 0 2024-09-13T22:55:55.979 INFO:tasks.workunit.client.1.smithi047.stdout:3/165: creat d0/d3/d4/d16/d2c/de/d1f/f37 x:0 0 0 2024-09-13T22:55:55.979 INFO:tasks.workunit.client.1.smithi047.stdout:6/153: truncate d3/f9 3293589 0 2024-09-13T22:55:55.980 INFO:tasks.workunit.client.1.smithi047.stdout:3/166: dread - d0/d3/d4/d16/f2f zero size 2024-09-13T22:55:55.981 INFO:tasks.workunit.client.1.smithi047.stdout:3/167: readlink d0/d3/d4/d16/d2c/lc 0 2024-09-13T22:55:55.982 INFO:tasks.workunit.client.1.smithi047.stdout:0/131: mkdir d1/d5/d16/d23/d2d 0 2024-09-13T22:55:55.982 INFO:tasks.workunit.client.1.smithi047.stdout:0/132: chown d1/d7 4048721 1 2024-09-13T22:55:55.983 INFO:tasks.workunit.client.1.smithi047.stdout:0/133: stat d1/d5/f9 0 2024-09-13T22:55:55.987 INFO:tasks.workunit.client.1.smithi047.stdout:8/148: mkdir d8/d36/d38 0 2024-09-13T22:55:55.987 INFO:tasks.workunit.client.1.smithi047.stdout:8/149: chown f1 707772 1 2024-09-13T22:55:55.988 INFO:tasks.workunit.client.1.smithi047.stdout:8/150: chown d8/fc 11 1 2024-09-13T22:55:55.990 INFO:tasks.workunit.client.1.smithi047.stdout:5/97: rename c2 to d19/d23/c28 0 2024-09-13T22:55:55.990 INFO:tasks.workunit.client.1.smithi047.stdout:5/98: fdatasync d19/f1c 0 2024-09-13T22:55:55.993 INFO:tasks.workunit.client.1.smithi047.stdout:6/154: mkdir d3/d15/d30 0 2024-09-13T22:55:56.001 INFO:tasks.workunit.client.1.smithi047.stdout:4/117: truncate f1 3678637 0 2024-09-13T22:55:56.002 INFO:tasks.workunit.client.1.smithi047.stdout:5/99: creat d19/d23/f29 x:0 0 0 2024-09-13T22:55:56.005 INFO:tasks.workunit.client.1.smithi047.stdout:0/134: mkdir d1/d5/d16/d23/d2d/d2e 0 2024-09-13T22:55:56.007 INFO:tasks.workunit.client.1.smithi047.stdout:8/151: symlink d8/d36/d38/l39 0 2024-09-13T22:55:56.010 INFO:tasks.workunit.client.1.smithi047.stdout:4/118: rmdir dc/de 39 2024-09-13T22:55:56.015 INFO:tasks.workunit.client.1.smithi047.stdout:5/100: truncate f10 889156 0 2024-09-13T22:55:56.016 INFO:tasks.workunit.client.1.smithi047.stdout:8/152: dwrite d8/f1a [4194304,4194304] 0 2024-09-13T22:55:56.018 INFO:tasks.workunit.client.1.smithi047.stdout:0/135: rename d1/d5/d16/d23/d2d/d2e to d1/d5/d11/d2f 0 2024-09-13T22:55:56.019 INFO:tasks.workunit.client.1.smithi047.stdout:0/136: write d1/d7/fb [160991,54624] 0 2024-09-13T22:55:56.027 INFO:tasks.workunit.client.1.smithi047.stdout:0/137: dwrite d1/d5/f8 [0,4194304] 0 2024-09-13T22:55:56.031 INFO:tasks.workunit.client.1.smithi047.stdout:5/101: mkdir d19/d23/d2a 0 2024-09-13T22:55:56.032 INFO:tasks.workunit.client.1.smithi047.stdout:8/153: fsync d8/f9 0 2024-09-13T22:55:56.033 INFO:tasks.workunit.client.1.smithi047.stdout:9/115: sync 2024-09-13T22:55:56.037 INFO:tasks.workunit.client.1.smithi047.stdout:9/116: dread d1/dc/d18/f19 [0,4194304] 0 2024-09-13T22:55:56.040 INFO:tasks.workunit.client.1.smithi047.stdout:9/117: read d1/dc/d14/f13 [226419,127348] 0 2024-09-13T22:55:56.042 INFO:tasks.workunit.client.1.smithi047.stdout:4/119: chown dc/de/c12 0 1 2024-09-13T22:55:56.043 INFO:tasks.workunit.client.1.smithi047.stdout:4/120: chown dc/de 4761740 1 2024-09-13T22:55:56.045 INFO:tasks.workunit.client.1.smithi047.stdout:0/138: mknod d1/d5/d16/c30 0 2024-09-13T22:55:56.050 INFO:tasks.workunit.client.1.smithi047.stdout:0/139: dwrite d1/d7/f1d [0,4194304] 0 2024-09-13T22:55:56.055 INFO:tasks.workunit.client.1.smithi047.stdout:6/155: getdents d3/d11 0 2024-09-13T22:55:56.056 INFO:tasks.workunit.client.1.smithi047.stdout:6/156: truncate d3/d11/d2b/f28 1393025 0 2024-09-13T22:55:56.061 INFO:tasks.workunit.client.1.smithi047.stdout:4/121: mkdir dc/de/d17/d25 0 2024-09-13T22:55:56.062 INFO:tasks.workunit.client.1.smithi047.stdout:4/122: readlink dc/de/l10 0 2024-09-13T22:55:56.064 INFO:tasks.workunit.client.1.smithi047.stdout:5/102: creat d19/d25/f2b x:0 0 0 2024-09-13T22:55:56.078 INFO:tasks.workunit.client.1.smithi047.stdout:0/140: link d1/d5/f9 d1/d5/d16/d23/d2d/f31 0 2024-09-13T22:55:56.081 INFO:tasks.workunit.client.1.smithi047.stdout:9/118: rename d1/dc/d14/d20/f1e to d1/f24 0 2024-09-13T22:55:56.082 INFO:tasks.workunit.client.1.smithi047.stdout:4/123: getdents dc/de/d17/d25 0 2024-09-13T22:55:56.083 INFO:tasks.workunit.client.1.smithi047.stdout:4/124: truncate dc/de/f18 923534 0 2024-09-13T22:55:56.085 INFO:tasks.workunit.client.1.smithi047.stdout:8/154: truncate f1 2302304 0 2024-09-13T22:55:56.090 INFO:tasks.workunit.client.1.smithi047.stdout:8/155: dread d8/f2d [0,4194304] 0 2024-09-13T22:55:56.090 INFO:tasks.workunit.client.1.smithi047.stdout:8/156: readlink d8/l29 0 2024-09-13T22:55:56.092 INFO:tasks.workunit.client.1.smithi047.stdout:5/103: rename l15 to d19/d25/l2c 0 2024-09-13T22:55:56.093 INFO:tasks.workunit.client.1.smithi047.stdout:6/157: write d3/f22 [583190,75829] 0 2024-09-13T22:55:56.096 INFO:tasks.workunit.client.1.smithi047.stdout:8/157: dwrite d8/f9 [0,4194304] 0 2024-09-13T22:55:56.106 INFO:tasks.workunit.client.1.smithi047.stdout:8/158: dwrite d8/f30 [0,4194304] 0 2024-09-13T22:55:56.109 INFO:tasks.workunit.client.1.smithi047.stdout:8/159: write d8/f26 [223906,87579] 0 2024-09-13T22:55:56.117 INFO:tasks.workunit.client.1.smithi047.stdout:0/141: link d1/d5/d16/d23/f2a d1/f32 0 2024-09-13T22:55:56.118 INFO:tasks.workunit.client.1.smithi047.stdout:0/142: truncate d1/d7/f26 197999 0 2024-09-13T22:55:56.122 INFO:tasks.workunit.client.1.smithi047.stdout:9/119: creat d1/f25 x:0 0 0 2024-09-13T22:55:56.122 INFO:tasks.workunit.client.1.smithi047.stdout:9/120: chown d1/f5 148 1 2024-09-13T22:55:56.123 INFO:tasks.workunit.client.1.smithi047.stdout:9/121: chown d1/c22 1495 1 2024-09-13T22:55:56.123 INFO:tasks.workunit.client.1.smithi047.stdout:9/122: readlink d1/dc/d18/l1f 0 2024-09-13T22:55:56.129 INFO:tasks.workunit.client.1.smithi047.stdout:4/125: write f1 [197755,30445] 0 2024-09-13T22:55:56.137 INFO:tasks.workunit.client.1.smithi047.stdout:8/160: dread d8/f2d [0,4194304] 0 2024-09-13T22:55:56.138 INFO:tasks.workunit.client.1.smithi047.stdout:2/193: sync 2024-09-13T22:55:56.138 INFO:tasks.workunit.client.1.smithi047.stdout:1/90: sync 2024-09-13T22:55:56.139 INFO:tasks.workunit.client.1.smithi047.stdout:7/76: sync 2024-09-13T22:55:56.139 INFO:tasks.workunit.client.1.smithi047.stdout:0/143: symlink d1/d5/d11/l33 0 2024-09-13T22:55:56.140 INFO:tasks.workunit.client.1.smithi047.stdout:7/77: write d0/f2 [1301556,72705] 0 2024-09-13T22:55:56.140 INFO:tasks.workunit.client.1.smithi047.stdout:2/194: write d1/f3 [2478479,21035] 0 2024-09-13T22:55:56.151 INFO:tasks.workunit.client.1.smithi047.stdout:5/104: truncate d19/f1e 1134877 0 2024-09-13T22:55:56.159 INFO:tasks.workunit.client.1.smithi047.stdout:1/91: mkdir d0/d7/d13 0 2024-09-13T22:55:56.160 INFO:tasks.workunit.client.1.smithi047.stdout:6/158: dwrite d3/d11/d2b/d1c/f2e [0,4194304] 0 2024-09-13T22:55:56.165 INFO:tasks.workunit.client.1.smithi047.stdout:2/195: mkdir d1/d16/d40 0 2024-09-13T22:55:56.165 INFO:tasks.workunit.client.1.smithi047.stdout:9/123: dwrite d1/dc/d14/f16 [0,4194304] 0 2024-09-13T22:55:56.167 INFO:tasks.workunit.client.1.smithi047.stdout:9/124: chown d1/dc/d14/c21 55948 1 2024-09-13T22:55:56.168 INFO:tasks.workunit.client.1.smithi047.stdout:9/125: truncate d1/f25 557836 0 2024-09-13T22:55:56.170 INFO:tasks.workunit.client.1.smithi047.stdout:4/126: getdents dc/de/d17/d25 0 2024-09-13T22:55:56.173 INFO:tasks.workunit.client.1.smithi047.stdout:5/105: symlink d19/l2d 0 2024-09-13T22:55:56.181 INFO:tasks.workunit.client.1.smithi047.stdout:1/92: dread d0/f9 [0,4194304] 0 2024-09-13T22:55:56.181 INFO:tasks.workunit.client.1.smithi047.stdout:7/78: mknod d0/d19/c1b 0 2024-09-13T22:55:56.186 INFO:tasks.workunit.client.1.smithi047.stdout:8/161: rename d8/f34 to d8/d36/f3a 0 2024-09-13T22:55:56.187 INFO:tasks.workunit.client.1.smithi047.stdout:7/79: dread d0/d7/da/f11 [0,4194304] 0 2024-09-13T22:55:56.188 INFO:tasks.workunit.client.1.smithi047.stdout:9/126: chown d1/dc/d14/dd/f1d 3306624 1 2024-09-13T22:55:56.189 INFO:tasks.workunit.client.1.smithi047.stdout:3/168: sync 2024-09-13T22:55:56.192 INFO:tasks.workunit.client.1.smithi047.stdout:5/106: mkdir d19/d23/d2e 0 2024-09-13T22:55:56.193 INFO:tasks.workunit.client.1.smithi047.stdout:5/107: chown c12 6 1 2024-09-13T22:55:56.200 INFO:tasks.workunit.client.1.smithi047.stdout:1/93: dwrite d0/f5 [4194304,4194304] 0 2024-09-13T22:55:56.200 INFO:tasks.workunit.client.1.smithi047.stdout:1/94: chown d0/fd 161491 1 2024-09-13T22:55:56.202 INFO:tasks.workunit.client.1.smithi047.stdout:0/144: rename d1/d5/d16/c30 to d1/d5/d11/c34 0 2024-09-13T22:55:56.206 INFO:tasks.workunit.client.1.smithi047.stdout:7/80: creat d0/d19/f1c x:0 0 0 2024-09-13T22:55:56.210 INFO:tasks.workunit.client.1.smithi047.stdout:4/127: link dc/de/f14 dc/de/f26 0 2024-09-13T22:55:56.213 INFO:tasks.workunit.client.1.smithi047.stdout:7/81: dwrite d0/f2 [0,4194304] 0 2024-09-13T22:55:56.213 INFO:tasks.workunit.client.1.smithi047.stdout:3/169: rename d0/d3/d4/d16/d2c/de/c14 to d0/d3/d4/d16/d2c/de/c38 0 2024-09-13T22:55:56.214 INFO:tasks.workunit.client.1.smithi047.stdout:7/82: fdatasync d0/d7/f6 0 2024-09-13T22:55:56.217 INFO:tasks.workunit.client.1.smithi047.stdout:5/108: unlink f17 0 2024-09-13T22:55:56.222 INFO:tasks.workunit.client.1.smithi047.stdout:3/170: dwrite d0/d3/d4/d16/d2c/de/f28 [4194304,4194304] 0 2024-09-13T22:55:56.226 INFO:tasks.workunit.client.1.smithi047.stdout:6/159: dwrite d3/f9 [0,4194304] 0 2024-09-13T22:55:56.228 INFO:tasks.workunit.client.1.smithi047.stdout:1/95: mkdir d0/d7/d14 0 2024-09-13T22:55:56.234 INFO:tasks.workunit.client.1.smithi047.stdout:2/196: rename d1/de/f12 to d1/df/d1d/d20/d2b/f41 0 2024-09-13T22:55:56.242 INFO:tasks.workunit.client.1.smithi047.stdout:7/83: creat d0/d7/f1d x:0 0 0 2024-09-13T22:55:56.242 INFO:tasks.workunit.client.1.smithi047.stdout:7/84: write d0/d19/f1c [469031,21660] 0 2024-09-13T22:55:56.243 INFO:tasks.workunit.client.1.smithi047.stdout:7/85: chown d0/db/c1a 665100198 1 2024-09-13T22:55:56.246 INFO:tasks.workunit.client.1.smithi047.stdout:7/86: dread d0/d7/f6 [0,4194304] 0 2024-09-13T22:55:56.257 INFO:tasks.workunit.client.1.smithi047.stdout:3/171: rename d0/f31 to d0/d3/d4/d16/d32/f39 0 2024-09-13T22:55:56.263 INFO:tasks.workunit.client.1.smithi047.stdout:8/162: dwrite f1 [0,4194304] 0 2024-09-13T22:55:56.264 INFO:tasks.workunit.client.1.smithi047.stdout:8/163: write d8/f2e [56003,97580] 0 2024-09-13T22:55:56.265 INFO:tasks.workunit.client.1.smithi047.stdout:7/87: fsync d0/d7/f17 0 2024-09-13T22:55:56.269 INFO:tasks.workunit.client.1.smithi047.stdout:6/160: symlink d3/d15/d30/l31 0 2024-09-13T22:55:56.270 INFO:tasks.workunit.client.1.smithi047.stdout:1/96: mknod d0/d7/d13/c15 0 2024-09-13T22:55:56.273 INFO:tasks.workunit.client.1.smithi047.stdout:9/127: getdents d1 0 2024-09-13T22:55:56.275 INFO:tasks.workunit.client.1.smithi047.stdout:7/88: dwrite d0/d7/f6 [0,4194304] 0 2024-09-13T22:55:56.275 INFO:tasks.workunit.client.1.smithi047.stdout:9/128: stat d1/dc/d18 0 2024-09-13T22:55:56.276 INFO:tasks.workunit.client.1.smithi047.stdout:9/129: chown d1/c22 1685048 1 2024-09-13T22:55:56.278 INFO:tasks.workunit.client.1.smithi047.stdout:1/97: dread d0/fd [0,4194304] 0 2024-09-13T22:55:56.278 INFO:tasks.workunit.client.1.smithi047.stdout:2/197: rename d1/f10 to d1/df/d1d/d20/f42 0 2024-09-13T22:55:56.279 INFO:tasks.workunit.client.1.smithi047.stdout:1/98: rename d0 to d0/d7/d14/d16 22 2024-09-13T22:55:56.280 INFO:tasks.workunit.client.1.smithi047.stdout:3/172: mkdir d0/d3/d4/d1a/d2a/d3a 0 2024-09-13T22:55:56.282 INFO:tasks.workunit.client.1.smithi047.stdout:8/164: creat d8/d36/d38/f3b x:0 0 0 2024-09-13T22:55:56.283 INFO:tasks.workunit.client.1.smithi047.stdout:8/165: chown d8/l24 986928247 1 2024-09-13T22:55:56.284 INFO:tasks.workunit.client.1.smithi047.stdout:6/161: write d3/d11/d2b/d1c/f1e [3755171,17530] 0 2024-09-13T22:55:56.289 INFO:tasks.workunit.client.1.smithi047.stdout:7/89: mkdir d0/d7/da/d1e 0 2024-09-13T22:55:56.290 INFO:tasks.workunit.client.1.smithi047.stdout:6/162: dread d3/f9 [0,4194304] 0 2024-09-13T22:55:56.291 INFO:tasks.workunit.client.1.smithi047.stdout:7/90: write d0/d7/f17 [115441,77207] 0 2024-09-13T22:55:56.292 INFO:tasks.workunit.client.1.smithi047.stdout:4/128: truncate dc/f22 3070327 0 2024-09-13T22:55:56.293 INFO:tasks.workunit.client.1.smithi047.stdout:6/163: dread - d3/f2f zero size 2024-09-13T22:55:56.298 INFO:tasks.workunit.client.1.smithi047.stdout:2/198: mkdir d1/df/d1d/d20/d37/d43 0 2024-09-13T22:55:56.298 INFO:tasks.workunit.client.1.smithi047.stdout:1/99: creat d0/f17 x:0 0 0 2024-09-13T22:55:56.298 INFO:tasks.workunit.client.1.smithi047.stdout:6/164: fdatasync d3/d11/d2b/d1c/f1e 0 2024-09-13T22:55:56.298 INFO:tasks.workunit.client.1.smithi047.stdout:5/109: getdents d19 0 2024-09-13T22:55:56.299 INFO:tasks.workunit.client.1.smithi047.stdout:1/100: stat d0/d7/d14 0 2024-09-13T22:55:56.299 INFO:tasks.workunit.client.1.smithi047.stdout:2/199: fdatasync d1/df/f1b 0 2024-09-13T22:55:56.299 INFO:tasks.workunit.client.1.smithi047.stdout:8/166: creat d8/d36/f3c x:0 0 0 2024-09-13T22:55:56.300 INFO:tasks.workunit.client.1.smithi047.stdout:8/167: dread - d8/f2b zero size 2024-09-13T22:55:56.301 INFO:tasks.workunit.client.1.smithi047.stdout:3/173: dread d0/d3/d4/d16/d2c/de/f10 [0,4194304] 0 2024-09-13T22:55:56.308 INFO:tasks.workunit.client.1.smithi047.stdout:6/165: mknod d3/d11/d2b/c32 0 2024-09-13T22:55:56.309 INFO:tasks.workunit.client.1.smithi047.stdout:6/166: chown d3/d15/f1d 0 1 2024-09-13T22:55:56.311 INFO:tasks.workunit.client.1.smithi047.stdout:2/200: mknod d1/df/d1d/d20/d29/c44 0 2024-09-13T22:55:56.312 INFO:tasks.workunit.client.1.smithi047.stdout:2/201: dread - d1/df/d1d/d20/f2c zero size 2024-09-13T22:55:56.312 INFO:tasks.workunit.client.1.smithi047.stdout:9/130: write d1/dc/d18/f19 [3020892,16027] 0 2024-09-13T22:55:56.313 INFO:tasks.workunit.client.1.smithi047.stdout:9/131: readlink d1/la 0 2024-09-13T22:55:56.316 INFO:tasks.workunit.client.1.smithi047.stdout:9/132: read d1/dc/d14/f16 [2294534,27073] 0 2024-09-13T22:55:56.317 INFO:tasks.workunit.client.1.smithi047.stdout:3/174: write d0/d3/d4/d16/d2c/f20 [925215,9150] 0 2024-09-13T22:55:56.322 INFO:tasks.workunit.client.1.smithi047.stdout:9/133: write d1/dc/d18/f19 [9383185,83786] 0 2024-09-13T22:55:56.322 INFO:tasks.workunit.client.1.smithi047.stdout:2/202: dwrite d1/df/d1d/d20/d29/f2d [4194304,4194304] 0 2024-09-13T22:55:56.323 INFO:tasks.workunit.client.1.smithi047.stdout:1/101: creat d0/d7/d14/f18 x:0 0 0 2024-09-13T22:55:56.323 INFO:tasks.workunit.client.1.smithi047.stdout:1/102: dread - d0/d7/f12 zero size 2024-09-13T22:55:56.326 INFO:tasks.workunit.client.1.smithi047.stdout:8/168: link d8/d36/f3c d8/d36/f3d 0 2024-09-13T22:55:56.326 INFO:tasks.workunit.client.1.smithi047.stdout:8/169: stat d8/c25 0 2024-09-13T22:55:56.329 INFO:tasks.workunit.client.1.smithi047.stdout:7/91: creat d0/f1f x:0 0 0 2024-09-13T22:55:56.332 INFO:tasks.workunit.client.1.smithi047.stdout:6/167: mkdir d3/d2c/d33 0 2024-09-13T22:55:56.334 INFO:tasks.workunit.client.1.smithi047.stdout:3/175: mkdir d0/d3/d4/d16/d2c/de/d1f/d3b 0 2024-09-13T22:55:56.335 INFO:tasks.workunit.client.1.smithi047.stdout:4/129: write f8 [552391,63410] 0 2024-09-13T22:55:56.336 INFO:tasks.workunit.client.1.smithi047.stdout:8/170: dwrite d8/f2e [0,4194304] 0 2024-09-13T22:55:56.337 INFO:tasks.workunit.client.1.smithi047.stdout:8/171: stat d8/f1f 0 2024-09-13T22:55:56.338 INFO:tasks.workunit.client.1.smithi047.stdout:4/130: write dc/de/d17/f1e [1409276,43993] 0 2024-09-13T22:55:56.339 INFO:tasks.workunit.client.1.smithi047.stdout:2/203: creat d1/df/d35/f45 x:0 0 0 2024-09-13T22:55:56.340 INFO:tasks.workunit.client.1.smithi047.stdout:3/176: write d0/d3/d4/d16/d1c/f2d [259807,106210] 0 2024-09-13T22:55:56.352 INFO:tasks.workunit.client.1.smithi047.stdout:6/168: mknod d3/d11/d2b/d1c/c34 0 2024-09-13T22:55:56.352 INFO:tasks.workunit.client.1.smithi047.stdout:9/134: symlink d1/dc/d14/l26 0 2024-09-13T22:55:56.355 INFO:tasks.workunit.client.1.smithi047.stdout:8/172: dwrite d8/f2c [0,4194304] 0 2024-09-13T22:55:56.355 INFO:tasks.workunit.client.1.smithi047.stdout:3/177: dwrite d0/d3/d4/d16/d2c/f20 [0,4194304] 0 2024-09-13T22:55:56.358 INFO:tasks.workunit.client.1.smithi047.stdout:2/204: creat d1/de/f46 x:0 0 0 2024-09-13T22:55:56.361 INFO:tasks.workunit.client.1.smithi047.stdout:6/169: dread d3/f8 [0,4194304] 0 2024-09-13T22:55:56.363 INFO:tasks.workunit.client.1.smithi047.stdout:1/103: link d0/d7/d14/f18 d0/d7/d10/f19 0 2024-09-13T22:55:56.365 INFO:tasks.workunit.client.1.smithi047.stdout:1/104: rename d0 to d0/d7/db/d1a 22 2024-09-13T22:55:56.366 INFO:tasks.workunit.client.1.smithi047.stdout:1/105: stat d0/d7/d10/c11 0 2024-09-13T22:55:56.371 INFO:tasks.workunit.client.1.smithi047.stdout:2/205: symlink d1/de/l47 0 2024-09-13T22:55:56.373 INFO:tasks.workunit.client.1.smithi047.stdout:3/178: mknod d0/d3/d4/d16/d1c/c3c 0 2024-09-13T22:55:56.374 INFO:tasks.workunit.client.1.smithi047.stdout:2/206: fsync d1/df/d35/f45 0 2024-09-13T22:55:56.374 INFO:tasks.workunit.client.1.smithi047.stdout:6/170: mknod d3/d11/c35 0 2024-09-13T22:55:56.376 INFO:tasks.workunit.client.1.smithi047.stdout:7/92: creat d0/f20 x:0 0 0 2024-09-13T22:55:56.377 INFO:tasks.workunit.client.1.smithi047.stdout:3/179: write d0/d3/d4/d16/d2c/de/f11 [1070212,87476] 0 2024-09-13T22:55:56.378 INFO:tasks.workunit.client.1.smithi047.stdout:2/207: write d1/df/d1d/d20/d2b/f34 [2003356,11480] 0 2024-09-13T22:55:56.378 INFO:tasks.workunit.client.1.smithi047.stdout:1/106: mkdir d0/d7/d13/d1b 0 2024-09-13T22:55:56.380 INFO:tasks.workunit.client.1.smithi047.stdout:7/93: write d0/db/fc [5079483,92115] 0 2024-09-13T22:55:56.382 INFO:tasks.workunit.client.1.smithi047.stdout:7/94: read d0/db/f16 [504598,43991] 0 2024-09-13T22:55:56.382 INFO:tasks.workunit.client.1.smithi047.stdout:8/173: mkdir d8/d3e 0 2024-09-13T22:55:56.385 INFO:tasks.workunit.client.1.smithi047.stdout:7/95: write d0/d19/f1c [1334002,94858] 0 2024-09-13T22:55:56.386 INFO:tasks.workunit.client.1.smithi047.stdout:6/171: creat d3/d15/f36 x:0 0 0 2024-09-13T22:55:56.389 INFO:tasks.workunit.client.1.smithi047.stdout:1/107: dread d0/f5 [0,4194304] 0 2024-09-13T22:55:56.391 INFO:tasks.workunit.client.1.smithi047.stdout:3/180: mkdir d0/d3/d4/d16/d2c/de/d3d 0 2024-09-13T22:55:56.395 INFO:tasks.workunit.client.1.smithi047.stdout:4/131: link dc/c11 dc/de/d17/d25/c27 0 2024-09-13T22:55:56.396 INFO:tasks.workunit.client.1.smithi047.stdout:7/96: dwrite d0/f20 [0,4194304] 0 2024-09-13T22:55:56.399 INFO:tasks.workunit.client.1.smithi047.stdout:9/135: link d1/c11 d1/dc/d14/c27 0 2024-09-13T22:55:56.406 INFO:tasks.workunit.client.1.smithi047.stdout:3/181: dread d0/d3/d4/d16/d2c/de/f11 [0,4194304] 0 2024-09-13T22:55:56.412 INFO:tasks.workunit.client.1.smithi047.stdout:7/97: creat d0/d7/da/f21 x:0 0 0 2024-09-13T22:55:56.412 INFO:tasks.workunit.client.1.smithi047.stdout:4/132: dwrite dc/de/d17/f1e [0,4194304] 0 2024-09-13T22:55:56.416 INFO:tasks.workunit.client.1.smithi047.stdout:9/136: write d1/f5 [459742,108285] 0 2024-09-13T22:55:56.420 INFO:tasks.workunit.client.1.smithi047.stdout:3/182: dread d0/d3/d4/f9 [0,4194304] 0 2024-09-13T22:55:56.421 INFO:tasks.workunit.client.1.smithi047.stdout:3/183: chown d0/d3/d4/d16/d1c/f2d 0 1 2024-09-13T22:55:56.421 INFO:tasks.workunit.client.1.smithi047.stdout:7/98: dread d0/f20 [0,4194304] 0 2024-09-13T22:55:56.421 INFO:tasks.workunit.client.1.smithi047.stdout:1/108: symlink d0/d7/d13/d1b/l1c 0 2024-09-13T22:55:56.427 INFO:tasks.workunit.client.1.smithi047.stdout:6/172: write d3/d15/f1d [5043212,94468] 0 2024-09-13T22:55:56.435 INFO:tasks.workunit.client.1.smithi047.stdout:6/173: fsync d3/d15/f1d 0 2024-09-13T22:55:56.435 INFO:tasks.workunit.client.1.smithi047.stdout:7/99: fsync d0/d7/da/f11 0 2024-09-13T22:55:56.436 INFO:tasks.workunit.client.1.smithi047.stdout:8/174: dwrite d8/f23 [4194304,4194304] 0 2024-09-13T22:55:56.437 INFO:tasks.workunit.client.1.smithi047.stdout:1/109: mkdir d0/d1d 0 2024-09-13T22:55:56.439 INFO:tasks.workunit.client.1.smithi047.stdout:3/184: write d0/d3/d4/d16/d2c/de/f10 [5135633,77706] 0 2024-09-13T22:55:56.441 INFO:tasks.workunit.client.1.smithi047.stdout:4/133: rename dc/f22 to dc/de/d17/f28 0 2024-09-13T22:55:56.443 INFO:tasks.workunit.client.1.smithi047.stdout:2/208: dwrite d1/de/d17/f31 [0,4194304] 0 2024-09-13T22:55:56.445 INFO:tasks.workunit.client.1.smithi047.stdout:6/174: read d3/d15/f1d [4800918,81585] 0 2024-09-13T22:55:56.447 INFO:tasks.workunit.client.1.smithi047.stdout:9/137: write d1/dc/d14/f16 [3893608,129554] 0 2024-09-13T22:55:56.448 INFO:tasks.workunit.client.1.smithi047.stdout:8/175: fsync d8/f2d 0 2024-09-13T22:55:56.451 INFO:tasks.workunit.client.1.smithi047.stdout:2/209: unlink d1/c19 0 2024-09-13T22:55:56.451 INFO:tasks.workunit.client.1.smithi047.stdout:8/176: fdatasync d8/f1f 0 2024-09-13T22:55:56.455 INFO:tasks.workunit.client.1.smithi047.stdout:7/100: dwrite d0/d7/f12 [0,4194304] 0 2024-09-13T22:55:56.456 INFO:tasks.workunit.client.1.smithi047.stdout:8/177: chown d8/f9 446474551 1 2024-09-13T22:55:56.460 INFO:tasks.workunit.client.1.smithi047.stdout:2/210: truncate d1/f11 1292752 0 2024-09-13T22:55:56.464 INFO:tasks.workunit.client.1.smithi047.stdout:0/145: sync 2024-09-13T22:55:56.466 INFO:tasks.workunit.client.1.smithi047.stdout:0/146: write d1/f17 [100881,3911] 0 2024-09-13T22:55:56.469 INFO:tasks.workunit.client.1.smithi047.stdout:3/185: link d0/d3/d4/d16/d2c/de/f10 d0/d3/d4/f3e 0 2024-09-13T22:55:56.469 INFO:tasks.workunit.client.1.smithi047.stdout:8/178: mkdir d8/d3f 0 2024-09-13T22:55:56.471 INFO:tasks.workunit.client.1.smithi047.stdout:2/211: mknod d1/de/c48 0 2024-09-13T22:55:56.472 INFO:tasks.workunit.client.1.smithi047.stdout:4/134: dwrite dc/de/f14 [0,4194304] 0 2024-09-13T22:55:56.472 INFO:tasks.workunit.client.1.smithi047.stdout:7/101: creat d0/d7/da/d1e/f22 x:0 0 0 2024-09-13T22:55:56.474 INFO:tasks.workunit.client.1.smithi047.stdout:6/175: write d3/f26 [2477416,33818] 0 2024-09-13T22:55:56.481 INFO:tasks.workunit.client.1.smithi047.stdout:1/110: dwrite d0/d7/d10/f19 [0,4194304] 0 2024-09-13T22:55:56.481 INFO:tasks.workunit.client.1.smithi047.stdout:0/147: creat d1/d5/d11/f35 x:0 0 0 2024-09-13T22:55:56.481 INFO:tasks.workunit.client.1.smithi047.stdout:0/148: dread - d1/d5/f24 zero size 2024-09-13T22:55:56.482 INFO:tasks.workunit.client.1.smithi047.stdout:8/179: write d8/f27 [1958915,26589] 0 2024-09-13T22:55:56.483 INFO:tasks.workunit.client.1.smithi047.stdout:0/149: chown d1/d5/d16/d23/c2c 2600 1 2024-09-13T22:55:56.485 INFO:tasks.workunit.client.1.smithi047.stdout:3/186: symlink d0/d3/d4/d16/d2c/de/d1f/l3f 0 2024-09-13T22:55:56.490 INFO:tasks.workunit.client.1.smithi047.stdout:7/102: symlink d0/d7/da/l23 0 2024-09-13T22:55:56.491 INFO:tasks.workunit.client.1.smithi047.stdout:9/138: link d1/c11 d1/dc/d14/d20/c28 0 2024-09-13T22:55:56.494 INFO:tasks.workunit.client.1.smithi047.stdout:8/180: dwrite d8/f1c [0,4194304] 0 2024-09-13T22:55:56.495 INFO:tasks.workunit.client.1.smithi047.stdout:8/181: chown d8/f2e 4 1 2024-09-13T22:55:56.496 INFO:tasks.workunit.client.1.smithi047.stdout:1/111: fsync d0/f5 0 2024-09-13T22:55:56.500 INFO:tasks.workunit.client.1.smithi047.stdout:4/135: mkdir dc/d29 0 2024-09-13T22:55:56.502 INFO:tasks.workunit.client.1.smithi047.stdout:3/187: rename d0/d3/d4/d16/d2c/f36 to d0/d3/d4/d16/d2c/de/f40 0 2024-09-13T22:55:56.506 INFO:tasks.workunit.client.1.smithi047.stdout:7/103: dwrite d0/d7/f17 [0,4194304] 0 2024-09-13T22:55:56.507 INFO:tasks.workunit.client.1.smithi047.stdout:3/188: readlink d0/d3/d4/d16/d2c/l1b 0 2024-09-13T22:55:56.512 INFO:tasks.workunit.client.1.smithi047.stdout:7/104: write d0/d7/f17 [405294,25452] 0 2024-09-13T22:55:56.516 INFO:tasks.workunit.client.1.smithi047.stdout:7/105: write d0/db/fc [1924830,53297] 0 2024-09-13T22:55:56.517 INFO:tasks.workunit.client.1.smithi047.stdout:6/176: rmdir d3/d2c/d33 0 2024-09-13T22:55:56.517 INFO:tasks.workunit.client.1.smithi047.stdout:4/136: dread f4 [0,4194304] 0 2024-09-13T22:55:56.518 INFO:tasks.workunit.client.1.smithi047.stdout:0/150: creat d1/f36 x:0 0 0 2024-09-13T22:55:56.518 INFO:tasks.workunit.client.1.smithi047.stdout:8/182: dwrite d8/fc [0,4194304] 0 2024-09-13T22:55:56.520 INFO:tasks.workunit.client.1.smithi047.stdout:6/177: creat d3/d15/d30/f37 x:0 0 0 2024-09-13T22:55:56.522 INFO:tasks.workunit.client.1.smithi047.stdout:8/183: fsync d8/f9 0 2024-09-13T22:55:56.523 INFO:tasks.workunit.client.1.smithi047.stdout:3/189: dread d0/d3/d4/d16/d2c/de/f11 [0,4194304] 0 2024-09-13T22:55:56.526 INFO:tasks.workunit.client.1.smithi047.stdout:3/190: read - d0/d3/d4/d1a/d2a/f30 zero size 2024-09-13T22:55:56.527 INFO:tasks.workunit.client.1.smithi047.stdout:4/137: mknod dc/de/d23/c2a 0 2024-09-13T22:55:56.528 INFO:tasks.workunit.client.1.smithi047.stdout:6/178: dread d3/f22 [0,4194304] 0 2024-09-13T22:55:56.529 INFO:tasks.workunit.client.1.smithi047.stdout:7/106: creat d0/d7/da/d1e/f24 x:0 0 0 2024-09-13T22:55:56.531 INFO:tasks.workunit.client.1.smithi047.stdout:7/107: chown d0/d19 2708 1 2024-09-13T22:55:56.531 INFO:tasks.workunit.client.1.smithi047.stdout:3/191: fsync d0/d3/d4/d16/d2c/f24 0 2024-09-13T22:55:56.531 INFO:tasks.workunit.client.1.smithi047.stdout:4/138: write dc/de/f14 [3686385,103190] 0 2024-09-13T22:55:56.531 INFO:tasks.workunit.client.1.smithi047.stdout:6/179: write d3/f26 [581373,40394] 0 2024-09-13T22:55:56.533 INFO:tasks.workunit.client.1.smithi047.stdout:1/112: dwrite d0/fd [0,4194304] 0 2024-09-13T22:55:56.535 INFO:tasks.workunit.client.1.smithi047.stdout:7/108: fsync d0/d7/f12 0 2024-09-13T22:55:56.535 INFO:tasks.workunit.client.1.smithi047.stdout:4/139: fsync f8 0 2024-09-13T22:55:56.536 INFO:tasks.workunit.client.1.smithi047.stdout:6/180: stat d3/d11/d2b/d1c/c34 0 2024-09-13T22:55:56.537 INFO:tasks.workunit.client.1.smithi047.stdout:1/113: write d0/d7/f12 [201206,8323] 0 2024-09-13T22:55:56.539 INFO:tasks.workunit.client.1.smithi047.stdout:4/140: dread - dc/de/f16 zero size 2024-09-13T22:55:56.540 INFO:tasks.workunit.client.1.smithi047.stdout:7/109: fsync d0/d7/f17 0 2024-09-13T22:55:56.540 INFO:tasks.workunit.client.1.smithi047.stdout:6/181: chown d3/d11/l2d 8 1 2024-09-13T22:55:56.540 INFO:tasks.workunit.client.1.smithi047.stdout:0/151: link d1/f4 d1/f37 0 2024-09-13T22:55:56.541 INFO:tasks.workunit.client.1.smithi047.stdout:1/114: rename d0/d7 to d0/d7/d13/d1e 22 2024-09-13T22:55:56.546 INFO:tasks.workunit.client.1.smithi047.stdout:4/141: creat dc/de/d23/f2b x:0 0 0 2024-09-13T22:55:56.548 INFO:tasks.workunit.client.1.smithi047.stdout:0/152: creat d1/d5/d11/d2f/f38 x:0 0 0 2024-09-13T22:55:56.549 INFO:tasks.workunit.client.1.smithi047.stdout:7/110: unlink d0/d7/da/f21 0 2024-09-13T22:55:56.549 INFO:tasks.workunit.client.1.smithi047.stdout:4/142: truncate dc/de/f16 553162 0 2024-09-13T22:55:56.551 INFO:tasks.workunit.client.1.smithi047.stdout:3/192: truncate d0/d3/d4/d1a/f27 91489 0 2024-09-13T22:55:56.552 INFO:tasks.workunit.client.1.smithi047.stdout:1/115: dread d0/fd [0,4194304] 0 2024-09-13T22:55:56.552 INFO:tasks.workunit.client.1.smithi047.stdout:8/184: dwrite f4 [0,4194304] 0 2024-09-13T22:55:56.553 INFO:tasks.workunit.client.1.smithi047.stdout:3/193: chown d0/d3/d4/f3e 6235 1 2024-09-13T22:55:56.553 INFO:tasks.workunit.client.1.smithi047.stdout:1/116: write d0/f5 [7581780,84604] 0 2024-09-13T22:55:56.554 INFO:tasks.workunit.client.1.smithi047.stdout:1/117: fdatasync d0/d7/f12 0 2024-09-13T22:55:56.556 INFO:tasks.workunit.client.1.smithi047.stdout:1/118: write d0/f5 [7327166,39950] 0 2024-09-13T22:55:56.557 INFO:tasks.workunit.client.1.smithi047.stdout:0/153: symlink d1/d5/d16/d23/d2d/l39 0 2024-09-13T22:55:56.557 INFO:tasks.workunit.client.1.smithi047.stdout:0/154: dread - d1/d5/f29 zero size 2024-09-13T22:55:56.558 INFO:tasks.workunit.client.1.smithi047.stdout:7/111: mknod d0/d19/c25 0 2024-09-13T22:55:56.559 INFO:tasks.workunit.client.1.smithi047.stdout:4/143: rmdir dc/de/d17/d25 39 2024-09-13T22:55:56.562 INFO:tasks.workunit.client.1.smithi047.stdout:8/185: mkdir d8/d36/d40 0 2024-09-13T22:55:56.563 INFO:tasks.workunit.client.1.smithi047.stdout:6/182: truncate d3/d15/f1d 31439 0 2024-09-13T22:55:56.568 INFO:tasks.workunit.client.1.smithi047.stdout:1/119: dwrite d0/f17 [0,4194304] 0 2024-09-13T22:55:56.569 INFO:tasks.workunit.client.1.smithi047.stdout:0/155: dwrite d1/f2 [0,4194304] 0 2024-09-13T22:55:56.571 INFO:tasks.workunit.client.1.smithi047.stdout:7/112: creat d0/d7/da/f26 x:0 0 0 2024-09-13T22:55:56.572 INFO:tasks.workunit.client.1.smithi047.stdout:7/113: rename d0 to d0/d7/da/d27 22 2024-09-13T22:55:56.576 INFO:tasks.workunit.client.1.smithi047.stdout:8/186: mknod d8/d36/d38/c41 0 2024-09-13T22:55:56.580 INFO:tasks.workunit.client.1.smithi047.stdout:6/183: mknod d3/d15/c38 0 2024-09-13T22:55:56.581 INFO:tasks.workunit.client.1.smithi047.stdout:6/184: dread - d3/d15/d30/f37 zero size 2024-09-13T22:55:56.583 INFO:tasks.workunit.client.1.smithi047.stdout:1/120: unlink d0/f17 0 2024-09-13T22:55:56.584 INFO:tasks.workunit.client.1.smithi047.stdout:1/121: read d0/f9 [1098825,43389] 0 2024-09-13T22:55:56.584 INFO:tasks.workunit.client.1.smithi047.stdout:4/144: truncate fb 455518 0 2024-09-13T22:55:56.590 INFO:tasks.workunit.client.1.smithi047.stdout:6/185: dwrite d3/f2f [0,4194304] 0 2024-09-13T22:55:56.593 INFO:tasks.workunit.client.1.smithi047.stdout:4/145: mknod dc/de/c2c 0 2024-09-13T22:55:56.596 INFO:tasks.workunit.client.1.smithi047.stdout:8/187: rmdir d8 39 2024-09-13T22:55:56.598 INFO:tasks.workunit.client.1.smithi047.stdout:1/122: creat d0/d7/d10/f1f x:0 0 0 2024-09-13T22:55:56.598 INFO:tasks.workunit.client.1.smithi047.stdout:3/194: truncate d0/f12 1675871 0 2024-09-13T22:55:56.603 INFO:tasks.workunit.client.1.smithi047.stdout:4/146: dwrite dc/de/d23/f2b [0,4194304] 0 2024-09-13T22:55:56.603 INFO:tasks.workunit.client.1.smithi047.stdout:1/123: dread d0/f9 [0,4194304] 0 2024-09-13T22:55:56.605 INFO:tasks.workunit.client.1.smithi047.stdout:7/114: creat d0/f28 x:0 0 0 2024-09-13T22:55:56.606 INFO:tasks.workunit.client.1.smithi047.stdout:0/156: write d1/f32 [510426,63931] 0 2024-09-13T22:55:56.607 INFO:tasks.workunit.client.1.smithi047.stdout:7/115: write d0/f2 [4812922,107015] 0 2024-09-13T22:55:56.607 INFO:tasks.workunit.client.1.smithi047.stdout:7/116: chown d0/d7/da 14346256 1 2024-09-13T22:55:56.608 INFO:tasks.workunit.client.1.smithi047.stdout:3/195: dread d0/d3/d4/f9 [0,4194304] 0 2024-09-13T22:55:56.608 INFO:tasks.workunit.client.1.smithi047.stdout:6/186: creat d3/d11/d2b/d1c/d23/f39 x:0 0 0 2024-09-13T22:55:56.610 INFO:tasks.workunit.client.1.smithi047.stdout:1/124: rmdir d0/d7/d13/d1b 39 2024-09-13T22:55:56.610 INFO:tasks.workunit.client.1.smithi047.stdout:6/187: dread - d3/d15/f36 zero size 2024-09-13T22:55:56.612 INFO:tasks.workunit.client.1.smithi047.stdout:1/125: write d0/d7/d14/f18 [2931669,97652] 0 2024-09-13T22:55:56.615 INFO:tasks.workunit.client.1.smithi047.stdout:1/126: write d0/d7/d14/f18 [3556231,57458] 0 2024-09-13T22:55:56.616 INFO:tasks.workunit.client.1.smithi047.stdout:7/117: dread d0/d7/f12 [0,4194304] 0 2024-09-13T22:55:56.616 INFO:tasks.workunit.client.1.smithi047.stdout:0/157: mknod d1/d5/d16/c3a 0 2024-09-13T22:55:56.621 INFO:tasks.workunit.client.1.smithi047.stdout:1/127: creat d0/f20 x:0 0 0 2024-09-13T22:55:56.624 INFO:tasks.workunit.client.1.smithi047.stdout:7/118: rmdir d0 39 2024-09-13T22:55:56.625 INFO:tasks.workunit.client.1.smithi047.stdout:3/196: creat d0/d25/d34/f41 x:0 0 0 2024-09-13T22:55:56.629 INFO:tasks.workunit.client.1.smithi047.stdout:0/158: mknod d1/c3b 0 2024-09-13T22:55:56.631 INFO:tasks.workunit.client.1.smithi047.stdout:1/128: unlink d0/f9 0 2024-09-13T22:55:56.633 INFO:tasks.workunit.client.1.smithi047.stdout:7/119: stat d0/d7/da/lf 0 2024-09-13T22:55:56.633 INFO:tasks.workunit.client.1.smithi047.stdout:7/120: chown d0/d7 41 1 2024-09-13T22:55:56.635 INFO:tasks.workunit.client.1.smithi047.stdout:6/188: link d3/d11/l2d d3/d11/d2b/d1c/l3a 0 2024-09-13T22:55:56.636 INFO:tasks.workunit.client.1.smithi047.stdout:6/189: fsync d3/f7 0 2024-09-13T22:55:56.637 INFO:tasks.workunit.client.1.smithi047.stdout:1/129: rmdir d0/d7/d13 39 2024-09-13T22:55:56.638 INFO:tasks.workunit.client.1.smithi047.stdout:1/130: readlink d0/d7/la 0 2024-09-13T22:55:56.642 INFO:tasks.workunit.client.1.smithi047.stdout:7/121: truncate d0/db/f16 1143417 0 2024-09-13T22:55:56.642 INFO:tasks.workunit.client.1.smithi047.stdout:7/122: chown d0/d19/c1b 56923254 1 2024-09-13T22:55:56.646 INFO:tasks.workunit.client.1.smithi047.stdout:6/190: dread d3/f22 [0,4194304] 0 2024-09-13T22:55:56.648 INFO:tasks.workunit.client.1.smithi047.stdout:0/159: link d1/d5/d16/d23/f27 d1/d5/d16/f3c 0 2024-09-13T22:55:56.652 INFO:tasks.workunit.client.1.smithi047.stdout:0/160: dread d1/f32 [0,4194304] 0 2024-09-13T22:55:56.652 INFO:tasks.workunit.client.1.smithi047.stdout:7/123: unlink d0/d7/f12 0 2024-09-13T22:55:56.654 INFO:tasks.workunit.client.1.smithi047.stdout:6/191: dwrite d3/d11/d2b/d1c/f20 [0,4194304] 0 2024-09-13T22:55:56.655 INFO:tasks.workunit.client.1.smithi047.stdout:5/110: sync 2024-09-13T22:55:56.656 INFO:tasks.workunit.client.1.smithi047.stdout:3/197: truncate d0/d3/f33 7135480 0 2024-09-13T22:55:56.658 INFO:tasks.workunit.client.1.smithi047.stdout:3/198: chown d0/d3/d4/d16/d2c/de/d1f/l3f 1415 1 2024-09-13T22:55:56.660 INFO:tasks.workunit.client.1.smithi047.stdout:1/131: symlink d0/d7/l21 0 2024-09-13T22:55:56.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:56 smithi047 ceph-mon[34560]: pgmap v8: 65 pgs: 65 active+clean; 244 MiB data, 939 MiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 7.7 MiB/s wr, 125 op/s 2024-09-13T22:55:56.669 INFO:tasks.workunit.client.1.smithi047.stdout:3/199: mkdir d0/d3/d4/d16/d32/d42 0 2024-09-13T22:55:56.670 INFO:tasks.workunit.client.1.smithi047.stdout:1/132: stat d0/d7/d13/c15 0 2024-09-13T22:55:56.670 INFO:tasks.workunit.client.1.smithi047.stdout:3/200: dread - d0/d25/d34/f41 zero size 2024-09-13T22:55:56.671 INFO:tasks.workunit.client.1.smithi047.stdout:3/201: dread - d0/d3/d4/d16/d2c/f24 zero size 2024-09-13T22:55:56.677 INFO:tasks.workunit.client.1.smithi047.stdout:7/124: creat d0/f29 x:0 0 0 2024-09-13T22:55:56.686 INFO:tasks.workunit.client.1.smithi047.stdout:0/161: getdents d1/d5 0 2024-09-13T22:55:56.687 INFO:tasks.workunit.client.1.smithi047.stdout:0/162: stat d1/d5/d16/d23/d2d/l39 0 2024-09-13T22:55:56.695 INFO:tasks.workunit.client.1.smithi047.stdout:0/163: dwrite d1/d7/fb [0,4194304] 0 2024-09-13T22:55:56.698 INFO:tasks.workunit.client.1.smithi047.stdout:3/202: read d0/d3/f33 [3352335,83418] 0 2024-09-13T22:55:56.699 INFO:tasks.workunit.client.1.smithi047.stdout:0/164: truncate d1/d5/d16/d23/d2d/f31 5190549 0 2024-09-13T22:55:56.701 INFO:tasks.workunit.client.1.smithi047.stdout:5/111: link d19/c22 d19/d23/d2e/c2f 0 2024-09-13T22:55:56.708 INFO:tasks.workunit.client.1.smithi047.stdout:6/192: link d3/d11/d2b/d1c/l3a d3/l3b 0 2024-09-13T22:55:56.711 INFO:tasks.workunit.client.1.smithi047.stdout:3/203: rename d0/d3/d4/d1a/d2a to d0/d3/d4/d1a/d43 0 2024-09-13T22:55:56.717 INFO:tasks.workunit.client.1.smithi047.stdout:5/112: unlink l11 0 2024-09-13T22:55:56.719 INFO:tasks.workunit.client.1.smithi047.stdout:6/193: symlink d3/d2c/l3c 0 2024-09-13T22:55:56.719 INFO:tasks.workunit.client.1.smithi047.stdout:3/204: dwrite d0/d3/d4/d16/f2f [0,4194304] 0 2024-09-13T22:55:56.721 INFO:tasks.workunit.client.1.smithi047.stdout:3/205: read - d0/d3/d4/d16/d2c/f24 zero size 2024-09-13T22:55:56.730 INFO:tasks.workunit.client.1.smithi047.stdout:3/206: fsync d0/d3/d4/d16/d2c/de/f40 0 2024-09-13T22:55:56.730 INFO:tasks.workunit.client.1.smithi047.stdout:7/125: write d0/d7/da/f11 [1173219,47853] 0 2024-09-13T22:55:56.731 INFO:tasks.workunit.client.1.smithi047.stdout:3/207: chown d0/d3/d4/d16/d2c/de/d3d 13292683 1 2024-09-13T22:55:56.732 INFO:tasks.workunit.client.1.smithi047.stdout:5/113: mknod d19/d23/d2a/c30 0 2024-09-13T22:55:56.732 INFO:tasks.workunit.client.1.smithi047.stdout:3/208: readlink d0/d3/d4/d16/d2c/de/d1f/l3f 0 2024-09-13T22:55:56.736 INFO:tasks.workunit.client.1.smithi047.stdout:7/126: mknod d0/d7/da/d1e/c2a 0 2024-09-13T22:55:56.738 INFO:tasks.workunit.client.1.smithi047.stdout:5/114: dwrite d19/d23/f29 [0,4194304] 0 2024-09-13T22:55:56.739 INFO:tasks.workunit.client.1.smithi047.stdout:6/194: rename d3/d11/d2b/d1c/c34 to d3/c3d 0 2024-09-13T22:55:56.744 INFO:tasks.workunit.client.1.smithi047.stdout:7/127: rmdir d0/db 39 2024-09-13T22:55:56.749 INFO:tasks.workunit.client.1.smithi047.stdout:6/195: readlink d3/ld 0 2024-09-13T22:55:56.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:56 smithi002 ceph-mon[27637]: pgmap v8: 65 pgs: 65 active+clean; 244 MiB data, 939 MiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 7.7 MiB/s wr, 125 op/s 2024-09-13T22:55:56.753 INFO:tasks.workunit.client.1.smithi047.stdout:3/209: rename d0/d3/d4/d1a to d0/d25/d44 0 2024-09-13T22:55:56.754 INFO:tasks.workunit.client.1.smithi047.stdout:0/165: dwrite d1/d5/d16/d23/d2d/f31 [0,4194304] 0 2024-09-13T22:55:56.756 INFO:tasks.workunit.client.1.smithi047.stdout:7/128: creat d0/d7/da/f2b x:0 0 0 2024-09-13T22:55:56.758 INFO:tasks.workunit.client.1.smithi047.stdout:7/129: dread - d0/d7/da/d1e/f24 zero size 2024-09-13T22:55:56.758 INFO:tasks.workunit.client.1.smithi047.stdout:7/130: stat d0/d7/da/lf 0 2024-09-13T22:55:56.759 INFO:tasks.workunit.client.1.smithi047.stdout:5/115: symlink d19/d23/d2e/l31 0 2024-09-13T22:55:56.761 INFO:tasks.workunit.client.1.smithi047.stdout:6/196: mknod d3/d11/c3e 0 2024-09-13T22:55:56.763 INFO:tasks.workunit.client.1.smithi047.stdout:3/210: chown d0/d25/d44/f27 493610939 1 2024-09-13T22:55:56.765 INFO:tasks.workunit.client.1.smithi047.stdout:0/166: symlink d1/d5/d11/d2f/l3d 0 2024-09-13T22:55:56.765 INFO:tasks.workunit.client.1.smithi047.stdout:0/167: chown d1/d5/f29 229663 1 2024-09-13T22:55:56.767 INFO:tasks.workunit.client.1.smithi047.stdout:7/131: creat d0/d7/f2c x:0 0 0 2024-09-13T22:55:56.769 INFO:tasks.workunit.client.1.smithi047.stdout:5/116: mkdir d19/d23/d32 0 2024-09-13T22:55:56.771 INFO:tasks.workunit.client.1.smithi047.stdout:5/117: dread d19/f1c [0,4194304] 0 2024-09-13T22:55:56.772 INFO:tasks.workunit.client.1.smithi047.stdout:6/197: creat d3/d11/f3f x:0 0 0 2024-09-13T22:55:56.772 INFO:tasks.workunit.client.1.smithi047.stdout:5/118: chown d19/l1b 9981023 1 2024-09-13T22:55:56.778 INFO:tasks.workunit.client.1.smithi047.stdout:7/132: write d0/db/fc [470388,7907] 0 2024-09-13T22:55:56.779 INFO:tasks.workunit.client.1.smithi047.stdout:7/133: readlink d0/d7/da/lf 0 2024-09-13T22:55:56.780 INFO:tasks.workunit.client.1.smithi047.stdout:7/134: dread - d0/d7/da/f26 zero size 2024-09-13T22:55:56.781 INFO:tasks.workunit.client.1.smithi047.stdout:6/198: creat d3/d11/f40 x:0 0 0 2024-09-13T22:55:56.781 INFO:tasks.workunit.client.1.smithi047.stdout:7/135: write d0/d7/f6 [1206077,63438] 0 2024-09-13T22:55:56.790 INFO:tasks.workunit.client.1.smithi047.stdout:6/199: mknod d3/d15/c41 0 2024-09-13T22:55:56.790 INFO:tasks.workunit.client.1.smithi047.stdout:6/200: stat d3/d11/d2b/d1c/f20 0 2024-09-13T22:55:56.801 INFO:tasks.workunit.client.1.smithi047.stdout:3/211: getdents d0/d3/d4/d16/d2c/de/d1f 0 2024-09-13T22:55:56.803 INFO:tasks.workunit.client.1.smithi047.stdout:0/168: getdents d1 0 2024-09-13T22:55:56.805 INFO:tasks.workunit.client.1.smithi047.stdout:5/119: write d19/f1d [3343205,90443] 0 2024-09-13T22:55:56.806 INFO:tasks.workunit.client.1.smithi047.stdout:3/212: symlink d0/d3/d4/d16/d1c/l45 0 2024-09-13T22:55:56.811 INFO:tasks.workunit.client.1.smithi047.stdout:3/213: chown d0/d3/d4/d16/d2c/de/c38 59867946 1 2024-09-13T22:55:56.813 INFO:tasks.workunit.client.1.smithi047.stdout:0/169: link d1/d7/fb d1/d7/f3e 0 2024-09-13T22:55:56.818 INFO:tasks.workunit.client.1.smithi047.stdout:3/214: rename d0/d3/d4/d16/d2c/de/f11 to d0/d3/d4/d16/d2c/f46 0 2024-09-13T22:55:56.821 INFO:tasks.workunit.client.1.smithi047.stdout:0/170: creat d1/d5/f3f x:0 0 0 2024-09-13T22:55:56.824 INFO:tasks.workunit.client.1.smithi047.stdout:7/136: dwrite d0/db/f16 [0,4194304] 0 2024-09-13T22:55:56.824 INFO:tasks.workunit.client.1.smithi047.stdout:7/137: chown d0/db 7 1 2024-09-13T22:55:56.832 INFO:tasks.workunit.client.1.smithi047.stdout:7/138: write d0/f20 [768387,70140] 0 2024-09-13T22:55:56.838 INFO:tasks.workunit.client.1.smithi047.stdout:5/120: dwrite f10 [0,4194304] 0 2024-09-13T22:55:56.839 INFO:tasks.workunit.client.1.smithi047.stdout:7/139: creat d0/d19/f2d x:0 0 0 2024-09-13T22:55:56.839 INFO:tasks.workunit.client.1.smithi047.stdout:5/121: stat d19/d23 0 2024-09-13T22:55:56.842 INFO:tasks.workunit.client.1.smithi047.stdout:3/215: write d0/d3/d4/f3e [3341253,71123] 0 2024-09-13T22:55:56.843 INFO:tasks.workunit.client.1.smithi047.stdout:3/216: chown d0/d3/d4/d16/d2c/de/d1f 39 1 2024-09-13T22:55:56.847 INFO:tasks.workunit.client.1.smithi047.stdout:7/140: mkdir d0/d7/da/d2e 0 2024-09-13T22:55:56.847 INFO:tasks.workunit.client.1.smithi047.stdout:7/141: chown d0/d19/c1b 569201 1 2024-09-13T22:55:56.849 INFO:tasks.workunit.client.1.smithi047.stdout:0/171: getdents d1/d5/d11 0 2024-09-13T22:55:56.850 INFO:tasks.workunit.client.1.smithi047.stdout:0/172: chown d1/d5/c14 28 1 2024-09-13T22:55:56.852 INFO:tasks.workunit.client.1.smithi047.stdout:3/217: rmdir d0/d25/d44 39 2024-09-13T22:55:56.855 INFO:tasks.workunit.client.1.smithi047.stdout:5/122: rename cf to d19/d23/d2e/c33 0 2024-09-13T22:55:56.855 INFO:tasks.workunit.client.1.smithi047.stdout:3/218: dread d0/d3/d4/d16/d1c/f2d [0,4194304] 0 2024-09-13T22:55:56.862 INFO:tasks.workunit.client.1.smithi047.stdout:5/123: rename d19/d23/d2a to d19/d34 0 2024-09-13T22:55:56.867 INFO:tasks.workunit.client.1.smithi047.stdout:0/173: write d1/d5/d16/f3c [492990,117786] 0 2024-09-13T22:55:56.868 INFO:tasks.workunit.client.1.smithi047.stdout:0/174: chown d1/d7/f18 161064 1 2024-09-13T22:55:56.872 INFO:tasks.workunit.client.1.smithi047.stdout:7/142: link d0/d19/c25 d0/d7/da/d1e/c2f 0 2024-09-13T22:55:56.874 INFO:tasks.workunit.client.1.smithi047.stdout:0/175: rmdir d1/d7 39 2024-09-13T22:55:56.886 INFO:tasks.workunit.client.1.smithi047.stdout:3/219: truncate d0/d3/f15 3345027 0 2024-09-13T22:55:56.887 INFO:tasks.workunit.client.1.smithi047.stdout:3/220: write d0/d25/d34/f41 [757885,6735] 0 2024-09-13T22:55:56.888 INFO:tasks.workunit.client.1.smithi047.stdout:3/221: chown d0/d3/d4/d16/d32 5481 1 2024-09-13T22:55:56.890 INFO:tasks.workunit.client.1.smithi047.stdout:5/124: getdents d19/d25 0 2024-09-13T22:55:56.890 INFO:tasks.workunit.client.1.smithi047.stdout:3/222: read d0/d3/d4/d16/d2c/de/f10 [4866726,123892] 0 2024-09-13T22:55:56.891 INFO:tasks.workunit.client.1.smithi047.stdout:5/125: write d19/d23/f29 [3852291,59847] 0 2024-09-13T22:55:56.893 INFO:tasks.workunit.client.1.smithi047.stdout:7/143: truncate d0/d7/f6 1635918 0 2024-09-13T22:55:56.898 INFO:tasks.workunit.client.1.smithi047.stdout:7/144: creat d0/db/f30 x:0 0 0 2024-09-13T22:55:56.904 INFO:tasks.workunit.client.1.smithi047.stdout:3/223: mknod d0/d25/c47 0 2024-09-13T22:55:56.904 INFO:tasks.workunit.client.1.smithi047.stdout:7/145: dread d0/d19/f1c [0,4194304] 0 2024-09-13T22:55:56.908 INFO:tasks.workunit.client.1.smithi047.stdout:7/146: write d0/db/f16 [53879,15816] 0 2024-09-13T22:55:56.909 INFO:tasks.workunit.client.1.smithi047.stdout:0/176: rename d1/d5/d16/d23/f27 to d1/f40 0 2024-09-13T22:55:56.912 INFO:tasks.workunit.client.1.smithi047.stdout:7/147: dwrite d0/f29 [0,4194304] 0 2024-09-13T22:55:56.912 INFO:tasks.workunit.client.1.smithi047.stdout:3/224: mknod d0/c48 0 2024-09-13T22:55:56.931 INFO:tasks.workunit.client.1.smithi047.stdout:0/177: rename d1/d7/fb to d1/d5/d11/d2f/f41 0 2024-09-13T22:55:56.932 INFO:tasks.workunit.client.1.smithi047.stdout:0/178: write d1/d5/f29 [439269,54848] 0 2024-09-13T22:55:56.933 INFO:tasks.workunit.client.1.smithi047.stdout:0/179: dread d1/d5/d16/d23/f25 [0,4194304] 0 2024-09-13T22:55:56.935 INFO:tasks.workunit.client.1.smithi047.stdout:7/148: symlink d0/l31 0 2024-09-13T22:55:56.938 INFO:tasks.workunit.client.1.smithi047.stdout:3/225: creat d0/d25/d44/f49 x:0 0 0 2024-09-13T22:55:56.942 INFO:tasks.workunit.client.1.smithi047.stdout:0/180: write d1/f40 [1552312,60588] 0 2024-09-13T22:55:56.943 INFO:tasks.workunit.client.1.smithi047.stdout:0/181: chown d1/d5/d16/d23/d2d 422506 1 2024-09-13T22:55:56.944 INFO:tasks.workunit.client.1.smithi047.stdout:7/149: mkdir d0/d19/d32 0 2024-09-13T22:55:56.951 INFO:tasks.workunit.client.1.smithi047.stdout:3/226: creat d0/d3/d4/d16/d2c/de/d1f/d2e/f4a x:0 0 0 2024-09-13T22:55:56.952 INFO:tasks.workunit.client.1.smithi047.stdout:3/227: fsync d0/d3/d4/d16/d2c/f23 0 2024-09-13T22:55:56.953 INFO:tasks.workunit.client.1.smithi047.stdout:0/182: rename d1/f32 to d1/d5/d16/d23/f42 0 2024-09-13T22:55:56.957 INFO:tasks.workunit.client.1.smithi047.stdout:3/228: creat d0/d25/d34/f4b x:0 0 0 2024-09-13T22:55:56.958 INFO:tasks.workunit.client.1.smithi047.stdout:0/183: mknod d1/d5/d16/c43 0 2024-09-13T22:55:56.959 INFO:tasks.workunit.client.1.smithi047.stdout:7/150: creat d0/f33 x:0 0 0 2024-09-13T22:55:56.962 INFO:tasks.workunit.client.1.smithi047.stdout:0/184: creat d1/d7/f44 x:0 0 0 2024-09-13T22:55:56.964 INFO:tasks.workunit.client.1.smithi047.stdout:7/151: creat d0/d7/da/f34 x:0 0 0 2024-09-13T22:55:56.969 INFO:tasks.workunit.client.1.smithi047.stdout:0/185: dwrite d1/d7/fe [0,4194304] 0 2024-09-13T22:55:56.974 INFO:tasks.workunit.client.1.smithi047.stdout:7/152: dwrite d0/d7/da/d1e/f22 [0,4194304] 0 2024-09-13T22:55:56.976 INFO:tasks.workunit.client.1.smithi047.stdout:7/153: dread - d0/d7/f14 zero size 2024-09-13T22:55:56.976 INFO:tasks.workunit.client.1.smithi047.stdout:7/154: read - d0/f1f zero size 2024-09-13T22:55:56.979 INFO:tasks.workunit.client.1.smithi047.stdout:0/186: mkdir d1/d5/d16/d23/d45 0 2024-09-13T22:55:56.980 INFO:tasks.workunit.client.1.smithi047.stdout:7/155: read d0/d19/f1c [39357,10961] 0 2024-09-13T22:55:56.981 INFO:tasks.workunit.client.1.smithi047.stdout:7/156: read d0/d19/f1c [22256,62853] 0 2024-09-13T22:55:56.983 INFO:tasks.workunit.client.1.smithi047.stdout:7/157: chown d0/d7/da/f2b 94 1 2024-09-13T22:55:56.984 INFO:tasks.workunit.client.1.smithi047.stdout:0/187: rmdir d1/d5/d11/d2f 39 2024-09-13T22:55:56.984 INFO:tasks.workunit.client.1.smithi047.stdout:7/158: read d0/d7/f17 [150267,127734] 0 2024-09-13T22:55:56.985 INFO:tasks.workunit.client.1.smithi047.stdout:0/188: chown d1/d7/c22 31 1 2024-09-13T22:55:56.986 INFO:tasks.workunit.client.1.smithi047.stdout:0/189: fdatasync d1/d5/f29 0 2024-09-13T22:55:56.986 INFO:tasks.workunit.client.1.smithi047.stdout:0/190: chown d1/d5/d11/c19 1566815487 1 2024-09-13T22:55:56.987 INFO:tasks.workunit.client.1.smithi047.stdout:0/191: fdatasync d1/d5/d11/f35 0 2024-09-13T22:55:56.991 INFO:tasks.workunit.client.1.smithi047.stdout:7/159: mknod d0/db/c35 0 2024-09-13T22:55:56.994 INFO:tasks.workunit.client.1.smithi047.stdout:3/229: dwrite d0/d3/d4/d16/d2c/de/f28 [4194304,4194304] 0 2024-09-13T22:55:56.996 INFO:tasks.workunit.client.1.smithi047.stdout:7/160: rmdir d0/d19 39 2024-09-13T22:55:57.000 INFO:tasks.workunit.client.1.smithi047.stdout:0/192: mknod d1/d5/d11/c46 0 2024-09-13T22:55:57.004 INFO:tasks.workunit.client.1.smithi047.stdout:7/161: creat d0/d7/f36 x:0 0 0 2024-09-13T22:55:57.004 INFO:tasks.workunit.client.1.smithi047.stdout:7/162: read - d0/d7/f2c zero size 2024-09-13T22:55:57.006 INFO:tasks.workunit.client.1.smithi047.stdout:0/193: chown d1/d5/d11/d2f/l3d 3887 1 2024-09-13T22:55:57.009 INFO:tasks.workunit.client.1.smithi047.stdout:7/163: dread d0/f29 [0,4194304] 0 2024-09-13T22:55:57.012 INFO:tasks.workunit.client.1.smithi047.stdout:0/194: mkdir d1/d5/d16/d47 0 2024-09-13T22:55:57.014 INFO:tasks.workunit.client.1.smithi047.stdout:3/230: creat d0/d3/d4/f4c x:0 0 0 2024-09-13T22:55:57.020 INFO:tasks.workunit.client.1.smithi047.stdout:0/195: creat d1/d5/d11/d2f/f48 x:0 0 0 2024-09-13T22:55:57.024 INFO:tasks.workunit.client.1.smithi047.stdout:7/164: mkdir d0/d7/da/d2e/d37 0 2024-09-13T22:55:57.026 INFO:tasks.workunit.client.1.smithi047.stdout:0/196: chown d1/f37 21367852 1 2024-09-13T22:55:57.027 INFO:tasks.workunit.client.1.smithi047.stdout:3/231: dwrite d0/d3/d4/f9 [0,4194304] 0 2024-09-13T22:55:57.027 INFO:tasks.workunit.client.1.smithi047.stdout:7/165: mknod d0/d7/c38 0 2024-09-13T22:55:57.028 INFO:tasks.workunit.client.1.smithi047.stdout:0/197: dread - d1/d5/d11/d2f/f38 zero size 2024-09-13T22:55:57.029 INFO:tasks.workunit.client.1.smithi047.stdout:0/198: chown d1/d5/d16 1 1 2024-09-13T22:55:57.034 INFO:tasks.workunit.client.1.smithi047.stdout:3/232: unlink d0/d3/d4/d16/d2c/lc 0 2024-09-13T22:55:57.037 INFO:tasks.workunit.client.1.smithi047.stdout:0/199: dwrite d1/d5/f8 [0,4194304] 0 2024-09-13T22:55:57.038 INFO:tasks.workunit.client.1.smithi047.stdout:3/233: mknod d0/d25/d44/d43/c4d 0 2024-09-13T22:55:57.040 INFO:tasks.workunit.client.1.smithi047.stdout:7/166: mknod d0/d19/d32/c39 0 2024-09-13T22:55:57.041 INFO:tasks.workunit.client.1.smithi047.stdout:0/200: rmdir d1/d7 39 2024-09-13T22:55:57.044 INFO:tasks.workunit.client.1.smithi047.stdout:3/234: creat d0/d3/d4/d16/f4e x:0 0 0 2024-09-13T22:55:57.047 INFO:tasks.workunit.client.1.smithi047.stdout:7/167: dwrite d0/f1f [0,4194304] 0 2024-09-13T22:55:57.049 INFO:tasks.workunit.client.1.smithi047.stdout:7/168: dread - d0/d7/da/d1e/f24 zero size 2024-09-13T22:55:57.051 INFO:tasks.workunit.client.1.smithi047.stdout:7/169: read d0/d7/f17 [374073,34038] 0 2024-09-13T22:55:57.052 INFO:tasks.workunit.client.1.smithi047.stdout:7/170: readlink d0/d7/da/lf 0 2024-09-13T22:55:57.053 INFO:tasks.workunit.client.1.smithi047.stdout:3/235: read d0/d3/d4/d16/d2c/de/f10 [3716416,82388] 0 2024-09-13T22:55:57.059 INFO:tasks.workunit.client.1.smithi047.stdout:7/171: dwrite d0/f1f [0,4194304] 0 2024-09-13T22:55:57.061 INFO:tasks.workunit.client.1.smithi047.stdout:3/236: creat d0/d25/d34/f4f x:0 0 0 2024-09-13T22:55:57.063 INFO:tasks.workunit.client.1.smithi047.stdout:3/237: chown d0/d3/d4/f9 789 1 2024-09-13T22:55:57.063 INFO:tasks.workunit.client.1.smithi047.stdout:7/172: dread d0/d7/da/f11 [0,4194304] 0 2024-09-13T22:55:57.064 INFO:tasks.workunit.client.1.smithi047.stdout:7/173: dread - d0/d19/f2d zero size 2024-09-13T22:55:57.068 INFO:tasks.workunit.client.1.smithi047.stdout:7/174: dread d0/d7/da/f11 [0,4194304] 0 2024-09-13T22:55:57.068 INFO:tasks.workunit.client.1.smithi047.stdout:7/175: stat d0/d19/c1b 0 2024-09-13T22:55:57.074 INFO:tasks.workunit.client.1.smithi047.stdout:3/238: creat d0/d3/d4/d16/d2c/de/d3d/f50 x:0 0 0 2024-09-13T22:55:57.077 INFO:tasks.workunit.client.1.smithi047.stdout:7/176: creat d0/d19/f3a x:0 0 0 2024-09-13T22:55:57.078 INFO:tasks.workunit.client.1.smithi047.stdout:0/201: getdents d1/d7 0 2024-09-13T22:55:57.082 INFO:tasks.workunit.client.1.smithi047.stdout:7/177: dwrite d0/db/fc [0,4194304] 0 2024-09-13T22:55:57.082 INFO:tasks.workunit.client.1.smithi047.stdout:3/239: rename d0/d3/d4/d16/d2c/de/f40 to d0/d3/d4/d16/d2c/de/d1f/d3b/f51 0 2024-09-13T22:55:57.085 INFO:tasks.workunit.client.1.smithi047.stdout:3/240: truncate d0/d3/d4/d16/d2c/f24 399631 0 2024-09-13T22:55:57.091 INFO:tasks.workunit.client.1.smithi047.stdout:7/178: creat d0/db/f3b x:0 0 0 2024-09-13T22:55:57.093 INFO:tasks.workunit.client.1.smithi047.stdout:3/241: truncate d0/d25/d44/f27 3458 0 2024-09-13T22:55:57.099 INFO:tasks.workunit.client.1.smithi047.stdout:3/242: dwrite d0/d3/f33 [4194304,4194304] 0 2024-09-13T22:55:57.105 INFO:tasks.workunit.client.1.smithi047.stdout:3/243: unlink d0/d3/d4/d16/f2f 0 2024-09-13T22:55:57.105 INFO:tasks.workunit.client.1.smithi047.stdout:3/244: readlink d0/d3/d4/d16/d2c/l1b 0 2024-09-13T22:55:57.109 INFO:tasks.workunit.client.1.smithi047.stdout:3/245: creat d0/d3/d4/d16/d1c/f52 x:0 0 0 2024-09-13T22:55:57.112 INFO:tasks.workunit.client.1.smithi047.stdout:3/246: creat d0/d3/d4/d16/f53 x:0 0 0 2024-09-13T22:55:57.113 INFO:tasks.workunit.client.1.smithi047.stdout:3/247: dread - d0/d3/d4/d16/d2c/de/d1f/f37 zero size 2024-09-13T22:55:57.114 INFO:tasks.workunit.client.1.smithi047.stdout:3/248: write d0/d3/d4/d16/f4e [617098,35783] 0 2024-09-13T22:55:57.117 INFO:tasks.workunit.client.1.smithi047.stdout:3/249: creat d0/d25/d44/d43/f54 x:0 0 0 2024-09-13T22:55:57.157 INFO:tasks.workunit.client.0.smithi002.stdout:7/2: sync 2024-09-13T22:55:57.158 INFO:tasks.workunit.client.0.smithi002.stdout:7/3: unlink - no file 2024-09-13T22:55:57.178 INFO:tasks.workunit.client.1.smithi047.stdout:7/179: dwrite d0/f29 [0,4194304] 0 2024-09-13T22:55:57.179 INFO:tasks.workunit.client.0.smithi002.stdout:8/25: sync 2024-09-13T22:55:57.179 INFO:tasks.workunit.client.0.smithi002.stdout:5/28: sync 2024-09-13T22:55:57.179 INFO:tasks.workunit.client.0.smithi002.stdout:0/42: sync 2024-09-13T22:55:57.179 INFO:tasks.workunit.client.0.smithi002.stdout:2/13: sync 2024-09-13T22:55:57.179 INFO:tasks.workunit.client.0.smithi002.stdout:3/43: sync 2024-09-13T22:55:57.179 INFO:tasks.workunit.client.0.smithi002.stdout:1/92: sync 2024-09-13T22:55:57.179 INFO:tasks.workunit.client.0.smithi002.stdout:4/5: sync 2024-09-13T22:55:57.179 INFO:tasks.workunit.client.0.smithi002.stdout:9/63: sync 2024-09-13T22:55:57.179 INFO:tasks.workunit.client.0.smithi002.stdout:6/56: sync 2024-09-13T22:55:57.180 INFO:tasks.workunit.client.1.smithi047.stdout:7/180: chown d0/d7/da/f2b 0 1 2024-09-13T22:55:57.180 INFO:tasks.workunit.client.0.smithi002.stdout:5/29: fdatasync d1/f8 0 2024-09-13T22:55:57.182 INFO:tasks.workunit.client.0.smithi002.stdout:6/57: symlink lf 0 2024-09-13T22:55:57.184 INFO:tasks.workunit.client.0.smithi002.stdout:0/43: symlink d1/lf 0 2024-09-13T22:55:57.186 INFO:tasks.workunit.client.0.smithi002.stdout:1/93: symlink d1/l1a 0 2024-09-13T22:55:57.187 INFO:tasks.workunit.client.0.smithi002.stdout:1/94: chown d1/f15 70237774 1 2024-09-13T22:55:57.188 INFO:tasks.workunit.client.0.smithi002.stdout:1/95: write d1/d6/fa [1335071,119850] 0 2024-09-13T22:55:57.188 INFO:tasks.workunit.client.1.smithi047.stdout:7/181: link d0/d7/da/f11 d0/d7/f3c 0 2024-09-13T22:55:57.189 INFO:tasks.workunit.client.1.smithi047.stdout:3/250: getdents d0/d3/d4/d16/d1c 0 2024-09-13T22:55:57.190 INFO:tasks.workunit.client.1.smithi047.stdout:7/182: stat d0/d7/da/d1e/f22 0 2024-09-13T22:55:57.190 INFO:tasks.workunit.client.1.smithi047.stdout:3/251: chown d0/d3/d4/f4c 345364 1 2024-09-13T22:55:57.191 INFO:tasks.workunit.client.1.smithi047.stdout:7/183: dread - d0/d7/f15 zero size 2024-09-13T22:55:57.192 INFO:tasks.workunit.client.0.smithi002.stdout:4/6: rename f0 to f2 0 2024-09-13T22:55:57.194 INFO:tasks.workunit.client.0.smithi002.stdout:9/64: creat d8/d11/f19 x:0 0 0 2024-09-13T22:55:57.194 INFO:tasks.workunit.client.1.smithi047.stdout:3/252: mknod d0/d3/d4/d16/d2c/de/d1f/c55 0 2024-09-13T22:55:57.197 INFO:tasks.workunit.client.0.smithi002.stdout:5/30: mknod d1/c9 0 2024-09-13T22:55:57.197 INFO:tasks.workunit.client.0.smithi002.stdout:1/96: dwrite d1/d6/f18 [0,4194304] 0 2024-09-13T22:55:57.198 INFO:tasks.workunit.client.0.smithi002.stdout:6/58: mknod c10 0 2024-09-13T22:55:57.198 INFO:tasks.workunit.client.1.smithi047.stdout:3/253: mknod d0/d3/d4/d16/d2c/c56 0 2024-09-13T22:55:57.200 INFO:tasks.workunit.client.0.smithi002.stdout:6/59: chown f5 259591 1 2024-09-13T22:55:57.200 INFO:tasks.workunit.client.0.smithi002.stdout:1/97: write d1/fe [3186156,74473] 0 2024-09-13T22:55:57.202 INFO:tasks.workunit.client.0.smithi002.stdout:3/44: dwrite d9/d15/f14 [0,4194304] 0 2024-09-13T22:55:57.203 INFO:tasks.workunit.client.0.smithi002.stdout:1/98: fsync d1/d13/f19 0 2024-09-13T22:55:57.203 INFO:tasks.workunit.client.1.smithi047.stdout:3/254: mknod d0/d3/d4/d16/d32/d42/c57 0 2024-09-13T22:55:57.205 INFO:tasks.workunit.client.0.smithi002.stdout:1/99: write d1/d6/fa [1081708,47036] 0 2024-09-13T22:55:57.205 INFO:tasks.workunit.client.0.smithi002.stdout:4/7: mkdir d3 0 2024-09-13T22:55:57.206 INFO:tasks.workunit.client.0.smithi002.stdout:1/100: chown d1/f15 10260 1 2024-09-13T22:55:57.211 INFO:tasks.workunit.client.1.smithi047.stdout:3/255: dwrite d0/d3/d4/d16/d2c/de/d3d/f50 [0,4194304] 0 2024-09-13T22:55:57.212 INFO:tasks.workunit.client.0.smithi002.stdout:5/31: mknod d1/ca 0 2024-09-13T22:55:57.213 INFO:tasks.workunit.client.0.smithi002.stdout:5/32: truncate d1/f8 530652 0 2024-09-13T22:55:57.213 INFO:tasks.workunit.client.1.smithi047.stdout:3/256: write d0/d25/d44/f1e [1149399,58511] 0 2024-09-13T22:55:57.214 INFO:tasks.workunit.client.1.smithi047.stdout:3/257: chown d0/d3/d4/d16/d1c 17542 1 2024-09-13T22:55:57.216 INFO:tasks.workunit.client.1.smithi047.stdout:3/258: stat d0/d3/d4/d16/d2c/de/d1f 0 2024-09-13T22:55:57.218 INFO:tasks.workunit.client.1.smithi047.stdout:3/259: write d0/d3/d4/d16/d2c/f24 [1153931,94446] 0 2024-09-13T22:55:57.222 INFO:tasks.workunit.client.0.smithi002.stdout:3/45: creat d9/f16 x:0 0 0 2024-09-13T22:55:57.225 INFO:tasks.workunit.client.1.smithi047.stdout:3/260: creat d0/f58 x:0 0 0 2024-09-13T22:55:57.231 INFO:tasks.workunit.client.0.smithi002.stdout:5/33: symlink d1/lb 0 2024-09-13T22:55:57.232 INFO:tasks.workunit.client.1.smithi047.stdout:3/261: link d0/d3/d4/d16/d2c/f46 d0/d3/d4/d16/d32/d42/f59 0 2024-09-13T22:55:57.233 INFO:tasks.workunit.client.0.smithi002.stdout:2/14: getdents d1 0 2024-09-13T22:55:57.233 INFO:tasks.workunit.client.0.smithi002.stdout:2/15: readlink l0 0 2024-09-13T22:55:57.235 INFO:tasks.workunit.client.0.smithi002.stdout:6/60: truncate f1 2031795 0 2024-09-13T22:55:57.236 INFO:tasks.workunit.client.0.smithi002.stdout:4/8: creat d3/f4 x:0 0 0 2024-09-13T22:55:57.240 INFO:tasks.workunit.client.0.smithi002.stdout:2/16: creat d1/f3 x:0 0 0 2024-09-13T22:55:57.241 INFO:tasks.workunit.client.0.smithi002.stdout:6/61: fdatasync f1 0 2024-09-13T22:55:57.242 INFO:tasks.workunit.client.0.smithi002.stdout:8/26: link d3/f4 d3/f6 0 2024-09-13T22:55:57.245 INFO:tasks.workunit.client.0.smithi002.stdout:6/62: symlink l11 0 2024-09-13T22:55:57.247 INFO:tasks.workunit.client.0.smithi002.stdout:6/63: mkdir d12 0 2024-09-13T22:55:57.248 INFO:tasks.workunit.client.0.smithi002.stdout:6/64: write fa [544122,99337] 0 2024-09-13T22:55:57.256 INFO:tasks.workunit.client.0.smithi002.stdout:6/65: link fd d12/f13 0 2024-09-13T22:55:57.257 INFO:tasks.workunit.client.0.smithi002.stdout:4/9: dread f2 [0,4194304] 0 2024-09-13T22:55:57.262 INFO:tasks.workunit.client.0.smithi002.stdout:0/44: dwrite d1/d4/fb [0,4194304] 0 2024-09-13T22:55:57.264 INFO:tasks.workunit.client.0.smithi002.stdout:9/65: truncate d8/fe 565482 0 2024-09-13T22:55:57.267 INFO:tasks.workunit.client.0.smithi002.stdout:6/66: read f1 [1235913,54664] 0 2024-09-13T22:55:57.268 INFO:tasks.workunit.client.0.smithi002.stdout:0/45: dread d1/d4/fb [0,4194304] 0 2024-09-13T22:55:57.271 INFO:tasks.workunit.client.0.smithi002.stdout:6/67: rmdir d12 39 2024-09-13T22:55:57.271 INFO:tasks.workunit.client.0.smithi002.stdout:9/66: dwrite f5 [0,4194304] 0 2024-09-13T22:55:57.272 INFO:tasks.workunit.client.0.smithi002.stdout:1/101: truncate d1/ff 1135737 0 2024-09-13T22:55:57.272 INFO:tasks.workunit.client.0.smithi002.stdout:1/102: fdatasync d1/f7 0 2024-09-13T22:55:57.273 INFO:tasks.workunit.client.0.smithi002.stdout:0/46: mkdir d1/d2/d10 0 2024-09-13T22:55:57.274 INFO:tasks.workunit.client.0.smithi002.stdout:0/47: chown d1/d4 970082827 1 2024-09-13T22:55:57.275 INFO:tasks.workunit.client.0.smithi002.stdout:2/17: getdents d1 0 2024-09-13T22:55:57.275 INFO:tasks.workunit.client.0.smithi002.stdout:2/18: readlink l0 0 2024-09-13T22:55:57.276 INFO:tasks.workunit.client.0.smithi002.stdout:5/34: truncate d1/f8 225345 0 2024-09-13T22:55:57.276 INFO:tasks.workunit.client.0.smithi002.stdout:5/35: chown d1/ca 1719626961 1 2024-09-13T22:55:57.277 INFO:tasks.workunit.client.0.smithi002.stdout:9/67: symlink d8/d11/l1a 0 2024-09-13T22:55:57.277 INFO:tasks.workunit.client.0.smithi002.stdout:5/36: write d1/f3 [1535021,128244] 0 2024-09-13T22:55:57.278 INFO:tasks.workunit.client.0.smithi002.stdout:9/68: fsync f0 0 2024-09-13T22:55:57.279 INFO:tasks.workunit.client.1.smithi047.stdout:2/212: sync 2024-09-13T22:55:57.280 INFO:tasks.workunit.client.1.smithi047.stdout:2/213: stat d1/de/c22 0 2024-09-13T22:55:57.281 INFO:tasks.workunit.client.0.smithi002.stdout:0/48: symlink d1/l11 0 2024-09-13T22:55:57.288 INFO:tasks.workunit.client.0.smithi002.stdout:0/49: dread d1/fa [0,4194304] 0 2024-09-13T22:55:57.288 INFO:tasks.workunit.client.0.smithi002.stdout:8/27: dwrite d3/f4 [0,4194304] 0 2024-09-13T22:55:57.289 INFO:tasks.workunit.client.1.smithi047.stdout:2/214: symlink d1/df/d26/l49 0 2024-09-13T22:55:57.292 INFO:tasks.workunit.client.0.smithi002.stdout:6/68: creat d12/f14 x:0 0 0 2024-09-13T22:55:57.293 INFO:tasks.workunit.client.0.smithi002.stdout:4/10: dwrite f2 [0,4194304] 0 2024-09-13T22:55:57.293 INFO:tasks.workunit.client.0.smithi002.stdout:6/69: readlink l3 0 2024-09-13T22:55:57.293 INFO:tasks.workunit.client.0.smithi002.stdout:9/69: dread d8/fa [0,4194304] 0 2024-09-13T22:55:57.294 INFO:tasks.workunit.client.0.smithi002.stdout:9/70: chown d8/lb 6 1 2024-09-13T22:55:57.299 INFO:tasks.workunit.client.1.smithi047.stdout:2/215: fsync d1/df/d1d/d20/d37/f39 0 2024-09-13T22:55:57.301 INFO:tasks.workunit.client.1.smithi047.stdout:2/216: chown d1/d16/c3a 1476877 1 2024-09-13T22:55:57.302 INFO:tasks.workunit.client.0.smithi002.stdout:4/11: dwrite d3/f4 [0,4194304] 0 2024-09-13T22:55:57.302 INFO:tasks.workunit.client.0.smithi002.stdout:4/12: stat f1 0 2024-09-13T22:55:57.303 INFO:tasks.workunit.client.0.smithi002.stdout:9/71: dwrite f5 [0,4194304] 0 2024-09-13T22:55:57.306 INFO:tasks.workunit.client.0.smithi002.stdout:9/72: write d8/d11/f19 [867680,98601] 0 2024-09-13T22:55:57.310 INFO:tasks.workunit.client.0.smithi002.stdout:7/4: sync 2024-09-13T22:55:57.310 INFO:tasks.workunit.client.0.smithi002.stdout:7/5: fdatasync - no filename 2024-09-13T22:55:57.311 INFO:tasks.workunit.client.1.smithi047.stdout:2/217: rename d1/f3 to d1/de/f4a 0 2024-09-13T22:55:57.320 INFO:tasks.workunit.client.1.smithi047.stdout:2/218: dwrite d1/de/d17/f31 [0,4194304] 0 2024-09-13T22:55:57.322 INFO:tasks.workunit.client.0.smithi002.stdout:1/103: link d1/l1a d1/d6/l1b 0 2024-09-13T22:55:57.325 INFO:tasks.workunit.client.1.smithi047.stdout:2/219: mkdir d1/df/d26/d4b 0 2024-09-13T22:55:57.329 INFO:tasks.workunit.client.0.smithi002.stdout:8/28: write d3/f4 [4716917,123343] 0 2024-09-13T22:55:57.329 INFO:tasks.workunit.client.0.smithi002.stdout:8/29: chown d3 9911 1 2024-09-13T22:55:57.330 INFO:tasks.workunit.client.1.smithi047.stdout:2/220: symlink d1/de/d17/l4c 0 2024-09-13T22:55:57.331 INFO:tasks.workunit.client.0.smithi002.stdout:2/19: link l0 d1/l4 0 2024-09-13T22:55:57.331 INFO:tasks.workunit.client.1.smithi047.stdout:2/221: write d1/df/d1d/d20/d2b/f34 [530767,56400] 0 2024-09-13T22:55:57.336 INFO:tasks.workunit.client.0.smithi002.stdout:8/30: dwrite d3/f4 [4194304,4194304] 0 2024-09-13T22:55:57.338 INFO:tasks.workunit.client.1.smithi047.stdout:2/222: creat d1/d16/d40/f4d x:0 0 0 2024-09-13T22:55:57.341 INFO:tasks.workunit.client.0.smithi002.stdout:0/50: creat d1/d2/d10/f12 x:0 0 0 2024-09-13T22:55:57.341 INFO:tasks.workunit.client.0.smithi002.stdout:8/31: write d3/f6 [5650598,108083] 0 2024-09-13T22:55:57.342 INFO:tasks.workunit.client.0.smithi002.stdout:8/32: readlink - no filename 2024-09-13T22:55:57.342 INFO:tasks.workunit.client.1.smithi047.stdout:2/223: symlink d1/d16/d40/l4e 0 2024-09-13T22:55:57.343 INFO:tasks.workunit.client.0.smithi002.stdout:6/70: truncate d12/f13 207245 0 2024-09-13T22:55:57.344 INFO:tasks.workunit.client.0.smithi002.stdout:2/20: dwrite d1/f3 [0,4194304] 0 2024-09-13T22:55:57.345 INFO:tasks.workunit.client.0.smithi002.stdout:1/104: mkdir d1/d1c 0 2024-09-13T22:55:57.349 INFO:tasks.workunit.client.0.smithi002.stdout:5/37: dwrite d1/f8 [0,4194304] 0 2024-09-13T22:55:57.350 INFO:tasks.workunit.client.0.smithi002.stdout:1/105: readlink d1/d6/l1b 0 2024-09-13T22:55:57.355 INFO:tasks.workunit.client.0.smithi002.stdout:7/6: creat f0 x:0 0 0 2024-09-13T22:55:57.355 INFO:tasks.workunit.client.0.smithi002.stdout:3/46: sync 2024-09-13T22:55:57.356 INFO:tasks.workunit.client.0.smithi002.stdout:1/106: chown d1/f9 36 1 2024-09-13T22:55:57.357 INFO:tasks.workunit.client.0.smithi002.stdout:0/51: stat d1/d2/c9 0 2024-09-13T22:55:57.359 INFO:tasks.workunit.client.0.smithi002.stdout:0/52: chown d1 27458502 1 2024-09-13T22:55:57.364 INFO:tasks.workunit.client.0.smithi002.stdout:9/73: getdents d8/d11 0 2024-09-13T22:55:57.365 INFO:tasks.workunit.client.0.smithi002.stdout:1/107: mkdir d1/d13/d1d 0 2024-09-13T22:55:57.366 INFO:tasks.workunit.client.0.smithi002.stdout:8/33: dwrite d3/f6 [0,4194304] 0 2024-09-13T22:55:57.366 INFO:tasks.workunit.client.0.smithi002.stdout:3/47: symlink d9/df/d10/l17 0 2024-09-13T22:55:57.366 INFO:tasks.workunit.client.0.smithi002.stdout:8/34: readlink - no filename 2024-09-13T22:55:57.366 INFO:tasks.workunit.client.0.smithi002.stdout:8/35: readlink - no filename 2024-09-13T22:55:57.369 INFO:tasks.workunit.client.0.smithi002.stdout:6/71: dwrite d12/f14 [0,4194304] 0 2024-09-13T22:55:57.371 INFO:tasks.workunit.client.0.smithi002.stdout:9/74: write d8/d11/f12 [243475,50947] 0 2024-09-13T22:55:57.374 INFO:tasks.workunit.client.0.smithi002.stdout:2/21: dwrite d1/f2 [0,4194304] 0 2024-09-13T22:55:57.374 INFO:tasks.workunit.client.0.smithi002.stdout:0/53: mknod d1/d4/c13 0 2024-09-13T22:55:57.378 INFO:tasks.workunit.client.0.smithi002.stdout:0/54: chown d1/d2/c9 296971081 1 2024-09-13T22:55:57.378 INFO:tasks.workunit.client.0.smithi002.stdout:3/48: creat d9/df/d10/f18 x:0 0 0 2024-09-13T22:55:57.381 INFO:tasks.workunit.client.1.smithi047.stdout:2/224: truncate d1/de/f4a 1583630 0 2024-09-13T22:55:57.381 INFO:tasks.workunit.client.0.smithi002.stdout:4/13: truncate f1 2032634 0 2024-09-13T22:55:57.381 INFO:tasks.workunit.client.0.smithi002.stdout:7/7: dwrite f0 [0,4194304] 0 2024-09-13T22:55:57.382 INFO:tasks.workunit.client.0.smithi002.stdout:3/49: stat d9/df/d10/f18 0 2024-09-13T22:55:57.384 INFO:tasks.workunit.client.0.smithi002.stdout:9/75: dread f5 [0,4194304] 0 2024-09-13T22:55:57.385 INFO:tasks.workunit.client.0.smithi002.stdout:2/22: dread d1/f3 [0,4194304] 0 2024-09-13T22:55:57.393 INFO:tasks.workunit.client.0.smithi002.stdout:3/50: dwrite d9/df/d10/f12 [0,4194304] 0 2024-09-13T22:55:57.395 INFO:tasks.workunit.client.0.smithi002.stdout:5/38: truncate d1/f3 674695 0 2024-09-13T22:55:57.396 INFO:tasks.workunit.client.0.smithi002.stdout:8/36: creat d3/f7 x:0 0 0 2024-09-13T22:55:57.397 INFO:tasks.workunit.client.0.smithi002.stdout:8/37: write d3/f7 [843268,65580] 0 2024-09-13T22:55:57.399 INFO:tasks.workunit.client.0.smithi002.stdout:5/39: dread d1/f8 [0,4194304] 0 2024-09-13T22:55:57.400 INFO:tasks.workunit.client.0.smithi002.stdout:2/23: creat d1/f5 x:0 0 0 2024-09-13T22:55:57.400 INFO:tasks.workunit.client.0.smithi002.stdout:6/72: write f1 [2327856,110617] 0 2024-09-13T22:55:57.402 INFO:tasks.workunit.client.0.smithi002.stdout:7/8: write f0 [4476998,54665] 0 2024-09-13T22:55:57.406 INFO:tasks.workunit.client.0.smithi002.stdout:3/51: mknod d9/df/d10/c19 0 2024-09-13T22:55:57.409 INFO:tasks.workunit.client.0.smithi002.stdout:2/24: dwrite d1/f2 [0,4194304] 0 2024-09-13T22:55:57.412 INFO:tasks.workunit.client.0.smithi002.stdout:7/9: dwrite f0 [0,4194304] 0 2024-09-13T22:55:57.412 INFO:tasks.workunit.client.0.smithi002.stdout:8/38: unlink d3/f7 0 2024-09-13T22:55:57.415 INFO:tasks.workunit.client.0.smithi002.stdout:1/108: truncate d1/d6/fa 500579 0 2024-09-13T22:55:57.418 INFO:tasks.workunit.client.0.smithi002.stdout:3/52: dwrite d9/fe [0,4194304] 0 2024-09-13T22:55:57.420 INFO:tasks.workunit.client.0.smithi002.stdout:3/53: write d9/f16 [290344,83127] 0 2024-09-13T22:55:57.421 INFO:tasks.workunit.client.0.smithi002.stdout:6/73: rename le to d12/l15 0 2024-09-13T22:55:57.430 INFO:tasks.workunit.client.0.smithi002.stdout:0/55: truncate d1/d4/f7 3640141 0 2024-09-13T22:55:57.431 INFO:tasks.workunit.client.0.smithi002.stdout:2/25: mknod d1/c6 0 2024-09-13T22:55:57.432 INFO:tasks.workunit.client.0.smithi002.stdout:2/26: readlink l0 0 2024-09-13T22:55:57.434 INFO:tasks.workunit.client.0.smithi002.stdout:8/39: read d3/f5 [2893693,129649] 0 2024-09-13T22:55:57.435 INFO:tasks.workunit.client.0.smithi002.stdout:9/76: link d8/c18 d8/d11/c1b 0 2024-09-13T22:55:57.436 INFO:tasks.workunit.client.0.smithi002.stdout:8/40: truncate d3/f5 5075988 0 2024-09-13T22:55:57.436 INFO:tasks.workunit.client.1.smithi047.stdout:2/225: dwrite d1/de/f4a [0,4194304] 0 2024-09-13T22:55:57.437 INFO:tasks.workunit.client.0.smithi002.stdout:9/77: fdatasync d8/ff 0 2024-09-13T22:55:57.437 INFO:tasks.workunit.client.0.smithi002.stdout:0/56: dwrite d1/d4/fe [0,4194304] 0 2024-09-13T22:55:57.438 INFO:tasks.workunit.client.1.smithi047.stdout:2/226: write d1/d16/d40/f4d [237096,126544] 0 2024-09-13T22:55:57.442 INFO:tasks.workunit.client.0.smithi002.stdout:3/54: creat d9/f1a x:0 0 0 2024-09-13T22:55:57.443 INFO:tasks.workunit.client.0.smithi002.stdout:2/27: write d1/f2 [5007741,102817] 0 2024-09-13T22:55:57.444 INFO:tasks.workunit.client.0.smithi002.stdout:3/55: write d9/f1a [237393,40937] 0 2024-09-13T22:55:57.444 INFO:tasks.workunit.client.0.smithi002.stdout:2/28: write d1/f2 [49660,105026] 0 2024-09-13T22:55:57.447 INFO:tasks.workunit.client.1.smithi047.stdout:2/227: dwrite d1/d16/d40/f4d [0,4194304] 0 2024-09-13T22:55:57.449 INFO:tasks.workunit.client.0.smithi002.stdout:3/56: dread d9/d15/f14 [0,4194304] 0 2024-09-13T22:55:57.449 INFO:tasks.workunit.client.1.smithi047.stdout:2/228: read d1/de/d17/f31 [522029,95346] 0 2024-09-13T22:55:57.454 INFO:tasks.workunit.client.0.smithi002.stdout:3/57: dwrite d9/d15/f14 [0,4194304] 0 2024-09-13T22:55:57.456 INFO:tasks.workunit.client.0.smithi002.stdout:7/10: rename f0 to f1 0 2024-09-13T22:55:57.458 INFO:tasks.workunit.client.1.smithi047.stdout:2/229: truncate d1/df/d1d/d20/d37/f39 1039080 0 2024-09-13T22:55:57.465 INFO:tasks.workunit.client.1.smithi047.stdout:2/230: rename d1/df/d1d/d2e/l2f to d1/df/d26/d4b/l4f 0 2024-09-13T22:55:57.468 INFO:tasks.workunit.client.1.smithi047.stdout:2/231: dread d1/de/f33 [0,4194304] 0 2024-09-13T22:55:57.468 INFO:tasks.workunit.client.0.smithi002.stdout:0/57: creat d1/f14 x:0 0 0 2024-09-13T22:55:57.469 INFO:tasks.workunit.client.0.smithi002.stdout:0/58: dread - d1/d2/fd zero size 2024-09-13T22:55:57.472 INFO:tasks.workunit.client.0.smithi002.stdout:5/40: dwrite d1/f3 [0,4194304] 0 2024-09-13T22:55:57.472 INFO:tasks.workunit.client.0.smithi002.stdout:9/78: rename d8/d11 to d8/d10/d1c 0 2024-09-13T22:55:57.473 INFO:tasks.workunit.client.0.smithi002.stdout:1/109: mkdir d1/d1c/d1e 0 2024-09-13T22:55:57.478 INFO:tasks.workunit.client.1.smithi047.stdout:2/232: creat d1/df/d26/d4b/f50 x:0 0 0 2024-09-13T22:55:57.483 INFO:tasks.workunit.client.0.smithi002.stdout:2/29: mkdir d1/d7 0 2024-09-13T22:55:57.483 INFO:tasks.workunit.client.0.smithi002.stdout:4/14: link f2 d3/f5 0 2024-09-13T22:55:57.485 INFO:tasks.workunit.client.1.smithi047.stdout:2/233: dread d1/de/d17/f31 [0,4194304] 0 2024-09-13T22:55:57.486 INFO:tasks.workunit.client.0.smithi002.stdout:3/58: mknod d9/c1b 0 2024-09-13T22:55:57.489 INFO:tasks.workunit.client.1.smithi047.stdout:2/234: dread d1/de/f4a [0,4194304] 0 2024-09-13T22:55:57.491 INFO:tasks.workunit.client.0.smithi002.stdout:7/11: dwrite f1 [0,4194304] 0 2024-09-13T22:55:57.493 INFO:tasks.workunit.client.0.smithi002.stdout:6/74: truncate f5 116845 0 2024-09-13T22:55:57.493 INFO:tasks.workunit.client.0.smithi002.stdout:6/75: read fa [589325,74727] 0 2024-09-13T22:55:57.495 INFO:tasks.workunit.client.1.smithi047.stdout:2/235: symlink d1/de/l51 0 2024-09-13T22:55:57.497 INFO:tasks.workunit.client.0.smithi002.stdout:0/59: dread d1/fa [0,4194304] 0 2024-09-13T22:55:57.498 INFO:tasks.workunit.client.0.smithi002.stdout:5/41: symlink d1/lc 0 2024-09-13T22:55:57.499 INFO:tasks.workunit.client.0.smithi002.stdout:9/79: rmdir d8/d10/d1c 39 2024-09-13T22:55:57.510 INFO:tasks.workunit.client.0.smithi002.stdout:8/41: link d3/f6 d3/f8 0 2024-09-13T22:55:57.510 INFO:tasks.workunit.client.1.smithi047.stdout:2/236: dread d1/df/d1d/d20/d2b/f34 [0,4194304] 0 2024-09-13T22:55:57.511 INFO:tasks.workunit.client.0.smithi002.stdout:3/59: dread d9/d15/f14 [0,4194304] 0 2024-09-13T22:55:57.511 INFO:tasks.workunit.client.0.smithi002.stdout:7/12: symlink l2 0 2024-09-13T22:55:57.513 INFO:tasks.workunit.client.0.smithi002.stdout:6/76: read d12/f13 [183025,100451] 0 2024-09-13T22:55:57.513 INFO:tasks.workunit.client.0.smithi002.stdout:8/42: dread d3/f8 [4194304,4194304] 0 2024-09-13T22:55:57.514 INFO:tasks.workunit.client.1.smithi047.stdout:2/237: creat d1/df/d1d/d20/d29/f52 x:0 0 0 2024-09-13T22:55:57.514 INFO:tasks.workunit.client.0.smithi002.stdout:0/60: symlink d1/d4/l15 0 2024-09-13T22:55:57.515 INFO:tasks.workunit.client.0.smithi002.stdout:5/42: symlink d1/ld 0 2024-09-13T22:55:57.516 INFO:tasks.workunit.client.0.smithi002.stdout:9/80: unlink c7 0 2024-09-13T22:55:57.517 INFO:tasks.workunit.client.1.smithi047.stdout:2/238: mknod d1/df/d26/d4b/c53 0 2024-09-13T22:55:57.517 INFO:tasks.workunit.client.0.smithi002.stdout:9/81: write f0 [1040438,16205] 0 2024-09-13T22:55:57.517 INFO:tasks.workunit.client.1.smithi047.stdout:2/239: chown d1/de/l51 59070 1 2024-09-13T22:55:57.518 INFO:tasks.workunit.client.0.smithi002.stdout:2/30: mkdir d1/d7/d8 0 2024-09-13T22:55:57.518 INFO:tasks.workunit.client.0.smithi002.stdout:5/43: dread d1/f3 [0,4194304] 0 2024-09-13T22:55:57.519 INFO:tasks.workunit.client.1.smithi047.stdout:2/240: write d1/de/f46 [479917,98859] 0 2024-09-13T22:55:57.519 INFO:tasks.workunit.client.0.smithi002.stdout:2/31: write d1/f2 [1641242,119891] 0 2024-09-13T22:55:57.520 INFO:tasks.workunit.client.0.smithi002.stdout:7/13: symlink l3 0 2024-09-13T22:55:57.522 INFO:tasks.workunit.client.1.smithi047.stdout:2/241: mkdir d1/df/d1d/d20/d54 0 2024-09-13T22:55:57.523 INFO:tasks.workunit.client.1.smithi047.stdout:2/242: write d1/df/d1d/d20/d29/f2d [7508808,33349] 0 2024-09-13T22:55:57.524 INFO:tasks.workunit.client.0.smithi002.stdout:3/60: symlink d9/df/d10/l1c 0 2024-09-13T22:55:57.524 INFO:tasks.workunit.client.0.smithi002.stdout:3/61: chown d9/df/d10 30002177 1 2024-09-13T22:55:57.525 INFO:tasks.workunit.client.0.smithi002.stdout:3/62: stat d9/d15/c11 0 2024-09-13T22:55:57.527 INFO:tasks.workunit.client.0.smithi002.stdout:6/77: rmdir d12 39 2024-09-13T22:55:57.528 INFO:tasks.workunit.client.1.smithi047.stdout:2/243: mknod d1/d16/c55 0 2024-09-13T22:55:57.532 INFO:tasks.workunit.client.1.smithi047.stdout:2/244: fdatasync d1/df/d1d/d20/f42 0 2024-09-13T22:55:57.534 INFO:tasks.workunit.client.0.smithi002.stdout:1/110: rmdir d1/d16 0 2024-09-13T22:55:57.537 INFO:tasks.workunit.client.0.smithi002.stdout:4/15: truncate d3/f4 2001402 0 2024-09-13T22:55:57.541 INFO:tasks.workunit.client.0.smithi002.stdout:1/111: dwrite d1/d13/f19 [0,4194304] 0 2024-09-13T22:55:57.541 INFO:tasks.workunit.client.0.smithi002.stdout:2/32: write d1/f3 [1189336,21658] 0 2024-09-13T22:55:57.541 INFO:tasks.workunit.client.0.smithi002.stdout:9/82: dread d8/d10/d1c/f15 [0,4194304] 0 2024-09-13T22:55:57.542 INFO:tasks.workunit.client.0.smithi002.stdout:7/14: unlink l2 0 2024-09-13T22:55:57.542 INFO:tasks.workunit.client.0.smithi002.stdout:1/112: truncate d1/f15 715900 0 2024-09-13T22:55:57.544 INFO:tasks.workunit.client.0.smithi002.stdout:5/44: dread d1/f8 [0,4194304] 0 2024-09-13T22:55:57.546 INFO:tasks.workunit.client.0.smithi002.stdout:8/43: mknod d3/c9 0 2024-09-13T22:55:57.548 INFO:tasks.workunit.client.0.smithi002.stdout:0/61: truncate d1/d4/fb 698419 0 2024-09-13T22:55:57.550 INFO:tasks.workunit.client.0.smithi002.stdout:3/63: dwrite d9/d15/f14 [0,4194304] 0 2024-09-13T22:55:57.550 INFO:tasks.workunit.client.0.smithi002.stdout:5/45: dread d1/f8 [0,4194304] 0 2024-09-13T22:55:57.550 INFO:tasks.workunit.client.0.smithi002.stdout:3/64: stat d9/d15 0 2024-09-13T22:55:57.551 INFO:tasks.workunit.client.0.smithi002.stdout:5/46: read d1/f8 [3826735,94138] 0 2024-09-13T22:55:57.552 INFO:tasks.workunit.client.0.smithi002.stdout:5/47: chown c0 4827085 1 2024-09-13T22:55:57.553 INFO:tasks.workunit.client.0.smithi002.stdout:5/48: chown d1/ld 216 1 2024-09-13T22:55:57.554 INFO:tasks.workunit.client.1.smithi047.stdout:2/245: write d1/de/d17/f1c [1577227,49720] 0 2024-09-13T22:55:57.556 INFO:tasks.workunit.client.0.smithi002.stdout:3/65: dread d9/f16 [0,4194304] 0 2024-09-13T22:55:57.556 INFO:tasks.workunit.client.1.smithi047.stdout:2/246: truncate d1/de/f46 888068 0 2024-09-13T22:55:57.556 INFO:tasks.workunit.client.0.smithi002.stdout:6/78: write fa [568220,105125] 0 2024-09-13T22:55:57.557 INFO:tasks.workunit.client.0.smithi002.stdout:3/66: fdatasync d9/df/d10/f18 0 2024-09-13T22:55:57.558 INFO:tasks.workunit.client.0.smithi002.stdout:7/15: creat f4 x:0 0 0 2024-09-13T22:55:57.558 INFO:tasks.workunit.client.0.smithi002.stdout:7/16: readlink l3 0 2024-09-13T22:55:57.559 INFO:tasks.workunit.client.0.smithi002.stdout:7/17: write f4 [380298,36165] 0 2024-09-13T22:55:57.564 INFO:tasks.workunit.client.1.smithi047.stdout:2/247: creat d1/df/d1d/d3c/f56 x:0 0 0 2024-09-13T22:55:57.565 INFO:tasks.workunit.client.0.smithi002.stdout:0/62: mknod d1/c16 0 2024-09-13T22:55:57.568 INFO:tasks.workunit.client.1.smithi047.stdout:2/248: mkdir d1/d16/d40/d57 0 2024-09-13T22:55:57.568 INFO:tasks.workunit.client.1.smithi047.stdout:2/249: fdatasync d1/df/d1d/d20/d29/f52 0 2024-09-13T22:55:57.570 INFO:tasks.workunit.client.0.smithi002.stdout:5/49: creat d1/fe x:0 0 0 2024-09-13T22:55:57.570 INFO:tasks.workunit.client.0.smithi002.stdout:8/44: write d3/f8 [7875952,58941] 0 2024-09-13T22:55:57.573 INFO:tasks.workunit.client.0.smithi002.stdout:3/67: creat d9/df/d10/f1d x:0 0 0 2024-09-13T22:55:57.574 INFO:tasks.workunit.client.0.smithi002.stdout:1/113: mknod d1/d13/d1d/c1f 0 2024-09-13T22:55:57.575 INFO:tasks.workunit.client.0.smithi002.stdout:7/18: symlink l5 0 2024-09-13T22:55:57.575 INFO:tasks.workunit.client.1.smithi047.stdout:2/250: dwrite d1/de/d17/f1c [4194304,4194304] 0 2024-09-13T22:55:57.576 INFO:tasks.workunit.client.1.smithi047.stdout:2/251: fsync d1/df/d26/d4b/f50 0 2024-09-13T22:55:57.580 INFO:tasks.workunit.client.0.smithi002.stdout:7/19: dwrite f1 [0,4194304] 0 2024-09-13T22:55:57.582 INFO:tasks.workunit.client.0.smithi002.stdout:9/83: creat d8/d10/f1d x:0 0 0 2024-09-13T22:55:57.583 INFO:tasks.workunit.client.0.smithi002.stdout:5/50: symlink d1/lf 0 2024-09-13T22:55:57.584 INFO:tasks.workunit.client.0.smithi002.stdout:9/84: fsync d8/d10/f17 0 2024-09-13T22:55:57.584 INFO:tasks.workunit.client.1.smithi047.stdout:2/252: dwrite d1/de/f13 [0,4194304] 0 2024-09-13T22:55:57.586 INFO:tasks.workunit.client.0.smithi002.stdout:8/45: write d3/f5 [599931,38816] 0 2024-09-13T22:55:57.586 INFO:tasks.workunit.client.0.smithi002.stdout:9/85: chown d8/c14 419801083 1 2024-09-13T22:55:57.586 INFO:tasks.workunit.client.0.smithi002.stdout:9/86: fsync d8/ff 0 2024-09-13T22:55:57.587 INFO:tasks.workunit.client.0.smithi002.stdout:8/46: truncate d3/f8 8845123 0 2024-09-13T22:55:57.588 INFO:tasks.workunit.client.0.smithi002.stdout:8/47: read d3/f4 [7273838,3709] 0 2024-09-13T22:55:57.593 INFO:tasks.workunit.client.0.smithi002.stdout:8/48: dread d3/f6 [4194304,4194304] 0 2024-09-13T22:55:57.595 INFO:tasks.workunit.client.0.smithi002.stdout:8/49: write d3/f4 [6064838,22580] 0 2024-09-13T22:55:57.597 INFO:tasks.workunit.client.0.smithi002.stdout:7/20: creat f6 x:0 0 0 2024-09-13T22:55:57.599 INFO:tasks.workunit.client.0.smithi002.stdout:2/33: getdents d1/d7 0 2024-09-13T22:55:57.600 INFO:tasks.workunit.client.0.smithi002.stdout:0/63: chown d1/d4/fb 526 1 2024-09-13T22:55:57.601 INFO:tasks.workunit.client.0.smithi002.stdout:9/87: mkdir d8/d1e 0 2024-09-13T22:55:57.602 INFO:tasks.workunit.client.0.smithi002.stdout:0/64: chown d1/d2/c8 1860 1 2024-09-13T22:55:57.603 INFO:tasks.workunit.client.0.smithi002.stdout:6/79: write d12/f13 [102027,108377] 0 2024-09-13T22:55:57.604 INFO:tasks.workunit.client.0.smithi002.stdout:4/16: read d3/f4 [740601,106406] 0 2024-09-13T22:55:57.605 INFO:tasks.workunit.client.0.smithi002.stdout:7/21: creat f7 x:0 0 0 2024-09-13T22:55:57.606 INFO:tasks.workunit.client.0.smithi002.stdout:5/51: dwrite d1/f3 [0,4194304] 0 2024-09-13T22:55:57.606 INFO:tasks.workunit.client.0.smithi002.stdout:2/34: creat d1/f9 x:0 0 0 2024-09-13T22:55:57.607 INFO:tasks.workunit.client.0.smithi002.stdout:5/52: readlink d1/l7 0 2024-09-13T22:55:57.607 INFO:tasks.workunit.client.0.smithi002.stdout:2/35: readlink d1/l4 0 2024-09-13T22:55:57.608 INFO:tasks.workunit.client.0.smithi002.stdout:2/36: truncate d1/f5 725070 0 2024-09-13T22:55:57.609 INFO:tasks.workunit.client.1.smithi047.stdout:2/253: dwrite d1/de/f33 [0,4194304] 0 2024-09-13T22:55:57.610 INFO:tasks.workunit.client.0.smithi002.stdout:9/88: dread d8/d10/d1c/f15 [0,4194304] 0 2024-09-13T22:55:57.613 INFO:tasks.workunit.client.0.smithi002.stdout:1/114: rmdir d1/d1c/d1e 0 2024-09-13T22:55:57.615 INFO:tasks.workunit.client.1.smithi047.stdout:2/254: creat d1/df/d1d/d20/d37/f58 x:0 0 0 2024-09-13T22:55:57.615 INFO:tasks.workunit.client.1.smithi047.stdout:2/255: fsync d1/f24 0 2024-09-13T22:55:57.617 INFO:tasks.workunit.client.0.smithi002.stdout:2/37: dwrite d1/f5 [0,4194304] 0 2024-09-13T22:55:57.619 INFO:tasks.workunit.client.0.smithi002.stdout:4/17: symlink d3/l6 0 2024-09-13T22:55:57.621 INFO:tasks.workunit.client.0.smithi002.stdout:7/22: mkdir d8 0 2024-09-13T22:55:57.621 INFO:tasks.workunit.client.0.smithi002.stdout:4/18: chown d3/l6 76263794 1 2024-09-13T22:55:57.625 INFO:tasks.workunit.client.0.smithi002.stdout:3/68: getdents d9/df 0 2024-09-13T22:55:57.625 INFO:tasks.workunit.client.0.smithi002.stdout:0/65: dwrite d1/fa [0,4194304] 0 2024-09-13T22:55:57.625 INFO:tasks.workunit.client.0.smithi002.stdout:3/69: chown l2 2 1 2024-09-13T22:55:57.626 INFO:tasks.workunit.client.0.smithi002.stdout:0/66: fdatasync d1/d4/fe 0 2024-09-13T22:55:57.631 INFO:tasks.workunit.client.0.smithi002.stdout:1/115: symlink d1/d1c/l20 0 2024-09-13T22:55:57.632 INFO:tasks.workunit.client.0.smithi002.stdout:3/70: dread f3 [0,4194304] 0 2024-09-13T22:55:57.633 INFO:tasks.workunit.client.0.smithi002.stdout:8/50: truncate d3/f6 1234337 0 2024-09-13T22:55:57.633 INFO:tasks.workunit.client.1.smithi047.stdout:2/256: truncate d1/d16/d40/f4d 1730005 0 2024-09-13T22:55:57.633 INFO:tasks.workunit.client.0.smithi002.stdout:0/67: dread d1/d4/fe [0,4194304] 0 2024-09-13T22:55:57.634 INFO:tasks.workunit.client.0.smithi002.stdout:8/51: write d3/f5 [986206,98581] 0 2024-09-13T22:55:57.634 INFO:tasks.workunit.client.0.smithi002.stdout:5/53: write d1/f8 [3512510,19779] 0 2024-09-13T22:55:57.642 INFO:tasks.workunit.client.1.smithi047.stdout:2/257: dwrite d1/de/f4a [0,4194304] 0 2024-09-13T22:55:57.651 INFO:tasks.workunit.client.1.smithi047.stdout:2/258: symlink d1/df/d1d/d3c/l59 0 2024-09-13T22:55:57.654 INFO:tasks.workunit.client.0.smithi002.stdout:1/116: mkdir d1/d13/d21 0 2024-09-13T22:55:57.655 INFO:tasks.workunit.client.0.smithi002.stdout:4/19: write d3/f5 [2956056,43099] 0 2024-09-13T22:55:57.655 INFO:tasks.workunit.client.0.smithi002.stdout:6/80: write f5 [765648,91396] 0 2024-09-13T22:55:57.655 INFO:tasks.workunit.client.0.smithi002.stdout:3/71: unlink d9/df/d10/c19 0 2024-09-13T22:55:57.657 INFO:tasks.workunit.client.1.smithi047.stdout:2/259: rename d1/de/d17/f31 to d1/df/d26/d4b/f5a 0 2024-09-13T22:55:57.660 INFO:tasks.workunit.client.1.smithi047.stdout:2/260: creat d1/de/f5b x:0 0 0 2024-09-13T22:55:57.660 INFO:tasks.workunit.client.0.smithi002.stdout:3/72: dwrite d9/fb [0,4194304] 0 2024-09-13T22:55:57.662 INFO:tasks.workunit.client.0.smithi002.stdout:5/54: mkdir d1/d10 0 2024-09-13T22:55:57.663 INFO:tasks.workunit.client.0.smithi002.stdout:5/55: rename d1 to d1/d11 22 2024-09-13T22:55:57.664 INFO:tasks.workunit.client.0.smithi002.stdout:5/56: write d1/f8 [1957781,3016] 0 2024-09-13T22:55:57.664 INFO:tasks.workunit.client.0.smithi002.stdout:5/57: stat d1/l7 0 2024-09-13T22:55:57.665 INFO:tasks.workunit.client.0.smithi002.stdout:7/23: mkdir d8/d9 0 2024-09-13T22:55:57.666 INFO:tasks.workunit.client.1.smithi047.stdout:2/261: creat d1/df/d1d/d20/d54/f5c x:0 0 0 2024-09-13T22:55:57.667 INFO:tasks.workunit.client.1.smithi047.stdout:2/262: write d1/de/f33 [282085,95503] 0 2024-09-13T22:55:57.667 INFO:tasks.workunit.client.0.smithi002.stdout:2/38: truncate d1/f3 3575658 0 2024-09-13T22:55:57.669 INFO:tasks.workunit.client.1.smithi047.stdout:9/139: sync 2024-09-13T22:55:57.680 INFO:tasks.workunit.client.1.smithi047.stdout:9/140: creat d1/dc/d14/f29 x:0 0 0 2024-09-13T22:55:57.681 INFO:tasks.workunit.client.1.smithi047.stdout:2/263: getdents d1/df/d1d/d20/d37 0 2024-09-13T22:55:57.682 INFO:tasks.workunit.client.1.smithi047.stdout:2/264: read - d1/de/f5b zero size 2024-09-13T22:55:57.684 INFO:tasks.workunit.client.1.smithi047.stdout:9/141: creat d1/dc/f2a x:0 0 0 2024-09-13T22:55:57.686 INFO:tasks.workunit.client.1.smithi047.stdout:9/142: truncate d1/dc/f15 387798 0 2024-09-13T22:55:57.687 INFO:tasks.workunit.client.1.smithi047.stdout:9/143: dread - d1/dc/f2a zero size 2024-09-13T22:55:57.689 INFO:tasks.workunit.client.1.smithi047.stdout:2/265: dwrite d1/df/d1d/d20/d54/f5c [0,4194304] 0 2024-09-13T22:55:57.696 INFO:tasks.workunit.client.1.smithi047.stdout:9/144: dwrite d1/f24 [0,4194304] 0 2024-09-13T22:55:57.708 INFO:tasks.workunit.client.1.smithi047.stdout:9/145: link d1/dc/d14/dd/f1d d1/f2b 0 2024-09-13T22:55:57.713 INFO:tasks.workunit.client.1.smithi047.stdout:9/146: dread d1/dc/d14/f13 [0,4194304] 0 2024-09-13T22:55:57.715 INFO:tasks.workunit.client.1.smithi047.stdout:9/147: symlink d1/dc/d14/d20/l2c 0 2024-09-13T22:55:57.716 INFO:tasks.workunit.client.1.smithi047.stdout:9/148: dread d1/f25 [0,4194304] 0 2024-09-13T22:55:57.717 INFO:tasks.workunit.client.1.smithi047.stdout:9/149: write d1/f25 [470338,124869] 0 2024-09-13T22:55:57.718 INFO:tasks.workunit.client.1.smithi047.stdout:9/150: stat d1/dc/d14/f13 0 2024-09-13T22:55:57.720 INFO:tasks.workunit.client.1.smithi047.stdout:9/151: mkdir d1/d2d 0 2024-09-13T22:55:57.749 INFO:tasks.workunit.client.1.smithi047.stdout:9/152: write d1/dc/d14/f13 [373094,69133] 0 2024-09-13T22:55:57.749 INFO:tasks.workunit.client.1.smithi047.stdout:9/153: dread - d1/f1a zero size 2024-09-13T22:55:57.750 INFO:tasks.workunit.client.1.smithi047.stdout:9/154: chown d1/c23 13173210 1 2024-09-13T22:55:57.753 INFO:tasks.workunit.client.1.smithi047.stdout:9/155: mknod d1/dc/d14/c2e 0 2024-09-13T22:55:57.757 INFO:tasks.workunit.client.1.smithi047.stdout:9/156: creat d1/dc/d14/f2f x:0 0 0 2024-09-13T22:55:57.763 INFO:tasks.workunit.client.1.smithi047.stdout:9/157: dwrite d1/dc/d14/f17 [0,4194304] 0 2024-09-13T22:55:57.764 INFO:tasks.workunit.client.1.smithi047.stdout:9/158: chown d1/dc/d14/dd 29000633 1 2024-09-13T22:55:57.774 INFO:tasks.workunit.client.0.smithi002.stdout:3/73: sync 2024-09-13T22:55:57.774 INFO:tasks.workunit.client.0.smithi002.stdout:9/89: sync 2024-09-13T22:55:57.778 INFO:tasks.workunit.client.0.smithi002.stdout:3/74: dread f5 [0,4194304] 0 2024-09-13T22:55:57.781 INFO:tasks.workunit.client.1.smithi047.stdout:9/159: dread d1/dc/d14/dd/f1d [0,4194304] 0 2024-09-13T22:55:57.785 INFO:tasks.workunit.client.1.smithi047.stdout:9/160: dread d1/f24 [0,4194304] 0 2024-09-13T22:55:57.787 INFO:tasks.workunit.client.1.smithi047.stdout:9/161: write d1/dc/d14/f2f [634000,95087] 0 2024-09-13T22:55:57.790 INFO:tasks.workunit.client.1.smithi047.stdout:9/162: mknod d1/dc/d14/d20/c30 0 2024-09-13T22:55:57.794 INFO:tasks.workunit.client.1.smithi047.stdout:9/163: rename d1/dc/d14/f29 to d1/d2d/f31 0 2024-09-13T22:55:57.804 INFO:tasks.workunit.client.1.smithi047.stdout:9/164: link d1/c23 d1/c32 0 2024-09-13T22:55:57.808 INFO:tasks.workunit.client.1.smithi047.stdout:9/165: unlink d1/dc/d14/d20/c30 0 2024-09-13T22:55:57.809 INFO:tasks.workunit.client.1.smithi047.stdout:9/166: write d1/f5 [2089049,76611] 0 2024-09-13T22:55:57.822 INFO:tasks.workunit.client.1.smithi047.stdout:9/167: dwrite d1/dc/d14/f17 [4194304,4194304] 0 2024-09-13T22:55:57.822 INFO:tasks.workunit.client.1.smithi047.stdout:9/168: chown d1/dc/f2a 1921 1 2024-09-13T22:55:57.826 INFO:tasks.workunit.client.1.smithi047.stdout:6/201: sync 2024-09-13T22:55:57.826 INFO:tasks.workunit.client.1.smithi047.stdout:5/126: sync 2024-09-13T22:55:57.826 INFO:tasks.workunit.client.1.smithi047.stdout:1/133: sync 2024-09-13T22:55:57.826 INFO:tasks.workunit.client.1.smithi047.stdout:7/184: sync 2024-09-13T22:55:57.826 INFO:tasks.workunit.client.1.smithi047.stdout:0/202: sync 2024-09-13T22:55:57.826 INFO:tasks.workunit.client.1.smithi047.stdout:8/188: sync 2024-09-13T22:55:57.826 INFO:tasks.workunit.client.1.smithi047.stdout:4/147: sync 2024-09-13T22:55:57.827 INFO:tasks.workunit.client.1.smithi047.stdout:3/262: sync 2024-09-13T22:55:57.829 INFO:tasks.workunit.client.1.smithi047.stdout:5/127: chown d19/l2d 3 1 2024-09-13T22:55:57.830 INFO:tasks.workunit.client.1.smithi047.stdout:1/134: read - d0/d7/d10/f1f zero size 2024-09-13T22:55:57.831 INFO:tasks.workunit.client.1.smithi047.stdout:6/202: write d3/d11/d2b/d1c/f2e [40928,90109] 0 2024-09-13T22:55:57.832 INFO:tasks.workunit.client.1.smithi047.stdout:9/169: dwrite d1/dc/f2a [0,4194304] 0 2024-09-13T22:55:57.834 INFO:tasks.workunit.client.1.smithi047.stdout:9/170: stat d1/dc/d14/f17 0 2024-09-13T22:55:57.835 INFO:tasks.workunit.client.1.smithi047.stdout:9/171: read - d1/f1a zero size 2024-09-13T22:55:57.841 INFO:tasks.workunit.client.1.smithi047.stdout:1/135: dwrite d0/d7/f12 [0,4194304] 0 2024-09-13T22:55:57.842 INFO:tasks.workunit.client.1.smithi047.stdout:3/263: mkdir d0/d25/d44/d5a 0 2024-09-13T22:55:57.842 INFO:tasks.workunit.client.1.smithi047.stdout:7/185: creat d0/d7/f3d x:0 0 0 2024-09-13T22:55:57.843 INFO:tasks.workunit.client.1.smithi047.stdout:3/264: stat d0/d3/d4/d16/d2c/de 0 2024-09-13T22:55:57.845 INFO:tasks.workunit.client.1.smithi047.stdout:7/186: chown d0/d7/da/d1e/f22 1173 1 2024-09-13T22:55:57.849 INFO:tasks.workunit.client.1.smithi047.stdout:4/148: mknod dc/de/d17/d25/c2d 0 2024-09-13T22:55:57.850 INFO:tasks.workunit.client.1.smithi047.stdout:4/149: chown dc/de/c12 8416769 1 2024-09-13T22:55:57.851 INFO:tasks.workunit.client.1.smithi047.stdout:4/150: write dc/de/f14 [85035,71689] 0 2024-09-13T22:55:57.853 INFO:tasks.workunit.client.1.smithi047.stdout:5/128: creat d19/f35 x:0 0 0 2024-09-13T22:55:57.862 INFO:tasks.workunit.client.1.smithi047.stdout:2/266: sync 2024-09-13T22:55:57.863 INFO:tasks.workunit.client.1.smithi047.stdout:2/267: chown d1/de/l47 40 1 2024-09-13T22:55:57.863 INFO:tasks.workunit.client.1.smithi047.stdout:2/268: chown d1/f1a 0 1 2024-09-13T22:55:57.864 INFO:tasks.workunit.client.1.smithi047.stdout:2/269: write d1/de/f25 [1736835,33324] 0 2024-09-13T22:55:57.868 INFO:tasks.workunit.client.1.smithi047.stdout:7/187: creat d0/d7/f3e x:0 0 0 2024-09-13T22:55:57.869 INFO:tasks.workunit.client.1.smithi047.stdout:2/270: dread d1/de/f46 [0,4194304] 0 2024-09-13T22:55:57.870 INFO:tasks.workunit.client.1.smithi047.stdout:7/188: chown d0/d19/f1c 80594 1 2024-09-13T22:55:57.872 INFO:tasks.workunit.client.1.smithi047.stdout:3/265: dwrite d0/d3/d4/d16/d2c/de/d1f/d3b/f51 [0,4194304] 0 2024-09-13T22:55:57.873 INFO:tasks.workunit.client.1.smithi047.stdout:8/189: symlink d8/l42 0 2024-09-13T22:55:57.875 INFO:tasks.workunit.client.1.smithi047.stdout:8/190: write d8/f21 [6402335,95283] 0 2024-09-13T22:55:57.877 INFO:tasks.workunit.client.1.smithi047.stdout:4/151: mknod dc/de/c2e 0 2024-09-13T22:55:57.878 INFO:tasks.workunit.client.1.smithi047.stdout:4/152: fsync dc/de/f26 0 2024-09-13T22:55:57.880 INFO:tasks.workunit.client.1.smithi047.stdout:4/153: write dc/de/f16 [408176,93940] 0 2024-09-13T22:55:57.880 INFO:tasks.workunit.client.1.smithi047.stdout:5/129: creat d19/f36 x:0 0 0 2024-09-13T22:55:57.881 INFO:tasks.workunit.client.1.smithi047.stdout:5/130: write f10 [1654437,128357] 0 2024-09-13T22:55:57.885 INFO:tasks.workunit.client.1.smithi047.stdout:4/154: dread f4 [0,4194304] 0 2024-09-13T22:55:57.887 INFO:tasks.workunit.client.1.smithi047.stdout:9/172: link d1/d2d/f31 d1/dc/d18/f33 0 2024-09-13T22:55:57.888 INFO:tasks.workunit.client.1.smithi047.stdout:9/173: write d1/dc/d14/f17 [1046528,94383] 0 2024-09-13T22:55:57.889 INFO:tasks.workunit.client.1.smithi047.stdout:1/136: mknod d0/d7/c22 0 2024-09-13T22:55:57.896 INFO:tasks.workunit.client.1.smithi047.stdout:1/137: dwrite d0/d7/d10/f1f [0,4194304] 0 2024-09-13T22:55:57.901 INFO:tasks.workunit.client.1.smithi047.stdout:2/271: rename d1/d16/l3d to d1/d16/d40/l5d 0 2024-09-13T22:55:57.902 INFO:tasks.workunit.client.1.smithi047.stdout:2/272: write d1/f24 [4609766,106689] 0 2024-09-13T22:55:57.903 INFO:tasks.workunit.client.1.smithi047.stdout:7/189: creat d0/d19/f3f x:0 0 0 2024-09-13T22:55:57.904 INFO:tasks.workunit.client.1.smithi047.stdout:7/190: readlink d0/d7/da/l23 0 2024-09-13T22:55:57.904 INFO:tasks.workunit.client.1.smithi047.stdout:1/138: dread d0/d7/f12 [0,4194304] 0 2024-09-13T22:55:57.904 INFO:tasks.workunit.client.1.smithi047.stdout:2/273: chown d1/de/f13 53 1 2024-09-13T22:55:57.906 INFO:tasks.workunit.client.1.smithi047.stdout:3/266: mkdir d0/d3/d4/d16/d1c/d5b 0 2024-09-13T22:55:57.906 INFO:tasks.workunit.client.1.smithi047.stdout:1/139: fdatasync d0/f20 0 2024-09-13T22:55:57.906 INFO:tasks.workunit.client.1.smithi047.stdout:3/267: chown d0/d3/f33 32748 1 2024-09-13T22:55:57.910 INFO:tasks.workunit.client.1.smithi047.stdout:8/191: write d8/f32 [701265,20952] 0 2024-09-13T22:55:57.915 INFO:tasks.workunit.client.1.smithi047.stdout:0/203: write d1/f4 [1156779,80105] 0 2024-09-13T22:55:57.917 INFO:tasks.workunit.client.1.smithi047.stdout:6/203: creat d3/f42 x:0 0 0 2024-09-13T22:55:57.922 INFO:tasks.workunit.client.1.smithi047.stdout:9/174: stat d1/c23 0 2024-09-13T22:55:57.931 INFO:tasks.workunit.client.1.smithi047.stdout:5/131: rename c16 to d19/d23/d2e/c37 0 2024-09-13T22:55:57.931 INFO:tasks.workunit.client.1.smithi047.stdout:5/132: chown f10 184 1 2024-09-13T22:55:57.932 INFO:tasks.workunit.client.1.smithi047.stdout:5/133: dread - d19/d25/f2b zero size 2024-09-13T22:55:57.933 INFO:tasks.workunit.client.1.smithi047.stdout:7/191: mknod d0/d7/da/d2e/c40 0 2024-09-13T22:55:57.934 INFO:tasks.workunit.client.1.smithi047.stdout:7/192: chown d0/d7/f17 972712 1 2024-09-13T22:55:57.936 INFO:tasks.workunit.client.1.smithi047.stdout:2/274: mkdir d1/df/d1d/d2e/d5e 0 2024-09-13T22:55:57.939 INFO:tasks.workunit.client.1.smithi047.stdout:3/268: creat d0/f5c x:0 0 0 2024-09-13T22:55:57.941 INFO:tasks.workunit.client.1.smithi047.stdout:8/192: unlink d8/f2d 0 2024-09-13T22:55:57.946 INFO:tasks.workunit.client.1.smithi047.stdout:6/204: symlink d3/d11/l43 0 2024-09-13T22:55:57.951 INFO:tasks.workunit.client.1.smithi047.stdout:5/134: creat d19/d25/f38 x:0 0 0 2024-09-13T22:55:57.952 INFO:tasks.workunit.client.1.smithi047.stdout:5/135: truncate d19/d25/f2b 915693 0 2024-09-13T22:55:57.952 INFO:tasks.workunit.client.1.smithi047.stdout:5/136: readlink d19/d23/d2e/l31 0 2024-09-13T22:55:57.959 INFO:tasks.workunit.client.1.smithi047.stdout:7/193: dread d0/d7/f6 [0,4194304] 0 2024-09-13T22:55:57.959 INFO:tasks.workunit.client.1.smithi047.stdout:3/269: symlink d0/d3/d4/d16/d2c/de/d1f/d2e/l5d 0 2024-09-13T22:55:57.960 INFO:tasks.workunit.client.1.smithi047.stdout:3/270: chown d0/d3/d4/d16/d32/d42 3071 1 2024-09-13T22:55:57.965 INFO:tasks.workunit.client.1.smithi047.stdout:4/155: creat dc/f2f x:0 0 0 2024-09-13T22:55:57.966 INFO:tasks.workunit.client.1.smithi047.stdout:4/156: read f6 [853706,63706] 0 2024-09-13T22:55:57.967 INFO:tasks.workunit.client.1.smithi047.stdout:5/137: creat d19/f39 x:0 0 0 2024-09-13T22:55:57.968 INFO:tasks.workunit.client.1.smithi047.stdout:3/271: dwrite d0/d3/d4/d16/d2c/de/d1f/f37 [0,4194304] 0 2024-09-13T22:55:57.970 INFO:tasks.workunit.client.1.smithi047.stdout:2/275: symlink d1/l5f 0 2024-09-13T22:55:57.973 INFO:tasks.workunit.client.1.smithi047.stdout:1/140: link d0/c4 d0/d1d/c23 0 2024-09-13T22:55:57.974 INFO:tasks.workunit.client.1.smithi047.stdout:3/272: write d0/d3/d4/d16/d2c/de/d3d/f50 [3954111,104604] 0 2024-09-13T22:55:57.977 INFO:tasks.workunit.client.1.smithi047.stdout:4/157: dwrite dc/f2f [0,4194304] 0 2024-09-13T22:55:57.978 INFO:tasks.workunit.client.1.smithi047.stdout:3/273: write d0/d3/d4/d16/d2c/de/f28 [5012093,52542] 0 2024-09-13T22:55:57.981 INFO:tasks.workunit.client.1.smithi047.stdout:3/274: write d0/d3/d4/f4c [347479,126353] 0 2024-09-13T22:55:57.983 INFO:tasks.workunit.client.1.smithi047.stdout:5/138: creat d19/d23/f3a x:0 0 0 2024-09-13T22:55:57.983 INFO:tasks.workunit.client.1.smithi047.stdout:1/141: dread d0/d7/d10/f1f [0,4194304] 0 2024-09-13T22:55:57.985 INFO:tasks.workunit.client.1.smithi047.stdout:5/139: write d19/f1d [814147,44918] 0 2024-09-13T22:55:57.989 INFO:tasks.workunit.client.1.smithi047.stdout:2/276: symlink d1/de/d17/l60 0 2024-09-13T22:55:57.996 INFO:tasks.workunit.client.1.smithi047.stdout:0/204: dwrite d1/d7/f3e [0,4194304] 0 2024-09-13T22:55:57.998 INFO:tasks.workunit.client.1.smithi047.stdout:0/205: fdatasync d1/d7/fe 0 2024-09-13T22:55:58.003 INFO:tasks.workunit.client.1.smithi047.stdout:4/158: rename dc/de/d17/c20 to dc/de/d23/c30 0 2024-09-13T22:55:58.011 INFO:tasks.workunit.client.1.smithi047.stdout:5/140: rmdir d19/d23/d2e 39 2024-09-13T22:55:58.011 INFO:tasks.workunit.client.1.smithi047.stdout:5/141: readlink d19/l1b 0 2024-09-13T22:55:58.013 INFO:tasks.workunit.client.1.smithi047.stdout:2/277: rmdir d1/df/d26/d4b 39 2024-09-13T22:55:58.018 INFO:tasks.workunit.client.1.smithi047.stdout:5/142: dwrite d19/f1c [0,4194304] 0 2024-09-13T22:55:58.019 INFO:tasks.workunit.client.1.smithi047.stdout:5/143: write f10 [465028,69474] 0 2024-09-13T22:55:58.021 INFO:tasks.workunit.client.1.smithi047.stdout:0/206: mknod d1/d7/c49 0 2024-09-13T22:55:58.021 INFO:tasks.workunit.client.1.smithi047.stdout:5/144: read d19/d23/f29 [986059,122001] 0 2024-09-13T22:55:58.022 INFO:tasks.workunit.client.1.smithi047.stdout:5/145: truncate d19/f36 1023780 0 2024-09-13T22:55:58.023 INFO:tasks.workunit.client.1.smithi047.stdout:4/159: mknod dc/de/d17/d25/c31 0 2024-09-13T22:55:58.026 INFO:tasks.workunit.client.1.smithi047.stdout:3/275: truncate d0/d3/f15 1507493 0 2024-09-13T22:55:58.027 INFO:tasks.workunit.client.1.smithi047.stdout:0/207: dread d1/d5/d16/f3c [0,4194304] 0 2024-09-13T22:55:58.028 INFO:tasks.workunit.client.1.smithi047.stdout:0/208: readlink d1/d5/d16/d23/d2d/l39 0 2024-09-13T22:55:58.029 INFO:tasks.workunit.client.1.smithi047.stdout:1/142: mknod d0/d7/d13/d1b/c24 0 2024-09-13T22:55:58.031 INFO:tasks.workunit.client.1.smithi047.stdout:0/209: dread d1/d5/d16/f3c [0,4194304] 0 2024-09-13T22:55:58.031 INFO:tasks.workunit.client.1.smithi047.stdout:0/210: fdatasync d1/f40 0 2024-09-13T22:55:58.034 INFO:tasks.workunit.client.1.smithi047.stdout:1/143: dread d0/d7/d14/f18 [0,4194304] 0 2024-09-13T22:55:58.037 INFO:tasks.workunit.client.1.smithi047.stdout:7/194: truncate d0/f20 3042053 0 2024-09-13T22:55:58.040 INFO:tasks.workunit.client.1.smithi047.stdout:0/211: dwrite d1/f40 [0,4194304] 0 2024-09-13T22:55:58.043 INFO:tasks.workunit.client.1.smithi047.stdout:0/212: fsync d1/d5/f24 0 2024-09-13T22:55:58.046 INFO:tasks.workunit.client.1.smithi047.stdout:5/146: creat d19/d25/f3b x:0 0 0 2024-09-13T22:55:58.049 INFO:tasks.workunit.client.1.smithi047.stdout:1/144: dwrite d0/d7/d14/f18 [0,4194304] 0 2024-09-13T22:55:58.050 INFO:tasks.workunit.client.1.smithi047.stdout:3/276: mkdir d0/d3/d5e 0 2024-09-13T22:55:58.051 INFO:tasks.workunit.client.1.smithi047.stdout:7/195: dwrite d0/d19/f3f [0,4194304] 0 2024-09-13T22:55:58.052 INFO:tasks.workunit.client.0.smithi002.stdout:6/81: mkdir d12/d16 0 2024-09-13T22:55:58.052 INFO:tasks.workunit.client.1.smithi047.stdout:3/277: stat d0/d3/d4/f9 0 2024-09-13T22:55:58.053 INFO:tasks.workunit.client.0.smithi002.stdout:6/82: write fa [1540926,21475] 0 2024-09-13T22:55:58.058 INFO:tasks.workunit.client.0.smithi002.stdout:4/20: symlink d3/l7 0 2024-09-13T22:55:58.058 INFO:tasks.workunit.client.0.smithi002.stdout:4/21: readlink d3/l6 0 2024-09-13T22:55:58.061 INFO:tasks.workunit.client.1.smithi047.stdout:7/196: dwrite d0/d7/da/f26 [0,4194304] 0 2024-09-13T22:55:58.061 INFO:tasks.workunit.client.0.smithi002.stdout:1/117: symlink d1/d13/l22 0 2024-09-13T22:55:58.062 INFO:tasks.workunit.client.1.smithi047.stdout:7/197: dread - d0/d7/f3e zero size 2024-09-13T22:55:58.063 INFO:tasks.workunit.client.0.smithi002.stdout:4/22: dread f2 [0,4194304] 0 2024-09-13T22:55:58.064 INFO:tasks.workunit.client.0.smithi002.stdout:4/23: rename d3 to d3/d8 22 2024-09-13T22:55:58.064 INFO:tasks.workunit.client.0.smithi002.stdout:4/24: stat d3/f5 0 2024-09-13T22:55:58.066 INFO:tasks.workunit.client.1.smithi047.stdout:1/145: fsync d0/d7/d14/f18 0 2024-09-13T22:55:58.068 INFO:tasks.workunit.client.1.smithi047.stdout:7/198: dread d0/f29 [0,4194304] 0 2024-09-13T22:55:58.069 INFO:tasks.workunit.client.1.smithi047.stdout:7/199: write d0/db/f16 [886374,103693] 0 2024-09-13T22:55:58.073 INFO:tasks.workunit.client.1.smithi047.stdout:4/160: mknod dc/de/d17/c32 0 2024-09-13T22:55:58.091 INFO:tasks.workunit.client.0.smithi002.stdout:6/83: rename d12/d16 to d12/d17 0 2024-09-13T22:55:58.094 INFO:tasks.workunit.client.1.smithi047.stdout:7/200: rename d0/l31 to d0/d7/da/l41 0 2024-09-13T22:55:58.097 INFO:tasks.workunit.client.1.smithi047.stdout:5/147: mknod d19/d23/d32/c3c 0 2024-09-13T22:55:58.100 INFO:tasks.workunit.client.1.smithi047.stdout:0/213: creat d1/d5/d16/d47/f4a x:0 0 0 2024-09-13T22:55:58.104 INFO:tasks.workunit.client.0.smithi002.stdout:7/24: link f7 d8/fa 0 2024-09-13T22:55:58.104 INFO:tasks.workunit.client.0.smithi002.stdout:7/25: dread - f7 zero size 2024-09-13T22:55:58.105 INFO:tasks.workunit.client.0.smithi002.stdout:7/26: write f4 [1090034,110388] 0 2024-09-13T22:55:58.107 INFO:tasks.workunit.client.1.smithi047.stdout:2/278: getdents d1/df/d1d 0 2024-09-13T22:55:58.110 INFO:tasks.workunit.client.0.smithi002.stdout:9/90: mknod d8/d10/c1f 0 2024-09-13T22:55:58.111 INFO:tasks.workunit.client.1.smithi047.stdout:1/146: write d0/d7/d10/f1f [55799,17798] 0 2024-09-13T22:55:58.114 INFO:tasks.workunit.client.1.smithi047.stdout:7/201: mknod d0/d19/c42 0 2024-09-13T22:55:58.115 INFO:tasks.workunit.client.1.smithi047.stdout:7/202: write d0/f33 [896086,58398] 0 2024-09-13T22:55:58.115 INFO:tasks.workunit.client.1.smithi047.stdout:4/161: mknod dc/d29/c33 0 2024-09-13T22:55:58.116 INFO:tasks.workunit.client.1.smithi047.stdout:7/203: chown d0/f1f 356812 1 2024-09-13T22:55:58.116 INFO:tasks.workunit.client.1.smithi047.stdout:4/162: write dc/de/f26 [1175789,4016] 0 2024-09-13T22:55:58.119 INFO:tasks.workunit.client.0.smithi002.stdout:6/84: creat d12/d17/f18 x:0 0 0 2024-09-13T22:55:58.121 INFO:tasks.workunit.client.1.smithi047.stdout:4/163: dread dc/de/f16 [0,4194304] 0 2024-09-13T22:55:58.121 INFO:tasks.workunit.client.1.smithi047.stdout:5/148: mknod d19/d34/c3d 0 2024-09-13T22:55:58.122 INFO:tasks.workunit.client.1.smithi047.stdout:3/278: truncate d0/d25/d44/f1e 2820912 0 2024-09-13T22:55:58.124 INFO:tasks.workunit.client.1.smithi047.stdout:7/204: dwrite d0/db/fc [0,4194304] 0 2024-09-13T22:55:58.128 INFO:tasks.workunit.client.0.smithi002.stdout:0/68: getdents d1/d2 0 2024-09-13T22:55:58.133 INFO:tasks.workunit.client.0.smithi002.stdout:3/75: truncate d9/d15/f14 1275871 0 2024-09-13T22:55:58.133 INFO:tasks.workunit.client.0.smithi002.stdout:8/52: getdents d3 0 2024-09-13T22:55:58.133 INFO:tasks.workunit.client.0.smithi002.stdout:3/76: read - d9/df/d10/f1d zero size 2024-09-13T22:55:58.136 INFO:tasks.workunit.client.1.smithi047.stdout:4/164: read fb [407904,130706] 0 2024-09-13T22:55:58.137 INFO:tasks.workunit.client.0.smithi002.stdout:1/118: write d1/d6/fa [920972,100052] 0 2024-09-13T22:55:58.139 INFO:tasks.workunit.client.1.smithi047.stdout:5/149: unlink d19/f1e 0 2024-09-13T22:55:58.141 INFO:tasks.workunit.client.1.smithi047.stdout:3/279: unlink d0/c29 0 2024-09-13T22:55:58.143 INFO:tasks.workunit.client.1.smithi047.stdout:4/165: dwrite dc/f2f [4194304,4194304] 0 2024-09-13T22:55:58.144 INFO:tasks.workunit.client.0.smithi002.stdout:7/27: creat d8/fb x:0 0 0 2024-09-13T22:55:58.146 INFO:tasks.workunit.client.1.smithi047.stdout:0/214: rename d1/d5/d16/d23/f2a to d1/d7/f4b 0 2024-09-13T22:55:58.146 INFO:tasks.workunit.client.0.smithi002.stdout:2/39: link l0 d1/la 0 2024-09-13T22:55:58.148 INFO:tasks.workunit.client.1.smithi047.stdout:7/205: unlink d0/d7/da/f11 0 2024-09-13T22:55:58.149 INFO:tasks.workunit.client.0.smithi002.stdout:4/25: sync 2024-09-13T22:55:58.150 INFO:tasks.workunit.client.1.smithi047.stdout:7/206: truncate d0/f28 1022691 0 2024-09-13T22:55:58.152 INFO:tasks.workunit.client.1.smithi047.stdout:0/215: dread d1/d5/d16/d23/d2d/f31 [0,4194304] 0 2024-09-13T22:55:58.152 INFO:tasks.workunit.client.1.smithi047.stdout:0/216: stat d1/d7/f1d 0 2024-09-13T22:55:58.153 INFO:tasks.workunit.client.0.smithi002.stdout:6/85: creat d12/d17/f19 x:0 0 0 2024-09-13T22:55:58.157 INFO:tasks.workunit.client.0.smithi002.stdout:0/69: creat d1/f17 x:0 0 0 2024-09-13T22:55:58.157 INFO:tasks.workunit.client.1.smithi047.stdout:5/150: rmdir d19/d23/d32 39 2024-09-13T22:55:58.158 INFO:tasks.workunit.client.0.smithi002.stdout:6/86: dwrite fa [0,4194304] 0 2024-09-13T22:55:58.159 INFO:tasks.workunit.client.1.smithi047.stdout:3/280: mknod d0/d25/d44/d43/c5f 0 2024-09-13T22:55:58.160 INFO:tasks.workunit.client.1.smithi047.stdout:3/281: chown d0/d3/d4/d16/d2c/de/d3d 829 1 2024-09-13T22:55:58.161 INFO:tasks.workunit.client.0.smithi002.stdout:3/77: mknod d9/df/c1e 0 2024-09-13T22:55:58.163 INFO:tasks.workunit.client.1.smithi047.stdout:4/166: symlink dc/de/d23/l34 0 2024-09-13T22:55:58.164 INFO:tasks.workunit.client.0.smithi002.stdout:5/58: getdents d1 0 2024-09-13T22:55:58.165 INFO:tasks.workunit.client.0.smithi002.stdout:6/87: dwrite f5 [0,4194304] 0 2024-09-13T22:55:58.165 INFO:tasks.workunit.client.1.smithi047.stdout:2/279: truncate d1/df/d1d/d20/d2b/f34 1934166 0 2024-09-13T22:55:58.169 INFO:tasks.workunit.client.1.smithi047.stdout:1/147: rename d0/d7/d13/d1b/c24 to d0/d7/db/c25 0 2024-09-13T22:55:58.169 INFO:tasks.workunit.client.1.smithi047.stdout:3/282: dwrite d0/d3/d4/d16/d2c/de/f17 [4194304,4194304] 0 2024-09-13T22:55:58.171 INFO:tasks.workunit.client.1.smithi047.stdout:1/148: write d0/d7/d10/f1f [4228506,96838] 0 2024-09-13T22:55:58.171 INFO:tasks.workunit.client.1.smithi047.stdout:3/283: dread - d0/f58 zero size 2024-09-13T22:55:58.172 INFO:tasks.workunit.client.0.smithi002.stdout:1/119: mknod d1/d13/c23 0 2024-09-13T22:55:58.177 INFO:tasks.workunit.client.0.smithi002.stdout:7/28: rename f4 to d8/fc 0 2024-09-13T22:55:58.179 INFO:tasks.workunit.client.0.smithi002.stdout:2/40: creat d1/d7/fb x:0 0 0 2024-09-13T22:55:58.179 INFO:tasks.workunit.client.0.smithi002.stdout:2/41: chown d1/l4 5 1 2024-09-13T22:55:58.180 INFO:tasks.workunit.client.0.smithi002.stdout:2/42: readlink l0 0 2024-09-13T22:55:58.181 INFO:tasks.workunit.client.1.smithi047.stdout:7/207: unlink d0/f2 0 2024-09-13T22:55:58.183 INFO:tasks.workunit.client.0.smithi002.stdout:4/26: write d3/f5 [3459379,11116] 0 2024-09-13T22:55:58.186 INFO:tasks.workunit.client.0.smithi002.stdout:2/43: dwrite d1/f2 [0,4194304] 0 2024-09-13T22:55:58.188 INFO:tasks.workunit.client.0.smithi002.stdout:4/27: dread f1 [0,4194304] 0 2024-09-13T22:55:58.198 INFO:tasks.workunit.client.1.smithi047.stdout:2/280: rmdir d1/df/d1d/d20 39 2024-09-13T22:55:58.198 INFO:tasks.workunit.client.1.smithi047.stdout:2/281: chown d1/l5f 10701 1 2024-09-13T22:55:58.202 INFO:tasks.workunit.client.1.smithi047.stdout:0/217: write d1/d7/f26 [108939,14742] 0 2024-09-13T22:55:58.204 INFO:tasks.workunit.client.0.smithi002.stdout:3/78: mknod d9/d15/c1f 0 2024-09-13T22:55:58.204 INFO:tasks.workunit.client.1.smithi047.stdout:0/218: truncate d1/d5/f10 635529 0 2024-09-13T22:55:58.205 INFO:tasks.workunit.client.1.smithi047.stdout:0/219: dread - d1/d5/d11/f20 zero size 2024-09-13T22:55:58.205 INFO:tasks.workunit.client.0.smithi002.stdout:3/79: read d9/df/d10/f12 [1347152,103810] 0 2024-09-13T22:55:58.206 INFO:tasks.workunit.client.0.smithi002.stdout:3/80: chown d9/fe 1860352 1 2024-09-13T22:55:58.207 INFO:tasks.workunit.client.0.smithi002.stdout:5/59: creat d1/f12 x:0 0 0 2024-09-13T22:55:58.207 INFO:tasks.workunit.client.0.smithi002.stdout:5/60: stat d1/lb 0 2024-09-13T22:55:58.208 INFO:tasks.workunit.client.0.smithi002.stdout:9/91: dwrite d8/fe [0,4194304] 0 2024-09-13T22:55:58.210 INFO:tasks.workunit.client.0.smithi002.stdout:6/88: unlink c7 0 2024-09-13T22:55:58.210 INFO:tasks.workunit.client.0.smithi002.stdout:6/89: readlink lf 0 2024-09-13T22:55:58.211 INFO:tasks.workunit.client.0.smithi002.stdout:6/90: write fa [3470135,35709] 0 2024-09-13T22:55:58.211 INFO:tasks.workunit.client.0.smithi002.stdout:6/91: truncate d12/f13 668201 0 2024-09-13T22:55:58.213 INFO:tasks.workunit.client.0.smithi002.stdout:1/120: creat d1/f24 x:0 0 0 2024-09-13T22:55:58.219 INFO:tasks.workunit.client.0.smithi002.stdout:1/121: dwrite d1/f7 [4194304,4194304] 0 2024-09-13T22:55:58.220 INFO:tasks.workunit.client.1.smithi047.stdout:3/284: write d0/d3/d4/d16/d2c/de/f10 [655665,12141] 0 2024-09-13T22:55:58.224 INFO:tasks.workunit.client.0.smithi002.stdout:4/28: unlink d3/l7 0 2024-09-13T22:55:58.231 INFO:tasks.workunit.client.1.smithi047.stdout:4/167: truncate dc/fd 3689938 0 2024-09-13T22:55:58.233 INFO:tasks.workunit.client.0.smithi002.stdout:5/61: creat d1/f13 x:0 0 0 2024-09-13T22:55:58.233 INFO:tasks.workunit.client.0.smithi002.stdout:5/62: fdatasync d1/fe 0 2024-09-13T22:55:58.234 INFO:tasks.workunit.client.0.smithi002.stdout:1/122: fsync d1/f7 0 2024-09-13T22:55:58.234 INFO:tasks.workunit.client.0.smithi002.stdout:5/63: stat d1/lb 0 2024-09-13T22:55:58.235 INFO:tasks.workunit.client.0.smithi002.stdout:9/92: mknod d8/c20 0 2024-09-13T22:55:58.235 INFO:tasks.workunit.client.0.smithi002.stdout:5/64: fsync d1/f3 0 2024-09-13T22:55:58.236 INFO:tasks.workunit.client.0.smithi002.stdout:3/81: write f3 [4248712,64471] 0 2024-09-13T22:55:58.236 INFO:tasks.workunit.client.0.smithi002.stdout:3/82: chown d9/df/d10 4755 1 2024-09-13T22:55:58.236 INFO:tasks.workunit.client.0.smithi002.stdout:3/83: readlink l2 0 2024-09-13T22:55:58.237 INFO:tasks.workunit.client.0.smithi002.stdout:9/93: write d8/fe [4430313,120744] 0 2024-09-13T22:55:58.238 INFO:tasks.workunit.client.1.smithi047.stdout:3/285: rmdir d0/d25/d44 39 2024-09-13T22:55:58.241 INFO:tasks.workunit.client.0.smithi002.stdout:6/92: rename l4 to d12/d17/l1a 0 2024-09-13T22:55:58.242 INFO:tasks.workunit.client.0.smithi002.stdout:6/93: truncate d12/d17/f18 45716 0 2024-09-13T22:55:58.242 INFO:tasks.workunit.client.0.smithi002.stdout:6/94: chown f5 9087813 1 2024-09-13T22:55:58.244 INFO:tasks.workunit.client.0.smithi002.stdout:7/29: creat d8/d9/fd x:0 0 0 2024-09-13T22:55:58.250 INFO:tasks.workunit.client.1.smithi047.stdout:4/168: creat dc/d29/f35 x:0 0 0 2024-09-13T22:55:58.251 INFO:tasks.workunit.client.0.smithi002.stdout:8/53: link d3/f8 d3/fa 0 2024-09-13T22:55:58.251 INFO:tasks.workunit.client.0.smithi002.stdout:8/54: readlink - no filename 2024-09-13T22:55:58.251 INFO:tasks.workunit.client.1.smithi047.stdout:4/169: dread fb [0,4194304] 0 2024-09-13T22:55:58.253 INFO:tasks.workunit.client.1.smithi047.stdout:3/286: truncate d0/d3/d4/d16/d1c/f2d 1202591 0 2024-09-13T22:55:58.254 INFO:tasks.workunit.client.1.smithi047.stdout:5/151: link d19/d34/c3d d19/d23/d32/c3e 0 2024-09-13T22:55:58.255 INFO:tasks.workunit.client.0.smithi002.stdout:4/29: dwrite d3/f5 [0,4194304] 0 2024-09-13T22:55:58.257 INFO:tasks.workunit.client.1.smithi047.stdout:2/282: symlink d1/df/d1d/d20/d29/l61 0 2024-09-13T22:55:58.258 INFO:tasks.workunit.client.0.smithi002.stdout:1/123: creat d1/d13/d1d/f25 x:0 0 0 2024-09-13T22:55:58.259 INFO:tasks.workunit.client.1.smithi047.stdout:5/152: dread d19/f1c [0,4194304] 0 2024-09-13T22:55:58.259 INFO:tasks.workunit.client.1.smithi047.stdout:0/220: rename d1/d5/d11/d2f/l3d to d1/l4c 0 2024-09-13T22:55:58.261 INFO:tasks.workunit.client.0.smithi002.stdout:1/124: dread d1/d6/fa [0,4194304] 0 2024-09-13T22:55:58.262 INFO:tasks.workunit.client.1.smithi047.stdout:1/149: getdents d0/d7/d14 0 2024-09-13T22:55:58.262 INFO:tasks.workunit.client.0.smithi002.stdout:1/125: truncate d1/d13/d1d/f25 801823 0 2024-09-13T22:55:58.263 INFO:tasks.workunit.client.1.smithi047.stdout:1/150: chown d0/le 72 1 2024-09-13T22:55:58.263 INFO:tasks.workunit.client.0.smithi002.stdout:1/126: write d1/f15 [288643,129532] 0 2024-09-13T22:55:58.264 INFO:tasks.workunit.client.1.smithi047.stdout:7/208: creat d0/d7/da/d2e/d37/f43 x:0 0 0 2024-09-13T22:55:58.265 INFO:tasks.workunit.client.0.smithi002.stdout:3/84: fsync f5 0 2024-09-13T22:55:58.268 INFO:tasks.workunit.client.0.smithi002.stdout:9/94: unlink d8/d10/f1d 0 2024-09-13T22:55:58.269 INFO:tasks.workunit.client.0.smithi002.stdout:9/95: fsync d8/fe 0 2024-09-13T22:55:58.270 INFO:tasks.workunit.client.0.smithi002.stdout:1/127: dwrite d1/f15 [0,4194304] 0 2024-09-13T22:55:58.272 INFO:tasks.workunit.client.0.smithi002.stdout:7/30: unlink d8/fa 0 2024-09-13T22:55:58.273 INFO:tasks.workunit.client.1.smithi047.stdout:2/283: symlink d1/df/d1d/d20/d37/l62 0 2024-09-13T22:55:58.273 INFO:tasks.workunit.client.0.smithi002.stdout:9/96: dread d8/ff [0,4194304] 0 2024-09-13T22:55:58.274 INFO:tasks.workunit.client.0.smithi002.stdout:8/55: mknod d3/cb 0 2024-09-13T22:55:58.275 INFO:tasks.workunit.client.1.smithi047.stdout:5/153: chown d19/d23/d2e 768 1 2024-09-13T22:55:58.277 INFO:tasks.workunit.client.1.smithi047.stdout:5/154: chown d19/d25/f2b 21 1 2024-09-13T22:55:58.278 INFO:tasks.workunit.client.1.smithi047.stdout:5/155: read d19/f1d [2446449,72179] 0 2024-09-13T22:55:58.279 INFO:tasks.workunit.client.0.smithi002.stdout:7/31: dwrite d8/d9/fd [0,4194304] 0 2024-09-13T22:55:58.279 INFO:tasks.workunit.client.0.smithi002.stdout:7/32: readlink l5 0 2024-09-13T22:55:58.283 INFO:tasks.workunit.client.1.smithi047.stdout:1/151: creat d0/d7/d14/f26 x:0 0 0 2024-09-13T22:55:58.286 INFO:tasks.workunit.client.1.smithi047.stdout:7/209: creat d0/d7/da/d2e/f44 x:0 0 0 2024-09-13T22:55:58.287 INFO:tasks.workunit.client.1.smithi047.stdout:7/210: chown d0/db/f3b 0 1 2024-09-13T22:55:58.292 INFO:tasks.workunit.client.0.smithi002.stdout:1/128: fdatasync d1/f15 0 2024-09-13T22:55:58.293 INFO:tasks.workunit.client.1.smithi047.stdout:2/284: creat d1/de/f63 x:0 0 0 2024-09-13T22:55:58.293 INFO:tasks.workunit.client.0.smithi002.stdout:1/129: chown d1/f9 0 1 2024-09-13T22:55:58.295 INFO:tasks.workunit.client.0.smithi002.stdout:6/95: rename d12/d17/l1a to d12/d17/l1b 0 2024-09-13T22:55:58.296 INFO:tasks.workunit.client.1.smithi047.stdout:2/285: dread d1/de/f4a [0,4194304] 0 2024-09-13T22:55:58.299 INFO:tasks.workunit.client.0.smithi002.stdout:0/70: sync 2024-09-13T22:55:58.299 INFO:tasks.workunit.client.0.smithi002.stdout:2/44: sync 2024-09-13T22:55:58.300 INFO:tasks.workunit.client.0.smithi002.stdout:2/45: readlink d1/la 0 2024-09-13T22:55:58.301 INFO:tasks.workunit.client.0.smithi002.stdout:6/96: dwrite f1 [0,4194304] 0 2024-09-13T22:55:58.302 INFO:tasks.workunit.client.0.smithi002.stdout:2/46: chown d1/d7/d8 4 1 2024-09-13T22:55:58.303 INFO:tasks.workunit.client.1.smithi047.stdout:5/156: rename d19/d25/f3b to d19/d25/f3f 0 2024-09-13T22:55:58.303 INFO:tasks.workunit.client.1.smithi047.stdout:1/152: creat d0/d7/d14/f27 x:0 0 0 2024-09-13T22:55:58.303 INFO:tasks.workunit.client.1.smithi047.stdout:1/153: chown d0/d7/f12 7292972 1 2024-09-13T22:55:58.303 INFO:tasks.workunit.client.0.smithi002.stdout:8/56: mkdir d3/dc 0 2024-09-13T22:55:58.304 INFO:tasks.workunit.client.1.smithi047.stdout:7/211: truncate d0/d19/f1c 1669458 0 2024-09-13T22:55:58.304 INFO:tasks.workunit.client.0.smithi002.stdout:4/30: dwrite d3/f4 [0,4194304] 0 2024-09-13T22:55:58.304 INFO:tasks.workunit.client.1.smithi047.stdout:1/154: write d0/d7/d10/f1f [563923,96774] 0 2024-09-13T22:55:58.305 INFO:tasks.workunit.client.1.smithi047.stdout:1/155: chown d0/d7 28 1 2024-09-13T22:55:58.306 INFO:tasks.workunit.client.1.smithi047.stdout:7/212: write d0/d7/da/d2e/d37/f43 [263747,4191] 0 2024-09-13T22:55:58.308 INFO:tasks.workunit.client.0.smithi002.stdout:7/33: dread - f7 zero size 2024-09-13T22:55:58.310 INFO:tasks.workunit.client.1.smithi047.stdout:3/287: link d0/d3/d4/d16/d2c/de/d3d/f50 d0/d25/d44/f60 0 2024-09-13T22:55:58.311 INFO:tasks.workunit.client.1.smithi047.stdout:4/170: dwrite dc/de/d17/f28 [0,4194304] 0 2024-09-13T22:55:58.315 INFO:tasks.workunit.client.0.smithi002.stdout:4/31: dwrite d3/f4 [0,4194304] 0 2024-09-13T22:55:58.316 INFO:tasks.workunit.client.1.smithi047.stdout:0/221: write d1/d5/d16/d23/f42 [950885,33352] 0 2024-09-13T22:55:58.317 INFO:tasks.workunit.client.0.smithi002.stdout:3/85: dwrite d9/f16 [0,4194304] 0 2024-09-13T22:55:58.317 INFO:tasks.workunit.client.0.smithi002.stdout:4/32: chown f1 5675 1 2024-09-13T22:55:58.321 INFO:tasks.workunit.client.1.smithi047.stdout:2/286: creat d1/d16/f64 x:0 0 0 2024-09-13T22:55:58.325 INFO:tasks.workunit.client.0.smithi002.stdout:1/130: creat d1/d1c/f26 x:0 0 0 2024-09-13T22:55:58.337 INFO:tasks.workunit.client.0.smithi002.stdout:8/57: rmdir d3 39 2024-09-13T22:55:58.337 INFO:tasks.workunit.client.1.smithi047.stdout:1/156: mkdir d0/d7/d14/d28 0 2024-09-13T22:55:58.337 INFO:tasks.workunit.client.1.smithi047.stdout:7/213: rename d0/f28 to d0/d19/d32/f45 0 2024-09-13T22:55:58.337 INFO:tasks.workunit.client.1.smithi047.stdout:7/214: chown d0/f1f 55919 1 2024-09-13T22:55:58.338 INFO:tasks.workunit.client.1.smithi047.stdout:9/175: sync 2024-09-13T22:55:58.339 INFO:tasks.workunit.client.0.smithi002.stdout:2/47: rename l0 to d1/d7/d8/lc 0 2024-09-13T22:55:58.339 INFO:tasks.workunit.client.0.smithi002.stdout:2/48: dread - d1/d7/fb zero size 2024-09-13T22:55:58.340 INFO:tasks.workunit.client.0.smithi002.stdout:2/49: truncate d1/f9 664750 0 2024-09-13T22:55:58.341 INFO:tasks.workunit.client.0.smithi002.stdout:2/50: write d1/f2 [5300452,5496] 0 2024-09-13T22:55:58.342 INFO:tasks.workunit.client.1.smithi047.stdout:3/288: rmdir d0/d3/d4/d16/d32/d42 39 2024-09-13T22:55:58.344 INFO:tasks.workunit.client.0.smithi002.stdout:7/34: rmdir d8/d9 39 2024-09-13T22:55:58.345 INFO:tasks.workunit.client.0.smithi002.stdout:2/51: dread d1/f2 [0,4194304] 0 2024-09-13T22:55:58.346 INFO:tasks.workunit.client.1.smithi047.stdout:4/171: unlink dc/de/d17/f28 0 2024-09-13T22:55:58.348 INFO:tasks.workunit.client.1.smithi047.stdout:0/222: creat d1/d5/d16/d47/f4d x:0 0 0 2024-09-13T22:55:58.350 INFO:tasks.workunit.client.0.smithi002.stdout:3/86: mknod d9/d15/c20 0 2024-09-13T22:55:58.352 INFO:tasks.workunit.client.0.smithi002.stdout:4/33: mknod d3/c9 0 2024-09-13T22:55:58.353 INFO:tasks.workunit.client.0.smithi002.stdout:4/34: write d3/f4 [3271848,28535] 0 2024-09-13T22:55:58.356 INFO:tasks.workunit.client.0.smithi002.stdout:5/65: getdents d1 0 2024-09-13T22:55:58.357 INFO:tasks.workunit.client.1.smithi047.stdout:5/157: link d19/d25/f3f d19/d34/f40 0 2024-09-13T22:55:58.360 INFO:tasks.workunit.client.0.smithi002.stdout:9/97: creat d8/d10/f21 x:0 0 0 2024-09-13T22:55:58.361 INFO:tasks.workunit.client.0.smithi002.stdout:9/98: write d8/d10/d1c/f12 [1224503,82121] 0 2024-09-13T22:55:58.362 INFO:tasks.workunit.client.0.smithi002.stdout:9/99: write d8/d10/d1c/f12 [341079,7075] 0 2024-09-13T22:55:58.363 INFO:tasks.workunit.client.1.smithi047.stdout:9/176: mknod d1/dc/c34 0 2024-09-13T22:55:58.364 INFO:tasks.workunit.client.1.smithi047.stdout:3/289: rmdir d0/d3/d4/d16/d1c 39 2024-09-13T22:55:58.368 INFO:tasks.workunit.client.1.smithi047.stdout:3/290: write d0/d3/d4/d16/d2c/de/f17 [7035451,117961] 0 2024-09-13T22:55:58.369 INFO:tasks.workunit.client.1.smithi047.stdout:7/215: dwrite d0/d7/f3d [0,4194304] 0 2024-09-13T22:55:58.369 INFO:tasks.workunit.client.1.smithi047.stdout:3/291: readlink d0/d3/d4/l35 0 2024-09-13T22:55:58.370 INFO:tasks.workunit.client.1.smithi047.stdout:4/172: creat dc/de/d17/d25/f36 x:0 0 0 2024-09-13T22:55:58.370 INFO:tasks.workunit.client.1.smithi047.stdout:4/173: chown fb 142729 1 2024-09-13T22:55:58.372 INFO:tasks.workunit.client.1.smithi047.stdout:0/223: mknod d1/d5/d16/d47/c4e 0 2024-09-13T22:55:58.373 INFO:tasks.workunit.client.0.smithi002.stdout:2/52: rmdir d1 39 2024-09-13T22:55:58.376 INFO:tasks.workunit.client.1.smithi047.stdout:2/287: mknod d1/df/c65 0 2024-09-13T22:55:58.378 INFO:tasks.workunit.client.0.smithi002.stdout:7/35: dwrite d8/d9/fd [4194304,4194304] 0 2024-09-13T22:55:58.378 INFO:tasks.workunit.client.0.smithi002.stdout:7/36: stat f7 0 2024-09-13T22:55:58.378 INFO:tasks.workunit.client.0.smithi002.stdout:7/37: chown f6 7 1 2024-09-13T22:55:58.380 INFO:tasks.workunit.client.0.smithi002.stdout:7/38: dread - f7 zero size 2024-09-13T22:55:58.381 INFO:tasks.workunit.client.1.smithi047.stdout:9/177: creat d1/dc/d18/f35 x:0 0 0 2024-09-13T22:55:58.382 INFO:tasks.workunit.client.1.smithi047.stdout:9/178: chown d1/f1a 12394 1 2024-09-13T22:55:58.383 INFO:tasks.workunit.client.1.smithi047.stdout:9/179: chown d1/dc/d14/c2e 0 1 2024-09-13T22:55:58.384 INFO:tasks.workunit.client.0.smithi002.stdout:5/66: rename d1/ld to d1/l14 0 2024-09-13T22:55:58.391 INFO:tasks.workunit.client.1.smithi047.stdout:7/216: unlink d0/db/f3b 0 2024-09-13T22:55:58.392 INFO:tasks.workunit.client.1.smithi047.stdout:5/158: dwrite d19/f1d [0,4194304] 0 2024-09-13T22:55:58.394 INFO:tasks.workunit.client.1.smithi047.stdout:7/217: chown d0/d7/da/d2e/d37/f43 265182 1 2024-09-13T22:55:58.395 INFO:tasks.workunit.client.1.smithi047.stdout:5/159: stat d19/d23/f29 0 2024-09-13T22:55:58.397 INFO:tasks.workunit.client.1.smithi047.stdout:7/218: write d0/d19/f2d [793469,120430] 0 2024-09-13T22:55:58.400 INFO:tasks.workunit.client.0.smithi002.stdout:9/100: write d8/d10/d1c/f15 [4080590,62265] 0 2024-09-13T22:55:58.407 INFO:tasks.workunit.client.0.smithi002.stdout:1/131: sync 2024-09-13T22:55:58.409 INFO:tasks.workunit.client.1.smithi047.stdout:9/180: rename d1/dc/d14/dd/f9 to d1/d2d/f36 0 2024-09-13T22:55:58.411 INFO:tasks.workunit.client.0.smithi002.stdout:7/39: write f7 [576182,56575] 0 2024-09-13T22:55:58.412 INFO:tasks.workunit.client.1.smithi047.stdout:4/174: dwrite dc/de/f16 [0,4194304] 0 2024-09-13T22:55:58.413 INFO:tasks.workunit.client.0.smithi002.stdout:4/35: link d3/f5 d3/fa 0 2024-09-13T22:55:58.417 INFO:tasks.workunit.client.0.smithi002.stdout:0/71: getdents d1 0 2024-09-13T22:55:58.417 INFO:tasks.workunit.client.0.smithi002.stdout:7/40: dread f7 [0,4194304] 0 2024-09-13T22:55:58.418 INFO:tasks.workunit.client.0.smithi002.stdout:6/97: getdents d12/d17 0 2024-09-13T22:55:58.418 INFO:tasks.workunit.client.0.smithi002.stdout:0/72: readlink d1/d2/lc 0 2024-09-13T22:55:58.419 INFO:tasks.workunit.client.0.smithi002.stdout:8/58: creat d3/dc/fd x:0 0 0 2024-09-13T22:55:58.420 INFO:tasks.workunit.client.0.smithi002.stdout:0/73: chown d1/d4/c13 12324 1 2024-09-13T22:55:58.420 INFO:tasks.workunit.client.0.smithi002.stdout:4/36: dwrite d3/f4 [0,4194304] 0 2024-09-13T22:55:58.421 INFO:tasks.workunit.client.1.smithi047.stdout:0/224: creat d1/d5/d16/d23/d45/f4f x:0 0 0 2024-09-13T22:55:58.425 INFO:tasks.workunit.client.1.smithi047.stdout:1/157: link d0/d7/db/c25 d0/d7/d10/c29 0 2024-09-13T22:55:58.426 INFO:tasks.workunit.client.1.smithi047.stdout:1/158: dread - d0/d7/d14/f27 zero size 2024-09-13T22:55:58.428 INFO:tasks.workunit.client.0.smithi002.stdout:1/132: rmdir d1/d13 39 2024-09-13T22:55:58.429 INFO:tasks.workunit.client.0.smithi002.stdout:1/133: dread - d1/fb zero size 2024-09-13T22:55:58.430 INFO:tasks.workunit.client.1.smithi047.stdout:3/292: truncate d0/d3/f33 7463227 0 2024-09-13T22:55:58.434 INFO:tasks.workunit.client.1.smithi047.stdout:9/181: creat d1/dc/d14/d20/f37 x:0 0 0 2024-09-13T22:55:58.434 INFO:tasks.workunit.client.1.smithi047.stdout:2/288: write d1/df/d1d/d20/d2b/f34 [2073725,79302] 0 2024-09-13T22:55:58.437 INFO:tasks.workunit.client.1.smithi047.stdout:2/289: chown d1/df/d1d/d20/d37/l62 178460 1 2024-09-13T22:55:58.437 INFO:tasks.workunit.client.0.smithi002.stdout:5/67: creat d1/d10/f15 x:0 0 0 2024-09-13T22:55:58.437 INFO:tasks.workunit.client.0.smithi002.stdout:5/68: fsync d1/fe 0 2024-09-13T22:55:58.438 INFO:tasks.workunit.client.0.smithi002.stdout:5/69: fsync d1/f8 0 2024-09-13T22:55:58.438 INFO:tasks.workunit.client.1.smithi047.stdout:0/225: dread d1/f37 [0,4194304] 0 2024-09-13T22:55:58.443 INFO:tasks.workunit.client.0.smithi002.stdout:7/41: unlink l5 0 2024-09-13T22:55:58.443 INFO:tasks.workunit.client.0.smithi002.stdout:5/70: dwrite d1/f3 [0,4194304] 0 2024-09-13T22:55:58.445 INFO:tasks.workunit.client.1.smithi047.stdout:6/205: sync 2024-09-13T22:55:58.445 INFO:tasks.workunit.client.1.smithi047.stdout:8/193: sync 2024-09-13T22:55:58.446 INFO:tasks.workunit.client.1.smithi047.stdout:8/194: write d8/f1f [570960,123578] 0 2024-09-13T22:55:58.447 INFO:tasks.workunit.client.0.smithi002.stdout:8/59: fdatasync d3/fa 0 2024-09-13T22:55:58.448 INFO:tasks.workunit.client.0.smithi002.stdout:8/60: chown d3/f6 0 1 2024-09-13T22:55:58.448 INFO:tasks.workunit.client.1.smithi047.stdout:1/159: creat d0/d7/d14/f2a x:0 0 0 2024-09-13T22:55:58.449 INFO:tasks.workunit.client.0.smithi002.stdout:9/101: creat d8/d1e/f22 x:0 0 0 2024-09-13T22:55:58.449 INFO:tasks.workunit.client.0.smithi002.stdout:9/102: chown d8/fa 6 1 2024-09-13T22:55:58.451 INFO:tasks.workunit.client.1.smithi047.stdout:9/182: symlink d1/dc/d14/d20/l38 0 2024-09-13T22:55:58.452 INFO:tasks.workunit.client.1.smithi047.stdout:9/183: write d1/dc/d18/f19 [5638806,106987] 0 2024-09-13T22:55:58.454 INFO:tasks.workunit.client.0.smithi002.stdout:5/71: write d1/f12 [3315,31264] 0 2024-09-13T22:55:58.455 INFO:tasks.workunit.client.0.smithi002.stdout:5/72: write d1/fe [574398,73770] 0 2024-09-13T22:55:58.458 INFO:tasks.workunit.client.1.smithi047.stdout:0/226: unlink d1/d5/d11/d2f/f41 0 2024-09-13T22:55:58.458 INFO:tasks.workunit.client.1.smithi047.stdout:0/227: fdatasync d1/d5/f3f 0 2024-09-13T22:55:58.459 INFO:tasks.workunit.client.0.smithi002.stdout:3/87: getdents d9 0 2024-09-13T22:55:58.460 INFO:tasks.workunit.client.1.smithi047.stdout:4/175: link dc/f2f dc/de/d23/f37 0 2024-09-13T22:55:58.461 INFO:tasks.workunit.client.1.smithi047.stdout:4/176: chown dc/de/d17/f1b 13219 1 2024-09-13T22:55:58.462 INFO:tasks.workunit.client.0.smithi002.stdout:5/73: dwrite d1/d10/f15 [0,4194304] 0 2024-09-13T22:55:58.465 INFO:tasks.workunit.client.0.smithi002.stdout:7/42: mknod d8/d9/ce 0 2024-09-13T22:55:58.467 INFO:tasks.workunit.client.0.smithi002.stdout:7/43: rename d8 to d8/d9/df 22 2024-09-13T22:55:58.468 INFO:tasks.workunit.client.0.smithi002.stdout:6/98: link fd d12/f1c 0 2024-09-13T22:55:58.469 INFO:tasks.workunit.client.1.smithi047.stdout:4/177: dwrite dc/de/d17/d25/f36 [0,4194304] 0 2024-09-13T22:55:58.469 INFO:tasks.workunit.client.0.smithi002.stdout:4/37: dwrite f2 [4194304,4194304] 0 2024-09-13T22:55:58.470 INFO:tasks.workunit.client.1.smithi047.stdout:6/206: creat d3/d15/d30/f44 x:0 0 0 2024-09-13T22:55:58.471 INFO:tasks.workunit.client.1.smithi047.stdout:4/178: write f8 [328011,125693] 0 2024-09-13T22:55:58.473 INFO:tasks.workunit.client.0.smithi002.stdout:5/74: dwrite d1/f8 [0,4194304] 0 2024-09-13T22:55:58.475 INFO:tasks.workunit.client.0.smithi002.stdout:5/75: write d1/f13 [147895,17176] 0 2024-09-13T22:55:58.476 INFO:tasks.workunit.client.0.smithi002.stdout:8/61: creat d3/dc/fe x:0 0 0 2024-09-13T22:55:58.478 INFO:tasks.workunit.client.1.smithi047.stdout:1/160: rename d0/d7/d10/f19 to d0/d7/d14/f2b 0 2024-09-13T22:55:58.479 INFO:tasks.workunit.client.1.smithi047.stdout:4/179: dread dc/f2f [0,4194304] 0 2024-09-13T22:55:58.480 INFO:tasks.workunit.client.1.smithi047.stdout:1/161: readlink d0/d7/la 0 2024-09-13T22:55:58.480 INFO:tasks.workunit.client.0.smithi002.stdout:9/103: symlink d8/d10/d1c/l23 0 2024-09-13T22:55:58.482 INFO:tasks.workunit.client.0.smithi002.stdout:9/104: write d8/d10/d1c/f12 [1602460,41785] 0 2024-09-13T22:55:58.488 INFO:tasks.workunit.client.1.smithi047.stdout:2/290: symlink d1/df/d1d/l66 0 2024-09-13T22:55:58.489 INFO:tasks.workunit.client.1.smithi047.stdout:5/160: getdents d19 0 2024-09-13T22:55:58.489 INFO:tasks.workunit.client.1.smithi047.stdout:4/180: dread dc/f2f [0,4194304] 0 2024-09-13T22:55:58.494 INFO:tasks.workunit.client.1.smithi047.stdout:1/162: dwrite d0/d7/d14/f27 [0,4194304] 0 2024-09-13T22:55:58.498 INFO:tasks.workunit.client.0.smithi002.stdout:6/99: fdatasync d12/f1c 0 2024-09-13T22:55:58.499 INFO:tasks.workunit.client.0.smithi002.stdout:6/100: readlink l3 0 2024-09-13T22:55:58.499 INFO:tasks.workunit.client.1.smithi047.stdout:7/219: getdents d0/d19 0 2024-09-13T22:55:58.499 INFO:tasks.workunit.client.1.smithi047.stdout:1/163: read - d0/d7/d14/f26 zero size 2024-09-13T22:55:58.500 INFO:tasks.workunit.client.1.smithi047.stdout:6/207: dread d3/f7 [0,4194304] 0 2024-09-13T22:55:58.502 INFO:tasks.workunit.client.0.smithi002.stdout:4/38: creat d3/fb x:0 0 0 2024-09-13T22:55:58.503 INFO:tasks.workunit.client.1.smithi047.stdout:7/220: fsync d0/d7/da/d2e/d37/f43 0 2024-09-13T22:55:58.503 INFO:tasks.workunit.client.1.smithi047.stdout:8/195: dwrite d8/d36/f3d [0,4194304] 0 2024-09-13T22:55:58.503 INFO:tasks.workunit.client.0.smithi002.stdout:6/101: dread f1 [0,4194304] 0 2024-09-13T22:55:58.504 INFO:tasks.workunit.client.0.smithi002.stdout:4/39: write d3/f4 [3881812,31792] 0 2024-09-13T22:55:58.504 INFO:tasks.workunit.client.1.smithi047.stdout:1/164: readlink d0/d7/l21 0 2024-09-13T22:55:58.506 INFO:tasks.workunit.client.1.smithi047.stdout:8/196: stat d8/d36/f3d 0 2024-09-13T22:55:58.507 INFO:tasks.workunit.client.0.smithi002.stdout:4/40: dread f2 [0,4194304] 0 2024-09-13T22:55:58.509 INFO:tasks.workunit.client.0.smithi002.stdout:5/76: symlink d1/d10/l16 0 2024-09-13T22:55:58.510 INFO:tasks.workunit.client.1.smithi047.stdout:3/293: creat d0/d3/d4/d16/f61 x:0 0 0 2024-09-13T22:55:58.512 INFO:tasks.workunit.client.1.smithi047.stdout:0/228: write d1/f37 [2053207,56484] 0 2024-09-13T22:55:58.513 INFO:tasks.workunit.client.1.smithi047.stdout:8/197: dwrite d8/f2e [0,4194304] 0 2024-09-13T22:55:58.514 INFO:tasks.workunit.client.1.smithi047.stdout:8/198: chown d8/l2f 1215 1 2024-09-13T22:55:58.515 INFO:tasks.workunit.client.1.smithi047.stdout:3/294: truncate d0/d25/d44/d43/f54 385338 0 2024-09-13T22:55:58.521 INFO:tasks.workunit.client.1.smithi047.stdout:9/184: rename d1/dc/d14/c21 to d1/dc/c39 0 2024-09-13T22:55:58.523 INFO:tasks.workunit.client.0.smithi002.stdout:9/105: mknod d8/d10/d1c/c24 0 2024-09-13T22:55:58.525 INFO:tasks.workunit.client.0.smithi002.stdout:2/53: getdents d1 0 2024-09-13T22:55:58.525 INFO:tasks.workunit.client.1.smithi047.stdout:3/295: dwrite d0/f58 [0,4194304] 0 2024-09-13T22:55:58.528 INFO:tasks.workunit.client.1.smithi047.stdout:4/181: unlink dc/de/d23/f2b 0 2024-09-13T22:55:58.528 INFO:tasks.workunit.client.0.smithi002.stdout:2/54: dread d1/f5 [0,4194304] 0 2024-09-13T22:55:58.529 INFO:tasks.workunit.client.0.smithi002.stdout:1/134: creat d1/f27 x:0 0 0 2024-09-13T22:55:58.529 INFO:tasks.workunit.client.0.smithi002.stdout:8/62: truncate d3/fa 1676837 0 2024-09-13T22:55:58.540 INFO:tasks.workunit.client.1.smithi047.stdout:7/221: write d0/d19/d32/f45 [1557870,7215] 0 2024-09-13T22:55:58.541 INFO:tasks.workunit.client.0.smithi002.stdout:6/102: mknod d12/d17/c1d 0 2024-09-13T22:55:58.543 INFO:tasks.workunit.client.0.smithi002.stdout:3/88: truncate f3 3518497 0 2024-09-13T22:55:58.543 INFO:tasks.workunit.client.0.smithi002.stdout:3/89: write d9/fb [1685795,42342] 0 2024-09-13T22:55:58.546 INFO:tasks.workunit.client.1.smithi047.stdout:8/199: unlink d8/d36/c37 0 2024-09-13T22:55:58.547 INFO:tasks.workunit.client.0.smithi002.stdout:0/74: getdents d1 0 2024-09-13T22:55:58.547 INFO:tasks.workunit.client.0.smithi002.stdout:0/75: readlink d1/d4/l15 0 2024-09-13T22:55:58.549 INFO:tasks.workunit.client.0.smithi002.stdout:9/106: creat d8/d1e/f25 x:0 0 0 2024-09-13T22:55:58.549 INFO:tasks.workunit.client.0.smithi002.stdout:9/107: read - d8/d10/f17 zero size 2024-09-13T22:55:58.550 INFO:tasks.workunit.client.0.smithi002.stdout:7/44: sync 2024-09-13T22:55:58.550 INFO:tasks.workunit.client.0.smithi002.stdout:9/108: dread - d8/d10/f21 zero size 2024-09-13T22:55:58.550 INFO:tasks.workunit.client.0.smithi002.stdout:9/109: readlink l2 0 2024-09-13T22:55:58.551 INFO:tasks.workunit.client.1.smithi047.stdout:9/185: symlink d1/dc/d14/dd/l3a 0 2024-09-13T22:55:58.551 INFO:tasks.workunit.client.1.smithi047.stdout:9/186: chown d1/dc/d14/c12 805 1 2024-09-13T22:55:58.553 INFO:tasks.workunit.client.0.smithi002.stdout:7/45: dread f1 [0,4194304] 0 2024-09-13T22:55:58.555 INFO:tasks.workunit.client.0.smithi002.stdout:1/135: fsync d1/d13/d1d/f25 0 2024-09-13T22:55:58.556 INFO:tasks.workunit.client.1.smithi047.stdout:9/187: dread d1/dc/d14/f2f [0,4194304] 0 2024-09-13T22:55:58.562 INFO:tasks.workunit.client.0.smithi002.stdout:1/136: dwrite d1/d13/d1d/f25 [0,4194304] 0 2024-09-13T22:55:58.563 INFO:tasks.workunit.client.1.smithi047.stdout:4/182: creat dc/d29/f38 x:0 0 0 2024-09-13T22:55:58.563 INFO:tasks.workunit.client.1.smithi047.stdout:9/188: dwrite d1/f5 [0,4194304] 0 2024-09-13T22:55:58.563 INFO:tasks.workunit.client.1.smithi047.stdout:9/189: fdatasync d1/dc/d14/f2f 0 2024-09-13T22:55:58.565 INFO:tasks.workunit.client.1.smithi047.stdout:9/190: rename d1/dc/d14/d20 to d1/dc/d14/d20/d3b 22 2024-09-13T22:55:58.567 INFO:tasks.workunit.client.1.smithi047.stdout:2/291: write d1/df/d1d/d20/d2b/f41 [2050967,116021] 0 2024-09-13T22:55:58.571 INFO:tasks.workunit.client.1.smithi047.stdout:1/165: creat d0/d1d/f2c x:0 0 0 2024-09-13T22:55:58.571 INFO:tasks.workunit.client.0.smithi002.stdout:2/55: dwrite d1/f2 [0,4194304] 0 2024-09-13T22:55:58.572 INFO:tasks.workunit.client.1.smithi047.stdout:7/222: symlink d0/d7/da/l46 0 2024-09-13T22:55:58.575 INFO:tasks.workunit.client.0.smithi002.stdout:6/103: truncate d12/f13 1169127 0 2024-09-13T22:55:58.583 INFO:tasks.workunit.client.1.smithi047.stdout:5/161: truncate f10 4061782 0 2024-09-13T22:55:58.591 INFO:tasks.workunit.client.0.smithi002.stdout:9/110: truncate d8/fa 46642 0 2024-09-13T22:55:58.592 INFO:tasks.workunit.client.1.smithi047.stdout:4/183: chown dc/fd 831795542 1 2024-09-13T22:55:58.594 INFO:tasks.workunit.client.1.smithi047.stdout:6/208: dwrite d3/d15/f1d [0,4194304] 0 2024-09-13T22:55:58.594 INFO:tasks.workunit.client.1.smithi047.stdout:9/191: mknod d1/dc/d14/d20/c3c 0 2024-09-13T22:55:58.594 INFO:tasks.workunit.client.0.smithi002.stdout:4/41: truncate d3/fa 7061353 0 2024-09-13T22:55:58.602 INFO:tasks.workunit.client.1.smithi047.stdout:7/223: rmdir d0/d7/da 39 2024-09-13T22:55:58.603 INFO:tasks.workunit.client.0.smithi002.stdout:8/63: read d3/f6 [50169,69659] 0 2024-09-13T22:55:58.603 INFO:tasks.workunit.client.0.smithi002.stdout:8/64: chown d3 17108 1 2024-09-13T22:55:58.603 INFO:tasks.workunit.client.0.smithi002.stdout:8/65: stat d3/dc 0 2024-09-13T22:55:58.605 INFO:tasks.workunit.client.1.smithi047.stdout:3/296: dwrite d0/d3/f15 [0,4194304] 0 2024-09-13T22:55:58.605 INFO:tasks.workunit.client.0.smithi002.stdout:1/137: rename d1/d6/fc to d1/d13/d21/f28 0 2024-09-13T22:55:58.605 INFO:tasks.workunit.client.0.smithi002.stdout:1/138: stat d1/f7 0 2024-09-13T22:55:58.606 INFO:tasks.workunit.client.1.smithi047.stdout:3/297: dread - d0/d25/d44/d43/f30 zero size 2024-09-13T22:55:58.613 INFO:tasks.workunit.client.0.smithi002.stdout:1/139: dwrite d1/fb [0,4194304] 0 2024-09-13T22:55:58.613 INFO:tasks.workunit.client.0.smithi002.stdout:2/56: mknod d1/d7/cd 0 2024-09-13T22:55:58.615 INFO:tasks.workunit.client.1.smithi047.stdout:5/162: mkdir d19/d23/d2e/d41 0 2024-09-13T22:55:58.615 INFO:tasks.workunit.client.1.smithi047.stdout:5/163: chown d19/d23/c24 4172366 1 2024-09-13T22:55:58.617 INFO:tasks.workunit.client.0.smithi002.stdout:5/77: link d1/c9 d1/d10/c17 0 2024-09-13T22:55:58.622 INFO:tasks.workunit.client.1.smithi047.stdout:4/184: mkdir dc/de/d39 0 2024-09-13T22:55:58.624 INFO:tasks.workunit.client.1.smithi047.stdout:6/209: rmdir d3/d2c 39 2024-09-13T22:55:58.624 INFO:tasks.workunit.client.1.smithi047.stdout:6/210: fdatasync d3/f7 0 2024-09-13T22:55:58.628 INFO:tasks.workunit.client.1.smithi047.stdout:1/166: mkdir d0/d7/d13/d2d 0 2024-09-13T22:55:58.629 INFO:tasks.workunit.client.1.smithi047.stdout:7/224: fsync d0/d7/f3e 0 2024-09-13T22:55:58.631 INFO:tasks.workunit.client.0.smithi002.stdout:7/46: truncate d8/fc 1029974 0 2024-09-13T22:55:58.633 INFO:tasks.workunit.client.0.smithi002.stdout:8/66: mknod d3/dc/cf 0 2024-09-13T22:55:58.633 INFO:tasks.workunit.client.1.smithi047.stdout:1/167: dwrite d0/f5 [4194304,4194304] 0 2024-09-13T22:55:58.636 INFO:tasks.workunit.client.0.smithi002.stdout:2/57: symlink d1/d7/le 0 2024-09-13T22:55:58.637 INFO:tasks.workunit.client.0.smithi002.stdout:7/47: dwrite f6 [0,4194304] 0 2024-09-13T22:55:58.639 INFO:tasks.workunit.client.0.smithi002.stdout:1/140: creat d1/d13/d1d/f29 x:0 0 0 2024-09-13T22:55:58.642 INFO:tasks.workunit.client.1.smithi047.stdout:5/164: mkdir d19/d34/d42 0 2024-09-13T22:55:58.643 INFO:tasks.workunit.client.1.smithi047.stdout:1/168: dwrite d0/d7/d14/f27 [4194304,4194304] 0 2024-09-13T22:55:58.644 INFO:tasks.workunit.client.1.smithi047.stdout:5/165: chown d19/d25/f2b 3503223 1 2024-09-13T22:55:58.645 INFO:tasks.workunit.client.1.smithi047.stdout:1/169: read d0/d7/d14/f2b [149680,71141] 0 2024-09-13T22:55:58.646 INFO:tasks.workunit.client.0.smithi002.stdout:0/76: sync 2024-09-13T22:55:58.647 INFO:tasks.workunit.client.1.smithi047.stdout:1/170: fdatasync d0/d7/d10/f1f 0 2024-09-13T22:55:58.648 INFO:tasks.workunit.client.0.smithi002.stdout:5/78: creat d1/f18 x:0 0 0 2024-09-13T22:55:58.649 INFO:tasks.workunit.client.1.smithi047.stdout:4/185: symlink dc/de/l3a 0 2024-09-13T22:55:58.649 INFO:tasks.workunit.client.1.smithi047.stdout:1/171: write d0/d1d/f2c [1011709,893] 0 2024-09-13T22:55:58.650 INFO:tasks.workunit.client.1.smithi047.stdout:4/186: stat dc/de 0 2024-09-13T22:55:58.651 INFO:tasks.workunit.client.1.smithi047.stdout:6/211: rmdir d3/d11/d2b 39 2024-09-13T22:55:58.651 INFO:tasks.workunit.client.1.smithi047.stdout:1/172: chown d0/d7/la 389 1 2024-09-13T22:55:58.653 INFO:tasks.workunit.client.0.smithi002.stdout:5/79: dread d1/f8 [0,4194304] 0 2024-09-13T22:55:58.655 INFO:tasks.workunit.client.1.smithi047.stdout:9/192: symlink d1/dc/d14/l3d 0 2024-09-13T22:55:58.656 INFO:tasks.workunit.client.1.smithi047.stdout:9/193: write d1/dc/d14/f16 [3183631,18984] 0 2024-09-13T22:55:58.661 INFO:tasks.workunit.client.0.smithi002.stdout:8/67: creat d3/f10 x:0 0 0 2024-09-13T22:55:58.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:55:58 smithi047 ceph-mon[34560]: pgmap v9: 65 pgs: 65 active+clean; 581 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.3 MiB/s rd, 62 MiB/s wr, 220 op/s 2024-09-13T22:55:58.663 INFO:tasks.workunit.client.1.smithi047.stdout:0/229: getdents d1/d7 0 2024-09-13T22:55:58.665 INFO:tasks.workunit.client.0.smithi002.stdout:5/80: dwrite d1/fe [0,4194304] 0 2024-09-13T22:55:58.665 INFO:tasks.workunit.client.1.smithi047.stdout:9/194: read d1/dc/d14/f16 [2634097,42809] 0 2024-09-13T22:55:58.666 INFO:tasks.workunit.client.0.smithi002.stdout:5/81: read - d1/f18 zero size 2024-09-13T22:55:58.668 INFO:tasks.workunit.client.0.smithi002.stdout:2/58: mknod d1/cf 0 2024-09-13T22:55:58.669 INFO:tasks.workunit.client.1.smithi047.stdout:8/200: getdents d8/d36/d38 0 2024-09-13T22:55:58.689 INFO:tasks.workunit.client.1.smithi047.stdout:3/298: rename d0/d3/d4/d16/d1c/f52 to d0/d3/d4/d16/d2c/de/d3d/f62 0 2024-09-13T22:55:58.708 INFO:tasks.workunit.client.0.smithi002.stdout:6/104: sync 2024-09-13T22:55:58.716 INFO:tasks.workunit.client.0.smithi002.stdout:1/141: fsync d1/d6/fa 0 2024-09-13T22:55:58.719 INFO:tasks.workunit.client.1.smithi047.stdout:5/166: rename d19/f39 to d19/f43 0 2024-09-13T22:55:58.720 INFO:tasks.workunit.client.1.smithi047.stdout:5/167: truncate d19/f36 1766925 0 2024-09-13T22:55:58.720 INFO:tasks.workunit.client.0.smithi002.stdout:3/90: getdents d9/d15 0 2024-09-13T22:55:58.732 INFO:tasks.workunit.client.1.smithi047.stdout:4/187: creat dc/de/d23/f3b x:0 0 0 2024-09-13T22:55:58.733 INFO:tasks.workunit.client.0.smithi002.stdout:0/77: sync 2024-09-13T22:55:58.735 INFO:tasks.workunit.client.0.smithi002.stdout:0/78: write d1/d2/d10/f12 [1046817,74159] 0 2024-09-13T22:55:58.737 INFO:tasks.workunit.client.0.smithi002.stdout:9/111: dwrite d8/fa [0,4194304] 0 2024-09-13T22:55:58.737 INFO:tasks.workunit.client.0.smithi002.stdout:0/79: dread d1/d4/f7 [0,4194304] 0 2024-09-13T22:55:58.738 INFO:tasks.workunit.client.0.smithi002.stdout:0/80: write d1/fa [5189333,106462] 0 2024-09-13T22:55:58.740 INFO:tasks.workunit.client.1.smithi047.stdout:7/225: mkdir d0/d7/da/d47 0 2024-09-13T22:55:58.745 INFO:tasks.workunit.client.1.smithi047.stdout:0/230: symlink d1/d5/d16/l50 0 2024-09-13T22:55:58.745 INFO:tasks.workunit.client.1.smithi047.stdout:0/231: readlink d1/d5/d16/d23/d2d/l39 0 2024-09-13T22:55:58.748 INFO:tasks.workunit.client.0.smithi002.stdout:5/82: mknod d1/d10/c19 0 2024-09-13T22:55:58.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:55:58 smithi002 ceph-mon[27637]: pgmap v9: 65 pgs: 65 active+clean; 581 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.3 MiB/s rd, 62 MiB/s wr, 220 op/s 2024-09-13T22:55:58.751 INFO:tasks.workunit.client.0.smithi002.stdout:2/59: creat d1/d7/d8/f10 x:0 0 0 2024-09-13T22:55:58.751 INFO:tasks.workunit.client.0.smithi002.stdout:2/60: chown d1/d7/d8 332008 1 2024-09-13T22:55:58.752 INFO:tasks.workunit.client.0.smithi002.stdout:4/42: read d3/f5 [3923218,119752] 0 2024-09-13T22:55:58.753 INFO:tasks.workunit.client.0.smithi002.stdout:4/43: write d3/fb [779223,79186] 0 2024-09-13T22:55:58.757 INFO:tasks.workunit.client.1.smithi047.stdout:1/173: rename d0/d7/d14/f26 to d0/d1d/f2e 0 2024-09-13T22:55:58.758 INFO:tasks.workunit.client.1.smithi047.stdout:1/174: dread - d0/d1d/f2e zero size 2024-09-13T22:55:58.758 INFO:tasks.workunit.client.1.smithi047.stdout:1/175: readlink d0/d7/la 0 2024-09-13T22:55:58.762 INFO:tasks.workunit.client.0.smithi002.stdout:1/142: creat d1/d6/f2a x:0 0 0 2024-09-13T22:55:58.762 INFO:tasks.workunit.client.1.smithi047.stdout:6/212: creat d3/d11/d2b/d1c/f45 x:0 0 0 2024-09-13T22:55:58.765 INFO:tasks.workunit.client.0.smithi002.stdout:3/91: rename d9/d15/f14 to d9/df/d10/f21 0 2024-09-13T22:55:58.766 INFO:tasks.workunit.client.1.smithi047.stdout:3/299: dread d0/d3/f33 [0,4194304] 0 2024-09-13T22:55:58.768 INFO:tasks.workunit.client.0.smithi002.stdout:1/143: dwrite d1/d1c/f26 [0,4194304] 0 2024-09-13T22:55:58.770 INFO:tasks.workunit.client.1.smithi047.stdout:6/213: dwrite d3/d11/d2b/d1c/d23/f39 [0,4194304] 0 2024-09-13T22:55:58.771 INFO:tasks.workunit.client.1.smithi047.stdout:6/214: read d3/d15/f1d [543952,80467] 0 2024-09-13T22:55:58.773 INFO:tasks.workunit.client.0.smithi002.stdout:9/112: mknod d8/d1e/c26 0 2024-09-13T22:55:58.776 INFO:tasks.workunit.client.1.smithi047.stdout:0/232: chown d1/l4c 5109 1 2024-09-13T22:55:58.782 INFO:tasks.workunit.client.1.smithi047.stdout:8/201: mkdir d8/d36/d40/d43 0 2024-09-13T22:55:58.786 INFO:tasks.workunit.client.0.smithi002.stdout:8/68: unlink d3/f10 0 2024-09-13T22:55:58.786 INFO:tasks.workunit.client.0.smithi002.stdout:8/69: fdatasync d3/dc/fe 0 2024-09-13T22:55:58.786 INFO:tasks.workunit.client.1.smithi047.stdout:1/176: mknod d0/d7/db/c2f 0 2024-09-13T22:55:58.787 INFO:tasks.workunit.client.0.smithi002.stdout:5/83: symlink d1/d10/l1a 0 2024-09-13T22:55:58.788 INFO:tasks.workunit.client.0.smithi002.stdout:5/84: write d1/f18 [93224,36204] 0 2024-09-13T22:55:58.792 INFO:tasks.workunit.client.0.smithi002.stdout:2/61: unlink d1/f9 0 2024-09-13T22:55:58.794 INFO:tasks.workunit.client.0.smithi002.stdout:2/62: write d1/d7/d8/f10 [31305,116628] 0 2024-09-13T22:55:58.796 INFO:tasks.workunit.client.0.smithi002.stdout:4/44: mknod d3/cc 0 2024-09-13T22:55:58.796 INFO:tasks.workunit.client.0.smithi002.stdout:4/45: stat d3/l6 0 2024-09-13T22:55:58.798 INFO:tasks.workunit.client.1.smithi047.stdout:8/202: dread d8/f26 [0,4194304] 0 2024-09-13T22:55:58.800 INFO:tasks.workunit.client.0.smithi002.stdout:2/63: dwrite d1/f2 [0,4194304] 0 2024-09-13T22:55:58.809 INFO:tasks.workunit.client.0.smithi002.stdout:3/92: rename d9/fe to d9/f22 0 2024-09-13T22:55:58.811 INFO:tasks.workunit.client.0.smithi002.stdout:3/93: dread d9/f1a [0,4194304] 0 2024-09-13T22:55:58.814 INFO:tasks.workunit.client.1.smithi047.stdout:0/233: rmdir d1/d5/d11 39 2024-09-13T22:55:58.816 INFO:tasks.workunit.client.0.smithi002.stdout:9/113: creat d8/d1e/f27 x:0 0 0 2024-09-13T22:55:58.819 INFO:tasks.workunit.client.1.smithi047.stdout:0/234: dread d1/d7/f4b [0,4194304] 0 2024-09-13T22:55:58.820 INFO:tasks.workunit.client.0.smithi002.stdout:8/70: rename d3/dc/cf to d3/c11 0 2024-09-13T22:55:58.821 INFO:tasks.workunit.client.1.smithi047.stdout:5/168: link l8 d19/d34/d42/l44 0 2024-09-13T22:55:58.821 INFO:tasks.workunit.client.1.smithi047.stdout:5/169: stat d19/d25/f2b 0 2024-09-13T22:55:58.821 INFO:tasks.workunit.client.0.smithi002.stdout:8/71: write d3/dc/fe [722235,88189] 0 2024-09-13T22:55:58.822 INFO:tasks.workunit.client.0.smithi002.stdout:5/85: rename d1/l7 to d1/l1b 0 2024-09-13T22:55:58.823 INFO:tasks.workunit.client.0.smithi002.stdout:5/86: fsync d1/fe 0 2024-09-13T22:55:58.823 INFO:tasks.workunit.client.0.smithi002.stdout:5/87: fsync d1/f13 0 2024-09-13T22:55:58.824 INFO:tasks.workunit.client.1.smithi047.stdout:4/188: creat dc/f3c x:0 0 0 2024-09-13T22:55:58.824 INFO:tasks.workunit.client.0.smithi002.stdout:5/88: fsync d1/fe 0 2024-09-13T22:55:58.826 INFO:tasks.workunit.client.1.smithi047.stdout:4/189: write dc/f3c [756201,84305] 0 2024-09-13T22:55:58.827 INFO:tasks.workunit.client.1.smithi047.stdout:8/203: rmdir d8/d36/d40 39 2024-09-13T22:55:58.828 INFO:tasks.workunit.client.1.smithi047.stdout:4/190: read f8 [182735,94703] 0 2024-09-13T22:55:58.830 INFO:tasks.workunit.client.1.smithi047.stdout:5/170: dwrite d19/d25/f38 [0,4194304] 0 2024-09-13T22:55:58.830 INFO:tasks.workunit.client.0.smithi002.stdout:5/89: dwrite d1/f3 [0,4194304] 0 2024-09-13T22:55:58.831 INFO:tasks.workunit.client.0.smithi002.stdout:5/90: fdatasync d1/f12 0 2024-09-13T22:55:58.832 INFO:tasks.workunit.client.0.smithi002.stdout:4/46: mknod d3/cd 0 2024-09-13T22:55:58.832 INFO:tasks.workunit.client.0.smithi002.stdout:5/91: write d1/fe [3453876,37491] 0 2024-09-13T22:55:58.832 INFO:tasks.workunit.client.1.smithi047.stdout:3/300: symlink d0/d25/l63 0 2024-09-13T22:55:58.832 INFO:tasks.workunit.client.1.smithi047.stdout:5/171: dread d19/d25/f2b [0,4194304] 0 2024-09-13T22:55:58.835 INFO:tasks.workunit.client.1.smithi047.stdout:7/226: creat d0/d7/f48 x:0 0 0 2024-09-13T22:55:58.836 INFO:tasks.workunit.client.1.smithi047.stdout:7/227: stat d0/d19/d32 0 2024-09-13T22:55:58.836 INFO:tasks.workunit.client.1.smithi047.stdout:9/195: write d1/dc/d14/f2f [457962,3496] 0 2024-09-13T22:55:58.839 INFO:tasks.workunit.client.0.smithi002.stdout:2/64: symlink d1/d7/d8/l11 0 2024-09-13T22:55:58.839 INFO:tasks.workunit.client.1.smithi047.stdout:9/196: write d1/f5 [1789873,87272] 0 2024-09-13T22:55:58.840 INFO:tasks.workunit.client.0.smithi002.stdout:7/48: dread d8/fc [0,4194304] 0 2024-09-13T22:55:58.841 INFO:tasks.workunit.client.0.smithi002.stdout:7/49: write f6 [3052232,45790] 0 2024-09-13T22:55:58.842 INFO:tasks.workunit.client.0.smithi002.stdout:2/65: dread d1/d7/d8/f10 [0,4194304] 0 2024-09-13T22:55:58.842 INFO:tasks.workunit.client.0.smithi002.stdout:7/50: write d8/fb [429199,65562] 0 2024-09-13T22:55:58.843 INFO:tasks.workunit.client.0.smithi002.stdout:2/66: fsync d1/d7/d8/f10 0 2024-09-13T22:55:58.843 INFO:tasks.workunit.client.1.smithi047.stdout:3/301: dwrite d0/d3/d4/d16/d2c/de/f10 [4194304,4194304] 0 2024-09-13T22:55:58.843 INFO:tasks.workunit.client.0.smithi002.stdout:2/67: fsync d1/f2 0 2024-09-13T22:55:58.848 INFO:tasks.workunit.client.0.smithi002.stdout:6/105: write f5 [2905095,88826] 0 2024-09-13T22:55:58.849 INFO:tasks.workunit.client.0.smithi002.stdout:6/106: chown l3 56457 1 2024-09-13T22:55:58.849 INFO:tasks.workunit.client.0.smithi002.stdout:3/94: creat d9/df/f23 x:0 0 0 2024-09-13T22:55:58.850 INFO:tasks.workunit.client.1.smithi047.stdout:1/177: symlink d0/d7/d13/l30 0 2024-09-13T22:55:58.852 INFO:tasks.workunit.client.1.smithi047.stdout:1/178: chown d0/d1d/f2e 486078 1 2024-09-13T22:55:58.852 INFO:tasks.workunit.client.0.smithi002.stdout:1/144: link d1/d13/d1d/f25 d1/d13/d21/f2b 0 2024-09-13T22:55:58.853 INFO:tasks.workunit.client.1.smithi047.stdout:3/302: dwrite d0/d3/d4/f4c [0,4194304] 0 2024-09-13T22:55:58.853 INFO:tasks.workunit.client.1.smithi047.stdout:1/179: fsync d0/f20 0 2024-09-13T22:55:58.853 INFO:tasks.workunit.client.0.smithi002.stdout:1/145: write d1/d13/d1d/f29 [770718,87059] 0 2024-09-13T22:55:58.854 INFO:tasks.workunit.client.1.smithi047.stdout:0/235: mknod d1/d5/d16/d23/d2d/c51 0 2024-09-13T22:55:58.857 INFO:tasks.workunit.client.0.smithi002.stdout:9/114: mknod d8/c28 0 2024-09-13T22:55:58.860 INFO:tasks.workunit.client.0.smithi002.stdout:0/81: link d1/d4/f7 d1/d2/f18 0 2024-09-13T22:55:58.863 INFO:tasks.workunit.client.0.smithi002.stdout:8/72: symlink d3/l12 0 2024-09-13T22:55:58.864 INFO:tasks.workunit.client.0.smithi002.stdout:9/115: dread d8/d10/d1c/f19 [0,4194304] 0 2024-09-13T22:55:58.864 INFO:tasks.workunit.client.0.smithi002.stdout:8/73: readlink d3/l12 0 2024-09-13T22:55:58.864 INFO:tasks.workunit.client.1.smithi047.stdout:8/204: creat d8/d36/d38/f44 x:0 0 0 2024-09-13T22:55:58.865 INFO:tasks.workunit.client.1.smithi047.stdout:8/205: write d8/d36/f3a [49386,80145] 0 2024-09-13T22:55:58.866 INFO:tasks.workunit.client.1.smithi047.stdout:4/191: write f6 [1942715,56653] 0 2024-09-13T22:55:58.866 INFO:tasks.workunit.client.1.smithi047.stdout:8/206: write d8/d36/d38/f44 [659063,15684] 0 2024-09-13T22:55:58.867 INFO:tasks.workunit.client.0.smithi002.stdout:0/82: dread d1/d2/d10/f12 [0,4194304] 0 2024-09-13T22:55:58.868 INFO:tasks.workunit.client.1.smithi047.stdout:8/207: write d8/d36/f3c [2862239,3655] 0 2024-09-13T22:55:58.868 INFO:tasks.workunit.client.0.smithi002.stdout:0/83: dread - d1/f14 zero size 2024-09-13T22:55:58.869 INFO:tasks.workunit.client.0.smithi002.stdout:0/84: chown d1 2 1 2024-09-13T22:55:58.871 INFO:tasks.workunit.client.0.smithi002.stdout:4/47: mknod d3/ce 0 2024-09-13T22:55:58.872 INFO:tasks.workunit.client.0.smithi002.stdout:8/74: dwrite d3/f5 [0,4194304] 0 2024-09-13T22:55:58.887 INFO:tasks.workunit.client.1.smithi047.stdout:7/228: mkdir d0/d19/d32/d49 0 2024-09-13T22:55:58.888 INFO:tasks.workunit.client.0.smithi002.stdout:5/92: mknod d1/d10/c1c 0 2024-09-13T22:55:58.889 INFO:tasks.workunit.client.1.smithi047.stdout:9/197: creat d1/dc/d14/dd/f3e x:0 0 0 2024-09-13T22:55:58.894 INFO:tasks.workunit.client.0.smithi002.stdout:5/93: dwrite d1/f3 [0,4194304] 0 2024-09-13T22:55:58.923 INFO:tasks.workunit.client.1.smithi047.stdout:0/236: write d1/d5/d11/d2f/f48 [562493,34784] 0 2024-09-13T22:55:58.924 INFO:tasks.workunit.client.0.smithi002.stdout:7/51: dread f1 [0,4194304] 0 2024-09-13T22:55:58.925 INFO:tasks.workunit.client.1.smithi047.stdout:3/303: truncate d0/d3/d4/d16/d2c/de/f17 2318970 0 2024-09-13T22:55:58.926 INFO:tasks.workunit.client.0.smithi002.stdout:2/68: symlink d1/d7/d8/l12 0 2024-09-13T22:55:58.930 INFO:tasks.workunit.client.1.smithi047.stdout:6/215: write d3/f8 [2391397,28857] 0 2024-09-13T22:55:58.931 INFO:tasks.workunit.client.0.smithi002.stdout:6/107: stat d12/f1c 0 2024-09-13T22:55:58.933 INFO:tasks.workunit.client.1.smithi047.stdout:4/192: symlink dc/d29/l3d 0 2024-09-13T22:55:58.934 INFO:tasks.workunit.client.0.smithi002.stdout:3/95: creat d9/d15/f24 x:0 0 0 2024-09-13T22:55:58.936 INFO:tasks.workunit.client.0.smithi002.stdout:3/96: read - d9/df/f23 zero size 2024-09-13T22:55:58.936 INFO:tasks.workunit.client.0.smithi002.stdout:1/146: mknod d1/d13/c2c 0 2024-09-13T22:55:58.937 INFO:tasks.workunit.client.0.smithi002.stdout:6/108: dwrite f1 [0,4194304] 0 2024-09-13T22:55:58.939 INFO:tasks.workunit.client.1.smithi047.stdout:8/208: unlink f4 0 2024-09-13T22:55:58.939 INFO:tasks.workunit.client.1.smithi047.stdout:8/209: chown d8/f10 1041526 1 2024-09-13T22:55:58.944 INFO:tasks.workunit.client.0.smithi002.stdout:1/147: dwrite d1/f7 [4194304,4194304] 0 2024-09-13T22:55:58.945 INFO:tasks.workunit.client.1.smithi047.stdout:9/198: unlink d1/dc/d14/l26 0 2024-09-13T22:55:58.949 INFO:tasks.workunit.client.0.smithi002.stdout:0/85: creat d1/d2/f19 x:0 0 0 2024-09-13T22:55:58.957 INFO:tasks.workunit.client.0.smithi002.stdout:7/52: fsync d8/fc 0 2024-09-13T22:55:58.959 INFO:tasks.workunit.client.1.smithi047.stdout:9/199: creat d1/f3f x:0 0 0 2024-09-13T22:55:58.961 INFO:tasks.workunit.client.1.smithi047.stdout:1/180: rename d0/f20 to d0/d7/f31 0 2024-09-13T22:55:58.962 INFO:tasks.workunit.client.1.smithi047.stdout:1/181: write d0/d1d/f2c [260785,17977] 0 2024-09-13T22:55:58.963 INFO:tasks.workunit.client.1.smithi047.stdout:0/237: mkdir d1/d5/d11/d52 0 2024-09-13T22:55:58.964 INFO:tasks.workunit.client.1.smithi047.stdout:0/238: chown d1/d5/d16/d23/d2d/c51 1234897 1 2024-09-13T22:55:58.968 INFO:tasks.workunit.client.0.smithi002.stdout:3/97: rename d9/c1b to d9/df/c25 0 2024-09-13T22:55:58.970 INFO:tasks.workunit.client.1.smithi047.stdout:6/216: mkdir d3/d2c/d46 0 2024-09-13T22:55:58.971 INFO:tasks.workunit.client.1.smithi047.stdout:4/193: mknod dc/de/d39/c3e 0 2024-09-13T22:55:58.974 INFO:tasks.workunit.client.0.smithi002.stdout:1/148: creat d1/d6/f2d x:0 0 0 2024-09-13T22:55:58.975 INFO:tasks.workunit.client.0.smithi002.stdout:1/149: dread - d1/d6/f2a zero size 2024-09-13T22:55:58.975 INFO:tasks.workunit.client.1.smithi047.stdout:9/200: creat d1/f40 x:0 0 0 2024-09-13T22:55:58.976 INFO:tasks.workunit.client.1.smithi047.stdout:9/201: chown d1/dc/d18/f19 15 1 2024-09-13T22:55:58.980 INFO:tasks.workunit.client.1.smithi047.stdout:8/210: rename f1 to d8/d36/d38/f45 0 2024-09-13T22:55:58.980 INFO:tasks.workunit.client.0.smithi002.stdout:1/150: dwrite d1/d6/f18 [0,4194304] 0 2024-09-13T22:55:58.982 INFO:tasks.workunit.client.0.smithi002.stdout:1/151: dread d1/d6/fa [0,4194304] 0 2024-09-13T22:55:58.985 INFO:tasks.workunit.client.1.smithi047.stdout:1/182: creat d0/d7/d13/d1b/f32 x:0 0 0 2024-09-13T22:55:58.987 INFO:tasks.workunit.client.0.smithi002.stdout:5/94: link d1/f18 d1/f1d 0 2024-09-13T22:55:58.988 INFO:tasks.workunit.client.0.smithi002.stdout:5/95: truncate d1/f18 808270 0 2024-09-13T22:55:58.988 INFO:tasks.workunit.client.1.smithi047.stdout:0/239: symlink d1/d5/d16/d47/l53 0 2024-09-13T22:55:58.988 INFO:tasks.workunit.client.0.smithi002.stdout:5/96: rename d1 to d1/d10/d1e 22 2024-09-13T22:55:58.991 INFO:tasks.workunit.client.1.smithi047.stdout:6/217: creat d3/d15/d30/f47 x:0 0 0 2024-09-13T22:55:58.993 INFO:tasks.workunit.client.1.smithi047.stdout:4/194: creat dc/de/f3f x:0 0 0 2024-09-13T22:55:58.994 INFO:tasks.workunit.client.0.smithi002.stdout:3/98: mkdir d9/d15/d26 0 2024-09-13T22:55:58.995 INFO:tasks.workunit.client.1.smithi047.stdout:4/195: readlink dc/de/d17/l1f 0 2024-09-13T22:55:58.996 INFO:tasks.workunit.client.1.smithi047.stdout:7/229: link d0/d19/f1c d0/d7/f4a 0 2024-09-13T22:55:58.996 INFO:tasks.workunit.client.1.smithi047.stdout:4/196: chown dc/de/f16 7036 1 2024-09-13T22:55:58.998 INFO:tasks.workunit.client.1.smithi047.stdout:6/218: dwrite d3/f8 [0,4194304] 0 2024-09-13T22:55:58.998 INFO:tasks.workunit.client.0.smithi002.stdout:6/109: link f1 d12/d17/f1e 0 2024-09-13T22:55:58.999 INFO:tasks.workunit.client.1.smithi047.stdout:6/219: fdatasync d3/d15/d30/f44 0 2024-09-13T22:55:58.999 INFO:tasks.workunit.client.1.smithi047.stdout:9/202: mknod d1/d2d/c41 0 2024-09-13T22:55:59.003 INFO:tasks.workunit.client.0.smithi002.stdout:4/48: write d3/f5 [785928,35974] 0 2024-09-13T22:55:59.004 INFO:tasks.workunit.client.0.smithi002.stdout:9/116: link d8/d10/d1c/c24 d8/d1e/c29 0 2024-09-13T22:55:59.004 INFO:tasks.workunit.client.0.smithi002.stdout:9/117: read d8/fa [935146,59109] 0 2024-09-13T22:55:59.007 INFO:tasks.workunit.client.0.smithi002.stdout:9/118: dread f0 [0,4194304] 0 2024-09-13T22:55:59.008 INFO:tasks.workunit.client.1.smithi047.stdout:6/220: dwrite d3/d15/f36 [0,4194304] 0 2024-09-13T22:55:59.008 INFO:tasks.workunit.client.0.smithi002.stdout:9/119: chown d8/c28 10470 1 2024-09-13T22:55:59.010 INFO:tasks.workunit.client.1.smithi047.stdout:1/183: unlink d0/d7/d13/l30 0 2024-09-13T22:55:59.013 INFO:tasks.workunit.client.0.smithi002.stdout:8/75: link d3/fa d3/dc/f13 0 2024-09-13T22:55:59.017 INFO:tasks.workunit.client.0.smithi002.stdout:5/97: symlink d1/d10/l1f 0 2024-09-13T22:55:59.017 INFO:tasks.workunit.client.1.smithi047.stdout:1/184: dwrite d0/d7/d14/f2a [0,4194304] 0 2024-09-13T22:55:59.019 INFO:tasks.workunit.client.1.smithi047.stdout:1/185: truncate d0/d1d/f2c 2024175 0 2024-09-13T22:55:59.020 INFO:tasks.workunit.client.1.smithi047.stdout:7/230: creat d0/d7/da/d2e/f4b x:0 0 0 2024-09-13T22:55:59.020 INFO:tasks.workunit.client.0.smithi002.stdout:7/53: mkdir d8/d10 0 2024-09-13T22:55:59.023 INFO:tasks.workunit.client.1.smithi047.stdout:4/197: mkdir dc/de/d23/d40 0 2024-09-13T22:55:59.024 INFO:tasks.workunit.client.0.smithi002.stdout:2/69: link d1/d7/le d1/d7/d8/l13 0 2024-09-13T22:55:59.024 INFO:tasks.workunit.client.0.smithi002.stdout:2/70: fdatasync d1/f2 0 2024-09-13T22:55:59.027 INFO:tasks.workunit.client.1.smithi047.stdout:3/304: dwrite d0/f12 [0,4194304] 0 2024-09-13T22:55:59.027 INFO:tasks.workunit.client.1.smithi047.stdout:3/305: chown d0 7648 1 2024-09-13T22:55:59.027 INFO:tasks.workunit.client.0.smithi002.stdout:3/99: unlink d9/df/c1e 0 2024-09-13T22:55:59.034 INFO:tasks.workunit.client.0.smithi002.stdout:4/49: rmdir d3 39 2024-09-13T22:55:59.036 INFO:tasks.workunit.client.1.smithi047.stdout:6/221: mkdir d3/d15/d30/d48 0 2024-09-13T22:55:59.039 INFO:tasks.workunit.client.1.smithi047.stdout:0/240: mknod d1/c54 0 2024-09-13T22:55:59.042 INFO:tasks.workunit.client.1.smithi047.stdout:1/186: creat d0/d7/d10/f33 x:0 0 0 2024-09-13T22:55:59.043 INFO:tasks.workunit.client.0.smithi002.stdout:9/120: symlink d8/d10/d1c/l2a 0 2024-09-13T22:55:59.044 INFO:tasks.workunit.client.0.smithi002.stdout:9/121: chown d8/fe 5 1 2024-09-13T22:55:59.044 INFO:tasks.workunit.client.0.smithi002.stdout:9/122: read d8/d10/d1c/f15 [2198394,95972] 0 2024-09-13T22:55:59.045 INFO:tasks.workunit.client.1.smithi047.stdout:7/231: rename d0/d7/da/f26 to d0/db/f4c 0 2024-09-13T22:55:59.048 INFO:tasks.workunit.client.0.smithi002.stdout:9/123: dread d8/fe [0,4194304] 0 2024-09-13T22:55:59.049 INFO:tasks.workunit.client.0.smithi002.stdout:9/124: write d8/d1e/f22 [514073,103798] 0 2024-09-13T22:55:59.050 INFO:tasks.workunit.client.0.smithi002.stdout:5/98: creat d1/d10/f20 x:0 0 0 2024-09-13T22:55:59.051 INFO:tasks.workunit.client.0.smithi002.stdout:8/76: dread d3/f8 [0,4194304] 0 2024-09-13T22:55:59.051 INFO:tasks.workunit.client.1.smithi047.stdout:9/203: mkdir d1/dc/d14/d42 0 2024-09-13T22:55:59.053 INFO:tasks.workunit.client.1.smithi047.stdout:9/204: write d1/dc/d14/f17 [1469349,29631] 0 2024-09-13T22:55:59.056 INFO:tasks.workunit.client.1.smithi047.stdout:8/211: mknod d8/d36/d40/d43/c46 0 2024-09-13T22:55:59.056 INFO:tasks.workunit.client.0.smithi002.stdout:0/86: write d1/d4/fb [445485,101586] 0 2024-09-13T22:55:59.058 INFO:tasks.workunit.client.0.smithi002.stdout:8/77: dwrite d3/dc/fd [0,4194304] 0 2024-09-13T22:55:59.060 INFO:tasks.workunit.client.0.smithi002.stdout:8/78: dread d3/f6 [0,4194304] 0 2024-09-13T22:55:59.068 INFO:tasks.workunit.client.0.smithi002.stdout:9/125: write f0 [832010,59618] 0 2024-09-13T22:55:59.069 INFO:tasks.workunit.client.1.smithi047.stdout:0/241: rename d1/d5/f8 to d1/d5/d16/d23/d2d/f55 0 2024-09-13T22:55:59.070 INFO:tasks.workunit.client.0.smithi002.stdout:9/126: write d8/d10/d1c/f12 [19077,70953] 0 2024-09-13T22:55:59.071 INFO:tasks.workunit.client.0.smithi002.stdout:5/99: unlink d1/c9 0 2024-09-13T22:55:59.073 INFO:tasks.workunit.client.1.smithi047.stdout:7/232: mknod d0/d7/da/d2e/d37/c4d 0 2024-09-13T22:55:59.073 INFO:tasks.workunit.client.0.smithi002.stdout:7/54: getdents d8/d10 0 2024-09-13T22:55:59.074 INFO:tasks.workunit.client.1.smithi047.stdout:7/233: write d0/db/f16 [654941,65899] 0 2024-09-13T22:55:59.074 INFO:tasks.workunit.client.1.smithi047.stdout:1/187: write d0/d7/d14/f2a [4830519,79679] 0 2024-09-13T22:55:59.075 INFO:tasks.workunit.client.0.smithi002.stdout:3/100: getdents d9/d15/d26 0 2024-09-13T22:55:59.079 INFO:tasks.workunit.client.1.smithi047.stdout:9/205: creat d1/dc/f43 x:0 0 0 2024-09-13T22:55:59.080 INFO:tasks.workunit.client.0.smithi002.stdout:4/50: mknod d3/cf 0 2024-09-13T22:55:59.082 INFO:tasks.workunit.client.1.smithi047.stdout:3/306: creat d0/d3/d4/d16/d32/d42/f64 x:0 0 0 2024-09-13T22:55:59.083 INFO:tasks.workunit.client.1.smithi047.stdout:7/234: dwrite d0/d7/da/d2e/f4b [0,4194304] 0 2024-09-13T22:55:59.085 INFO:tasks.workunit.client.0.smithi002.stdout:8/79: mknod d3/c14 0 2024-09-13T22:55:59.086 INFO:tasks.workunit.client.1.smithi047.stdout:4/198: dwrite fb [0,4194304] 0 2024-09-13T22:55:59.086 INFO:tasks.workunit.client.1.smithi047.stdout:3/307: readlink d0/d3/d4/d16/d2c/l1b 0 2024-09-13T22:55:59.090 INFO:tasks.workunit.client.0.smithi002.stdout:1/152: getdents d1/d13/d1d 0 2024-09-13T22:55:59.094 INFO:tasks.workunit.client.1.smithi047.stdout:0/242: dread d1/d5/d16/d23/f42 [0,4194304] 0 2024-09-13T22:55:59.097 INFO:tasks.workunit.client.0.smithi002.stdout:9/127: unlink d8/ff 0 2024-09-13T22:55:59.100 INFO:tasks.workunit.client.0.smithi002.stdout:5/100: fsync d1/f8 0 2024-09-13T22:55:59.102 INFO:tasks.workunit.client.1.smithi047.stdout:9/206: creat d1/f44 x:0 0 0 2024-09-13T22:55:59.102 INFO:tasks.workunit.client.0.smithi002.stdout:9/128: dread d8/d1e/f22 [0,4194304] 0 2024-09-13T22:55:59.102 INFO:tasks.workunit.client.0.smithi002.stdout:3/101: read f3 [917764,121121] 0 2024-09-13T22:55:59.103 INFO:tasks.workunit.client.1.smithi047.stdout:4/199: dread f6 [0,4194304] 0 2024-09-13T22:55:59.104 INFO:tasks.workunit.client.1.smithi047.stdout:4/200: fsync dc/de/f16 0 2024-09-13T22:55:59.105 INFO:tasks.workunit.client.1.smithi047.stdout:4/201: fsync dc/f3c 0 2024-09-13T22:55:59.105 INFO:tasks.workunit.client.0.smithi002.stdout:4/51: unlink d3/c9 0 2024-09-13T22:55:59.105 INFO:tasks.workunit.client.0.smithi002.stdout:4/52: stat f1 0 2024-09-13T22:55:59.106 INFO:tasks.workunit.client.1.smithi047.stdout:8/212: creat d8/d3e/f47 x:0 0 0 2024-09-13T22:55:59.107 INFO:tasks.workunit.client.0.smithi002.stdout:6/110: sync 2024-09-13T22:55:59.108 INFO:tasks.workunit.client.1.smithi047.stdout:7/235: write d0/db/f4c [2010464,15466] 0 2024-09-13T22:55:59.108 INFO:tasks.workunit.client.0.smithi002.stdout:8/80: mknod d3/c15 0 2024-09-13T22:55:59.109 INFO:tasks.workunit.client.0.smithi002.stdout:4/53: dread d3/fa [4194304,4194304] 0 2024-09-13T22:55:59.110 INFO:tasks.workunit.client.1.smithi047.stdout:6/222: creat d3/d11/f49 x:0 0 0 2024-09-13T22:55:59.112 INFO:tasks.workunit.client.0.smithi002.stdout:0/87: dwrite d1/d2/d10/f12 [0,4194304] 0 2024-09-13T22:55:59.113 INFO:tasks.workunit.client.0.smithi002.stdout:0/88: dread - d1/d2/fd zero size 2024-09-13T22:55:59.115 INFO:tasks.workunit.client.1.smithi047.stdout:0/243: rename d1/d5/c14 to d1/d5/d16/d23/c56 0 2024-09-13T22:55:59.116 INFO:tasks.workunit.client.1.smithi047.stdout:0/244: fdatasync d1/d7/f18 0 2024-09-13T22:55:59.117 INFO:tasks.workunit.client.1.smithi047.stdout:0/245: chown d1/c54 3 1 2024-09-13T22:55:59.118 INFO:tasks.workunit.client.1.smithi047.stdout:1/188: mkdir d0/d7/d14/d28/d34 0 2024-09-13T22:55:59.119 INFO:tasks.workunit.client.1.smithi047.stdout:1/189: chown d0/d7/d14/d28 237 1 2024-09-13T22:55:59.123 INFO:tasks.workunit.client.1.smithi047.stdout:9/207: creat d1/dc/d14/dd/f45 x:0 0 0 2024-09-13T22:55:59.125 INFO:tasks.workunit.client.1.smithi047.stdout:9/208: chown d1/d2d/c41 4914954 1 2024-09-13T22:55:59.126 INFO:tasks.workunit.client.1.smithi047.stdout:0/246: dwrite d1/d5/d16/d23/d45/f4f [0,4194304] 0 2024-09-13T22:55:59.128 INFO:tasks.workunit.client.0.smithi002.stdout:7/55: mkdir d8/d10/d11 0 2024-09-13T22:55:59.130 INFO:tasks.workunit.client.0.smithi002.stdout:2/71: sync 2024-09-13T22:55:59.131 INFO:tasks.workunit.client.1.smithi047.stdout:4/202: creat dc/d29/f41 x:0 0 0 2024-09-13T22:55:59.131 INFO:tasks.workunit.client.0.smithi002.stdout:1/153: dwrite d1/d13/d1d/f25 [0,4194304] 0 2024-09-13T22:55:59.132 INFO:tasks.workunit.client.0.smithi002.stdout:9/129: creat d8/d10/d1c/f2b x:0 0 0 2024-09-13T22:55:59.134 INFO:tasks.workunit.client.1.smithi047.stdout:9/209: dread d1/f2b [0,4194304] 0 2024-09-13T22:55:59.135 INFO:tasks.workunit.client.1.smithi047.stdout:9/210: write d1/f1a [137582,12111] 0 2024-09-13T22:55:59.138 INFO:tasks.workunit.client.1.smithi047.stdout:7/236: unlink d0/d7/f48 0 2024-09-13T22:55:59.140 INFO:tasks.workunit.client.1.smithi047.stdout:6/223: mknod d3/d11/d2b/d1c/c4a 0 2024-09-13T22:55:59.140 INFO:tasks.workunit.client.0.smithi002.stdout:6/111: rmdir d12/d17 39 2024-09-13T22:55:59.145 INFO:tasks.workunit.client.0.smithi002.stdout:6/112: dread fa [0,4194304] 0 2024-09-13T22:55:59.145 INFO:tasks.workunit.client.0.smithi002.stdout:3/102: write d9/f1a [508664,71646] 0 2024-09-13T22:55:59.146 INFO:tasks.workunit.client.0.smithi002.stdout:4/54: rename d3/f4 to d3/f10 0 2024-09-13T22:55:59.147 INFO:tasks.workunit.client.0.smithi002.stdout:3/103: write d9/df/f23 [62847,111221] 0 2024-09-13T22:55:59.147 INFO:tasks.workunit.client.1.smithi047.stdout:0/247: write d1/f36 [876048,110080] 0 2024-09-13T22:55:59.149 INFO:tasks.workunit.client.0.smithi002.stdout:0/89: creat d1/f1a x:0 0 0 2024-09-13T22:55:59.152 INFO:tasks.workunit.client.1.smithi047.stdout:8/213: link d8/f23 d8/d36/d40/f48 0 2024-09-13T22:55:59.154 INFO:tasks.workunit.client.1.smithi047.stdout:9/211: symlink d1/dc/l46 0 2024-09-13T22:55:59.155 INFO:tasks.workunit.client.0.smithi002.stdout:8/81: write d3/dc/f13 [1266858,60372] 0 2024-09-13T22:55:59.156 INFO:tasks.workunit.client.0.smithi002.stdout:7/56: unlink d8/d9/ce 0 2024-09-13T22:55:59.158 INFO:tasks.workunit.client.0.smithi002.stdout:2/72: creat d1/f14 x:0 0 0 2024-09-13T22:55:59.159 INFO:tasks.workunit.client.0.smithi002.stdout:9/130: mkdir d8/d2c 0 2024-09-13T22:55:59.161 INFO:tasks.workunit.client.0.smithi002.stdout:1/154: mkdir d1/d13/d1d/d2e 0 2024-09-13T22:55:59.161 INFO:tasks.workunit.client.1.smithi047.stdout:0/248: write d1/d5/d16/f3c [4354255,64688] 0 2024-09-13T22:55:59.162 INFO:tasks.workunit.client.0.smithi002.stdout:1/155: read d1/fe [3820536,38464] 0 2024-09-13T22:55:59.163 INFO:tasks.workunit.client.1.smithi047.stdout:4/203: link dc/de/f3f dc/de/d23/f42 0 2024-09-13T22:55:59.163 INFO:tasks.workunit.client.0.smithi002.stdout:1/156: fdatasync d1/f27 0 2024-09-13T22:55:59.164 INFO:tasks.workunit.client.1.smithi047.stdout:4/204: chown dc/de/d23 16219065 1 2024-09-13T22:55:59.165 INFO:tasks.workunit.client.0.smithi002.stdout:5/101: dread d1/d10/f15 [0,4194304] 0 2024-09-13T22:55:59.166 INFO:tasks.workunit.client.1.smithi047.stdout:8/214: creat d8/d36/d40/d43/f49 x:0 0 0 2024-09-13T22:55:59.167 INFO:tasks.workunit.client.1.smithi047.stdout:9/212: truncate d1/dc/d14/f16 14707 0 2024-09-13T22:55:59.169 INFO:tasks.workunit.client.1.smithi047.stdout:7/237: truncate d0/d19/f1c 1071779 0 2024-09-13T22:55:59.172 INFO:tasks.workunit.client.1.smithi047.stdout:1/190: truncate d0/d7/d14/f2b 571053 0 2024-09-13T22:55:59.173 INFO:tasks.workunit.client.1.smithi047.stdout:8/215: symlink d8/d36/d38/l4a 0 2024-09-13T22:55:59.173 INFO:tasks.workunit.client.1.smithi047.stdout:8/216: stat d8/f23 0 2024-09-13T22:55:59.175 INFO:tasks.workunit.client.1.smithi047.stdout:9/213: creat d1/dc/f47 x:0 0 0 2024-09-13T22:55:59.175 INFO:tasks.workunit.client.1.smithi047.stdout:9/214: fdatasync d1/dc/d14/f17 0 2024-09-13T22:55:59.176 INFO:tasks.workunit.client.1.smithi047.stdout:4/205: creat dc/de/d23/d40/f43 x:0 0 0 2024-09-13T22:55:59.177 INFO:tasks.workunit.client.0.smithi002.stdout:4/55: write f2 [2548338,70177] 0 2024-09-13T22:55:59.177 INFO:tasks.workunit.client.1.smithi047.stdout:1/191: symlink d0/d7/d14/d28/l35 0 2024-09-13T22:55:59.178 INFO:tasks.workunit.client.0.smithi002.stdout:4/56: chown d3/fb 1768003 1 2024-09-13T22:55:59.179 INFO:tasks.workunit.client.0.smithi002.stdout:4/57: truncate d3/fb 1859527 0 2024-09-13T22:55:59.179 INFO:tasks.workunit.client.0.smithi002.stdout:3/104: rename d9/f22 to d9/d15/f27 0 2024-09-13T22:55:59.179 INFO:tasks.workunit.client.0.smithi002.stdout:4/58: chown d3/l6 4624628 1 2024-09-13T22:55:59.181 INFO:tasks.workunit.client.0.smithi002.stdout:0/90: mknod d1/d2/c1b 0 2024-09-13T22:55:59.181 INFO:tasks.workunit.client.0.smithi002.stdout:0/91: stat d1/c16 0 2024-09-13T22:55:59.182 INFO:tasks.workunit.client.0.smithi002.stdout:0/92: dread - d1/f17 zero size 2024-09-13T22:55:59.183 INFO:tasks.workunit.client.0.smithi002.stdout:4/59: dread d3/fa [4194304,4194304] 0 2024-09-13T22:55:59.183 INFO:tasks.workunit.client.0.smithi002.stdout:8/82: mkdir d3/dc/d16 0 2024-09-13T22:55:59.184 INFO:tasks.workunit.client.0.smithi002.stdout:8/83: write d3/f5 [1684904,98039] 0 2024-09-13T22:55:59.186 INFO:tasks.workunit.client.0.smithi002.stdout:7/57: truncate f7 570382 0 2024-09-13T22:55:59.187 INFO:tasks.workunit.client.0.smithi002.stdout:7/58: chown d8/fb 3 1 2024-09-13T22:55:59.189 INFO:tasks.workunit.client.1.smithi047.stdout:9/215: rename d1/dc/d18/f19 to d1/dc/d18/f48 0 2024-09-13T22:55:59.189 INFO:tasks.workunit.client.0.smithi002.stdout:7/59: dread d8/fc [0,4194304] 0 2024-09-13T22:55:59.189 INFO:tasks.workunit.client.0.smithi002.stdout:2/73: fsync d1/f5 0 2024-09-13T22:55:59.190 INFO:tasks.workunit.client.0.smithi002.stdout:2/74: chown d1/d7/fb 64817702 1 2024-09-13T22:55:59.192 INFO:tasks.workunit.client.1.smithi047.stdout:1/192: rename d0/d7/d13/d1b to d0/d7/d14/d28/d36 0 2024-09-13T22:55:59.194 INFO:tasks.workunit.client.1.smithi047.stdout:8/217: mknod d8/c4b 0 2024-09-13T22:55:59.198 INFO:tasks.workunit.client.1.smithi047.stdout:1/193: write d0/d1d/f2e [577442,44246] 0 2024-09-13T22:55:59.201 INFO:tasks.workunit.client.0.smithi002.stdout:4/60: dwrite d3/f5 [0,4194304] 0 2024-09-13T22:55:59.201 INFO:tasks.workunit.client.1.smithi047.stdout:8/218: symlink d8/d36/d38/l4c 0 2024-09-13T22:55:59.206 INFO:tasks.workunit.client.1.smithi047.stdout:8/219: mkdir d8/d36/d40/d43/d4d 0 2024-09-13T22:55:59.206 INFO:tasks.workunit.client.1.smithi047.stdout:4/206: write dc/de/f3f [1042825,126464] 0 2024-09-13T22:55:59.207 INFO:tasks.workunit.client.1.smithi047.stdout:4/207: fsync fb 0 2024-09-13T22:55:59.208 INFO:tasks.workunit.client.0.smithi002.stdout:3/105: symlink d9/d15/l28 0 2024-09-13T22:55:59.210 INFO:tasks.workunit.client.0.smithi002.stdout:4/61: dwrite f2 [4194304,4194304] 0 2024-09-13T22:55:59.211 INFO:tasks.workunit.client.0.smithi002.stdout:4/62: write d3/fb [624670,56950] 0 2024-09-13T22:55:59.213 INFO:tasks.workunit.client.1.smithi047.stdout:1/194: truncate d0/d7/d10/f1f 907809 0 2024-09-13T22:55:59.214 INFO:tasks.workunit.client.1.smithi047.stdout:1/195: read - d0/d7/d10/f33 zero size 2024-09-13T22:55:59.215 INFO:tasks.workunit.client.0.smithi002.stdout:0/93: rmdir d1/d4 39 2024-09-13T22:55:59.217 INFO:tasks.workunit.client.0.smithi002.stdout:0/94: write d1/d2/d10/f12 [308129,18148] 0 2024-09-13T22:55:59.223 INFO:tasks.workunit.client.1.smithi047.stdout:4/208: mknod dc/de/d23/d40/c44 0 2024-09-13T22:55:59.230 INFO:tasks.workunit.client.1.smithi047.stdout:4/209: dwrite dc/d29/f41 [0,4194304] 0 2024-09-13T22:55:59.230 INFO:tasks.workunit.client.0.smithi002.stdout:9/131: mknod d8/d10/c2d 0 2024-09-13T22:55:59.232 INFO:tasks.workunit.client.1.smithi047.stdout:4/210: chown dc/de/d23/f37 837937 1 2024-09-13T22:55:59.239 INFO:tasks.workunit.client.0.smithi002.stdout:1/157: link d1/d13/d1d/f25 d1/d6/f2f 0 2024-09-13T22:55:59.240 INFO:tasks.workunit.client.1.smithi047.stdout:4/211: symlink dc/de/d17/d25/l45 0 2024-09-13T22:55:59.241 INFO:tasks.workunit.client.0.smithi002.stdout:7/60: write f1 [1227806,41687] 0 2024-09-13T22:55:59.242 INFO:tasks.workunit.client.0.smithi002.stdout:7/61: write f1 [1884673,128666] 0 2024-09-13T22:55:59.243 INFO:tasks.workunit.client.1.smithi047.stdout:1/196: creat d0/d7/f37 x:0 0 0 2024-09-13T22:55:59.245 INFO:tasks.workunit.client.1.smithi047.stdout:8/220: getdents d8/d36/d40/d43 0 2024-09-13T22:55:59.250 INFO:tasks.workunit.client.1.smithi047.stdout:8/221: rename d8/d36/d40/d43 to d8/d3e/d4e 0 2024-09-13T22:55:59.251 INFO:tasks.workunit.client.1.smithi047.stdout:4/212: mkdir dc/de/d17/d46 0 2024-09-13T22:55:59.253 INFO:tasks.workunit.client.1.smithi047.stdout:4/213: write dc/d29/f35 [165934,126815] 0 2024-09-13T22:55:59.254 INFO:tasks.workunit.client.1.smithi047.stdout:4/214: chown dc/d29/f35 61 1 2024-09-13T22:55:59.255 INFO:tasks.workunit.client.0.smithi002.stdout:8/84: symlink d3/dc/d16/l17 0 2024-09-13T22:55:59.256 INFO:tasks.workunit.client.1.smithi047.stdout:8/222: dwrite d8/f2e [0,4194304] 0 2024-09-13T22:55:59.256 INFO:tasks.workunit.client.0.smithi002.stdout:4/63: dwrite d3/f10 [4194304,4194304] 0 2024-09-13T22:55:59.257 INFO:tasks.workunit.client.0.smithi002.stdout:8/85: truncate d3/fa 2191466 0 2024-09-13T22:55:59.258 INFO:tasks.workunit.client.1.smithi047.stdout:8/223: chown d8/d36/d38/l4a 3945 1 2024-09-13T22:55:59.263 INFO:tasks.workunit.client.1.smithi047.stdout:4/215: unlink dc/l1d 0 2024-09-13T22:55:59.264 INFO:tasks.workunit.client.0.smithi002.stdout:8/86: dwrite d3/dc/f13 [0,4194304] 0 2024-09-13T22:55:59.267 INFO:tasks.workunit.client.0.smithi002.stdout:1/158: rename d1/d6 to d1/d13/d30 0 2024-09-13T22:55:59.269 INFO:tasks.workunit.client.1.smithi047.stdout:8/224: symlink d8/d36/d40/l4f 0 2024-09-13T22:55:59.272 INFO:tasks.workunit.client.0.smithi002.stdout:5/102: unlink d1/d10/l1f 0 2024-09-13T22:55:59.278 INFO:tasks.workunit.client.0.smithi002.stdout:1/159: dwrite d1/fb [0,4194304] 0 2024-09-13T22:55:59.279 INFO:tasks.workunit.client.1.smithi047.stdout:4/216: creat dc/de/d39/f47 x:0 0 0 2024-09-13T22:55:59.279 INFO:tasks.workunit.client.1.smithi047.stdout:4/217: chown dc/de/d17/d25/f36 812 1 2024-09-13T22:55:59.279 INFO:tasks.workunit.client.1.smithi047.stdout:4/218: dread f4 [0,4194304] 0 2024-09-13T22:55:59.280 INFO:tasks.workunit.client.0.smithi002.stdout:3/106: creat d9/d15/d26/f29 x:0 0 0 2024-09-13T22:55:59.282 INFO:tasks.workunit.client.0.smithi002.stdout:4/64: rename d3/cf to d3/c11 0 2024-09-13T22:55:59.284 INFO:tasks.workunit.client.1.smithi047.stdout:4/219: creat dc/de/d17/d46/f48 x:0 0 0 2024-09-13T22:55:59.285 INFO:tasks.workunit.client.0.smithi002.stdout:9/132: mknod d8/d2c/c2e 0 2024-09-13T22:55:59.286 INFO:tasks.workunit.client.0.smithi002.stdout:8/87: mkdir d3/dc/d18 0 2024-09-13T22:55:59.286 INFO:tasks.workunit.client.1.smithi047.stdout:4/220: creat dc/de/d23/f49 x:0 0 0 2024-09-13T22:55:59.288 INFO:tasks.workunit.client.0.smithi002.stdout:8/88: fsync d3/dc/fe 0 2024-09-13T22:55:59.289 INFO:tasks.workunit.client.0.smithi002.stdout:1/160: rmdir d1/d13/d1d 39 2024-09-13T22:55:59.289 INFO:tasks.workunit.client.0.smithi002.stdout:9/133: truncate d8/d10/f17 23695 0 2024-09-13T22:55:59.290 INFO:tasks.workunit.client.1.smithi047.stdout:4/221: mkdir dc/de/d17/d25/d4a 0 2024-09-13T22:55:59.291 INFO:tasks.workunit.client.0.smithi002.stdout:4/65: dwrite d3/fb [0,4194304] 0 2024-09-13T22:55:59.292 INFO:tasks.workunit.client.0.smithi002.stdout:6/113: link lc d12/l1f 0 2024-09-13T22:55:59.292 INFO:tasks.workunit.client.1.smithi047.stdout:8/225: write d8/d36/d40/f48 [2462159,49983] 0 2024-09-13T22:55:59.292 INFO:tasks.workunit.client.0.smithi002.stdout:4/66: chown d3/fb 946839283 1 2024-09-13T22:55:59.295 INFO:tasks.workunit.client.0.smithi002.stdout:0/95: link d1/f14 d1/f1c 0 2024-09-13T22:55:59.295 INFO:tasks.workunit.client.0.smithi002.stdout:8/89: dread d3/f4 [0,4194304] 0 2024-09-13T22:55:59.296 INFO:tasks.workunit.client.0.smithi002.stdout:3/107: creat d9/f2a x:0 0 0 2024-09-13T22:55:59.298 INFO:tasks.workunit.client.1.smithi047.stdout:4/222: symlink dc/de/d17/l4b 0 2024-09-13T22:55:59.299 INFO:tasks.workunit.client.0.smithi002.stdout:3/108: dread d9/d15/f27 [0,4194304] 0 2024-09-13T22:55:59.300 INFO:tasks.workunit.client.1.smithi047.stdout:8/226: rmdir d8/d36/d40 39 2024-09-13T22:55:59.301 INFO:tasks.workunit.client.0.smithi002.stdout:2/75: getdents d1 0 2024-09-13T22:55:59.304 INFO:tasks.workunit.client.1.smithi047.stdout:4/223: mkdir dc/d29/d4c 0 2024-09-13T22:55:59.306 INFO:tasks.workunit.client.0.smithi002.stdout:5/103: write d1/f18 [230579,52586] 0 2024-09-13T22:55:59.310 INFO:tasks.workunit.client.1.smithi047.stdout:4/224: rename dc/de/d17/d46 to dc/d29/d4d 0 2024-09-13T22:55:59.311 INFO:tasks.workunit.client.1.smithi047.stdout:4/225: fsync dc/d29/f35 0 2024-09-13T22:55:59.315 INFO:tasks.workunit.client.1.smithi047.stdout:8/227: dread d8/d36/f3a [0,4194304] 0 2024-09-13T22:55:59.316 INFO:tasks.workunit.client.1.smithi047.stdout:4/226: creat dc/d29/f4e x:0 0 0 2024-09-13T22:55:59.319 INFO:tasks.workunit.client.1.smithi047.stdout:8/228: symlink d8/d3f/l50 0 2024-09-13T22:55:59.320 INFO:tasks.workunit.client.1.smithi047.stdout:4/227: mknod dc/d29/d4c/c4f 0 2024-09-13T22:55:59.322 INFO:tasks.workunit.client.1.smithi047.stdout:4/228: unlink dc/de/l10 0 2024-09-13T22:55:59.322 INFO:tasks.workunit.client.1.smithi047.stdout:4/229: stat dc/de/f14 0 2024-09-13T22:55:59.323 INFO:tasks.workunit.client.1.smithi047.stdout:4/230: truncate dc/f2f 542016 0 2024-09-13T22:55:59.326 INFO:tasks.workunit.client.1.smithi047.stdout:4/231: link f8 dc/de/d17/d25/d4a/f50 0 2024-09-13T22:55:59.341 INFO:tasks.workunit.client.1.smithi047.stdout:8/229: truncate d8/f10 3436479 0 2024-09-13T22:55:59.343 INFO:tasks.workunit.client.1.smithi047.stdout:8/230: mknod d8/d36/d38/c51 0 2024-09-13T22:55:59.344 INFO:tasks.workunit.client.1.smithi047.stdout:4/232: read dc/de/d23/f37 [525128,31297] 0 2024-09-13T22:55:59.346 INFO:tasks.workunit.client.1.smithi047.stdout:4/233: write dc/de/d23/f3b [260731,78163] 0 2024-09-13T22:55:59.346 INFO:tasks.workunit.client.1.smithi047.stdout:8/231: rmdir d8/d3e 39 2024-09-13T22:55:59.347 INFO:tasks.workunit.client.1.smithi047.stdout:8/232: write d8/f21 [8431814,15875] 0 2024-09-13T22:55:59.351 INFO:tasks.workunit.client.1.smithi047.stdout:4/234: symlink dc/d29/l51 0 2024-09-13T22:55:59.357 INFO:tasks.workunit.client.1.smithi047.stdout:4/235: link f1 dc/de/f52 0 2024-09-13T22:55:59.358 INFO:tasks.workunit.client.0.smithi002.stdout:7/62: link f1 d8/f12 0 2024-09-13T22:55:59.358 INFO:tasks.workunit.client.0.smithi002.stdout:1/161: mkdir d1/d13/d30/d31 0 2024-09-13T22:55:59.358 INFO:tasks.workunit.client.0.smithi002.stdout:4/67: fsync f2 0 2024-09-13T22:55:59.358 INFO:tasks.workunit.client.0.smithi002.stdout:5/104: dwrite d1/f12 [0,4194304] 0 2024-09-13T22:55:59.358 INFO:tasks.workunit.client.0.smithi002.stdout:0/96: fsync d1/d4/fe 0 2024-09-13T22:55:59.360 INFO:tasks.workunit.client.0.smithi002.stdout:2/76: creat d1/f15 x:0 0 0 2024-09-13T22:55:59.360 INFO:tasks.workunit.client.0.smithi002.stdout:4/68: chown d3/fb 7648 1 2024-09-13T22:55:59.361 INFO:tasks.workunit.client.0.smithi002.stdout:2/77: chown d1/f2 5714 1 2024-09-13T22:55:59.362 INFO:tasks.workunit.client.0.smithi002.stdout:4/69: creat d3/f12 x:0 0 0 2024-09-13T22:55:59.363 INFO:tasks.workunit.client.0.smithi002.stdout:9/134: creat d8/d10/f2f x:0 0 0 2024-09-13T22:55:59.364 INFO:tasks.workunit.client.0.smithi002.stdout:4/70: write d3/fa [9283429,94979] 0 2024-09-13T22:55:59.365 INFO:tasks.workunit.client.0.smithi002.stdout:7/63: mkdir d8/d10/d11/d13 0 2024-09-13T22:55:59.367 INFO:tasks.workunit.client.0.smithi002.stdout:3/109: link d9/d15/c11 d9/df/c2b 0 2024-09-13T22:55:59.369 INFO:tasks.workunit.client.0.smithi002.stdout:2/78: creat d1/d7/f16 x:0 0 0 2024-09-13T22:55:59.370 INFO:tasks.workunit.client.0.smithi002.stdout:6/114: getdents d12 0 2024-09-13T22:55:59.371 INFO:tasks.workunit.client.0.smithi002.stdout:0/97: dwrite d1/d2/fd [0,4194304] 0 2024-09-13T22:55:59.371 INFO:tasks.workunit.client.1.smithi047.stdout:8/233: dwrite d8/f2c [4194304,4194304] 0 2024-09-13T22:55:59.373 INFO:tasks.workunit.client.0.smithi002.stdout:1/162: creat d1/d13/f32 x:0 0 0 2024-09-13T22:55:59.376 INFO:tasks.workunit.client.0.smithi002.stdout:4/71: mknod d3/c13 0 2024-09-13T22:55:59.378 INFO:tasks.workunit.client.1.smithi047.stdout:8/234: dwrite d8/f1c [0,4194304] 0 2024-09-13T22:55:59.381 INFO:tasks.workunit.client.0.smithi002.stdout:5/105: creat d1/d10/f21 x:0 0 0 2024-09-13T22:55:59.382 INFO:tasks.workunit.client.0.smithi002.stdout:4/72: dread d3/f5 [0,4194304] 0 2024-09-13T22:55:59.383 INFO:tasks.workunit.client.0.smithi002.stdout:7/64: symlink d8/d10/d11/l14 0 2024-09-13T22:55:59.384 INFO:tasks.workunit.client.0.smithi002.stdout:7/65: read d8/fb [326045,28629] 0 2024-09-13T22:55:59.386 INFO:tasks.workunit.client.1.smithi047.stdout:4/236: dwrite dc/f2f [0,4194304] 0 2024-09-13T22:55:59.388 INFO:tasks.workunit.client.1.smithi047.stdout:8/235: dwrite d8/f1c [0,4194304] 0 2024-09-13T22:55:59.390 INFO:tasks.workunit.client.0.smithi002.stdout:6/115: dread f1 [0,4194304] 0 2024-09-13T22:55:59.390 INFO:tasks.workunit.client.0.smithi002.stdout:2/79: creat d1/d7/d8/f17 x:0 0 0 2024-09-13T22:55:59.393 INFO:tasks.workunit.client.1.smithi047.stdout:4/237: creat dc/de/f53 x:0 0 0 2024-09-13T22:55:59.394 INFO:tasks.workunit.client.0.smithi002.stdout:6/116: dread fd [0,4194304] 0 2024-09-13T22:55:59.398 INFO:tasks.workunit.client.0.smithi002.stdout:5/106: stat d1/d10/l16 0 2024-09-13T22:55:59.400 INFO:tasks.workunit.client.0.smithi002.stdout:9/135: dwrite d8/d10/d1c/f19 [0,4194304] 0 2024-09-13T22:55:59.401 INFO:tasks.workunit.client.0.smithi002.stdout:9/136: write d8/d10/d1c/f12 [2044334,45465] 0 2024-09-13T22:55:59.408 INFO:tasks.workunit.client.0.smithi002.stdout:7/66: creat d8/d10/f15 x:0 0 0 2024-09-13T22:55:59.408 INFO:tasks.workunit.client.1.smithi047.stdout:8/236: link d8/l24 d8/d3e/l52 0 2024-09-13T22:55:59.410 INFO:tasks.workunit.client.0.smithi002.stdout:2/80: creat d1/f18 x:0 0 0 2024-09-13T22:55:59.410 INFO:tasks.workunit.client.0.smithi002.stdout:2/81: stat d1/d7/d8 0 2024-09-13T22:55:59.411 INFO:tasks.workunit.client.1.smithi047.stdout:4/238: getdents dc 0 2024-09-13T22:55:59.412 INFO:tasks.workunit.client.0.smithi002.stdout:1/163: mkdir d1/d13/d1d/d33 0 2024-09-13T22:55:59.413 INFO:tasks.workunit.client.0.smithi002.stdout:1/164: chown d1/d13/d30 472 1 2024-09-13T22:55:59.413 INFO:tasks.workunit.client.0.smithi002.stdout:1/165: readlink d1/d13/d30/l1b 0 2024-09-13T22:55:59.414 INFO:tasks.workunit.client.1.smithi047.stdout:8/237: dwrite d8/f1e [0,4194304] 0 2024-09-13T22:55:59.416 INFO:tasks.workunit.client.0.smithi002.stdout:2/82: dwrite d1/f5 [0,4194304] 0 2024-09-13T22:55:59.417 INFO:tasks.workunit.client.0.smithi002.stdout:6/117: creat d12/d17/f20 x:0 0 0 2024-09-13T22:55:59.418 INFO:tasks.workunit.client.0.smithi002.stdout:6/118: stat d12/d17/f18 0 2024-09-13T22:55:59.418 INFO:tasks.workunit.client.1.smithi047.stdout:4/239: mknod dc/de/c54 0 2024-09-13T22:55:59.423 INFO:tasks.workunit.client.0.smithi002.stdout:1/166: dwrite d1/d13/d1d/f29 [0,4194304] 0 2024-09-13T22:55:59.424 INFO:tasks.workunit.client.1.smithi047.stdout:4/240: dread dc/de/d23/f37 [0,4194304] 0 2024-09-13T22:55:59.426 INFO:tasks.workunit.client.1.smithi047.stdout:8/238: mknod d8/c53 0 2024-09-13T22:55:59.428 INFO:tasks.workunit.client.1.smithi047.stdout:4/241: chown dc/de/d23/c24 496256908 1 2024-09-13T22:55:59.429 INFO:tasks.workunit.client.0.smithi002.stdout:9/137: mknod d8/d2c/c30 0 2024-09-13T22:55:59.430 INFO:tasks.workunit.client.0.smithi002.stdout:3/110: link d9/d15/c20 d9/df/d10/c2c 0 2024-09-13T22:55:59.430 INFO:tasks.workunit.client.0.smithi002.stdout:5/107: dread d1/f8 [0,4194304] 0 2024-09-13T22:55:59.431 INFO:tasks.workunit.client.1.smithi047.stdout:4/242: creat dc/de/d23/f55 x:0 0 0 2024-09-13T22:55:59.432 INFO:tasks.workunit.client.1.smithi047.stdout:4/243: chown dc/de/d23/f37 1495131458 1 2024-09-13T22:55:59.434 INFO:tasks.workunit.client.1.smithi047.stdout:8/239: symlink d8/l54 0 2024-09-13T22:55:59.434 INFO:tasks.workunit.client.1.smithi047.stdout:8/240: chown d8/d3f 0 1 2024-09-13T22:55:59.435 INFO:tasks.workunit.client.1.smithi047.stdout:8/241: fdatasync d8/f2c 0 2024-09-13T22:55:59.436 INFO:tasks.workunit.client.1.smithi047.stdout:8/242: write d8/f32 [1194294,20116] 0 2024-09-13T22:55:59.436 INFO:tasks.workunit.client.1.smithi047.stdout:4/244: mknod dc/d29/d4d/c56 0 2024-09-13T22:55:59.439 INFO:tasks.workunit.client.0.smithi002.stdout:2/83: unlink d1/f3 0 2024-09-13T22:55:59.440 INFO:tasks.workunit.client.0.smithi002.stdout:6/119: rmdir d12 39 2024-09-13T22:55:59.447 INFO:tasks.workunit.client.0.smithi002.stdout:3/111: creat d9/d15/f2d x:0 0 0 2024-09-13T22:55:59.448 INFO:tasks.workunit.client.0.smithi002.stdout:3/112: write d9/df/d10/f18 [269448,34183] 0 2024-09-13T22:55:59.449 INFO:tasks.workunit.client.0.smithi002.stdout:3/113: readlink d9/d15/l28 0 2024-09-13T22:55:59.451 INFO:tasks.workunit.client.0.smithi002.stdout:2/84: mknod d1/d7/c19 0 2024-09-13T22:55:59.454 INFO:tasks.workunit.client.0.smithi002.stdout:4/73: getdents d3 0 2024-09-13T22:55:59.454 INFO:tasks.workunit.client.0.smithi002.stdout:4/74: readlink d3/l6 0 2024-09-13T22:55:59.455 INFO:tasks.workunit.client.1.smithi047.stdout:4/245: write dc/de/f52 [1595945,7147] 0 2024-09-13T22:55:59.456 INFO:tasks.workunit.client.0.smithi002.stdout:3/114: creat d9/df/d10/f2e x:0 0 0 2024-09-13T22:55:59.457 INFO:tasks.workunit.client.0.smithi002.stdout:3/115: write d9/df/d10/f2e [979740,35245] 0 2024-09-13T22:55:59.458 INFO:tasks.workunit.client.0.smithi002.stdout:3/116: write f5 [1991921,23235] 0 2024-09-13T22:55:59.459 INFO:tasks.workunit.client.0.smithi002.stdout:3/117: dread - d9/d15/d26/f29 zero size 2024-09-13T22:55:59.459 INFO:tasks.workunit.client.1.smithi047.stdout:8/243: dwrite d8/f26 [0,4194304] 0 2024-09-13T22:55:59.460 INFO:tasks.workunit.client.0.smithi002.stdout:2/85: creat d1/d7/d8/f1a x:0 0 0 2024-09-13T22:55:59.461 INFO:tasks.workunit.client.0.smithi002.stdout:9/138: truncate f5 4178494 0 2024-09-13T22:55:59.464 INFO:tasks.workunit.client.0.smithi002.stdout:6/120: creat d12/f21 x:0 0 0 2024-09-13T22:55:59.465 INFO:tasks.workunit.client.1.smithi047.stdout:4/246: read f8 [214618,126875] 0 2024-09-13T22:55:59.466 INFO:tasks.workunit.client.1.smithi047.stdout:4/247: chown dc/de/f53 1910794828 1 2024-09-13T22:55:59.466 INFO:tasks.workunit.client.0.smithi002.stdout:5/108: creat d1/d10/f22 x:0 0 0 2024-09-13T22:55:59.467 INFO:tasks.workunit.client.0.smithi002.stdout:7/67: link f7 d8/d9/f16 0 2024-09-13T22:55:59.467 INFO:tasks.workunit.client.1.smithi047.stdout:8/244: dwrite d8/d36/f3d [0,4194304] 0 2024-09-13T22:55:59.469 INFO:tasks.workunit.client.0.smithi002.stdout:3/118: unlink d9/df/l13 0 2024-09-13T22:55:59.470 INFO:tasks.workunit.client.0.smithi002.stdout:2/86: readlink d1/la 0 2024-09-13T22:55:59.470 INFO:tasks.workunit.client.0.smithi002.stdout:2/87: dread - d1/d7/fb zero size 2024-09-13T22:55:59.474 INFO:tasks.workunit.client.0.smithi002.stdout:9/139: creat d8/d2c/f31 x:0 0 0 2024-09-13T22:55:59.474 INFO:tasks.workunit.client.1.smithi047.stdout:8/245: dread d8/d36/f3c [0,4194304] 0 2024-09-13T22:55:59.476 INFO:tasks.workunit.client.1.smithi047.stdout:4/248: dwrite dc/d29/d4d/f48 [0,4194304] 0 2024-09-13T22:55:59.481 INFO:tasks.workunit.client.0.smithi002.stdout:7/68: chown f7 126 1 2024-09-13T22:55:59.481 INFO:tasks.workunit.client.1.smithi047.stdout:2/292: sync 2024-09-13T22:55:59.482 INFO:tasks.workunit.client.1.smithi047.stdout:8/246: mknod d8/d3e/c55 0 2024-09-13T22:55:59.482 INFO:tasks.workunit.client.0.smithi002.stdout:4/75: dwrite f2 [4194304,4194304] 0 2024-09-13T22:55:59.488 INFO:tasks.workunit.client.0.smithi002.stdout:3/119: rmdir d9/df 39 2024-09-13T22:55:59.491 INFO:tasks.workunit.client.1.smithi047.stdout:8/247: symlink d8/d36/d38/l56 0 2024-09-13T22:55:59.495 INFO:tasks.workunit.client.1.smithi047.stdout:2/293: fsync d1/df/d1d/d20/f42 0 2024-09-13T22:55:59.495 INFO:tasks.workunit.client.1.smithi047.stdout:4/249: write dc/fd [1019649,35951] 0 2024-09-13T22:55:59.497 INFO:tasks.workunit.client.1.smithi047.stdout:2/294: write d1/de/f13 [5018370,52712] 0 2024-09-13T22:55:59.498 INFO:tasks.workunit.client.1.smithi047.stdout:4/250: write dc/de/d39/f47 [542684,53400] 0 2024-09-13T22:55:59.498 INFO:tasks.workunit.client.1.smithi047.stdout:4/251: readlink dc/de/l3a 0 2024-09-13T22:55:59.500 INFO:tasks.workunit.client.1.smithi047.stdout:2/295: truncate d1/de/f5b 20303 0 2024-09-13T22:55:59.501 INFO:tasks.workunit.client.1.smithi047.stdout:2/296: stat d1/de/d17/f1c 0 2024-09-13T22:55:59.503 INFO:tasks.workunit.client.1.smithi047.stdout:8/248: link d8/f1a d8/d3e/f57 0 2024-09-13T22:55:59.505 INFO:tasks.workunit.client.1.smithi047.stdout:4/252: dwrite dc/d29/f35 [0,4194304] 0 2024-09-13T22:55:59.505 INFO:tasks.workunit.client.0.smithi002.stdout:9/140: symlink d8/d10/l32 0 2024-09-13T22:55:59.506 INFO:tasks.workunit.client.1.smithi047.stdout:4/253: dread - dc/de/d23/f49 zero size 2024-09-13T22:55:59.506 INFO:tasks.workunit.client.0.smithi002.stdout:6/121: unlink d12/d17/l1b 0 2024-09-13T22:55:59.506 INFO:tasks.workunit.client.0.smithi002.stdout:9/141: chown d8/d10/d1c/l2a 503550 1 2024-09-13T22:55:59.507 INFO:tasks.workunit.client.0.smithi002.stdout:8/90: sync 2024-09-13T22:55:59.509 INFO:tasks.workunit.client.0.smithi002.stdout:7/69: symlink d8/l17 0 2024-09-13T22:55:59.513 INFO:tasks.workunit.client.1.smithi047.stdout:4/254: creat dc/f57 x:0 0 0 2024-09-13T22:55:59.514 INFO:tasks.workunit.client.1.smithi047.stdout:2/297: symlink d1/df/d1d/l67 0 2024-09-13T22:55:59.517 INFO:tasks.workunit.client.0.smithi002.stdout:3/120: dwrite d9/df/f23 [0,4194304] 0 2024-09-13T22:55:59.517 INFO:tasks.workunit.client.0.smithi002.stdout:8/91: creat d3/dc/d16/f19 x:0 0 0 2024-09-13T22:55:59.523 INFO:tasks.workunit.client.1.smithi047.stdout:9/216: sync 2024-09-13T22:55:59.523 INFO:tasks.workunit.client.1.smithi047.stdout:1/197: sync 2024-09-13T22:55:59.523 INFO:tasks.workunit.client.1.smithi047.stdout:7/238: sync 2024-09-13T22:55:59.523 INFO:tasks.workunit.client.1.smithi047.stdout:0/249: sync 2024-09-13T22:55:59.524 INFO:tasks.workunit.client.1.smithi047.stdout:5/172: sync 2024-09-13T22:55:59.524 INFO:tasks.workunit.client.1.smithi047.stdout:6/224: sync 2024-09-13T22:55:59.524 INFO:tasks.workunit.client.1.smithi047.stdout:3/308: sync 2024-09-13T22:55:59.525 INFO:tasks.workunit.client.1.smithi047.stdout:7/239: readlink d0/d7/da/lf 0 2024-09-13T22:55:59.526 INFO:tasks.workunit.client.1.smithi047.stdout:8/249: link d8/d3e/d4e/c46 d8/d36/d40/c58 0 2024-09-13T22:55:59.526 INFO:tasks.workunit.client.1.smithi047.stdout:7/240: chown d0/d7/da/d2e 168858817 1 2024-09-13T22:55:59.527 INFO:tasks.workunit.client.1.smithi047.stdout:0/250: truncate d1/d5/f3f 683585 0 2024-09-13T22:55:59.528 INFO:tasks.workunit.client.1.smithi047.stdout:5/173: mkdir d19/d25/d45 0 2024-09-13T22:55:59.529 INFO:tasks.workunit.client.1.smithi047.stdout:9/217: truncate d1/dc/d14/d20/f37 200983 0 2024-09-13T22:55:59.529 INFO:tasks.workunit.client.1.smithi047.stdout:6/225: mknod d3/c4b 0 2024-09-13T22:55:59.529 INFO:tasks.workunit.client.1.smithi047.stdout:5/174: stat d19/f1d 0 2024-09-13T22:55:59.532 INFO:tasks.workunit.client.1.smithi047.stdout:9/218: write d1/dc/d14/dd/f45 [1014884,848] 0 2024-09-13T22:55:59.535 INFO:tasks.workunit.client.1.smithi047.stdout:5/175: write d19/f1c [4933720,75157] 0 2024-09-13T22:55:59.538 INFO:tasks.workunit.client.1.smithi047.stdout:9/219: symlink d1/dc/d14/d20/l49 0 2024-09-13T22:55:59.538 INFO:tasks.workunit.client.1.smithi047.stdout:0/251: dread d1/d5/d16/f3c [0,4194304] 0 2024-09-13T22:55:59.539 INFO:tasks.workunit.client.1.smithi047.stdout:5/176: creat d19/d34/f46 x:0 0 0 2024-09-13T22:55:59.539 INFO:tasks.workunit.client.1.smithi047.stdout:9/220: fdatasync d1/dc/d18/f35 0 2024-09-13T22:55:59.540 INFO:tasks.workunit.client.1.smithi047.stdout:5/177: chown c13 40250275 1 2024-09-13T22:55:59.541 INFO:tasks.workunit.client.1.smithi047.stdout:6/226: dwrite d3/d11/d2b/d1c/f1e [4194304,4194304] 0 2024-09-13T22:55:59.543 INFO:tasks.workunit.client.1.smithi047.stdout:6/227: write d3/f26 [1671855,29597] 0 2024-09-13T22:55:59.545 INFO:tasks.workunit.client.1.smithi047.stdout:6/228: write d3/d11/d2b/f28 [826966,33538] 0 2024-09-13T22:55:59.546 INFO:tasks.workunit.client.1.smithi047.stdout:6/229: dread - d3/d15/d30/f37 zero size 2024-09-13T22:55:59.550 INFO:tasks.workunit.client.1.smithi047.stdout:6/230: rename d3/d15 to d3/d11/d2b/d4c 0 2024-09-13T22:55:59.551 INFO:tasks.workunit.client.0.smithi002.stdout:5/109: rename d1/d10/c1c to d1/d10/c23 0 2024-09-13T22:55:59.552 INFO:tasks.workunit.client.1.smithi047.stdout:6/231: mkdir d3/d11/d2b/d1c/d4d 0 2024-09-13T22:55:59.553 INFO:tasks.workunit.client.0.smithi002.stdout:6/122: dwrite d12/f21 [0,4194304] 0 2024-09-13T22:55:59.553 INFO:tasks.workunit.client.0.smithi002.stdout:9/142: dwrite d8/fe [0,4194304] 0 2024-09-13T22:55:59.554 INFO:tasks.workunit.client.0.smithi002.stdout:3/121: creat d9/d15/f2f x:0 0 0 2024-09-13T22:55:59.555 INFO:tasks.workunit.client.1.smithi047.stdout:6/232: rmdir d3/d2c/d46 0 2024-09-13T22:55:59.556 INFO:tasks.workunit.client.0.smithi002.stdout:8/92: truncate d3/dc/d16/f19 879810 0 2024-09-13T22:55:59.556 INFO:tasks.workunit.client.0.smithi002.stdout:9/143: write f0 [214773,47749] 0 2024-09-13T22:55:59.556 INFO:tasks.workunit.client.1.smithi047.stdout:6/233: write d3/d11/f49 [44914,29684] 0 2024-09-13T22:55:59.557 INFO:tasks.workunit.client.0.smithi002.stdout:8/93: readlink d3/l12 0 2024-09-13T22:55:59.557 INFO:tasks.workunit.client.0.smithi002.stdout:5/110: rename d1/lc to d1/l24 0 2024-09-13T22:55:59.559 INFO:tasks.workunit.client.0.smithi002.stdout:4/76: truncate d3/f5 5763977 0 2024-09-13T22:55:59.564 INFO:tasks.workunit.client.1.smithi047.stdout:2/298: rmdir d1/df 39 2024-09-13T22:55:59.565 INFO:tasks.workunit.client.0.smithi002.stdout:3/122: creat d9/d15/f30 x:0 0 0 2024-09-13T22:55:59.565 INFO:tasks.workunit.client.0.smithi002.stdout:5/111: dread d1/f3 [0,4194304] 0 2024-09-13T22:55:59.565 INFO:tasks.workunit.client.0.smithi002.stdout:8/94: dread d3/f8 [0,4194304] 0 2024-09-13T22:55:59.566 INFO:tasks.workunit.client.1.smithi047.stdout:6/234: dread d3/d11/d2b/f28 [0,4194304] 0 2024-09-13T22:55:59.568 INFO:tasks.workunit.client.1.smithi047.stdout:6/235: read - d3/d11/d2b/d4c/d30/f44 zero size 2024-09-13T22:55:59.568 INFO:tasks.workunit.client.1.smithi047.stdout:6/236: stat d3/ld 0 2024-09-13T22:55:59.573 INFO:tasks.workunit.client.1.smithi047.stdout:1/198: write d0/d7/d14/f18 [742962,44913] 0 2024-09-13T22:55:59.573 INFO:tasks.workunit.client.0.smithi002.stdout:3/123: symlink d9/df/l31 0 2024-09-13T22:55:59.574 INFO:tasks.workunit.client.1.smithi047.stdout:1/199: write d0/d7/d14/f2b [623943,108781] 0 2024-09-13T22:55:59.575 INFO:tasks.workunit.client.1.smithi047.stdout:4/255: symlink dc/d29/l58 0 2024-09-13T22:55:59.577 INFO:tasks.workunit.client.1.smithi047.stdout:3/309: truncate d0/d3/d4/d16/f4e 197813 0 2024-09-13T22:55:59.578 INFO:tasks.workunit.client.0.smithi002.stdout:8/95: symlink d3/dc/l1a 0 2024-09-13T22:55:59.579 INFO:tasks.workunit.client.0.smithi002.stdout:0/98: sync 2024-09-13T22:55:59.580 INFO:tasks.workunit.client.1.smithi047.stdout:6/237: creat d3/d11/d2b/d4c/d30/d48/f4e x:0 0 0 2024-09-13T22:55:59.584 INFO:tasks.workunit.client.1.smithi047.stdout:6/238: write d3/f8 [1202460,89199] 0 2024-09-13T22:55:59.585 INFO:tasks.workunit.client.1.smithi047.stdout:8/250: dwrite d8/f10 [4194304,4194304] 0 2024-09-13T22:55:59.587 INFO:tasks.workunit.client.0.smithi002.stdout:8/96: dwrite d3/dc/fd [0,4194304] 0 2024-09-13T22:55:59.588 INFO:tasks.workunit.client.0.smithi002.stdout:0/99: dwrite d1/d2/d10/f12 [0,4194304] 0 2024-09-13T22:55:59.588 INFO:tasks.workunit.client.0.smithi002.stdout:8/97: read d3/dc/f13 [533359,13276] 0 2024-09-13T22:55:59.590 INFO:tasks.workunit.client.1.smithi047.stdout:7/241: dwrite d0/d7/f4a [0,4194304] 0 2024-09-13T22:55:59.590 INFO:tasks.workunit.client.1.smithi047.stdout:1/200: rename d0/fd to d0/d7/db/f38 0 2024-09-13T22:55:59.591 INFO:tasks.workunit.client.1.smithi047.stdout:0/252: truncate d1/d5/d16/d23/d2d/f55 1473324 0 2024-09-13T22:55:59.593 INFO:tasks.workunit.client.1.smithi047.stdout:6/239: fsync d3/f42 0 2024-09-13T22:55:59.594 INFO:tasks.workunit.client.0.smithi002.stdout:6/123: creat d12/f22 x:0 0 0 2024-09-13T22:55:59.596 INFO:tasks.workunit.client.0.smithi002.stdout:8/98: dwrite d3/dc/d16/f19 [0,4194304] 0 2024-09-13T22:55:59.597 INFO:tasks.workunit.client.1.smithi047.stdout:2/299: symlink d1/df/l68 0 2024-09-13T22:55:59.598 INFO:tasks.workunit.client.1.smithi047.stdout:8/251: write d8/f2c [4187746,110964] 0 2024-09-13T22:55:59.603 INFO:tasks.workunit.client.0.smithi002.stdout:8/99: dread d3/f5 [0,4194304] 0 2024-09-13T22:55:59.604 INFO:tasks.workunit.client.0.smithi002.stdout:3/124: creat d9/d15/d26/f32 x:0 0 0 2024-09-13T22:55:59.604 INFO:tasks.workunit.client.0.smithi002.stdout:8/100: stat d3/dc/d16/l17 0 2024-09-13T22:55:59.608 INFO:tasks.workunit.client.0.smithi002.stdout:5/112: symlink d1/d10/l25 0 2024-09-13T22:55:59.610 INFO:tasks.workunit.client.1.smithi047.stdout:5/178: dwrite d19/d34/f40 [0,4194304] 0 2024-09-13T22:55:59.610 INFO:tasks.workunit.client.1.smithi047.stdout:8/252: readlink d8/d3f/l50 0 2024-09-13T22:55:59.610 INFO:tasks.workunit.client.1.smithi047.stdout:9/221: dwrite d1/dc/d14/f16 [0,4194304] 0 2024-09-13T22:55:59.610 INFO:tasks.workunit.client.1.smithi047.stdout:1/201: chown d0/d1d/f2c 52392427 1 2024-09-13T22:55:59.611 INFO:tasks.workunit.client.1.smithi047.stdout:5/179: truncate d19/f1d 4567004 0 2024-09-13T22:55:59.617 INFO:tasks.workunit.client.0.smithi002.stdout:1/167: sync 2024-09-13T22:55:59.617 INFO:tasks.workunit.client.0.smithi002.stdout:2/88: sync 2024-09-13T22:55:59.618 INFO:tasks.workunit.client.1.smithi047.stdout:3/310: mkdir d0/d3/d65 0 2024-09-13T22:55:59.620 INFO:tasks.workunit.client.0.smithi002.stdout:4/77: dread d3/f5 [4194304,4194304] 0 2024-09-13T22:55:59.621 INFO:tasks.workunit.client.1.smithi047.stdout:3/311: write d0/d3/d4/d16/d32/d42/f64 [33754,89713] 0 2024-09-13T22:55:59.625 INFO:tasks.workunit.client.0.smithi002.stdout:2/89: dwrite d1/f18 [0,4194304] 0 2024-09-13T22:55:59.626 INFO:tasks.workunit.client.0.smithi002.stdout:2/90: fsync d1/f15 0 2024-09-13T22:55:59.628 INFO:tasks.workunit.client.0.smithi002.stdout:0/100: creat d1/d2/f1d x:0 0 0 2024-09-13T22:55:59.628 INFO:tasks.workunit.client.0.smithi002.stdout:2/91: write d1/f14 [971850,46105] 0 2024-09-13T22:55:59.628 INFO:tasks.workunit.client.0.smithi002.stdout:2/92: readlink d1/la 0 2024-09-13T22:55:59.635 INFO:tasks.workunit.client.1.smithi047.stdout:4/256: rename f1 to dc/de/d23/d40/f59 0 2024-09-13T22:55:59.639 INFO:tasks.workunit.client.1.smithi047.stdout:7/242: truncate d0/d7/f2c 139272 0 2024-09-13T22:55:59.640 INFO:tasks.workunit.client.0.smithi002.stdout:9/144: dwrite f5 [0,4194304] 0 2024-09-13T22:55:59.645 INFO:tasks.workunit.client.0.smithi002.stdout:8/101: rename d3/dc/d16/l17 to d3/dc/d18/l1b 0 2024-09-13T22:55:59.647 INFO:tasks.workunit.client.0.smithi002.stdout:5/113: symlink d1/l26 0 2024-09-13T22:55:59.648 INFO:tasks.workunit.client.0.smithi002.stdout:5/114: read d1/f13 [63469,44961] 0 2024-09-13T22:55:59.650 INFO:tasks.workunit.client.1.smithi047.stdout:5/180: readlink lb 0 2024-09-13T22:55:59.652 INFO:tasks.workunit.client.0.smithi002.stdout:4/78: mkdir d3/d14 0 2024-09-13T22:55:59.652 INFO:tasks.workunit.client.0.smithi002.stdout:4/79: read - d3/f12 zero size 2024-09-13T22:55:59.653 INFO:tasks.workunit.client.0.smithi002.stdout:5/115: dwrite d1/f1d [0,4194304] 0 2024-09-13T22:55:59.654 INFO:tasks.workunit.client.0.smithi002.stdout:5/116: fsync d1/f12 0 2024-09-13T22:55:59.655 INFO:tasks.workunit.client.1.smithi047.stdout:1/202: dread d0/d7/d10/f1f [0,4194304] 0 2024-09-13T22:55:59.656 INFO:tasks.workunit.client.0.smithi002.stdout:0/101: symlink d1/d2/d10/l1e 0 2024-09-13T22:55:59.657 INFO:tasks.workunit.client.1.smithi047.stdout:3/312: fsync d0/d3/d4/d16/d2c/de/d3d/f50 0 2024-09-13T22:55:59.659 INFO:tasks.workunit.client.1.smithi047.stdout:3/313: write d0/d3/d4/d16/d2c/de/d1f/d2e/f4a [1020293,50798] 0 2024-09-13T22:55:59.661 INFO:tasks.workunit.client.1.smithi047.stdout:3/314: stat d0/d3/d4/d16/f61 0 2024-09-13T22:55:59.663 INFO:tasks.workunit.client.1.smithi047.stdout:4/257: mknod dc/de/c5a 0 2024-09-13T22:55:59.664 INFO:tasks.workunit.client.1.smithi047.stdout:2/300: dread d1/df/d1d/d20/f42 [0,4194304] 0 2024-09-13T22:55:59.666 INFO:tasks.workunit.client.1.smithi047.stdout:4/258: stat dc/de/d17/f1b 0 2024-09-13T22:55:59.667 INFO:tasks.workunit.client.1.smithi047.stdout:0/253: getdents d1/d7 0 2024-09-13T22:55:59.667 INFO:tasks.workunit.client.1.smithi047.stdout:2/301: write d1/d16/f23 [5420817,113583] 0 2024-09-13T22:55:59.669 INFO:tasks.workunit.client.1.smithi047.stdout:7/243: mkdir d0/d7/da/d4e 0 2024-09-13T22:55:59.670 INFO:tasks.workunit.client.0.smithi002.stdout:3/125: symlink d9/l33 0 2024-09-13T22:55:59.671 INFO:tasks.workunit.client.1.smithi047.stdout:3/315: dwrite d0/f12 [0,4194304] 0 2024-09-13T22:55:59.671 INFO:tasks.workunit.client.1.smithi047.stdout:4/259: truncate dc/de/d23/f55 860658 0 2024-09-13T22:55:59.671 INFO:tasks.workunit.client.1.smithi047.stdout:2/302: truncate d1/d16/f64 86177 0 2024-09-13T22:55:59.674 INFO:tasks.workunit.client.1.smithi047.stdout:3/316: fsync d0/d3/d4/d16/d2c/de/d1f/d3b/f51 0 2024-09-13T22:55:59.674 INFO:tasks.workunit.client.0.smithi002.stdout:8/102: fdatasync d3/f5 0 2024-09-13T22:55:59.679 INFO:tasks.workunit.client.1.smithi047.stdout:8/253: truncate d8/d3e/f57 7272500 0 2024-09-13T22:55:59.683 INFO:tasks.workunit.client.1.smithi047.stdout:8/254: dread d8/d36/f3c [0,4194304] 0 2024-09-13T22:55:59.684 INFO:tasks.workunit.client.0.smithi002.stdout:0/102: rmdir d1/d2 39 2024-09-13T22:55:59.686 INFO:tasks.workunit.client.1.smithi047.stdout:6/240: truncate d3/f26 2236713 0 2024-09-13T22:55:59.688 INFO:tasks.workunit.client.1.smithi047.stdout:8/255: dread d8/f2e [0,4194304] 0 2024-09-13T22:55:59.689 INFO:tasks.workunit.client.1.smithi047.stdout:8/256: read d8/d36/d38/f45 [1589528,123162] 0 2024-09-13T22:55:59.691 INFO:tasks.workunit.client.1.smithi047.stdout:8/257: write d8/f2b [899791,75033] 0 2024-09-13T22:55:59.691 INFO:tasks.workunit.client.1.smithi047.stdout:6/241: dread d3/f7 [0,4194304] 0 2024-09-13T22:55:59.692 INFO:tasks.workunit.client.1.smithi047.stdout:8/258: write d8/f1e [4834118,95053] 0 2024-09-13T22:55:59.693 INFO:tasks.workunit.client.1.smithi047.stdout:8/259: fdatasync d8/f2e 0 2024-09-13T22:55:59.694 INFO:tasks.workunit.client.1.smithi047.stdout:8/260: read d8/d36/f3d [875764,61460] 0 2024-09-13T22:55:59.699 INFO:tasks.workunit.client.0.smithi002.stdout:9/145: symlink d8/d10/l33 0 2024-09-13T22:55:59.699 INFO:tasks.workunit.client.0.smithi002.stdout:9/146: readlink d8/d10/d1c/l2a 0 2024-09-13T22:55:59.700 INFO:tasks.workunit.client.1.smithi047.stdout:2/303: mknod d1/df/d1d/d20/d2b/c69 0 2024-09-13T22:55:59.700 INFO:tasks.workunit.client.0.smithi002.stdout:3/126: mknod d9/df/c34 0 2024-09-13T22:55:59.701 INFO:tasks.workunit.client.1.smithi047.stdout:8/261: dwrite d8/d36/d40/f48 [0,4194304] 0 2024-09-13T22:55:59.703 INFO:tasks.workunit.client.0.smithi002.stdout:8/103: write d3/dc/f13 [435401,118640] 0 2024-09-13T22:55:59.705 INFO:tasks.workunit.client.1.smithi047.stdout:5/181: creat d19/d25/d45/f47 x:0 0 0 2024-09-13T22:55:59.706 INFO:tasks.workunit.client.0.smithi002.stdout:4/80: creat d3/d14/f15 x:0 0 0 2024-09-13T22:55:59.707 INFO:tasks.workunit.client.0.smithi002.stdout:8/104: dread d3/fa [0,4194304] 0 2024-09-13T22:55:59.709 INFO:tasks.workunit.client.0.smithi002.stdout:5/117: symlink d1/d10/l27 0 2024-09-13T22:55:59.710 INFO:tasks.workunit.client.0.smithi002.stdout:5/118: write d1/d10/f22 [763583,38244] 0 2024-09-13T22:55:59.712 INFO:tasks.workunit.client.1.smithi047.stdout:9/222: link d1/dc/d14/f17 d1/dc/d14/f4a 0 2024-09-13T22:55:59.713 INFO:tasks.workunit.client.0.smithi002.stdout:0/103: stat d1/d2/f1d 0 2024-09-13T22:55:59.715 INFO:tasks.workunit.client.1.smithi047.stdout:5/182: dwrite d19/d34/f40 [0,4194304] 0 2024-09-13T22:55:59.716 INFO:tasks.workunit.client.0.smithi002.stdout:7/70: sync 2024-09-13T22:55:59.717 INFO:tasks.workunit.client.1.smithi047.stdout:5/183: write d19/d34/f46 [559217,48409] 0 2024-09-13T22:55:59.718 INFO:tasks.workunit.client.0.smithi002.stdout:6/124: rename d12/f13 to d12/f23 0 2024-09-13T22:55:59.720 INFO:tasks.workunit.client.1.smithi047.stdout:5/184: write d19/f36 [1752608,71117] 0 2024-09-13T22:55:59.722 INFO:tasks.workunit.client.1.smithi047.stdout:5/185: readlink d19/d25/l2c 0 2024-09-13T22:55:59.723 INFO:tasks.workunit.client.1.smithi047.stdout:9/223: dwrite d1/f40 [0,4194304] 0 2024-09-13T22:55:59.724 INFO:tasks.workunit.client.1.smithi047.stdout:5/186: write d19/d34/f46 [1422026,99643] 0 2024-09-13T22:55:59.725 INFO:tasks.workunit.client.1.smithi047.stdout:9/224: write d1/dc/f15 [1390074,83012] 0 2024-09-13T22:55:59.726 INFO:tasks.workunit.client.1.smithi047.stdout:5/187: write d19/d34/f40 [330562,105970] 0 2024-09-13T22:55:59.728 INFO:tasks.workunit.client.0.smithi002.stdout:3/127: mkdir d9/d15/d35 0 2024-09-13T22:55:59.731 INFO:tasks.workunit.client.0.smithi002.stdout:4/81: creat d3/d14/f16 x:0 0 0 2024-09-13T22:55:59.732 INFO:tasks.workunit.client.0.smithi002.stdout:4/82: truncate d3/fa 6387532 0 2024-09-13T22:55:59.734 INFO:tasks.workunit.client.0.smithi002.stdout:1/168: sync 2024-09-13T22:55:59.734 INFO:tasks.workunit.client.0.smithi002.stdout:8/105: symlink d3/dc/l1c 0 2024-09-13T22:55:59.737 INFO:tasks.workunit.client.0.smithi002.stdout:2/93: getdents d1 0 2024-09-13T22:55:59.739 INFO:tasks.workunit.client.1.smithi047.stdout:2/304: creat d1/d16/f6a x:0 0 0 2024-09-13T22:55:59.741 INFO:tasks.workunit.client.0.smithi002.stdout:9/147: link d8/d10/d1c/f2b d8/d1e/f34 0 2024-09-13T22:55:59.742 INFO:tasks.workunit.client.0.smithi002.stdout:9/148: write d8/d1e/f27 [521290,14158] 0 2024-09-13T22:55:59.744 INFO:tasks.workunit.client.0.smithi002.stdout:3/128: mkdir d9/d15/d36 0 2024-09-13T22:55:59.747 INFO:tasks.workunit.client.1.smithi047.stdout:1/203: rename d0/d7/d10/f1f to d0/d7/d13/f39 0 2024-09-13T22:55:59.748 INFO:tasks.workunit.client.1.smithi047.stdout:1/204: write d0/d1d/f2c [2053410,60051] 0 2024-09-13T22:55:59.749 INFO:tasks.workunit.client.0.smithi002.stdout:7/71: write f7 [761705,28221] 0 2024-09-13T22:55:59.750 INFO:tasks.workunit.client.0.smithi002.stdout:7/72: readlink d8/d10/d11/l14 0 2024-09-13T22:55:59.751 INFO:tasks.workunit.client.0.smithi002.stdout:8/106: mknod d3/dc/c1d 0 2024-09-13T22:55:59.752 INFO:tasks.workunit.client.0.smithi002.stdout:6/125: write f5 [2974651,124081] 0 2024-09-13T22:55:59.753 INFO:tasks.workunit.client.0.smithi002.stdout:1/169: mkdir d1/d13/d1d/d34 0 2024-09-13T22:55:59.759 INFO:tasks.workunit.client.0.smithi002.stdout:2/94: creat d1/d7/d8/f1b x:0 0 0 2024-09-13T22:55:59.761 INFO:tasks.workunit.client.1.smithi047.stdout:9/225: mknod d1/dc/c4b 0 2024-09-13T22:55:59.762 INFO:tasks.workunit.client.1.smithi047.stdout:9/226: chown d1/la 50 1 2024-09-13T22:55:59.765 INFO:tasks.workunit.client.0.smithi002.stdout:3/129: creat d9/df/d10/f37 x:0 0 0 2024-09-13T22:55:59.765 INFO:tasks.workunit.client.1.smithi047.stdout:6/242: symlink d3/d11/d2b/d1c/d4d/l4f 0 2024-09-13T22:55:59.767 INFO:tasks.workunit.client.1.smithi047.stdout:0/254: link d1/d5/d16/f3c d1/d5/d11/f57 0 2024-09-13T22:55:59.767 INFO:tasks.workunit.client.1.smithi047.stdout:7/244: rmdir d0/d19/d32/d49 0 2024-09-13T22:55:59.769 INFO:tasks.workunit.client.0.smithi002.stdout:8/107: symlink d3/l1e 0 2024-09-13T22:55:59.773 INFO:tasks.workunit.client.1.smithi047.stdout:4/260: rename dc/de/c54 to dc/de/d17/d25/d4a/c5b 0 2024-09-13T22:55:59.773 INFO:tasks.workunit.client.1.smithi047.stdout:1/205: creat d0/d7/db/f3a x:0 0 0 2024-09-13T22:55:59.774 INFO:tasks.workunit.client.0.smithi002.stdout:6/126: fsync d12/d17/f20 0 2024-09-13T22:55:59.774 INFO:tasks.workunit.client.0.smithi002.stdout:8/108: dread d3/f5 [4194304,4194304] 0 2024-09-13T22:55:59.774 INFO:tasks.workunit.client.0.smithi002.stdout:5/119: creat d1/d10/f28 x:0 0 0 2024-09-13T22:55:59.774 INFO:tasks.workunit.client.0.smithi002.stdout:0/104: creat d1/f1f x:0 0 0 2024-09-13T22:55:59.774 INFO:tasks.workunit.client.1.smithi047.stdout:5/188: creat d19/d34/d42/f48 x:0 0 0 2024-09-13T22:55:59.775 INFO:tasks.workunit.client.0.smithi002.stdout:2/95: symlink d1/l1c 0 2024-09-13T22:55:59.775 INFO:tasks.workunit.client.0.smithi002.stdout:2/96: chown d1 20258 1 2024-09-13T22:55:59.775 INFO:tasks.workunit.client.1.smithi047.stdout:9/227: mkdir d1/dc/d14/dd/d4c 0 2024-09-13T22:55:59.777 INFO:tasks.workunit.client.0.smithi002.stdout:2/97: readlink d1/la 0 2024-09-13T22:55:59.777 INFO:tasks.workunit.client.1.smithi047.stdout:6/243: unlink d3/d11/d2b/d4c/d30/l31 0 2024-09-13T22:55:59.778 INFO:tasks.workunit.client.1.smithi047.stdout:0/255: symlink d1/d5/d16/d23/l58 0 2024-09-13T22:55:59.779 INFO:tasks.workunit.client.0.smithi002.stdout:0/105: dwrite d1/d2/f19 [0,4194304] 0 2024-09-13T22:55:59.779 INFO:tasks.workunit.client.0.smithi002.stdout:0/106: rename d1 to d1/d4/d20 22 2024-09-13T22:55:59.782 INFO:tasks.workunit.client.1.smithi047.stdout:3/317: getdents d0/d3/d4/d16/d2c/de/d1f 0 2024-09-13T22:55:59.784 INFO:tasks.workunit.client.0.smithi002.stdout:7/73: symlink d8/d10/d11/d13/l18 0 2024-09-13T22:55:59.785 INFO:tasks.workunit.client.0.smithi002.stdout:7/74: write f6 [905755,84663] 0 2024-09-13T22:55:59.785 INFO:tasks.workunit.client.0.smithi002.stdout:3/130: dwrite d9/d15/f27 [0,4194304] 0 2024-09-13T22:55:59.787 INFO:tasks.workunit.client.0.smithi002.stdout:6/127: write d12/f14 [3464495,85971] 0 2024-09-13T22:55:59.787 INFO:tasks.workunit.client.0.smithi002.stdout:7/75: write d8/d9/fd [5849919,41512] 0 2024-09-13T22:55:59.788 INFO:tasks.workunit.client.0.smithi002.stdout:6/128: dread - d12/d17/f20 zero size 2024-09-13T22:55:59.788 INFO:tasks.workunit.client.1.smithi047.stdout:7/245: dwrite d0/d7/f1d [0,4194304] 0 2024-09-13T22:55:59.789 INFO:tasks.workunit.client.1.smithi047.stdout:7/246: fsync d0/d7/f2c 0 2024-09-13T22:55:59.791 INFO:tasks.workunit.client.0.smithi002.stdout:1/170: creat d1/d13/d1d/d34/f35 x:0 0 0 2024-09-13T22:55:59.792 INFO:tasks.workunit.client.1.smithi047.stdout:4/261: symlink dc/de/d17/d25/d4a/l5c 0 2024-09-13T22:55:59.794 INFO:tasks.workunit.client.0.smithi002.stdout:8/109: creat d3/dc/d18/f1f x:0 0 0 2024-09-13T22:55:59.799 INFO:tasks.workunit.client.1.smithi047.stdout:9/228: dread d1/dc/d14/f17 [4194304,4194304] 0 2024-09-13T22:55:59.799 INFO:tasks.workunit.client.1.smithi047.stdout:5/189: mkdir d19/d23/d32/d49 0 2024-09-13T22:55:59.800 INFO:tasks.workunit.client.0.smithi002.stdout:7/76: dwrite f6 [0,4194304] 0 2024-09-13T22:55:59.803 INFO:tasks.workunit.client.0.smithi002.stdout:6/129: dwrite d12/f21 [0,4194304] 0 2024-09-13T22:55:59.804 INFO:tasks.workunit.client.1.smithi047.stdout:4/262: dwrite dc/d29/f41 [4194304,4194304] 0 2024-09-13T22:55:59.804 INFO:tasks.workunit.client.1.smithi047.stdout:5/190: write d19/d34/f46 [533711,72254] 0 2024-09-13T22:55:59.804 INFO:tasks.workunit.client.0.smithi002.stdout:2/98: creat d1/f1d x:0 0 0 2024-09-13T22:55:59.805 INFO:tasks.workunit.client.0.smithi002.stdout:1/171: dread d1/d13/d1d/f29 [0,4194304] 0 2024-09-13T22:55:59.807 INFO:tasks.workunit.client.1.smithi047.stdout:6/244: readlink d3/d11/l2d 0 2024-09-13T22:55:59.809 INFO:tasks.workunit.client.0.smithi002.stdout:4/83: getdents d3 0 2024-09-13T22:55:59.809 INFO:tasks.workunit.client.0.smithi002.stdout:9/149: truncate d8/d10/d1c/f19 699335 0 2024-09-13T22:55:59.811 INFO:tasks.workunit.client.0.smithi002.stdout:2/99: dwrite d1/f14 [0,4194304] 0 2024-09-13T22:55:59.816 INFO:tasks.workunit.client.0.smithi002.stdout:0/107: rename d1/d2/d10/f12 to d1/d4/f21 0 2024-09-13T22:55:59.817 INFO:tasks.workunit.client.1.smithi047.stdout:4/263: dwrite dc/de/f53 [0,4194304] 0 2024-09-13T22:55:59.838 INFO:tasks.workunit.client.0.smithi002.stdout:5/120: mknod d1/d10/c29 0 2024-09-13T22:55:59.841 INFO:tasks.workunit.client.0.smithi002.stdout:6/130: readlink d12/l1f 0 2024-09-13T22:55:59.843 INFO:tasks.workunit.client.0.smithi002.stdout:1/172: unlink d1/d13/d1d/f25 0 2024-09-13T22:55:59.845 INFO:tasks.workunit.client.0.smithi002.stdout:4/84: rmdir d3 39 2024-09-13T22:55:59.845 INFO:tasks.workunit.client.0.smithi002.stdout:7/77: write d8/f12 [1738835,126818] 0 2024-09-13T22:55:59.846 INFO:tasks.workunit.client.1.smithi047.stdout:0/256: fdatasync d1/d5/d16/d23/d2d/f55 0 2024-09-13T22:55:59.847 INFO:tasks.workunit.client.0.smithi002.stdout:7/78: fsync f6 0 2024-09-13T22:55:59.847 INFO:tasks.workunit.client.0.smithi002.stdout:2/100: creat d1/d7/d8/f1e x:0 0 0 2024-09-13T22:55:59.849 INFO:tasks.workunit.client.0.smithi002.stdout:2/101: dread - d1/d7/fb zero size 2024-09-13T22:55:59.850 INFO:tasks.workunit.client.0.smithi002.stdout:1/173: dwrite d1/f15 [0,4194304] 0 2024-09-13T22:55:59.851 INFO:tasks.workunit.client.0.smithi002.stdout:9/150: rename d8/c28 to d8/d10/d1c/c35 0 2024-09-13T22:55:59.852 INFO:tasks.workunit.client.0.smithi002.stdout:9/151: fsync d8/d1e/f25 0 2024-09-13T22:55:59.853 INFO:tasks.workunit.client.1.smithi047.stdout:2/305: rename d1/l5f to d1/df/l6b 0 2024-09-13T22:55:59.854 INFO:tasks.workunit.client.0.smithi002.stdout:1/174: dread d1/fb [0,4194304] 0 2024-09-13T22:55:59.856 INFO:tasks.workunit.client.0.smithi002.stdout:0/108: symlink d1/d2/l22 0 2024-09-13T22:55:59.857 INFO:tasks.workunit.client.1.smithi047.stdout:4/264: dwrite dc/fd [0,4194304] 0 2024-09-13T22:55:59.857 INFO:tasks.workunit.client.0.smithi002.stdout:0/109: truncate d1/d4/f7 844163 0 2024-09-13T22:55:59.857 INFO:tasks.workunit.client.0.smithi002.stdout:0/110: dread - d1/d2/f1d zero size 2024-09-13T22:55:59.858 INFO:tasks.workunit.client.0.smithi002.stdout:0/111: write d1/d2/f19 [4706655,101133] 0 2024-09-13T22:55:59.859 INFO:tasks.workunit.client.1.smithi047.stdout:4/265: chown dc/de/d17/d25/d4a 2237 1 2024-09-13T22:55:59.859 INFO:tasks.workunit.client.1.smithi047.stdout:7/247: creat d0/d7/da/d4e/f4f x:0 0 0 2024-09-13T22:55:59.859 INFO:tasks.workunit.client.1.smithi047.stdout:3/318: write d0/d3/d4/d16/d1c/f2d [1231064,59401] 0 2024-09-13T22:55:59.860 INFO:tasks.workunit.client.0.smithi002.stdout:3/131: creat d9/d15/d36/f38 x:0 0 0 2024-09-13T22:55:59.861 INFO:tasks.workunit.client.0.smithi002.stdout:3/132: readlink d9/d15/l28 0 2024-09-13T22:55:59.862 INFO:tasks.workunit.client.0.smithi002.stdout:3/133: read d9/f1a [516360,93896] 0 2024-09-13T22:55:59.863 INFO:tasks.workunit.client.1.smithi047.stdout:1/206: rmdir d0/d7/d14/d28/d34 0 2024-09-13T22:55:59.864 INFO:tasks.workunit.client.1.smithi047.stdout:3/319: truncate d0/d25/d34/f4f 875829 0 2024-09-13T22:55:59.865 INFO:tasks.workunit.client.1.smithi047.stdout:1/207: write d0/d7/d14/f27 [5280465,118557] 0 2024-09-13T22:55:59.865 INFO:tasks.workunit.client.0.smithi002.stdout:0/112: dwrite d1/d4/f7 [0,4194304] 0 2024-09-13T22:55:59.867 INFO:tasks.workunit.client.0.smithi002.stdout:8/110: link d3/dc/d16/f19 d3/f20 0 2024-09-13T22:55:59.867 INFO:tasks.workunit.client.1.smithi047.stdout:5/191: symlink d19/d23/d2e/d41/l4a 0 2024-09-13T22:55:59.867 INFO:tasks.workunit.client.1.smithi047.stdout:1/208: write d0/d1d/f2c [490763,66518] 0 2024-09-13T22:55:59.869 INFO:tasks.workunit.client.1.smithi047.stdout:5/192: fsync d19/d25/f38 0 2024-09-13T22:55:59.869 INFO:tasks.workunit.client.0.smithi002.stdout:5/121: mkdir d1/d2a 0 2024-09-13T22:55:59.871 INFO:tasks.workunit.client.1.smithi047.stdout:1/209: write d0/d1d/f2c [1816184,36438] 0 2024-09-13T22:55:59.871 INFO:tasks.workunit.client.1.smithi047.stdout:7/248: dread d0/d7/f1d [0,4194304] 0 2024-09-13T22:55:59.875 INFO:tasks.workunit.client.0.smithi002.stdout:4/85: dread d3/f5 [4194304,4194304] 0 2024-09-13T22:55:59.875 INFO:tasks.workunit.client.1.smithi047.stdout:1/210: write d0/d1d/f2c [1443707,123458] 0 2024-09-13T22:55:59.877 INFO:tasks.workunit.client.0.smithi002.stdout:2/102: readlink d1/d7/d8/l13 0 2024-09-13T22:55:59.879 INFO:tasks.workunit.client.1.smithi047.stdout:4/266: write f4 [3671844,109781] 0 2024-09-13T22:55:59.881 INFO:tasks.workunit.client.1.smithi047.stdout:7/249: truncate d0/d7/da/d4e/f4f 804158 0 2024-09-13T22:55:59.881 INFO:tasks.workunit.client.1.smithi047.stdout:3/320: dwrite d0/d25/d44/d43/f30 [0,4194304] 0 2024-09-13T22:55:59.884 INFO:tasks.workunit.client.0.smithi002.stdout:9/152: creat d8/d1e/f36 x:0 0 0 2024-09-13T22:55:59.887 INFO:tasks.workunit.client.1.smithi047.stdout:9/229: link d1/dc/d14/f13 d1/dc/d14/f4d 0 2024-09-13T22:55:59.888 INFO:tasks.workunit.client.1.smithi047.stdout:9/230: dread - d1/dc/d18/f35 zero size 2024-09-13T22:55:59.889 INFO:tasks.workunit.client.1.smithi047.stdout:9/231: chown d1/dc/d14/dd/l3a 30826 1 2024-09-13T22:55:59.891 INFO:tasks.workunit.client.1.smithi047.stdout:5/193: dread d19/f1d [0,4194304] 0 2024-09-13T22:55:59.898 INFO:tasks.workunit.client.0.smithi002.stdout:7/79: write d8/fc [550978,117612] 0 2024-09-13T22:55:59.899 INFO:tasks.workunit.client.0.smithi002.stdout:7/80: truncate d8/d9/f16 1632126 0 2024-09-13T22:55:59.900 INFO:tasks.workunit.client.0.smithi002.stdout:3/134: rename c7 to d9/df/c39 0 2024-09-13T22:55:59.903 INFO:tasks.workunit.client.0.smithi002.stdout:0/113: unlink d1/f1f 0 2024-09-13T22:55:59.904 INFO:tasks.workunit.client.0.smithi002.stdout:8/111: mkdir d3/d21 0 2024-09-13T22:55:59.904 INFO:tasks.workunit.client.0.smithi002.stdout:7/81: dwrite f1 [0,4194304] 0 2024-09-13T22:55:59.905 INFO:tasks.workunit.client.0.smithi002.stdout:7/82: write d8/d10/f15 [524667,54358] 0 2024-09-13T22:55:59.906 INFO:tasks.workunit.client.0.smithi002.stdout:7/83: stat f6 0 2024-09-13T22:55:59.907 INFO:tasks.workunit.client.0.smithi002.stdout:7/84: write d8/d10/f15 [464041,115944] 0 2024-09-13T22:55:59.909 INFO:tasks.workunit.client.1.smithi047.stdout:2/306: creat d1/df/d1d/d20/d37/d43/f6c x:0 0 0 2024-09-13T22:55:59.910 INFO:tasks.workunit.client.1.smithi047.stdout:2/307: write d1/df/d26/f30 [4010238,5673] 0 2024-09-13T22:55:59.914 INFO:tasks.workunit.client.0.smithi002.stdout:4/86: creat d3/f17 x:0 0 0 2024-09-13T22:55:59.916 INFO:tasks.workunit.client.1.smithi047.stdout:1/211: rename d0/d7/c22 to d0/c3b 0 2024-09-13T22:55:59.918 INFO:tasks.workunit.client.1.smithi047.stdout:1/212: dread d0/d7/d14/f18 [0,4194304] 0 2024-09-13T22:55:59.920 INFO:tasks.workunit.client.1.smithi047.stdout:4/267: unlink dc/f57 0 2024-09-13T22:55:59.926 INFO:tasks.workunit.client.0.smithi002.stdout:5/122: rename d1/d10/c29 to d1/c2b 0 2024-09-13T22:55:59.927 INFO:tasks.workunit.client.1.smithi047.stdout:5/194: rmdir d19/d23/d2e 39 2024-09-13T22:55:59.929 INFO:tasks.workunit.client.1.smithi047.stdout:6/245: getdents d3/d11/d2b/d1c/d23 0 2024-09-13T22:55:59.930 INFO:tasks.workunit.client.1.smithi047.stdout:6/246: write d3/f8 [1793485,73634] 0 2024-09-13T22:55:59.931 INFO:tasks.workunit.client.0.smithi002.stdout:9/153: write d8/d1e/f34 [809201,77240] 0 2024-09-13T22:55:59.932 INFO:tasks.workunit.client.0.smithi002.stdout:9/154: chown d8/d1e/f27 1 1 2024-09-13T22:55:59.933 INFO:tasks.workunit.client.0.smithi002.stdout:9/155: dread - d8/d2c/f31 zero size 2024-09-13T22:55:59.933 INFO:tasks.workunit.client.1.smithi047.stdout:0/257: creat d1/d5/f59 x:0 0 0 2024-09-13T22:55:59.933 INFO:tasks.workunit.client.0.smithi002.stdout:9/156: readlink d8/d10/d1c/l1a 0 2024-09-13T22:55:59.934 INFO:tasks.workunit.client.1.smithi047.stdout:0/258: chown d1/d7/f18 84219 1 2024-09-13T22:55:59.938 INFO:tasks.workunit.client.1.smithi047.stdout:6/247: dwrite d3/d11/d2b/d4c/d30/f47 [0,4194304] 0 2024-09-13T22:55:59.940 INFO:tasks.workunit.client.0.smithi002.stdout:6/131: link d12/f14 d12/f24 0 2024-09-13T22:55:59.940 INFO:tasks.workunit.client.0.smithi002.stdout:8/112: write d3/f20 [3702078,21839] 0 2024-09-13T22:55:59.947 INFO:tasks.workunit.client.1.smithi047.stdout:3/321: link d0/d3/d4/d16/d2c/de/d1f/d3b/f51 d0/d25/d44/d5a/f66 0 2024-09-13T22:55:59.953 INFO:tasks.workunit.client.1.smithi047.stdout:0/259: creat d1/d5/d16/d23/d2d/f5a x:0 0 0 2024-09-13T22:55:59.955 INFO:tasks.workunit.client.0.smithi002.stdout:4/87: creat d3/f18 x:0 0 0 2024-09-13T22:55:59.955 INFO:tasks.workunit.client.0.smithi002.stdout:2/103: rename d1/d7/fb to d1/f1f 0 2024-09-13T22:55:59.956 INFO:tasks.workunit.client.0.smithi002.stdout:3/135: creat d9/d15/d35/f3a x:0 0 0 2024-09-13T22:55:59.956 INFO:tasks.workunit.client.1.smithi047.stdout:6/248: rmdir d3/d11 39 2024-09-13T22:55:59.958 INFO:tasks.workunit.client.0.smithi002.stdout:9/157: creat d8/f37 x:0 0 0 2024-09-13T22:55:59.959 INFO:tasks.workunit.client.0.smithi002.stdout:2/104: write d1/f14 [3488378,74926] 0 2024-09-13T22:55:59.959 INFO:tasks.workunit.client.1.smithi047.stdout:7/250: truncate d0/d7/da/d1e/f22 4013083 0 2024-09-13T22:55:59.961 INFO:tasks.workunit.client.0.smithi002.stdout:2/105: read - d1/d7/d8/f17 zero size 2024-09-13T22:55:59.961 INFO:tasks.workunit.client.0.smithi002.stdout:5/123: symlink d1/d2a/l2c 0 2024-09-13T22:55:59.962 INFO:tasks.workunit.client.1.smithi047.stdout:3/322: symlink d0/d3/d4/d16/d1c/l67 0 2024-09-13T22:55:59.963 INFO:tasks.workunit.client.0.smithi002.stdout:6/132: dwrite d12/d17/f1e [0,4194304] 0 2024-09-13T22:55:59.965 INFO:tasks.workunit.client.1.smithi047.stdout:9/232: rmdir d1/dc/d14/d42 0 2024-09-13T22:55:59.966 INFO:tasks.workunit.client.0.smithi002.stdout:4/88: dwrite d3/f12 [0,4194304] 0 2024-09-13T22:55:59.968 INFO:tasks.workunit.client.1.smithi047.stdout:5/195: dwrite d19/f1d [4194304,4194304] 0 2024-09-13T22:55:59.969 INFO:tasks.workunit.client.1.smithi047.stdout:2/308: truncate d1/d16/f23 857067 0 2024-09-13T22:55:59.969 INFO:tasks.workunit.client.1.smithi047.stdout:0/260: fsync d1/d5/d11/f2b 0 2024-09-13T22:55:59.970 INFO:tasks.workunit.client.1.smithi047.stdout:2/309: chown d1/df/c3e 796 1 2024-09-13T22:55:59.973 INFO:tasks.workunit.client.1.smithi047.stdout:2/310: write d1/df/d1d/d20/d37/d43/f6c [845120,50323] 0 2024-09-13T22:55:59.973 INFO:tasks.workunit.client.0.smithi002.stdout:1/175: creat d1/d13/d21/f36 x:0 0 0 2024-09-13T22:55:59.977 INFO:tasks.workunit.client.0.smithi002.stdout:6/133: dwrite f1 [0,4194304] 0 2024-09-13T22:55:59.978 INFO:tasks.workunit.client.1.smithi047.stdout:1/213: creat d0/d7/d13/f3c x:0 0 0 2024-09-13T22:55:59.981 INFO:tasks.workunit.client.0.smithi002.stdout:4/89: dwrite d3/f10 [4194304,4194304] 0 2024-09-13T22:55:59.982 INFO:tasks.workunit.client.1.smithi047.stdout:6/249: dwrite d3/d11/f40 [0,4194304] 0 2024-09-13T22:55:59.982 INFO:tasks.workunit.client.0.smithi002.stdout:4/90: dread - d3/d14/f16 zero size 2024-09-13T22:55:59.983 INFO:tasks.workunit.client.1.smithi047.stdout:7/251: creat d0/db/f50 x:0 0 0 2024-09-13T22:55:59.984 INFO:tasks.workunit.client.0.smithi002.stdout:4/91: truncate d3/f18 343964 0 2024-09-13T22:55:59.985 INFO:tasks.workunit.client.0.smithi002.stdout:4/92: chown d3/l6 15514264 1 2024-09-13T22:55:59.986 INFO:tasks.workunit.client.1.smithi047.stdout:3/323: mkdir d0/d3/d4/d16/d2c/de/d68 0 2024-09-13T22:55:59.989 INFO:tasks.workunit.client.0.smithi002.stdout:0/114: getdents d1/d4 0 2024-09-13T22:55:59.990 INFO:tasks.workunit.client.1.smithi047.stdout:5/196: chown d19/d23/d2e 325 1 2024-09-13T22:55:59.993 INFO:tasks.workunit.client.0.smithi002.stdout:2/106: dwrite d1/f1f [0,4194304] 0 2024-09-13T22:55:59.998 INFO:tasks.workunit.client.1.smithi047.stdout:0/261: read d1/d5/f9 [2272449,75542] 0 2024-09-13T22:55:59.999 INFO:tasks.workunit.client.0.smithi002.stdout:3/136: mkdir d9/d3b 0 2024-09-13T22:55:59.999 INFO:tasks.workunit.client.1.smithi047.stdout:3/324: dwrite d0/d25/d34/f41 [0,4194304] 0 2024-09-13T22:56:00.005 INFO:tasks.workunit.client.0.smithi002.stdout:8/113: link d3/dc/d18/f1f d3/dc/f22 0 2024-09-13T22:56:00.008 INFO:tasks.workunit.client.1.smithi047.stdout:4/268: truncate dc/d29/f41 1117348 0 2024-09-13T22:56:00.010 INFO:tasks.workunit.client.1.smithi047.stdout:7/252: dread d0/f1f [0,4194304] 0 2024-09-13T22:56:00.011 INFO:tasks.workunit.client.0.smithi002.stdout:1/176: write d1/d13/d1d/f29 [4972259,42091] 0 2024-09-13T22:56:00.012 INFO:tasks.workunit.client.1.smithi047.stdout:3/325: dwrite d0/d3/d4/d16/d2c/f23 [0,4194304] 0 2024-09-13T22:56:00.014 INFO:tasks.workunit.client.0.smithi002.stdout:6/134: chown d12/l15 1 1 2024-09-13T22:56:00.017 INFO:tasks.workunit.client.0.smithi002.stdout:1/177: dwrite d1/d13/d30/f2d [0,4194304] 0 2024-09-13T22:56:00.017 INFO:tasks.workunit.client.1.smithi047.stdout:6/250: mkdir d3/d11/d2b/d50 0 2024-09-13T22:56:00.019 INFO:tasks.workunit.client.0.smithi002.stdout:9/158: mknod d8/d10/c38 0 2024-09-13T22:56:00.019 INFO:tasks.workunit.client.0.smithi002.stdout:9/159: chown d8 3939612 1 2024-09-13T22:56:00.023 INFO:tasks.workunit.client.0.smithi002.stdout:4/93: write f2 [6132842,77243] 0 2024-09-13T22:56:00.024 INFO:tasks.workunit.client.1.smithi047.stdout:1/214: dwrite d0/d7/db/f38 [4194304,4194304] 0 2024-09-13T22:56:00.025 INFO:tasks.workunit.client.0.smithi002.stdout:4/94: write d3/d14/f16 [944638,121081] 0 2024-09-13T22:56:00.025 INFO:tasks.workunit.client.1.smithi047.stdout:7/253: dwrite d0/d7/da/d2e/d37/f43 [0,4194304] 0 2024-09-13T22:56:00.025 INFO:tasks.workunit.client.0.smithi002.stdout:4/95: dread - d3/f17 zero size 2024-09-13T22:56:00.026 INFO:tasks.workunit.client.0.smithi002.stdout:7/85: sync 2024-09-13T22:56:00.029 INFO:tasks.workunit.client.1.smithi047.stdout:7/254: read d0/d19/f2d [827796,103458] 0 2024-09-13T22:56:00.031 INFO:tasks.workunit.client.1.smithi047.stdout:5/197: fsync d19/d23/f29 0 2024-09-13T22:56:00.039 INFO:tasks.workunit.client.1.smithi047.stdout:4/269: write dc/de/d17/f1e [3004564,90509] 0 2024-09-13T22:56:00.040 INFO:tasks.workunit.client.0.smithi002.stdout:3/137: dread d9/f1a [0,4194304] 0 2024-09-13T22:56:00.040 INFO:tasks.workunit.client.0.smithi002.stdout:8/114: creat d3/dc/d18/f23 x:0 0 0 2024-09-13T22:56:00.043 INFO:tasks.workunit.client.1.smithi047.stdout:3/326: mkdir d0/d3/d4/d16/d2c/de/d1f/d3b/d69 0 2024-09-13T22:56:00.043 INFO:tasks.workunit.client.0.smithi002.stdout:0/115: write d1/d4/fb [4471885,53015] 0 2024-09-13T22:56:00.044 INFO:tasks.workunit.client.0.smithi002.stdout:0/116: write d1/d4/fb [4026516,125038] 0 2024-09-13T22:56:00.048 INFO:tasks.workunit.client.0.smithi002.stdout:6/135: creat d12/d17/f25 x:0 0 0 2024-09-13T22:56:00.048 INFO:tasks.workunit.client.1.smithi047.stdout:4/270: dwrite dc/de/f18 [0,4194304] 0 2024-09-13T22:56:00.053 INFO:tasks.workunit.client.0.smithi002.stdout:9/160: creat d8/d1e/f39 x:0 0 0 2024-09-13T22:56:00.054 INFO:tasks.workunit.client.0.smithi002.stdout:5/124: creat d1/d10/f2d x:0 0 0 2024-09-13T22:56:00.055 INFO:tasks.workunit.client.0.smithi002.stdout:9/161: fdatasync d8/d10/d1c/f2b 0 2024-09-13T22:56:00.057 INFO:tasks.workunit.client.1.smithi047.stdout:4/271: dwrite dc/de/d17/f1b [0,4194304] 0 2024-09-13T22:56:00.057 INFO:tasks.workunit.client.0.smithi002.stdout:6/136: dwrite f5 [0,4194304] 0 2024-09-13T22:56:00.058 INFO:tasks.workunit.client.0.smithi002.stdout:4/96: mknod d3/d14/c19 0 2024-09-13T22:56:00.058 INFO:tasks.workunit.client.0.smithi002.stdout:5/125: write d1/d10/f28 [295859,67618] 0 2024-09-13T22:56:00.059 INFO:tasks.workunit.client.0.smithi002.stdout:9/162: write d8/fe [3875770,108784] 0 2024-09-13T22:56:00.060 INFO:tasks.workunit.client.0.smithi002.stdout:1/178: write d1/fb [636402,42420] 0 2024-09-13T22:56:00.061 INFO:tasks.workunit.client.0.smithi002.stdout:5/126: chown d1/d2a/l2c 1633107 1 2024-09-13T22:56:00.062 INFO:tasks.workunit.client.0.smithi002.stdout:9/163: stat d8/d10/l32 0 2024-09-13T22:56:00.067 INFO:tasks.workunit.client.1.smithi047.stdout:1/215: creat d0/d7/d14/d28/d36/f3d x:0 0 0 2024-09-13T22:56:00.068 INFO:tasks.workunit.client.0.smithi002.stdout:8/115: creat d3/f24 x:0 0 0 2024-09-13T22:56:00.069 INFO:tasks.workunit.client.1.smithi047.stdout:7/255: mkdir d0/d7/da/d1e/d51 0 2024-09-13T22:56:00.070 INFO:tasks.workunit.client.0.smithi002.stdout:6/137: dwrite d12/d17/f25 [0,4194304] 0 2024-09-13T22:56:00.070 INFO:tasks.workunit.client.1.smithi047.stdout:7/256: write d0/d7/f2c [1158672,4025] 0 2024-09-13T22:56:00.071 INFO:tasks.workunit.client.0.smithi002.stdout:1/179: dread d1/d13/d1d/f29 [4194304,4194304] 0 2024-09-13T22:56:00.073 INFO:tasks.workunit.client.1.smithi047.stdout:5/198: symlink d19/d34/d42/l4b 0 2024-09-13T22:56:00.075 INFO:tasks.workunit.client.1.smithi047.stdout:0/262: symlink d1/d5/l5b 0 2024-09-13T22:56:00.077 INFO:tasks.workunit.client.1.smithi047.stdout:2/311: creat d1/df/d26/f6d x:0 0 0 2024-09-13T22:56:00.078 INFO:tasks.workunit.client.1.smithi047.stdout:0/263: chown d1/d5/d16/d23/f42 23 1 2024-09-13T22:56:00.078 INFO:tasks.workunit.client.0.smithi002.stdout:8/116: dwrite d3/dc/d18/f23 [0,4194304] 0 2024-09-13T22:56:00.078 INFO:tasks.workunit.client.1.smithi047.stdout:7/257: dwrite d0/db/f16 [0,4194304] 0 2024-09-13T22:56:00.082 INFO:tasks.workunit.client.0.smithi002.stdout:4/97: creat d3/d14/f1a x:0 0 0 2024-09-13T22:56:00.089 INFO:tasks.workunit.client.1.smithi047.stdout:3/327: rename d0/d25/d44/d43/c4d to d0/d3/d4/d16/d2c/de/d68/c6a 0 2024-09-13T22:56:00.091 INFO:tasks.workunit.client.0.smithi002.stdout:2/107: link d1/d7/d8/l13 d1/d7/d8/l20 0 2024-09-13T22:56:00.092 INFO:tasks.workunit.client.1.smithi047.stdout:9/233: getdents d1/dc/d14/dd 0 2024-09-13T22:56:00.093 INFO:tasks.workunit.client.1.smithi047.stdout:9/234: chown d1/c1c 15 1 2024-09-13T22:56:00.094 INFO:tasks.workunit.client.0.smithi002.stdout:9/164: creat d8/d1e/f3a x:0 0 0 2024-09-13T22:56:00.094 INFO:tasks.workunit.client.1.smithi047.stdout:9/235: write d1/f44 [787237,80281] 0 2024-09-13T22:56:00.095 INFO:tasks.workunit.client.1.smithi047.stdout:4/272: chown dc/f19 98080705 1 2024-09-13T22:56:00.095 INFO:tasks.workunit.client.1.smithi047.stdout:9/236: read - d1/dc/d18/f35 zero size 2024-09-13T22:56:00.099 INFO:tasks.workunit.client.0.smithi002.stdout:2/108: dwrite d1/d7/d8/f1a [0,4194304] 0 2024-09-13T22:56:00.100 INFO:tasks.workunit.client.1.smithi047.stdout:9/237: dread d1/dc/d14/f16 [0,4194304] 0 2024-09-13T22:56:00.101 INFO:tasks.workunit.client.0.smithi002.stdout:3/138: rename d9/d15/c11 to d9/d15/d26/c3c 0 2024-09-13T22:56:00.101 INFO:tasks.workunit.client.1.smithi047.stdout:8/262: sync 2024-09-13T22:56:00.102 INFO:tasks.workunit.client.0.smithi002.stdout:9/165: dwrite d8/fe [0,4194304] 0 2024-09-13T22:56:00.103 INFO:tasks.workunit.client.0.smithi002.stdout:0/117: mknod d1/c23 0 2024-09-13T22:56:00.104 INFO:tasks.workunit.client.0.smithi002.stdout:0/118: chown d1/d2/d10 531496886 1 2024-09-13T22:56:00.105 INFO:tasks.workunit.client.1.smithi047.stdout:5/199: rmdir d19/d34 39 2024-09-13T22:56:00.108 INFO:tasks.workunit.client.0.smithi002.stdout:0/119: dread d1/d2/f18 [0,4194304] 0 2024-09-13T22:56:00.110 INFO:tasks.workunit.client.1.smithi047.stdout:2/312: mknod d1/df/d1d/d20/d2b/c6e 0 2024-09-13T22:56:00.111 INFO:tasks.workunit.client.1.smithi047.stdout:2/313: fdatasync d1/de/f5b 0 2024-09-13T22:56:00.114 INFO:tasks.workunit.client.0.smithi002.stdout:0/120: dwrite d1/d2/f19 [0,4194304] 0 2024-09-13T22:56:00.115 INFO:tasks.workunit.client.0.smithi002.stdout:4/98: rmdir d3 39 2024-09-13T22:56:00.118 INFO:tasks.workunit.client.1.smithi047.stdout:7/258: symlink d0/d7/da/d2e/d37/l52 0 2024-09-13T22:56:00.124 INFO:tasks.workunit.client.1.smithi047.stdout:1/216: rename d0/d7/la to d0/d7/d14/l3e 0 2024-09-13T22:56:00.126 INFO:tasks.workunit.client.1.smithi047.stdout:3/328: creat d0/d25/d44/d43/f6b x:0 0 0 2024-09-13T22:56:00.127 INFO:tasks.workunit.client.1.smithi047.stdout:4/273: rmdir dc/de/d17 39 2024-09-13T22:56:00.127 INFO:tasks.workunit.client.1.smithi047.stdout:0/264: dwrite d1/d5/d16/f3c [0,4194304] 0 2024-09-13T22:56:00.129 INFO:tasks.workunit.client.1.smithi047.stdout:1/217: read d0/d7/d14/f27 [4816026,121386] 0 2024-09-13T22:56:00.129 INFO:tasks.workunit.client.0.smithi002.stdout:2/109: rmdir d1/d7 39 2024-09-13T22:56:00.135 INFO:tasks.workunit.client.0.smithi002.stdout:2/110: dwrite d1/f5 [0,4194304] 0 2024-09-13T22:56:00.135 INFO:tasks.workunit.client.0.smithi002.stdout:2/111: chown d1/l4 257954 1 2024-09-13T22:56:00.136 INFO:tasks.workunit.client.0.smithi002.stdout:3/139: symlink d9/d15/d26/l3d 0 2024-09-13T22:56:00.137 INFO:tasks.workunit.client.1.smithi047.stdout:8/263: chown d8/d36/d40/c58 1 1 2024-09-13T22:56:00.141 INFO:tasks.workunit.client.1.smithi047.stdout:5/200: unlink d19/d23/d32/c3c 0 2024-09-13T22:56:00.147 INFO:tasks.workunit.client.0.smithi002.stdout:8/117: truncate d3/dc/fe 343092 0 2024-09-13T22:56:00.147 INFO:tasks.workunit.client.1.smithi047.stdout:6/251: getdents d3/d2c 0 2024-09-13T22:56:00.148 INFO:tasks.workunit.client.1.smithi047.stdout:7/259: symlink d0/d19/d32/l53 0 2024-09-13T22:56:00.149 INFO:tasks.workunit.client.1.smithi047.stdout:7/260: fsync d0/d19/f1c 0 2024-09-13T22:56:00.150 INFO:tasks.workunit.client.0.smithi002.stdout:9/166: dwrite d8/d1e/f22 [0,4194304] 0 2024-09-13T22:56:00.151 INFO:tasks.workunit.client.0.smithi002.stdout:0/121: rename d1/d4/fe to d1/d4/f24 0 2024-09-13T22:56:00.153 INFO:tasks.workunit.client.0.smithi002.stdout:7/86: getdents d8/d10/d11/d13 0 2024-09-13T22:56:00.154 INFO:tasks.workunit.client.0.smithi002.stdout:4/99: dread d3/d14/f16 [0,4194304] 0 2024-09-13T22:56:00.155 INFO:tasks.workunit.client.0.smithi002.stdout:5/127: creat d1/d10/f2e x:0 0 0 2024-09-13T22:56:00.156 INFO:tasks.workunit.client.1.smithi047.stdout:7/261: dwrite d0/d7/da/f34 [0,4194304] 0 2024-09-13T22:56:00.157 INFO:tasks.workunit.client.1.smithi047.stdout:3/329: creat d0/d3/d4/d16/d2c/de/d1f/f6c x:0 0 0 2024-09-13T22:56:00.160 INFO:tasks.workunit.client.1.smithi047.stdout:1/218: chown d0/d7/d13/f39 730056 1 2024-09-13T22:56:00.165 INFO:tasks.workunit.client.0.smithi002.stdout:3/140: symlink d9/df/d10/l3e 0 2024-09-13T22:56:00.166 INFO:tasks.workunit.client.1.smithi047.stdout:0/265: dread d1/d5/d16/d23/d2d/f55 [0,4194304] 0 2024-09-13T22:56:00.167 INFO:tasks.workunit.client.1.smithi047.stdout:9/238: unlink d1/dc/c39 0 2024-09-13T22:56:00.168 INFO:tasks.workunit.client.1.smithi047.stdout:9/239: chown d1/dc/d14/dd/f1d 13747141 1 2024-09-13T22:56:00.168 INFO:tasks.workunit.client.1.smithi047.stdout:8/264: creat d8/d36/d40/f59 x:0 0 0 2024-09-13T22:56:00.168 INFO:tasks.workunit.client.1.smithi047.stdout:8/265: fdatasync d8/f23 0 2024-09-13T22:56:00.169 INFO:tasks.workunit.client.1.smithi047.stdout:5/201: rmdir d19/d23/d2e/d41 39 2024-09-13T22:56:00.172 INFO:tasks.workunit.client.0.smithi002.stdout:8/118: read d3/fa [2866736,33356] 0 2024-09-13T22:56:00.172 INFO:tasks.workunit.client.1.smithi047.stdout:6/252: symlink d3/d11/d2b/d1c/d4d/l51 0 2024-09-13T22:56:00.178 INFO:tasks.workunit.client.0.smithi002.stdout:9/167: symlink d8/d1e/l3b 0 2024-09-13T22:56:00.178 INFO:tasks.workunit.client.0.smithi002.stdout:9/168: chown d8/d1e/l3b 0 1 2024-09-13T22:56:00.180 INFO:tasks.workunit.client.1.smithi047.stdout:5/202: dread d19/d25/f38 [0,4194304] 0 2024-09-13T22:56:00.181 INFO:tasks.workunit.client.0.smithi002.stdout:7/87: rmdir d8/d9 39 2024-09-13T22:56:00.183 INFO:tasks.workunit.client.1.smithi047.stdout:7/262: mknod d0/d7/da/d2e/c54 0 2024-09-13T22:56:00.185 INFO:tasks.workunit.client.0.smithi002.stdout:4/100: rename d3/f5 to d3/f1b 0 2024-09-13T22:56:00.187 INFO:tasks.workunit.client.0.smithi002.stdout:5/128: creat d1/f2f x:0 0 0 2024-09-13T22:56:00.187 INFO:tasks.workunit.client.1.smithi047.stdout:2/314: write d1/d16/f23 [1832686,77052] 0 2024-09-13T22:56:00.188 INFO:tasks.workunit.client.1.smithi047.stdout:1/219: write d0/d7/d14/f27 [7624311,3564] 0 2024-09-13T22:56:00.191 INFO:tasks.workunit.client.0.smithi002.stdout:6/138: rename c10 to d12/c26 0 2024-09-13T22:56:00.192 INFO:tasks.workunit.client.1.smithi047.stdout:0/266: symlink d1/d5/d16/d23/d2d/l5c 0 2024-09-13T22:56:00.193 INFO:tasks.workunit.client.0.smithi002.stdout:2/112: creat d1/d7/f21 x:0 0 0 2024-09-13T22:56:00.194 INFO:tasks.workunit.client.1.smithi047.stdout:2/315: dwrite d1/de/f63 [0,4194304] 0 2024-09-13T22:56:00.195 INFO:tasks.workunit.client.0.smithi002.stdout:3/141: mkdir d9/d15/d35/d3f 0 2024-09-13T22:56:00.196 INFO:tasks.workunit.client.0.smithi002.stdout:3/142: dread - d9/d15/d36/f38 zero size 2024-09-13T22:56:00.197 INFO:tasks.workunit.client.0.smithi002.stdout:3/143: chown d9/f2a 1598080 1 2024-09-13T22:56:00.197 INFO:tasks.workunit.client.1.smithi047.stdout:9/240: mkdir d1/dc/d14/d20/d4e 0 2024-09-13T22:56:00.199 INFO:tasks.workunit.client.0.smithi002.stdout:8/119: truncate d3/f8 2477407 0 2024-09-13T22:56:00.201 INFO:tasks.workunit.client.1.smithi047.stdout:2/316: dwrite d1/de/d17/f1c [0,4194304] 0 2024-09-13T22:56:00.207 INFO:tasks.workunit.client.0.smithi002.stdout:9/169: dread d8/fa [0,4194304] 0 2024-09-13T22:56:00.208 INFO:tasks.workunit.client.1.smithi047.stdout:2/317: dread d1/de/f63 [0,4194304] 0 2024-09-13T22:56:00.208 INFO:tasks.workunit.client.1.smithi047.stdout:7/263: read d0/d7/f17 [3924225,9161] 0 2024-09-13T22:56:00.209 INFO:tasks.workunit.client.1.smithi047.stdout:2/318: write d1/df/d1d/d20/d54/f5c [4853775,128885] 0 2024-09-13T22:56:00.212 INFO:tasks.workunit.client.1.smithi047.stdout:3/330: rename d0/d3/d4/d16/d2c/de/d1f/f6c to d0/d25/d44/d43/d3a/f6d 0 2024-09-13T22:56:00.217 INFO:tasks.workunit.client.1.smithi047.stdout:0/267: mknod d1/d5/d16/d23/c5d 0 2024-09-13T22:56:00.219 INFO:tasks.workunit.client.0.smithi002.stdout:4/101: dwrite d3/fa [0,4194304] 0 2024-09-13T22:56:00.220 INFO:tasks.workunit.client.0.smithi002.stdout:4/102: write d3/f1b [7332387,32922] 0 2024-09-13T22:56:00.221 INFO:tasks.workunit.client.0.smithi002.stdout:6/139: creat d12/d17/f27 x:0 0 0 2024-09-13T22:56:00.221 INFO:tasks.workunit.client.0.smithi002.stdout:3/144: dread d9/df/d10/f12 [0,4194304] 0 2024-09-13T22:56:00.223 INFO:tasks.workunit.client.0.smithi002.stdout:6/140: dread d12/d17/f18 [0,4194304] 0 2024-09-13T22:56:00.223 INFO:tasks.workunit.client.1.smithi047.stdout:9/241: creat d1/dc/d14/d20/f4f x:0 0 0 2024-09-13T22:56:00.223 INFO:tasks.workunit.client.0.smithi002.stdout:3/145: write d9/d15/f30 [360069,124711] 0 2024-09-13T22:56:00.224 INFO:tasks.workunit.client.0.smithi002.stdout:3/146: fsync d9/d15/f24 0 2024-09-13T22:56:00.224 INFO:tasks.workunit.client.0.smithi002.stdout:2/113: mknod d1/d7/d8/c22 0 2024-09-13T22:56:00.225 INFO:tasks.workunit.client.1.smithi047.stdout:9/242: read d1/dc/d14/f4d [365162,480] 0 2024-09-13T22:56:00.225 INFO:tasks.workunit.client.0.smithi002.stdout:2/114: dread - d1/f1d zero size 2024-09-13T22:56:00.225 INFO:tasks.workunit.client.0.smithi002.stdout:3/147: truncate d9/d15/d26/f32 1042759 0 2024-09-13T22:56:00.226 INFO:tasks.workunit.client.0.smithi002.stdout:0/122: truncate d1/d4/f24 684000 0 2024-09-13T22:56:00.226 INFO:tasks.workunit.client.0.smithi002.stdout:3/148: dread - d9/d15/d36/f38 zero size 2024-09-13T22:56:00.229 INFO:tasks.workunit.client.1.smithi047.stdout:9/243: dread d1/dc/d14/f13 [0,4194304] 0 2024-09-13T22:56:00.238 INFO:tasks.workunit.client.0.smithi002.stdout:1/180: rename d1/d13/d21/f28 to d1/d13/d1d/d2e/f37 0 2024-09-13T22:56:00.241 INFO:tasks.workunit.client.1.smithi047.stdout:6/253: rename d3/d11/d2b/d4c/c38 to d3/d2c/c52 0 2024-09-13T22:56:00.243 INFO:tasks.workunit.client.1.smithi047.stdout:3/331: creat d0/d3/d4/d16/d2c/de/d3d/f6e x:0 0 0 2024-09-13T22:56:00.245 INFO:tasks.workunit.client.1.smithi047.stdout:7/264: write d0/f29 [2533237,112221] 0 2024-09-13T22:56:00.245 INFO:tasks.workunit.client.1.smithi047.stdout:0/268: chown d1/c3b 797437064 1 2024-09-13T22:56:00.247 INFO:tasks.workunit.client.1.smithi047.stdout:6/254: dread d3/d11/d2b/d4c/d30/f47 [0,4194304] 0 2024-09-13T22:56:00.250 INFO:tasks.workunit.client.1.smithi047.stdout:8/266: getdents d8/d3e/d4e 0 2024-09-13T22:56:00.250 INFO:tasks.workunit.client.1.smithi047.stdout:7/265: dread d0/d7/f4a [0,4194304] 0 2024-09-13T22:56:00.254 INFO:tasks.workunit.client.1.smithi047.stdout:4/274: getdents dc/de/d17/d25/d4a 0 2024-09-13T22:56:00.256 INFO:tasks.workunit.client.1.smithi047.stdout:8/267: dwrite d8/f1f [0,4194304] 0 2024-09-13T22:56:00.257 INFO:tasks.workunit.client.0.smithi002.stdout:7/88: link d8/d9/f16 d8/d9/f19 0 2024-09-13T22:56:00.258 INFO:tasks.workunit.client.0.smithi002.stdout:7/89: readlink d8/d10/d11/d13/l18 0 2024-09-13T22:56:00.260 INFO:tasks.workunit.client.0.smithi002.stdout:5/129: creat d1/d10/f30 x:0 0 0 2024-09-13T22:56:00.263 INFO:tasks.workunit.client.0.smithi002.stdout:4/103: rename d3/c13 to d3/d14/c1c 0 2024-09-13T22:56:00.264 INFO:tasks.workunit.client.1.smithi047.stdout:3/332: fsync d0/d3/d4/d16/d32/d42/f59 0 2024-09-13T22:56:00.265 INFO:tasks.workunit.client.0.smithi002.stdout:3/149: dwrite f3 [0,4194304] 0 2024-09-13T22:56:00.266 INFO:tasks.workunit.client.1.smithi047.stdout:0/269: creat d1/d5/d16/d23/d2d/f5e x:0 0 0 2024-09-13T22:56:00.267 INFO:tasks.workunit.client.1.smithi047.stdout:6/255: mknod d3/d11/d2b/d1c/d23/c53 0 2024-09-13T22:56:00.268 INFO:tasks.workunit.client.1.smithi047.stdout:2/319: write d1/d16/d40/f4d [662213,119921] 0 2024-09-13T22:56:00.268 INFO:tasks.workunit.client.1.smithi047.stdout:2/320: chown d1/de 1 1 2024-09-13T22:56:00.269 INFO:tasks.workunit.client.0.smithi002.stdout:3/150: dread - d9/f2a zero size 2024-09-13T22:56:00.273 INFO:tasks.workunit.client.0.smithi002.stdout:7/90: dwrite f6 [0,4194304] 0 2024-09-13T22:56:00.274 INFO:tasks.workunit.client.0.smithi002.stdout:5/130: dread d1/f18 [0,4194304] 0 2024-09-13T22:56:00.274 INFO:tasks.workunit.client.0.smithi002.stdout:0/123: mknod d1/c25 0 2024-09-13T22:56:00.274 INFO:tasks.workunit.client.1.smithi047.stdout:8/268: unlink d8/c53 0 2024-09-13T22:56:00.276 INFO:tasks.workunit.client.0.smithi002.stdout:0/124: dread - d1/f14 zero size 2024-09-13T22:56:00.277 INFO:tasks.workunit.client.0.smithi002.stdout:1/181: dread d1/d13/d30/f2f [0,4194304] 0 2024-09-13T22:56:00.278 INFO:tasks.workunit.client.0.smithi002.stdout:9/170: creat d8/d10/f3c x:0 0 0 2024-09-13T22:56:00.288 INFO:tasks.workunit.client.0.smithi002.stdout:3/151: creat d9/df/f40 x:0 0 0 2024-09-13T22:56:00.289 INFO:tasks.workunit.client.1.smithi047.stdout:3/333: dread d0/d3/d4/f3e [4194304,4194304] 0 2024-09-13T22:56:00.289 INFO:tasks.workunit.client.0.smithi002.stdout:3/152: write d9/df/d10/f1d [954567,74469] 0 2024-09-13T22:56:00.291 INFO:tasks.workunit.client.0.smithi002.stdout:2/115: link d1/d7/d8/f1a d1/f23 0 2024-09-13T22:56:00.294 INFO:tasks.workunit.client.1.smithi047.stdout:5/203: rename d19/d23/d32/d49 to d19/d23/d4c 0 2024-09-13T22:56:00.296 INFO:tasks.workunit.client.1.smithi047.stdout:0/270: write d1/d7/f4b [381440,8926] 0 2024-09-13T22:56:00.298 INFO:tasks.workunit.client.1.smithi047.stdout:7/266: write d0/f20 [3729100,93570] 0 2024-09-13T22:56:00.300 INFO:tasks.workunit.client.1.smithi047.stdout:2/321: mkdir d1/d6f 0 2024-09-13T22:56:00.301 INFO:tasks.workunit.client.1.smithi047.stdout:0/271: dread d1/d7/f26 [0,4194304] 0 2024-09-13T22:56:00.301 INFO:tasks.workunit.client.1.smithi047.stdout:6/256: dread d3/d11/d2b/d4c/f1d [0,4194304] 0 2024-09-13T22:56:00.305 INFO:tasks.workunit.client.0.smithi002.stdout:0/125: mkdir d1/d4/d26 0 2024-09-13T22:56:00.306 INFO:tasks.workunit.client.0.smithi002.stdout:3/153: dread d9/fb [0,4194304] 0 2024-09-13T22:56:00.306 INFO:tasks.workunit.client.0.smithi002.stdout:0/126: write d1/d2/f1d [492615,128987] 0 2024-09-13T22:56:00.307 INFO:tasks.workunit.client.0.smithi002.stdout:1/182: creat d1/d13/d1d/d2e/f38 x:0 0 0 2024-09-13T22:56:00.308 INFO:tasks.workunit.client.1.smithi047.stdout:3/334: creat d0/d3/d4/d16/d2c/de/d1f/d2e/f6f x:0 0 0 2024-09-13T22:56:00.308 INFO:tasks.workunit.client.0.smithi002.stdout:0/127: write d1/d2/fd [397406,77836] 0 2024-09-13T22:56:00.309 INFO:tasks.workunit.client.0.smithi002.stdout:9/171: mkdir d8/d10/d1c/d3d 0 2024-09-13T22:56:00.312 INFO:tasks.workunit.client.0.smithi002.stdout:6/141: getdents d12/d17 0 2024-09-13T22:56:00.315 INFO:tasks.workunit.client.1.smithi047.stdout:6/257: symlink d3/d11/d2b/d1c/d4d/l54 0 2024-09-13T22:56:00.317 INFO:tasks.workunit.client.1.smithi047.stdout:4/275: link dc/de/c12 dc/de/d17/c5d 0 2024-09-13T22:56:00.318 INFO:tasks.workunit.client.1.smithi047.stdout:4/276: chown dc/d29/l58 584819 1 2024-09-13T22:56:00.318 INFO:tasks.workunit.client.1.smithi047.stdout:4/277: stat dc/de/d23/c24 0 2024-09-13T22:56:00.318 INFO:tasks.workunit.client.0.smithi002.stdout:5/131: unlink d1/d10/c19 0 2024-09-13T22:56:00.319 INFO:tasks.workunit.client.0.smithi002.stdout:4/104: truncate d3/f1b 3924479 0 2024-09-13T22:56:00.320 INFO:tasks.workunit.client.1.smithi047.stdout:8/269: link d8/c19 d8/d36/d40/c5a 0 2024-09-13T22:56:00.320 INFO:tasks.workunit.client.0.smithi002.stdout:4/105: dread - d3/f17 zero size 2024-09-13T22:56:00.322 INFO:tasks.workunit.client.0.smithi002.stdout:8/120: dread d3/f6 [0,4194304] 0 2024-09-13T22:56:00.322 INFO:tasks.workunit.client.0.smithi002.stdout:8/121: readlink d3/l12 0 2024-09-13T22:56:00.322 INFO:tasks.workunit.client.0.smithi002.stdout:8/122: chown d3/f6 3000 1 2024-09-13T22:56:00.422 INFO:tasks.workunit.client.1.smithi047.stdout:3/335: mkdir d0/d3/d4/d16/d2c/de/d70 0 2024-09-13T22:56:00.424 INFO:tasks.workunit.client.1.smithi047.stdout:5/204: chown d19/d34/d42/l44 112645 1 2024-09-13T22:56:00.427 INFO:tasks.workunit.client.0.smithi002.stdout:1/183: truncate d1/d13/d1d/f29 2781629 0 2024-09-13T22:56:00.427 INFO:tasks.workunit.client.1.smithi047.stdout:3/336: dwrite d0/f5c [0,4194304] 0 2024-09-13T22:56:00.428 INFO:tasks.workunit.client.0.smithi002.stdout:1/184: write d1/d1c/f26 [4387236,120039] 0 2024-09-13T22:56:00.428 INFO:tasks.workunit.client.1.smithi047.stdout:7/267: symlink d0/d7/da/d47/l55 0 2024-09-13T22:56:00.428 INFO:tasks.workunit.client.0.smithi002.stdout:1/185: read d1/d13/d30/f2d [2170040,3659] 0 2024-09-13T22:56:00.430 INFO:tasks.workunit.client.0.smithi002.stdout:1/186: truncate d1/d13/d1d/d2e/f38 399080 0 2024-09-13T22:56:00.432 INFO:tasks.workunit.client.1.smithi047.stdout:2/322: mknod d1/df/c70 0 2024-09-13T22:56:00.436 INFO:tasks.workunit.client.1.smithi047.stdout:0/272: mknod d1/d5/d11/c5f 0 2024-09-13T22:56:00.437 INFO:tasks.workunit.client.1.smithi047.stdout:3/337: dwrite d0/d3/d4/d16/d2c/f24 [0,4194304] 0 2024-09-13T22:56:00.437 INFO:tasks.workunit.client.1.smithi047.stdout:3/338: stat d0/d3/d4 0 2024-09-13T22:56:00.438 INFO:tasks.workunit.client.0.smithi002.stdout:6/142: mkdir d12/d17/d28 0 2024-09-13T22:56:00.438 INFO:tasks.workunit.client.0.smithi002.stdout:6/143: truncate d12/f21 5091177 0 2024-09-13T22:56:00.439 INFO:tasks.workunit.client.1.smithi047.stdout:6/258: mkdir d3/d2c/d55 0 2024-09-13T22:56:00.443 INFO:tasks.workunit.client.0.smithi002.stdout:2/116: symlink d1/l24 0 2024-09-13T22:56:00.444 INFO:tasks.workunit.client.0.smithi002.stdout:2/117: dread - d1/f15 zero size 2024-09-13T22:56:00.448 INFO:tasks.workunit.client.0.smithi002.stdout:5/132: truncate d1/f3 1301593 0 2024-09-13T22:56:00.449 INFO:tasks.workunit.client.1.smithi047.stdout:5/205: creat d19/d25/d45/f4d x:0 0 0 2024-09-13T22:56:00.455 INFO:tasks.workunit.client.0.smithi002.stdout:8/123: truncate d3/dc/f13 1218236 0 2024-09-13T22:56:00.457 INFO:tasks.workunit.client.1.smithi047.stdout:0/273: read d1/f17 [61021,23908] 0 2024-09-13T22:56:00.460 INFO:tasks.workunit.client.1.smithi047.stdout:3/339: unlink d0/d3/d4/d16/d2c/f23 0 2024-09-13T22:56:00.460 INFO:tasks.workunit.client.0.smithi002.stdout:8/124: dwrite d3/f24 [0,4194304] 0 2024-09-13T22:56:00.461 INFO:tasks.workunit.client.0.smithi002.stdout:8/125: readlink d3/l12 0 2024-09-13T22:56:00.463 INFO:tasks.workunit.client.1.smithi047.stdout:6/259: creat d3/d11/d2b/d1c/f56 x:0 0 0 2024-09-13T22:56:00.467 INFO:tasks.workunit.client.0.smithi002.stdout:0/128: link d1/d2/f19 d1/d2/f27 0 2024-09-13T22:56:00.471 INFO:tasks.workunit.client.0.smithi002.stdout:9/172: creat d8/d10/d1c/d3d/f3e x:0 0 0 2024-09-13T22:56:00.472 INFO:tasks.workunit.client.1.smithi047.stdout:7/268: truncate d0/d7/f6 1919207 0 2024-09-13T22:56:00.472 INFO:tasks.workunit.client.0.smithi002.stdout:6/144: mknod d12/d17/c29 0 2024-09-13T22:56:00.479 INFO:tasks.workunit.client.0.smithi002.stdout:7/91: getdents d8/d10/d11 0 2024-09-13T22:56:00.479 INFO:tasks.workunit.client.0.smithi002.stdout:7/92: chown d8/d10/d11/d13 31891 1 2024-09-13T22:56:00.482 INFO:tasks.workunit.client.0.smithi002.stdout:3/154: rmdir d9/d15/d35/d3f 0 2024-09-13T22:56:00.483 INFO:tasks.workunit.client.0.smithi002.stdout:3/155: write f5 [13913,90547] 0 2024-09-13T22:56:00.484 INFO:tasks.workunit.client.1.smithi047.stdout:5/206: rename f10 to d19/d25/d45/f4e 0 2024-09-13T22:56:00.485 INFO:tasks.workunit.client.0.smithi002.stdout:7/93: dwrite d8/d10/f15 [0,4194304] 0 2024-09-13T22:56:00.489 INFO:tasks.workunit.client.0.smithi002.stdout:0/129: symlink d1/d2/l28 0 2024-09-13T22:56:00.491 INFO:tasks.workunit.client.1.smithi047.stdout:8/270: dwrite d8/f9 [0,4194304] 0 2024-09-13T22:56:00.494 INFO:tasks.workunit.client.0.smithi002.stdout:3/156: dread f5 [0,4194304] 0 2024-09-13T22:56:00.494 INFO:tasks.workunit.client.0.smithi002.stdout:9/173: rmdir d8/d1e 39 2024-09-13T22:56:00.495 INFO:tasks.workunit.client.0.smithi002.stdout:9/174: chown d8/fa 30 1 2024-09-13T22:56:00.496 INFO:tasks.workunit.client.0.smithi002.stdout:0/130: dwrite d1/d2/f1d [0,4194304] 0 2024-09-13T22:56:00.496 INFO:tasks.workunit.client.1.smithi047.stdout:6/260: mknod d3/d2c/d55/c57 0 2024-09-13T22:56:00.499 INFO:tasks.workunit.client.0.smithi002.stdout:6/145: mkdir d12/d17/d2a 0 2024-09-13T22:56:00.500 INFO:tasks.workunit.client.1.smithi047.stdout:4/278: getdents dc/d29/d4d 0 2024-09-13T22:56:00.505 INFO:tasks.workunit.client.1.smithi047.stdout:5/207: fdatasync d19/d25/f2b 0 2024-09-13T22:56:00.506 INFO:tasks.workunit.client.1.smithi047.stdout:5/208: read - d19/f35 zero size 2024-09-13T22:56:00.507 INFO:tasks.workunit.client.1.smithi047.stdout:5/209: write d19/d23/f3a [209525,89648] 0 2024-09-13T22:56:00.507 INFO:tasks.workunit.client.1.smithi047.stdout:3/340: truncate d0/d3/d4/d16/d1c/f2d 1036467 0 2024-09-13T22:56:00.511 INFO:tasks.workunit.client.1.smithi047.stdout:7/269: truncate d0/d19/f1c 1772647 0 2024-09-13T22:56:00.512 INFO:tasks.workunit.client.1.smithi047.stdout:7/270: write d0/d7/da/f34 [2177414,21746] 0 2024-09-13T22:56:00.513 INFO:tasks.workunit.client.1.smithi047.stdout:7/271: readlink d0/d7/da/l23 0 2024-09-13T22:56:00.517 INFO:tasks.workunit.client.1.smithi047.stdout:6/261: mknod d3/d2c/d55/c58 0 2024-09-13T22:56:00.519 INFO:tasks.workunit.client.0.smithi002.stdout:8/126: link d3/f5 d3/dc/d16/f25 0 2024-09-13T22:56:00.520 INFO:tasks.workunit.client.1.smithi047.stdout:4/279: symlink dc/de/d23/d40/l5e 0 2024-09-13T22:56:00.522 INFO:tasks.workunit.client.0.smithi002.stdout:7/94: creat d8/d9/f1a x:0 0 0 2024-09-13T22:56:00.527 INFO:tasks.workunit.client.0.smithi002.stdout:3/157: creat d9/df/f41 x:0 0 0 2024-09-13T22:56:00.527 INFO:tasks.workunit.client.1.smithi047.stdout:7/272: symlink d0/d7/da/d4e/l56 0 2024-09-13T22:56:00.528 INFO:tasks.workunit.client.0.smithi002.stdout:7/95: dwrite d8/d9/fd [4194304,4194304] 0 2024-09-13T22:56:00.528 INFO:tasks.workunit.client.1.smithi047.stdout:7/273: write d0/d7/da/f2b [1028470,122287] 0 2024-09-13T22:56:00.528 INFO:tasks.workunit.client.0.smithi002.stdout:7/96: write f6 [1546502,33714] 0 2024-09-13T22:56:00.530 INFO:tasks.workunit.client.0.smithi002.stdout:7/97: read d8/d9/f16 [148805,48944] 0 2024-09-13T22:56:00.531 INFO:tasks.workunit.client.0.smithi002.stdout:0/131: creat d1/d2/f29 x:0 0 0 2024-09-13T22:56:00.532 INFO:tasks.workunit.client.0.smithi002.stdout:7/98: write d8/fc [601768,2789] 0 2024-09-13T22:56:00.533 INFO:tasks.workunit.client.0.smithi002.stdout:0/132: write d1/d2/f1d [3151834,101658] 0 2024-09-13T22:56:00.535 INFO:tasks.workunit.client.1.smithi047.stdout:6/262: unlink d3/d11/f49 0 2024-09-13T22:56:00.538 INFO:tasks.workunit.client.0.smithi002.stdout:2/118: rename d1/d7/d8/l13 to d1/l25 0 2024-09-13T22:56:00.543 INFO:tasks.workunit.client.1.smithi047.stdout:0/274: rename d1/d5/d16/l50 to d1/d5/l60 0 2024-09-13T22:56:00.543 INFO:tasks.workunit.client.0.smithi002.stdout:4/106: write d3/fa [1835665,66322] 0 2024-09-13T22:56:00.549 INFO:tasks.workunit.client.1.smithi047.stdout:3/341: creat d0/d3/d65/f71 x:0 0 0 2024-09-13T22:56:00.550 INFO:tasks.workunit.client.0.smithi002.stdout:5/133: chown d1/f3 4943288 1 2024-09-13T22:56:00.550 INFO:tasks.workunit.client.0.smithi002.stdout:7/99: dread d8/d9/fd [0,4194304] 0 2024-09-13T22:56:00.552 INFO:tasks.workunit.client.0.smithi002.stdout:3/158: creat d9/d15/f42 x:0 0 0 2024-09-13T22:56:00.555 INFO:tasks.workunit.client.1.smithi047.stdout:6/263: rename d3/c10 to d3/d2c/c59 0 2024-09-13T22:56:00.555 INFO:tasks.workunit.client.1.smithi047.stdout:6/264: chown d3/d2c 816074747 1 2024-09-13T22:56:00.556 INFO:tasks.workunit.client.1.smithi047.stdout:0/275: creat d1/d5/d16/d23/d2d/f61 x:0 0 0 2024-09-13T22:56:00.556 INFO:tasks.workunit.client.1.smithi047.stdout:6/265: write d3/d11/d2b/d1c/f2e [380417,35168] 0 2024-09-13T22:56:00.557 INFO:tasks.workunit.client.1.smithi047.stdout:5/210: creat d19/f4f x:0 0 0 2024-09-13T22:56:00.558 INFO:tasks.workunit.client.1.smithi047.stdout:5/211: write d19/f35 [976636,99594] 0 2024-09-13T22:56:00.559 INFO:tasks.workunit.client.0.smithi002.stdout:6/146: truncate d12/f14 3240213 0 2024-09-13T22:56:00.560 INFO:tasks.workunit.client.1.smithi047.stdout:3/342: symlink d0/d3/d65/l72 0 2024-09-13T22:56:00.562 INFO:tasks.workunit.client.1.smithi047.stdout:7/274: mkdir d0/d57 0 2024-09-13T22:56:00.564 INFO:tasks.workunit.client.1.smithi047.stdout:8/271: link d8/l33 d8/l5b 0 2024-09-13T22:56:00.568 INFO:tasks.workunit.client.1.smithi047.stdout:4/280: link dc/f2f dc/d29/d4c/f5f 0 2024-09-13T22:56:00.568 INFO:tasks.workunit.client.1.smithi047.stdout:7/275: dwrite d0/d7/da/f34 [0,4194304] 0 2024-09-13T22:56:00.569 INFO:tasks.workunit.client.0.smithi002.stdout:4/107: creat d3/d14/f1d x:0 0 0 2024-09-13T22:56:00.574 INFO:tasks.workunit.client.1.smithi047.stdout:6/266: read d3/f9 [2874946,35406] 0 2024-09-13T22:56:00.575 INFO:tasks.workunit.client.1.smithi047.stdout:5/212: symlink d19/d25/l50 0 2024-09-13T22:56:00.577 INFO:tasks.workunit.client.0.smithi002.stdout:1/187: dread d1/d13/d1d/f29 [0,4194304] 0 2024-09-13T22:56:00.577 INFO:tasks.workunit.client.1.smithi047.stdout:1/220: sync 2024-09-13T22:56:00.579 INFO:tasks.workunit.client.0.smithi002.stdout:9/175: creat d8/d10/f3f x:0 0 0 2024-09-13T22:56:00.579 INFO:tasks.workunit.client.0.smithi002.stdout:7/100: dread d8/fb [0,4194304] 0 2024-09-13T22:56:00.580 INFO:tasks.workunit.client.1.smithi047.stdout:8/272: rmdir d8/d36/d38 39 2024-09-13T22:56:00.580 INFO:tasks.workunit.client.1.smithi047.stdout:8/273: chown d8/d36/d40 1344477 1 2024-09-13T22:56:00.582 INFO:tasks.workunit.client.0.smithi002.stdout:3/159: symlink d9/d15/d26/l43 0 2024-09-13T22:56:00.583 INFO:tasks.workunit.client.0.smithi002.stdout:3/160: readlink d9/d15/d26/l3d 0 2024-09-13T22:56:00.583 INFO:tasks.workunit.client.1.smithi047.stdout:7/276: fdatasync d0/d7/f15 0 2024-09-13T22:56:00.584 INFO:tasks.workunit.client.0.smithi002.stdout:3/161: write d9/d15/d35/f3a [728509,44009] 0 2024-09-13T22:56:00.585 INFO:tasks.workunit.client.0.smithi002.stdout:7/101: dwrite d8/fc [0,4194304] 0 2024-09-13T22:56:00.586 INFO:tasks.workunit.client.1.smithi047.stdout:4/281: mknod dc/de/d23/d40/c60 0 2024-09-13T22:56:00.587 INFO:tasks.workunit.client.0.smithi002.stdout:8/127: write d3/f4 [35280,81511] 0 2024-09-13T22:56:00.592 INFO:tasks.workunit.client.1.smithi047.stdout:7/277: dwrite d0/f33 [0,4194304] 0 2024-09-13T22:56:00.592 INFO:tasks.workunit.client.1.smithi047.stdout:7/278: chown d0/d7/f3e 125 1 2024-09-13T22:56:00.597 INFO:tasks.workunit.client.1.smithi047.stdout:3/343: mkdir d0/d3/d4/d16/d73 0 2024-09-13T22:56:00.599 INFO:tasks.workunit.client.1.smithi047.stdout:7/279: dwrite d0/d7/da/d2e/f44 [0,4194304] 0 2024-09-13T22:56:00.600 INFO:tasks.workunit.client.1.smithi047.stdout:1/221: rmdir d0/d7/db 39 2024-09-13T22:56:00.601 INFO:tasks.workunit.client.1.smithi047.stdout:1/222: dread - d0/d7/d13/f3c zero size 2024-09-13T22:56:00.601 INFO:tasks.workunit.client.1.smithi047.stdout:7/280: read d0/d7/da/d4e/f4f [218029,82014] 0 2024-09-13T22:56:00.602 INFO:tasks.workunit.client.1.smithi047.stdout:8/274: creat d8/d36/d40/f5c x:0 0 0 2024-09-13T22:56:00.604 INFO:tasks.workunit.client.1.smithi047.stdout:7/281: truncate d0/db/f4c 4673499 0 2024-09-13T22:56:00.613 INFO:tasks.workunit.client.1.smithi047.stdout:5/213: creat d19/d23/d2e/d41/f51 x:0 0 0 2024-09-13T22:56:00.617 INFO:tasks.workunit.client.1.smithi047.stdout:8/275: dread d8/f1a [4194304,4194304] 0 2024-09-13T22:56:00.621 INFO:tasks.workunit.client.1.smithi047.stdout:1/223: dread d0/d7/d14/f2a [0,4194304] 0 2024-09-13T22:56:00.623 INFO:tasks.workunit.client.1.smithi047.stdout:5/214: dwrite d19/d34/d42/f48 [0,4194304] 0 2024-09-13T22:56:00.625 INFO:tasks.workunit.client.1.smithi047.stdout:1/224: fdatasync d0/d7/d14/d28/d36/f3d 0 2024-09-13T22:56:00.625 INFO:tasks.workunit.client.1.smithi047.stdout:6/267: rmdir d3/d11/d2b/d50 0 2024-09-13T22:56:00.627 INFO:tasks.workunit.client.1.smithi047.stdout:8/276: dwrite d8/f27 [0,4194304] 0 2024-09-13T22:56:00.628 INFO:tasks.workunit.client.1.smithi047.stdout:6/268: write d3/d11/d2b/d1c/f2e [3228813,6147] 0 2024-09-13T22:56:00.633 INFO:tasks.workunit.client.0.smithi002.stdout:0/133: mknod d1/c2a 0 2024-09-13T22:56:00.633 INFO:tasks.workunit.client.0.smithi002.stdout:2/119: unlink d1/d7/le 0 2024-09-13T22:56:00.633 INFO:tasks.workunit.client.0.smithi002.stdout:5/134: mknod d1/d10/c31 0 2024-09-13T22:56:00.634 INFO:tasks.workunit.client.0.smithi002.stdout:1/188: unlink d1/d13/d30/c12 0 2024-09-13T22:56:00.634 INFO:tasks.workunit.client.0.smithi002.stdout:2/120: readlink d1/d7/d8/lc 0 2024-09-13T22:56:00.635 INFO:tasks.workunit.client.0.smithi002.stdout:7/102: fsync d8/d9/f19 0 2024-09-13T22:56:00.635 INFO:tasks.workunit.client.0.smithi002.stdout:3/162: read d9/fd [372,15365] 0 2024-09-13T22:56:00.636 INFO:tasks.workunit.client.1.smithi047.stdout:4/282: link dc/f2f dc/d29/f61 0 2024-09-13T22:56:00.637 INFO:tasks.workunit.client.0.smithi002.stdout:6/147: truncate d12/d17/f1e 3605848 0 2024-09-13T22:56:00.639 INFO:tasks.workunit.client.0.smithi002.stdout:6/148: fdatasync d12/d17/f27 0 2024-09-13T22:56:00.641 INFO:tasks.workunit.client.1.smithi047.stdout:3/344: dwrite d0/d25/d44/f1e [0,4194304] 0 2024-09-13T22:56:00.643 INFO:tasks.workunit.client.0.smithi002.stdout:7/103: dwrite d8/f12 [0,4194304] 0 2024-09-13T22:56:00.646 INFO:tasks.workunit.client.0.smithi002.stdout:3/163: dwrite d9/d15/d26/f29 [0,4194304] 0 2024-09-13T22:56:00.648 INFO:tasks.workunit.client.1.smithi047.stdout:5/215: dwrite d19/f43 [0,4194304] 0 2024-09-13T22:56:00.650 INFO:tasks.workunit.client.1.smithi047.stdout:1/225: dread d0/d7/db/f38 [4194304,4194304] 0 2024-09-13T22:56:00.650 INFO:tasks.workunit.client.1.smithi047.stdout:5/216: dread - d19/f4f zero size 2024-09-13T22:56:00.652 INFO:tasks.workunit.client.1.smithi047.stdout:1/226: readlink d0/d7/d14/d28/d36/l1c 0 2024-09-13T22:56:00.654 INFO:tasks.workunit.client.1.smithi047.stdout:6/269: symlink d3/d2c/d55/l5a 0 2024-09-13T22:56:00.656 INFO:tasks.workunit.client.1.smithi047.stdout:6/270: chown l2 12148 1 2024-09-13T22:56:00.656 INFO:tasks.workunit.client.0.smithi002.stdout:1/189: write d1/d13/d30/f2f [1073723,101789] 0 2024-09-13T22:56:00.660 INFO:tasks.workunit.client.1.smithi047.stdout:8/277: write d8/f1a [2982670,114314] 0 2024-09-13T22:56:00.665 INFO:tasks.workunit.client.0.smithi002.stdout:0/134: dwrite d1/d4/fb [0,4194304] 0 2024-09-13T22:56:00.666 INFO:tasks.workunit.client.0.smithi002.stdout:0/135: dread - d1/f17 zero size 2024-09-13T22:56:00.667 INFO:tasks.workunit.client.0.smithi002.stdout:8/128: link d3/dc/fd d3/dc/f26 0 2024-09-13T22:56:00.669 INFO:tasks.workunit.client.0.smithi002.stdout:1/190: dwrite d1/d13/d30/f18 [0,4194304] 0 2024-09-13T22:56:00.669 INFO:tasks.workunit.client.0.smithi002.stdout:8/129: chown d3/dc 2165 1 2024-09-13T22:56:00.675 INFO:tasks.workunit.client.1.smithi047.stdout:4/283: write dc/de/d17/d25/d4a/f50 [59595,56982] 0 2024-09-13T22:56:00.677 INFO:tasks.workunit.client.0.smithi002.stdout:7/104: mknod d8/d10/c1b 0 2024-09-13T22:56:00.677 INFO:tasks.workunit.client.1.smithi047.stdout:6/271: creat d3/d11/d2b/d1c/f5b x:0 0 0 2024-09-13T22:56:00.679 INFO:tasks.workunit.client.1.smithi047.stdout:7/282: link d0/d19/d32/c39 d0/d7/c58 0 2024-09-13T22:56:00.682 INFO:tasks.workunit.client.0.smithi002.stdout:3/164: mkdir d9/d15/d26/d44 0 2024-09-13T22:56:00.685 INFO:tasks.workunit.client.1.smithi047.stdout:3/345: rename d0/d3/d4/d16/d2c/de/d68/c6a to d0/d25/d44/d5a/c74 0 2024-09-13T22:56:00.686 INFO:tasks.workunit.client.1.smithi047.stdout:3/346: read d0/d25/d44/d43/f54 [97873,42533] 0 2024-09-13T22:56:00.687 INFO:tasks.workunit.client.1.smithi047.stdout:5/217: link d19/d25/d45/f4d d19/d23/d4c/f52 0 2024-09-13T22:56:00.687 INFO:tasks.workunit.client.0.smithi002.stdout:3/165: dwrite d9/f2a [0,4194304] 0 2024-09-13T22:56:00.689 INFO:tasks.workunit.client.1.smithi047.stdout:4/284: creat dc/de/d23/d40/f62 x:0 0 0 2024-09-13T22:56:00.691 INFO:tasks.workunit.client.1.smithi047.stdout:6/272: mkdir d3/d11/d2b/d5c 0 2024-09-13T22:56:00.691 INFO:tasks.workunit.client.1.smithi047.stdout:4/285: truncate dc/de/f3f 2162628 0 2024-09-13T22:56:00.694 INFO:tasks.workunit.client.1.smithi047.stdout:7/283: dread d0/d19/f1c [0,4194304] 0 2024-09-13T22:56:00.694 INFO:tasks.workunit.client.1.smithi047.stdout:9/244: sync 2024-09-13T22:56:00.694 INFO:tasks.workunit.client.1.smithi047.stdout:2/323: sync 2024-09-13T22:56:00.695 INFO:tasks.workunit.client.0.smithi002.stdout:4/108: getdents d3 0 2024-09-13T22:56:00.696 INFO:tasks.workunit.client.0.smithi002.stdout:7/105: read f7 [1377658,129222] 0 2024-09-13T22:56:00.698 INFO:tasks.workunit.client.0.smithi002.stdout:5/135: creat d1/d10/f32 x:0 0 0 2024-09-13T22:56:00.701 INFO:tasks.workunit.client.0.smithi002.stdout:2/121: truncate d1/d7/d8/f10 164665 0 2024-09-13T22:56:00.701 INFO:tasks.workunit.client.0.smithi002.stdout:5/136: dread d1/d10/f15 [0,4194304] 0 2024-09-13T22:56:00.702 INFO:tasks.workunit.client.0.smithi002.stdout:5/137: fdatasync d1/d10/f21 0 2024-09-13T22:56:00.702 INFO:tasks.workunit.client.0.smithi002.stdout:3/166: symlink d9/df/d10/l45 0 2024-09-13T22:56:00.705 INFO:tasks.workunit.client.1.smithi047.stdout:7/284: creat d0/d7/da/d2e/d37/f59 x:0 0 0 2024-09-13T22:56:00.707 INFO:tasks.workunit.client.1.smithi047.stdout:9/245: rmdir d1/dc/d14 39 2024-09-13T22:56:00.708 INFO:tasks.workunit.client.1.smithi047.stdout:4/286: rmdir dc/de/d23/d40 39 2024-09-13T22:56:00.710 INFO:tasks.workunit.client.1.smithi047.stdout:4/287: read dc/de/d17/d25/f36 [1949331,110868] 0 2024-09-13T22:56:00.710 INFO:tasks.workunit.client.1.smithi047.stdout:2/324: rename d1/df/d1d/d20/d37/f58 to d1/d16/d40/d57/f71 0 2024-09-13T22:56:00.710 INFO:tasks.workunit.client.0.smithi002.stdout:6/149: write d12/f23 [1255095,63989] 0 2024-09-13T22:56:00.712 INFO:tasks.workunit.client.1.smithi047.stdout:8/278: truncate d8/f9 6796941 0 2024-09-13T22:56:00.713 INFO:tasks.workunit.client.0.smithi002.stdout:8/130: write d3/dc/d16/f25 [2120640,68910] 0 2024-09-13T22:56:00.714 INFO:tasks.workunit.client.1.smithi047.stdout:3/347: symlink d0/d3/d4/l75 0 2024-09-13T22:56:00.716 INFO:tasks.workunit.client.0.smithi002.stdout:4/109: unlink d3/f17 0 2024-09-13T22:56:00.717 INFO:tasks.workunit.client.1.smithi047.stdout:1/227: getdents d0/d7/d14 0 2024-09-13T22:56:00.719 INFO:tasks.workunit.client.1.smithi047.stdout:6/273: link d3/d11/d2b/d4c/d30/d48/f4e d3/d11/d2b/d4c/d30/f5d 0 2024-09-13T22:56:00.719 INFO:tasks.workunit.client.1.smithi047.stdout:6/274: fsync d3/f7 0 2024-09-13T22:56:00.725 INFO:tasks.workunit.client.0.smithi002.stdout:5/138: creat d1/d2a/f33 x:0 0 0 2024-09-13T22:56:00.726 INFO:tasks.workunit.client.0.smithi002.stdout:3/167: mkdir d9/d15/d46 0 2024-09-13T22:56:00.728 INFO:tasks.workunit.client.0.smithi002.stdout:0/136: rmdir d1/d4/d26 0 2024-09-13T22:56:00.729 INFO:tasks.workunit.client.0.smithi002.stdout:3/168: dread d9/d15/f30 [0,4194304] 0 2024-09-13T22:56:00.730 INFO:tasks.workunit.client.0.smithi002.stdout:1/191: mkdir d1/d13/d21/d39 0 2024-09-13T22:56:00.732 INFO:tasks.workunit.client.1.smithi047.stdout:2/325: creat d1/df/d1d/d20/d54/f72 x:0 0 0 2024-09-13T22:56:00.733 INFO:tasks.workunit.client.1.smithi047.stdout:2/326: dread d1/de/f5b [0,4194304] 0 2024-09-13T22:56:00.737 INFO:tasks.workunit.client.0.smithi002.stdout:4/110: creat d3/f1e x:0 0 0 2024-09-13T22:56:00.737 INFO:tasks.workunit.client.0.smithi002.stdout:4/111: readlink d3/l6 0 2024-09-13T22:56:00.737 INFO:tasks.workunit.client.1.smithi047.stdout:1/228: creat d0/d7/d10/f3f x:0 0 0 2024-09-13T22:56:00.738 INFO:tasks.workunit.client.0.smithi002.stdout:4/112: dread - d3/d14/f1a zero size 2024-09-13T22:56:00.738 INFO:tasks.workunit.client.1.smithi047.stdout:1/229: readlink d0/d7/l8 0 2024-09-13T22:56:00.738 INFO:tasks.workunit.client.1.smithi047.stdout:1/230: chown d0/d7/d14/d28 12352 1 2024-09-13T22:56:00.739 INFO:tasks.workunit.client.0.smithi002.stdout:7/106: rename d8/d9/f16 to d8/d10/d11/d13/f1c 0 2024-09-13T22:56:00.740 INFO:tasks.workunit.client.0.smithi002.stdout:2/122: creat d1/d7/f26 x:0 0 0 2024-09-13T22:56:00.741 INFO:tasks.workunit.client.1.smithi047.stdout:9/246: mkdir d1/dc/d14/d20/d50 0 2024-09-13T22:56:00.741 INFO:tasks.workunit.client.0.smithi002.stdout:2/123: truncate d1/d7/f26 1018622 0 2024-09-13T22:56:00.741 INFO:tasks.workunit.client.0.smithi002.stdout:5/139: symlink d1/d2a/l34 0 2024-09-13T22:56:00.743 INFO:tasks.workunit.client.0.smithi002.stdout:0/137: mknod d1/d2/c2b 0 2024-09-13T22:56:00.744 INFO:tasks.workunit.client.0.smithi002.stdout:0/138: stat d1/d2/c1b 0 2024-09-13T22:56:00.744 INFO:tasks.workunit.client.1.smithi047.stdout:4/288: creat dc/de/d23/d40/f63 x:0 0 0 2024-09-13T22:56:00.745 INFO:tasks.workunit.client.0.smithi002.stdout:3/169: mknod d9/df/d10/c47 0 2024-09-13T22:56:00.745 INFO:tasks.workunit.client.1.smithi047.stdout:4/289: write dc/de/d17/f1e [3375673,3835] 0 2024-09-13T22:56:00.746 INFO:tasks.workunit.client.0.smithi002.stdout:3/170: truncate d9/d15/f2f 980386 0 2024-09-13T22:56:00.746 INFO:tasks.workunit.client.1.smithi047.stdout:8/279: symlink d8/d3e/d4e/d4d/l5d 0 2024-09-13T22:56:00.746 INFO:tasks.workunit.client.1.smithi047.stdout:4/290: stat dc/d29/c33 0 2024-09-13T22:56:00.747 INFO:tasks.workunit.client.0.smithi002.stdout:1/192: creat d1/d13/d1d/f3a x:0 0 0 2024-09-13T22:56:00.748 INFO:tasks.workunit.client.0.smithi002.stdout:1/193: truncate d1/d13/d1d/d34/f35 1022456 0 2024-09-13T22:56:00.749 INFO:tasks.workunit.client.1.smithi047.stdout:2/327: symlink d1/d16/d40/d57/l73 0 2024-09-13T22:56:00.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:00 smithi002 ceph-mon[27637]: pgmap v10: 65 pgs: 65 active+clean; 581 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.0 MiB/s rd, 56 MiB/s wr, 201 op/s 2024-09-13T22:56:00.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:00 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:56:00.750 INFO:tasks.workunit.client.1.smithi047.stdout:8/280: dread d8/d36/f3a [4194304,4194304] 0 2024-09-13T22:56:00.750 INFO:tasks.workunit.client.1.smithi047.stdout:3/348: mkdir d0/d3/d4/d16/d32/d76 0 2024-09-13T22:56:00.752 INFO:tasks.workunit.client.0.smithi002.stdout:4/113: creat d3/d14/f1f x:0 0 0 2024-09-13T22:56:00.753 INFO:tasks.workunit.client.1.smithi047.stdout:1/231: symlink d0/d7/d14/l40 0 2024-09-13T22:56:00.754 INFO:tasks.workunit.client.1.smithi047.stdout:7/285: link d0/d19/c1b d0/d7/da/c5a 0 2024-09-13T22:56:00.760 INFO:tasks.workunit.client.0.smithi002.stdout:0/139: creat d1/d2/d10/f2c x:0 0 0 2024-09-13T22:56:00.762 INFO:tasks.workunit.client.0.smithi002.stdout:3/171: stat d9/df/c2b 0 2024-09-13T22:56:00.762 INFO:tasks.workunit.client.1.smithi047.stdout:3/349: creat d0/d3/d4/d16/d2c/de/f77 x:0 0 0 2024-09-13T22:56:00.764 INFO:tasks.workunit.client.0.smithi002.stdout:6/150: creat d12/f2b x:0 0 0 2024-09-13T22:56:00.765 INFO:tasks.workunit.client.1.smithi047.stdout:6/275: rename d3/d11/d2b/d4c/f1d to d3/d11/f5e 0 2024-09-13T22:56:00.767 INFO:tasks.workunit.client.0.smithi002.stdout:6/151: dread d12/f21 [0,4194304] 0 2024-09-13T22:56:00.767 INFO:tasks.workunit.client.1.smithi047.stdout:1/232: creat d0/d1d/f41 x:0 0 0 2024-09-13T22:56:00.768 INFO:tasks.workunit.client.0.smithi002.stdout:6/152: truncate d12/f22 371916 0 2024-09-13T22:56:00.769 INFO:tasks.workunit.client.0.smithi002.stdout:8/131: write d3/dc/fe [1177090,79186] 0 2024-09-13T22:56:00.770 INFO:tasks.workunit.client.1.smithi047.stdout:9/247: mkdir d1/dc/d14/d20/d4e/d51 0 2024-09-13T22:56:00.770 INFO:tasks.workunit.client.0.smithi002.stdout:8/132: chown d3/c15 119 1 2024-09-13T22:56:00.771 INFO:tasks.workunit.client.0.smithi002.stdout:8/133: chown d3/l1e 13681 1 2024-09-13T22:56:00.776 INFO:tasks.workunit.client.0.smithi002.stdout:1/194: mkdir d1/d13/d30/d31/d3b 0 2024-09-13T22:56:00.777 INFO:tasks.workunit.client.1.smithi047.stdout:7/286: mkdir d0/d57/d5b 0 2024-09-13T22:56:00.778 INFO:tasks.workunit.client.1.smithi047.stdout:8/281: dwrite d8/d36/d38/f45 [4194304,4194304] 0 2024-09-13T22:56:00.781 INFO:tasks.workunit.client.0.smithi002.stdout:8/134: mkdir d3/d27 0 2024-09-13T22:56:00.783 INFO:tasks.workunit.client.0.smithi002.stdout:7/107: truncate f6 768636 0 2024-09-13T22:56:00.786 INFO:tasks.workunit.client.0.smithi002.stdout:5/140: rename d1/d10/f15 to d1/d10/f35 0 2024-09-13T22:56:00.788 INFO:tasks.workunit.client.1.smithi047.stdout:2/328: truncate d1/de/f25 2102478 0 2024-09-13T22:56:00.792 INFO:tasks.workunit.client.0.smithi002.stdout:8/135: dwrite d3/fa [0,4194304] 0 2024-09-13T22:56:00.793 INFO:tasks.workunit.client.0.smithi002.stdout:1/195: dread d1/d1c/f26 [0,4194304] 0 2024-09-13T22:56:00.793 INFO:tasks.workunit.client.1.smithi047.stdout:7/287: unlink d0/d7/da/d2e/d37/f59 0 2024-09-13T22:56:00.793 INFO:tasks.workunit.client.1.smithi047.stdout:7/288: write d0/d19/f3f [3699563,4361] 0 2024-09-13T22:56:00.793 INFO:tasks.workunit.client.1.smithi047.stdout:8/282: symlink d8/d3e/d4e/d4d/l5e 0 2024-09-13T22:56:00.795 INFO:tasks.workunit.client.0.smithi002.stdout:2/124: dwrite d1/f23 [0,4194304] 0 2024-09-13T22:56:00.795 INFO:tasks.workunit.client.0.smithi002.stdout:2/125: read d1/d7/f26 [564802,26019] 0 2024-09-13T22:56:00.796 INFO:tasks.workunit.client.0.smithi002.stdout:2/126: write d1/d7/d8/f1b [944353,117479] 0 2024-09-13T22:56:00.797 INFO:tasks.workunit.client.0.smithi002.stdout:2/127: chown d1/d7/d8 3069473 1 2024-09-13T22:56:00.798 INFO:tasks.workunit.client.1.smithi047.stdout:4/291: rename dc/de/d23/d40/f43 to dc/de/d23/f64 0 2024-09-13T22:56:00.800 INFO:tasks.workunit.client.1.smithi047.stdout:4/292: truncate dc/d29/f38 344115 0 2024-09-13T22:56:00.800 INFO:tasks.workunit.client.0.smithi002.stdout:6/153: mknod d12/d17/d2a/c2c 0 2024-09-13T22:56:00.800 INFO:tasks.workunit.client.1.smithi047.stdout:4/293: chown dc/de/c12 6 1 2024-09-13T22:56:00.804 INFO:tasks.workunit.client.0.smithi002.stdout:2/128: dwrite d1/d7/d8/f1a [0,4194304] 0 2024-09-13T22:56:00.805 INFO:tasks.workunit.client.1.smithi047.stdout:6/276: write d3/f26 [859869,95347] 0 2024-09-13T22:56:00.810 INFO:tasks.workunit.client.0.smithi002.stdout:7/108: symlink d8/d10/l1d 0 2024-09-13T22:56:00.814 INFO:tasks.workunit.client.0.smithi002.stdout:5/141: rmdir d1 39 2024-09-13T22:56:00.816 INFO:tasks.workunit.client.1.smithi047.stdout:8/283: rmdir d8/d3e 39 2024-09-13T22:56:00.819 INFO:tasks.workunit.client.1.smithi047.stdout:9/248: getdents d1/dc/d14/dd 0 2024-09-13T22:56:00.819 INFO:tasks.workunit.client.1.smithi047.stdout:9/249: dread - d1/f3f zero size 2024-09-13T22:56:00.823 INFO:tasks.workunit.client.1.smithi047.stdout:6/277: dread d3/d11/d2b/d1c/f2e [0,4194304] 0 2024-09-13T22:56:00.823 INFO:tasks.workunit.client.1.smithi047.stdout:4/294: fsync dc/fd 0 2024-09-13T22:56:00.826 INFO:tasks.workunit.client.1.smithi047.stdout:8/284: mknod d8/d36/d40/c5f 0 2024-09-13T22:56:00.827 INFO:tasks.workunit.client.1.smithi047.stdout:8/285: fdatasync d8/d36/d40/f48 0 2024-09-13T22:56:00.828 INFO:tasks.workunit.client.1.smithi047.stdout:9/250: unlink d1/c22 0 2024-09-13T22:56:00.829 INFO:tasks.workunit.client.1.smithi047.stdout:8/286: read d8/f30 [4022668,67664] 0 2024-09-13T22:56:00.830 INFO:tasks.workunit.client.1.smithi047.stdout:8/287: fdatasync d8/d36/d40/f59 0 2024-09-13T22:56:00.830 INFO:tasks.workunit.client.0.smithi002.stdout:2/129: write d1/f1d [681732,103563] 0 2024-09-13T22:56:00.830 INFO:tasks.workunit.client.0.smithi002.stdout:7/109: creat d8/d10/f1e x:0 0 0 2024-09-13T22:56:00.830 INFO:tasks.workunit.client.0.smithi002.stdout:2/130: chown d1/f23 617324 1 2024-09-13T22:56:00.832 INFO:tasks.workunit.client.0.smithi002.stdout:0/140: link d1/d2/f19 d1/f2d 0 2024-09-13T22:56:00.833 INFO:tasks.workunit.client.0.smithi002.stdout:8/136: mknod d3/d27/c28 0 2024-09-13T22:56:00.837 INFO:tasks.workunit.client.0.smithi002.stdout:1/196: rename d1/d13/d1d/d2e/f38 to d1/d13/d21/d39/f3c 0 2024-09-13T22:56:00.837 INFO:tasks.workunit.client.0.smithi002.stdout:6/154: dread d12/f24 [0,4194304] 0 2024-09-13T22:56:00.838 INFO:tasks.workunit.client.0.smithi002.stdout:9/176: sync 2024-09-13T22:56:00.839 INFO:tasks.workunit.client.1.smithi047.stdout:1/233: rename d0/d7/f31 to d0/d7/d13/f42 0 2024-09-13T22:56:00.841 INFO:tasks.workunit.client.0.smithi002.stdout:7/110: unlink d8/d10/l1d 0 2024-09-13T22:56:00.842 INFO:tasks.workunit.client.1.smithi047.stdout:8/288: symlink d8/d3f/l60 0 2024-09-13T22:56:00.842 INFO:tasks.workunit.client.1.smithi047.stdout:8/289: stat d8/d36/f3d 0 2024-09-13T22:56:00.844 INFO:tasks.workunit.client.1.smithi047.stdout:6/278: symlink d3/d11/l5f 0 2024-09-13T22:56:00.847 INFO:tasks.workunit.client.1.smithi047.stdout:2/329: rename d1 to d1/df/d26/d74 22 2024-09-13T22:56:00.847 INFO:tasks.workunit.client.1.smithi047.stdout:2/330: chown d1/df/d35 119709 1 2024-09-13T22:56:00.851 INFO:tasks.workunit.client.0.smithi002.stdout:5/142: rename d1/d10/f28 to d1/f36 0 2024-09-13T22:56:00.853 INFO:tasks.workunit.client.0.smithi002.stdout:1/197: mkdir d1/d13/d30/d31/d3d 0 2024-09-13T22:56:00.853 INFO:tasks.workunit.client.0.smithi002.stdout:1/198: dread - d1/d13/d1d/f3a zero size 2024-09-13T22:56:00.855 INFO:tasks.workunit.client.1.smithi047.stdout:9/251: creat d1/dc/d14/f52 x:0 0 0 2024-09-13T22:56:00.857 INFO:tasks.workunit.client.0.smithi002.stdout:7/111: rmdir d8 39 2024-09-13T22:56:00.857 INFO:tasks.workunit.client.1.smithi047.stdout:1/234: write d0/d7/f12 [4896611,9188] 0 2024-09-13T22:56:00.859 INFO:tasks.workunit.client.1.smithi047.stdout:7/289: rename d0/d19/d32 to d0/d57/d5b/d5c 0 2024-09-13T22:56:00.859 INFO:tasks.workunit.client.0.smithi002.stdout:9/177: dwrite d8/d1e/f22 [4194304,4194304] 0 2024-09-13T22:56:00.861 INFO:tasks.workunit.client.1.smithi047.stdout:2/331: creat d1/df/d1d/d20/d2b/f75 x:0 0 0 2024-09-13T22:56:00.863 INFO:tasks.workunit.client.0.smithi002.stdout:8/137: creat d3/d21/f29 x:0 0 0 2024-09-13T22:56:00.863 INFO:tasks.workunit.client.1.smithi047.stdout:8/290: symlink d8/l61 0 2024-09-13T22:56:00.866 INFO:tasks.workunit.client.0.smithi002.stdout:2/131: truncate d1/d7/d8/f1a 707263 0 2024-09-13T22:56:00.867 INFO:tasks.workunit.client.0.smithi002.stdout:2/132: fsync d1/d7/d8/f1b 0 2024-09-13T22:56:00.868 INFO:tasks.workunit.client.0.smithi002.stdout:2/133: fsync d1/d7/d8/f1b 0 2024-09-13T22:56:00.869 INFO:tasks.workunit.client.1.smithi047.stdout:6/279: dwrite d3/d11/d2b/d1c/f2e [0,4194304] 0 2024-09-13T22:56:00.869 INFO:tasks.workunit.client.1.smithi047.stdout:9/252: write d1/dc/d18/f48 [9899105,181] 0 2024-09-13T22:56:00.869 INFO:tasks.workunit.client.0.smithi002.stdout:2/134: read - d1/d7/f16 zero size 2024-09-13T22:56:00.870 INFO:tasks.workunit.client.0.smithi002.stdout:0/141: rename d1/l11 to d1/d4/l2e 0 2024-09-13T22:56:00.870 INFO:tasks.workunit.client.0.smithi002.stdout:1/199: rename d1/d13/d1d/d34 to d1/d13/d1d/d34/d3e 22 2024-09-13T22:56:00.876 INFO:tasks.workunit.client.0.smithi002.stdout:8/138: symlink d3/dc/d18/l2a 0 2024-09-13T22:56:00.876 INFO:tasks.workunit.client.0.smithi002.stdout:8/139: fdatasync d3/f6 0 2024-09-13T22:56:00.880 INFO:tasks.workunit.client.0.smithi002.stdout:8/140: dread d3/fa [0,4194304] 0 2024-09-13T22:56:00.880 INFO:tasks.workunit.client.0.smithi002.stdout:5/143: write d1/f3 [1239653,66640] 0 2024-09-13T22:56:00.881 INFO:tasks.workunit.client.0.smithi002.stdout:8/141: chown d3/f20 187643858 1 2024-09-13T22:56:00.881 INFO:tasks.workunit.client.0.smithi002.stdout:5/144: dread - d1/d10/f2e zero size 2024-09-13T22:56:00.881 INFO:tasks.workunit.client.0.smithi002.stdout:0/142: symlink d1/d2/l2f 0 2024-09-13T22:56:00.883 INFO:tasks.workunit.client.0.smithi002.stdout:7/112: unlink d8/fc 0 2024-09-13T22:56:00.885 INFO:tasks.workunit.client.0.smithi002.stdout:9/178: symlink d8/l40 0 2024-09-13T22:56:00.886 INFO:tasks.workunit.client.0.smithi002.stdout:9/179: write d8/d10/d1c/f2b [988351,37577] 0 2024-09-13T22:56:00.887 INFO:tasks.workunit.client.0.smithi002.stdout:5/145: creat d1/f37 x:0 0 0 2024-09-13T22:56:00.891 INFO:tasks.workunit.client.0.smithi002.stdout:8/142: rename d3/dc/c1d to d3/c2b 0 2024-09-13T22:56:00.891 INFO:tasks.workunit.client.0.smithi002.stdout:7/113: rename d8 to d8/d10/d11/d1f 22 2024-09-13T22:56:00.891 INFO:tasks.workunit.client.0.smithi002.stdout:0/143: rmdir d1/d2 39 2024-09-13T22:56:00.894 INFO:tasks.workunit.client.0.smithi002.stdout:8/143: dread d3/f4 [0,4194304] 0 2024-09-13T22:56:00.895 INFO:tasks.workunit.client.0.smithi002.stdout:9/180: rename d8/d2c/f31 to d8/d1e/f41 0 2024-09-13T22:56:00.895 INFO:tasks.workunit.client.1.smithi047.stdout:0/276: sync 2024-09-13T22:56:00.896 INFO:tasks.workunit.client.1.smithi047.stdout:8/291: symlink d8/d36/d38/l62 0 2024-09-13T22:56:00.897 INFO:tasks.workunit.client.0.smithi002.stdout:9/181: truncate d8/d10/d1c/f2b 1344416 0 2024-09-13T22:56:00.897 INFO:tasks.workunit.client.1.smithi047.stdout:6/280: creat d3/d11/d2b/f60 x:0 0 0 2024-09-13T22:56:00.897 INFO:tasks.workunit.client.0.smithi002.stdout:2/135: getdents d1/d7/d8 0 2024-09-13T22:56:00.898 INFO:tasks.workunit.client.0.smithi002.stdout:2/136: write d1/d7/d8/f1b [738527,34037] 0 2024-09-13T22:56:00.899 INFO:tasks.workunit.client.1.smithi047.stdout:4/295: rename dc/f3c to dc/d29/d4d/f65 0 2024-09-13T22:56:00.899 INFO:tasks.workunit.client.1.smithi047.stdout:7/290: rename d0/d57 to d0/d57/d5b/d5d 22 2024-09-13T22:56:00.900 INFO:tasks.workunit.client.0.smithi002.stdout:1/200: getdents d1/d13/d30/d31 0 2024-09-13T22:56:00.900 INFO:tasks.workunit.client.0.smithi002.stdout:0/144: dread d1/d4/f24 [0,4194304] 0 2024-09-13T22:56:00.901 INFO:tasks.workunit.client.1.smithi047.stdout:4/296: readlink dc/de/d17/l1f 0 2024-09-13T22:56:00.902 INFO:tasks.workunit.client.1.smithi047.stdout:2/332: creat d1/df/d26/d4b/f76 x:0 0 0 2024-09-13T22:56:00.902 INFO:tasks.workunit.client.0.smithi002.stdout:1/201: truncate d1/d13/f32 465140 0 2024-09-13T22:56:00.903 INFO:tasks.workunit.client.0.smithi002.stdout:8/144: mknod d3/d27/c2c 0 2024-09-13T22:56:00.904 INFO:tasks.workunit.client.0.smithi002.stdout:8/145: chown d3/d27 206514924 1 2024-09-13T22:56:00.904 INFO:tasks.workunit.client.0.smithi002.stdout:9/182: dwrite d8/d1e/f39 [0,4194304] 0 2024-09-13T22:56:00.905 INFO:tasks.workunit.client.0.smithi002.stdout:8/146: chown d3/d21 12305725 1 2024-09-13T22:56:00.905 INFO:tasks.workunit.client.1.smithi047.stdout:6/281: mknod d3/d11/d2b/d4c/c61 0 2024-09-13T22:56:00.905 INFO:tasks.workunit.client.0.smithi002.stdout:8/147: stat d3/dc/d18/l2a 0 2024-09-13T22:56:00.906 INFO:tasks.workunit.client.1.smithi047.stdout:8/292: symlink d8/l63 0 2024-09-13T22:56:00.907 INFO:tasks.workunit.client.0.smithi002.stdout:8/148: write d3/f8 [4138422,128376] 0 2024-09-13T22:56:00.908 INFO:tasks.workunit.client.0.smithi002.stdout:2/137: creat d1/d7/d8/f27 x:0 0 0 2024-09-13T22:56:00.909 INFO:tasks.workunit.client.1.smithi047.stdout:0/277: dread d1/d5/d16/d23/d45/f4f [0,4194304] 0 2024-09-13T22:56:00.911 INFO:tasks.workunit.client.1.smithi047.stdout:9/253: rename d1/dc/f2a to d1/dc/d14/d20/d4e/d51/f53 0 2024-09-13T22:56:00.912 INFO:tasks.workunit.client.1.smithi047.stdout:0/278: write d1/d5/d16/d23/f42 [48578,45720] 0 2024-09-13T22:56:00.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:00 smithi047 ceph-mon[34560]: pgmap v10: 65 pgs: 65 active+clean; 581 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.0 MiB/s rd, 56 MiB/s wr, 201 op/s 2024-09-13T22:56:00.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:00 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:56:00.914 INFO:tasks.workunit.client.0.smithi002.stdout:0/145: write d1/d2/f1d [4777769,79369] 0 2024-09-13T22:56:00.916 INFO:tasks.workunit.client.1.smithi047.stdout:4/297: rmdir dc/d29 39 2024-09-13T22:56:00.918 INFO:tasks.workunit.client.1.smithi047.stdout:7/291: unlink d0/d7/da/d2e/c40 0 2024-09-13T22:56:00.925 INFO:tasks.workunit.client.1.smithi047.stdout:7/292: dwrite d0/db/f4c [0,4194304] 0 2024-09-13T22:56:00.925 INFO:tasks.workunit.client.0.smithi002.stdout:5/146: getdents d1/d10 0 2024-09-13T22:56:00.927 INFO:tasks.workunit.client.1.smithi047.stdout:2/333: write d1/de/f46 [389626,70334] 0 2024-09-13T22:56:00.931 INFO:tasks.workunit.client.1.smithi047.stdout:9/254: rmdir d1/dc/d18 39 2024-09-13T22:56:00.932 INFO:tasks.workunit.client.0.smithi002.stdout:2/138: dread d1/f5 [0,4194304] 0 2024-09-13T22:56:00.932 INFO:tasks.workunit.client.0.smithi002.stdout:2/139: stat d1/d7/d8/c22 0 2024-09-13T22:56:00.933 INFO:tasks.workunit.client.0.smithi002.stdout:7/114: getdents d8/d10 0 2024-09-13T22:56:00.934 INFO:tasks.workunit.client.0.smithi002.stdout:2/140: write d1/d7/d8/f17 [946406,46295] 0 2024-09-13T22:56:00.934 INFO:tasks.workunit.client.0.smithi002.stdout:9/183: mkdir d8/d10/d42 0 2024-09-13T22:56:00.936 INFO:tasks.workunit.client.0.smithi002.stdout:9/184: write d8/d1e/f25 [257574,48042] 0 2024-09-13T22:56:00.936 INFO:tasks.workunit.client.0.smithi002.stdout:5/147: rmdir d1/d10 39 2024-09-13T22:56:00.939 INFO:tasks.workunit.client.1.smithi047.stdout:7/293: symlink d0/db/l5e 0 2024-09-13T22:56:00.940 INFO:tasks.workunit.client.1.smithi047.stdout:9/255: dwrite d1/dc/d14/d20/f4f [0,4194304] 0 2024-09-13T22:56:00.941 INFO:tasks.workunit.client.0.smithi002.stdout:9/185: dread d8/d1e/f27 [0,4194304] 0 2024-09-13T22:56:00.941 INFO:tasks.workunit.client.0.smithi002.stdout:2/141: dwrite d1/d7/d8/f17 [0,4194304] 0 2024-09-13T22:56:00.941 INFO:tasks.workunit.client.1.smithi047.stdout:7/294: chown d0/d7/da/d1e/c2a 581 1 2024-09-13T22:56:00.942 INFO:tasks.workunit.client.1.smithi047.stdout:7/295: readlink d0/d7/da/d47/l55 0 2024-09-13T22:56:00.942 INFO:tasks.workunit.client.0.smithi002.stdout:8/149: link d3/f6 d3/dc/d18/f2d 0 2024-09-13T22:56:00.943 INFO:tasks.workunit.client.1.smithi047.stdout:7/296: chown d0/d7/da/d2e 1961201001 1 2024-09-13T22:56:00.944 INFO:tasks.workunit.client.1.smithi047.stdout:2/334: mknod d1/df/d1d/d20/d2b/c77 0 2024-09-13T22:56:00.946 INFO:tasks.workunit.client.1.smithi047.stdout:6/282: rename d3/d11/f5e to d3/d11/d2b/d1c/d4d/f62 0 2024-09-13T22:56:00.948 INFO:tasks.workunit.client.1.smithi047.stdout:0/279: rename d1/d5/d16/d23 to d1/d5/d16/d23/d2d/d62 22 2024-09-13T22:56:00.951 INFO:tasks.workunit.client.0.smithi002.stdout:4/114: sync 2024-09-13T22:56:00.952 INFO:tasks.workunit.client.0.smithi002.stdout:5/148: rename d1/ca to d1/d2a/c38 0 2024-09-13T22:56:00.952 INFO:tasks.workunit.client.1.smithi047.stdout:7/297: dwrite d0/d7/da/f2b [0,4194304] 0 2024-09-13T22:56:00.953 INFO:tasks.workunit.client.1.smithi047.stdout:7/298: fsync d0/db/f16 0 2024-09-13T22:56:00.955 INFO:tasks.workunit.client.1.smithi047.stdout:8/293: rename d8/d3e to d8/d64 0 2024-09-13T22:56:00.957 INFO:tasks.workunit.client.1.smithi047.stdout:8/294: write d8/f2c [8261041,82246] 0 2024-09-13T22:56:00.959 INFO:tasks.workunit.client.0.smithi002.stdout:2/142: symlink d1/d7/d8/l28 0 2024-09-13T22:56:00.961 INFO:tasks.workunit.client.1.smithi047.stdout:4/298: rename dc/de/d17/l4b to dc/de/d17/d25/d4a/l66 0 2024-09-13T22:56:00.962 INFO:tasks.workunit.client.1.smithi047.stdout:0/280: creat d1/d5/d16/f63 x:0 0 0 2024-09-13T22:56:00.964 INFO:tasks.workunit.client.1.smithi047.stdout:0/281: read d1/d5/f29 [254616,9738] 0 2024-09-13T22:56:00.964 INFO:tasks.workunit.client.0.smithi002.stdout:1/202: link d1/d13/d21/f2b d1/d13/f3f 0 2024-09-13T22:56:00.965 INFO:tasks.workunit.client.0.smithi002.stdout:1/203: fsync d1/f27 0 2024-09-13T22:56:00.966 INFO:tasks.workunit.client.0.smithi002.stdout:7/115: truncate f6 1742489 0 2024-09-13T22:56:00.970 INFO:tasks.workunit.client.1.smithi047.stdout:7/299: unlink d0/d7/f17 0 2024-09-13T22:56:00.971 INFO:tasks.workunit.client.1.smithi047.stdout:7/300: write d0/d7/f3e [208843,70603] 0 2024-09-13T22:56:00.974 INFO:tasks.workunit.client.1.smithi047.stdout:8/295: mknod d8/d36/d38/c65 0 2024-09-13T22:56:00.978 INFO:tasks.workunit.client.1.smithi047.stdout:6/283: dwrite d3/d11/d2b/f28 [0,4194304] 0 2024-09-13T22:56:00.981 INFO:tasks.workunit.client.1.smithi047.stdout:2/335: rmdir d1/d6f 0 2024-09-13T22:56:00.982 INFO:tasks.workunit.client.0.smithi002.stdout:5/149: symlink d1/l39 0 2024-09-13T22:56:00.984 INFO:tasks.workunit.client.0.smithi002.stdout:9/186: link d8/d1e/c26 d8/d1e/c43 0 2024-09-13T22:56:00.985 INFO:tasks.workunit.client.1.smithi047.stdout:7/301: symlink d0/d57/d5b/d5c/l5f 0 2024-09-13T22:56:00.987 INFO:tasks.workunit.client.0.smithi002.stdout:2/143: fdatasync d1/d7/d8/f1a 0 2024-09-13T22:56:00.988 INFO:tasks.workunit.client.1.smithi047.stdout:8/296: creat d8/d3f/f66 x:0 0 0 2024-09-13T22:56:00.989 INFO:tasks.workunit.client.0.smithi002.stdout:2/144: write d1/d7/d8/f17 [3979278,83253] 0 2024-09-13T22:56:00.989 INFO:tasks.workunit.client.1.smithi047.stdout:8/297: fdatasync d8/d36/f3a 0 2024-09-13T22:56:00.990 INFO:tasks.workunit.client.0.smithi002.stdout:9/187: dread d8/d1e/f34 [0,4194304] 0 2024-09-13T22:56:00.997 INFO:tasks.workunit.client.0.smithi002.stdout:7/116: write d8/d9/fd [5020348,4899] 0 2024-09-13T22:56:00.997 INFO:tasks.workunit.client.0.smithi002.stdout:5/150: chown d1/d10/f32 284 1 2024-09-13T22:56:01.000 INFO:tasks.workunit.client.1.smithi047.stdout:2/336: creat d1/df/d35/f78 x:0 0 0 2024-09-13T22:56:01.001 INFO:tasks.workunit.client.1.smithi047.stdout:7/302: chown d0/d7/f6 5508 1 2024-09-13T22:56:01.001 INFO:tasks.workunit.client.1.smithi047.stdout:0/282: truncate d1/f4 1518263 0 2024-09-13T22:56:01.002 INFO:tasks.workunit.client.1.smithi047.stdout:7/303: readlink d0/d57/d5b/d5c/l53 0 2024-09-13T22:56:01.002 INFO:tasks.workunit.client.1.smithi047.stdout:0/283: stat d1/d5/d16/f63 0 2024-09-13T22:56:01.004 INFO:tasks.workunit.client.0.smithi002.stdout:8/150: getdents d3/dc/d16 0 2024-09-13T22:56:01.009 INFO:tasks.workunit.client.1.smithi047.stdout:6/284: dwrite d3/f9 [0,4194304] 0 2024-09-13T22:56:01.010 INFO:tasks.workunit.client.0.smithi002.stdout:9/188: unlink d8/d10/d1c/l2a 0 2024-09-13T22:56:01.011 INFO:tasks.workunit.client.0.smithi002.stdout:4/115: getdents d3/d14 0 2024-09-13T22:56:01.014 INFO:tasks.workunit.client.1.smithi047.stdout:2/337: rmdir d1/de 39 2024-09-13T22:56:01.019 INFO:tasks.workunit.client.0.smithi002.stdout:5/151: unlink d1/d10/f30 0 2024-09-13T22:56:01.020 INFO:tasks.workunit.client.0.smithi002.stdout:5/152: write d1/fe [1247923,117149] 0 2024-09-13T22:56:01.020 INFO:tasks.workunit.client.1.smithi047.stdout:0/284: creat d1/d5/d16/d23/f64 x:0 0 0 2024-09-13T22:56:01.021 INFO:tasks.workunit.client.1.smithi047.stdout:4/299: dwrite dc/d29/f41 [0,4194304] 0 2024-09-13T22:56:01.023 INFO:tasks.workunit.client.1.smithi047.stdout:8/298: truncate d8/f10 4772204 0 2024-09-13T22:56:01.026 INFO:tasks.workunit.client.0.smithi002.stdout:3/172: sync 2024-09-13T22:56:01.026 INFO:tasks.workunit.client.0.smithi002.stdout:6/155: sync 2024-09-13T22:56:01.027 INFO:tasks.workunit.client.0.smithi002.stdout:3/173: read d9/d15/f27 [2268874,76948] 0 2024-09-13T22:56:01.028 INFO:tasks.workunit.client.0.smithi002.stdout:9/189: creat d8/d10/d1c/d3d/f44 x:0 0 0 2024-09-13T22:56:01.028 INFO:tasks.workunit.client.0.smithi002.stdout:6/156: truncate d12/d17/f19 297893 0 2024-09-13T22:56:01.029 INFO:tasks.workunit.client.0.smithi002.stdout:6/157: readlink l11 0 2024-09-13T22:56:01.030 INFO:tasks.workunit.client.0.smithi002.stdout:4/116: unlink d3/d14/f15 0 2024-09-13T22:56:01.030 INFO:tasks.workunit.client.0.smithi002.stdout:4/117: chown f2 239212236 1 2024-09-13T22:56:01.031 INFO:tasks.workunit.client.1.smithi047.stdout:2/338: fsync d1/de/f5b 0 2024-09-13T22:56:01.032 INFO:tasks.workunit.client.0.smithi002.stdout:4/118: write d3/fb [2843176,53513] 0 2024-09-13T22:56:01.032 INFO:tasks.workunit.client.0.smithi002.stdout:7/117: symlink d8/l20 0 2024-09-13T22:56:01.033 INFO:tasks.workunit.client.1.smithi047.stdout:7/304: mknod d0/d7/da/d1e/d51/c60 0 2024-09-13T22:56:01.036 INFO:tasks.workunit.client.1.smithi047.stdout:7/305: write d0/d7/da/d1e/f24 [658350,105079] 0 2024-09-13T22:56:01.037 INFO:tasks.workunit.client.0.smithi002.stdout:9/190: dwrite d8/d1e/f39 [0,4194304] 0 2024-09-13T22:56:01.038 INFO:tasks.workunit.client.1.smithi047.stdout:2/339: dwrite d1/df/d26/d4b/f50 [0,4194304] 0 2024-09-13T22:56:01.038 INFO:tasks.workunit.client.1.smithi047.stdout:4/300: rename dc/d29/d4c/c4f to dc/de/d23/d40/c67 0 2024-09-13T22:56:01.040 INFO:tasks.workunit.client.1.smithi047.stdout:4/301: chown dc/d29/f38 3 1 2024-09-13T22:56:01.041 INFO:tasks.workunit.client.0.smithi002.stdout:8/151: dwrite d3/f6 [0,4194304] 0 2024-09-13T22:56:01.043 INFO:tasks.workunit.client.0.smithi002.stdout:3/174: creat d9/d15/d26/f48 x:0 0 0 2024-09-13T22:56:01.044 INFO:tasks.workunit.client.1.smithi047.stdout:0/285: mkdir d1/d5/d11/d52/d65 0 2024-09-13T22:56:01.045 INFO:tasks.workunit.client.0.smithi002.stdout:3/175: dread - d9/d15/f2d zero size 2024-09-13T22:56:01.045 INFO:tasks.workunit.client.0.smithi002.stdout:0/146: sync 2024-09-13T22:56:01.045 INFO:tasks.workunit.client.0.smithi002.stdout:1/204: sync 2024-09-13T22:56:01.046 INFO:tasks.workunit.client.0.smithi002.stdout:3/176: chown d9/d15/d36 0 1 2024-09-13T22:56:01.050 INFO:tasks.workunit.client.1.smithi047.stdout:2/340: dwrite d1/df/f3f [0,4194304] 0 2024-09-13T22:56:01.050 INFO:tasks.workunit.client.0.smithi002.stdout:8/152: dwrite d3/dc/d16/f25 [0,4194304] 0 2024-09-13T22:56:01.051 INFO:tasks.workunit.client.0.smithi002.stdout:8/153: write d3/f6 [402429,10775] 0 2024-09-13T22:56:01.053 INFO:tasks.workunit.client.1.smithi047.stdout:7/306: mknod d0/d7/da/d4e/c61 0 2024-09-13T22:56:01.056 INFO:tasks.workunit.client.0.smithi002.stdout:6/158: truncate d12/d17/f18 392125 0 2024-09-13T22:56:01.056 INFO:tasks.workunit.client.1.smithi047.stdout:0/286: dread d1/d5/d11/d2f/f48 [0,4194304] 0 2024-09-13T22:56:01.057 INFO:tasks.workunit.client.1.smithi047.stdout:0/287: fsync d1/d5/f59 0 2024-09-13T22:56:01.058 INFO:tasks.workunit.client.1.smithi047.stdout:0/288: readlink d1/d5/l5b 0 2024-09-13T22:56:01.061 INFO:tasks.workunit.client.1.smithi047.stdout:8/299: symlink d8/l67 0 2024-09-13T22:56:01.061 INFO:tasks.workunit.client.1.smithi047.stdout:4/302: mknod dc/de/d39/c68 0 2024-09-13T22:56:01.062 INFO:tasks.workunit.client.1.smithi047.stdout:0/289: dread d1/d5/d16/d23/d2d/f55 [0,4194304] 0 2024-09-13T22:56:01.062 INFO:tasks.workunit.client.0.smithi002.stdout:4/119: mknod d3/c20 0 2024-09-13T22:56:01.063 INFO:tasks.workunit.client.1.smithi047.stdout:5/218: sync 2024-09-13T22:56:01.063 INFO:tasks.workunit.client.1.smithi047.stdout:3/350: sync 2024-09-13T22:56:01.063 INFO:tasks.workunit.client.1.smithi047.stdout:6/285: creat d3/d11/f63 x:0 0 0 2024-09-13T22:56:01.064 INFO:tasks.workunit.client.1.smithi047.stdout:8/300: write d8/f32 [2212895,105109] 0 2024-09-13T22:56:01.064 INFO:tasks.workunit.client.1.smithi047.stdout:0/290: write d1/d7/f4b [1569161,6692] 0 2024-09-13T22:56:01.067 INFO:tasks.workunit.client.1.smithi047.stdout:6/286: truncate d3/d11/f3f 606996 0 2024-09-13T22:56:01.072 INFO:tasks.workunit.client.1.smithi047.stdout:2/341: creat d1/df/d1d/d20/d37/d43/f79 x:0 0 0 2024-09-13T22:56:01.073 INFO:tasks.workunit.client.0.smithi002.stdout:1/205: dread d1/d13/d1d/d2e/f37 [0,4194304] 0 2024-09-13T22:56:01.074 INFO:tasks.workunit.client.1.smithi047.stdout:6/287: dwrite d3/f7 [0,4194304] 0 2024-09-13T22:56:01.075 INFO:tasks.workunit.client.0.smithi002.stdout:7/118: dwrite d8/d10/d11/d13/f1c [0,4194304] 0 2024-09-13T22:56:01.075 INFO:tasks.workunit.client.0.smithi002.stdout:2/145: getdents d1 0 2024-09-13T22:56:01.076 INFO:tasks.workunit.client.1.smithi047.stdout:7/307: creat d0/d19/f62 x:0 0 0 2024-09-13T22:56:01.077 INFO:tasks.workunit.client.0.smithi002.stdout:5/153: dwrite d1/d10/f2d [0,4194304] 0 2024-09-13T22:56:01.077 INFO:tasks.workunit.client.0.smithi002.stdout:7/119: write d8/f12 [4783728,3047] 0 2024-09-13T22:56:01.078 INFO:tasks.workunit.client.0.smithi002.stdout:2/146: write d1/f1d [1529254,86133] 0 2024-09-13T22:56:01.082 INFO:tasks.workunit.client.0.smithi002.stdout:3/177: rmdir d9 39 2024-09-13T22:56:01.085 INFO:tasks.workunit.client.0.smithi002.stdout:0/147: mknod d1/d4/c30 0 2024-09-13T22:56:01.086 INFO:tasks.workunit.client.1.smithi047.stdout:5/219: rmdir d19/d34/d42 39 2024-09-13T22:56:01.088 INFO:tasks.workunit.client.0.smithi002.stdout:9/191: dread d8/d10/d1c/f15 [0,4194304] 0 2024-09-13T22:56:01.089 INFO:tasks.workunit.client.1.smithi047.stdout:4/303: truncate dc/d29/d4c/f5f 3092140 0 2024-09-13T22:56:01.089 INFO:tasks.workunit.client.0.smithi002.stdout:9/192: dread - d8/d10/f3f zero size 2024-09-13T22:56:01.090 INFO:tasks.workunit.client.1.smithi047.stdout:4/304: chown dc/de/d23/d40/f63 2 1 2024-09-13T22:56:01.091 INFO:tasks.workunit.client.0.smithi002.stdout:6/159: truncate d12/f21 1201829 0 2024-09-13T22:56:01.095 INFO:tasks.workunit.client.1.smithi047.stdout:3/351: rename d0/d3/d4/d16/d2c/de/d1f/d2e/f4a to d0/d25/d44/d43/d3a/f78 0 2024-09-13T22:56:01.099 INFO:tasks.workunit.client.1.smithi047.stdout:6/288: mkdir d3/d11/d2b/d4c/d30/d48/d64 0 2024-09-13T22:56:01.102 INFO:tasks.workunit.client.1.smithi047.stdout:6/289: dread d3/d11/f3f [0,4194304] 0 2024-09-13T22:56:01.102 INFO:tasks.workunit.client.1.smithi047.stdout:7/308: unlink d0/d57/d5b/d5c/l53 0 2024-09-13T22:56:01.104 INFO:tasks.workunit.client.1.smithi047.stdout:2/342: dwrite d1/de/f63 [4194304,4194304] 0 2024-09-13T22:56:01.106 INFO:tasks.workunit.client.1.smithi047.stdout:2/343: chown d1/df/d1d/d20/d2b/f34 26653 1 2024-09-13T22:56:01.107 INFO:tasks.workunit.client.1.smithi047.stdout:0/291: mknod d1/d5/d11/c66 0 2024-09-13T22:56:01.113 INFO:tasks.workunit.client.0.smithi002.stdout:2/147: creat d1/f29 x:0 0 0 2024-09-13T22:56:01.114 INFO:tasks.workunit.client.0.smithi002.stdout:7/120: creat d8/d10/d11/d13/f21 x:0 0 0 2024-09-13T22:56:01.116 INFO:tasks.workunit.client.0.smithi002.stdout:7/121: write d8/d10/f15 [2688075,70774] 0 2024-09-13T22:56:01.119 INFO:tasks.workunit.client.1.smithi047.stdout:3/352: rename d0/d3/d4/d16/d1c/d5b to d0/d3/d4/d16/d32/d42/d79 0 2024-09-13T22:56:01.120 INFO:tasks.workunit.client.0.smithi002.stdout:0/148: mkdir d1/d2/d10/d31 0 2024-09-13T22:56:01.121 INFO:tasks.workunit.client.0.smithi002.stdout:3/178: dwrite d9/d15/f2f [0,4194304] 0 2024-09-13T22:56:01.127 INFO:tasks.workunit.client.1.smithi047.stdout:1/235: sync 2024-09-13T22:56:01.128 INFO:tasks.workunit.client.1.smithi047.stdout:9/256: sync 2024-09-13T22:56:01.130 INFO:tasks.workunit.client.0.smithi002.stdout:4/120: link d3/fa d3/f21 0 2024-09-13T22:56:01.132 INFO:tasks.workunit.client.0.smithi002.stdout:1/206: mkdir d1/d13/d21/d40 0 2024-09-13T22:56:01.133 INFO:tasks.workunit.client.1.smithi047.stdout:2/344: mkdir d1/df/d1d/d20/d37/d7a 0 2024-09-13T22:56:01.135 INFO:tasks.workunit.client.1.smithi047.stdout:2/345: fsync d1/df/d1d/d20/d37/d43/f79 0 2024-09-13T22:56:01.135 INFO:tasks.workunit.client.0.smithi002.stdout:8/154: truncate d3/f20 1035419 0 2024-09-13T22:56:01.136 INFO:tasks.workunit.client.1.smithi047.stdout:0/292: mknod d1/d5/d16/d23/c67 0 2024-09-13T22:56:01.136 INFO:tasks.workunit.client.1.smithi047.stdout:2/346: write d1/d16/f6a [411696,99437] 0 2024-09-13T22:56:01.136 INFO:tasks.workunit.client.0.smithi002.stdout:8/155: fsync d3/dc/d18/f2d 0 2024-09-13T22:56:01.137 INFO:tasks.workunit.client.1.smithi047.stdout:5/220: truncate d19/f43 3460037 0 2024-09-13T22:56:01.137 INFO:tasks.workunit.client.1.smithi047.stdout:2/347: stat d1/d16/c3b 0 2024-09-13T22:56:01.137 INFO:tasks.workunit.client.0.smithi002.stdout:8/156: chown d3/dc/l1c 493960 1 2024-09-13T22:56:01.138 INFO:tasks.workunit.client.0.smithi002.stdout:1/207: dwrite d1/d13/d30/f18 [0,4194304] 0 2024-09-13T22:56:01.138 INFO:tasks.workunit.client.1.smithi047.stdout:0/293: truncate d1/d5/d16/f63 807984 0 2024-09-13T22:56:01.139 INFO:tasks.workunit.client.1.smithi047.stdout:0/294: chown d1/d7/f44 242286931 1 2024-09-13T22:56:01.139 INFO:tasks.workunit.client.0.smithi002.stdout:1/208: chown d1/d13/d30/l1b 1224937102 1 2024-09-13T22:56:01.141 INFO:tasks.workunit.client.0.smithi002.stdout:1/209: fdatasync d1/d13/d1d/d34/f35 0 2024-09-13T22:56:01.141 INFO:tasks.workunit.client.1.smithi047.stdout:8/301: getdents d8/d64/d4e 0 2024-09-13T22:56:01.141 INFO:tasks.workunit.client.1.smithi047.stdout:0/295: truncate d1/d5/d16/d23/d2d/f5a 231087 0 2024-09-13T22:56:01.142 INFO:tasks.workunit.client.0.smithi002.stdout:7/122: mknod d8/d9/c22 0 2024-09-13T22:56:01.151 INFO:tasks.workunit.client.0.smithi002.stdout:3/179: creat d9/df/f49 x:0 0 0 2024-09-13T22:56:01.152 INFO:tasks.workunit.client.0.smithi002.stdout:3/180: chown d9/df/d10/f18 7 1 2024-09-13T22:56:01.155 INFO:tasks.workunit.client.1.smithi047.stdout:2/348: dread d1/de/f33 [0,4194304] 0 2024-09-13T22:56:01.156 INFO:tasks.workunit.client.1.smithi047.stdout:1/236: creat d0/d7/d10/f43 x:0 0 0 2024-09-13T22:56:01.156 INFO:tasks.workunit.client.1.smithi047.stdout:2/349: fdatasync d1/d16/f6a 0 2024-09-13T22:56:01.157 INFO:tasks.workunit.client.1.smithi047.stdout:1/237: truncate d0/d7/d10/f33 19611 0 2024-09-13T22:56:01.158 INFO:tasks.workunit.client.1.smithi047.stdout:2/350: read - d1/df/d1d/d20/d29/f52 zero size 2024-09-13T22:56:01.158 INFO:tasks.workunit.client.1.smithi047.stdout:9/257: rename d1/dc/d14/d20 to d1/dc/d14/dd/d54 0 2024-09-13T22:56:01.159 INFO:tasks.workunit.client.1.smithi047.stdout:9/258: readlink d1/dc/d14/dd/l3a 0 2024-09-13T22:56:01.159 INFO:tasks.workunit.client.0.smithi002.stdout:6/160: mknod d12/d17/d28/c2d 0 2024-09-13T22:56:01.161 INFO:tasks.workunit.client.0.smithi002.stdout:4/121: mknod d3/d14/c22 0 2024-09-13T22:56:01.166 INFO:tasks.workunit.client.0.smithi002.stdout:8/157: chown d3/c11 1 1 2024-09-13T22:56:01.167 INFO:tasks.workunit.client.0.smithi002.stdout:8/158: chown d3/dc 82681747 1 2024-09-13T22:56:01.168 INFO:tasks.workunit.client.0.smithi002.stdout:2/148: chown d1/f1f 1 1 2024-09-13T22:56:01.168 INFO:tasks.workunit.client.1.smithi047.stdout:0/296: symlink d1/d7/l68 0 2024-09-13T22:56:01.171 INFO:tasks.workunit.client.0.smithi002.stdout:1/210: unlink d1/d13/d30/f18 0 2024-09-13T22:56:01.172 INFO:tasks.workunit.client.1.smithi047.stdout:6/290: link d3/l3b d3/d11/d2b/d4c/l65 0 2024-09-13T22:56:01.173 INFO:tasks.workunit.client.0.smithi002.stdout:7/123: rmdir d8 39 2024-09-13T22:56:01.175 INFO:tasks.workunit.client.0.smithi002.stdout:0/149: mkdir d1/d2/d10/d31/d32 0 2024-09-13T22:56:01.176 INFO:tasks.workunit.client.1.smithi047.stdout:1/238: rmdir d0/d1d 39 2024-09-13T22:56:01.177 INFO:tasks.workunit.client.0.smithi002.stdout:3/181: rename d9/df/d10/l1c to d9/d15/l4a 0 2024-09-13T22:56:01.180 INFO:tasks.workunit.client.1.smithi047.stdout:2/351: rename d1/df/d1d/d20/d37/d43 to d1/df/d1d/d20/d37/d7b 0 2024-09-13T22:56:01.181 INFO:tasks.workunit.client.0.smithi002.stdout:6/161: rmdir d12/d17/d28 39 2024-09-13T22:56:01.182 INFO:tasks.workunit.client.1.smithi047.stdout:3/353: truncate d0/d3/d4/d16/d2c/de/f10 6984892 0 2024-09-13T22:56:01.183 INFO:tasks.workunit.client.1.smithi047.stdout:2/352: fdatasync d1/df/d1d/d20/d37/d7b/f79 0 2024-09-13T22:56:01.184 INFO:tasks.workunit.client.0.smithi002.stdout:4/122: creat d3/f23 x:0 0 0 2024-09-13T22:56:01.186 INFO:tasks.workunit.client.0.smithi002.stdout:4/123: dread f2 [0,4194304] 0 2024-09-13T22:56:01.188 INFO:tasks.workunit.client.0.smithi002.stdout:5/154: getdents d1/d2a 0 2024-09-13T22:56:01.189 INFO:tasks.workunit.client.1.smithi047.stdout:2/353: dwrite d1/d16/d40/f4d [0,4194304] 0 2024-09-13T22:56:01.191 INFO:tasks.workunit.client.0.smithi002.stdout:5/155: dread d1/f13 [0,4194304] 0 2024-09-13T22:56:01.192 INFO:tasks.workunit.client.0.smithi002.stdout:5/156: truncate d1/f2f 261699 0 2024-09-13T22:56:01.192 INFO:tasks.workunit.client.1.smithi047.stdout:4/305: getdents dc/de 0 2024-09-13T22:56:01.193 INFO:tasks.workunit.client.0.smithi002.stdout:2/149: truncate d1/d7/d8/f10 785400 0 2024-09-13T22:56:01.195 INFO:tasks.workunit.client.1.smithi047.stdout:8/302: fsync d8/d36/f3a 0 2024-09-13T22:56:01.202 INFO:tasks.workunit.client.0.smithi002.stdout:0/150: rename d1/d2/c9 to d1/d2/c33 0 2024-09-13T22:56:01.203 INFO:tasks.workunit.client.0.smithi002.stdout:0/151: readlink d1/d2/l28 0 2024-09-13T22:56:01.203 INFO:tasks.workunit.client.1.smithi047.stdout:7/309: getdents d0/d7/da/d4e 0 2024-09-13T22:56:01.204 INFO:tasks.workunit.client.1.smithi047.stdout:5/221: dwrite d19/d25/d45/f4e [0,4194304] 0 2024-09-13T22:56:01.204 INFO:tasks.workunit.client.0.smithi002.stdout:8/159: dwrite d3/dc/f22 [0,4194304] 0 2024-09-13T22:56:01.204 INFO:tasks.workunit.client.0.smithi002.stdout:0/152: fdatasync d1/d2/f1d 0 2024-09-13T22:56:01.204 INFO:tasks.workunit.client.0.smithi002.stdout:3/182: creat d9/d15/d26/f4b x:0 0 0 2024-09-13T22:56:01.205 INFO:tasks.workunit.client.1.smithi047.stdout:3/354: mknod d0/d25/d34/c7a 0 2024-09-13T22:56:01.206 INFO:tasks.workunit.client.0.smithi002.stdout:3/183: write d9/d15/d36/f38 [625440,65325] 0 2024-09-13T22:56:01.206 INFO:tasks.workunit.client.0.smithi002.stdout:9/193: getdents d8/d2c 0 2024-09-13T22:56:01.207 INFO:tasks.workunit.client.1.smithi047.stdout:3/355: chown d0/d3/d4/d16/d2c/de/d3d/f62 3 1 2024-09-13T22:56:01.208 INFO:tasks.workunit.client.0.smithi002.stdout:0/153: dread d1/d2/f1d [0,4194304] 0 2024-09-13T22:56:01.209 INFO:tasks.workunit.client.1.smithi047.stdout:3/356: chown d0/d3/d4/d16/d2c/de/d3d/f62 123252853 1 2024-09-13T22:56:01.209 INFO:tasks.workunit.client.1.smithi047.stdout:2/354: fsync d1/de/f4a 0 2024-09-13T22:56:01.211 INFO:tasks.workunit.client.1.smithi047.stdout:3/357: chown d0/d3/d4/d16/d1c/l67 20315 1 2024-09-13T22:56:01.214 INFO:tasks.workunit.client.0.smithi002.stdout:9/194: dwrite d8/d10/f3f [0,4194304] 0 2024-09-13T22:56:01.221 INFO:tasks.workunit.client.0.smithi002.stdout:6/162: write d12/f24 [3315901,32478] 0 2024-09-13T22:56:01.221 INFO:tasks.workunit.client.1.smithi047.stdout:4/306: dwrite dc/de/d23/f64 [0,4194304] 0 2024-09-13T22:56:01.222 INFO:tasks.workunit.client.0.smithi002.stdout:2/150: symlink d1/d7/l2a 0 2024-09-13T22:56:01.225 INFO:tasks.workunit.client.1.smithi047.stdout:4/307: read dc/de/d23/f3b [15454,49993] 0 2024-09-13T22:56:01.226 INFO:tasks.workunit.client.0.smithi002.stdout:4/124: write d3/f21 [107486,40395] 0 2024-09-13T22:56:01.229 INFO:tasks.workunit.client.0.smithi002.stdout:7/124: truncate f6 2605299 0 2024-09-13T22:56:01.230 INFO:tasks.workunit.client.0.smithi002.stdout:7/125: write f7 [3474667,38206] 0 2024-09-13T22:56:01.235 INFO:tasks.workunit.client.0.smithi002.stdout:5/157: dwrite d1/f8 [0,4194304] 0 2024-09-13T22:56:01.235 INFO:tasks.workunit.client.0.smithi002.stdout:8/160: mkdir d3/dc/d18/d2e 0 2024-09-13T22:56:01.236 INFO:tasks.workunit.client.1.smithi047.stdout:2/355: creat d1/d16/f7c x:0 0 0 2024-09-13T22:56:01.236 INFO:tasks.workunit.client.0.smithi002.stdout:8/161: fsync d3/dc/d18/f2d 0 2024-09-13T22:56:01.236 INFO:tasks.workunit.client.0.smithi002.stdout:3/184: fsync d9/df/d10/f12 0 2024-09-13T22:56:01.237 INFO:tasks.workunit.client.1.smithi047.stdout:2/356: dread d1/de/f5b [0,4194304] 0 2024-09-13T22:56:01.238 INFO:tasks.workunit.client.0.smithi002.stdout:3/185: write d9/f16 [3436218,94704] 0 2024-09-13T22:56:01.242 INFO:tasks.workunit.client.1.smithi047.stdout:2/357: dread d1/d16/d40/f4d [0,4194304] 0 2024-09-13T22:56:01.245 INFO:tasks.workunit.client.1.smithi047.stdout:0/297: creat d1/f69 x:0 0 0 2024-09-13T22:56:01.249 INFO:tasks.workunit.client.1.smithi047.stdout:5/222: dwrite d19/d23/d4c/f52 [0,4194304] 0 2024-09-13T22:56:01.250 INFO:tasks.workunit.client.1.smithi047.stdout:4/308: creat dc/de/d39/f69 x:0 0 0 2024-09-13T22:56:01.250 INFO:tasks.workunit.client.0.smithi002.stdout:6/163: rmdir d12/d17/d2a 39 2024-09-13T22:56:01.253 INFO:tasks.workunit.client.1.smithi047.stdout:1/239: creat d0/d7/f44 x:0 0 0 2024-09-13T22:56:01.255 INFO:tasks.workunit.client.0.smithi002.stdout:2/151: read d1/f18 [2364999,64335] 0 2024-09-13T22:56:01.259 INFO:tasks.workunit.client.0.smithi002.stdout:7/126: chown d8/d10/f15 82415952 1 2024-09-13T22:56:01.264 INFO:tasks.workunit.client.0.smithi002.stdout:8/162: mkdir d3/dc/d16/d2f 0 2024-09-13T22:56:01.265 INFO:tasks.workunit.client.1.smithi047.stdout:2/358: creat d1/df/d1d/d20/d2b/f7d x:0 0 0 2024-09-13T22:56:01.266 INFO:tasks.workunit.client.1.smithi047.stdout:2/359: chown d1/d16/f23 58411022 1 2024-09-13T22:56:01.266 INFO:tasks.workunit.client.0.smithi002.stdout:3/186: fsync f5 0 2024-09-13T22:56:01.271 INFO:tasks.workunit.client.1.smithi047.stdout:0/298: truncate d1/d5/f9 4047848 0 2024-09-13T22:56:01.271 INFO:tasks.workunit.client.1.smithi047.stdout:4/309: dread dc/de/f26 [0,4194304] 0 2024-09-13T22:56:01.273 INFO:tasks.workunit.client.0.smithi002.stdout:9/195: link d8/d10/d1c/d3d/f44 d8/d1e/f45 0 2024-09-13T22:56:01.277 INFO:tasks.workunit.client.1.smithi047.stdout:9/259: getdents d1/dc/d18 0 2024-09-13T22:56:01.278 INFO:tasks.workunit.client.1.smithi047.stdout:4/310: dwrite dc/de/d17/d25/d4a/f50 [0,4194304] 0 2024-09-13T22:56:01.278 INFO:tasks.workunit.client.0.smithi002.stdout:1/211: getdents d1/d13/d30 0 2024-09-13T22:56:01.281 INFO:tasks.workunit.client.1.smithi047.stdout:1/240: fsync d0/d7/d13/f39 0 2024-09-13T22:56:01.284 INFO:tasks.workunit.client.0.smithi002.stdout:4/125: link f1 d3/f24 0 2024-09-13T22:56:01.285 INFO:tasks.workunit.client.1.smithi047.stdout:7/310: link d0/db/l5e d0/d7/da/d47/l63 0 2024-09-13T22:56:01.287 INFO:tasks.workunit.client.0.smithi002.stdout:2/152: symlink d1/d7/d8/l2b 0 2024-09-13T22:56:01.288 INFO:tasks.workunit.client.0.smithi002.stdout:4/126: dread d3/fa [0,4194304] 0 2024-09-13T22:56:01.289 INFO:tasks.workunit.client.0.smithi002.stdout:4/127: chown d3/f21 5 1 2024-09-13T22:56:01.289 INFO:tasks.workunit.client.0.smithi002.stdout:2/153: write d1/d7/d8/f1b [337306,106285] 0 2024-09-13T22:56:01.290 INFO:tasks.workunit.client.1.smithi047.stdout:3/358: creat d0/d3/d4/f7b x:0 0 0 2024-09-13T22:56:01.290 INFO:tasks.workunit.client.0.smithi002.stdout:5/158: getdents d1/d2a 0 2024-09-13T22:56:01.291 INFO:tasks.workunit.client.0.smithi002.stdout:2/154: dread d1/d7/d8/f1a [0,4194304] 0 2024-09-13T22:56:01.292 INFO:tasks.workunit.client.0.smithi002.stdout:7/127: creat d8/d10/f23 x:0 0 0 2024-09-13T22:56:01.293 INFO:tasks.workunit.client.1.smithi047.stdout:7/311: dwrite d0/d7/f3e [0,4194304] 0 2024-09-13T22:56:01.294 INFO:tasks.workunit.client.1.smithi047.stdout:7/312: chown d0/d7/da/d1e/f24 2030 1 2024-09-13T22:56:01.294 INFO:tasks.workunit.client.0.smithi002.stdout:5/159: dread d1/f8 [0,4194304] 0 2024-09-13T22:56:01.296 INFO:tasks.workunit.client.1.smithi047.stdout:8/303: getdents d8 0 2024-09-13T22:56:01.298 INFO:tasks.workunit.client.1.smithi047.stdout:2/360: unlink d1/de/f46 0 2024-09-13T22:56:01.299 INFO:tasks.workunit.client.0.smithi002.stdout:7/128: dwrite f7 [0,4194304] 0 2024-09-13T22:56:01.300 INFO:tasks.workunit.client.1.smithi047.stdout:0/299: mkdir d1/d5/d16/d6a 0 2024-09-13T22:56:01.300 INFO:tasks.workunit.client.0.smithi002.stdout:7/129: read - d8/d10/d11/d13/f21 zero size 2024-09-13T22:56:01.301 INFO:tasks.workunit.client.0.smithi002.stdout:7/130: write d8/d9/f1a [205738,77918] 0 2024-09-13T22:56:01.301 INFO:tasks.workunit.client.0.smithi002.stdout:3/187: rename d9/d15/c1f to d9/df/d10/c4c 0 2024-09-13T22:56:01.302 INFO:tasks.workunit.client.0.smithi002.stdout:0/154: link d1/c2a d1/d4/c34 0 2024-09-13T22:56:01.303 INFO:tasks.workunit.client.1.smithi047.stdout:5/223: mknod d19/c53 0 2024-09-13T22:56:01.311 INFO:tasks.workunit.client.1.smithi047.stdout:9/260: mknod d1/dc/d14/dd/d54/d4e/d51/c55 0 2024-09-13T22:56:01.312 INFO:tasks.workunit.client.0.smithi002.stdout:4/128: mkdir d3/d14/d25 0 2024-09-13T22:56:01.312 INFO:tasks.workunit.client.1.smithi047.stdout:1/241: write d0/d7/d13/f39 [1679514,85550] 0 2024-09-13T22:56:01.313 INFO:tasks.workunit.client.0.smithi002.stdout:4/129: truncate d3/f23 650750 0 2024-09-13T22:56:01.316 INFO:tasks.workunit.client.0.smithi002.stdout:2/155: truncate d1/d7/f26 1695679 0 2024-09-13T22:56:01.322 INFO:tasks.workunit.client.1.smithi047.stdout:8/304: rename d8/l5b to d8/d64/d4e/d4d/l68 0 2024-09-13T22:56:01.324 INFO:tasks.workunit.client.0.smithi002.stdout:7/131: rmdir d8 39 2024-09-13T22:56:01.326 INFO:tasks.workunit.client.1.smithi047.stdout:0/300: symlink d1/d5/d16/l6b 0 2024-09-13T22:56:01.326 INFO:tasks.workunit.client.1.smithi047.stdout:2/361: dread d1/de/f33 [0,4194304] 0 2024-09-13T22:56:01.326 INFO:tasks.workunit.client.0.smithi002.stdout:1/212: dwrite d1/f7 [0,4194304] 0 2024-09-13T22:56:01.329 INFO:tasks.workunit.client.0.smithi002.stdout:0/155: creat d1/d4/f35 x:0 0 0 2024-09-13T22:56:01.330 INFO:tasks.workunit.client.1.smithi047.stdout:4/311: symlink dc/de/d23/l6a 0 2024-09-13T22:56:01.331 INFO:tasks.workunit.client.1.smithi047.stdout:7/313: write d0/d7/f4a [1209776,122002] 0 2024-09-13T22:56:01.333 INFO:tasks.workunit.client.0.smithi002.stdout:9/196: fsync d8/d10/d1c/f19 0 2024-09-13T22:56:01.334 INFO:tasks.workunit.client.0.smithi002.stdout:8/163: truncate d3/dc/d16/f25 4388459 0 2024-09-13T22:56:01.336 INFO:tasks.workunit.client.0.smithi002.stdout:0/156: dread d1/d2/f1d [0,4194304] 0 2024-09-13T22:56:01.336 INFO:tasks.workunit.client.0.smithi002.stdout:8/164: chown d3/dc/f26 372 1 2024-09-13T22:56:01.337 INFO:tasks.workunit.client.0.smithi002.stdout:6/164: link d12/f14 d12/d17/d28/f2e 0 2024-09-13T22:56:01.338 INFO:tasks.workunit.client.1.smithi047.stdout:0/301: dread d1/d7/fe [0,4194304] 0 2024-09-13T22:56:01.338 INFO:tasks.workunit.client.0.smithi002.stdout:4/130: creat d3/d14/f26 x:0 0 0 2024-09-13T22:56:01.354 INFO:tasks.workunit.client.0.smithi002.stdout:2/156: mkdir d1/d7/d8/d2c 0 2024-09-13T22:56:01.355 INFO:tasks.workunit.client.0.smithi002.stdout:2/157: chown d1/d7/d8/lc 35859793 1 2024-09-13T22:56:01.357 INFO:tasks.workunit.client.1.smithi047.stdout:9/261: creat d1/d2d/f56 x:0 0 0 2024-09-13T22:56:01.357 INFO:tasks.workunit.client.1.smithi047.stdout:5/224: write d19/d23/f29 [5048711,28912] 0 2024-09-13T22:56:01.360 INFO:tasks.workunit.client.1.smithi047.stdout:3/359: creat d0/d3/d4/d16/d73/f7c x:0 0 0 2024-09-13T22:56:01.360 INFO:tasks.workunit.client.1.smithi047.stdout:3/360: write d0/d25/d34/f4b [911837,103537] 0 2024-09-13T22:56:01.361 INFO:tasks.workunit.client.0.smithi002.stdout:3/188: symlink d9/d15/d26/d44/l4d 0 2024-09-13T22:56:01.361 INFO:tasks.workunit.client.0.smithi002.stdout:3/189: readlink d9/df/d10/l45 0 2024-09-13T22:56:01.362 INFO:tasks.workunit.client.1.smithi047.stdout:3/361: read d0/d25/d44/d43/d3a/f78 [18397,59007] 0 2024-09-13T22:56:01.365 INFO:tasks.workunit.client.1.smithi047.stdout:2/362: rmdir d1 39 2024-09-13T22:56:01.368 INFO:tasks.workunit.client.1.smithi047.stdout:7/314: mkdir d0/d7/da/d2e/d64 0 2024-09-13T22:56:01.369 INFO:tasks.workunit.client.0.smithi002.stdout:3/190: dwrite d9/df/d10/f2e [0,4194304] 0 2024-09-13T22:56:01.371 INFO:tasks.workunit.client.0.smithi002.stdout:8/165: unlink d3/dc/d18/f1f 0 2024-09-13T22:56:01.373 INFO:tasks.workunit.client.0.smithi002.stdout:4/131: mknod d3/c27 0 2024-09-13T22:56:01.375 INFO:tasks.workunit.client.1.smithi047.stdout:0/302: creat d1/d7/f6c x:0 0 0 2024-09-13T22:56:01.375 INFO:tasks.workunit.client.1.smithi047.stdout:1/242: symlink d0/d7/d13/d2d/l45 0 2024-09-13T22:56:01.380 INFO:tasks.workunit.client.1.smithi047.stdout:5/225: rename d19/d23/f29 to d19/d23/d2e/d41/f54 0 2024-09-13T22:56:01.384 INFO:tasks.workunit.client.1.smithi047.stdout:0/303: dwrite d1/d5/d16/d47/f4d [0,4194304] 0 2024-09-13T22:56:01.385 INFO:tasks.workunit.client.1.smithi047.stdout:0/304: chown d1/d5/d16/d6a 59963681 1 2024-09-13T22:56:01.386 INFO:tasks.workunit.client.0.smithi002.stdout:5/160: rename d1/d2a/f33 to d1/f3a 0 2024-09-13T22:56:01.389 INFO:tasks.workunit.client.0.smithi002.stdout:4/132: dread d3/fb [0,4194304] 0 2024-09-13T22:56:01.389 INFO:tasks.workunit.client.0.smithi002.stdout:1/213: link d1/d13/d30/f2a d1/d13/d30/d31/f41 0 2024-09-13T22:56:01.391 INFO:tasks.workunit.client.0.smithi002.stdout:9/197: dwrite d8/d1e/f34 [0,4194304] 0 2024-09-13T22:56:01.395 INFO:tasks.workunit.client.0.smithi002.stdout:7/132: truncate f1 3145875 0 2024-09-13T22:56:01.399 INFO:tasks.workunit.client.1.smithi047.stdout:9/262: dwrite d1/dc/d18/f33 [0,4194304] 0 2024-09-13T22:56:01.400 INFO:tasks.workunit.client.1.smithi047.stdout:5/226: creat d19/d23/d32/f55 x:0 0 0 2024-09-13T22:56:01.404 INFO:tasks.workunit.client.0.smithi002.stdout:3/191: mkdir d9/d15/d36/d4e 0 2024-09-13T22:56:01.405 INFO:tasks.workunit.client.1.smithi047.stdout:8/305: symlink d8/d36/d38/l69 0 2024-09-13T22:56:01.409 INFO:tasks.workunit.client.1.smithi047.stdout:9/263: dwrite d1/dc/d14/f2f [0,4194304] 0 2024-09-13T22:56:01.411 INFO:tasks.workunit.client.1.smithi047.stdout:3/362: unlink d0/d3/d4/d16/d2c/de/f17 0 2024-09-13T22:56:01.417 INFO:tasks.workunit.client.1.smithi047.stdout:2/363: unlink d1/d16/c3b 0 2024-09-13T22:56:01.417 INFO:tasks.workunit.client.1.smithi047.stdout:9/264: dread d1/f25 [0,4194304] 0 2024-09-13T22:56:01.418 INFO:tasks.workunit.client.0.smithi002.stdout:2/158: creat d1/d7/d8/d2c/f2d x:0 0 0 2024-09-13T22:56:01.419 INFO:tasks.workunit.client.1.smithi047.stdout:2/364: chown d1/df/d1d/d20/d29/l61 4602250 1 2024-09-13T22:56:01.419 INFO:tasks.workunit.client.0.smithi002.stdout:0/157: truncate d1/d4/f21 1624051 0 2024-09-13T22:56:01.419 INFO:tasks.workunit.client.1.smithi047.stdout:2/365: fdatasync d1/df/d1d/d20/d2b/f41 0 2024-09-13T22:56:01.420 INFO:tasks.workunit.client.1.smithi047.stdout:2/366: readlink d1/de/l51 0 2024-09-13T22:56:01.422 INFO:tasks.workunit.client.1.smithi047.stdout:1/243: symlink d0/d7/d13/l46 0 2024-09-13T22:56:01.424 INFO:tasks.workunit.client.1.smithi047.stdout:1/244: write d0/d7/d14/f27 [2603757,125942] 0 2024-09-13T22:56:01.428 INFO:tasks.workunit.client.1.smithi047.stdout:2/367: dread d1/df/d1d/d20/f42 [0,4194304] 0 2024-09-13T22:56:01.431 INFO:tasks.workunit.client.1.smithi047.stdout:5/227: symlink d19/d25/l56 0 2024-09-13T22:56:01.432 INFO:tasks.workunit.client.1.smithi047.stdout:5/228: dread - d19/d23/d32/f55 zero size 2024-09-13T22:56:01.432 INFO:tasks.workunit.client.0.smithi002.stdout:1/214: symlink d1/d13/d1d/d2e/l42 0 2024-09-13T22:56:01.434 INFO:tasks.workunit.client.1.smithi047.stdout:8/306: read d8/f30 [1165087,5805] 0 2024-09-13T22:56:01.439 INFO:tasks.workunit.client.1.smithi047.stdout:7/315: truncate d0/d7/da/f34 1672212 0 2024-09-13T22:56:01.440 INFO:tasks.workunit.client.0.smithi002.stdout:9/198: creat d8/d2c/f46 x:0 0 0 2024-09-13T22:56:01.441 INFO:tasks.workunit.client.0.smithi002.stdout:9/199: truncate d8/d10/f21 307146 0 2024-09-13T22:56:01.441 INFO:tasks.workunit.client.1.smithi047.stdout:0/305: mkdir d1/d5/d11/d6d 0 2024-09-13T22:56:01.443 INFO:tasks.workunit.client.1.smithi047.stdout:0/306: dread d1/d5/d16/d23/d2d/f55 [0,4194304] 0 2024-09-13T22:56:01.445 INFO:tasks.workunit.client.0.smithi002.stdout:3/192: truncate d9/fd 823924 0 2024-09-13T22:56:01.446 INFO:tasks.workunit.client.0.smithi002.stdout:3/193: fsync d9/df/d10/f1d 0 2024-09-13T22:56:01.446 INFO:tasks.workunit.client.1.smithi047.stdout:9/265: unlink d1/dc/d14/c2e 0 2024-09-13T22:56:01.448 INFO:tasks.workunit.client.0.smithi002.stdout:8/166: unlink d3/dc/d16/f25 0 2024-09-13T22:56:01.449 INFO:tasks.workunit.client.0.smithi002.stdout:6/165: link d12/f14 d12/d17/d28/f2f 0 2024-09-13T22:56:01.456 INFO:tasks.workunit.client.0.smithi002.stdout:6/166: dwrite fd [0,4194304] 0 2024-09-13T22:56:01.460 INFO:tasks.workunit.client.0.smithi002.stdout:0/158: symlink d1/d2/l36 0 2024-09-13T22:56:01.460 INFO:tasks.workunit.client.1.smithi047.stdout:5/229: chown d19/d23/c28 8847 1 2024-09-13T22:56:01.462 INFO:tasks.workunit.client.0.smithi002.stdout:5/161: symlink d1/d10/l3b 0 2024-09-13T22:56:01.466 INFO:tasks.workunit.client.0.smithi002.stdout:4/133: creat d3/d14/d25/f28 x:0 0 0 2024-09-13T22:56:01.467 INFO:tasks.workunit.client.1.smithi047.stdout:8/307: write d8/f2c [6762138,57311] 0 2024-09-13T22:56:01.467 INFO:tasks.workunit.client.1.smithi047.stdout:5/230: dwrite d19/f35 [0,4194304] 0 2024-09-13T22:56:01.470 INFO:tasks.workunit.client.1.smithi047.stdout:7/316: fdatasync d0/d7/f36 0 2024-09-13T22:56:01.472 INFO:tasks.workunit.client.0.smithi002.stdout:4/134: dwrite d3/f18 [0,4194304] 0 2024-09-13T22:56:01.475 INFO:tasks.workunit.client.0.smithi002.stdout:9/200: rename d8/d1e/f39 to d8/d2c/f47 0 2024-09-13T22:56:01.481 INFO:tasks.workunit.client.0.smithi002.stdout:3/194: symlink d9/d15/d36/l4f 0 2024-09-13T22:56:01.484 INFO:tasks.workunit.client.0.smithi002.stdout:8/167: mknod d3/c30 0 2024-09-13T22:56:01.490 INFO:tasks.workunit.client.0.smithi002.stdout:2/159: mknod d1/c2e 0 2024-09-13T22:56:01.493 INFO:tasks.workunit.client.1.smithi047.stdout:1/245: write d0/d7/db/f38 [3664060,102827] 0 2024-09-13T22:56:01.495 INFO:tasks.workunit.client.1.smithi047.stdout:1/246: dread - d0/d7/d14/d28/d36/f32 zero size 2024-09-13T22:56:01.495 INFO:tasks.workunit.client.1.smithi047.stdout:3/363: rmdir d0/d3/d4/d16/d2c/de/d70 0 2024-09-13T22:56:01.496 INFO:tasks.workunit.client.1.smithi047.stdout:3/364: chown d0/d3/d4/d16/d73 17133038 1 2024-09-13T22:56:01.501 INFO:tasks.workunit.client.1.smithi047.stdout:2/368: dwrite d1/df/d1d/d20/d37/f39 [0,4194304] 0 2024-09-13T22:56:01.502 INFO:tasks.workunit.client.1.smithi047.stdout:2/369: fsync d1/df/d26/d4b/f76 0 2024-09-13T22:56:01.504 INFO:tasks.workunit.client.1.smithi047.stdout:2/370: chown d1/df/d1d/l66 5780650 1 2024-09-13T22:56:01.508 INFO:tasks.workunit.client.0.smithi002.stdout:7/133: write d8/fb [220816,97213] 0 2024-09-13T22:56:01.514 INFO:tasks.workunit.client.0.smithi002.stdout:9/201: rename f5 to d8/d10/d1c/d3d/f48 0 2024-09-13T22:56:01.515 INFO:tasks.workunit.client.0.smithi002.stdout:9/202: truncate d8/d1e/f25 724087 0 2024-09-13T22:56:01.516 INFO:tasks.workunit.client.0.smithi002.stdout:0/159: write d1/f14 [99834,13138] 0 2024-09-13T22:56:01.517 INFO:tasks.workunit.client.0.smithi002.stdout:0/160: chown d1/d2/l2f 60583798 1 2024-09-13T22:56:01.518 INFO:tasks.workunit.client.1.smithi047.stdout:3/365: rename d0/d3/d4/d16/d1c/f1d to d0/d3/d4/d16/d2c/de/d1f/d3b/d69/f7d 0 2024-09-13T22:56:01.520 INFO:tasks.workunit.client.0.smithi002.stdout:9/203: dwrite d8/d10/f21 [0,4194304] 0 2024-09-13T22:56:01.524 INFO:tasks.workunit.client.0.smithi002.stdout:6/167: mknod d12/d17/d2a/c30 0 2024-09-13T22:56:01.526 INFO:tasks.workunit.client.1.smithi047.stdout:0/307: dwrite d1/d5/d16/d23/d2d/f31 [0,4194304] 0 2024-09-13T22:56:01.528 INFO:tasks.workunit.client.1.smithi047.stdout:9/266: getdents d1/dc/d14/dd/d54/d4e 0 2024-09-13T22:56:01.529 INFO:tasks.workunit.client.1.smithi047.stdout:9/267: fdatasync d1/f40 0 2024-09-13T22:56:01.529 INFO:tasks.workunit.client.0.smithi002.stdout:1/215: creat d1/f43 x:0 0 0 2024-09-13T22:56:01.533 INFO:tasks.workunit.client.1.smithi047.stdout:3/366: fsync d0/d25/d44/d5a/f66 0 2024-09-13T22:56:01.535 INFO:tasks.workunit.client.0.smithi002.stdout:1/216: dread d1/f7 [0,4194304] 0 2024-09-13T22:56:01.536 INFO:tasks.workunit.client.0.smithi002.stdout:1/217: chown d1/d13/d30/f2d 13335 1 2024-09-13T22:56:01.538 INFO:tasks.workunit.client.1.smithi047.stdout:7/317: getdents d0/d19 0 2024-09-13T22:56:01.539 INFO:tasks.workunit.client.0.smithi002.stdout:4/135: truncate d3/f10 5843866 0 2024-09-13T22:56:01.544 INFO:tasks.workunit.client.0.smithi002.stdout:3/195: link d9/d15/f24 d9/d15/d36/d4e/f50 0 2024-09-13T22:56:01.546 INFO:tasks.workunit.client.0.smithi002.stdout:3/196: write d9/f2a [1292876,67223] 0 2024-09-13T22:56:01.546 INFO:tasks.workunit.client.0.smithi002.stdout:9/204: unlink d8/cd 0 2024-09-13T22:56:01.546 INFO:tasks.workunit.client.1.smithi047.stdout:2/371: dread d1/f2a [0,4194304] 0 2024-09-13T22:56:01.551 INFO:tasks.workunit.client.1.smithi047.stdout:8/308: link d8/f1a d8/d64/d4e/d4d/f6a 0 2024-09-13T22:56:01.552 INFO:tasks.workunit.client.1.smithi047.stdout:7/318: creat d0/d7/da/d1e/f65 x:0 0 0 2024-09-13T22:56:01.553 INFO:tasks.workunit.client.0.smithi002.stdout:2/160: mknod d1/c2f 0 2024-09-13T22:56:01.555 INFO:tasks.workunit.client.1.smithi047.stdout:1/247: getdents d0 0 2024-09-13T22:56:01.558 INFO:tasks.workunit.client.0.smithi002.stdout:6/168: write d12/f23 [5237787,95667] 0 2024-09-13T22:56:01.559 INFO:tasks.workunit.client.0.smithi002.stdout:6/169: write d12/d17/f19 [762085,102809] 0 2024-09-13T22:56:01.560 INFO:tasks.workunit.client.1.smithi047.stdout:9/268: link d1/dc/d14/f17 d1/dc/d14/dd/d4c/f57 0 2024-09-13T22:56:01.561 INFO:tasks.workunit.client.1.smithi047.stdout:3/367: dwrite d0/d3/d4/d16/d2c/f24 [4194304,4194304] 0 2024-09-13T22:56:01.564 INFO:tasks.workunit.client.0.smithi002.stdout:1/218: rename d1/d13/d21/f2b to d1/d13/d30/d31/f44 0 2024-09-13T22:56:01.564 INFO:tasks.workunit.client.1.smithi047.stdout:2/372: symlink d1/df/d1d/d20/d29/l7e 0 2024-09-13T22:56:01.565 INFO:tasks.workunit.client.0.smithi002.stdout:4/136: mkdir d3/d14/d29 0 2024-09-13T22:56:01.567 INFO:tasks.workunit.client.1.smithi047.stdout:7/319: unlink d0/d7/da/l23 0 2024-09-13T22:56:01.567 INFO:tasks.workunit.client.1.smithi047.stdout:7/320: dread - d0/db/f50 zero size 2024-09-13T22:56:01.569 INFO:tasks.workunit.client.1.smithi047.stdout:1/248: symlink d0/d7/d10/l47 0 2024-09-13T22:56:01.571 INFO:tasks.workunit.client.0.smithi002.stdout:9/205: symlink d8/d10/d1c/d3d/l49 0 2024-09-13T22:56:01.576 INFO:tasks.workunit.client.1.smithi047.stdout:1/249: dwrite d0/d7/d14/f27 [4194304,4194304] 0 2024-09-13T22:56:01.576 INFO:tasks.workunit.client.1.smithi047.stdout:3/368: mkdir d0/d3/d4/d16/d2c/d7e 0 2024-09-13T22:56:01.578 INFO:tasks.workunit.client.0.smithi002.stdout:5/162: link d1/l39 d1/d10/l3c 0 2024-09-13T22:56:01.579 INFO:tasks.workunit.client.1.smithi047.stdout:3/369: chown d0/d3/d4/f4c 431 1 2024-09-13T22:56:01.580 INFO:tasks.workunit.client.0.smithi002.stdout:2/161: dread d1/f1d [0,4194304] 0 2024-09-13T22:56:01.580 INFO:tasks.workunit.client.1.smithi047.stdout:2/373: unlink d1/de/f63 0 2024-09-13T22:56:01.581 INFO:tasks.workunit.client.1.smithi047.stdout:3/370: truncate d0/d3/d4/d16/d2c/de/f77 710941 0 2024-09-13T22:56:01.583 INFO:tasks.workunit.client.1.smithi047.stdout:8/309: mkdir d8/d6b 0 2024-09-13T22:56:01.586 INFO:tasks.workunit.client.1.smithi047.stdout:7/321: creat d0/d7/da/d4e/f66 x:0 0 0 2024-09-13T22:56:01.591 INFO:tasks.workunit.client.1.smithi047.stdout:0/308: getdents d1/d5/d16/d23 0 2024-09-13T22:56:01.593 INFO:tasks.workunit.client.0.smithi002.stdout:7/134: creat d8/f24 x:0 0 0 2024-09-13T22:56:01.598 INFO:tasks.workunit.client.0.smithi002.stdout:3/197: rename d9/df/d10 to d9/d15/d51 0 2024-09-13T22:56:01.599 INFO:tasks.workunit.client.1.smithi047.stdout:0/309: dwrite d1/d5/f24 [0,4194304] 0 2024-09-13T22:56:01.599 INFO:tasks.workunit.client.1.smithi047.stdout:2/374: mknod d1/df/d35/c7f 0 2024-09-13T22:56:01.600 INFO:tasks.workunit.client.1.smithi047.stdout:0/310: dread - d1/f69 zero size 2024-09-13T22:56:01.601 INFO:tasks.workunit.client.1.smithi047.stdout:2/375: chown d1/df/c70 27 1 2024-09-13T22:56:01.603 INFO:tasks.workunit.client.1.smithi047.stdout:8/310: mknod d8/d64/d4e/c6c 0 2024-09-13T22:56:01.608 INFO:tasks.workunit.client.0.smithi002.stdout:8/168: symlink d3/dc/d16/d2f/l31 0 2024-09-13T22:56:01.614 INFO:tasks.workunit.client.1.smithi047.stdout:2/376: mkdir d1/df/d1d/d20/d37/d7b/d80 0 2024-09-13T22:56:01.614 INFO:tasks.workunit.client.1.smithi047.stdout:2/377: chown d1/df/c3e 478 1 2024-09-13T22:56:01.615 INFO:tasks.workunit.client.0.smithi002.stdout:1/219: symlink d1/l45 0 2024-09-13T22:56:01.615 INFO:tasks.workunit.client.0.smithi002.stdout:7/135: dread f1 [0,4194304] 0 2024-09-13T22:56:01.615 INFO:tasks.workunit.client.0.smithi002.stdout:1/220: chown d1/fb 0 1 2024-09-13T22:56:01.616 INFO:tasks.workunit.client.1.smithi047.stdout:3/371: truncate d0/d3/d4/d16/d2c/de/d1f/f37 3480478 0 2024-09-13T22:56:01.617 INFO:tasks.workunit.client.0.smithi002.stdout:3/198: creat d9/d15/d35/f52 x:0 0 0 2024-09-13T22:56:01.618 INFO:tasks.workunit.client.1.smithi047.stdout:3/372: chown d0/d3/d4/d16/d2c/de/d3d/f6e 0 1 2024-09-13T22:56:01.619 INFO:tasks.workunit.client.0.smithi002.stdout:0/161: getdents d1 0 2024-09-13T22:56:01.620 INFO:tasks.workunit.client.0.smithi002.stdout:4/137: mkdir d3/d14/d29/d2a 0 2024-09-13T22:56:01.621 INFO:tasks.workunit.client.0.smithi002.stdout:4/138: fsync d3/d14/f26 0 2024-09-13T22:56:01.622 INFO:tasks.workunit.client.1.smithi047.stdout:2/378: dwrite d1/df/d1d/d20/d2b/f34 [0,4194304] 0 2024-09-13T22:56:01.622 INFO:tasks.workunit.client.0.smithi002.stdout:9/206: symlink d8/l4a 0 2024-09-13T22:56:01.624 INFO:tasks.workunit.client.0.smithi002.stdout:9/207: readlink d8/d1e/l3b 0 2024-09-13T22:56:01.624 INFO:tasks.workunit.client.0.smithi002.stdout:7/136: dwrite d8/d9/f1a [0,4194304] 0 2024-09-13T22:56:01.627 INFO:tasks.workunit.client.0.smithi002.stdout:9/208: write d8/d1e/f36 [1020970,16458] 0 2024-09-13T22:56:01.630 INFO:tasks.workunit.client.0.smithi002.stdout:0/162: dwrite d1/d2/f1d [0,4194304] 0 2024-09-13T22:56:01.630 INFO:tasks.workunit.client.1.smithi047.stdout:7/322: creat d0/f67 x:0 0 0 2024-09-13T22:56:01.631 INFO:tasks.workunit.client.0.smithi002.stdout:7/137: dread d8/f12 [0,4194304] 0 2024-09-13T22:56:01.633 INFO:tasks.workunit.client.1.smithi047.stdout:1/250: getdents d0/d7/d13 0 2024-09-13T22:56:01.639 INFO:tasks.workunit.client.1.smithi047.stdout:0/311: creat d1/f6e x:0 0 0 2024-09-13T22:56:01.643 INFO:tasks.workunit.client.1.smithi047.stdout:8/311: link d8/f23 d8/d6b/f6d 0 2024-09-13T22:56:01.644 INFO:tasks.workunit.client.1.smithi047.stdout:8/312: chown d8/d64/d4e/f49 320072 1 2024-09-13T22:56:01.645 INFO:tasks.workunit.client.1.smithi047.stdout:7/323: creat d0/d7/da/d1e/f68 x:0 0 0 2024-09-13T22:56:01.646 INFO:tasks.workunit.client.0.smithi002.stdout:8/169: fsync d3/dc/f22 0 2024-09-13T22:56:01.647 INFO:tasks.workunit.client.0.smithi002.stdout:2/162: dwrite d1/f5 [4194304,4194304] 0 2024-09-13T22:56:01.647 INFO:tasks.workunit.client.1.smithi047.stdout:1/251: creat d0/d7/d14/d28/f48 x:0 0 0 2024-09-13T22:56:01.648 INFO:tasks.workunit.client.1.smithi047.stdout:1/252: stat d0/f5 0 2024-09-13T22:56:01.648 INFO:tasks.workunit.client.1.smithi047.stdout:1/253: fdatasync d0/d1d/f41 0 2024-09-13T22:56:01.650 INFO:tasks.workunit.client.0.smithi002.stdout:4/139: rename d3/fa to d3/d14/f2b 0 2024-09-13T22:56:01.651 INFO:tasks.workunit.client.1.smithi047.stdout:3/373: dread d0/d3/f33 [0,4194304] 0 2024-09-13T22:56:01.652 INFO:tasks.workunit.client.1.smithi047.stdout:3/374: readlink d0/d3/d4/d16/d2c/l1b 0 2024-09-13T22:56:01.659 INFO:tasks.workunit.client.0.smithi002.stdout:5/163: creat d1/d10/f3d x:0 0 0 2024-09-13T22:56:01.661 INFO:tasks.workunit.client.0.smithi002.stdout:7/138: rmdir d8/d9 39 2024-09-13T22:56:01.661 INFO:tasks.workunit.client.1.smithi047.stdout:1/254: creat d0/d7/d10/f49 x:0 0 0 2024-09-13T22:56:01.664 INFO:tasks.workunit.client.0.smithi002.stdout:6/170: getdents d12/d17 0 2024-09-13T22:56:01.664 INFO:tasks.workunit.client.1.smithi047.stdout:2/379: link d1/df/d1d/d20/d29/f52 d1/df/d26/f81 0 2024-09-13T22:56:01.665 INFO:tasks.workunit.client.0.smithi002.stdout:1/221: mknod d1/d13/d21/c46 0 2024-09-13T22:56:01.666 INFO:tasks.workunit.client.0.smithi002.stdout:3/199: truncate d9/d15/d51/f21 325056 0 2024-09-13T22:56:01.667 INFO:tasks.workunit.client.0.smithi002.stdout:9/209: dwrite d8/d10/d1c/d3d/f44 [0,4194304] 0 2024-09-13T22:56:01.668 INFO:tasks.workunit.client.1.smithi047.stdout:3/375: creat d0/d3/d4/d16/d32/d76/f7f x:0 0 0 2024-09-13T22:56:01.669 INFO:tasks.workunit.client.1.smithi047.stdout:1/255: dwrite d0/d7/d14/d28/d36/f32 [0,4194304] 0 2024-09-13T22:56:01.670 INFO:tasks.workunit.client.1.smithi047.stdout:1/256: write d0/d7/f12 [5091377,37051] 0 2024-09-13T22:56:01.670 INFO:tasks.workunit.client.0.smithi002.stdout:8/170: chown d3/dc/fd 20411604 1 2024-09-13T22:56:01.671 INFO:tasks.workunit.client.1.smithi047.stdout:1/257: fsync d0/d7/d14/d28/f48 0 2024-09-13T22:56:01.672 INFO:tasks.workunit.client.1.smithi047.stdout:8/313: link d8/d64/d4e/c46 d8/d36/d40/c6e 0 2024-09-13T22:56:01.674 INFO:tasks.workunit.client.0.smithi002.stdout:4/140: symlink d3/d14/d25/l2c 0 2024-09-13T22:56:01.676 INFO:tasks.workunit.client.0.smithi002.stdout:0/163: unlink d1/d4/l2e 0 2024-09-13T22:56:01.677 INFO:tasks.workunit.client.1.smithi047.stdout:7/324: getdents d0/d7/da/d2e/d37 0 2024-09-13T22:56:01.680 INFO:tasks.workunit.client.0.smithi002.stdout:4/141: dread d3/f24 [0,4194304] 0 2024-09-13T22:56:01.680 INFO:tasks.workunit.client.0.smithi002.stdout:4/142: read f2 [2828427,80482] 0 2024-09-13T22:56:01.680 INFO:tasks.workunit.client.0.smithi002.stdout:7/139: symlink d8/d10/d11/l25 0 2024-09-13T22:56:01.682 INFO:tasks.workunit.client.1.smithi047.stdout:1/258: mknod d0/d7/d14/d28/d36/c4a 0 2024-09-13T22:56:01.683 INFO:tasks.workunit.client.1.smithi047.stdout:1/259: dread - d0/d7/d10/f43 zero size 2024-09-13T22:56:01.684 INFO:tasks.workunit.client.1.smithi047.stdout:1/260: write d0/d7/f12 [5077421,64642] 0 2024-09-13T22:56:01.691 INFO:tasks.workunit.client.0.smithi002.stdout:1/222: symlink d1/d13/d1d/d2e/l47 0 2024-09-13T22:56:01.693 INFO:tasks.workunit.client.1.smithi047.stdout:7/325: rename d0/d7/da/d2e/f44 to d0/d57/d5b/f69 0 2024-09-13T22:56:01.697 INFO:tasks.workunit.client.1.smithi047.stdout:8/314: dread d8/f26 [0,4194304] 0 2024-09-13T22:56:01.697 INFO:tasks.workunit.client.1.smithi047.stdout:8/315: truncate d8/d64/f47 268465 0 2024-09-13T22:56:01.698 INFO:tasks.workunit.client.0.smithi002.stdout:9/210: fdatasync d8/d10/d1c/f15 0 2024-09-13T22:56:01.700 INFO:tasks.workunit.client.0.smithi002.stdout:8/171: creat d3/d27/f32 x:0 0 0 2024-09-13T22:56:01.701 INFO:tasks.workunit.client.1.smithi047.stdout:2/380: link d1/df/c65 d1/df/d1d/d20/d37/d7b/d80/c82 0 2024-09-13T22:56:01.701 INFO:tasks.workunit.client.1.smithi047.stdout:3/376: write d0/d25/d44/f27 [764521,83302] 0 2024-09-13T22:56:01.702 INFO:tasks.workunit.client.0.smithi002.stdout:8/172: dread - d3/d21/f29 zero size 2024-09-13T22:56:01.702 INFO:tasks.workunit.client.0.smithi002.stdout:9/211: dread d8/d2c/f47 [0,4194304] 0 2024-09-13T22:56:01.702 INFO:tasks.workunit.client.0.smithi002.stdout:2/163: fdatasync d1/f18 0 2024-09-13T22:56:01.702 INFO:tasks.workunit.client.1.smithi047.stdout:3/377: chown d0/d3/d65 4902073 1 2024-09-13T22:56:01.706 INFO:tasks.workunit.client.0.smithi002.stdout:0/164: creat d1/d2/d10/d31/f37 x:0 0 0 2024-09-13T22:56:01.707 INFO:tasks.workunit.client.1.smithi047.stdout:2/381: dwrite d1/df/f3f [0,4194304] 0 2024-09-13T22:56:01.709 INFO:tasks.workunit.client.1.smithi047.stdout:1/261: mknod d0/d7/c4b 0 2024-09-13T22:56:01.715 INFO:tasks.workunit.client.0.smithi002.stdout:6/171: truncate f1 3058824 0 2024-09-13T22:56:01.715 INFO:tasks.workunit.client.1.smithi047.stdout:6/291: sync 2024-09-13T22:56:01.715 INFO:tasks.workunit.client.1.smithi047.stdout:4/312: sync 2024-09-13T22:56:01.717 INFO:tasks.workunit.client.1.smithi047.stdout:6/292: dread - d3/d11/d2b/f60 zero size 2024-09-13T22:56:01.718 INFO:tasks.workunit.client.1.smithi047.stdout:7/326: creat d0/d7/da/d2e/d64/f6a x:0 0 0 2024-09-13T22:56:01.719 INFO:tasks.workunit.client.1.smithi047.stdout:1/262: dwrite d0/d7/db/f3a [0,4194304] 0 2024-09-13T22:56:01.721 INFO:tasks.workunit.client.1.smithi047.stdout:2/382: creat d1/de/f83 x:0 0 0 2024-09-13T22:56:01.725 INFO:tasks.workunit.client.0.smithi002.stdout:7/140: dwrite f1 [0,4194304] 0 2024-09-13T22:56:01.727 INFO:tasks.workunit.client.0.smithi002.stdout:3/200: truncate d9/f2a 1670031 0 2024-09-13T22:56:01.729 INFO:tasks.workunit.client.0.smithi002.stdout:8/173: chown d3/c2b 62972 1 2024-09-13T22:56:01.731 INFO:tasks.workunit.client.1.smithi047.stdout:4/313: symlink dc/de/d17/d25/d4a/l6b 0 2024-09-13T22:56:01.732 INFO:tasks.workunit.client.1.smithi047.stdout:3/378: dwrite d0/d25/d44/d43/d3a/f6d [0,4194304] 0 2024-09-13T22:56:01.732 INFO:tasks.workunit.client.0.smithi002.stdout:3/201: dread d9/d15/d51/f18 [0,4194304] 0 2024-09-13T22:56:01.733 INFO:tasks.workunit.client.0.smithi002.stdout:3/202: fsync d9/df/f41 0 2024-09-13T22:56:01.734 INFO:tasks.workunit.client.1.smithi047.stdout:3/379: readlink d0/d3/d4/d16/d1c/l67 0 2024-09-13T22:56:01.734 INFO:tasks.workunit.client.0.smithi002.stdout:3/203: write d9/d15/f2f [4248875,46506] 0 2024-09-13T22:56:01.736 INFO:tasks.workunit.client.1.smithi047.stdout:6/293: creat d3/d11/d2b/d1c/d4d/f66 x:0 0 0 2024-09-13T22:56:01.738 INFO:tasks.workunit.client.1.smithi047.stdout:6/294: chown d3/d11/d2b/d4c/d30/f5d 344 1 2024-09-13T22:56:01.738 INFO:tasks.workunit.client.0.smithi002.stdout:2/164: creat d1/d7/d8/f30 x:0 0 0 2024-09-13T22:56:01.739 INFO:tasks.workunit.client.0.smithi002.stdout:0/165: symlink d1/d4/l38 0 2024-09-13T22:56:01.740 INFO:tasks.workunit.client.0.smithi002.stdout:0/166: truncate d1/d4/f7 5007060 0 2024-09-13T22:56:01.740 INFO:tasks.workunit.client.1.smithi047.stdout:1/263: creat d0/d7/d14/d28/d36/f4c x:0 0 0 2024-09-13T22:56:01.741 INFO:tasks.workunit.client.0.smithi002.stdout:5/164: creat d1/f3e x:0 0 0 2024-09-13T22:56:01.743 INFO:tasks.workunit.client.0.smithi002.stdout:6/172: mknod d12/d17/c31 0 2024-09-13T22:56:01.745 INFO:tasks.workunit.client.1.smithi047.stdout:4/314: unlink dc/de/d17/d25/d4a/l5c 0 2024-09-13T22:56:01.748 INFO:tasks.workunit.client.1.smithi047.stdout:3/380: rename d0/d3/f33 to d0/d3/d4/d16/d2c/de/f80 0 2024-09-13T22:56:01.751 INFO:tasks.workunit.client.1.smithi047.stdout:7/327: link d0/d19/f62 d0/d7/da/d1e/f6b 0 2024-09-13T22:56:01.751 INFO:tasks.workunit.client.1.smithi047.stdout:7/328: fsync d0/d7/da/d2e/d37/f43 0 2024-09-13T22:56:01.752 INFO:tasks.workunit.client.1.smithi047.stdout:6/295: mknod d3/d11/d2b/d4c/c67 0 2024-09-13T22:56:01.754 INFO:tasks.workunit.client.0.smithi002.stdout:8/174: write d3/dc/d18/f2d [4015611,26121] 0 2024-09-13T22:56:01.756 INFO:tasks.workunit.client.0.smithi002.stdout:4/143: truncate d3/f21 161893 0 2024-09-13T22:56:01.757 INFO:tasks.workunit.client.1.smithi047.stdout:8/316: getdents d8/d64/d4e 0 2024-09-13T22:56:01.757 INFO:tasks.workunit.client.1.smithi047.stdout:8/317: chown d8/d36/d38/f3b 725 1 2024-09-13T22:56:01.758 INFO:tasks.workunit.client.0.smithi002.stdout:9/212: mknod d8/c4b 0 2024-09-13T22:56:01.759 INFO:tasks.workunit.client.0.smithi002.stdout:9/213: write d8/d10/d1c/f12 [1016072,55356] 0 2024-09-13T22:56:01.760 INFO:tasks.workunit.client.1.smithi047.stdout:2/383: creat d1/df/d1d/d20/d37/d7a/f84 x:0 0 0 2024-09-13T22:56:01.760 INFO:tasks.workunit.client.0.smithi002.stdout:9/214: write d8/d1e/f36 [1498807,4683] 0 2024-09-13T22:56:01.762 INFO:tasks.workunit.client.1.smithi047.stdout:4/315: mkdir dc/d29/d6c 0 2024-09-13T22:56:01.763 INFO:tasks.workunit.client.0.smithi002.stdout:1/223: write d1/ff [1536887,37074] 0 2024-09-13T22:56:01.764 INFO:tasks.workunit.client.0.smithi002.stdout:1/224: fsync d1/f43 0 2024-09-13T22:56:01.765 INFO:tasks.workunit.client.1.smithi047.stdout:3/381: mkdir d0/d25/d44/d43/d3a/d81 0 2024-09-13T22:56:01.766 INFO:tasks.workunit.client.1.smithi047.stdout:2/384: dwrite d1/df/d1d/d20/d37/d7b/f6c [0,4194304] 0 2024-09-13T22:56:01.770 INFO:tasks.workunit.client.1.smithi047.stdout:7/329: creat d0/d7/da/d2e/d64/f6c x:0 0 0 2024-09-13T22:56:01.772 INFO:tasks.workunit.client.1.smithi047.stdout:6/296: symlink d3/d2c/l68 0 2024-09-13T22:56:01.772 INFO:tasks.workunit.client.1.smithi047.stdout:1/264: write d0/d7/d14/f2b [232823,125802] 0 2024-09-13T22:56:01.774 INFO:tasks.workunit.client.1.smithi047.stdout:1/265: write d0/d7/f37 [575558,121399] 0 2024-09-13T22:56:01.774 INFO:tasks.workunit.client.0.smithi002.stdout:5/165: dwrite d1/f1d [0,4194304] 0 2024-09-13T22:56:01.784 INFO:tasks.workunit.client.1.smithi047.stdout:8/318: dwrite d8/f32 [0,4194304] 0 2024-09-13T22:56:01.785 INFO:tasks.workunit.client.1.smithi047.stdout:8/319: write d8/d36/d40/f5c [354303,61530] 0 2024-09-13T22:56:01.786 INFO:tasks.workunit.client.1.smithi047.stdout:3/382: unlink d0/d3/d4/d16/d1c/l45 0 2024-09-13T22:56:01.788 INFO:tasks.workunit.client.1.smithi047.stdout:3/383: write d0/d3/d4/d16/f53 [1009751,6060] 0 2024-09-13T22:56:01.789 INFO:tasks.workunit.client.1.smithi047.stdout:2/385: mkdir d1/df/d1d/d20/d37/d85 0 2024-09-13T22:56:01.791 INFO:tasks.workunit.client.1.smithi047.stdout:7/330: write d0/d7/f1d [3995614,27954] 0 2024-09-13T22:56:01.794 INFO:tasks.workunit.client.1.smithi047.stdout:1/266: unlink d0/le 0 2024-09-13T22:56:01.796 INFO:tasks.workunit.client.0.smithi002.stdout:0/167: creat d1/d2/d10/d31/d32/f39 x:0 0 0 2024-09-13T22:56:01.796 INFO:tasks.workunit.client.0.smithi002.stdout:6/173: stat d12/d17/d28 0 2024-09-13T22:56:01.797 INFO:tasks.workunit.client.1.smithi047.stdout:8/320: symlink d8/d36/d38/l6f 0 2024-09-13T22:56:01.797 INFO:tasks.workunit.client.0.smithi002.stdout:5/166: stat d1/d10/c23 0 2024-09-13T22:56:01.798 INFO:tasks.workunit.client.0.smithi002.stdout:1/225: dread d1/fe [0,4194304] 0 2024-09-13T22:56:01.799 INFO:tasks.workunit.client.1.smithi047.stdout:2/386: unlink d1/df/d1d/d20/d37/d7b/d80/c82 0 2024-09-13T22:56:01.800 INFO:tasks.workunit.client.0.smithi002.stdout:1/226: dread d1/d13/d21/d39/f3c [0,4194304] 0 2024-09-13T22:56:01.800 INFO:tasks.workunit.client.1.smithi047.stdout:2/387: dread - d1/d16/f7c zero size 2024-09-13T22:56:01.800 INFO:tasks.workunit.client.1.smithi047.stdout:2/388: read - d1/df/d35/f78 zero size 2024-09-13T22:56:01.802 INFO:tasks.workunit.client.0.smithi002.stdout:9/215: unlink d8/d1e/c26 0 2024-09-13T22:56:01.803 INFO:tasks.workunit.client.1.smithi047.stdout:7/331: symlink d0/d57/d5b/d5c/l6d 0 2024-09-13T22:56:01.805 INFO:tasks.workunit.client.1.smithi047.stdout:2/389: dread d1/df/d1d/d20/d37/d7b/f6c [0,4194304] 0 2024-09-13T22:56:01.806 INFO:tasks.workunit.client.0.smithi002.stdout:0/168: creat d1/d2/d10/f3a x:0 0 0 2024-09-13T22:56:01.809 INFO:tasks.workunit.client.0.smithi002.stdout:3/204: truncate d9/d15/d51/f2e 3134549 0 2024-09-13T22:56:01.809 INFO:tasks.workunit.client.1.smithi047.stdout:7/332: dwrite d0/d7/da/d4e/f66 [0,4194304] 0 2024-09-13T22:56:01.811 INFO:tasks.workunit.client.1.smithi047.stdout:4/316: rename dc/de/d17/d25/l45 to dc/l6d 0 2024-09-13T22:56:01.811 INFO:tasks.workunit.client.1.smithi047.stdout:6/297: write d3/f22 [653808,129470] 0 2024-09-13T22:56:01.812 INFO:tasks.workunit.client.0.smithi002.stdout:0/169: dwrite d1/d2/fd [0,4194304] 0 2024-09-13T22:56:01.812 INFO:tasks.workunit.client.1.smithi047.stdout:4/317: chown dc/de/d17/d25 0 1 2024-09-13T22:56:01.816 INFO:tasks.workunit.client.1.smithi047.stdout:6/298: dread - d3/d11/d2b/d4c/d30/d48/f4e zero size 2024-09-13T22:56:01.816 INFO:tasks.workunit.client.1.smithi047.stdout:8/321: write d8/f1c [3729648,48537] 0 2024-09-13T22:56:01.817 INFO:tasks.workunit.client.0.smithi002.stdout:8/175: rename d3/d27/c28 to d3/dc/c33 0 2024-09-13T22:56:01.820 INFO:tasks.workunit.client.1.smithi047.stdout:6/299: dread d3/d11/d2b/d1c/f2e [0,4194304] 0 2024-09-13T22:56:01.820 INFO:tasks.workunit.client.0.smithi002.stdout:0/170: dwrite d1/d2/fd [0,4194304] 0 2024-09-13T22:56:01.821 INFO:tasks.workunit.client.1.smithi047.stdout:6/300: write d3/d11/f40 [728697,17986] 0 2024-09-13T22:56:01.822 INFO:tasks.workunit.client.0.smithi002.stdout:0/171: write d1/f1c [731413,53383] 0 2024-09-13T22:56:01.826 INFO:tasks.workunit.client.0.smithi002.stdout:8/176: dread d3/f24 [0,4194304] 0 2024-09-13T22:56:01.828 INFO:tasks.workunit.client.1.smithi047.stdout:6/301: dwrite d3/d11/d2b/d4c/d30/f44 [0,4194304] 0 2024-09-13T22:56:01.829 INFO:tasks.workunit.client.0.smithi002.stdout:6/174: creat d12/d17/d2a/f32 x:0 0 0 2024-09-13T22:56:01.829 INFO:tasks.workunit.client.1.smithi047.stdout:6/302: chown d3/d11/d2b/d1c 283904 1 2024-09-13T22:56:01.830 INFO:tasks.workunit.client.1.smithi047.stdout:7/333: mkdir d0/d7/da/d4e/d6e 0 2024-09-13T22:56:01.833 INFO:tasks.workunit.client.0.smithi002.stdout:1/227: creat d1/d13/d30/d31/d3d/f48 x:0 0 0 2024-09-13T22:56:01.835 INFO:tasks.workunit.client.1.smithi047.stdout:1/267: write d0/d7/f44 [847427,65214] 0 2024-09-13T22:56:01.836 INFO:tasks.workunit.client.0.smithi002.stdout:0/172: symlink d1/l3b 0 2024-09-13T22:56:01.837 INFO:tasks.workunit.client.1.smithi047.stdout:1/268: write d0/d7/d14/f18 [1483009,66391] 0 2024-09-13T22:56:01.838 INFO:tasks.workunit.client.1.smithi047.stdout:8/322: mkdir d8/d64/d4e/d70 0 2024-09-13T22:56:01.839 INFO:tasks.workunit.client.1.smithi047.stdout:1/269: read d0/d7/db/f38 [3372360,75943] 0 2024-09-13T22:56:01.845 INFO:tasks.workunit.client.0.smithi002.stdout:9/216: write d8/d1e/f27 [951639,5355] 0 2024-09-13T22:56:01.849 INFO:tasks.workunit.client.1.smithi047.stdout:3/384: dwrite d0/d3/d4/d16/d2c/de/f80 [0,4194304] 0 2024-09-13T22:56:01.850 INFO:tasks.workunit.client.0.smithi002.stdout:5/167: creat d1/f3f x:0 0 0 2024-09-13T22:56:01.853 INFO:tasks.workunit.client.0.smithi002.stdout:9/217: dwrite d8/d10/f21 [0,4194304] 0 2024-09-13T22:56:01.854 INFO:tasks.workunit.client.1.smithi047.stdout:2/390: dwrite d1/df/d26/d4b/f5a [4194304,4194304] 0 2024-09-13T22:56:01.854 INFO:tasks.workunit.client.1.smithi047.stdout:6/303: write d3/d11/d2b/d4c/d30/d48/f4e [873284,35397] 0 2024-09-13T22:56:01.855 INFO:tasks.workunit.client.1.smithi047.stdout:2/391: dread - d1/de/f83 zero size 2024-09-13T22:56:01.855 INFO:tasks.workunit.client.1.smithi047.stdout:6/304: readlink d3/d11/d2b/d1c/d4d/l51 0 2024-09-13T22:56:01.855 INFO:tasks.workunit.client.1.smithi047.stdout:4/318: symlink dc/de/d17/l6e 0 2024-09-13T22:56:01.856 INFO:tasks.workunit.client.1.smithi047.stdout:6/305: chown d3/d11/d2b/d1c 3379654 1 2024-09-13T22:56:01.860 INFO:tasks.workunit.client.0.smithi002.stdout:8/177: mkdir d3/dc/d34 0 2024-09-13T22:56:01.861 INFO:tasks.workunit.client.1.smithi047.stdout:5/231: sync 2024-09-13T22:56:01.865 INFO:tasks.workunit.client.1.smithi047.stdout:2/392: dwrite d1/df/d1d/d20/d37/d7b/f79 [0,4194304] 0 2024-09-13T22:56:01.875 INFO:tasks.workunit.client.0.smithi002.stdout:3/205: write d9/fd [1656549,88251] 0 2024-09-13T22:56:01.875 INFO:tasks.workunit.client.0.smithi002.stdout:5/168: write d1/f3a [998204,91824] 0 2024-09-13T22:56:01.876 INFO:tasks.workunit.client.0.smithi002.stdout:3/206: readlink d9/df/l31 0 2024-09-13T22:56:01.876 INFO:tasks.workunit.client.0.smithi002.stdout:5/169: write d1/f3e [290697,76706] 0 2024-09-13T22:56:01.881 INFO:tasks.workunit.client.0.smithi002.stdout:5/170: dread d1/f1d [0,4194304] 0 2024-09-13T22:56:01.881 INFO:tasks.workunit.client.1.smithi047.stdout:3/385: rmdir d0/d3/d4/d16/d2c 39 2024-09-13T22:56:01.883 INFO:tasks.workunit.client.0.smithi002.stdout:1/228: getdents d1/d13/d1d/d33 0 2024-09-13T22:56:01.883 INFO:tasks.workunit.client.1.smithi047.stdout:3/386: truncate d0/d3/d4/d16/d32/f39 552711 0 2024-09-13T22:56:01.884 INFO:tasks.workunit.client.0.smithi002.stdout:1/229: chown d1/d13/d30 687722200 1 2024-09-13T22:56:01.888 INFO:tasks.workunit.client.1.smithi047.stdout:6/306: mkdir d3/d11/d2b/d1c/d4d/d69 0 2024-09-13T22:56:01.888 INFO:tasks.workunit.client.0.smithi002.stdout:8/178: dread d3/dc/fd [0,4194304] 0 2024-09-13T22:56:01.888 INFO:tasks.workunit.client.0.smithi002.stdout:5/171: dwrite d1/d10/f3d [0,4194304] 0 2024-09-13T22:56:01.889 INFO:tasks.workunit.client.1.smithi047.stdout:7/334: unlink d0/d7/da/c5a 0 2024-09-13T22:56:01.889 INFO:tasks.workunit.client.1.smithi047.stdout:8/323: write d8/d64/d4e/d4d/f6a [1164841,59344] 0 2024-09-13T22:56:01.890 INFO:tasks.workunit.client.1.smithi047.stdout:7/335: chown d0/db/cd 266787431 1 2024-09-13T22:56:01.891 INFO:tasks.workunit.client.0.smithi002.stdout:6/175: creat d12/d17/f33 x:0 0 0 2024-09-13T22:56:01.895 INFO:tasks.workunit.client.1.smithi047.stdout:5/232: unlink d19/f35 0 2024-09-13T22:56:01.899 INFO:tasks.workunit.client.0.smithi002.stdout:1/230: rename d1/f43 to d1/d13/d21/d39/f49 0 2024-09-13T22:56:01.900 INFO:tasks.workunit.client.1.smithi047.stdout:1/270: symlink d0/d1d/l4d 0 2024-09-13T22:56:01.901 INFO:tasks.workunit.client.0.smithi002.stdout:9/218: dwrite d8/d1e/f34 [0,4194304] 0 2024-09-13T22:56:01.901 INFO:tasks.workunit.client.0.smithi002.stdout:0/173: unlink d1/f1c 0 2024-09-13T22:56:01.902 INFO:tasks.workunit.client.1.smithi047.stdout:1/271: dread - d0/d7/d14/d28/d36/f4c zero size 2024-09-13T22:56:01.903 INFO:tasks.workunit.client.1.smithi047.stdout:3/387: creat d0/d3/d4/d16/d1c/f82 x:0 0 0 2024-09-13T22:56:01.913 INFO:tasks.workunit.client.1.smithi047.stdout:2/393: dread d1/f1a [0,4194304] 0 2024-09-13T22:56:01.913 INFO:tasks.workunit.client.0.smithi002.stdout:3/207: mkdir d9/d3b/d53 0 2024-09-13T22:56:01.915 INFO:tasks.workunit.client.0.smithi002.stdout:3/208: dread - d9/d15/f42 zero size 2024-09-13T22:56:01.918 INFO:tasks.workunit.client.1.smithi047.stdout:4/319: rename dc/de/f16 to dc/de/d23/f6f 0 2024-09-13T22:56:01.919 INFO:tasks.workunit.client.1.smithi047.stdout:6/307: symlink d3/l6a 0 2024-09-13T22:56:01.921 INFO:tasks.workunit.client.0.smithi002.stdout:1/231: creat d1/d13/d30/d31/f4a x:0 0 0 2024-09-13T22:56:01.923 INFO:tasks.workunit.client.0.smithi002.stdout:0/174: fsync d1/f17 0 2024-09-13T22:56:01.924 INFO:tasks.workunit.client.1.smithi047.stdout:5/233: mknod d19/d34/d42/c57 0 2024-09-13T22:56:01.925 INFO:tasks.workunit.client.0.smithi002.stdout:6/176: dread f5 [0,4194304] 0 2024-09-13T22:56:01.929 INFO:tasks.workunit.client.0.smithi002.stdout:3/209: rename d9/d15/f27 to d9/df/f54 0 2024-09-13T22:56:01.930 INFO:tasks.workunit.client.0.smithi002.stdout:1/232: rmdir d1/d13/d1d/d2e 39 2024-09-13T22:56:01.933 INFO:tasks.workunit.client.1.smithi047.stdout:8/324: creat d8/f71 x:0 0 0 2024-09-13T22:56:01.935 INFO:tasks.workunit.client.1.smithi047.stdout:8/325: chown d8/d64/d4e/d70 282301 1 2024-09-13T22:56:01.936 INFO:tasks.workunit.client.0.smithi002.stdout:9/219: creat d8/d10/d42/f4c x:0 0 0 2024-09-13T22:56:01.936 INFO:tasks.workunit.client.0.smithi002.stdout:9/220: write d8/fe [1345260,64489] 0 2024-09-13T22:56:01.936 INFO:tasks.workunit.client.0.smithi002.stdout:8/179: link d3/dc/f22 d3/f35 0 2024-09-13T22:56:01.937 INFO:tasks.workunit.client.0.smithi002.stdout:9/221: chown d8/l40 0 1 2024-09-13T22:56:01.937 INFO:tasks.workunit.client.1.smithi047.stdout:5/234: mkdir d19/d23/d2e/d41/d58 0 2024-09-13T22:56:01.938 INFO:tasks.workunit.client.1.smithi047.stdout:5/235: chown d19/d23/d2e/d41/f54 880298 1 2024-09-13T22:56:01.939 INFO:tasks.workunit.client.1.smithi047.stdout:5/236: write d19/d34/d42/f48 [2706994,24947] 0 2024-09-13T22:56:01.941 INFO:tasks.workunit.client.1.smithi047.stdout:5/237: write d19/d25/d45/f47 [656508,24121] 0 2024-09-13T22:56:01.941 INFO:tasks.workunit.client.1.smithi047.stdout:1/272: creat d0/d7/f4e x:0 0 0 2024-09-13T22:56:01.942 INFO:tasks.workunit.client.0.smithi002.stdout:3/210: symlink d9/d15/d26/l55 0 2024-09-13T22:56:01.942 INFO:tasks.workunit.client.1.smithi047.stdout:5/238: write d19/f1c [1195131,76683] 0 2024-09-13T22:56:01.946 INFO:tasks.workunit.client.1.smithi047.stdout:8/326: chown d8/d3f/l60 126589207 1 2024-09-13T22:56:01.947 INFO:tasks.workunit.client.0.smithi002.stdout:5/172: getdents d1/d10 0 2024-09-13T22:56:01.949 INFO:tasks.workunit.client.0.smithi002.stdout:3/211: symlink d9/d3b/d53/l56 0 2024-09-13T22:56:01.950 INFO:tasks.workunit.client.0.smithi002.stdout:5/173: mknod d1/d10/c40 0 2024-09-13T22:56:01.951 INFO:tasks.workunit.client.1.smithi047.stdout:6/308: creat d3/d11/f6b x:0 0 0 2024-09-13T22:56:01.952 INFO:tasks.workunit.client.0.smithi002.stdout:3/212: unlink d9/df/f40 0 2024-09-13T22:56:01.953 INFO:tasks.workunit.client.0.smithi002.stdout:3/213: truncate d9/d15/d26/f4b 119410 0 2024-09-13T22:56:01.955 INFO:tasks.workunit.client.1.smithi047.stdout:2/394: getdents d1/df/d26 0 2024-09-13T22:56:01.958 INFO:tasks.workunit.client.1.smithi047.stdout:6/309: unlink d3/d11/d2b/d1c/d4d/f66 0 2024-09-13T22:56:01.959 INFO:tasks.workunit.client.1.smithi047.stdout:8/327: dread d8/d6b/f6d [0,4194304] 0 2024-09-13T22:56:01.960 INFO:tasks.workunit.client.1.smithi047.stdout:4/320: mkdir dc/de/d17/d70 0 2024-09-13T22:56:01.961 INFO:tasks.workunit.client.1.smithi047.stdout:1/273: creat d0/f4f x:0 0 0 2024-09-13T22:56:01.962 INFO:tasks.workunit.client.0.smithi002.stdout:3/214: dread d9/d15/d51/f12 [0,4194304] 0 2024-09-13T22:56:01.963 INFO:tasks.workunit.client.1.smithi047.stdout:5/239: creat d19/d23/d2e/f59 x:0 0 0 2024-09-13T22:56:01.967 INFO:tasks.workunit.client.1.smithi047.stdout:2/395: fsync d1/de/f25 0 2024-09-13T22:56:01.971 INFO:tasks.workunit.client.1.smithi047.stdout:5/240: creat d19/d23/d2e/d41/f5a x:0 0 0 2024-09-13T22:56:01.971 INFO:tasks.workunit.client.1.smithi047.stdout:1/274: write d0/d1d/f2c [952298,126960] 0 2024-09-13T22:56:01.974 INFO:tasks.workunit.client.1.smithi047.stdout:8/328: rename d8/d64/l52 to d8/d36/d38/l72 0 2024-09-13T22:56:01.979 INFO:tasks.workunit.client.1.smithi047.stdout:1/275: stat d0/d7/d14/d28/d36/l1c 0 2024-09-13T22:56:01.979 INFO:tasks.workunit.client.1.smithi047.stdout:5/241: creat d19/d34/d42/f5b x:0 0 0 2024-09-13T22:56:01.981 INFO:tasks.workunit.client.1.smithi047.stdout:1/276: fdatasync d0/d7/d14/f27 0 2024-09-13T22:56:01.986 INFO:tasks.workunit.client.1.smithi047.stdout:1/277: chown d0/d7/d14/d28 233746 1 2024-09-13T22:56:01.987 INFO:tasks.workunit.client.1.smithi047.stdout:4/321: dread dc/de/d23/f6f [0,4194304] 0 2024-09-13T22:56:01.988 INFO:tasks.workunit.client.1.smithi047.stdout:8/329: dwrite d8/d3f/f66 [0,4194304] 0 2024-09-13T22:56:01.990 INFO:tasks.workunit.client.1.smithi047.stdout:8/330: chown d8/d64 344831 1 2024-09-13T22:56:01.991 INFO:tasks.workunit.client.1.smithi047.stdout:2/396: dread d1/df/d26/f30 [0,4194304] 0 2024-09-13T22:56:01.992 INFO:tasks.workunit.client.0.smithi002.stdout:5/174: fdatasync d1/d10/f32 0 2024-09-13T22:56:01.993 INFO:tasks.workunit.client.0.smithi002.stdout:8/180: dwrite d3/f24 [4194304,4194304] 0 2024-09-13T22:56:01.994 INFO:tasks.workunit.client.1.smithi047.stdout:2/397: fsync d1/d16/f7c 0 2024-09-13T22:56:01.995 INFO:tasks.workunit.client.1.smithi047.stdout:8/331: stat d8/d36/d38/l62 0 2024-09-13T22:56:01.995 INFO:tasks.workunit.client.1.smithi047.stdout:5/242: dwrite d19/d34/f46 [0,4194304] 0 2024-09-13T22:56:01.995 INFO:tasks.workunit.client.1.smithi047.stdout:4/322: truncate dc/d29/f41 5037157 0 2024-09-13T22:56:01.997 INFO:tasks.workunit.client.0.smithi002.stdout:5/175: mkdir d1/d2a/d41 0 2024-09-13T22:56:01.998 INFO:tasks.workunit.client.0.smithi002.stdout:5/176: readlink d1/lf 0 2024-09-13T22:56:01.998 INFO:tasks.workunit.client.1.smithi047.stdout:5/243: fsync d19/d25/f38 0 2024-09-13T22:56:02.000 INFO:tasks.workunit.client.1.smithi047.stdout:8/332: truncate d8/d36/d40/f48 9034124 0 2024-09-13T22:56:02.001 INFO:tasks.workunit.client.1.smithi047.stdout:4/323: write dc/de/f3f [436843,109088] 0 2024-09-13T22:56:02.002 INFO:tasks.workunit.client.1.smithi047.stdout:8/333: chown d8/d36 1976393 1 2024-09-13T22:56:02.004 INFO:tasks.workunit.client.1.smithi047.stdout:2/398: dread - d1/df/d1d/d3c/f56 zero size 2024-09-13T22:56:02.006 INFO:tasks.workunit.client.0.smithi002.stdout:8/181: link d3/d27/f32 d3/f36 0 2024-09-13T22:56:02.009 INFO:tasks.workunit.client.1.smithi047.stdout:6/310: write d3/ff [617460,119956] 0 2024-09-13T22:56:02.009 INFO:tasks.workunit.client.0.smithi002.stdout:5/177: mknod d1/c42 0 2024-09-13T22:56:02.010 INFO:tasks.workunit.client.0.smithi002.stdout:3/215: write d9/d15/d51/f21 [298019,32250] 0 2024-09-13T22:56:02.011 INFO:tasks.workunit.client.1.smithi047.stdout:6/311: write d3/f8 [2784601,71344] 0 2024-09-13T22:56:02.013 INFO:tasks.workunit.client.0.smithi002.stdout:8/182: dwrite d3/f6 [0,4194304] 0 2024-09-13T22:56:02.015 INFO:tasks.workunit.client.1.smithi047.stdout:6/312: dread d3/d11/d2b/f28 [0,4194304] 0 2024-09-13T22:56:02.020 INFO:tasks.workunit.client.0.smithi002.stdout:8/183: dwrite d3/fa [0,4194304] 0 2024-09-13T22:56:02.041 INFO:tasks.workunit.client.1.smithi047.stdout:0/312: sync 2024-09-13T22:56:02.041 INFO:tasks.workunit.client.1.smithi047.stdout:9/269: sync 2024-09-13T22:56:02.045 INFO:tasks.workunit.client.0.smithi002.stdout:3/216: mknod d9/d15/d26/d44/c57 0 2024-09-13T22:56:02.047 INFO:tasks.workunit.client.1.smithi047.stdout:4/324: mknod dc/d29/d4d/c71 0 2024-09-13T22:56:02.052 INFO:tasks.workunit.client.1.smithi047.stdout:2/399: rename d1/de/d17/f1c to d1/df/d1d/d20/d37/d7b/f86 0 2024-09-13T22:56:02.054 INFO:tasks.workunit.client.1.smithi047.stdout:2/400: dread - d1/df/d35/f45 zero size 2024-09-13T22:56:02.054 INFO:tasks.workunit.client.1.smithi047.stdout:6/313: dread d3/f2f [0,4194304] 0 2024-09-13T22:56:02.055 INFO:tasks.workunit.client.1.smithi047.stdout:2/401: stat d1/df/d26 0 2024-09-13T22:56:02.055 INFO:tasks.workunit.client.0.smithi002.stdout:8/184: rename d3/cb to d3/d27/c37 0 2024-09-13T22:56:02.058 INFO:tasks.workunit.client.0.smithi002.stdout:3/217: mkdir d9/d15/d26/d44/d58 0 2024-09-13T22:56:02.059 INFO:tasks.workunit.client.0.smithi002.stdout:8/185: creat d3/f38 x:0 0 0 2024-09-13T22:56:02.062 INFO:tasks.workunit.client.1.smithi047.stdout:5/244: symlink d19/d23/d2e/l5c 0 2024-09-13T22:56:02.063 INFO:tasks.workunit.client.1.smithi047.stdout:8/334: dread d8/f10 [0,4194304] 0 2024-09-13T22:56:02.064 INFO:tasks.workunit.client.0.smithi002.stdout:8/186: write d3/dc/fe [587960,128070] 0 2024-09-13T22:56:02.064 INFO:tasks.workunit.client.1.smithi047.stdout:8/335: stat d8/d36/d38/l6f 0 2024-09-13T22:56:02.064 INFO:tasks.workunit.client.0.smithi002.stdout:3/218: dread d9/df/f54 [0,4194304] 0 2024-09-13T22:56:02.065 INFO:tasks.workunit.client.0.smithi002.stdout:3/219: truncate d9/d15/f2d 487673 0 2024-09-13T22:56:02.066 INFO:tasks.workunit.client.0.smithi002.stdout:3/220: write d9/d15/f2f [3739905,129559] 0 2024-09-13T22:56:02.071 INFO:tasks.workunit.client.0.smithi002.stdout:8/187: mkdir d3/d27/d39 0 2024-09-13T22:56:02.072 INFO:tasks.workunit.client.1.smithi047.stdout:0/313: dread d1/d5/d11/d2f/f48 [0,4194304] 0 2024-09-13T22:56:02.074 INFO:tasks.workunit.client.1.smithi047.stdout:4/325: symlink dc/d29/l72 0 2024-09-13T22:56:02.075 INFO:tasks.workunit.client.1.smithi047.stdout:1/278: truncate d0/d7/d14/d28/d36/f32 2206668 0 2024-09-13T22:56:02.076 INFO:tasks.workunit.client.1.smithi047.stdout:1/279: write d0/d7/d13/f3c [463715,118152] 0 2024-09-13T22:56:02.077 INFO:tasks.workunit.client.0.smithi002.stdout:3/221: symlink d9/d15/l59 0 2024-09-13T22:56:02.079 INFO:tasks.workunit.client.0.smithi002.stdout:8/188: symlink d3/d27/l3a 0 2024-09-13T22:56:02.080 INFO:tasks.workunit.client.1.smithi047.stdout:6/314: rmdir d3/d11/d2b/d4c 39 2024-09-13T22:56:02.081 INFO:tasks.workunit.client.1.smithi047.stdout:1/280: dread d0/d7/f44 [0,4194304] 0 2024-09-13T22:56:02.081 INFO:tasks.workunit.client.1.smithi047.stdout:1/281: chown d0/d1d 327106 1 2024-09-13T22:56:02.087 INFO:tasks.workunit.client.1.smithi047.stdout:9/270: write d1/f25 [1396860,34006] 0 2024-09-13T22:56:02.088 INFO:tasks.workunit.client.0.smithi002.stdout:8/189: creat d3/d27/d39/f3b x:0 0 0 2024-09-13T22:56:02.090 INFO:tasks.workunit.client.1.smithi047.stdout:6/315: dwrite d3/f7 [0,4194304] 0 2024-09-13T22:56:02.090 INFO:tasks.workunit.client.1.smithi047.stdout:8/336: fsync d8/d36/f3a 0 2024-09-13T22:56:02.092 INFO:tasks.workunit.client.1.smithi047.stdout:1/282: dwrite d0/d7/d10/f33 [0,4194304] 0 2024-09-13T22:56:02.094 INFO:tasks.workunit.client.0.smithi002.stdout:8/190: rename d3/d21/f29 to d3/dc/d18/f3c 0 2024-09-13T22:56:02.096 INFO:tasks.workunit.client.0.smithi002.stdout:3/222: write d9/d15/f30 [753164,51683] 0 2024-09-13T22:56:02.101 INFO:tasks.workunit.client.0.smithi002.stdout:8/191: mknod d3/dc/d16/d2f/c3d 0 2024-09-13T22:56:02.101 INFO:tasks.workunit.client.1.smithi047.stdout:2/402: dwrite d1/f1a [0,4194304] 0 2024-09-13T22:56:02.104 INFO:tasks.workunit.client.0.smithi002.stdout:3/223: fsync d9/df/f54 0 2024-09-13T22:56:02.106 INFO:tasks.workunit.client.0.smithi002.stdout:3/224: fdatasync d9/fd 0 2024-09-13T22:56:02.109 INFO:tasks.workunit.client.0.smithi002.stdout:8/192: dwrite d3/fa [4194304,4194304] 0 2024-09-13T22:56:02.113 INFO:tasks.workunit.client.0.smithi002.stdout:3/225: fdatasync d9/df/f54 0 2024-09-13T22:56:02.113 INFO:tasks.workunit.client.0.smithi002.stdout:3/226: dread - d9/d15/f24 zero size 2024-09-13T22:56:02.114 INFO:tasks.workunit.client.0.smithi002.stdout:8/193: fdatasync d3/d27/f32 0 2024-09-13T22:56:02.115 INFO:tasks.workunit.client.0.smithi002.stdout:3/227: chown d9/df/f41 796657101 1 2024-09-13T22:56:02.116 INFO:tasks.workunit.client.0.smithi002.stdout:3/228: readlink d9/d15/d51/l3e 0 2024-09-13T22:56:02.116 INFO:tasks.workunit.client.1.smithi047.stdout:9/271: symlink d1/d2d/l58 0 2024-09-13T22:56:02.117 INFO:tasks.workunit.client.0.smithi002.stdout:3/229: write d9/df/f41 [545069,25188] 0 2024-09-13T22:56:02.117 INFO:tasks.workunit.client.1.smithi047.stdout:9/272: chown d1/dc/d14/f13 2 1 2024-09-13T22:56:02.118 INFO:tasks.workunit.client.0.smithi002.stdout:3/230: read f3 [3919884,4994] 0 2024-09-13T22:56:02.124 INFO:tasks.workunit.client.0.smithi002.stdout:3/231: dwrite d9/f16 [0,4194304] 0 2024-09-13T22:56:02.126 INFO:tasks.workunit.client.1.smithi047.stdout:4/326: symlink dc/de/d39/l73 0 2024-09-13T22:56:02.127 INFO:tasks.workunit.client.0.smithi002.stdout:8/194: getdents d3/dc/d34 0 2024-09-13T22:56:02.134 INFO:tasks.workunit.client.0.smithi002.stdout:3/232: dread d9/d15/d51/f2e [0,4194304] 0 2024-09-13T22:56:02.136 INFO:tasks.workunit.client.1.smithi047.stdout:9/273: fdatasync d1/dc/d14/f13 0 2024-09-13T22:56:02.136 INFO:tasks.workunit.client.1.smithi047.stdout:2/403: dwrite d1/df/d1d/d20/d37/d7b/f6c [0,4194304] 0 2024-09-13T22:56:02.140 INFO:tasks.workunit.client.1.smithi047.stdout:1/283: mknod d0/d7/c50 0 2024-09-13T22:56:02.141 INFO:tasks.workunit.client.0.smithi002.stdout:8/195: link d3/f36 d3/dc/d16/f3e 0 2024-09-13T22:56:02.142 INFO:tasks.workunit.client.1.smithi047.stdout:1/284: write d0/d7/f12 [3158501,101394] 0 2024-09-13T22:56:02.143 INFO:tasks.workunit.client.1.smithi047.stdout:9/274: dwrite d1/f40 [0,4194304] 0 2024-09-13T22:56:02.145 INFO:tasks.workunit.client.1.smithi047.stdout:9/275: chown d1/dc/d14/f2f 1676243 1 2024-09-13T22:56:02.145 INFO:tasks.workunit.client.0.smithi002.stdout:0/175: sync 2024-09-13T22:56:02.145 INFO:tasks.workunit.client.0.smithi002.stdout:7/141: sync 2024-09-13T22:56:02.145 INFO:tasks.workunit.client.0.smithi002.stdout:2/165: sync 2024-09-13T22:56:02.145 INFO:tasks.workunit.client.0.smithi002.stdout:4/144: sync 2024-09-13T22:56:02.146 INFO:tasks.workunit.client.1.smithi047.stdout:0/314: link d1/d5/d11/l33 d1/d5/d11/d2f/l6f 0 2024-09-13T22:56:02.148 INFO:tasks.workunit.client.0.smithi002.stdout:8/196: readlink d3/dc/l1c 0 2024-09-13T22:56:02.150 INFO:tasks.workunit.client.1.smithi047.stdout:4/327: chown dc/de/f18 1 1 2024-09-13T22:56:02.150 INFO:tasks.workunit.client.0.smithi002.stdout:7/142: dwrite d8/f12 [0,4194304] 0 2024-09-13T22:56:02.151 INFO:tasks.workunit.client.1.smithi047.stdout:5/245: getdents d19/d23/d32 0 2024-09-13T22:56:02.152 INFO:tasks.workunit.client.0.smithi002.stdout:7/143: write d8/f24 [601544,92797] 0 2024-09-13T22:56:02.155 INFO:tasks.workunit.client.1.smithi047.stdout:5/246: truncate d19/d23/d2e/d41/f51 401803 0 2024-09-13T22:56:02.156 INFO:tasks.workunit.client.0.smithi002.stdout:3/233: dwrite d9/d15/d51/f18 [0,4194304] 0 2024-09-13T22:56:02.156 INFO:tasks.workunit.client.0.smithi002.stdout:3/234: chown d9 604766 1 2024-09-13T22:56:02.157 INFO:tasks.workunit.client.1.smithi047.stdout:4/328: dread dc/de/d23/f64 [0,4194304] 0 2024-09-13T22:56:02.157 INFO:tasks.workunit.client.0.smithi002.stdout:3/235: fsync d9/d15/d51/f37 0 2024-09-13T22:56:02.158 INFO:tasks.workunit.client.1.smithi047.stdout:8/337: truncate d8/d6b/f6d 7814764 0 2024-09-13T22:56:02.160 INFO:tasks.workunit.client.1.smithi047.stdout:6/316: creat d3/d11/d2b/f6c x:0 0 0 2024-09-13T22:56:02.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:01 smithi047 ceph-mon[34560]: pgmap v11: 65 pgs: 65 active+clean; 785 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 8.3 MiB/s rd, 95 MiB/s wr, 268 op/s 2024-09-13T22:56:02.164 INFO:tasks.workunit.client.1.smithi047.stdout:9/276: symlink d1/l59 0 2024-09-13T22:56:02.165 INFO:tasks.workunit.client.1.smithi047.stdout:0/315: rmdir d1/d5/d16/d23 39 2024-09-13T22:56:02.167 INFO:tasks.workunit.client.1.smithi047.stdout:0/316: dread - d1/d5/d16/d47/f4a zero size 2024-09-13T22:56:02.169 INFO:tasks.workunit.client.1.smithi047.stdout:9/277: dread d1/f1a [0,4194304] 0 2024-09-13T22:56:02.171 INFO:tasks.workunit.client.0.smithi002.stdout:1/233: sync 2024-09-13T22:56:02.171 INFO:tasks.workunit.client.0.smithi002.stdout:5/178: sync 2024-09-13T22:56:02.171 INFO:tasks.workunit.client.0.smithi002.stdout:6/177: sync 2024-09-13T22:56:02.171 INFO:tasks.workunit.client.0.smithi002.stdout:9/222: sync 2024-09-13T22:56:02.172 INFO:tasks.workunit.client.1.smithi047.stdout:2/404: symlink d1/l87 0 2024-09-13T22:56:02.172 INFO:tasks.workunit.client.0.smithi002.stdout:5/179: readlink d1/lb 0 2024-09-13T22:56:02.173 INFO:tasks.workunit.client.1.smithi047.stdout:2/405: write d1/df/d1d/d20/d37/f39 [3967209,1207] 0 2024-09-13T22:56:02.173 INFO:tasks.workunit.client.0.smithi002.stdout:4/145: write d3/fb [2123256,100634] 0 2024-09-13T22:56:02.174 INFO:tasks.workunit.client.1.smithi047.stdout:8/338: readlink d8/l61 0 2024-09-13T22:56:02.180 INFO:tasks.workunit.client.0.smithi002.stdout:5/180: dwrite d1/f3e [0,4194304] 0 2024-09-13T22:56:02.181 INFO:tasks.workunit.client.1.smithi047.stdout:0/317: chown d1/d5/d16/d23/c5d 368560 1 2024-09-13T22:56:02.182 INFO:tasks.workunit.client.0.smithi002.stdout:2/166: write d1/d7/f26 [1001969,76982] 0 2024-09-13T22:56:02.187 INFO:tasks.workunit.client.0.smithi002.stdout:8/197: link d3/c2b d3/dc/d34/c3f 0 2024-09-13T22:56:02.192 INFO:tasks.workunit.client.1.smithi047.stdout:2/406: symlink d1/df/d1d/d20/d37/d7b/l88 0 2024-09-13T22:56:02.193 INFO:tasks.workunit.client.1.smithi047.stdout:2/407: fsync d1/df/d1d/d3c/f56 0 2024-09-13T22:56:02.193 INFO:tasks.workunit.client.0.smithi002.stdout:7/144: dwrite f6 [0,4194304] 0 2024-09-13T22:56:02.194 INFO:tasks.workunit.client.1.smithi047.stdout:8/339: chown d8/c4b 8986 1 2024-09-13T22:56:02.195 INFO:tasks.workunit.client.1.smithi047.stdout:8/340: write d8/d36/d40/f59 [458008,87411] 0 2024-09-13T22:56:02.197 INFO:tasks.workunit.client.0.smithi002.stdout:3/236: creat d9/f5a x:0 0 0 2024-09-13T22:56:02.199 INFO:tasks.workunit.client.1.smithi047.stdout:0/318: symlink d1/d5/d11/d2f/l70 0 2024-09-13T22:56:02.200 INFO:tasks.workunit.client.1.smithi047.stdout:0/319: stat d1/d5/d16/l21 0 2024-09-13T22:56:02.201 INFO:tasks.workunit.client.0.smithi002.stdout:6/178: mkdir d12/d17/d34 0 2024-09-13T22:56:02.201 INFO:tasks.workunit.client.0.smithi002.stdout:7/145: dwrite d8/d10/f1e [0,4194304] 0 2024-09-13T22:56:02.201 INFO:tasks.workunit.client.0.smithi002.stdout:6/179: stat fa 0 2024-09-13T22:56:02.202 INFO:tasks.workunit.client.1.smithi047.stdout:9/278: mknod d1/dc/d14/dd/d54/d50/c5a 0 2024-09-13T22:56:02.203 INFO:tasks.workunit.client.1.smithi047.stdout:9/279: chown d1/f44 387750590 1 2024-09-13T22:56:02.204 INFO:tasks.workunit.client.0.smithi002.stdout:1/234: creat d1/d13/d30/d31/d3b/f4b x:0 0 0 2024-09-13T22:56:02.205 INFO:tasks.workunit.client.0.smithi002.stdout:2/167: write d1/f15 [153417,93414] 0 2024-09-13T22:56:02.205 INFO:tasks.workunit.client.1.smithi047.stdout:4/329: creat dc/de/d17/f74 x:0 0 0 2024-09-13T22:56:02.207 INFO:tasks.workunit.client.1.smithi047.stdout:4/330: write dc/de/d23/d40/f62 [398916,53900] 0 2024-09-13T22:56:02.208 INFO:tasks.workunit.client.1.smithi047.stdout:2/408: symlink d1/df/d1d/d20/d54/l89 0 2024-09-13T22:56:02.209 INFO:tasks.workunit.client.0.smithi002.stdout:9/223: link d8/d10/d1c/d3d/f3e d8/d10/d42/f4d 0 2024-09-13T22:56:02.210 INFO:tasks.workunit.client.0.smithi002.stdout:1/235: dread d1/d13/d21/d39/f3c [0,4194304] 0 2024-09-13T22:56:02.210 INFO:tasks.workunit.client.0.smithi002.stdout:0/176: getdents d1/d2/d10 0 2024-09-13T22:56:02.212 INFO:tasks.workunit.client.0.smithi002.stdout:1/236: readlink d1/d13/l17 0 2024-09-13T22:56:02.212 INFO:tasks.workunit.client.0.smithi002.stdout:3/237: dwrite d9/d15/d51/f1d [0,4194304] 0 2024-09-13T22:56:02.213 INFO:tasks.workunit.client.1.smithi047.stdout:2/409: dread d1/f1a [0,4194304] 0 2024-09-13T22:56:02.214 INFO:tasks.workunit.client.0.smithi002.stdout:0/177: truncate d1/d2/d10/d31/f37 796261 0 2024-09-13T22:56:02.215 INFO:tasks.workunit.client.0.smithi002.stdout:0/178: fsync d1/d2/d10/d31/f37 0 2024-09-13T22:56:02.215 INFO:tasks.workunit.client.1.smithi047.stdout:6/317: link d3/d11/d2b/d4c/f36 d3/d11/d2b/d1c/d4d/d69/f6d 0 2024-09-13T22:56:02.216 INFO:tasks.workunit.client.1.smithi047.stdout:5/247: getdents d19/d23/d2e 0 2024-09-13T22:56:02.216 INFO:tasks.workunit.client.0.smithi002.stdout:0/179: fdatasync d1/d2/d10/d31/d32/f39 0 2024-09-13T22:56:02.222 INFO:tasks.workunit.client.0.smithi002.stdout:6/180: creat d12/d17/d28/f35 x:0 0 0 2024-09-13T22:56:02.222 INFO:tasks.workunit.client.0.smithi002.stdout:6/181: chown l11 6394 1 2024-09-13T22:56:02.223 INFO:tasks.workunit.client.0.smithi002.stdout:6/182: write d12/d17/d2a/f32 [706453,104006] 0 2024-09-13T22:56:02.226 INFO:tasks.workunit.client.0.smithi002.stdout:8/198: fdatasync d3/dc/d16/f3e 0 2024-09-13T22:56:02.227 INFO:tasks.workunit.client.0.smithi002.stdout:4/146: write d3/d14/f2b [29933,61182] 0 2024-09-13T22:56:02.228 INFO:tasks.workunit.client.0.smithi002.stdout:4/147: dread - d3/f1e zero size 2024-09-13T22:56:02.228 INFO:tasks.workunit.client.0.smithi002.stdout:2/168: creat d1/d7/d8/f31 x:0 0 0 2024-09-13T22:56:02.229 INFO:tasks.workunit.client.1.smithi047.stdout:0/320: creat d1/d5/d11/d52/d65/f71 x:0 0 0 2024-09-13T22:56:02.231 INFO:tasks.workunit.client.1.smithi047.stdout:0/321: write d1/d5/d11/f20 [530427,120494] 0 2024-09-13T22:56:02.232 INFO:tasks.workunit.client.1.smithi047.stdout:5/248: mkdir d19/d34/d42/d5d 0 2024-09-13T22:56:02.239 INFO:tasks.workunit.client.1.smithi047.stdout:9/280: truncate d1/f44 269504 0 2024-09-13T22:56:02.241 INFO:tasks.workunit.client.0.smithi002.stdout:5/181: creat d1/f43 x:0 0 0 2024-09-13T22:56:02.242 INFO:tasks.workunit.client.0.smithi002.stdout:0/180: mkdir d1/d2/d10/d31/d3c 0 2024-09-13T22:56:02.243 INFO:tasks.workunit.client.0.smithi002.stdout:0/181: write d1/f17 [726615,47707] 0 2024-09-13T22:56:02.243 INFO:tasks.workunit.client.1.smithi047.stdout:2/410: mkdir d1/d8a 0 2024-09-13T22:56:02.244 INFO:tasks.workunit.client.0.smithi002.stdout:0/182: write d1/d2/d10/f3a [899888,28850] 0 2024-09-13T22:56:02.244 INFO:tasks.workunit.client.0.smithi002.stdout:7/146: rmdir d8/d9 39 2024-09-13T22:56:02.246 INFO:tasks.workunit.client.1.smithi047.stdout:9/281: dwrite d1/dc/d18/f35 [0,4194304] 0 2024-09-13T22:56:02.248 INFO:tasks.workunit.client.1.smithi047.stdout:0/322: rename d1/d5/f9 to d1/d5/d11/d52/f72 0 2024-09-13T22:56:02.249 INFO:tasks.workunit.client.1.smithi047.stdout:8/341: truncate d8/f27 2621279 0 2024-09-13T22:56:02.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:01 smithi002 ceph-mon[27637]: pgmap v11: 65 pgs: 65 active+clean; 785 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 8.3 MiB/s rd, 95 MiB/s wr, 268 op/s 2024-09-13T22:56:02.252 INFO:tasks.workunit.client.1.smithi047.stdout:5/249: creat d19/d23/d4c/f5e x:0 0 0 2024-09-13T22:56:02.254 INFO:tasks.workunit.client.1.smithi047.stdout:5/250: read d19/d34/f40 [1570694,117983] 0 2024-09-13T22:56:02.256 INFO:tasks.workunit.client.1.smithi047.stdout:2/411: mkdir d1/df/d35/d8b 0 2024-09-13T22:56:02.256 INFO:tasks.workunit.client.0.smithi002.stdout:2/169: chown d1/f14 308866 1 2024-09-13T22:56:02.258 INFO:tasks.workunit.client.1.smithi047.stdout:9/282: mkdir d1/dc/d14/dd/d54/d50/d5b 0 2024-09-13T22:56:02.260 INFO:tasks.workunit.client.0.smithi002.stdout:2/170: dread d1/d7/d8/f1b [0,4194304] 0 2024-09-13T22:56:02.261 INFO:tasks.workunit.client.0.smithi002.stdout:2/171: write d1/d7/d8/f1b [907930,88602] 0 2024-09-13T22:56:02.261 INFO:tasks.workunit.client.1.smithi047.stdout:0/323: write d1/f2 [2647788,19443] 0 2024-09-13T22:56:02.262 INFO:tasks.workunit.client.0.smithi002.stdout:2/172: write d1/d7/d8/f17 [4702501,38196] 0 2024-09-13T22:56:02.263 INFO:tasks.workunit.client.0.smithi002.stdout:3/238: symlink d9/l5b 0 2024-09-13T22:56:02.267 INFO:tasks.workunit.client.1.smithi047.stdout:5/251: chown d19/d23/d2e/c2f 1 1 2024-09-13T22:56:02.267 INFO:tasks.workunit.client.1.smithi047.stdout:5/252: dread - d19/d34/d42/f5b zero size 2024-09-13T22:56:02.269 INFO:tasks.workunit.client.1.smithi047.stdout:2/412: mknod d1/df/d26/d4b/c8c 0 2024-09-13T22:56:02.270 INFO:tasks.workunit.client.1.smithi047.stdout:9/283: fsync d1/f24 0 2024-09-13T22:56:02.271 INFO:tasks.workunit.client.0.smithi002.stdout:6/183: truncate d12/f21 243769 0 2024-09-13T22:56:02.273 INFO:tasks.workunit.client.1.smithi047.stdout:0/324: mknod d1/d7/c73 0 2024-09-13T22:56:02.273 INFO:tasks.workunit.client.1.smithi047.stdout:0/325: dread - d1/d5/d11/f35 zero size 2024-09-13T22:56:02.274 INFO:tasks.workunit.client.1.smithi047.stdout:0/326: readlink d1/d5/d11/l33 0 2024-09-13T22:56:02.274 INFO:tasks.workunit.client.0.smithi002.stdout:6/184: dread d12/f24 [0,4194304] 0 2024-09-13T22:56:02.276 INFO:tasks.workunit.client.0.smithi002.stdout:4/148: creat d3/d14/d29/d2a/f2d x:0 0 0 2024-09-13T22:56:02.277 INFO:tasks.workunit.client.1.smithi047.stdout:5/253: mknod d19/d23/d4c/c5f 0 2024-09-13T22:56:02.278 INFO:tasks.workunit.client.1.smithi047.stdout:5/254: write d19/d25/d45/f47 [748529,109298] 0 2024-09-13T22:56:02.284 INFO:tasks.workunit.client.1.smithi047.stdout:9/284: creat d1/dc/d14/dd/d54/d4e/d51/f5c x:0 0 0 2024-09-13T22:56:02.285 INFO:tasks.workunit.client.0.smithi002.stdout:3/239: symlink d9/d15/d36/l5c 0 2024-09-13T22:56:02.287 INFO:tasks.workunit.client.0.smithi002.stdout:1/237: rmdir d1/d13/d1d/d33 0 2024-09-13T22:56:02.289 INFO:tasks.workunit.client.0.smithi002.stdout:5/182: symlink d1/d2a/d41/l44 0 2024-09-13T22:56:02.290 INFO:tasks.workunit.client.0.smithi002.stdout:8/199: dwrite d3/dc/d16/f19 [0,4194304] 0 2024-09-13T22:56:02.292 INFO:tasks.workunit.client.1.smithi047.stdout:5/255: read d19/d25/f3f [745082,3068] 0 2024-09-13T22:56:02.300 INFO:tasks.workunit.client.1.smithi047.stdout:8/342: rename d8/l33 to d8/l73 0 2024-09-13T22:56:02.301 INFO:tasks.workunit.client.1.smithi047.stdout:9/285: dread d1/dc/d14/f4a [4194304,4194304] 0 2024-09-13T22:56:02.302 INFO:tasks.workunit.client.1.smithi047.stdout:9/286: dread - d1/dc/d14/f52 zero size 2024-09-13T22:56:02.303 INFO:tasks.workunit.client.0.smithi002.stdout:4/149: rename d3/c27 to d3/c2e 0 2024-09-13T22:56:02.305 INFO:tasks.workunit.client.0.smithi002.stdout:9/224: getdents d8/d10/d1c 0 2024-09-13T22:56:02.305 INFO:tasks.workunit.client.0.smithi002.stdout:4/150: read d3/d14/f16 [226609,122898] 0 2024-09-13T22:56:02.306 INFO:tasks.workunit.client.0.smithi002.stdout:2/173: mkdir d1/d32 0 2024-09-13T22:56:02.306 INFO:tasks.workunit.client.1.smithi047.stdout:8/343: mknod d8/d3f/c74 0 2024-09-13T22:56:02.307 INFO:tasks.workunit.client.0.smithi002.stdout:0/183: dwrite d1/f14 [0,4194304] 0 2024-09-13T22:56:02.308 INFO:tasks.workunit.client.0.smithi002.stdout:3/240: symlink d9/d15/d26/l5d 0 2024-09-13T22:56:02.308 INFO:tasks.workunit.client.1.smithi047.stdout:0/327: creat d1/d5/f74 x:0 0 0 2024-09-13T22:56:02.308 INFO:tasks.workunit.client.1.smithi047.stdout:0/328: fsync d1/d5/f10 0 2024-09-13T22:56:02.309 INFO:tasks.workunit.client.0.smithi002.stdout:3/241: write d9/df/f23 [218116,123604] 0 2024-09-13T22:56:02.309 INFO:tasks.workunit.client.0.smithi002.stdout:0/184: write d1/d2/d10/f3a [1048796,40557] 0 2024-09-13T22:56:02.310 INFO:tasks.workunit.client.1.smithi047.stdout:0/329: chown d1/d5/d11/d2f/f38 0 1 2024-09-13T22:56:02.310 INFO:tasks.workunit.client.0.smithi002.stdout:1/238: creat d1/d1c/f4c x:0 0 0 2024-09-13T22:56:02.311 INFO:tasks.workunit.client.1.smithi047.stdout:0/330: readlink d1/d5/d16/l21 0 2024-09-13T22:56:02.312 INFO:tasks.workunit.client.0.smithi002.stdout:5/183: chown d1/d10/f22 13 1 2024-09-13T22:56:02.313 INFO:tasks.workunit.client.0.smithi002.stdout:3/242: write d9/d15/f42 [285431,6490] 0 2024-09-13T22:56:02.314 INFO:tasks.workunit.client.0.smithi002.stdout:1/239: dread d1/d13/d21/d39/f3c [0,4194304] 0 2024-09-13T22:56:02.315 INFO:tasks.workunit.client.0.smithi002.stdout:3/243: chown d9/d15/d51/f18 130791182 1 2024-09-13T22:56:02.316 INFO:tasks.workunit.client.0.smithi002.stdout:0/185: dread d1/f14 [0,4194304] 0 2024-09-13T22:56:02.316 INFO:tasks.workunit.client.1.smithi047.stdout:2/413: getdents d1 0 2024-09-13T22:56:02.319 INFO:tasks.workunit.client.1.smithi047.stdout:2/414: dread d1/d16/f6a [0,4194304] 0 2024-09-13T22:56:02.323 INFO:tasks.workunit.client.0.smithi002.stdout:6/185: creat d12/d17/d34/f36 x:0 0 0 2024-09-13T22:56:02.324 INFO:tasks.workunit.client.1.smithi047.stdout:5/256: truncate d19/f1c 630121 0 2024-09-13T22:56:02.326 INFO:tasks.workunit.client.1.smithi047.stdout:9/287: rename d1/d2d/f36 to d1/dc/d14/dd/d54/d4e/d51/f5d 0 2024-09-13T22:56:02.328 INFO:tasks.workunit.client.1.smithi047.stdout:9/288: write d1/dc/d14/dd/d54/f37 [895066,113521] 0 2024-09-13T22:56:02.330 INFO:tasks.workunit.client.1.smithi047.stdout:8/344: dread d8/f27 [0,4194304] 0 2024-09-13T22:56:02.330 INFO:tasks.workunit.client.1.smithi047.stdout:9/289: write d1/f40 [3291058,81113] 0 2024-09-13T22:56:02.333 INFO:tasks.workunit.client.0.smithi002.stdout:2/174: rmdir d1/d7 39 2024-09-13T22:56:02.336 INFO:tasks.workunit.client.1.smithi047.stdout:2/415: dread d1/d16/d40/f4d [0,4194304] 0 2024-09-13T22:56:02.337 INFO:tasks.workunit.client.1.smithi047.stdout:2/416: dread - d1/de/f83 zero size 2024-09-13T22:56:02.338 INFO:tasks.workunit.client.1.smithi047.stdout:9/290: dwrite d1/dc/d14/f52 [0,4194304] 0 2024-09-13T22:56:02.339 INFO:tasks.workunit.client.0.smithi002.stdout:4/151: rename d3/f1b to d3/f2f 0 2024-09-13T22:56:02.342 INFO:tasks.workunit.client.0.smithi002.stdout:4/152: dread d3/fb [0,4194304] 0 2024-09-13T22:56:02.348 INFO:tasks.workunit.client.0.smithi002.stdout:1/240: fdatasync d1/d13/d30/d31/f41 0 2024-09-13T22:56:02.350 INFO:tasks.workunit.client.0.smithi002.stdout:1/241: dread - d1/d13/d30/d31/d3d/f48 zero size 2024-09-13T22:56:02.351 INFO:tasks.workunit.client.1.smithi047.stdout:5/257: creat d19/d25/d45/f60 x:0 0 0 2024-09-13T22:56:02.353 INFO:tasks.workunit.client.0.smithi002.stdout:7/147: getdents d8/d10 0 2024-09-13T22:56:02.354 INFO:tasks.workunit.client.0.smithi002.stdout:6/186: symlink d12/d17/d34/l37 0 2024-09-13T22:56:02.355 INFO:tasks.workunit.client.0.smithi002.stdout:1/242: dwrite d1/fb [0,4194304] 0 2024-09-13T22:56:02.356 INFO:tasks.workunit.client.0.smithi002.stdout:1/243: chown d1/d13/d30/d31/f44 2251 1 2024-09-13T22:56:02.357 INFO:tasks.workunit.client.1.smithi047.stdout:2/417: truncate d1/df/f1b 7773625 0 2024-09-13T22:56:02.359 INFO:tasks.workunit.client.1.smithi047.stdout:9/291: rmdir d1/dc/d14/dd/d54/d50 39 2024-09-13T22:56:02.359 INFO:tasks.workunit.client.1.smithi047.stdout:9/292: chown d1/c32 1905333 1 2024-09-13T22:56:02.360 INFO:tasks.workunit.client.0.smithi002.stdout:6/187: dread d12/d17/d28/f2e [0,4194304] 0 2024-09-13T22:56:02.361 INFO:tasks.workunit.client.1.smithi047.stdout:9/293: chown d1/dc/d14/c12 366 1 2024-09-13T22:56:02.362 INFO:tasks.workunit.client.0.smithi002.stdout:4/153: mkdir d3/d14/d29/d2a/d30 0 2024-09-13T22:56:02.363 INFO:tasks.workunit.client.1.smithi047.stdout:0/331: symlink d1/d5/l75 0 2024-09-13T22:56:02.364 INFO:tasks.workunit.client.0.smithi002.stdout:2/175: dread d1/d7/f26 [0,4194304] 0 2024-09-13T22:56:02.365 INFO:tasks.workunit.client.1.smithi047.stdout:0/332: fdatasync d1/d5/d11/d52/d65/f71 0 2024-09-13T22:56:02.365 INFO:tasks.workunit.client.1.smithi047.stdout:5/258: creat d19/d25/f61 x:0 0 0 2024-09-13T22:56:02.367 INFO:tasks.workunit.client.1.smithi047.stdout:8/345: symlink d8/d36/l75 0 2024-09-13T22:56:02.368 INFO:tasks.workunit.client.0.smithi002.stdout:6/188: dwrite d12/d17/d2a/f32 [0,4194304] 0 2024-09-13T22:56:02.369 INFO:tasks.workunit.client.1.smithi047.stdout:0/333: rmdir d1/d5/d11/d52/d65 39 2024-09-13T22:56:02.370 INFO:tasks.workunit.client.1.smithi047.stdout:0/334: truncate d1/d7/f6c 664258 0 2024-09-13T22:56:02.371 INFO:tasks.workunit.client.0.smithi002.stdout:6/189: readlink d12/d17/d34/l37 0 2024-09-13T22:56:02.371 INFO:tasks.workunit.client.0.smithi002.stdout:3/244: mkdir d9/d15/d36/d4e/d5e 0 2024-09-13T22:56:02.373 INFO:tasks.workunit.client.0.smithi002.stdout:2/176: dwrite d1/f15 [0,4194304] 0 2024-09-13T22:56:02.375 INFO:tasks.workunit.client.0.smithi002.stdout:2/177: chown d1/d7/d8/l2b 7484 1 2024-09-13T22:56:02.375 INFO:tasks.workunit.client.0.smithi002.stdout:6/190: dread d12/f24 [0,4194304] 0 2024-09-13T22:56:02.375 INFO:tasks.workunit.client.0.smithi002.stdout:2/178: fsync d1/f14 0 2024-09-13T22:56:02.380 INFO:tasks.workunit.client.1.smithi047.stdout:0/335: chown d1/f37 2 1 2024-09-13T22:56:02.381 INFO:tasks.workunit.client.1.smithi047.stdout:0/336: chown d1/d5/d16/d23/f64 508785 1 2024-09-13T22:56:02.381 INFO:tasks.workunit.client.0.smithi002.stdout:7/148: mkdir d8/d10/d11/d13/d26 0 2024-09-13T22:56:02.387 INFO:tasks.workunit.client.1.smithi047.stdout:2/418: creat d1/df/d1d/f8d x:0 0 0 2024-09-13T22:56:02.389 INFO:tasks.workunit.client.1.smithi047.stdout:2/419: truncate d1/df/d1d/d3c/f56 133422 0 2024-09-13T22:56:02.390 INFO:tasks.workunit.client.0.smithi002.stdout:0/186: truncate d1/d2/f1d 1112213 0 2024-09-13T22:56:02.391 INFO:tasks.workunit.client.1.smithi047.stdout:5/259: write d19/f43 [2351969,53873] 0 2024-09-13T22:56:02.392 INFO:tasks.workunit.client.1.smithi047.stdout:5/260: chown d19/d34/d42/f5b 101 1 2024-09-13T22:56:02.394 INFO:tasks.workunit.client.0.smithi002.stdout:4/154: creat d3/d14/d25/f31 x:0 0 0 2024-09-13T22:56:02.395 INFO:tasks.workunit.client.0.smithi002.stdout:4/155: write d3/f18 [1811519,62376] 0 2024-09-13T22:56:02.395 INFO:tasks.workunit.client.1.smithi047.stdout:5/261: dread d19/d23/d2e/d41/f51 [0,4194304] 0 2024-09-13T22:56:02.395 INFO:tasks.workunit.client.1.smithi047.stdout:2/420: mkdir d1/df/d1d/d20/d54/d8e 0 2024-09-13T22:56:02.397 INFO:tasks.workunit.client.1.smithi047.stdout:8/346: rename d8/l73 to d8/d36/l76 0 2024-09-13T22:56:02.398 INFO:tasks.workunit.client.1.smithi047.stdout:0/337: rename d1/d5/d16/d23/d2d to d1/d5/d16/d23/d2d/d76 22 2024-09-13T22:56:02.398 INFO:tasks.workunit.client.0.smithi002.stdout:8/200: getdents d3/d27 0 2024-09-13T22:56:02.398 INFO:tasks.workunit.client.0.smithi002.stdout:8/201: write d3/f8 [5610803,124753] 0 2024-09-13T22:56:02.399 INFO:tasks.workunit.client.1.smithi047.stdout:8/347: chown d8/d36/d38/c41 4 1 2024-09-13T22:56:02.400 INFO:tasks.workunit.client.1.smithi047.stdout:0/338: chown d1/d5/l75 28880161 1 2024-09-13T22:56:02.400 INFO:tasks.workunit.client.1.smithi047.stdout:2/421: write d1/df/d1d/d20/d37/d7b/f86 [3501959,75255] 0 2024-09-13T22:56:02.402 INFO:tasks.workunit.client.1.smithi047.stdout:8/348: dread - d8/d64/d4e/f49 zero size 2024-09-13T22:56:02.402 INFO:tasks.workunit.client.1.smithi047.stdout:5/262: dwrite d19/d34/d42/f5b [0,4194304] 0 2024-09-13T22:56:02.403 INFO:tasks.workunit.client.0.smithi002.stdout:6/191: write d12/d17/f19 [223171,16879] 0 2024-09-13T22:56:02.405 INFO:tasks.workunit.client.1.smithi047.stdout:2/422: write d1/df/d26/d4b/f5a [7164680,126282] 0 2024-09-13T22:56:02.406 INFO:tasks.workunit.client.1.smithi047.stdout:0/339: unlink d1/d5/f29 0 2024-09-13T22:56:02.410 INFO:tasks.workunit.client.0.smithi002.stdout:2/179: creat d1/d7/d8/f33 x:0 0 0 2024-09-13T22:56:02.413 INFO:tasks.workunit.client.1.smithi047.stdout:5/263: dwrite d19/f43 [0,4194304] 0 2024-09-13T22:56:02.414 INFO:tasks.workunit.client.0.smithi002.stdout:9/225: getdents d8/d10/d1c/d3d 0 2024-09-13T22:56:02.417 INFO:tasks.workunit.client.1.smithi047.stdout:8/349: dwrite d8/d3f/f66 [4194304,4194304] 0 2024-09-13T22:56:02.421 INFO:tasks.workunit.client.0.smithi002.stdout:1/244: fdatasync d1/d13/d1d/d2e/f37 0 2024-09-13T22:56:02.421 INFO:tasks.workunit.client.1.smithi047.stdout:0/340: dwrite d1/d5/d11/f35 [0,4194304] 0 2024-09-13T22:56:02.422 INFO:tasks.workunit.client.0.smithi002.stdout:1/245: write d1/f24 [220126,79424] 0 2024-09-13T22:56:02.424 INFO:tasks.workunit.client.1.smithi047.stdout:2/423: creat d1/df/d1d/d20/f8f x:0 0 0 2024-09-13T22:56:02.428 INFO:tasks.workunit.client.1.smithi047.stdout:0/341: read d1/d7/f18 [2414033,73748] 0 2024-09-13T22:56:02.429 INFO:tasks.workunit.client.1.smithi047.stdout:2/424: write d1/df/d35/f45 [197332,94575] 0 2024-09-13T22:56:02.432 INFO:tasks.workunit.client.1.smithi047.stdout:5/264: unlink d19/d23/c28 0 2024-09-13T22:56:02.437 INFO:tasks.workunit.client.0.smithi002.stdout:4/156: unlink d3/d14/c19 0 2024-09-13T22:56:02.438 INFO:tasks.workunit.client.0.smithi002.stdout:4/157: chown d3/d14/c22 1294417 1 2024-09-13T22:56:02.440 INFO:tasks.workunit.client.1.smithi047.stdout:2/425: creat d1/de/d17/f90 x:0 0 0 2024-09-13T22:56:02.441 INFO:tasks.workunit.client.1.smithi047.stdout:2/426: chown d1/f24 0 1 2024-09-13T22:56:02.441 INFO:tasks.workunit.client.0.smithi002.stdout:5/184: getdents d1/d2a/d41 0 2024-09-13T22:56:02.444 INFO:tasks.workunit.client.1.smithi047.stdout:5/265: fdatasync d19/d23/d2e/d41/f54 0 2024-09-13T22:56:02.445 INFO:tasks.workunit.client.1.smithi047.stdout:5/266: read d19/d34/d42/f5b [2713021,28024] 0 2024-09-13T22:56:02.445 INFO:tasks.workunit.client.0.smithi002.stdout:3/245: creat d9/d15/d46/f5f x:0 0 0 2024-09-13T22:56:02.446 INFO:tasks.workunit.client.1.smithi047.stdout:5/267: chown d19/d23/d2e/f59 7 1 2024-09-13T22:56:02.446 INFO:tasks.workunit.client.1.smithi047.stdout:8/350: mkdir d8/d77 0 2024-09-13T22:56:02.446 INFO:tasks.workunit.client.0.smithi002.stdout:8/202: dread d3/dc/f22 [0,4194304] 0 2024-09-13T22:56:02.447 INFO:tasks.workunit.client.1.smithi047.stdout:5/268: truncate d19/d25/d45/f60 51740 0 2024-09-13T22:56:02.447 INFO:tasks.workunit.client.1.smithi047.stdout:8/351: chown d8/d36/f3a 58332103 1 2024-09-13T22:56:02.449 INFO:tasks.workunit.client.0.smithi002.stdout:3/246: dread d9/d15/f42 [0,4194304] 0 2024-09-13T22:56:02.451 INFO:tasks.workunit.client.0.smithi002.stdout:3/247: write d9/d15/d51/f37 [186440,55721] 0 2024-09-13T22:56:02.453 INFO:tasks.workunit.client.0.smithi002.stdout:6/192: rename d12/d17/f19 to d12/d17/d34/f38 0 2024-09-13T22:56:02.456 INFO:tasks.workunit.client.1.smithi047.stdout:0/342: rename d1/d5/d11/d52/d65 to d1/d5/d16/d23/d77 0 2024-09-13T22:56:02.457 INFO:tasks.workunit.client.1.smithi047.stdout:0/343: truncate d1/d5/f10 1204178 0 2024-09-13T22:56:02.458 INFO:tasks.workunit.client.0.smithi002.stdout:2/180: mknod d1/d7/c34 0 2024-09-13T22:56:02.459 INFO:tasks.workunit.client.1.smithi047.stdout:0/344: write d1/d5/d11/f2b [805740,105594] 0 2024-09-13T22:56:02.462 INFO:tasks.workunit.client.1.smithi047.stdout:2/427: dread d1/df/f1b [4194304,4194304] 0 2024-09-13T22:56:02.462 INFO:tasks.workunit.client.1.smithi047.stdout:5/269: mknod d19/d34/d42/c62 0 2024-09-13T22:56:02.463 INFO:tasks.workunit.client.1.smithi047.stdout:5/270: fsync d19/f4f 0 2024-09-13T22:56:02.464 INFO:tasks.workunit.client.0.smithi002.stdout:9/226: write d8/d1e/f3a [773381,72788] 0 2024-09-13T22:56:02.464 INFO:tasks.workunit.client.1.smithi047.stdout:2/428: chown d1/df/d26/d4b/f50 7 1 2024-09-13T22:56:02.464 INFO:tasks.workunit.client.0.smithi002.stdout:2/181: dwrite d1/f18 [0,4194304] 0 2024-09-13T22:56:02.465 INFO:tasks.workunit.client.0.smithi002.stdout:2/182: chown d1/d7/l2a 3078 1 2024-09-13T22:56:02.467 INFO:tasks.workunit.client.1.smithi047.stdout:0/345: dwrite d1/d5/f59 [0,4194304] 0 2024-09-13T22:56:02.475 INFO:tasks.workunit.client.0.smithi002.stdout:5/185: stat d1/l1b 0 2024-09-13T22:56:02.477 INFO:tasks.workunit.client.0.smithi002.stdout:4/158: dwrite f2 [0,4194304] 0 2024-09-13T22:56:02.485 INFO:tasks.workunit.client.1.smithi047.stdout:7/336: sync 2024-09-13T22:56:02.486 INFO:tasks.workunit.client.1.smithi047.stdout:3/388: sync 2024-09-13T22:56:02.486 INFO:tasks.workunit.client.1.smithi047.stdout:5/271: truncate d19/d25/f38 1656767 0 2024-09-13T22:56:02.487 INFO:tasks.workunit.client.1.smithi047.stdout:5/272: rename d19/d23 to d19/d23/d4c/d63 22 2024-09-13T22:56:02.488 INFO:tasks.workunit.client.1.smithi047.stdout:5/273: write d19/f43 [2959579,14108] 0 2024-09-13T22:56:02.488 INFO:tasks.workunit.client.0.smithi002.stdout:3/248: rmdir d9/d15/d26 39 2024-09-13T22:56:02.490 INFO:tasks.workunit.client.0.smithi002.stdout:3/249: truncate d9/d15/d36/f38 1155371 0 2024-09-13T22:56:02.493 INFO:tasks.workunit.client.0.smithi002.stdout:4/159: dread d3/f12 [0,4194304] 0 2024-09-13T22:56:02.493 INFO:tasks.workunit.client.1.smithi047.stdout:2/429: symlink d1/df/d1d/d2e/d5e/l91 0 2024-09-13T22:56:02.494 INFO:tasks.workunit.client.1.smithi047.stdout:3/389: dwrite d0/d3/d4/d16/d32/d76/f7f [0,4194304] 0 2024-09-13T22:56:02.495 INFO:tasks.workunit.client.0.smithi002.stdout:7/149: creat d8/f27 x:0 0 0 2024-09-13T22:56:02.495 INFO:tasks.workunit.client.0.smithi002.stdout:7/150: chown f6 0 1 2024-09-13T22:56:02.495 INFO:tasks.workunit.client.1.smithi047.stdout:2/430: truncate d1/df/d35/f45 450455 0 2024-09-13T22:56:02.498 INFO:tasks.workunit.client.0.smithi002.stdout:0/187: write d1/d2/f27 [5142436,46277] 0 2024-09-13T22:56:02.499 INFO:tasks.workunit.client.0.smithi002.stdout:0/188: chown d1/d2/c8 40570987 1 2024-09-13T22:56:02.505 INFO:tasks.workunit.client.1.smithi047.stdout:5/274: rmdir d19/d23/d4c 39 2024-09-13T22:56:02.508 INFO:tasks.workunit.client.1.smithi047.stdout:0/346: dwrite d1/f4 [0,4194304] 0 2024-09-13T22:56:02.509 INFO:tasks.workunit.client.0.smithi002.stdout:6/193: write d12/d17/d28/f2f [3263211,78579] 0 2024-09-13T22:56:02.510 INFO:tasks.workunit.client.1.smithi047.stdout:0/347: dread - d1/d5/d16/d23/f64 zero size 2024-09-13T22:56:02.510 INFO:tasks.workunit.client.1.smithi047.stdout:2/431: mknod d1/df/d1d/d20/d37/c92 0 2024-09-13T22:56:02.514 INFO:tasks.workunit.client.1.smithi047.stdout:7/337: write d0/d7/f6 [1417414,88179] 0 2024-09-13T22:56:02.516 INFO:tasks.workunit.client.1.smithi047.stdout:5/275: rmdir d19/d25 39 2024-09-13T22:56:02.516 INFO:tasks.workunit.client.1.smithi047.stdout:5/276: chown d19/f4f 77284841 1 2024-09-13T22:56:02.520 INFO:tasks.workunit.client.0.smithi002.stdout:5/186: write d1/f8 [3407926,12242] 0 2024-09-13T22:56:02.523 INFO:tasks.workunit.client.0.smithi002.stdout:5/187: write d1/d10/f32 [615591,100217] 0 2024-09-13T22:56:02.523 INFO:tasks.workunit.client.1.smithi047.stdout:0/348: rename d1/d5/d11/f57 to d1/d5/d11/d6d/f78 0 2024-09-13T22:56:02.525 INFO:tasks.workunit.client.0.smithi002.stdout:8/203: dwrite d3/dc/f26 [0,4194304] 0 2024-09-13T22:56:02.526 INFO:tasks.workunit.client.1.smithi047.stdout:7/338: creat d0/d19/f6f x:0 0 0 2024-09-13T22:56:02.526 INFO:tasks.workunit.client.1.smithi047.stdout:7/339: chown d0/d7/f1d 6462 1 2024-09-13T22:56:02.527 INFO:tasks.workunit.client.0.smithi002.stdout:4/160: creat d3/d14/d29/d2a/f32 x:0 0 0 2024-09-13T22:56:02.530 INFO:tasks.workunit.client.0.smithi002.stdout:9/227: mkdir d8/d1e/d4e 0 2024-09-13T22:56:02.530 INFO:tasks.workunit.client.0.smithi002.stdout:7/151: fsync d8/d9/f19 0 2024-09-13T22:56:02.530 INFO:tasks.workunit.client.0.smithi002.stdout:0/189: symlink d1/d2/d10/d31/l3d 0 2024-09-13T22:56:02.531 INFO:tasks.workunit.client.0.smithi002.stdout:4/161: rename d3 to d3/d14/d29/d2a/d30/d33 22 2024-09-13T22:56:02.531 INFO:tasks.workunit.client.0.smithi002.stdout:9/228: fsync d8/d10/f2f 0 2024-09-13T22:56:02.533 INFO:tasks.workunit.client.0.smithi002.stdout:8/204: dread d3/f6 [4194304,4194304] 0 2024-09-13T22:56:02.533 INFO:tasks.workunit.client.1.smithi047.stdout:2/432: rename d1/de/l51 to d1/df/d1d/d20/d29/l93 0 2024-09-13T22:56:02.534 INFO:tasks.workunit.client.0.smithi002.stdout:3/250: dwrite d9/d15/d36/d4e/f50 [0,4194304] 0 2024-09-13T22:56:02.535 INFO:tasks.workunit.client.0.smithi002.stdout:1/246: creat d1/f4d x:0 0 0 2024-09-13T22:56:02.535 INFO:tasks.workunit.client.1.smithi047.stdout:0/349: mknod d1/d5/d16/d23/c79 0 2024-09-13T22:56:02.535 INFO:tasks.workunit.client.0.smithi002.stdout:9/229: truncate d8/d10/d42/f4d 999736 0 2024-09-13T22:56:02.536 INFO:tasks.workunit.client.1.smithi047.stdout:0/350: stat d1/d7/c49 0 2024-09-13T22:56:02.536 INFO:tasks.workunit.client.0.smithi002.stdout:6/194: mkdir d12/d17/d34/d39 0 2024-09-13T22:56:02.539 INFO:tasks.workunit.client.1.smithi047.stdout:5/277: mkdir d19/d64 0 2024-09-13T22:56:02.539 INFO:tasks.workunit.client.1.smithi047.stdout:5/278: stat d19/l21 0 2024-09-13T22:56:02.540 INFO:tasks.workunit.client.1.smithi047.stdout:5/279: chown cd 22 1 2024-09-13T22:56:02.540 INFO:tasks.workunit.client.1.smithi047.stdout:5/280: chown d19/d34/d42/c57 206186893 1 2024-09-13T22:56:02.541 INFO:tasks.workunit.client.1.smithi047.stdout:0/351: symlink d1/d7/l7a 0 2024-09-13T22:56:02.542 INFO:tasks.workunit.client.0.smithi002.stdout:5/188: readlink d1/l14 0 2024-09-13T22:56:02.544 INFO:tasks.workunit.client.1.smithi047.stdout:2/433: creat d1/df/d1d/d20/d54/d8e/f94 x:0 0 0 2024-09-13T22:56:02.545 INFO:tasks.workunit.client.1.smithi047.stdout:2/434: readlink d1/de/d17/l4c 0 2024-09-13T22:56:02.546 INFO:tasks.workunit.client.1.smithi047.stdout:5/281: dread d19/d34/f46 [0,4194304] 0 2024-09-13T22:56:02.549 INFO:tasks.workunit.client.1.smithi047.stdout:2/435: creat d1/df/d1d/d20/d54/f95 x:0 0 0 2024-09-13T22:56:02.552 INFO:tasks.workunit.client.0.smithi002.stdout:7/152: creat d8/d9/f28 x:0 0 0 2024-09-13T22:56:02.553 INFO:tasks.workunit.client.1.smithi047.stdout:0/352: mknod d1/d5/c7b 0 2024-09-13T22:56:02.554 INFO:tasks.workunit.client.0.smithi002.stdout:4/162: rmdir d3/d14/d25 39 2024-09-13T22:56:02.557 INFO:tasks.workunit.client.1.smithi047.stdout:2/436: dwrite d1/df/d1d/d20/d2b/f41 [4194304,4194304] 0 2024-09-13T22:56:02.559 INFO:tasks.workunit.client.0.smithi002.stdout:1/247: rmdir d1/d13/d1d 39 2024-09-13T22:56:02.560 INFO:tasks.workunit.client.1.smithi047.stdout:5/282: readlink d19/d23/d2e/l5c 0 2024-09-13T22:56:02.561 INFO:tasks.workunit.client.0.smithi002.stdout:8/205: truncate d3/dc/f22 2048090 0 2024-09-13T22:56:02.563 INFO:tasks.workunit.client.0.smithi002.stdout:9/230: mknod d8/d10/d42/c4f 0 2024-09-13T22:56:02.564 INFO:tasks.workunit.client.1.smithi047.stdout:7/340: write d0/f1f [2204212,53349] 0 2024-09-13T22:56:02.565 INFO:tasks.workunit.client.1.smithi047.stdout:0/353: rename d1/d5/d16/d23/d2d/l5c to d1/d5/d16/d23/d2d/l7c 0 2024-09-13T22:56:02.566 INFO:tasks.workunit.client.1.smithi047.stdout:0/354: read - d1/d5/d16/d23/f64 zero size 2024-09-13T22:56:02.567 INFO:tasks.workunit.client.0.smithi002.stdout:6/195: write d12/f1c [1538452,60334] 0 2024-09-13T22:56:02.568 INFO:tasks.workunit.client.1.smithi047.stdout:2/437: creat d1/df/d1d/d2e/d5e/f96 x:0 0 0 2024-09-13T22:56:02.569 INFO:tasks.workunit.client.0.smithi002.stdout:5/189: mkdir d1/d2a/d41/d45 0 2024-09-13T22:56:02.573 INFO:tasks.workunit.client.0.smithi002.stdout:2/183: getdents d1 0 2024-09-13T22:56:02.573 INFO:tasks.workunit.client.1.smithi047.stdout:2/438: rmdir d1/df/d1d/d2e 39 2024-09-13T22:56:02.575 INFO:tasks.workunit.client.0.smithi002.stdout:0/190: creat d1/d4/f3e x:0 0 0 2024-09-13T22:56:02.576 INFO:tasks.workunit.client.1.smithi047.stdout:5/283: symlink d19/d64/l65 0 2024-09-13T22:56:02.577 INFO:tasks.workunit.client.1.smithi047.stdout:2/439: dread d1/df/d1d/d20/d37/f39 [0,4194304] 0 2024-09-13T22:56:02.578 INFO:tasks.workunit.client.0.smithi002.stdout:7/153: mknod d8/d10/c29 0 2024-09-13T22:56:02.579 INFO:tasks.workunit.client.1.smithi047.stdout:2/440: chown d1/de/f13 835 1 2024-09-13T22:56:02.579 INFO:tasks.workunit.client.0.smithi002.stdout:7/154: chown d8/d10/d11/d13/d26 13 1 2024-09-13T22:56:02.579 INFO:tasks.workunit.client.0.smithi002.stdout:7/155: stat d8/d9/fd 0 2024-09-13T22:56:02.579 INFO:tasks.workunit.client.1.smithi047.stdout:2/441: readlink d1/df/d1d/d20/d37/d7b/l88 0 2024-09-13T22:56:02.581 INFO:tasks.workunit.client.0.smithi002.stdout:4/163: rename d3/d14/c1c to d3/d14/d29/d2a/c34 0 2024-09-13T22:56:02.583 INFO:tasks.workunit.client.0.smithi002.stdout:3/251: unlink d9/d15/l4a 0 2024-09-13T22:56:02.583 INFO:tasks.workunit.client.0.smithi002.stdout:3/252: fsync d9/d15/d36/d4e/f50 0 2024-09-13T22:56:02.588 INFO:tasks.workunit.client.1.smithi047.stdout:2/442: creat d1/f97 x:0 0 0 2024-09-13T22:56:02.589 INFO:tasks.workunit.client.0.smithi002.stdout:9/231: mkdir d8/d2c/d50 0 2024-09-13T22:56:02.590 INFO:tasks.workunit.client.1.smithi047.stdout:7/341: truncate d0/d7/f1d 2958218 0 2024-09-13T22:56:02.592 INFO:tasks.workunit.client.1.smithi047.stdout:5/284: mknod d19/c66 0 2024-09-13T22:56:02.594 INFO:tasks.workunit.client.0.smithi002.stdout:9/232: dwrite d8/d10/d1c/d3d/f44 [0,4194304] 0 2024-09-13T22:56:02.595 INFO:tasks.workunit.client.1.smithi047.stdout:7/342: creat d0/d7/da/d4e/f70 x:0 0 0 2024-09-13T22:56:02.596 INFO:tasks.workunit.client.0.smithi002.stdout:2/184: mkdir d1/d7/d35 0 2024-09-13T22:56:02.596 INFO:tasks.workunit.client.0.smithi002.stdout:5/190: chown d1/d10/l25 864897 1 2024-09-13T22:56:02.599 INFO:tasks.workunit.client.1.smithi047.stdout:7/343: mknod d0/d57/d5b/c71 0 2024-09-13T22:56:02.601 INFO:tasks.workunit.client.1.smithi047.stdout:5/285: creat d19/d23/d4c/f67 x:0 0 0 2024-09-13T22:56:02.603 INFO:tasks.workunit.client.0.smithi002.stdout:4/164: mknod d3/c35 0 2024-09-13T22:56:02.603 INFO:tasks.workunit.client.0.smithi002.stdout:4/165: dread - d3/d14/f1a zero size 2024-09-13T22:56:02.604 INFO:tasks.workunit.client.1.smithi047.stdout:2/443: write d1/d16/f7c [572843,42133] 0 2024-09-13T22:56:02.613 INFO:tasks.workunit.client.1.smithi047.stdout:7/344: symlink d0/d57/d5b/l72 0 2024-09-13T22:56:02.614 INFO:tasks.workunit.client.1.smithi047.stdout:7/345: write d0/d7/f36 [734572,45760] 0 2024-09-13T22:56:02.614 INFO:tasks.workunit.client.1.smithi047.stdout:7/346: fsync d0/d7/f6 0 2024-09-13T22:56:02.615 INFO:tasks.workunit.client.0.smithi002.stdout:3/253: mkdir d9/df/d60 0 2024-09-13T22:56:02.616 INFO:tasks.workunit.client.1.smithi047.stdout:5/286: write d19/d23/d2e/f59 [82605,61812] 0 2024-09-13T22:56:02.622 INFO:tasks.workunit.client.0.smithi002.stdout:6/196: truncate d12/d17/f1e 2955339 0 2024-09-13T22:56:02.623 INFO:tasks.workunit.client.1.smithi047.stdout:5/287: dwrite d19/d23/d2e/f59 [0,4194304] 0 2024-09-13T22:56:02.623 INFO:tasks.workunit.client.1.smithi047.stdout:2/444: dread d1/f1a [0,4194304] 0 2024-09-13T22:56:02.625 INFO:tasks.workunit.client.0.smithi002.stdout:9/233: rename d8/fa to d8/d10/d42/f51 0 2024-09-13T22:56:02.629 INFO:tasks.workunit.client.0.smithi002.stdout:5/191: creat d1/d2a/d41/f46 x:0 0 0 2024-09-13T22:56:02.629 INFO:tasks.workunit.client.1.smithi047.stdout:7/347: getdents d0/d7/da/d2e/d37 0 2024-09-13T22:56:02.631 INFO:tasks.workunit.client.0.smithi002.stdout:9/234: dwrite d8/d10/d1c/f2b [0,4194304] 0 2024-09-13T22:56:02.632 INFO:tasks.workunit.client.0.smithi002.stdout:9/235: read d8/d10/d1c/f15 [3515337,112484] 0 2024-09-13T22:56:02.634 INFO:tasks.workunit.client.1.smithi047.stdout:7/348: creat d0/db/f73 x:0 0 0 2024-09-13T22:56:02.642 INFO:tasks.workunit.client.1.smithi047.stdout:7/349: unlink d0/d19/f6f 0 2024-09-13T22:56:02.648 INFO:tasks.workunit.client.1.smithi047.stdout:7/350: creat d0/d7/da/f74 x:0 0 0 2024-09-13T22:56:02.653 INFO:tasks.workunit.client.1.smithi047.stdout:7/351: rename d0/d7/da/d2e/d37/l52 to d0/d7/da/d1e/l75 0 2024-09-13T22:56:02.656 INFO:tasks.workunit.client.1.smithi047.stdout:7/352: write d0/d57/d5b/f69 [1371081,25078] 0 2024-09-13T22:56:02.657 INFO:tasks.workunit.client.1.smithi047.stdout:7/353: truncate d0/d7/da/d1e/f65 1000100 0 2024-09-13T22:56:02.660 INFO:tasks.workunit.client.1.smithi047.stdout:7/354: rmdir d0/d7/da/d4e 39 2024-09-13T22:56:02.660 INFO:tasks.workunit.client.1.smithi047.stdout:7/355: stat d0/d19/f3f 0 2024-09-13T22:56:02.664 INFO:tasks.workunit.client.1.smithi047.stdout:7/356: rmdir d0/d7/da/d4e/d6e 0 2024-09-13T22:56:02.669 INFO:tasks.workunit.client.1.smithi047.stdout:7/357: dread d0/d7/f3c [0,4194304] 0 2024-09-13T22:56:02.676 INFO:tasks.workunit.client.0.smithi002.stdout:7/156: link f7 d8/d10/f2a 0 2024-09-13T22:56:02.676 INFO:tasks.workunit.client.0.smithi002.stdout:4/166: creat d3/d14/d29/d2a/f36 x:0 0 0 2024-09-13T22:56:02.676 INFO:tasks.workunit.client.0.smithi002.stdout:1/248: link d1/d13/f19 d1/d13/d1d/d2e/f4e 0 2024-09-13T22:56:02.676 INFO:tasks.workunit.client.0.smithi002.stdout:6/197: unlink cb 0 2024-09-13T22:56:02.677 INFO:tasks.workunit.client.0.smithi002.stdout:3/254: rename d9/df/f41 to d9/d3b/f61 0 2024-09-13T22:56:02.681 INFO:tasks.workunit.client.1.smithi047.stdout:7/358: dread d0/d7/da/d2e/f4b [0,4194304] 0 2024-09-13T22:56:02.682 INFO:tasks.workunit.client.1.smithi047.stdout:7/359: fdatasync d0/d7/f4a 0 2024-09-13T22:56:02.685 INFO:tasks.workunit.client.1.smithi047.stdout:7/360: rename d0/d57/d5b/d5c/l5f to d0/d7/da/d2e/d37/l76 0 2024-09-13T22:56:02.686 INFO:tasks.workunit.client.1.smithi047.stdout:7/361: write d0/db/f73 [589221,8822] 0 2024-09-13T22:56:02.693 INFO:tasks.workunit.client.1.smithi047.stdout:7/362: dread d0/d19/f1c [0,4194304] 0 2024-09-13T22:56:02.696 INFO:tasks.workunit.client.1.smithi047.stdout:7/363: truncate d0/db/f16 3791887 0 2024-09-13T22:56:02.701 INFO:tasks.workunit.client.1.smithi047.stdout:7/364: link d0/d7/da/f2b d0/d19/f77 0 2024-09-13T22:56:02.702 INFO:tasks.workunit.client.1.smithi047.stdout:7/365: symlink d0/l78 0 2024-09-13T22:56:02.714 INFO:tasks.workunit.client.0.smithi002.stdout:9/236: fsync d8/d2c/f47 0 2024-09-13T22:56:02.715 INFO:tasks.workunit.client.0.smithi002.stdout:6/198: fsync d12/d17/d28/f2f 0 2024-09-13T22:56:02.715 INFO:tasks.workunit.client.0.smithi002.stdout:7/157: creat d8/d10/f2b x:0 0 0 2024-09-13T22:56:02.715 INFO:tasks.workunit.client.0.smithi002.stdout:0/191: link d1/c2a d1/d2/c3f 0 2024-09-13T22:56:02.718 INFO:tasks.workunit.client.0.smithi002.stdout:7/158: read f7 [649314,63335] 0 2024-09-13T22:56:02.718 INFO:tasks.workunit.client.0.smithi002.stdout:9/237: fsync d8/d1e/f34 0 2024-09-13T22:56:02.718 INFO:tasks.workunit.client.0.smithi002.stdout:0/192: fdatasync d1/d4/f35 0 2024-09-13T22:56:02.720 INFO:tasks.workunit.client.0.smithi002.stdout:5/192: link d1/d10/l16 d1/d2a/d41/d45/l47 0 2024-09-13T22:56:02.720 INFO:tasks.workunit.client.0.smithi002.stdout:4/167: truncate d3/d14/d29/d2a/f2d 422451 0 2024-09-13T22:56:02.722 INFO:tasks.workunit.client.0.smithi002.stdout:5/193: dread - d1/f3f zero size 2024-09-13T22:56:02.724 INFO:tasks.workunit.client.0.smithi002.stdout:4/168: chown d3/d14/d29/d2a 56 1 2024-09-13T22:56:02.724 INFO:tasks.workunit.client.0.smithi002.stdout:9/238: truncate d8/d1e/f36 2280202 0 2024-09-13T22:56:02.725 INFO:tasks.workunit.client.0.smithi002.stdout:7/159: mknod d8/d10/d11/d13/d26/c2c 0 2024-09-13T22:56:02.725 INFO:tasks.workunit.client.0.smithi002.stdout:0/193: truncate d1/d2/f27 6089687 0 2024-09-13T22:56:02.726 INFO:tasks.workunit.client.0.smithi002.stdout:1/249: dwrite d1/f27 [0,4194304] 0 2024-09-13T22:56:02.727 INFO:tasks.workunit.client.0.smithi002.stdout:4/169: stat d3/d14/d29 0 2024-09-13T22:56:02.727 INFO:tasks.workunit.client.0.smithi002.stdout:9/239: chown l2 64131 1 2024-09-13T22:56:02.728 INFO:tasks.workunit.client.0.smithi002.stdout:3/255: dread d9/f16 [0,4194304] 0 2024-09-13T22:56:02.730 INFO:tasks.workunit.client.0.smithi002.stdout:0/194: symlink d1/d2/d10/l40 0 2024-09-13T22:56:02.731 INFO:tasks.workunit.client.0.smithi002.stdout:6/199: dwrite d12/d17/d2a/f32 [0,4194304] 0 2024-09-13T22:56:02.734 INFO:tasks.workunit.client.0.smithi002.stdout:1/250: fsync d1/d13/d30/fa 0 2024-09-13T22:56:02.734 INFO:tasks.workunit.client.0.smithi002.stdout:0/195: write d1/d2/f29 [343871,25949] 0 2024-09-13T22:56:02.735 INFO:tasks.workunit.client.0.smithi002.stdout:6/200: write d12/f22 [1413369,119803] 0 2024-09-13T22:56:02.735 INFO:tasks.workunit.client.0.smithi002.stdout:5/194: rename d1/d10/f2e to d1/d2a/d41/d45/f48 0 2024-09-13T22:56:02.737 INFO:tasks.workunit.client.0.smithi002.stdout:4/170: creat d3/d14/d29/d2a/f37 x:0 0 0 2024-09-13T22:56:02.738 INFO:tasks.workunit.client.0.smithi002.stdout:3/256: dread d9/df/f54 [0,4194304] 0 2024-09-13T22:56:02.739 INFO:tasks.workunit.client.0.smithi002.stdout:3/257: chown d9/d15/d51 805931859 1 2024-09-13T22:56:02.739 INFO:tasks.workunit.client.0.smithi002.stdout:4/171: truncate d3/d14/f1f 873492 0 2024-09-13T22:56:02.740 INFO:tasks.workunit.client.0.smithi002.stdout:1/251: creat d1/d1c/f4f x:0 0 0 2024-09-13T22:56:02.742 INFO:tasks.workunit.client.0.smithi002.stdout:1/252: fsync d1/d13/d21/f36 0 2024-09-13T22:56:02.742 INFO:tasks.workunit.client.0.smithi002.stdout:9/240: dread d8/d1e/f27 [0,4194304] 0 2024-09-13T22:56:02.744 INFO:tasks.workunit.client.0.smithi002.stdout:6/201: mknod d12/c3a 0 2024-09-13T22:56:02.744 INFO:tasks.workunit.client.0.smithi002.stdout:9/241: chown d8/d2c/c30 361 1 2024-09-13T22:56:02.744 INFO:tasks.workunit.client.0.smithi002.stdout:3/258: write d9/d15/d26/f4b [619696,100026] 0 2024-09-13T22:56:02.745 INFO:tasks.workunit.client.0.smithi002.stdout:5/195: dread d1/f3 [0,4194304] 0 2024-09-13T22:56:02.746 INFO:tasks.workunit.client.0.smithi002.stdout:3/259: fsync d9/fd 0 2024-09-13T22:56:02.746 INFO:tasks.workunit.client.0.smithi002.stdout:1/253: unlink d1/d13/d21/d39/f3c 0 2024-09-13T22:56:02.746 INFO:tasks.workunit.client.0.smithi002.stdout:4/172: mknod d3/d14/d29/d2a/d30/c38 0 2024-09-13T22:56:02.747 INFO:tasks.workunit.client.0.smithi002.stdout:9/242: mknod d8/d10/d42/c52 0 2024-09-13T22:56:02.750 INFO:tasks.workunit.client.0.smithi002.stdout:5/196: creat d1/f49 x:0 0 0 2024-09-13T22:56:02.753 INFO:tasks.workunit.client.0.smithi002.stdout:9/243: read d8/d1e/f22 [5086731,33014] 0 2024-09-13T22:56:02.755 INFO:tasks.workunit.client.0.smithi002.stdout:1/254: link d1/d13/c2c d1/d13/d30/d31/d3d/c50 0 2024-09-13T22:56:02.756 INFO:tasks.workunit.client.0.smithi002.stdout:6/202: dwrite d12/d17/d28/f2e [0,4194304] 0 2024-09-13T22:56:02.756 INFO:tasks.workunit.client.0.smithi002.stdout:9/244: read - d8/d10/f3c zero size 2024-09-13T22:56:02.760 INFO:tasks.workunit.client.0.smithi002.stdout:1/255: dread - d1/d13/d21/f36 zero size 2024-09-13T22:56:02.760 INFO:tasks.workunit.client.0.smithi002.stdout:4/173: dwrite d3/f21 [0,4194304] 0 2024-09-13T22:56:02.762 INFO:tasks.workunit.client.0.smithi002.stdout:4/174: write d3/d14/f1d [412838,36272] 0 2024-09-13T22:56:02.763 INFO:tasks.workunit.client.0.smithi002.stdout:0/196: read d1/d2/f18 [446510,19866] 0 2024-09-13T22:56:02.764 INFO:tasks.workunit.client.0.smithi002.stdout:9/245: mkdir d8/d10/d53 0 2024-09-13T22:56:02.767 INFO:tasks.workunit.client.0.smithi002.stdout:6/203: rename d12/d17/d28/c2d to d12/c3b 0 2024-09-13T22:56:02.767 INFO:tasks.workunit.client.0.smithi002.stdout:3/260: dread d9/fb [0,4194304] 0 2024-09-13T22:56:02.770 INFO:tasks.workunit.client.0.smithi002.stdout:1/256: dread d1/fb [0,4194304] 0 2024-09-13T22:56:02.771 INFO:tasks.workunit.client.0.smithi002.stdout:6/204: rmdir d12/d17/d2a 39 2024-09-13T22:56:02.774 INFO:tasks.workunit.client.0.smithi002.stdout:1/257: mkdir d1/d13/d1d/d34/d51 0 2024-09-13T22:56:02.775 INFO:tasks.workunit.client.0.smithi002.stdout:4/175: dwrite d3/f1e [0,4194304] 0 2024-09-13T22:56:02.778 INFO:tasks.workunit.client.0.smithi002.stdout:6/205: creat d12/d17/f3c x:0 0 0 2024-09-13T22:56:02.778 INFO:tasks.workunit.client.0.smithi002.stdout:1/258: mkdir d1/d13/d52 0 2024-09-13T22:56:02.779 INFO:tasks.workunit.client.0.smithi002.stdout:1/259: chown d1/d13/d52 1945 1 2024-09-13T22:56:02.779 INFO:tasks.workunit.client.0.smithi002.stdout:1/260: chown d1/c10 0 1 2024-09-13T22:56:02.779 INFO:tasks.workunit.client.0.smithi002.stdout:4/176: mknod d3/d14/d29/d2a/c39 0 2024-09-13T22:56:02.781 INFO:tasks.workunit.client.0.smithi002.stdout:6/206: mknod d12/d17/d34/d39/c3d 0 2024-09-13T22:56:02.781 INFO:tasks.workunit.client.0.smithi002.stdout:6/207: stat l3 0 2024-09-13T22:56:02.788 INFO:tasks.workunit.client.0.smithi002.stdout:6/208: dread d12/d17/d2a/f32 [0,4194304] 0 2024-09-13T22:56:02.804 INFO:tasks.workunit.client.0.smithi002.stdout:2/185: sync 2024-09-13T22:56:02.805 INFO:tasks.workunit.client.0.smithi002.stdout:2/186: write d1/f5 [6788703,91896] 0 2024-09-13T22:56:02.805 INFO:tasks.workunit.client.0.smithi002.stdout:2/187: chown d1/d7/d8/f1e 29801358 1 2024-09-13T22:56:02.807 INFO:tasks.workunit.client.0.smithi002.stdout:2/188: symlink d1/d7/l36 0 2024-09-13T22:56:02.808 INFO:tasks.workunit.client.0.smithi002.stdout:2/189: write d1/d7/f16 [854626,23723] 0 2024-09-13T22:56:02.808 INFO:tasks.workunit.client.0.smithi002.stdout:2/190: readlink d1/d7/d8/lc 0 2024-09-13T22:56:02.851 INFO:tasks.workunit.client.1.smithi047.stdout:2/445: write d1/f2a [576275,83531] 0 2024-09-13T22:56:02.855 INFO:tasks.workunit.client.1.smithi047.stdout:2/446: rename d1/df/d1d/d3c/l59 to d1/d16/d40/d57/l98 0 2024-09-13T22:56:02.856 INFO:tasks.workunit.client.1.smithi047.stdout:2/447: read - d1/df/d1d/d20/d37/d7a/f84 zero size 2024-09-13T22:56:02.862 INFO:tasks.workunit.client.1.smithi047.stdout:2/448: dwrite d1/df/d1d/d20/d37/d7a/f84 [0,4194304] 0 2024-09-13T22:56:02.865 INFO:tasks.workunit.client.1.smithi047.stdout:2/449: symlink d1/df/d1d/d3c/l99 0 2024-09-13T22:56:02.868 INFO:tasks.workunit.client.1.smithi047.stdout:2/450: creat d1/df/d1d/d20/f9a x:0 0 0 2024-09-13T22:56:02.872 INFO:tasks.workunit.client.1.smithi047.stdout:2/451: truncate d1/de/f5b 593211 0 2024-09-13T22:56:02.875 INFO:tasks.workunit.client.1.smithi047.stdout:2/452: write d1/df/d26/d4b/f76 [196438,105950] 0 2024-09-13T22:56:02.875 INFO:tasks.workunit.client.1.smithi047.stdout:7/366: dwrite d0/d19/f3a [0,4194304] 0 2024-09-13T22:56:02.877 INFO:tasks.workunit.client.1.smithi047.stdout:2/453: truncate d1/d16/d40/f4d 4964851 0 2024-09-13T22:56:02.877 INFO:tasks.workunit.client.0.smithi002.stdout:5/197: rmdir d1/d10 39 2024-09-13T22:56:02.878 INFO:tasks.workunit.client.1.smithi047.stdout:2/454: chown d1/df/d1d/d20/f42 61 1 2024-09-13T22:56:02.881 INFO:tasks.workunit.client.0.smithi002.stdout:7/160: truncate d8/d10/f15 1272561 0 2024-09-13T22:56:02.882 INFO:tasks.workunit.client.1.smithi047.stdout:2/455: creat d1/df/d1d/d20/d29/f9b x:0 0 0 2024-09-13T22:56:02.885 INFO:tasks.workunit.client.0.smithi002.stdout:5/198: mknod d1/d10/c4a 0 2024-09-13T22:56:02.888 INFO:tasks.workunit.client.0.smithi002.stdout:7/161: creat d8/d10/d11/f2d x:0 0 0 2024-09-13T22:56:02.888 INFO:tasks.workunit.client.0.smithi002.stdout:7/162: dread - d8/d10/f2b zero size 2024-09-13T22:56:02.889 INFO:tasks.workunit.client.0.smithi002.stdout:7/163: write d8/d10/f1e [4748634,103286] 0 2024-09-13T22:56:02.894 INFO:tasks.workunit.client.0.smithi002.stdout:7/164: dread d8/d10/f1e [0,4194304] 0 2024-09-13T22:56:02.896 INFO:tasks.workunit.client.0.smithi002.stdout:7/165: mkdir d8/d10/d11/d13/d2e 0 2024-09-13T22:56:02.900 INFO:tasks.workunit.client.0.smithi002.stdout:6/209: getdents d12/d17/d34/d39 0 2024-09-13T22:56:02.900 INFO:tasks.workunit.client.0.smithi002.stdout:4/177: truncate f2 2176793 0 2024-09-13T22:56:02.902 INFO:tasks.workunit.client.0.smithi002.stdout:7/166: dread f1 [0,4194304] 0 2024-09-13T22:56:02.904 INFO:tasks.workunit.client.0.smithi002.stdout:9/246: write d8/d10/d42/f51 [4942852,49468] 0 2024-09-13T22:56:02.906 INFO:tasks.workunit.client.0.smithi002.stdout:8/206: write d3/dc/f22 [264732,4080] 0 2024-09-13T22:56:02.907 INFO:tasks.workunit.client.0.smithi002.stdout:9/247: fdatasync f0 0 2024-09-13T22:56:02.907 INFO:tasks.workunit.client.0.smithi002.stdout:4/178: creat d3/f3a x:0 0 0 2024-09-13T22:56:02.908 INFO:tasks.workunit.client.0.smithi002.stdout:0/197: dwrite d1/d4/f24 [0,4194304] 0 2024-09-13T22:56:02.908 INFO:tasks.workunit.client.0.smithi002.stdout:6/210: mkdir d12/d17/d28/d3e 0 2024-09-13T22:56:02.910 INFO:tasks.workunit.client.0.smithi002.stdout:3/261: dwrite d9/d15/f42 [0,4194304] 0 2024-09-13T22:56:02.912 INFO:tasks.workunit.client.0.smithi002.stdout:8/207: chown d3/f6 4442 1 2024-09-13T22:56:02.912 INFO:tasks.workunit.client.1.smithi047.stdout:7/367: truncate d0/d7/f3e 3497704 0 2024-09-13T22:56:02.913 INFO:tasks.workunit.client.0.smithi002.stdout:7/167: symlink d8/d9/l2f 0 2024-09-13T22:56:02.914 INFO:tasks.workunit.client.0.smithi002.stdout:4/179: write d3/d14/f1d [235540,76254] 0 2024-09-13T22:56:02.915 INFO:tasks.workunit.client.0.smithi002.stdout:8/208: chown d3/d27/d39 319 1 2024-09-13T22:56:02.915 INFO:tasks.workunit.client.0.smithi002.stdout:1/261: dwrite d1/d13/d1d/f29 [0,4194304] 0 2024-09-13T22:56:02.915 INFO:tasks.workunit.client.0.smithi002.stdout:7/168: chown f1 468741875 1 2024-09-13T22:56:02.917 INFO:tasks.workunit.client.1.smithi047.stdout:2/456: write d1/df/d1d/d20/d29/f52 [202469,95730] 0 2024-09-13T22:56:02.918 INFO:tasks.workunit.client.0.smithi002.stdout:4/180: dread - d3/d14/d29/d2a/f32 zero size 2024-09-13T22:56:02.918 INFO:tasks.workunit.client.1.smithi047.stdout:7/368: dread - d0/d7/f14 zero size 2024-09-13T22:56:02.920 INFO:tasks.workunit.client.1.smithi047.stdout:7/369: write d0/d7/f3d [4350695,30798] 0 2024-09-13T22:56:02.921 INFO:tasks.workunit.client.0.smithi002.stdout:2/191: sync 2024-09-13T22:56:02.923 INFO:tasks.workunit.client.0.smithi002.stdout:0/198: creat d1/d2/d10/d31/f41 x:0 0 0 2024-09-13T22:56:02.924 INFO:tasks.workunit.client.1.smithi047.stdout:2/457: creat d1/df/d26/f9c x:0 0 0 2024-09-13T22:56:02.926 INFO:tasks.workunit.client.0.smithi002.stdout:1/262: dwrite d1/d13/d1d/d2e/f37 [0,4194304] 0 2024-09-13T22:56:02.929 INFO:tasks.workunit.client.1.smithi047.stdout:7/370: rename d0/c3 to d0/db/c79 0 2024-09-13T22:56:02.937 INFO:tasks.workunit.client.0.smithi002.stdout:4/181: unlink d3/d14/d29/d2a/f32 0 2024-09-13T22:56:02.938 INFO:tasks.workunit.client.1.smithi047.stdout:2/458: unlink d1/df/d1d/d20/l21 0 2024-09-13T22:56:02.940 INFO:tasks.workunit.client.0.smithi002.stdout:5/199: write d1/d10/f35 [4439806,22819] 0 2024-09-13T22:56:02.940 INFO:tasks.workunit.client.0.smithi002.stdout:5/200: readlink d1/l1b 0 2024-09-13T22:56:02.941 INFO:tasks.workunit.client.1.smithi047.stdout:2/459: creat d1/df/d1d/d3c/f9d x:0 0 0 2024-09-13T22:56:02.943 INFO:tasks.workunit.client.0.smithi002.stdout:3/262: symlink d9/d15/d26/d44/d58/l62 0 2024-09-13T22:56:02.944 INFO:tasks.workunit.client.0.smithi002.stdout:8/209: mkdir d3/dc/d18/d2e/d40 0 2024-09-13T22:56:02.945 INFO:tasks.workunit.client.1.smithi047.stdout:2/460: chown d1/df/d1d/c38 181032 1 2024-09-13T22:56:02.950 INFO:tasks.workunit.client.1.smithi047.stdout:7/371: write d0/db/f30 [526485,17579] 0 2024-09-13T22:56:02.951 INFO:tasks.workunit.client.1.smithi047.stdout:2/461: dread d1/df/d1d/d20/d37/f39 [0,4194304] 0 2024-09-13T22:56:02.952 INFO:tasks.workunit.client.0.smithi002.stdout:4/182: truncate d3/d14/d25/f28 83528 0 2024-09-13T22:56:02.952 INFO:tasks.workunit.client.1.smithi047.stdout:7/372: write d0/d57/d5b/d5c/f45 [1844665,88310] 0 2024-09-13T22:56:02.953 INFO:tasks.workunit.client.1.smithi047.stdout:2/462: write d1/f97 [208031,32160] 0 2024-09-13T22:56:02.954 INFO:tasks.workunit.client.1.smithi047.stdout:2/463: dread - d1/df/d1d/d20/d29/f9b zero size 2024-09-13T22:56:02.954 INFO:tasks.workunit.client.0.smithi002.stdout:2/192: mkdir d1/d32/d37 0 2024-09-13T22:56:02.955 INFO:tasks.workunit.client.1.smithi047.stdout:1/285: sync 2024-09-13T22:56:02.958 INFO:tasks.workunit.client.0.smithi002.stdout:3/263: mknod d9/d15/d36/c63 0 2024-09-13T22:56:02.960 INFO:tasks.workunit.client.0.smithi002.stdout:3/264: write d9/d15/d26/f29 [1736080,126893] 0 2024-09-13T22:56:02.961 INFO:tasks.workunit.client.1.smithi047.stdout:1/286: dwrite d0/d7/d13/f3c [0,4194304] 0 2024-09-13T22:56:02.962 INFO:tasks.workunit.client.0.smithi002.stdout:8/210: write d3/dc/d18/f3c [459925,112778] 0 2024-09-13T22:56:02.962 INFO:tasks.workunit.client.0.smithi002.stdout:5/201: dwrite d1/d10/f21 [0,4194304] 0 2024-09-13T22:56:02.963 INFO:tasks.workunit.client.0.smithi002.stdout:8/211: fsync d3/f35 0 2024-09-13T22:56:02.964 INFO:tasks.workunit.client.0.smithi002.stdout:1/263: link d1/d13/d30/d31/d3b/f4b d1/d13/d30/f53 0 2024-09-13T22:56:02.966 INFO:tasks.workunit.client.0.smithi002.stdout:1/264: fsync d1/d13/d1d/d2e/f37 0 2024-09-13T22:56:02.966 INFO:tasks.workunit.client.0.smithi002.stdout:5/202: truncate d1/d2a/d41/d45/f48 53095 0 2024-09-13T22:56:02.968 INFO:tasks.workunit.client.0.smithi002.stdout:3/265: dread d9/d15/f24 [0,4194304] 0 2024-09-13T22:56:02.968 INFO:tasks.workunit.client.0.smithi002.stdout:1/265: read d1/d13/d30/f2f [1486729,126522] 0 2024-09-13T22:56:02.971 INFO:tasks.workunit.client.0.smithi002.stdout:6/211: rename d12/c3b to d12/d17/c3f 0 2024-09-13T22:56:02.972 INFO:tasks.workunit.client.1.smithi047.stdout:2/464: write d1/df/d1d/d20/f2c [1044563,63552] 0 2024-09-13T22:56:02.973 INFO:tasks.workunit.client.1.smithi047.stdout:2/465: chown d1/df/d1d/d20 3876 1 2024-09-13T22:56:02.974 INFO:tasks.workunit.client.1.smithi047.stdout:2/466: write d1/df/d1d/d20/f8f [813868,38118] 0 2024-09-13T22:56:02.975 INFO:tasks.workunit.client.0.smithi002.stdout:3/266: dwrite d9/d15/f2d [0,4194304] 0 2024-09-13T22:56:02.976 INFO:tasks.workunit.client.0.smithi002.stdout:3/267: write d9/d15/d51/f12 [5060095,120536] 0 2024-09-13T22:56:02.977 INFO:tasks.workunit.client.0.smithi002.stdout:2/193: symlink d1/d7/l38 0 2024-09-13T22:56:02.978 INFO:tasks.workunit.client.0.smithi002.stdout:3/268: chown d9/d3b/d53/l56 2394769 1 2024-09-13T22:56:02.991 INFO:tasks.workunit.client.0.smithi002.stdout:7/169: getdents d8/d9 0 2024-09-13T22:56:02.992 INFO:tasks.workunit.client.0.smithi002.stdout:8/212: dread d3/f6 [4194304,4194304] 0 2024-09-13T22:56:02.993 INFO:tasks.workunit.client.1.smithi047.stdout:2/467: creat d1/df/f9e x:0 0 0 2024-09-13T22:56:02.994 INFO:tasks.workunit.client.1.smithi047.stdout:1/287: getdents d0/d7 0 2024-09-13T22:56:02.995 INFO:tasks.workunit.client.1.smithi047.stdout:7/373: dwrite d0/d7/f3e [0,4194304] 0 2024-09-13T22:56:02.996 INFO:tasks.workunit.client.1.smithi047.stdout:2/468: fdatasync d1/df/d1d/d20/d54/f95 0 2024-09-13T22:56:02.996 INFO:tasks.workunit.client.1.smithi047.stdout:7/374: fsync d0/f29 0 2024-09-13T22:56:02.997 INFO:tasks.workunit.client.1.smithi047.stdout:2/469: dread - d1/df/d1d/d20/d29/f9b zero size 2024-09-13T22:56:02.999 INFO:tasks.workunit.client.1.smithi047.stdout:2/470: write d1/df/d1d/d20/d29/f2d [9282915,77577] 0 2024-09-13T22:56:03.001 INFO:tasks.workunit.client.0.smithi002.stdout:9/248: rename d8/d10/d1c/l1a to d8/d10/d1c/d3d/l54 0 2024-09-13T22:56:03.003 INFO:tasks.workunit.client.1.smithi047.stdout:8/352: sync 2024-09-13T22:56:03.003 INFO:tasks.workunit.client.1.smithi047.stdout:9/294: sync 2024-09-13T22:56:03.003 INFO:tasks.workunit.client.1.smithi047.stdout:6/318: sync 2024-09-13T22:56:03.003 INFO:tasks.workunit.client.1.smithi047.stdout:4/331: sync 2024-09-13T22:56:03.004 INFO:tasks.workunit.client.1.smithi047.stdout:3/390: sync 2024-09-13T22:56:03.004 INFO:tasks.workunit.client.1.smithi047.stdout:0/355: sync 2024-09-13T22:56:03.004 INFO:tasks.workunit.client.1.smithi047.stdout:5/288: sync 2024-09-13T22:56:03.004 INFO:tasks.workunit.client.0.smithi002.stdout:9/249: write d8/d10/d1c/f12 [3127351,14272] 0 2024-09-13T22:56:03.004 INFO:tasks.workunit.client.0.smithi002.stdout:6/212: dread f1 [0,4194304] 0 2024-09-13T22:56:03.004 INFO:tasks.workunit.client.0.smithi002.stdout:2/194: creat d1/d7/d8/d2c/f39 x:0 0 0 2024-09-13T22:56:03.005 INFO:tasks.workunit.client.1.smithi047.stdout:7/375: dwrite d0/d7/f3e [4194304,4194304] 0 2024-09-13T22:56:03.006 INFO:tasks.workunit.client.0.smithi002.stdout:8/213: dread - d3/f36 zero size 2024-09-13T22:56:03.006 INFO:tasks.workunit.client.0.smithi002.stdout:6/213: read d12/f22 [846077,9458] 0 2024-09-13T22:56:03.013 INFO:tasks.workunit.client.0.smithi002.stdout:6/214: dwrite d12/f14 [0,4194304] 0 2024-09-13T22:56:03.013 INFO:tasks.workunit.client.1.smithi047.stdout:9/295: dread d1/dc/d14/f17 [4194304,4194304] 0 2024-09-13T22:56:03.014 INFO:tasks.workunit.client.1.smithi047.stdout:8/353: mkdir d8/d36/d78 0 2024-09-13T22:56:03.017 INFO:tasks.workunit.client.1.smithi047.stdout:6/319: dread d3/d11/f3f [0,4194304] 0 2024-09-13T22:56:03.018 INFO:tasks.workunit.client.0.smithi002.stdout:9/250: write d8/d1e/f22 [1495776,28957] 0 2024-09-13T22:56:03.018 INFO:tasks.workunit.client.1.smithi047.stdout:0/356: mknod d1/d5/d16/d23/c7d 0 2024-09-13T22:56:03.021 INFO:tasks.workunit.client.1.smithi047.stdout:3/391: rename d0/d3/d4/d16/f53 to d0/d3/d4/d16/d32/d42/f83 0 2024-09-13T22:56:03.023 INFO:tasks.workunit.client.0.smithi002.stdout:5/203: creat d1/d10/f4b x:0 0 0 2024-09-13T22:56:03.023 INFO:tasks.workunit.client.0.smithi002.stdout:5/204: dread - d1/f43 zero size 2024-09-13T22:56:03.024 INFO:tasks.workunit.client.1.smithi047.stdout:9/296: symlink d1/l5e 0 2024-09-13T22:56:03.026 INFO:tasks.workunit.client.1.smithi047.stdout:4/332: dwrite dc/f19 [0,4194304] 0 2024-09-13T22:56:03.030 INFO:tasks.workunit.client.1.smithi047.stdout:3/392: creat d0/f84 x:0 0 0 2024-09-13T22:56:03.034 INFO:tasks.workunit.client.1.smithi047.stdout:9/297: dwrite d1/dc/d18/f33 [0,4194304] 0 2024-09-13T22:56:03.035 INFO:tasks.workunit.client.1.smithi047.stdout:4/333: mknod dc/d29/c75 0 2024-09-13T22:56:03.039 INFO:tasks.workunit.client.0.smithi002.stdout:9/251: dwrite d8/d1e/f27 [0,4194304] 0 2024-09-13T22:56:03.040 INFO:tasks.workunit.client.1.smithi047.stdout:3/393: mkdir d0/d25/d44/d43/d85 0 2024-09-13T22:56:03.043 INFO:tasks.workunit.client.0.smithi002.stdout:2/195: mkdir d1/d32/d37/d3a 0 2024-09-13T22:56:03.044 INFO:tasks.workunit.client.1.smithi047.stdout:9/298: mkdir d1/d5f 0 2024-09-13T22:56:03.045 INFO:tasks.workunit.client.0.smithi002.stdout:5/205: creat d1/d2a/f4c x:0 0 0 2024-09-13T22:56:03.048 INFO:tasks.workunit.client.1.smithi047.stdout:8/354: dread d8/fc [0,4194304] 0 2024-09-13T22:56:03.048 INFO:tasks.workunit.client.1.smithi047.stdout:7/376: rename d0/d7/da/d1e/f65 to d0/d7/f7a 0 2024-09-13T22:56:03.049 INFO:tasks.workunit.client.1.smithi047.stdout:6/320: rename d3/d11/d2b/d1c to d3/d11/d2b/d1c/d4d/d6e 22 2024-09-13T22:56:03.052 INFO:tasks.workunit.client.1.smithi047.stdout:6/321: write d3/d11/d2b/d4c/d30/d48/f4e [189884,5856] 0 2024-09-13T22:56:03.052 INFO:tasks.workunit.client.0.smithi002.stdout:4/183: rename d3/f18 to d3/d14/f3b 0 2024-09-13T22:56:03.054 INFO:tasks.workunit.client.0.smithi002.stdout:6/215: creat d12/d17/d28/d3e/f40 x:0 0 0 2024-09-13T22:56:03.056 INFO:tasks.workunit.client.0.smithi002.stdout:3/269: getdents d9/d15/d36/d4e 0 2024-09-13T22:56:03.056 INFO:tasks.workunit.client.1.smithi047.stdout:3/394: dread d0/d3/d4/d16/d2c/de/f80 [0,4194304] 0 2024-09-13T22:56:03.058 INFO:tasks.workunit.client.0.smithi002.stdout:9/252: chown d8/d1e/c29 537202 1 2024-09-13T22:56:03.060 INFO:tasks.workunit.client.0.smithi002.stdout:9/253: truncate d8/d1e/f36 2842135 0 2024-09-13T22:56:03.061 INFO:tasks.workunit.client.0.smithi002.stdout:9/254: write d8/d2c/f46 [744409,111271] 0 2024-09-13T22:56:03.062 INFO:tasks.workunit.client.0.smithi002.stdout:3/270: dwrite d9/d15/d36/f38 [0,4194304] 0 2024-09-13T22:56:03.063 INFO:tasks.workunit.client.0.smithi002.stdout:1/266: link d1/d13/d30/d31/d3d/c50 d1/c54 0 2024-09-13T22:56:03.064 INFO:tasks.workunit.client.1.smithi047.stdout:9/299: dread d1/dc/d14/f16 [0,4194304] 0 2024-09-13T22:56:03.066 INFO:tasks.workunit.client.0.smithi002.stdout:3/271: dread d9/d15/f2d [0,4194304] 0 2024-09-13T22:56:03.066 INFO:tasks.workunit.client.0.smithi002.stdout:3/272: write d9/d15/d51/f21 [811221,39935] 0 2024-09-13T22:56:03.068 INFO:tasks.workunit.client.0.smithi002.stdout:3/273: read d9/d15/d36/d4e/f50 [1886284,8168] 0 2024-09-13T22:56:03.071 INFO:tasks.workunit.client.1.smithi047.stdout:3/395: unlink d0/d3/d4/d16/d2c/de/d1f/d2e/f6f 0 2024-09-13T22:56:03.075 INFO:tasks.workunit.client.1.smithi047.stdout:0/357: rename d1/d5/d16/d23/c5d to d1/d5/d16/c7e 0 2024-09-13T22:56:03.077 INFO:tasks.workunit.client.0.smithi002.stdout:6/216: rmdir d12/d17/d28/d3e 39 2024-09-13T22:56:03.082 INFO:tasks.workunit.client.1.smithi047.stdout:7/377: getdents d0/d19 0 2024-09-13T22:56:03.083 INFO:tasks.workunit.client.1.smithi047.stdout:7/378: fsync d0/db/fc 0 2024-09-13T22:56:03.087 INFO:tasks.workunit.client.0.smithi002.stdout:3/274: creat d9/d3b/f64 x:0 0 0 2024-09-13T22:56:03.088 INFO:tasks.workunit.client.1.smithi047.stdout:7/379: symlink d0/d7/da/d1e/d51/l7b 0 2024-09-13T22:56:03.089 INFO:tasks.workunit.client.1.smithi047.stdout:6/322: rename d3/d11/d2b/d1c/f45 to d3/d11/d2b/f6f 0 2024-09-13T22:56:03.094 INFO:tasks.workunit.client.1.smithi047.stdout:0/358: rename d1/d5/d11/d6d to d1/d5/d16/d23/d45/d7f 0 2024-09-13T22:56:03.094 INFO:tasks.workunit.client.0.smithi002.stdout:0/199: sync 2024-09-13T22:56:03.095 INFO:tasks.workunit.client.0.smithi002.stdout:9/255: creat d8/d2c/d50/f55 x:0 0 0 2024-09-13T22:56:03.096 INFO:tasks.workunit.client.0.smithi002.stdout:9/256: truncate d8/d10/f17 490341 0 2024-09-13T22:56:03.096 INFO:tasks.workunit.client.1.smithi047.stdout:9/300: getdents d1/dc/d14/dd/d54/d50 0 2024-09-13T22:56:03.098 INFO:tasks.workunit.client.1.smithi047.stdout:6/323: mkdir d3/d11/d2b/d1c/d70 0 2024-09-13T22:56:03.099 INFO:tasks.workunit.client.0.smithi002.stdout:9/257: dread d8/d1e/f34 [0,4194304] 0 2024-09-13T22:56:03.100 INFO:tasks.workunit.client.1.smithi047.stdout:9/301: dread d1/f40 [0,4194304] 0 2024-09-13T22:56:03.102 INFO:tasks.workunit.client.0.smithi002.stdout:8/214: rename d3/dc/d18/d2e/d40 to d3/dc/d41 0 2024-09-13T22:56:03.105 INFO:tasks.workunit.client.1.smithi047.stdout:7/380: dwrite d0/d7/da/d4e/f4f [0,4194304] 0 2024-09-13T22:56:03.107 INFO:tasks.workunit.client.0.smithi002.stdout:2/196: getdents d1/d7 0 2024-09-13T22:56:03.109 INFO:tasks.workunit.client.1.smithi047.stdout:7/381: dread d0/d19/f2d [0,4194304] 0 2024-09-13T22:56:03.110 INFO:tasks.workunit.client.1.smithi047.stdout:7/382: chown d0/d19/f77 1 1 2024-09-13T22:56:03.112 INFO:tasks.workunit.client.0.smithi002.stdout:5/206: getdents d1/d2a/d41 0 2024-09-13T22:56:03.112 INFO:tasks.workunit.client.1.smithi047.stdout:0/359: write d1/d7/f44 [488322,129719] 0 2024-09-13T22:56:03.113 INFO:tasks.workunit.client.0.smithi002.stdout:5/207: write d1/f49 [971115,29045] 0 2024-09-13T22:56:03.114 INFO:tasks.workunit.client.0.smithi002.stdout:7/170: sync 2024-09-13T22:56:03.116 INFO:tasks.workunit.client.0.smithi002.stdout:1/267: link d1/d13/d1d/c1f d1/d13/d30/d31/d3d/c55 0 2024-09-13T22:56:03.117 INFO:tasks.workunit.client.0.smithi002.stdout:1/268: dread - d1/d13/d30/f53 zero size 2024-09-13T22:56:03.118 INFO:tasks.workunit.client.0.smithi002.stdout:3/275: rename d9/d15/d51/l17 to d9/d15/d26/d44/l65 0 2024-09-13T22:56:03.120 INFO:tasks.workunit.client.0.smithi002.stdout:4/184: getdents d3 0 2024-09-13T22:56:03.121 INFO:tasks.workunit.client.0.smithi002.stdout:9/258: dwrite d8/d10/d1c/d3d/f48 [0,4194304] 0 2024-09-13T22:56:03.121 INFO:tasks.workunit.client.0.smithi002.stdout:1/269: truncate d1/d13/d21/d39/f49 336300 0 2024-09-13T22:56:03.123 INFO:tasks.workunit.client.1.smithi047.stdout:7/383: rename d0/f20 to d0/d19/f7c 0 2024-09-13T22:56:03.124 INFO:tasks.workunit.client.1.smithi047.stdout:0/360: mknod d1/d5/d11/d2f/c80 0 2024-09-13T22:56:03.125 INFO:tasks.workunit.client.0.smithi002.stdout:0/200: mknod d1/d2/d10/d31/d3c/c42 0 2024-09-13T22:56:03.126 INFO:tasks.workunit.client.1.smithi047.stdout:6/324: rmdir d3/d11/d2b/d5c 0 2024-09-13T22:56:03.127 INFO:tasks.workunit.client.1.smithi047.stdout:9/302: getdents d1/dc/d14/dd/d54/d50 0 2024-09-13T22:56:03.130 INFO:tasks.workunit.client.0.smithi002.stdout:9/259: dread d8/d10/d1c/f12 [0,4194304] 0 2024-09-13T22:56:03.135 INFO:tasks.workunit.client.1.smithi047.stdout:0/361: creat d1/d7/f81 x:0 0 0 2024-09-13T22:56:03.135 INFO:tasks.workunit.client.1.smithi047.stdout:9/303: dwrite d1/dc/f47 [0,4194304] 0 2024-09-13T22:56:03.136 INFO:tasks.workunit.client.1.smithi047.stdout:0/362: readlink d1/d5/l75 0 2024-09-13T22:56:03.139 INFO:tasks.workunit.client.1.smithi047.stdout:6/325: creat d3/d11/d2b/d4c/d30/f71 x:0 0 0 2024-09-13T22:56:03.139 INFO:tasks.workunit.client.0.smithi002.stdout:6/217: link d12/l15 d12/d17/d28/d3e/l41 0 2024-09-13T22:56:03.140 INFO:tasks.workunit.client.1.smithi047.stdout:7/384: dread d0/d7/da/f34 [0,4194304] 0 2024-09-13T22:56:03.142 INFO:tasks.workunit.client.0.smithi002.stdout:5/208: dread d1/d10/f2d [0,4194304] 0 2024-09-13T22:56:03.144 INFO:tasks.workunit.client.1.smithi047.stdout:9/304: dwrite d1/dc/d18/f35 [0,4194304] 0 2024-09-13T22:56:03.144 INFO:tasks.workunit.client.1.smithi047.stdout:0/363: creat d1/d5/d11/d2f/f82 x:0 0 0 2024-09-13T22:56:03.145 INFO:tasks.workunit.client.1.smithi047.stdout:0/364: write d1/d7/fe [78180,115986] 0 2024-09-13T22:56:03.146 INFO:tasks.workunit.client.1.smithi047.stdout:6/326: creat d3/d11/d2b/d4c/d30/f72 x:0 0 0 2024-09-13T22:56:03.148 INFO:tasks.workunit.client.0.smithi002.stdout:0/201: creat d1/d2/d10/d31/d3c/f43 x:0 0 0 2024-09-13T22:56:03.149 INFO:tasks.workunit.client.1.smithi047.stdout:7/385: symlink d0/d7/da/d47/l7d 0 2024-09-13T22:56:03.153 INFO:tasks.workunit.client.0.smithi002.stdout:9/260: creat d8/d2c/f56 x:0 0 0 2024-09-13T22:56:03.155 INFO:tasks.workunit.client.0.smithi002.stdout:2/197: link d1/d7/l38 d1/l3b 0 2024-09-13T22:56:03.155 INFO:tasks.workunit.client.0.smithi002.stdout:0/202: dwrite d1/d4/f24 [0,4194304] 0 2024-09-13T22:56:03.156 INFO:tasks.workunit.client.0.smithi002.stdout:2/198: dread - d1/d7/d8/f1e zero size 2024-09-13T22:56:03.158 INFO:tasks.workunit.client.0.smithi002.stdout:6/218: symlink d12/d17/d2a/l42 0 2024-09-13T22:56:03.159 INFO:tasks.workunit.client.0.smithi002.stdout:1/270: symlink d1/d13/l56 0 2024-09-13T22:56:03.161 INFO:tasks.workunit.client.1.smithi047.stdout:0/365: mkdir d1/d5/d11/d83 0 2024-09-13T22:56:03.161 INFO:tasks.workunit.client.0.smithi002.stdout:2/199: dwrite d1/f5 [0,4194304] 0 2024-09-13T22:56:03.162 INFO:tasks.workunit.client.0.smithi002.stdout:5/209: creat d1/d2a/d41/f4d x:0 0 0 2024-09-13T22:56:03.167 INFO:tasks.workunit.client.1.smithi047.stdout:0/366: mkdir d1/d5/d16/d23/d45/d84 0 2024-09-13T22:56:03.169 INFO:tasks.workunit.client.1.smithi047.stdout:9/305: dwrite d1/f40 [4194304,4194304] 0 2024-09-13T22:56:03.170 INFO:tasks.workunit.client.0.smithi002.stdout:8/215: rename d3/dc/d16/f3e to d3/dc/f42 0 2024-09-13T22:56:03.178 INFO:tasks.workunit.client.1.smithi047.stdout:0/367: write d1/d5/d11/d52/f72 [5034871,106721] 0 2024-09-13T22:56:03.179 INFO:tasks.workunit.client.1.smithi047.stdout:9/306: dwrite d1/f40 [0,4194304] 0 2024-09-13T22:56:03.180 INFO:tasks.workunit.client.1.smithi047.stdout:6/327: truncate d3/d11/d2b/d4c/d30/f44 3930832 0 2024-09-13T22:56:03.183 INFO:tasks.workunit.client.1.smithi047.stdout:6/328: write d3/d11/d2b/d4c/d30/f71 [602809,136] 0 2024-09-13T22:56:03.184 INFO:tasks.workunit.client.0.smithi002.stdout:0/203: dread d1/fa [0,4194304] 0 2024-09-13T22:56:03.185 INFO:tasks.workunit.client.1.smithi047.stdout:7/386: getdents d0/d7/da/d4e 0 2024-09-13T22:56:03.187 INFO:tasks.workunit.client.0.smithi002.stdout:2/200: symlink d1/l3c 0 2024-09-13T22:56:03.189 INFO:tasks.workunit.client.1.smithi047.stdout:9/307: mkdir d1/dc/d14/dd/d54/d50/d60 0 2024-09-13T22:56:03.191 INFO:tasks.workunit.client.1.smithi047.stdout:6/329: mknod d3/d11/d2b/d1c/d4d/c73 0 2024-09-13T22:56:03.192 INFO:tasks.workunit.client.1.smithi047.stdout:6/330: chown d3/d11/d2b/d4c/f36 582282 1 2024-09-13T22:56:03.200 INFO:tasks.workunit.client.1.smithi047.stdout:9/308: write d1/dc/d14/f13 [807140,14635] 0 2024-09-13T22:56:03.201 INFO:tasks.workunit.client.1.smithi047.stdout:6/331: write d3/d11/d2b/d1c/f2e [2523536,127321] 0 2024-09-13T22:56:03.204 INFO:tasks.workunit.client.1.smithi047.stdout:7/387: dread d0/d7/f1d [0,4194304] 0 2024-09-13T22:56:03.205 INFO:tasks.workunit.client.1.smithi047.stdout:9/309: unlink d1/d2d/l58 0 2024-09-13T22:56:03.205 INFO:tasks.workunit.client.1.smithi047.stdout:7/388: write d0/d7/da/d2e/d64/f6a [279893,16628] 0 2024-09-13T22:56:03.207 INFO:tasks.workunit.client.1.smithi047.stdout:7/389: write d0/d7/da/d4e/f66 [1766721,117503] 0 2024-09-13T22:56:03.208 INFO:tasks.workunit.client.1.smithi047.stdout:7/390: write d0/d7/f4a [1760423,6713] 0 2024-09-13T22:56:03.214 INFO:tasks.workunit.client.1.smithi047.stdout:7/391: link d0/d7/da/f2b d0/db/f7e 0 2024-09-13T22:56:03.214 INFO:tasks.workunit.client.1.smithi047.stdout:7/392: chown d0/d19/c42 483 1 2024-09-13T22:56:03.214 INFO:tasks.workunit.client.1.smithi047.stdout:6/332: truncate d3/d11/d2b/d4c/d30/f47 1402963 0 2024-09-13T22:56:03.216 INFO:tasks.workunit.client.1.smithi047.stdout:7/393: write d0/d7/da/d1e/f24 [1431926,4343] 0 2024-09-13T22:56:03.219 INFO:tasks.workunit.client.1.smithi047.stdout:9/310: dread d1/dc/d18/f48 [0,4194304] 0 2024-09-13T22:56:03.221 INFO:tasks.workunit.client.1.smithi047.stdout:9/311: write d1/dc/f15 [708512,40880] 0 2024-09-13T22:56:03.222 INFO:tasks.workunit.client.1.smithi047.stdout:6/333: dwrite d3/d11/f40 [4194304,4194304] 0 2024-09-13T22:56:03.227 INFO:tasks.workunit.client.1.smithi047.stdout:6/334: mkdir d3/d11/d74 0 2024-09-13T22:56:03.230 INFO:tasks.workunit.client.1.smithi047.stdout:9/312: link d1/dc/d14/dd/d54/l38 d1/dc/l61 0 2024-09-13T22:56:03.233 INFO:tasks.workunit.client.1.smithi047.stdout:7/394: dread d0/db/f7e [0,4194304] 0 2024-09-13T22:56:03.235 INFO:tasks.workunit.client.1.smithi047.stdout:9/313: dread d1/dc/d18/f48 [0,4194304] 0 2024-09-13T22:56:03.238 INFO:tasks.workunit.client.1.smithi047.stdout:9/314: mknod d1/dc/d14/dd/c62 0 2024-09-13T22:56:03.239 INFO:tasks.workunit.client.1.smithi047.stdout:7/395: dread d0/d7/f2c [0,4194304] 0 2024-09-13T22:56:03.240 INFO:tasks.workunit.client.1.smithi047.stdout:9/315: dread - d1/dc/d14/dd/f3e zero size 2024-09-13T22:56:03.241 INFO:tasks.workunit.client.1.smithi047.stdout:9/316: dread - d1/d2d/f56 zero size 2024-09-13T22:56:03.241 INFO:tasks.workunit.client.0.smithi002.stdout:5/210: mknod d1/d2a/d41/c4e 0 2024-09-13T22:56:03.242 INFO:tasks.workunit.client.1.smithi047.stdout:7/396: creat d0/d19/f7f x:0 0 0 2024-09-13T22:56:03.243 INFO:tasks.workunit.client.0.smithi002.stdout:8/216: dread - d3/dc/f42 zero size 2024-09-13T22:56:03.243 INFO:tasks.workunit.client.0.smithi002.stdout:3/276: getdents d9/d15/d35 0 2024-09-13T22:56:03.243 INFO:tasks.workunit.client.0.smithi002.stdout:0/204: symlink d1/d2/l44 0 2024-09-13T22:56:03.244 INFO:tasks.workunit.client.0.smithi002.stdout:2/201: rmdir d1/d7/d8 39 2024-09-13T22:56:03.245 INFO:tasks.workunit.client.0.smithi002.stdout:3/277: write d9/d15/f2f [4608856,76007] 0 2024-09-13T22:56:03.246 INFO:tasks.workunit.client.0.smithi002.stdout:2/202: chown d1/f1d 11581 1 2024-09-13T22:56:03.248 INFO:tasks.workunit.client.1.smithi047.stdout:7/397: mknod d0/d57/d5b/d5c/c80 0 2024-09-13T22:56:03.248 INFO:tasks.workunit.client.1.smithi047.stdout:6/335: write d3/d11/d2b/d4c/f36 [1009526,126034] 0 2024-09-13T22:56:03.253 INFO:tasks.workunit.client.0.smithi002.stdout:3/278: dread - d9/d15/d46/f5f zero size 2024-09-13T22:56:03.253 INFO:tasks.workunit.client.0.smithi002.stdout:5/211: dwrite d1/f3f [0,4194304] 0 2024-09-13T22:56:03.253 INFO:tasks.workunit.client.0.smithi002.stdout:6/219: link d12/d17/f33 d12/f43 0 2024-09-13T22:56:03.253 INFO:tasks.workunit.client.1.smithi047.stdout:7/398: chown d0/d7/da/l46 956321 1 2024-09-13T22:56:03.254 INFO:tasks.workunit.client.0.smithi002.stdout:8/217: dwrite d3/dc/fe [0,4194304] 0 2024-09-13T22:56:03.254 INFO:tasks.workunit.client.1.smithi047.stdout:9/317: rename d1/dc/d14/dd/c62 to d1/dc/d14/c63 0 2024-09-13T22:56:03.257 INFO:tasks.workunit.client.0.smithi002.stdout:0/205: creat d1/d2/f45 x:0 0 0 2024-09-13T22:56:03.257 INFO:tasks.workunit.client.0.smithi002.stdout:2/203: dwrite d1/f1f [4194304,4194304] 0 2024-09-13T22:56:03.259 INFO:tasks.workunit.client.0.smithi002.stdout:0/206: stat d1/d2/f27 0 2024-09-13T22:56:03.261 INFO:tasks.workunit.client.0.smithi002.stdout:7/171: rename l3 to d8/l30 0 2024-09-13T22:56:03.263 INFO:tasks.workunit.client.1.smithi047.stdout:6/336: rename d3/f9 to d3/d11/d2b/d1c/d70/f75 0 2024-09-13T22:56:03.268 INFO:tasks.workunit.client.0.smithi002.stdout:5/212: mkdir d1/d2a/d41/d45/d4f 0 2024-09-13T22:56:03.270 INFO:tasks.workunit.client.0.smithi002.stdout:6/220: creat d12/d17/d28/d3e/f44 x:0 0 0 2024-09-13T22:56:03.271 INFO:tasks.workunit.client.0.smithi002.stdout:4/185: sync 2024-09-13T22:56:03.271 INFO:tasks.workunit.client.0.smithi002.stdout:6/221: fsync d12/f23 0 2024-09-13T22:56:03.275 INFO:tasks.workunit.client.1.smithi047.stdout:6/337: mkdir d3/d11/d2b/d76 0 2024-09-13T22:56:03.277 INFO:tasks.workunit.client.0.smithi002.stdout:2/204: truncate d1/d7/d8/f31 746744 0 2024-09-13T22:56:03.279 INFO:tasks.workunit.client.1.smithi047.stdout:7/399: rename d0/d19/f62 to d0/f81 0 2024-09-13T22:56:03.280 INFO:tasks.workunit.client.0.smithi002.stdout:0/207: creat d1/d2/d10/d31/f46 x:0 0 0 2024-09-13T22:56:03.284 INFO:tasks.workunit.client.0.smithi002.stdout:9/261: rename d8/c14 to d8/d10/d1c/d3d/c57 0 2024-09-13T22:56:03.286 INFO:tasks.workunit.client.0.smithi002.stdout:7/172: mknod d8/d10/d11/d13/d26/c31 0 2024-09-13T22:56:03.287 INFO:tasks.workunit.client.0.smithi002.stdout:7/173: chown d8/d10/d11/d13/l18 2604 1 2024-09-13T22:56:03.288 INFO:tasks.workunit.client.1.smithi047.stdout:6/338: mkdir d3/d77 0 2024-09-13T22:56:03.292 INFO:tasks.workunit.client.0.smithi002.stdout:5/213: rmdir d1 39 2024-09-13T22:56:03.298 INFO:tasks.workunit.client.0.smithi002.stdout:4/186: symlink d3/d14/d29/l3c 0 2024-09-13T22:56:03.298 INFO:tasks.workunit.client.0.smithi002.stdout:4/187: chown d3/c35 16526252 1 2024-09-13T22:56:03.300 INFO:tasks.workunit.client.1.smithi047.stdout:7/400: write d0/db/f16 [2841214,23469] 0 2024-09-13T22:56:03.301 INFO:tasks.workunit.client.0.smithi002.stdout:0/208: creat d1/d2/d10/d31/d3c/f47 x:0 0 0 2024-09-13T22:56:03.302 INFO:tasks.workunit.client.1.smithi047.stdout:6/339: getdents d3/d11/d2b/d4c/d30/d48 0 2024-09-13T22:56:03.303 INFO:tasks.workunit.client.0.smithi002.stdout:8/218: write d3/f5 [4021985,74873] 0 2024-09-13T22:56:03.303 INFO:tasks.workunit.client.0.smithi002.stdout:9/262: readlink d8/d1e/l3b 0 2024-09-13T22:56:03.305 INFO:tasks.workunit.client.0.smithi002.stdout:8/219: write d3/dc/d18/f23 [2712183,22193] 0 2024-09-13T22:56:03.305 INFO:tasks.workunit.client.0.smithi002.stdout:3/279: creat d9/f66 x:0 0 0 2024-09-13T22:56:03.307 INFO:tasks.workunit.client.0.smithi002.stdout:3/280: read d9/d15/d26/f29 [2330933,21683] 0 2024-09-13T22:56:03.308 INFO:tasks.workunit.client.1.smithi047.stdout:6/340: symlink d3/d11/d2b/d1c/d4d/d69/l78 0 2024-09-13T22:56:03.308 INFO:tasks.workunit.client.0.smithi002.stdout:6/222: symlink d12/l45 0 2024-09-13T22:56:03.309 INFO:tasks.workunit.client.1.smithi047.stdout:7/401: link d0/d19/f77 d0/d19/f82 0 2024-09-13T22:56:03.309 INFO:tasks.workunit.client.0.smithi002.stdout:8/220: dread d3/f20 [0,4194304] 0 2024-09-13T22:56:03.310 INFO:tasks.workunit.client.0.smithi002.stdout:4/188: unlink d3/d14/f3b 0 2024-09-13T22:56:03.311 INFO:tasks.workunit.client.0.smithi002.stdout:3/281: dread d9/d15/f30 [0,4194304] 0 2024-09-13T22:56:03.313 INFO:tasks.workunit.client.0.smithi002.stdout:0/209: unlink d1/d2/l44 0 2024-09-13T22:56:03.314 INFO:tasks.workunit.client.0.smithi002.stdout:1/271: sync 2024-09-13T22:56:03.314 INFO:tasks.workunit.client.0.smithi002.stdout:3/282: dread d9/d15/d26/f32 [0,4194304] 0 2024-09-13T22:56:03.316 INFO:tasks.workunit.client.0.smithi002.stdout:9/263: creat d8/d2c/f58 x:0 0 0 2024-09-13T22:56:03.316 INFO:tasks.workunit.client.0.smithi002.stdout:0/210: write d1/d2/f29 [122727,80240] 0 2024-09-13T22:56:03.317 INFO:tasks.workunit.client.0.smithi002.stdout:1/272: read d1/ff [1049805,35462] 0 2024-09-13T22:56:03.317 INFO:tasks.workunit.client.0.smithi002.stdout:3/283: read d9/d15/f2d [139522,69510] 0 2024-09-13T22:56:03.317 INFO:tasks.workunit.client.1.smithi047.stdout:6/341: rename d3/d11/c35 to d3/d11/d2b/c79 0 2024-09-13T22:56:03.319 INFO:tasks.workunit.client.0.smithi002.stdout:4/189: dwrite d3/f23 [0,4194304] 0 2024-09-13T22:56:03.320 INFO:tasks.workunit.client.1.smithi047.stdout:7/402: dread d0/d19/f82 [0,4194304] 0 2024-09-13T22:56:03.322 INFO:tasks.workunit.client.1.smithi047.stdout:6/342: mknod d3/d11/d2b/d1c/d4d/c7a 0 2024-09-13T22:56:03.323 INFO:tasks.workunit.client.0.smithi002.stdout:0/211: dread d1/f17 [0,4194304] 0 2024-09-13T22:56:03.323 INFO:tasks.workunit.client.0.smithi002.stdout:0/212: chown d1/d2/l3 1 1 2024-09-13T22:56:03.324 INFO:tasks.workunit.client.0.smithi002.stdout:6/223: write d12/d17/f20 [237233,30908] 0 2024-09-13T22:56:03.325 INFO:tasks.workunit.client.0.smithi002.stdout:6/224: fdatasync d12/f14 0 2024-09-13T22:56:03.329 INFO:tasks.workunit.client.0.smithi002.stdout:8/221: mknod d3/d27/d39/c43 0 2024-09-13T22:56:03.329 INFO:tasks.workunit.client.0.smithi002.stdout:8/222: chown d3/dc/d18/l2a 3506844 1 2024-09-13T22:56:03.330 INFO:tasks.workunit.client.1.smithi047.stdout:6/343: dwrite d3/d11/d2b/d1c/d4d/d69/f6d [0,4194304] 0 2024-09-13T22:56:03.330 INFO:tasks.workunit.client.0.smithi002.stdout:8/223: readlink d3/l12 0 2024-09-13T22:56:03.331 INFO:tasks.workunit.client.1.smithi047.stdout:6/344: readlink d3/d11/d2b/d1c/d4d/d69/l78 0 2024-09-13T22:56:03.332 INFO:tasks.workunit.client.1.smithi047.stdout:6/345: chown d3/d11/d2b/d4c/d30/f71 17731131 1 2024-09-13T22:56:03.333 INFO:tasks.workunit.client.0.smithi002.stdout:2/205: rename d1/la to d1/d7/l3d 0 2024-09-13T22:56:03.340 INFO:tasks.workunit.client.1.smithi047.stdout:6/346: creat d3/d11/f7b x:0 0 0 2024-09-13T22:56:03.342 INFO:tasks.workunit.client.1.smithi047.stdout:7/403: dwrite d0/d19/f2d [0,4194304] 0 2024-09-13T22:56:03.344 INFO:tasks.workunit.client.0.smithi002.stdout:4/190: creat d3/f3d x:0 0 0 2024-09-13T22:56:03.345 INFO:tasks.workunit.client.0.smithi002.stdout:4/191: write d3/f23 [3039828,106976] 0 2024-09-13T22:56:03.348 INFO:tasks.workunit.client.0.smithi002.stdout:5/214: unlink d1/c2b 0 2024-09-13T22:56:03.350 INFO:tasks.workunit.client.1.smithi047.stdout:6/347: mkdir d3/d11/d2b/d7c 0 2024-09-13T22:56:03.351 INFO:tasks.workunit.client.1.smithi047.stdout:6/348: fsync d3/d11/d2b/d4c/d30/f71 0 2024-09-13T22:56:03.352 INFO:tasks.workunit.client.1.smithi047.stdout:7/404: mknod d0/d7/c83 0 2024-09-13T22:56:03.353 INFO:tasks.workunit.client.1.smithi047.stdout:6/349: chown d3/d11/d2b/d1c/d23 1 1 2024-09-13T22:56:03.357 INFO:tasks.workunit.client.1.smithi047.stdout:6/350: creat d3/d11/d2b/d4c/d30/d48/f7d x:0 0 0 2024-09-13T22:56:03.361 INFO:tasks.workunit.client.1.smithi047.stdout:6/351: creat d3/d11/d2b/d4c/d30/d48/f7e x:0 0 0 2024-09-13T22:56:03.361 INFO:tasks.workunit.client.0.smithi002.stdout:7/174: getdents d8/d10/d11/d13/d26 0 2024-09-13T22:56:03.362 INFO:tasks.workunit.client.1.smithi047.stdout:6/352: fdatasync d3/d11/d2b/d4c/d30/f37 0 2024-09-13T22:56:03.362 INFO:tasks.workunit.client.0.smithi002.stdout:7/175: chown f7 199070 1 2024-09-13T22:56:03.362 INFO:tasks.workunit.client.1.smithi047.stdout:7/405: getdents d0/d7/da/d1e/d51 0 2024-09-13T22:56:03.367 INFO:tasks.workunit.client.1.smithi047.stdout:6/353: mknod d3/d11/d2b/d4c/d30/c7f 0 2024-09-13T22:56:03.367 INFO:tasks.workunit.client.0.smithi002.stdout:0/213: dread d1/d4/f7 [0,4194304] 0 2024-09-13T22:56:03.369 INFO:tasks.workunit.client.1.smithi047.stdout:7/406: mknod d0/d7/da/d1e/d51/c84 0 2024-09-13T22:56:03.369 INFO:tasks.workunit.client.1.smithi047.stdout:7/407: readlink d0/d7/da/d1e/d51/l7b 0 2024-09-13T22:56:03.371 INFO:tasks.workunit.client.1.smithi047.stdout:6/354: chown d3/d11/d2b/c79 29 1 2024-09-13T22:56:03.377 INFO:tasks.workunit.client.1.smithi047.stdout:6/355: dread d3/ff [0,4194304] 0 2024-09-13T22:56:03.378 INFO:tasks.workunit.client.0.smithi002.stdout:6/225: fsync d12/f21 0 2024-09-13T22:56:03.379 INFO:tasks.workunit.client.1.smithi047.stdout:7/408: dwrite d0/d7/da/d2e/f4b [0,4194304] 0 2024-09-13T22:56:03.380 INFO:tasks.workunit.client.0.smithi002.stdout:6/226: read d12/f24 [3261994,123569] 0 2024-09-13T22:56:03.381 INFO:tasks.workunit.client.0.smithi002.stdout:9/264: truncate d8/d10/d1c/f12 1117138 0 2024-09-13T22:56:03.382 INFO:tasks.workunit.client.1.smithi047.stdout:6/356: unlink d3/l3b 0 2024-09-13T22:56:03.384 INFO:tasks.workunit.client.0.smithi002.stdout:3/284: truncate d9/d15/d26/f32 397642 0 2024-09-13T22:56:03.385 INFO:tasks.workunit.client.1.smithi047.stdout:7/409: mknod d0/d7/da/d2e/c85 0 2024-09-13T22:56:03.387 INFO:tasks.workunit.client.1.smithi047.stdout:6/357: dread d3/d11/f40 [4194304,4194304] 0 2024-09-13T22:56:03.388 INFO:tasks.workunit.client.0.smithi002.stdout:7/176: unlink f6 0 2024-09-13T22:56:03.389 INFO:tasks.workunit.client.0.smithi002.stdout:3/285: dread d9/d15/d51/f1d [0,4194304] 0 2024-09-13T22:56:03.391 INFO:tasks.workunit.client.0.smithi002.stdout:0/214: rename d1/d2/f27 to d1/d2/d10/d31/d3c/f48 0 2024-09-13T22:56:03.391 INFO:tasks.workunit.client.0.smithi002.stdout:3/286: write d9/d15/d51/f1d [1770236,122452] 0 2024-09-13T22:56:03.392 INFO:tasks.workunit.client.0.smithi002.stdout:2/206: truncate d1/d7/d8/f31 269490 0 2024-09-13T22:56:03.393 INFO:tasks.workunit.client.0.smithi002.stdout:2/207: chown d1/d7/d8/l11 74844739 1 2024-09-13T22:56:03.394 INFO:tasks.workunit.client.0.smithi002.stdout:2/208: dread - d1/d7/d8/f27 zero size 2024-09-13T22:56:03.395 INFO:tasks.workunit.client.0.smithi002.stdout:2/209: readlink d1/l24 0 2024-09-13T22:56:03.396 INFO:tasks.workunit.client.0.smithi002.stdout:2/210: write d1/d7/d8/f17 [1275921,112198] 0 2024-09-13T22:56:03.397 INFO:tasks.workunit.client.0.smithi002.stdout:3/287: dread d9/d15/d35/f3a [0,4194304] 0 2024-09-13T22:56:03.398 INFO:tasks.workunit.client.1.smithi047.stdout:6/358: creat d3/d11/d2b/d4c/f80 x:0 0 0 2024-09-13T22:56:03.399 INFO:tasks.workunit.client.0.smithi002.stdout:6/227: mknod d12/d17/d28/d3e/c46 0 2024-09-13T22:56:03.399 INFO:tasks.workunit.client.0.smithi002.stdout:6/228: readlink lf 0 2024-09-13T22:56:03.400 INFO:tasks.workunit.client.1.smithi047.stdout:7/410: link d0/d19/f7f d0/d7/da/d1e/f86 0 2024-09-13T22:56:03.401 INFO:tasks.workunit.client.0.smithi002.stdout:8/224: link d3/d27/f32 d3/d21/f44 0 2024-09-13T22:56:03.402 INFO:tasks.workunit.client.0.smithi002.stdout:2/211: dwrite d1/f15 [0,4194304] 0 2024-09-13T22:56:03.411 INFO:tasks.workunit.client.1.smithi047.stdout:6/359: creat d3/d11/f81 x:0 0 0 2024-09-13T22:56:03.414 INFO:tasks.workunit.client.1.smithi047.stdout:7/411: rename d0/d57/d5b/d5c/f45 to d0/d7/f87 0 2024-09-13T22:56:03.415 INFO:tasks.workunit.client.1.smithi047.stdout:7/412: read - d0/d7/f15 zero size 2024-09-13T22:56:03.415 INFO:tasks.workunit.client.0.smithi002.stdout:0/215: mkdir d1/d2/d49 0 2024-09-13T22:56:03.419 INFO:tasks.workunit.client.1.smithi047.stdout:7/413: mknod d0/d7/da/d2e/d37/c88 0 2024-09-13T22:56:03.426 INFO:tasks.workunit.client.1.smithi047.stdout:6/360: dread d3/d11/d2b/f28 [0,4194304] 0 2024-09-13T22:56:03.427 INFO:tasks.workunit.client.0.smithi002.stdout:6/229: symlink d12/d17/d34/d39/l47 0 2024-09-13T22:56:03.430 INFO:tasks.workunit.client.1.smithi047.stdout:7/414: rename d0/d57/d5b/d5c/c39 to d0/d7/da/c89 0 2024-09-13T22:56:03.431 INFO:tasks.workunit.client.1.smithi047.stdout:7/415: write d0/d7/da/d4e/f66 [2065135,106926] 0 2024-09-13T22:56:03.432 INFO:tasks.workunit.client.0.smithi002.stdout:6/230: dread d12/f1c [4194304,4194304] 0 2024-09-13T22:56:03.432 INFO:tasks.workunit.client.0.smithi002.stdout:6/231: readlink lc 0 2024-09-13T22:56:03.434 INFO:tasks.workunit.client.0.smithi002.stdout:3/288: write f5 [2448880,95142] 0 2024-09-13T22:56:03.437 INFO:tasks.workunit.client.1.smithi047.stdout:7/416: rename d0/db/f73 to d0/d57/d5b/f8a 0 2024-09-13T22:56:03.440 INFO:tasks.workunit.client.1.smithi047.stdout:6/361: dwrite d3/d11/d2b/f6f [0,4194304] 0 2024-09-13T22:56:03.441 INFO:tasks.workunit.client.1.smithi047.stdout:6/362: chown d3/d11/d2b/c79 935467550 1 2024-09-13T22:56:03.442 INFO:tasks.workunit.client.0.smithi002.stdout:0/216: symlink d1/d2/l4a 0 2024-09-13T22:56:03.443 INFO:tasks.workunit.client.0.smithi002.stdout:1/273: sync 2024-09-13T22:56:03.444 INFO:tasks.workunit.client.0.smithi002.stdout:1/274: chown d1/f4d 2 1 2024-09-13T22:56:03.446 INFO:tasks.workunit.client.1.smithi047.stdout:6/363: unlink d3/ld 0 2024-09-13T22:56:03.449 INFO:tasks.workunit.client.0.smithi002.stdout:4/192: getdents d3/d14 0 2024-09-13T22:56:03.449 INFO:tasks.workunit.client.0.smithi002.stdout:4/193: chown d3/d14/d25/f28 0 1 2024-09-13T22:56:03.450 INFO:tasks.workunit.client.0.smithi002.stdout:4/194: write d3/f1e [2098243,47606] 0 2024-09-13T22:56:03.451 INFO:tasks.workunit.client.0.smithi002.stdout:2/212: mkdir d1/d7/d35/d3e 0 2024-09-13T22:56:03.453 INFO:tasks.workunit.client.1.smithi047.stdout:6/364: dread d3/f2f [0,4194304] 0 2024-09-13T22:56:03.454 INFO:tasks.workunit.client.0.smithi002.stdout:2/213: write d1/f14 [4377088,10181] 0 2024-09-13T22:56:03.457 INFO:tasks.workunit.client.0.smithi002.stdout:3/289: rename d9/d15/f24 to d9/d3b/f67 0 2024-09-13T22:56:03.461 INFO:tasks.workunit.client.0.smithi002.stdout:9/265: rmdir d8/d1e/d4e 0 2024-09-13T22:56:03.461 INFO:tasks.workunit.client.0.smithi002.stdout:2/214: truncate d1/d7/d8/f27 871106 0 2024-09-13T22:56:03.461 INFO:tasks.workunit.client.0.smithi002.stdout:3/290: dread - d9/d15/d46/f5f zero size 2024-09-13T22:56:03.462 INFO:tasks.workunit.client.0.smithi002.stdout:4/195: dwrite d3/d14/f1f [0,4194304] 0 2024-09-13T22:56:03.462 INFO:tasks.workunit.client.0.smithi002.stdout:8/225: link d3/l1e d3/d21/l45 0 2024-09-13T22:56:03.463 INFO:tasks.workunit.client.0.smithi002.stdout:4/196: write d3/d14/d29/d2a/f2d [698250,20654] 0 2024-09-13T22:56:03.464 INFO:tasks.workunit.client.0.smithi002.stdout:5/215: sync 2024-09-13T22:56:03.467 INFO:tasks.workunit.client.0.smithi002.stdout:7/177: truncate f1 3797186 0 2024-09-13T22:56:03.469 INFO:tasks.workunit.client.0.smithi002.stdout:0/217: rename d1 to d1/d4b 22 2024-09-13T22:56:03.470 INFO:tasks.workunit.client.0.smithi002.stdout:1/275: getdents d1/d13/d21/d40 0 2024-09-13T22:56:03.474 INFO:tasks.workunit.client.0.smithi002.stdout:8/226: mkdir d3/dc/d18/d2e/d46 0 2024-09-13T22:56:03.475 INFO:tasks.workunit.client.0.smithi002.stdout:6/232: creat d12/d17/f48 x:0 0 0 2024-09-13T22:56:03.476 INFO:tasks.workunit.client.0.smithi002.stdout:5/216: fdatasync d1/f3 0 2024-09-13T22:56:03.478 INFO:tasks.workunit.client.0.smithi002.stdout:4/197: rmdir d3/d14/d29/d2a 39 2024-09-13T22:56:03.478 INFO:tasks.workunit.client.0.smithi002.stdout:4/198: truncate d3/d14/f26 225066 0 2024-09-13T22:56:03.481 INFO:tasks.workunit.client.0.smithi002.stdout:7/178: fdatasync f7 0 2024-09-13T22:56:03.483 INFO:tasks.workunit.client.0.smithi002.stdout:0/218: mknod d1/d2/c4c 0 2024-09-13T22:56:03.490 INFO:tasks.workunit.client.1.smithi047.stdout:6/365: dwrite d3/d11/d2b/d4c/d30/f44 [0,4194304] 0 2024-09-13T22:56:03.492 INFO:tasks.workunit.client.0.smithi002.stdout:2/215: write d1/d7/d8/f1b [2018392,107362] 0 2024-09-13T22:56:03.493 INFO:tasks.workunit.client.0.smithi002.stdout:2/216: dread - d1/d7/d8/f33 zero size 2024-09-13T22:56:03.495 INFO:tasks.workunit.client.0.smithi002.stdout:0/219: mknod d1/d2/d10/d31/d32/c4d 0 2024-09-13T22:56:03.496 INFO:tasks.workunit.client.0.smithi002.stdout:0/220: write d1/d2/d10/d31/d32/f39 [536013,110131] 0 2024-09-13T22:56:03.497 INFO:tasks.workunit.client.0.smithi002.stdout:3/291: creat d9/f68 x:0 0 0 2024-09-13T22:56:03.499 INFO:tasks.workunit.client.0.smithi002.stdout:0/221: write d1/d2/d10/d31/f46 [738139,109768] 0 2024-09-13T22:56:03.500 INFO:tasks.workunit.client.0.smithi002.stdout:6/233: write d12/f21 [315206,94125] 0 2024-09-13T22:56:03.501 INFO:tasks.workunit.client.1.smithi047.stdout:1/288: sync 2024-09-13T22:56:03.501 INFO:tasks.workunit.client.1.smithi047.stdout:2/471: sync 2024-09-13T22:56:03.502 INFO:tasks.workunit.client.0.smithi002.stdout:6/234: truncate d12/d17/f20 469639 0 2024-09-13T22:56:03.503 INFO:tasks.workunit.client.0.smithi002.stdout:4/199: mknod d3/d14/d29/d2a/d30/c3e 0 2024-09-13T22:56:03.504 INFO:tasks.workunit.client.1.smithi047.stdout:2/472: truncate d1/df/d1d/d20/f2c 1838047 0 2024-09-13T22:56:03.506 INFO:tasks.workunit.client.1.smithi047.stdout:6/366: truncate d3/d11/d2b/d4c/d30/f37 682963 0 2024-09-13T22:56:03.507 INFO:tasks.workunit.client.0.smithi002.stdout:7/179: rename d8/d10/f15 to d8/d10/f32 0 2024-09-13T22:56:03.509 INFO:tasks.workunit.client.0.smithi002.stdout:9/266: rename d8/d2c/d50/f55 to d8/d10/f59 0 2024-09-13T22:56:03.510 INFO:tasks.workunit.client.1.smithi047.stdout:6/367: write d3/d11/d2b/d4c/d30/f5d [1755842,88503] 0 2024-09-13T22:56:03.511 INFO:tasks.workunit.client.1.smithi047.stdout:1/289: dwrite d0/d7/d10/f3f [0,4194304] 0 2024-09-13T22:56:03.511 INFO:tasks.workunit.client.0.smithi002.stdout:1/276: creat d1/f57 x:0 0 0 2024-09-13T22:56:03.514 INFO:tasks.workunit.client.0.smithi002.stdout:2/217: mknod d1/d7/d8/c3f 0 2024-09-13T22:56:03.515 INFO:tasks.workunit.client.1.smithi047.stdout:6/368: rmdir d3/d2c/d55 39 2024-09-13T22:56:03.516 INFO:tasks.workunit.client.1.smithi047.stdout:6/369: chown d3/d11/d2b/d4c/d30/f71 408596025 1 2024-09-13T22:56:03.517 INFO:tasks.workunit.client.1.smithi047.stdout:1/290: readlink d0/d7/l8 0 2024-09-13T22:56:03.520 INFO:tasks.workunit.client.0.smithi002.stdout:0/222: mknod d1/d4/c4e 0 2024-09-13T22:56:03.520 INFO:tasks.workunit.client.0.smithi002.stdout:2/218: write d1/d7/d8/f17 [4369795,47932] 0 2024-09-13T22:56:03.523 INFO:tasks.workunit.client.1.smithi047.stdout:2/473: dread d1/de/f33 [0,4194304] 0 2024-09-13T22:56:03.523 INFO:tasks.workunit.client.1.smithi047.stdout:1/291: dread d0/d1d/f2e [0,4194304] 0 2024-09-13T22:56:03.523 INFO:tasks.workunit.client.0.smithi002.stdout:7/180: dwrite d8/f24 [0,4194304] 0 2024-09-13T22:56:03.524 INFO:tasks.workunit.client.0.smithi002.stdout:8/227: dwrite d3/dc/f13 [0,4194304] 0 2024-09-13T22:56:03.524 INFO:tasks.workunit.client.1.smithi047.stdout:6/370: dwrite d3/f8 [0,4194304] 0 2024-09-13T22:56:03.526 INFO:tasks.workunit.client.0.smithi002.stdout:2/219: write d1/d7/f21 [752056,34237] 0 2024-09-13T22:56:03.527 INFO:tasks.workunit.client.0.smithi002.stdout:6/235: creat d12/d17/d28/d3e/f49 x:0 0 0 2024-09-13T22:56:03.528 INFO:tasks.workunit.client.0.smithi002.stdout:1/277: dwrite d1/d13/d21/f36 [0,4194304] 0 2024-09-13T22:56:03.529 INFO:tasks.workunit.client.0.smithi002.stdout:4/200: mknod d3/d14/d25/c3f 0 2024-09-13T22:56:03.530 INFO:tasks.workunit.client.0.smithi002.stdout:6/236: read - d12/d17/d28/f35 zero size 2024-09-13T22:56:03.534 INFO:tasks.workunit.client.0.smithi002.stdout:1/278: chown d1/d13/d21/c46 1 1 2024-09-13T22:56:03.536 INFO:tasks.workunit.client.1.smithi047.stdout:1/292: symlink d0/l51 0 2024-09-13T22:56:03.538 INFO:tasks.workunit.client.1.smithi047.stdout:6/371: mknod d3/d2c/d55/c82 0 2024-09-13T22:56:03.541 INFO:tasks.workunit.client.0.smithi002.stdout:4/201: dwrite d3/d14/f26 [0,4194304] 0 2024-09-13T22:56:03.542 INFO:tasks.workunit.client.0.smithi002.stdout:6/237: dwrite d12/f21 [0,4194304] 0 2024-09-13T22:56:03.543 INFO:tasks.workunit.client.1.smithi047.stdout:1/293: rename d0/d1d/l4d to d0/d7/d14/l52 0 2024-09-13T22:56:03.545 INFO:tasks.workunit.client.0.smithi002.stdout:0/223: creat d1/d2/f4f x:0 0 0 2024-09-13T22:56:03.547 INFO:tasks.workunit.client.0.smithi002.stdout:8/228: creat d3/dc/d16/d2f/f47 x:0 0 0 2024-09-13T22:56:03.549 INFO:tasks.workunit.client.1.smithi047.stdout:6/372: mknod d3/d11/d2b/d76/c83 0 2024-09-13T22:56:03.551 INFO:tasks.workunit.client.1.smithi047.stdout:6/373: write d3/d11/d2b/d4c/d30/f44 [775619,119420] 0 2024-09-13T22:56:03.555 INFO:tasks.workunit.client.1.smithi047.stdout:1/294: mknod d0/d7/d13/d2d/c53 0 2024-09-13T22:56:03.556 INFO:tasks.workunit.client.1.smithi047.stdout:2/474: getdents d1/df/d1d/d20/d29 0 2024-09-13T22:56:03.558 INFO:tasks.workunit.client.1.smithi047.stdout:2/475: readlink d1/df/d1d/d20/d37/d7b/l88 0 2024-09-13T22:56:03.561 INFO:tasks.workunit.client.0.smithi002.stdout:9/267: mknod d8/d10/c5a 0 2024-09-13T22:56:03.562 INFO:tasks.workunit.client.1.smithi047.stdout:6/374: unlink d3/d11/d2b/d4c/c61 0 2024-09-13T22:56:03.563 INFO:tasks.workunit.client.1.smithi047.stdout:6/375: chown d3/d11/d2b/d4c/c41 142714296 1 2024-09-13T22:56:03.565 INFO:tasks.workunit.client.1.smithi047.stdout:6/376: fdatasync d3/d11/d2b/d1c/d4d/d69/f6d 0 2024-09-13T22:56:03.567 INFO:tasks.workunit.client.1.smithi047.stdout:6/377: write d3/d11/d2b/d4c/d30/d48/f7e [387731,75131] 0 2024-09-13T22:56:03.570 INFO:tasks.workunit.client.1.smithi047.stdout:6/378: write d3/f7 [3195070,90027] 0 2024-09-13T22:56:03.570 INFO:tasks.workunit.client.0.smithi002.stdout:3/292: creat d9/f69 x:0 0 0 2024-09-13T22:56:03.571 INFO:tasks.workunit.client.1.smithi047.stdout:6/379: chown d3/d11/d2b/d1c 112691957 1 2024-09-13T22:56:03.571 INFO:tasks.workunit.client.1.smithi047.stdout:1/295: dwrite d0/f5 [4194304,4194304] 0 2024-09-13T22:56:03.573 INFO:tasks.workunit.client.1.smithi047.stdout:1/296: chown d0/d7/d14/l40 425 1 2024-09-13T22:56:03.573 INFO:tasks.workunit.client.1.smithi047.stdout:6/380: write d3/d11/d2b/d4c/d30/d48/f7e [1201909,44712] 0 2024-09-13T22:56:03.574 INFO:tasks.workunit.client.0.smithi002.stdout:4/202: mkdir d3/d40 0 2024-09-13T22:56:03.581 INFO:tasks.workunit.client.1.smithi047.stdout:6/381: dread d3/f22 [0,4194304] 0 2024-09-13T22:56:03.581 INFO:tasks.workunit.client.0.smithi002.stdout:0/224: truncate d1/f1a 52815 0 2024-09-13T22:56:03.582 INFO:tasks.workunit.client.1.smithi047.stdout:1/297: dwrite d0/d1d/f41 [0,4194304] 0 2024-09-13T22:56:03.585 INFO:tasks.workunit.client.0.smithi002.stdout:1/279: write d1/d13/d30/f53 [466873,23499] 0 2024-09-13T22:56:03.590 INFO:tasks.workunit.client.0.smithi002.stdout:5/217: rename d1/f1d to d1/d10/f50 0 2024-09-13T22:56:03.590 INFO:tasks.workunit.client.0.smithi002.stdout:7/181: rename d8/d10/d11 to d8/d10/d11/d33 22 2024-09-13T22:56:03.591 INFO:tasks.workunit.client.1.smithi047.stdout:2/476: mkdir d1/df/d26/d9f 0 2024-09-13T22:56:03.592 INFO:tasks.workunit.client.0.smithi002.stdout:5/218: write d1/f3 [1538078,113022] 0 2024-09-13T22:56:03.592 INFO:tasks.workunit.client.0.smithi002.stdout:8/229: write d3/dc/f42 [338535,73206] 0 2024-09-13T22:56:03.593 INFO:tasks.workunit.client.1.smithi047.stdout:6/382: rmdir d3/d11/d2b/d4c 39 2024-09-13T22:56:03.595 INFO:tasks.workunit.client.1.smithi047.stdout:6/383: read d3/d11/d2b/d1c/d4d/d69/f6d [2773365,116941] 0 2024-09-13T22:56:03.595 INFO:tasks.workunit.client.0.smithi002.stdout:2/220: truncate d1/f5 8007051 0 2024-09-13T22:56:03.596 INFO:tasks.workunit.client.0.smithi002.stdout:2/221: chown d1/c2e 11 1 2024-09-13T22:56:03.597 INFO:tasks.workunit.client.0.smithi002.stdout:3/293: write d9/d15/d36/d4e/f50 [1927149,20799] 0 2024-09-13T22:56:03.601 INFO:tasks.workunit.client.1.smithi047.stdout:1/298: symlink d0/l54 0 2024-09-13T22:56:03.601 INFO:tasks.workunit.client.1.smithi047.stdout:1/299: fdatasync d0/f4f 0 2024-09-13T22:56:03.602 INFO:tasks.workunit.client.1.smithi047.stdout:6/384: creat d3/d11/d2b/d1c/d4d/f84 x:0 0 0 2024-09-13T22:56:03.603 INFO:tasks.workunit.client.1.smithi047.stdout:2/477: symlink d1/df/la0 0 2024-09-13T22:56:03.604 INFO:tasks.workunit.client.0.smithi002.stdout:7/182: write d8/d10/f1e [2218095,53324] 0 2024-09-13T22:56:03.605 INFO:tasks.workunit.client.1.smithi047.stdout:2/478: write d1/d16/f64 [699215,100206] 0 2024-09-13T22:56:03.605 INFO:tasks.workunit.client.1.smithi047.stdout:1/300: mkdir d0/d7/d10/d55 0 2024-09-13T22:56:03.606 INFO:tasks.workunit.client.0.smithi002.stdout:0/225: dread d1/d2/f1d [0,4194304] 0 2024-09-13T22:56:03.607 INFO:tasks.workunit.client.0.smithi002.stdout:9/268: mknod d8/c5b 0 2024-09-13T22:56:03.607 INFO:tasks.workunit.client.0.smithi002.stdout:9/269: dread - d8/d10/f3c zero size 2024-09-13T22:56:03.608 INFO:tasks.workunit.client.1.smithi047.stdout:2/479: dread d1/df/d1d/d3c/f56 [0,4194304] 0 2024-09-13T22:56:03.609 INFO:tasks.workunit.client.0.smithi002.stdout:9/270: readlink d8/l40 0 2024-09-13T22:56:03.609 INFO:tasks.workunit.client.0.smithi002.stdout:5/219: rmdir d1/d2a 39 2024-09-13T22:56:03.609 INFO:tasks.workunit.client.0.smithi002.stdout:9/271: write d8/d10/f17 [1044007,70137] 0 2024-09-13T22:56:03.611 INFO:tasks.workunit.client.1.smithi047.stdout:6/385: dread d3/d11/f40 [4194304,4194304] 0 2024-09-13T22:56:03.612 INFO:tasks.workunit.client.0.smithi002.stdout:2/222: rmdir d1/d32 39 2024-09-13T22:56:03.615 INFO:tasks.workunit.client.0.smithi002.stdout:0/226: dwrite d1/d2/d10/d31/f37 [0,4194304] 0 2024-09-13T22:56:03.617 INFO:tasks.workunit.client.0.smithi002.stdout:0/227: dread - d1/d4/f3e zero size 2024-09-13T22:56:03.618 INFO:tasks.workunit.client.0.smithi002.stdout:8/230: dwrite d3/dc/d16/f19 [0,4194304] 0 2024-09-13T22:56:03.619 INFO:tasks.workunit.client.0.smithi002.stdout:0/228: read d1/d4/fb [1867926,17958] 0 2024-09-13T22:56:03.619 INFO:tasks.workunit.client.0.smithi002.stdout:6/238: link d12/d17/d28/f2e d12/d17/f4a 0 2024-09-13T22:56:03.619 INFO:tasks.workunit.client.0.smithi002.stdout:9/272: dwrite d8/fe [4194304,4194304] 0 2024-09-13T22:56:03.621 INFO:tasks.workunit.client.1.smithi047.stdout:1/301: rmdir d0 39 2024-09-13T22:56:03.622 INFO:tasks.workunit.client.0.smithi002.stdout:6/239: write d12/f23 [6049404,51192] 0 2024-09-13T22:56:03.624 INFO:tasks.workunit.client.0.smithi002.stdout:6/240: chown d12/d17/d34/d39/l47 18632 1 2024-09-13T22:56:03.633 INFO:tasks.workunit.client.0.smithi002.stdout:7/183: dread d8/d10/f32 [0,4194304] 0 2024-09-13T22:56:03.635 INFO:tasks.workunit.client.0.smithi002.stdout:7/184: write d8/d10/f1e [4885261,36676] 0 2024-09-13T22:56:03.635 INFO:tasks.workunit.client.1.smithi047.stdout:6/386: write d3/d11/d2b/d1c/f27 [846828,23709] 0 2024-09-13T22:56:03.637 INFO:tasks.workunit.client.0.smithi002.stdout:3/294: getdents d9/d15/d35 0 2024-09-13T22:56:03.640 INFO:tasks.workunit.client.0.smithi002.stdout:9/273: mknod d8/d10/d1c/c5c 0 2024-09-13T22:56:03.641 INFO:tasks.workunit.client.0.smithi002.stdout:0/229: creat d1/d2/d10/d31/d32/f50 x:0 0 0 2024-09-13T22:56:03.642 INFO:tasks.workunit.client.1.smithi047.stdout:2/480: truncate d1/d16/d40/f4d 3573417 0 2024-09-13T22:56:03.642 INFO:tasks.workunit.client.1.smithi047.stdout:2/481: chown d1/d16/f64 151547 1 2024-09-13T22:56:03.643 INFO:tasks.workunit.client.0.smithi002.stdout:1/280: link d1/d13/d30/f2f d1/d13/d30/d31/d3b/f58 0 2024-09-13T22:56:03.644 INFO:tasks.workunit.client.0.smithi002.stdout:6/241: mkdir d12/d17/d34/d4b 0 2024-09-13T22:56:03.644 INFO:tasks.workunit.client.0.smithi002.stdout:6/242: chown d12/d17/f20 7011934 1 2024-09-13T22:56:03.646 INFO:tasks.workunit.client.1.smithi047.stdout:1/302: truncate d0/f5 4888900 0 2024-09-13T22:56:03.646 INFO:tasks.workunit.client.1.smithi047.stdout:1/303: stat d0/f4f 0 2024-09-13T22:56:03.647 INFO:tasks.workunit.client.1.smithi047.stdout:2/482: mknod d1/d16/ca1 0 2024-09-13T22:56:03.648 INFO:tasks.workunit.client.1.smithi047.stdout:2/483: stat d1/df/d1d/d20/d37/d7a 0 2024-09-13T22:56:03.651 INFO:tasks.workunit.client.1.smithi047.stdout:6/387: getdents d3/d11/d2b/d4c/d30/d48 0 2024-09-13T22:56:03.651 INFO:tasks.workunit.client.1.smithi047.stdout:1/304: getdents d0/d7/d10/d55 0 2024-09-13T22:56:03.651 INFO:tasks.workunit.client.1.smithi047.stdout:6/388: dread - d3/d11/d2b/d1c/d4d/f84 zero size 2024-09-13T22:56:03.651 INFO:tasks.workunit.client.0.smithi002.stdout:2/223: symlink d1/d32/l40 0 2024-09-13T22:56:03.652 INFO:tasks.workunit.client.1.smithi047.stdout:1/305: readlink d0/d7/d13/l46 0 2024-09-13T22:56:03.652 INFO:tasks.workunit.client.1.smithi047.stdout:2/484: truncate d1/de/f25 601857 0 2024-09-13T22:56:03.653 INFO:tasks.workunit.client.1.smithi047.stdout:1/306: write d0/d7/d13/f39 [2650192,40819] 0 2024-09-13T22:56:03.661 INFO:tasks.workunit.client.1.smithi047.stdout:2/485: truncate d1/de/f4a 1921273 0 2024-09-13T22:56:03.665 INFO:tasks.workunit.client.0.smithi002.stdout:7/185: write d8/d9/f19 [3717937,23445] 0 2024-09-13T22:56:03.665 INFO:tasks.workunit.client.0.smithi002.stdout:9/274: dread d8/d1e/f25 [0,4194304] 0 2024-09-13T22:56:03.665 INFO:tasks.workunit.client.0.smithi002.stdout:9/275: readlink d8/d10/l16 0 2024-09-13T22:56:03.665 INFO:tasks.workunit.client.0.smithi002.stdout:1/281: rename d1/f7 to d1/d13/d30/f59 0 2024-09-13T22:56:03.665 INFO:tasks.workunit.client.0.smithi002.stdout:1/282: chown d1/d13/d30/d31/d3d/f48 5 1 2024-09-13T22:56:03.666 INFO:tasks.workunit.client.0.smithi002.stdout:6/243: unlink d12/d17/d28/d3e/f44 0 2024-09-13T22:56:03.666 INFO:tasks.workunit.client.1.smithi047.stdout:2/486: dread d1/de/f5b [0,4194304] 0 2024-09-13T22:56:03.666 INFO:tasks.workunit.client.1.smithi047.stdout:1/307: creat d0/d7/d13/f56 x:0 0 0 2024-09-13T22:56:03.667 INFO:tasks.workunit.client.0.smithi002.stdout:6/244: stat d12/d17/f1e 0 2024-09-13T22:56:03.669 INFO:tasks.workunit.client.0.smithi002.stdout:5/220: creat d1/d10/f51 x:0 0 0 2024-09-13T22:56:03.670 INFO:tasks.workunit.client.0.smithi002.stdout:1/283: dwrite d1/d13/d30/d31/d3b/f4b [0,4194304] 0 2024-09-13T22:56:03.670 INFO:tasks.workunit.client.0.smithi002.stdout:1/284: fdatasync d1/d1c/f4c 0 2024-09-13T22:56:03.695 INFO:tasks.workunit.client.1.smithi047.stdout:5/289: sync 2024-09-13T22:56:03.696 INFO:tasks.workunit.client.1.smithi047.stdout:5/290: write d19/f43 [4799742,14281] 0 2024-09-13T22:56:03.795 INFO:tasks.workunit.client.1.smithi047.stdout:6/389: creat d3/d11/d74/f85 x:0 0 0 2024-09-13T22:56:03.796 INFO:tasks.workunit.client.1.smithi047.stdout:6/390: dread - d3/d11/d74/f85 zero size 2024-09-13T22:56:03.801 INFO:tasks.workunit.client.1.smithi047.stdout:6/391: dwrite d3/d11/d2b/d4c/d30/f37 [0,4194304] 0 2024-09-13T22:56:03.859 INFO:tasks.workunit.client.1.smithi047.stdout:4/334: sync 2024-09-13T22:56:03.860 INFO:tasks.workunit.client.1.smithi047.stdout:4/335: truncate dc/de/d39/f69 374048 0 2024-09-13T22:56:03.862 INFO:tasks.workunit.client.0.smithi002.stdout:8/231: link d3/c11 d3/d27/c48 0 2024-09-13T22:56:03.862 INFO:tasks.workunit.client.1.smithi047.stdout:4/336: dread dc/de/d23/f55 [0,4194304] 0 2024-09-13T22:56:03.863 INFO:tasks.workunit.client.0.smithi002.stdout:8/232: truncate d3/f36 916719 0 2024-09-13T22:56:03.864 INFO:tasks.workunit.client.0.smithi002.stdout:8/233: chown d3/dc/d18/d2e/d46 715 1 2024-09-13T22:56:03.867 INFO:tasks.workunit.client.0.smithi002.stdout:0/230: getdents d1/d2/d49 0 2024-09-13T22:56:03.872 INFO:tasks.workunit.client.0.smithi002.stdout:7/186: creat d8/d10/d11/d13/f34 x:0 0 0 2024-09-13T22:56:03.876 INFO:tasks.workunit.client.1.smithi047.stdout:5/291: read d19/d25/d45/f4e [3141176,57871] 0 2024-09-13T22:56:03.877 INFO:tasks.workunit.client.1.smithi047.stdout:5/292: chown d19/f36 29 1 2024-09-13T22:56:03.877 INFO:tasks.workunit.client.1.smithi047.stdout:5/293: readlink l8 0 2024-09-13T22:56:03.881 INFO:tasks.workunit.client.0.smithi002.stdout:9/276: sync 2024-09-13T22:56:03.881 INFO:tasks.workunit.client.0.smithi002.stdout:4/203: sync 2024-09-13T22:56:03.881 INFO:tasks.workunit.client.0.smithi002.stdout:1/285: mknod d1/d1c/c5a 0 2024-09-13T22:56:03.884 INFO:tasks.workunit.client.0.smithi002.stdout:4/204: dread d3/d14/f1d [0,4194304] 0 2024-09-13T22:56:03.885 INFO:tasks.workunit.client.1.smithi047.stdout:6/392: write d3/d11/f40 [5839518,4167] 0 2024-09-13T22:56:03.885 INFO:tasks.workunit.client.0.smithi002.stdout:4/205: write d3/d14/f26 [2797168,102101] 0 2024-09-13T22:56:03.890 INFO:tasks.workunit.client.1.smithi047.stdout:4/337: symlink dc/de/d17/d25/d4a/l76 0 2024-09-13T22:56:03.891 INFO:tasks.workunit.client.0.smithi002.stdout:8/234: creat d3/d21/f49 x:0 0 0 2024-09-13T22:56:03.893 INFO:tasks.workunit.client.0.smithi002.stdout:2/224: mkdir d1/d7/d41 0 2024-09-13T22:56:03.898 INFO:tasks.workunit.client.0.smithi002.stdout:7/187: symlink d8/d10/l35 0 2024-09-13T22:56:03.904 INFO:tasks.workunit.client.0.smithi002.stdout:5/221: unlink d1/d2a/l2c 0 2024-09-13T22:56:03.905 INFO:tasks.workunit.client.0.smithi002.stdout:5/222: write d1/d2a/d41/f46 [305278,107005] 0 2024-09-13T22:56:03.905 INFO:tasks.workunit.client.1.smithi047.stdout:6/393: chown d3/d11/d2b/d1c/l3a 42398 1 2024-09-13T22:56:03.911 INFO:tasks.workunit.client.0.smithi002.stdout:1/286: dread - d1/d13/d30/d31/f41 zero size 2024-09-13T22:56:03.912 INFO:tasks.workunit.client.1.smithi047.stdout:2/487: getdents d1/de/d17 0 2024-09-13T22:56:03.915 INFO:tasks.workunit.client.0.smithi002.stdout:4/206: symlink d3/d14/d29/d2a/d30/l41 0 2024-09-13T22:56:03.916 INFO:tasks.workunit.client.0.smithi002.stdout:4/207: chown d3/d14/f1f 119 1 2024-09-13T22:56:03.916 INFO:tasks.workunit.client.0.smithi002.stdout:4/208: chown d3/c2e 93632 1 2024-09-13T22:56:03.918 INFO:tasks.workunit.client.0.smithi002.stdout:3/295: getdents d9/d15 0 2024-09-13T22:56:03.920 INFO:tasks.workunit.client.0.smithi002.stdout:8/235: rmdir d3/dc/d16/d2f 39 2024-09-13T22:56:03.921 INFO:tasks.workunit.client.1.smithi047.stdout:6/394: creat d3/d11/d2b/d1c/d70/f86 x:0 0 0 2024-09-13T22:56:03.923 INFO:tasks.workunit.client.1.smithi047.stdout:6/395: truncate d3/d11/d2b/d1c/f27 1212779 0 2024-09-13T22:56:03.923 INFO:tasks.workunit.client.0.smithi002.stdout:2/225: unlink d1/d7/f21 0 2024-09-13T22:56:03.924 INFO:tasks.workunit.client.1.smithi047.stdout:4/338: mknod dc/de/d23/c77 0 2024-09-13T22:56:03.926 INFO:tasks.workunit.client.0.smithi002.stdout:2/226: dread d1/f15 [0,4194304] 0 2024-09-13T22:56:03.927 INFO:tasks.workunit.client.1.smithi047.stdout:6/396: dread d3/f2f [0,4194304] 0 2024-09-13T22:56:03.927 INFO:tasks.workunit.client.0.smithi002.stdout:2/227: chown d1/c2f 52719487 1 2024-09-13T22:56:03.930 INFO:tasks.workunit.client.1.smithi047.stdout:5/294: mknod d19/d23/d2e/d41/d58/c68 0 2024-09-13T22:56:03.931 INFO:tasks.workunit.client.1.smithi047.stdout:4/339: dwrite dc/de/d17/f74 [0,4194304] 0 2024-09-13T22:56:03.932 INFO:tasks.workunit.client.0.smithi002.stdout:5/223: chown d1/d10/c17 33 1 2024-09-13T22:56:03.933 INFO:tasks.workunit.client.1.smithi047.stdout:2/488: mknod d1/df/d1d/d2e/ca2 0 2024-09-13T22:56:03.935 INFO:tasks.workunit.client.0.smithi002.stdout:9/277: mknod d8/d1e/c5d 0 2024-09-13T22:56:03.936 INFO:tasks.workunit.client.0.smithi002.stdout:9/278: truncate d8/d1e/f3a 1853888 0 2024-09-13T22:56:03.937 INFO:tasks.workunit.client.0.smithi002.stdout:9/279: chown d8/d1e/f34 663 1 2024-09-13T22:56:03.941 INFO:tasks.workunit.client.1.smithi047.stdout:3/396: sync 2024-09-13T22:56:03.941 INFO:tasks.workunit.client.1.smithi047.stdout:8/355: sync 2024-09-13T22:56:03.942 INFO:tasks.workunit.client.1.smithi047.stdout:2/489: dwrite d1/df/d1d/d20/d29/f9b [0,4194304] 0 2024-09-13T22:56:03.942 INFO:tasks.workunit.client.1.smithi047.stdout:5/295: mkdir d19/d23/d32/d69 0 2024-09-13T22:56:03.945 INFO:tasks.workunit.client.0.smithi002.stdout:4/209: creat d3/d14/f42 x:0 0 0 2024-09-13T22:56:03.946 INFO:tasks.workunit.client.1.smithi047.stdout:4/340: mknod dc/d29/d4d/c78 0 2024-09-13T22:56:03.956 INFO:tasks.workunit.client.1.smithi047.stdout:8/356: symlink d8/d36/d40/l79 0 2024-09-13T22:56:03.958 INFO:tasks.workunit.client.1.smithi047.stdout:3/397: mkdir d0/d3/d4/d16/d73/d86 0 2024-09-13T22:56:03.958 INFO:tasks.workunit.client.1.smithi047.stdout:3/398: stat d0/d3 0 2024-09-13T22:56:03.959 INFO:tasks.workunit.client.0.smithi002.stdout:7/188: mkdir d8/d10/d11/d13/d2e/d36 0 2024-09-13T22:56:03.960 INFO:tasks.workunit.client.0.smithi002.stdout:5/224: readlink d1/d10/l3c 0 2024-09-13T22:56:03.961 INFO:tasks.workunit.client.1.smithi047.stdout:4/341: dread dc/de/f18 [0,4194304] 0 2024-09-13T22:56:03.967 INFO:tasks.workunit.client.0.smithi002.stdout:5/225: dwrite d1/d2a/d41/f46 [0,4194304] 0 2024-09-13T22:56:03.968 INFO:tasks.workunit.client.0.smithi002.stdout:5/226: chown d1 16372 1 2024-09-13T22:56:03.968 INFO:tasks.workunit.client.0.smithi002.stdout:5/227: read - d1/d10/f4b zero size 2024-09-13T22:56:03.972 INFO:tasks.workunit.client.0.smithi002.stdout:8/236: symlink d3/dc/d34/l4a 0 2024-09-13T22:56:03.974 INFO:tasks.workunit.client.0.smithi002.stdout:2/228: mkdir d1/d7/d42 0 2024-09-13T22:56:03.974 INFO:tasks.workunit.client.0.smithi002.stdout:6/245: write f1 [1033561,113768] 0 2024-09-13T22:56:03.976 INFO:tasks.workunit.client.0.smithi002.stdout:7/189: chown d8/l30 2988487 1 2024-09-13T22:56:03.977 INFO:tasks.workunit.client.0.smithi002.stdout:5/228: dwrite d1/f3 [0,4194304] 0 2024-09-13T22:56:03.977 INFO:tasks.workunit.client.0.smithi002.stdout:0/231: link d1/c23 d1/d2/c51 0 2024-09-13T22:56:03.978 INFO:tasks.workunit.client.0.smithi002.stdout:9/280: symlink d8/d10/l5e 0 2024-09-13T22:56:03.979 INFO:tasks.workunit.client.0.smithi002.stdout:7/190: truncate d8/d10/d11/d13/f21 736468 0 2024-09-13T22:56:03.980 INFO:tasks.workunit.client.0.smithi002.stdout:1/287: creat d1/d13/d21/f5b x:0 0 0 2024-09-13T22:56:03.981 INFO:tasks.workunit.client.0.smithi002.stdout:9/281: chown d8/d10/f2f 2366 1 2024-09-13T22:56:03.986 INFO:tasks.workunit.client.0.smithi002.stdout:0/232: rename d1/l3b to d1/d2/d10/l52 0 2024-09-13T22:56:03.987 INFO:tasks.workunit.client.0.smithi002.stdout:0/233: dread - d1/d2/d10/f2c zero size 2024-09-13T22:56:03.990 INFO:tasks.workunit.client.0.smithi002.stdout:8/237: mkdir d3/dc/d16/d4b 0 2024-09-13T22:56:03.991 INFO:tasks.workunit.client.0.smithi002.stdout:0/234: dread d1/d2/f18 [0,4194304] 0 2024-09-13T22:56:03.991 INFO:tasks.workunit.client.0.smithi002.stdout:5/229: mknod d1/d2a/d41/d45/d4f/c52 0 2024-09-13T22:56:03.992 INFO:tasks.workunit.client.0.smithi002.stdout:5/230: write d1/f12 [4062673,117080] 0 2024-09-13T22:56:03.995 INFO:tasks.workunit.client.0.smithi002.stdout:0/235: mknod d1/d2/d10/c53 0 2024-09-13T22:56:03.997 INFO:tasks.workunit.client.0.smithi002.stdout:5/231: truncate d1/d10/f22 921100 0 2024-09-13T22:56:03.997 INFO:tasks.workunit.client.0.smithi002.stdout:0/236: symlink d1/d2/d10/d31/d3c/l54 0 2024-09-13T22:56:03.999 INFO:tasks.workunit.client.0.smithi002.stdout:5/232: creat d1/d2a/f53 x:0 0 0 2024-09-13T22:56:03.999 INFO:tasks.workunit.client.0.smithi002.stdout:5/233: fsync d1/d2a/d41/f4d 0 2024-09-13T22:56:04.000 INFO:tasks.workunit.client.0.smithi002.stdout:5/234: read - d1/d10/f4b zero size 2024-09-13T22:56:04.000 INFO:tasks.workunit.client.1.smithi047.stdout:8/357: mkdir d8/d36/d38/d7a 0 2024-09-13T22:56:04.000 INFO:tasks.workunit.client.1.smithi047.stdout:3/399: creat d0/d25/d44/f87 x:0 0 0 2024-09-13T22:56:04.003 INFO:tasks.workunit.client.1.smithi047.stdout:3/400: stat d0/d3/d4/d16/d2c/de/d1f/d2e 0 2024-09-13T22:56:04.006 INFO:tasks.workunit.client.0.smithi002.stdout:5/235: unlink d1/d10/f21 0 2024-09-13T22:56:04.009 INFO:tasks.workunit.client.1.smithi047.stdout:4/342: dwrite dc/d29/d4d/f65 [0,4194304] 0 2024-09-13T22:56:04.011 INFO:tasks.workunit.client.1.smithi047.stdout:4/343: fsync dc/de/d17/f1e 0 2024-09-13T22:56:04.011 INFO:tasks.workunit.client.0.smithi002.stdout:3/296: mknod d9/c6a 0 2024-09-13T22:56:04.011 INFO:tasks.workunit.client.0.smithi002.stdout:3/297: chown d9/d3b/d53/l56 398 1 2024-09-13T22:56:04.013 INFO:tasks.workunit.client.0.smithi002.stdout:5/236: creat d1/d2a/d41/d45/f54 x:0 0 0 2024-09-13T22:56:04.015 INFO:tasks.workunit.client.1.smithi047.stdout:1/308: dread d0/f5 [0,4194304] 0 2024-09-13T22:56:04.015 INFO:tasks.workunit.client.1.smithi047.stdout:3/401: creat d0/d3/d4/d16/d2c/de/d68/f88 x:0 0 0 2024-09-13T22:56:04.016 INFO:tasks.workunit.client.1.smithi047.stdout:8/358: dread d8/f2c [0,4194304] 0 2024-09-13T22:56:04.019 INFO:tasks.workunit.client.0.smithi002.stdout:3/298: rename d9/d15/d26/f4b to d9/d15/d26/d44/f6b 0 2024-09-13T22:56:04.022 INFO:tasks.workunit.client.0.smithi002.stdout:5/237: mkdir d1/d2a/d41/d55 0 2024-09-13T22:56:04.022 INFO:tasks.workunit.client.0.smithi002.stdout:5/238: dread - d1/d2a/f4c zero size 2024-09-13T22:56:04.023 INFO:tasks.workunit.client.0.smithi002.stdout:5/239: write d1/f43 [1020277,20226] 0 2024-09-13T22:56:04.023 INFO:tasks.workunit.client.1.smithi047.stdout:1/309: mkdir d0/d7/d14/d57 0 2024-09-13T22:56:04.024 INFO:tasks.workunit.client.0.smithi002.stdout:4/210: sync 2024-09-13T22:56:04.025 INFO:tasks.workunit.client.1.smithi047.stdout:6/397: rename d3/d11/d2b/f28 to d3/d77/f87 0 2024-09-13T22:56:04.026 INFO:tasks.workunit.client.1.smithi047.stdout:6/398: stat d3/d11/d2b/d1c/f56 0 2024-09-13T22:56:04.027 INFO:tasks.workunit.client.1.smithi047.stdout:3/402: creat d0/d25/d34/f89 x:0 0 0 2024-09-13T22:56:04.027 INFO:tasks.workunit.client.1.smithi047.stdout:6/399: chown d3/d11/d74/f85 225730075 1 2024-09-13T22:56:04.028 INFO:tasks.workunit.client.0.smithi002.stdout:3/299: truncate d9/d15/f30 894339 0 2024-09-13T22:56:04.028 INFO:tasks.workunit.client.1.smithi047.stdout:6/400: chown d3/d77/f87 471311965 1 2024-09-13T22:56:04.029 INFO:tasks.workunit.client.0.smithi002.stdout:3/300: write d9/f68 [270253,14251] 0 2024-09-13T22:56:04.029 INFO:tasks.workunit.client.1.smithi047.stdout:3/403: readlink d0/d3/d4/d16/d2c/de/d1f/d2e/l5d 0 2024-09-13T22:56:04.029 INFO:tasks.workunit.client.1.smithi047.stdout:1/310: creat d0/d7/db/f58 x:0 0 0 2024-09-13T22:56:04.036 INFO:tasks.workunit.client.1.smithi047.stdout:4/344: dread dc/de/d23/f64 [0,4194304] 0 2024-09-13T22:56:04.036 INFO:tasks.workunit.client.1.smithi047.stdout:3/404: dwrite d0/d25/d44/f27 [0,4194304] 0 2024-09-13T22:56:04.037 INFO:tasks.workunit.client.0.smithi002.stdout:3/301: mkdir d9/d15/d6c 0 2024-09-13T22:56:04.038 INFO:tasks.workunit.client.1.smithi047.stdout:6/401: symlink d3/d11/d2b/d1c/l88 0 2024-09-13T22:56:04.040 INFO:tasks.workunit.client.0.smithi002.stdout:5/240: mkdir d1/d2a/d41/d55/d56 0 2024-09-13T22:56:04.042 INFO:tasks.workunit.client.1.smithi047.stdout:1/311: creat d0/d7/d13/d2d/f59 x:0 0 0 2024-09-13T22:56:04.043 INFO:tasks.workunit.client.1.smithi047.stdout:1/312: write d0/d7/db/f58 [475608,39926] 0 2024-09-13T22:56:04.044 INFO:tasks.workunit.client.0.smithi002.stdout:3/302: creat d9/df/f6d x:0 0 0 2024-09-13T22:56:04.046 INFO:tasks.workunit.client.1.smithi047.stdout:4/345: creat dc/d29/d4c/f79 x:0 0 0 2024-09-13T22:56:04.047 INFO:tasks.workunit.client.1.smithi047.stdout:4/346: write dc/d29/f4e [810042,6713] 0 2024-09-13T22:56:04.050 INFO:tasks.workunit.client.1.smithi047.stdout:6/402: mkdir d3/d11/d2b/d1c/d70/d89 0 2024-09-13T22:56:04.052 INFO:tasks.workunit.client.0.smithi002.stdout:6/246: sync 2024-09-13T22:56:04.055 INFO:tasks.workunit.client.0.smithi002.stdout:8/238: unlink d3/c15 0 2024-09-13T22:56:04.056 INFO:tasks.workunit.client.0.smithi002.stdout:6/247: mknod d12/d17/d2a/c4c 0 2024-09-13T22:56:04.058 INFO:tasks.workunit.client.1.smithi047.stdout:6/403: unlink d3/d2c/l68 0 2024-09-13T22:56:04.058 INFO:tasks.workunit.client.0.smithi002.stdout:4/211: rmdir d3/d14 39 2024-09-13T22:56:04.060 INFO:tasks.workunit.client.0.smithi002.stdout:8/239: readlink d3/l1e 0 2024-09-13T22:56:04.061 INFO:tasks.workunit.client.0.smithi002.stdout:8/240: chown d3/dc/d16/f19 45 1 2024-09-13T22:56:04.061 INFO:tasks.workunit.client.0.smithi002.stdout:8/241: write d3/f36 [1402629,1716] 0 2024-09-13T22:56:04.062 INFO:tasks.workunit.client.1.smithi047.stdout:8/359: rename d8/d6b/f6d to d8/f7b 0 2024-09-13T22:56:04.065 INFO:tasks.workunit.client.1.smithi047.stdout:4/347: symlink dc/d29/d6c/l7a 0 2024-09-13T22:56:04.066 INFO:tasks.workunit.client.1.smithi047.stdout:4/348: write dc/f19 [1457043,32101] 0 2024-09-13T22:56:04.067 INFO:tasks.workunit.client.1.smithi047.stdout:9/318: sync 2024-09-13T22:56:04.067 INFO:tasks.workunit.client.1.smithi047.stdout:7/417: sync 2024-09-13T22:56:04.067 INFO:tasks.workunit.client.1.smithi047.stdout:0/368: sync 2024-09-13T22:56:04.068 INFO:tasks.workunit.client.1.smithi047.stdout:0/369: fsync d1/f4 0 2024-09-13T22:56:04.069 INFO:tasks.workunit.client.1.smithi047.stdout:9/319: truncate d1/d2d/f56 524828 0 2024-09-13T22:56:04.070 INFO:tasks.workunit.client.1.smithi047.stdout:1/313: creat d0/f5a x:0 0 0 2024-09-13T22:56:04.072 INFO:tasks.workunit.client.0.smithi002.stdout:4/212: write d3/d14/d29/d2a/f36 [818735,24430] 0 2024-09-13T22:56:04.077 INFO:tasks.workunit.client.0.smithi002.stdout:6/248: rename d12/d17/d34/d39/c3d to d12/d17/c4d 0 2024-09-13T22:56:04.077 INFO:tasks.workunit.client.0.smithi002.stdout:4/213: creat d3/d14/d29/d2a/f43 x:0 0 0 2024-09-13T22:56:04.077 INFO:tasks.workunit.client.1.smithi047.stdout:4/349: dread dc/de/d23/f64 [0,4194304] 0 2024-09-13T22:56:04.078 INFO:tasks.workunit.client.1.smithi047.stdout:1/314: dread d0/d7/d14/f18 [0,4194304] 0 2024-09-13T22:56:04.078 INFO:tasks.workunit.client.1.smithi047.stdout:3/405: getdents d0/d3/d4/d16/d2c/de/d1f/d3b 0 2024-09-13T22:56:04.079 INFO:tasks.workunit.client.1.smithi047.stdout:5/296: dwrite d19/f1c [0,4194304] 0 2024-09-13T22:56:04.081 INFO:tasks.workunit.client.0.smithi002.stdout:8/242: rename d3/dc/d18/f3c to d3/dc/d41/f4c 0 2024-09-13T22:56:04.083 INFO:tasks.workunit.client.1.smithi047.stdout:5/297: write d19/d23/f3a [1267627,128251] 0 2024-09-13T22:56:04.086 INFO:tasks.workunit.client.1.smithi047.stdout:6/404: symlink d3/d11/d2b/d7c/l8a 0 2024-09-13T22:56:04.089 INFO:tasks.workunit.client.1.smithi047.stdout:6/405: readlink d3/d11/d2b/d1c/d4d/l54 0 2024-09-13T22:56:04.089 INFO:tasks.workunit.client.1.smithi047.stdout:1/315: dwrite d0/d7/d14/f2b [0,4194304] 0 2024-09-13T22:56:04.092 INFO:tasks.workunit.client.1.smithi047.stdout:1/316: chown d0/d7/d10/f43 141 1 2024-09-13T22:56:04.093 INFO:tasks.workunit.client.1.smithi047.stdout:7/418: mkdir d0/d57/d5b/d8b 0 2024-09-13T22:56:04.094 INFO:tasks.workunit.client.1.smithi047.stdout:5/298: dwrite d19/d23/d2e/d41/f5a [0,4194304] 0 2024-09-13T22:56:04.095 INFO:tasks.workunit.client.0.smithi002.stdout:8/243: rmdir d3/dc 39 2024-09-13T22:56:04.097 INFO:tasks.workunit.client.1.smithi047.stdout:1/317: truncate d0/d7/d10/f43 955734 0 2024-09-13T22:56:04.098 INFO:tasks.workunit.client.1.smithi047.stdout:0/370: unlink d1/d7/f44 0 2024-09-13T22:56:04.098 INFO:tasks.workunit.client.0.smithi002.stdout:2/229: write d1/d7/f26 [1144160,53175] 0 2024-09-13T22:56:04.101 INFO:tasks.workunit.client.1.smithi047.stdout:9/320: unlink d1/dc/d14/dd/d54/c28 0 2024-09-13T22:56:04.101 INFO:tasks.workunit.client.1.smithi047.stdout:8/360: dread d8/f10 [0,4194304] 0 2024-09-13T22:56:04.101 INFO:tasks.workunit.client.0.smithi002.stdout:4/214: rmdir d3/d14/d25 39 2024-09-13T22:56:04.102 INFO:tasks.workunit.client.0.smithi002.stdout:1/288: write d1/d13/f19 [1524631,112855] 0 2024-09-13T22:56:04.103 INFO:tasks.workunit.client.0.smithi002.stdout:9/282: write d8/d10/d1c/f19 [1545847,103781] 0 2024-09-13T22:56:04.106 INFO:tasks.workunit.client.0.smithi002.stdout:8/244: write d3/dc/f13 [5482132,118589] 0 2024-09-13T22:56:04.107 INFO:tasks.workunit.client.0.smithi002.stdout:2/230: creat d1/d7/d35/f43 x:0 0 0 2024-09-13T22:56:04.108 INFO:tasks.workunit.client.0.smithi002.stdout:7/191: truncate d8/d10/f1e 4334054 0 2024-09-13T22:56:04.109 INFO:tasks.workunit.client.1.smithi047.stdout:2/490: sync 2024-09-13T22:56:04.111 INFO:tasks.workunit.client.0.smithi002.stdout:4/215: creat d3/d14/d29/d2a/f44 x:0 0 0 2024-09-13T22:56:04.111 INFO:tasks.workunit.client.0.smithi002.stdout:4/216: chown d3/f3a 7749 1 2024-09-13T22:56:04.113 INFO:tasks.workunit.client.0.smithi002.stdout:0/237: write d1/fa [327704,101579] 0 2024-09-13T22:56:04.113 INFO:tasks.workunit.client.1.smithi047.stdout:0/371: dread d1/d5/d11/f35 [0,4194304] 0 2024-09-13T22:56:04.114 INFO:tasks.workunit.client.0.smithi002.stdout:0/238: chown d1/d2/d10/d31/f37 116 1 2024-09-13T22:56:04.115 INFO:tasks.workunit.client.0.smithi002.stdout:9/283: mknod d8/d2c/c5f 0 2024-09-13T22:56:04.115 INFO:tasks.workunit.client.0.smithi002.stdout:5/241: sync 2024-09-13T22:56:04.119 INFO:tasks.workunit.client.1.smithi047.stdout:6/406: mknod d3/d11/d2b/d76/c8b 0 2024-09-13T22:56:04.120 INFO:tasks.workunit.client.1.smithi047.stdout:0/372: dwrite d1/d5/d11/d2f/f82 [0,4194304] 0 2024-09-13T22:56:04.121 INFO:tasks.workunit.client.0.smithi002.stdout:9/284: dread f0 [0,4194304] 0 2024-09-13T22:56:04.121 INFO:tasks.workunit.client.1.smithi047.stdout:0/373: truncate d1/f69 220138 0 2024-09-13T22:56:04.122 INFO:tasks.workunit.client.1.smithi047.stdout:0/374: write d1/d7/f6c [976281,56699] 0 2024-09-13T22:56:04.123 INFO:tasks.workunit.client.0.smithi002.stdout:2/231: creat d1/d7/d8/d2c/f44 x:0 0 0 2024-09-13T22:56:04.128 INFO:tasks.workunit.client.0.smithi002.stdout:1/289: creat d1/d13/d21/d40/f5c x:0 0 0 2024-09-13T22:56:04.129 INFO:tasks.workunit.client.0.smithi002.stdout:9/285: dwrite d8/d1e/f34 [0,4194304] 0 2024-09-13T22:56:04.130 INFO:tasks.workunit.client.0.smithi002.stdout:1/290: chown d1/d13/l17 1 1 2024-09-13T22:56:04.132 INFO:tasks.workunit.client.0.smithi002.stdout:0/239: symlink d1/d2/l55 0 2024-09-13T22:56:04.134 INFO:tasks.workunit.client.0.smithi002.stdout:5/242: rmdir d1 39 2024-09-13T22:56:04.136 INFO:tasks.workunit.client.1.smithi047.stdout:8/361: creat d8/d64/f7c x:0 0 0 2024-09-13T22:56:04.139 INFO:tasks.workunit.client.0.smithi002.stdout:2/232: creat d1/d32/d37/f45 x:0 0 0 2024-09-13T22:56:04.140 INFO:tasks.workunit.client.0.smithi002.stdout:2/233: fsync d1/d7/d8/f1e 0 2024-09-13T22:56:04.140 INFO:tasks.workunit.client.0.smithi002.stdout:2/234: stat d1/d32/l40 0 2024-09-13T22:56:04.141 INFO:tasks.workunit.client.1.smithi047.stdout:2/491: symlink d1/d16/d40/d57/la3 0 2024-09-13T22:56:04.142 INFO:tasks.workunit.client.1.smithi047.stdout:2/492: chown d1/df/f1b 1231 1 2024-09-13T22:56:04.143 INFO:tasks.workunit.client.1.smithi047.stdout:2/493: stat d1/de 0 2024-09-13T22:56:04.144 INFO:tasks.workunit.client.1.smithi047.stdout:3/406: mknod d0/d25/d44/d43/d85/c8a 0 2024-09-13T22:56:04.144 INFO:tasks.workunit.client.1.smithi047.stdout:2/494: fsync d1/df/d1d/d20/d37/d7b/f6c 0 2024-09-13T22:56:04.145 INFO:tasks.workunit.client.1.smithi047.stdout:3/407: write d0/d25/d44/d43/f6b [994399,42846] 0 2024-09-13T22:56:04.145 INFO:tasks.workunit.client.1.smithi047.stdout:2/495: read d1/df/f3f [1109114,3838] 0 2024-09-13T22:56:04.146 INFO:tasks.workunit.client.0.smithi002.stdout:4/217: mkdir d3/d40/d45 0 2024-09-13T22:56:04.147 INFO:tasks.workunit.client.1.smithi047.stdout:2/496: write d1/df/d1d/d20/d2b/f41 [107833,93488] 0 2024-09-13T22:56:04.149 INFO:tasks.workunit.client.1.smithi047.stdout:6/407: symlink d3/d77/l8c 0 2024-09-13T22:56:04.150 INFO:tasks.workunit.client.0.smithi002.stdout:9/286: mknod d8/d2c/c60 0 2024-09-13T22:56:04.151 INFO:tasks.workunit.client.0.smithi002.stdout:9/287: chown d8/d10/l5e 30 1 2024-09-13T22:56:04.151 INFO:tasks.workunit.client.0.smithi002.stdout:9/288: chown d8/d10/f21 1802823013 1 2024-09-13T22:56:04.152 INFO:tasks.workunit.client.1.smithi047.stdout:1/318: rmdir d0 39 2024-09-13T22:56:04.152 INFO:tasks.workunit.client.0.smithi002.stdout:9/289: dread - d8/d10/d42/f4c zero size 2024-09-13T22:56:04.154 INFO:tasks.workunit.client.0.smithi002.stdout:0/240: creat d1/d2/f56 x:0 0 0 2024-09-13T22:56:04.155 INFO:tasks.workunit.client.0.smithi002.stdout:0/241: stat d1/d2/f45 0 2024-09-13T22:56:04.155 INFO:tasks.workunit.client.0.smithi002.stdout:0/242: write d1/d2/d10/d31/f41 [118697,11046] 0 2024-09-13T22:56:04.156 INFO:tasks.workunit.client.1.smithi047.stdout:6/408: dwrite d3/d11/d2b/d1c/d70/f86 [0,4194304] 0 2024-09-13T22:56:04.157 INFO:tasks.workunit.client.1.smithi047.stdout:6/409: write d3/d11/d2b/d1c/f1e [2633188,91500] 0 2024-09-13T22:56:04.158 INFO:tasks.workunit.client.0.smithi002.stdout:1/291: rename d1/d13/d1d/d2e to d1/d13/d30/d31/d3d/d5d 0 2024-09-13T22:56:04.159 INFO:tasks.workunit.client.1.smithi047.stdout:6/410: fdatasync d3/d11/d2b/f60 0 2024-09-13T22:56:04.159 INFO:tasks.workunit.client.1.smithi047.stdout:7/419: symlink d0/d57/d5b/d8b/l8c 0 2024-09-13T22:56:04.161 INFO:tasks.workunit.client.1.smithi047.stdout:7/420: fsync d0/db/f4c 0 2024-09-13T22:56:04.161 INFO:tasks.workunit.client.0.smithi002.stdout:3/303: stat d9/d15/c20 0 2024-09-13T22:56:04.162 INFO:tasks.workunit.client.1.smithi047.stdout:7/421: dread - d0/d19/f7f zero size 2024-09-13T22:56:04.165 INFO:tasks.workunit.client.0.smithi002.stdout:6/249: dwrite d12/d17/d28/f2f [0,4194304] 0 2024-09-13T22:56:04.167 INFO:tasks.workunit.client.0.smithi002.stdout:8/245: link d3/dc/f26 d3/dc/d16/f4d 0 2024-09-13T22:56:04.167 INFO:tasks.workunit.client.1.smithi047.stdout:9/321: chown d1/c11 375874 1 2024-09-13T22:56:04.169 INFO:tasks.workunit.client.1.smithi047.stdout:8/362: chown d8/d36/l76 13278104 1 2024-09-13T22:56:04.170 INFO:tasks.workunit.client.0.smithi002.stdout:8/246: write d3/dc/f22 [47183,66839] 0 2024-09-13T22:56:04.171 INFO:tasks.workunit.client.0.smithi002.stdout:4/218: mknod d3/d14/d29/d2a/c46 0 2024-09-13T22:56:04.176 INFO:tasks.workunit.client.0.smithi002.stdout:0/243: creat d1/d2/d10/d31/d32/f57 x:0 0 0 2024-09-13T22:56:04.177 INFO:tasks.workunit.client.1.smithi047.stdout:9/322: dread d1/dc/d14/dd/d54/f37 [0,4194304] 0 2024-09-13T22:56:04.182 INFO:tasks.workunit.client.1.smithi047.stdout:9/323: dread d1/dc/d18/f33 [0,4194304] 0 2024-09-13T22:56:04.182 INFO:tasks.workunit.client.0.smithi002.stdout:0/244: dwrite d1/d2/d10/d31/d3c/f43 [0,4194304] 0 2024-09-13T22:56:04.188 INFO:tasks.workunit.client.0.smithi002.stdout:7/192: truncate f7 46689 0 2024-09-13T22:56:04.189 INFO:tasks.workunit.client.1.smithi047.stdout:1/319: dread d0/d7/f44 [0,4194304] 0 2024-09-13T22:56:04.189 INFO:tasks.workunit.client.1.smithi047.stdout:1/320: chown d0 717 1 2024-09-13T22:56:04.194 INFO:tasks.workunit.client.1.smithi047.stdout:6/411: mknod d3/d11/d2b/d7c/c8d 0 2024-09-13T22:56:04.197 INFO:tasks.workunit.client.1.smithi047.stdout:5/299: creat d19/d23/f6a x:0 0 0 2024-09-13T22:56:04.201 INFO:tasks.workunit.client.1.smithi047.stdout:6/412: dwrite d3/d11/d2b/d1c/d23/f39 [0,4194304] 0 2024-09-13T22:56:04.202 INFO:tasks.workunit.client.0.smithi002.stdout:3/304: creat d9/d15/d26/f6e x:0 0 0 2024-09-13T22:56:04.204 INFO:tasks.workunit.client.0.smithi002.stdout:5/243: mkdir d1/d57 0 2024-09-13T22:56:04.205 INFO:tasks.workunit.client.1.smithi047.stdout:5/300: dwrite d19/f1d [4194304,4194304] 0 2024-09-13T22:56:04.207 INFO:tasks.workunit.client.1.smithi047.stdout:5/301: chown d19/d25/d45/f4e 2785 1 2024-09-13T22:56:04.207 INFO:tasks.workunit.client.1.smithi047.stdout:7/422: symlink d0/d57/d5b/d8b/l8d 0 2024-09-13T22:56:04.209 INFO:tasks.workunit.client.0.smithi002.stdout:0/245: creat d1/d2/d10/f58 x:0 0 0 2024-09-13T22:56:04.212 INFO:tasks.workunit.client.0.smithi002.stdout:6/250: mkdir d12/d17/d4e 0 2024-09-13T22:56:04.213 INFO:tasks.workunit.client.1.smithi047.stdout:8/363: chown d8/f13 1604 1 2024-09-13T22:56:04.215 INFO:tasks.workunit.client.1.smithi047.stdout:4/350: getdents dc/de/d17/d25/d4a 0 2024-09-13T22:56:04.218 INFO:tasks.workunit.client.1.smithi047.stdout:4/351: read dc/de/d17/d25/f36 [62441,88462] 0 2024-09-13T22:56:04.221 INFO:tasks.workunit.client.0.smithi002.stdout:9/290: truncate d8/d10/d42/f51 764678 0 2024-09-13T22:56:04.222 INFO:tasks.workunit.client.0.smithi002.stdout:8/247: symlink d3/dc/d18/d2e/d46/l4e 0 2024-09-13T22:56:04.223 INFO:tasks.workunit.client.1.smithi047.stdout:3/408: truncate d0/d3/d4/f3e 6433157 0 2024-09-13T22:56:04.225 INFO:tasks.workunit.client.0.smithi002.stdout:1/292: rename d1/d13/d30/d31/d3d/c55 to d1/d13/d21/c5e 0 2024-09-13T22:56:04.229 INFO:tasks.workunit.client.0.smithi002.stdout:3/305: dread d9/d15/d51/f21 [0,4194304] 0 2024-09-13T22:56:04.229 INFO:tasks.workunit.client.0.smithi002.stdout:3/306: dread - d9/f66 zero size 2024-09-13T22:56:04.230 INFO:tasks.workunit.client.1.smithi047.stdout:0/375: creat d1/d5/d11/f85 x:0 0 0 2024-09-13T22:56:04.231 INFO:tasks.workunit.client.0.smithi002.stdout:0/246: dread d1/f17 [0,4194304] 0 2024-09-13T22:56:04.231 INFO:tasks.workunit.client.0.smithi002.stdout:6/251: creat d12/d17/d2a/f4f x:0 0 0 2024-09-13T22:56:04.232 INFO:tasks.workunit.client.0.smithi002.stdout:0/247: dread - d1/d2/d10/d31/d32/f57 zero size 2024-09-13T22:56:04.233 INFO:tasks.workunit.client.0.smithi002.stdout:3/307: dread d9/d3b/f61 [0,4194304] 0 2024-09-13T22:56:04.233 INFO:tasks.workunit.client.1.smithi047.stdout:1/321: unlink d0/d7/d10/f3f 0 2024-09-13T22:56:04.234 INFO:tasks.workunit.client.0.smithi002.stdout:2/235: getdents d1/d32 0 2024-09-13T22:56:04.236 INFO:tasks.workunit.client.0.smithi002.stdout:7/193: write d8/d10/f32 [1732764,115288] 0 2024-09-13T22:56:04.237 INFO:tasks.workunit.client.1.smithi047.stdout:6/413: read - d3/d11/f81 zero size 2024-09-13T22:56:04.239 INFO:tasks.workunit.client.1.smithi047.stdout:5/302: rmdir d19/d23 39 2024-09-13T22:56:04.241 INFO:tasks.workunit.client.0.smithi002.stdout:4/219: dwrite d3/f24 [0,4194304] 0 2024-09-13T22:56:04.244 INFO:tasks.workunit.client.0.smithi002.stdout:4/220: write d3/f21 [1888215,6222] 0 2024-09-13T22:56:04.245 INFO:tasks.workunit.client.0.smithi002.stdout:2/236: dwrite d1/d7/d8/f33 [0,4194304] 0 2024-09-13T22:56:04.250 INFO:tasks.workunit.client.0.smithi002.stdout:5/244: symlink d1/l58 0 2024-09-13T22:56:04.252 INFO:tasks.workunit.client.1.smithi047.stdout:4/352: write dc/de/d23/d40/f59 [450668,22489] 0 2024-09-13T22:56:04.253 INFO:tasks.workunit.client.1.smithi047.stdout:4/353: stat dc/d29/f38 0 2024-09-13T22:56:04.254 INFO:tasks.workunit.client.0.smithi002.stdout:0/248: dread d1/d2/f19 [0,4194304] 0 2024-09-13T22:56:04.257 INFO:tasks.workunit.client.1.smithi047.stdout:3/409: unlink d0/d3/d4/l75 0 2024-09-13T22:56:04.258 INFO:tasks.workunit.client.1.smithi047.stdout:3/410: stat d0/d3/d4/d16/d73/f7c 0 2024-09-13T22:56:04.260 INFO:tasks.workunit.client.1.smithi047.stdout:9/324: creat d1/d5f/f64 x:0 0 0 2024-09-13T22:56:04.262 INFO:tasks.workunit.client.0.smithi002.stdout:9/291: mkdir d8/d10/d61 0 2024-09-13T22:56:04.263 INFO:tasks.workunit.client.1.smithi047.stdout:0/376: write d1/d5/d16/f3c [2894552,18884] 0 2024-09-13T22:56:04.264 INFO:tasks.workunit.client.0.smithi002.stdout:7/194: unlink d8/d10/c1b 0 2024-09-13T22:56:04.265 INFO:tasks.workunit.client.0.smithi002.stdout:7/195: dread - d8/d10/f23 zero size 2024-09-13T22:56:04.266 INFO:tasks.workunit.client.1.smithi047.stdout:1/322: mkdir d0/d1d/d5b 0 2024-09-13T22:56:04.270 INFO:tasks.workunit.client.0.smithi002.stdout:4/221: write d3/d14/f1f [4941996,3370] 0 2024-09-13T22:56:04.272 INFO:tasks.workunit.client.1.smithi047.stdout:8/364: rename d8/d36/d38/l72 to d8/d64/l7d 0 2024-09-13T22:56:04.274 INFO:tasks.workunit.client.1.smithi047.stdout:4/354: mkdir dc/de/d23/d40/d7b 0 2024-09-13T22:56:04.275 INFO:tasks.workunit.client.0.smithi002.stdout:4/222: dwrite f2 [0,4194304] 0 2024-09-13T22:56:04.276 INFO:tasks.workunit.client.1.smithi047.stdout:3/411: read d0/d3/d4/d16/d2c/de/d3d/f50 [697859,99477] 0 2024-09-13T22:56:04.281 INFO:tasks.workunit.client.0.smithi002.stdout:5/245: mkdir d1/d2a/d41/d45/d59 0 2024-09-13T22:56:04.283 INFO:tasks.workunit.client.1.smithi047.stdout:2/497: link d1/df/c65 d1/df/d1d/d3c/ca4 0 2024-09-13T22:56:04.285 INFO:tasks.workunit.client.1.smithi047.stdout:9/325: dwrite d1/dc/d14/dd/d4c/f57 [0,4194304] 0 2024-09-13T22:56:04.285 INFO:tasks.workunit.client.0.smithi002.stdout:3/308: creat d9/d15/d46/f6f x:0 0 0 2024-09-13T22:56:04.287 INFO:tasks.workunit.client.1.smithi047.stdout:7/423: truncate d0/db/f16 1309153 0 2024-09-13T22:56:04.291 INFO:tasks.workunit.client.0.smithi002.stdout:8/248: creat d3/f4f x:0 0 0 2024-09-13T22:56:04.292 INFO:tasks.workunit.client.1.smithi047.stdout:7/424: read d0/d7/da/d4e/f66 [1669520,117823] 0 2024-09-13T22:56:04.293 INFO:tasks.workunit.client.1.smithi047.stdout:5/303: rename c13 to d19/d64/c6b 0 2024-09-13T22:56:04.294 INFO:tasks.workunit.client.1.smithi047.stdout:5/304: stat d19/l21 0 2024-09-13T22:56:04.296 INFO:tasks.workunit.client.1.smithi047.stdout:9/326: dread d1/f25 [0,4194304] 0 2024-09-13T22:56:04.296 INFO:tasks.workunit.client.1.smithi047.stdout:8/365: creat d8/d64/d4e/d4d/f7e x:0 0 0 2024-09-13T22:56:04.297 INFO:tasks.workunit.client.1.smithi047.stdout:9/327: chown d1/c32 119 1 2024-09-13T22:56:04.298 INFO:tasks.workunit.client.1.smithi047.stdout:8/366: dread - d8/d64/d4e/d4d/f7e zero size 2024-09-13T22:56:04.298 INFO:tasks.workunit.client.1.smithi047.stdout:4/355: write dc/de/d23/f6f [268975,122838] 0 2024-09-13T22:56:04.298 INFO:tasks.workunit.client.1.smithi047.stdout:3/412: rmdir d0/d25/d44/d43 39 2024-09-13T22:56:04.300 INFO:tasks.workunit.client.1.smithi047.stdout:9/328: read d1/dc/f15 [1284431,24318] 0 2024-09-13T22:56:04.300 INFO:tasks.workunit.client.0.smithi002.stdout:2/237: truncate d1/d7/d8/f31 1137560 0 2024-09-13T22:56:04.300 INFO:tasks.workunit.client.1.smithi047.stdout:8/367: fsync d8/d36/d40/f5c 0 2024-09-13T22:56:04.301 INFO:tasks.workunit.client.1.smithi047.stdout:9/329: chown d1/dc/cf 27643901 1 2024-09-13T22:56:04.301 INFO:tasks.workunit.client.1.smithi047.stdout:4/356: read dc/de/f3f [1162572,112268] 0 2024-09-13T22:56:04.303 INFO:tasks.workunit.client.1.smithi047.stdout:4/357: write f8 [3231969,31377] 0 2024-09-13T22:56:04.304 INFO:tasks.workunit.client.1.smithi047.stdout:4/358: fsync fb 0 2024-09-13T22:56:04.306 INFO:tasks.workunit.client.1.smithi047.stdout:4/359: write dc/d29/f41 [239213,63236] 0 2024-09-13T22:56:04.307 INFO:tasks.workunit.client.0.smithi002.stdout:5/246: rename d1/d2a/d41/d45/d59 to d1/d2a/d5a 0 2024-09-13T22:56:04.307 INFO:tasks.workunit.client.1.smithi047.stdout:8/368: dread d8/f27 [0,4194304] 0 2024-09-13T22:56:04.308 INFO:tasks.workunit.client.1.smithi047.stdout:8/369: stat d8/d64/f7c 0 2024-09-13T22:56:04.311 INFO:tasks.workunit.client.0.smithi002.stdout:5/247: dread d1/f3a [0,4194304] 0 2024-09-13T22:56:04.313 INFO:tasks.workunit.client.0.smithi002.stdout:5/248: dread d1/d2a/d41/d45/f48 [0,4194304] 0 2024-09-13T22:56:04.318 INFO:tasks.workunit.client.0.smithi002.stdout:1/293: getdents d1/d13/d30/d31 0 2024-09-13T22:56:04.322 INFO:tasks.workunit.client.0.smithi002.stdout:3/309: write d9/d15/d51/f21 [1439333,39448] 0 2024-09-13T22:56:04.324 INFO:tasks.workunit.client.0.smithi002.stdout:1/294: dwrite d1/d13/d30/d31/d3d/d5d/f37 [4194304,4194304] 0 2024-09-13T22:56:04.324 INFO:tasks.workunit.client.0.smithi002.stdout:3/310: readlink d9/d15/d26/d44/d58/l62 0 2024-09-13T22:56:04.325 INFO:tasks.workunit.client.0.smithi002.stdout:3/311: readlink d9/d3b/d53/l56 0 2024-09-13T22:56:04.326 INFO:tasks.workunit.client.0.smithi002.stdout:0/249: creat d1/f59 x:0 0 0 2024-09-13T22:56:04.328 INFO:tasks.workunit.client.0.smithi002.stdout:6/252: getdents d12/d17/d34/d39 0 2024-09-13T22:56:04.329 INFO:tasks.workunit.client.1.smithi047.stdout:3/413: dwrite d0/d25/d44/d43/f6b [0,4194304] 0 2024-09-13T22:56:04.332 INFO:tasks.workunit.client.1.smithi047.stdout:3/414: dread - d0/d3/d4/f7b zero size 2024-09-13T22:56:04.332 INFO:tasks.workunit.client.1.smithi047.stdout:3/415: chown d0/d3/d4/d16/d2c/f46 1624812 1 2024-09-13T22:56:04.335 INFO:tasks.workunit.client.1.smithi047.stdout:4/360: creat dc/d29/d4d/f7c x:0 0 0 2024-09-13T22:56:04.336 INFO:tasks.workunit.client.0.smithi002.stdout:9/292: creat d8/d10/f62 x:0 0 0 2024-09-13T22:56:04.337 INFO:tasks.workunit.client.0.smithi002.stdout:9/293: readlink l2 0 2024-09-13T22:56:04.337 INFO:tasks.workunit.client.0.smithi002.stdout:9/294: readlink d8/d10/l16 0 2024-09-13T22:56:04.338 INFO:tasks.workunit.client.0.smithi002.stdout:9/295: dread - d8/d10/f59 zero size 2024-09-13T22:56:04.338 INFO:tasks.workunit.client.0.smithi002.stdout:9/296: stat d8/d10/f59 0 2024-09-13T22:56:04.341 INFO:tasks.workunit.client.1.smithi047.stdout:1/323: creat d0/f5c x:0 0 0 2024-09-13T22:56:04.341 INFO:tasks.workunit.client.1.smithi047.stdout:3/416: dwrite d0/d3/d4/f7b [0,4194304] 0 2024-09-13T22:56:04.344 INFO:tasks.workunit.client.1.smithi047.stdout:8/370: mknod d8/d64/d4e/d4d/c7f 0 2024-09-13T22:56:04.345 INFO:tasks.workunit.client.0.smithi002.stdout:2/238: mknod d1/d7/d41/c46 0 2024-09-13T22:56:04.346 INFO:tasks.workunit.client.1.smithi047.stdout:8/371: write d8/d36/d40/f5c [201197,6469] 0 2024-09-13T22:56:04.348 INFO:tasks.workunit.client.1.smithi047.stdout:8/372: chown d8/d36/d38/f45 220 1 2024-09-13T22:56:04.350 INFO:tasks.workunit.client.1.smithi047.stdout:6/414: getdents d3/d11/d2b/d1c/d4d 0 2024-09-13T22:56:04.355 INFO:tasks.workunit.client.1.smithi047.stdout:5/305: mkdir d19/d34/d6c 0 2024-09-13T22:56:04.355 INFO:tasks.workunit.client.0.smithi002.stdout:3/312: creat d9/d3b/f70 x:0 0 0 2024-09-13T22:56:04.356 INFO:tasks.workunit.client.0.smithi002.stdout:3/313: fdatasync d9/d3b/f64 0 2024-09-13T22:56:04.357 INFO:tasks.workunit.client.0.smithi002.stdout:6/253: rmdir d12/d17 39 2024-09-13T22:56:04.362 INFO:tasks.workunit.client.1.smithi047.stdout:5/306: dwrite d19/f1c [0,4194304] 0 2024-09-13T22:56:04.362 INFO:tasks.workunit.client.0.smithi002.stdout:5/249: rename d1/d10/f20 to d1/d2a/d41/f5b 0 2024-09-13T22:56:04.365 INFO:tasks.workunit.client.0.smithi002.stdout:8/249: creat d3/dc/d16/f50 x:0 0 0 2024-09-13T22:56:04.365 INFO:tasks.workunit.client.0.smithi002.stdout:8/250: readlink d3/d21/l45 0 2024-09-13T22:56:04.366 INFO:tasks.workunit.client.0.smithi002.stdout:7/196: sync 2024-09-13T22:56:04.368 INFO:tasks.workunit.client.0.smithi002.stdout:7/197: truncate d8/d10/f32 2104071 0 2024-09-13T22:56:04.369 INFO:tasks.workunit.client.1.smithi047.stdout:5/307: dwrite d19/d25/d45/f47 [0,4194304] 0 2024-09-13T22:56:04.377 INFO:tasks.workunit.client.0.smithi002.stdout:3/314: unlink d9/f69 0 2024-09-13T22:56:04.381 INFO:tasks.workunit.client.0.smithi002.stdout:0/250: rename d1/d4/fb to d1/d2/d49/f5a 0 2024-09-13T22:56:04.382 INFO:tasks.workunit.client.0.smithi002.stdout:0/251: read d1/d2/f29 [163235,90389] 0 2024-09-13T22:56:04.383 INFO:tasks.workunit.client.0.smithi002.stdout:9/297: mkdir d8/d10/d53/d63 0 2024-09-13T22:56:04.384 INFO:tasks.workunit.client.1.smithi047.stdout:2/498: link d1/d16/c55 d1/de/d17/ca5 0 2024-09-13T22:56:04.384 INFO:tasks.workunit.client.0.smithi002.stdout:9/298: fdatasync d8/d2c/f58 0 2024-09-13T22:56:04.386 INFO:tasks.workunit.client.1.smithi047.stdout:0/377: link d1/ld d1/d5/d11/d83/l86 0 2024-09-13T22:56:04.387 INFO:tasks.workunit.client.0.smithi002.stdout:4/223: getdents d3/d14/d25 0 2024-09-13T22:56:04.389 INFO:tasks.workunit.client.0.smithi002.stdout:3/315: mkdir d9/df/d71 0 2024-09-13T22:56:04.390 INFO:tasks.workunit.client.1.smithi047.stdout:1/324: mkdir d0/d7/d13/d5d 0 2024-09-13T22:56:04.391 INFO:tasks.workunit.client.0.smithi002.stdout:6/254: write d12/d17/f27 [687830,120103] 0 2024-09-13T22:56:04.392 INFO:tasks.workunit.client.1.smithi047.stdout:3/417: creat d0/d25/d44/d5a/f8b x:0 0 0 2024-09-13T22:56:04.392 INFO:tasks.workunit.client.0.smithi002.stdout:6/255: write d12/d17/f27 [668836,118212] 0 2024-09-13T22:56:04.397 INFO:tasks.workunit.client.0.smithi002.stdout:5/250: symlink d1/d57/l5c 0 2024-09-13T22:56:04.398 INFO:tasks.workunit.client.1.smithi047.stdout:7/425: link d0/db/f7e d0/d7/da/d2e/d64/f8e 0 2024-09-13T22:56:04.402 INFO:tasks.workunit.client.0.smithi002.stdout:0/252: unlink d1/d4/l15 0 2024-09-13T22:56:04.403 INFO:tasks.workunit.client.0.smithi002.stdout:0/253: read d1/d2/f1d [493762,107617] 0 2024-09-13T22:56:04.406 INFO:tasks.workunit.client.0.smithi002.stdout:1/295: sync 2024-09-13T22:56:04.407 INFO:tasks.workunit.client.0.smithi002.stdout:1/296: fsync d1/f24 0 2024-09-13T22:56:04.409 INFO:tasks.workunit.client.0.smithi002.stdout:2/239: creat d1/d7/f47 x:0 0 0 2024-09-13T22:56:04.409 INFO:tasks.workunit.client.1.smithi047.stdout:9/330: link d1/l5e d1/dc/d14/dd/d54/d50/d5b/l65 0 2024-09-13T22:56:04.410 INFO:tasks.workunit.client.1.smithi047.stdout:9/331: chown d1/c23 8 1 2024-09-13T22:56:04.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:04 smithi047 ceph-mon[34560]: pgmap v12: 65 pgs: 65 active+clean; 1.1 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 15 MiB/s rd, 152 MiB/s wr, 321 op/s 2024-09-13T22:56:04.418 INFO:tasks.workunit.client.1.smithi047.stdout:1/325: symlink d0/d7/d14/l5e 0 2024-09-13T22:56:04.420 INFO:tasks.workunit.client.1.smithi047.stdout:3/418: unlink d0/d3/d4/d16/d73/f7c 0 2024-09-13T22:56:04.421 INFO:tasks.workunit.client.0.smithi002.stdout:5/251: rmdir d1/d2a/d41/d45/d4f 39 2024-09-13T22:56:04.422 INFO:tasks.workunit.client.1.smithi047.stdout:8/373: dwrite d8/f10 [4194304,4194304] 0 2024-09-13T22:56:04.425 INFO:tasks.workunit.client.0.smithi002.stdout:8/251: rename d3/dc/d41 to d3/dc/d51 0 2024-09-13T22:56:04.426 INFO:tasks.workunit.client.0.smithi002.stdout:7/198: write d8/d9/f19 [915327,56696] 0 2024-09-13T22:56:04.427 INFO:tasks.workunit.client.1.smithi047.stdout:6/415: mkdir d3/d11/d2b/d1c/d70/d89/d8e 0 2024-09-13T22:56:04.430 INFO:tasks.workunit.client.1.smithi047.stdout:6/416: read d3/d11/d2b/d4c/d30/d48/f7e [499746,57970] 0 2024-09-13T22:56:04.433 INFO:tasks.workunit.client.1.smithi047.stdout:4/361: truncate dc/d29/f41 4018974 0 2024-09-13T22:56:04.433 INFO:tasks.workunit.client.0.smithi002.stdout:9/299: symlink d8/d10/d53/d63/l64 0 2024-09-13T22:56:04.434 INFO:tasks.workunit.client.0.smithi002.stdout:7/199: dread d8/d9/f19 [0,4194304] 0 2024-09-13T22:56:04.434 INFO:tasks.workunit.client.0.smithi002.stdout:9/300: dread - d8/d10/f62 zero size 2024-09-13T22:56:04.437 INFO:tasks.workunit.client.1.smithi047.stdout:9/332: rmdir d1/dc/d14/dd/d4c 39 2024-09-13T22:56:04.438 INFO:tasks.workunit.client.1.smithi047.stdout:0/378: dwrite d1/d5/d11/f35 [0,4194304] 0 2024-09-13T22:56:04.441 INFO:tasks.workunit.client.0.smithi002.stdout:4/224: symlink d3/d14/l47 0 2024-09-13T22:56:04.441 INFO:tasks.workunit.client.1.smithi047.stdout:7/426: dwrite d0/d19/f7c [0,4194304] 0 2024-09-13T22:56:04.444 INFO:tasks.workunit.client.1.smithi047.stdout:6/417: dread d3/d11/d2b/f6f [0,4194304] 0 2024-09-13T22:56:04.447 INFO:tasks.workunit.client.1.smithi047.stdout:1/326: mknod d0/d7/d14/c5f 0 2024-09-13T22:56:04.447 INFO:tasks.workunit.client.1.smithi047.stdout:3/419: unlink d0/d3/d4/d16/d2c/de/d1f/c55 0 2024-09-13T22:56:04.453 INFO:tasks.workunit.client.1.smithi047.stdout:5/308: unlink d19/d23/d2e/c33 0 2024-09-13T22:56:04.453 INFO:tasks.workunit.client.0.smithi002.stdout:8/252: symlink d3/dc/d18/l52 0 2024-09-13T22:56:04.454 INFO:tasks.workunit.client.1.smithi047.stdout:5/309: read - d19/d23/d4c/f67 zero size 2024-09-13T22:56:04.459 INFO:tasks.workunit.client.1.smithi047.stdout:2/499: mkdir d1/d8a/da6 0 2024-09-13T22:56:04.461 INFO:tasks.workunit.client.0.smithi002.stdout:9/301: symlink d8/d10/d1c/l65 0 2024-09-13T22:56:04.464 INFO:tasks.workunit.client.0.smithi002.stdout:1/297: mknod d1/d13/d1d/d34/d51/c5f 0 2024-09-13T22:56:04.466 INFO:tasks.workunit.client.1.smithi047.stdout:7/427: fsync d0/d7/da/f2b 0 2024-09-13T22:56:04.471 INFO:tasks.workunit.client.1.smithi047.stdout:9/333: read d1/dc/d14/dd/d54/d4e/d51/f5d [72455,65959] 0 2024-09-13T22:56:04.472 INFO:tasks.workunit.client.0.smithi002.stdout:8/253: rename d3/c30 to d3/dc/d18/c53 0 2024-09-13T22:56:04.474 INFO:tasks.workunit.client.1.smithi047.stdout:1/327: creat d0/d1d/f60 x:0 0 0 2024-09-13T22:56:04.481 INFO:tasks.workunit.client.1.smithi047.stdout:3/420: rename d0/d3/d4/d16/d32/d42/f83 to d0/d3/d4/d16/d2c/de/f8c 0 2024-09-13T22:56:04.481 INFO:tasks.workunit.client.1.smithi047.stdout:3/421: truncate d0/f12 5036823 0 2024-09-13T22:56:04.481 INFO:tasks.workunit.client.0.smithi002.stdout:8/254: dwrite d3/d27/f32 [0,4194304] 0 2024-09-13T22:56:04.481 INFO:tasks.workunit.client.0.smithi002.stdout:9/302: unlink d8/d10/f17 0 2024-09-13T22:56:04.483 INFO:tasks.workunit.client.0.smithi002.stdout:1/298: rmdir d1/d13/d30 39 2024-09-13T22:56:04.484 INFO:tasks.workunit.client.0.smithi002.stdout:6/256: truncate f1 2644505 0 2024-09-13T22:56:04.485 INFO:tasks.workunit.client.0.smithi002.stdout:6/257: fdatasync d12/d17/f48 0 2024-09-13T22:56:04.487 INFO:tasks.workunit.client.0.smithi002.stdout:2/240: link d1/f23 d1/d7/d35/f48 0 2024-09-13T22:56:04.487 INFO:tasks.workunit.client.1.smithi047.stdout:5/310: creat d19/d25/d45/f6d x:0 0 0 2024-09-13T22:56:04.487 INFO:tasks.workunit.client.0.smithi002.stdout:2/241: write d1/f1f [5823629,24155] 0 2024-09-13T22:56:04.489 INFO:tasks.workunit.client.0.smithi002.stdout:1/299: dwrite d1/d1c/f4c [0,4194304] 0 2024-09-13T22:56:04.491 INFO:tasks.workunit.client.0.smithi002.stdout:0/254: link d1/d2/f18 d1/d2/d49/f5b 0 2024-09-13T22:56:04.496 INFO:tasks.workunit.client.0.smithi002.stdout:0/255: dwrite d1/d2/fd [0,4194304] 0 2024-09-13T22:56:04.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:04 smithi002 ceph-mon[27637]: pgmap v12: 65 pgs: 65 active+clean; 1.1 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 15 MiB/s rd, 152 MiB/s wr, 321 op/s 2024-09-13T22:56:04.502 INFO:tasks.workunit.client.0.smithi002.stdout:3/316: truncate d9/d15/d36/d4e/f50 92650 0 2024-09-13T22:56:04.504 INFO:tasks.workunit.client.0.smithi002.stdout:3/317: write d9/d3b/f64 [247442,123949] 0 2024-09-13T22:56:04.506 INFO:tasks.workunit.client.1.smithi047.stdout:0/379: dwrite d1/d5/d11/d2f/f38 [0,4194304] 0 2024-09-13T22:56:04.508 INFO:tasks.workunit.client.1.smithi047.stdout:0/380: write d1/d5/d11/f20 [1366717,40671] 0 2024-09-13T22:56:04.514 INFO:tasks.workunit.client.1.smithi047.stdout:2/500: link d1/df/d1d/d20/f8f d1/df/d1d/d2e/fa7 0 2024-09-13T22:56:04.515 INFO:tasks.workunit.client.1.smithi047.stdout:2/501: dread - d1/df/d35/f78 zero size 2024-09-13T22:56:04.524 INFO:tasks.workunit.client.1.smithi047.stdout:1/328: symlink d0/d1d/d5b/l61 0 2024-09-13T22:56:04.524 INFO:tasks.workunit.client.0.smithi002.stdout:9/303: write d8/d10/d42/f4d [650243,126402] 0 2024-09-13T22:56:04.526 INFO:tasks.workunit.client.0.smithi002.stdout:6/258: symlink d12/d17/l50 0 2024-09-13T22:56:04.530 INFO:tasks.workunit.client.0.smithi002.stdout:2/242: symlink d1/d7/d35/d3e/l49 0 2024-09-13T22:56:04.531 INFO:tasks.workunit.client.1.smithi047.stdout:3/422: write d0/d3/f15 [1425196,31793] 0 2024-09-13T22:56:04.533 INFO:tasks.workunit.client.1.smithi047.stdout:5/311: creat d19/d34/d42/d5d/f6e x:0 0 0 2024-09-13T22:56:04.533 INFO:tasks.workunit.client.1.smithi047.stdout:9/334: dwrite d1/f25 [0,4194304] 0 2024-09-13T22:56:04.534 INFO:tasks.workunit.client.0.smithi002.stdout:1/300: rmdir d1/d13/d30/d31/d3b 39 2024-09-13T22:56:04.534 INFO:tasks.workunit.client.1.smithi047.stdout:9/335: chown d1/f24 838952900 1 2024-09-13T22:56:04.535 INFO:tasks.workunit.client.0.smithi002.stdout:1/301: stat d1/d13/d21/d40/f5c 0 2024-09-13T22:56:04.536 INFO:tasks.workunit.client.0.smithi002.stdout:1/302: chown d1/d13/f19 47177561 1 2024-09-13T22:56:04.540 INFO:tasks.workunit.client.1.smithi047.stdout:4/362: link dc/c11 dc/d29/d6c/c7d 0 2024-09-13T22:56:04.544 INFO:tasks.workunit.client.0.smithi002.stdout:3/318: dread d9/d15/f2f [0,4194304] 0 2024-09-13T22:56:04.545 INFO:tasks.workunit.client.1.smithi047.stdout:6/418: getdents d3/d2c 0 2024-09-13T22:56:04.549 INFO:tasks.workunit.client.1.smithi047.stdout:1/329: read d0/d7/d14/d28/d36/f32 [1864192,94545] 0 2024-09-13T22:56:04.550 INFO:tasks.workunit.client.0.smithi002.stdout:3/319: dwrite d9/f66 [0,4194304] 0 2024-09-13T22:56:04.551 INFO:tasks.workunit.client.0.smithi002.stdout:1/303: symlink d1/d13/d21/d39/l60 0 2024-09-13T22:56:04.552 INFO:tasks.workunit.client.1.smithi047.stdout:3/423: mkdir d0/d25/d44/d5a/d8d 0 2024-09-13T22:56:04.553 INFO:tasks.workunit.client.1.smithi047.stdout:6/419: dwrite d3/f42 [0,4194304] 0 2024-09-13T22:56:04.553 INFO:tasks.workunit.client.0.smithi002.stdout:8/255: link d3/dc/d16/d2f/c3d d3/dc/d34/c54 0 2024-09-13T22:56:04.554 INFO:tasks.workunit.client.0.smithi002.stdout:8/256: fdatasync d3/dc/f42 0 2024-09-13T22:56:04.556 INFO:tasks.workunit.client.1.smithi047.stdout:9/336: write d1/dc/d14/dd/d54/d4e/d51/f53 [997383,24743] 0 2024-09-13T22:56:04.560 INFO:tasks.workunit.client.1.smithi047.stdout:0/381: mknod d1/d5/d11/c87 0 2024-09-13T22:56:04.563 INFO:tasks.workunit.client.0.smithi002.stdout:9/304: creat d8/d10/d61/f66 x:0 0 0 2024-09-13T22:56:04.564 INFO:tasks.workunit.client.1.smithi047.stdout:2/502: symlink d1/df/d26/d9f/la8 0 2024-09-13T22:56:04.564 INFO:tasks.workunit.client.1.smithi047.stdout:2/503: stat d1 0 2024-09-13T22:56:04.564 INFO:tasks.workunit.client.0.smithi002.stdout:9/305: chown d8/d10/d1c/c24 1240 1 2024-09-13T22:56:04.568 INFO:tasks.workunit.client.0.smithi002.stdout:7/200: sync 2024-09-13T22:56:04.568 INFO:tasks.workunit.client.0.smithi002.stdout:5/252: sync 2024-09-13T22:56:04.568 INFO:tasks.workunit.client.1.smithi047.stdout:6/420: mkdir d3/d77/d8f 0 2024-09-13T22:56:04.569 INFO:tasks.workunit.client.0.smithi002.stdout:9/306: dread d8/d1e/f34 [0,4194304] 0 2024-09-13T22:56:04.570 INFO:tasks.workunit.client.0.smithi002.stdout:9/307: chown d8/d2c/f47 189 1 2024-09-13T22:56:04.570 INFO:tasks.workunit.client.1.smithi047.stdout:3/424: creat d0/d3/d4/d16/d2c/de/d1f/f8e x:0 0 0 2024-09-13T22:56:04.572 INFO:tasks.workunit.client.1.smithi047.stdout:9/337: creat d1/dc/d14/dd/d54/d50/f66 x:0 0 0 2024-09-13T22:56:04.574 INFO:tasks.workunit.client.0.smithi002.stdout:3/320: chown d9/d15/d51/c4c 175841904 1 2024-09-13T22:56:04.575 INFO:tasks.workunit.client.1.smithi047.stdout:0/382: mkdir d1/d5/d11/d2f/d88 0 2024-09-13T22:56:04.575 INFO:tasks.workunit.client.0.smithi002.stdout:3/321: write d9/f5a [364089,70262] 0 2024-09-13T22:56:04.576 INFO:tasks.workunit.client.1.smithi047.stdout:0/383: fdatasync d1/d5/d11/f2b 0 2024-09-13T22:56:04.578 INFO:tasks.workunit.client.1.smithi047.stdout:4/363: fsync dc/de/d23/f37 0 2024-09-13T22:56:04.582 INFO:tasks.workunit.client.1.smithi047.stdout:1/330: mkdir d0/d7/d14/d57/d62 0 2024-09-13T22:56:04.583 INFO:tasks.workunit.client.0.smithi002.stdout:5/253: dread d1/f3e [0,4194304] 0 2024-09-13T22:56:04.586 INFO:tasks.workunit.client.1.smithi047.stdout:6/421: rename d3/d11/d2b/d1c/d4d/f62 to d3/d11/d2b/d1c/d4d/d69/f90 0 2024-09-13T22:56:04.587 INFO:tasks.workunit.client.0.smithi002.stdout:6/259: creat d12/f51 x:0 0 0 2024-09-13T22:56:04.590 INFO:tasks.workunit.client.0.smithi002.stdout:1/304: write d1/d13/d30/d31/f41 [943514,130531] 0 2024-09-13T22:56:04.591 INFO:tasks.workunit.client.0.smithi002.stdout:1/305: readlink d1/d13/d30/l1b 0 2024-09-13T22:56:04.591 INFO:tasks.workunit.client.1.smithi047.stdout:9/338: dread d1/dc/d18/f33 [0,4194304] 0 2024-09-13T22:56:04.592 INFO:tasks.workunit.client.1.smithi047.stdout:9/339: readlink d1/l59 0 2024-09-13T22:56:04.594 INFO:tasks.workunit.client.0.smithi002.stdout:2/243: rename d1/d7/d42 to d1/d4a 0 2024-09-13T22:56:04.595 INFO:tasks.workunit.client.0.smithi002.stdout:2/244: fdatasync d1/d7/d8/d2c/f2d 0 2024-09-13T22:56:04.595 INFO:tasks.workunit.client.0.smithi002.stdout:1/306: dread d1/d13/d21/f36 [0,4194304] 0 2024-09-13T22:56:04.595 INFO:tasks.workunit.client.1.smithi047.stdout:0/384: truncate d1/d5/d16/d23/d2d/f55 478180 0 2024-09-13T22:56:04.596 INFO:tasks.workunit.client.0.smithi002.stdout:2/245: dread - d1/d7/d8/d2c/f39 zero size 2024-09-13T22:56:04.598 INFO:tasks.workunit.client.0.smithi002.stdout:7/201: dread d8/d10/d11/d13/f1c [0,4194304] 0 2024-09-13T22:56:04.599 INFO:tasks.workunit.client.1.smithi047.stdout:4/364: creat dc/de/d17/d25/f7e x:0 0 0 2024-09-13T22:56:04.600 INFO:tasks.workunit.client.1.smithi047.stdout:4/365: chown ca 124395130 1 2024-09-13T22:56:04.601 INFO:tasks.workunit.client.1.smithi047.stdout:4/366: chown dc/d29/f4e 0 1 2024-09-13T22:56:04.602 INFO:tasks.workunit.client.1.smithi047.stdout:2/504: mkdir d1/df/d1d/da9 0 2024-09-13T22:56:04.603 INFO:tasks.workunit.client.1.smithi047.stdout:0/385: dwrite d1/d5/f3f [0,4194304] 0 2024-09-13T22:56:04.604 INFO:tasks.workunit.client.0.smithi002.stdout:3/322: mknod d9/d15/d51/c72 0 2024-09-13T22:56:04.604 INFO:tasks.workunit.client.1.smithi047.stdout:4/367: fdatasync dc/d29/d4d/f48 0 2024-09-13T22:56:04.605 INFO:tasks.workunit.client.1.smithi047.stdout:4/368: stat dc/de/d39/l73 0 2024-09-13T22:56:04.606 INFO:tasks.workunit.client.1.smithi047.stdout:4/369: readlink dc/de/d23/l6a 0 2024-09-13T22:56:04.608 INFO:tasks.workunit.client.1.smithi047.stdout:1/331: mknod d0/d7/d13/d2d/c63 0 2024-09-13T22:56:04.608 INFO:tasks.workunit.client.1.smithi047.stdout:4/370: chown f4 26 1 2024-09-13T22:56:04.610 INFO:tasks.workunit.client.1.smithi047.stdout:6/422: creat d3/d11/d2b/d4c/d30/f91 x:0 0 0 2024-09-13T22:56:04.611 INFO:tasks.workunit.client.1.smithi047.stdout:6/423: chown d3/f8 193985383 1 2024-09-13T22:56:04.615 INFO:tasks.workunit.client.0.smithi002.stdout:5/254: readlink d1/d10/l16 0 2024-09-13T22:56:04.615 INFO:tasks.workunit.client.0.smithi002.stdout:0/256: link d1/c16 d1/c5c 0 2024-09-13T22:56:04.616 INFO:tasks.workunit.client.0.smithi002.stdout:5/255: write d1/f3 [2851247,97104] 0 2024-09-13T22:56:04.616 INFO:tasks.workunit.client.0.smithi002.stdout:5/256: readlink d1/lf 0 2024-09-13T22:56:04.620 INFO:tasks.workunit.client.0.smithi002.stdout:4/225: sync 2024-09-13T22:56:04.620 INFO:tasks.workunit.client.0.smithi002.stdout:4/226: dread - d3/d14/f42 zero size 2024-09-13T22:56:04.664 INFO:tasks.workunit.client.1.smithi047.stdout:0/386: rename d1/d5/d16/d23/l58 to d1/d5/d16/d6a/l89 0 2024-09-13T22:56:04.665 INFO:tasks.workunit.client.0.smithi002.stdout:1/307: symlink d1/d13/d1d/d34/l61 0 2024-09-13T22:56:04.667 INFO:tasks.workunit.client.1.smithi047.stdout:1/332: creat d0/d7/f64 x:0 0 0 2024-09-13T22:56:04.668 INFO:tasks.workunit.client.1.smithi047.stdout:9/340: mknod d1/dc/d14/dd/d54/d50/d5b/c67 0 2024-09-13T22:56:04.669 INFO:tasks.workunit.client.1.smithi047.stdout:9/341: chown d1/la 58267187 1 2024-09-13T22:56:04.669 INFO:tasks.workunit.client.1.smithi047.stdout:0/387: dread d1/d5/d11/f20 [0,4194304] 0 2024-09-13T22:56:04.675 INFO:tasks.workunit.client.1.smithi047.stdout:4/371: rename dc/de/d17/d25/d4a/c5b to dc/de/d23/d40/d7b/c7f 0 2024-09-13T22:56:04.676 INFO:tasks.workunit.client.1.smithi047.stdout:4/372: readlink dc/d29/l72 0 2024-09-13T22:56:04.676 INFO:tasks.workunit.client.0.smithi002.stdout:3/323: mknod d9/d3b/c73 0 2024-09-13T22:56:04.677 INFO:tasks.workunit.client.1.smithi047.stdout:4/373: truncate dc/de/d17/f74 4766077 0 2024-09-13T22:56:04.680 INFO:tasks.workunit.client.1.smithi047.stdout:0/388: rmdir d1/d5/d16/d6a 39 2024-09-13T22:56:04.682 INFO:tasks.workunit.client.1.smithi047.stdout:0/389: fdatasync d1/d5/f59 0 2024-09-13T22:56:04.682 INFO:tasks.workunit.client.0.smithi002.stdout:0/257: unlink d1/d2/d10/d31/d32/f57 0 2024-09-13T22:56:04.682 INFO:tasks.workunit.client.0.smithi002.stdout:0/258: stat d1/f59 0 2024-09-13T22:56:04.685 INFO:tasks.workunit.client.1.smithi047.stdout:0/390: write d1/d5/f3f [2348937,120864] 0 2024-09-13T22:56:04.688 INFO:tasks.workunit.client.1.smithi047.stdout:2/505: link d1/f97 d1/df/d26/faa 0 2024-09-13T22:56:04.689 INFO:tasks.workunit.client.1.smithi047.stdout:1/333: dwrite d0/d7/d13/f42 [0,4194304] 0 2024-09-13T22:56:04.691 INFO:tasks.workunit.client.1.smithi047.stdout:4/374: dread dc/de/d23/f6f [0,4194304] 0 2024-09-13T22:56:04.691 INFO:tasks.workunit.client.0.smithi002.stdout:6/260: unlink d12/d17/c1d 0 2024-09-13T22:56:04.692 INFO:tasks.workunit.client.1.smithi047.stdout:1/334: dread d0/d7/f44 [0,4194304] 0 2024-09-13T22:56:04.692 INFO:tasks.workunit.client.0.smithi002.stdout:4/227: dwrite d3/d14/f2b [0,4194304] 0 2024-09-13T22:56:04.693 INFO:tasks.workunit.client.0.smithi002.stdout:6/261: fsync d12/d17/d28/d3e/f40 0 2024-09-13T22:56:04.697 INFO:tasks.workunit.client.1.smithi047.stdout:6/424: rename d3/d11/d2b/f60 to d3/d77/d8f/f92 0 2024-09-13T22:56:04.697 INFO:tasks.workunit.client.1.smithi047.stdout:1/335: chown d0/d7/d13/d2d/f59 3 1 2024-09-13T22:56:04.697 INFO:tasks.workunit.client.1.smithi047.stdout:6/425: chown d3/lc 1 1 2024-09-13T22:56:04.697 INFO:tasks.workunit.client.0.smithi002.stdout:4/228: write d3/d14/d29/d2a/f36 [117525,96983] 0 2024-09-13T22:56:04.697 INFO:tasks.workunit.client.0.smithi002.stdout:4/229: read d3/f24 [1538545,104421] 0 2024-09-13T22:56:04.699 INFO:tasks.workunit.client.0.smithi002.stdout:1/308: creat d1/d13/d30/d31/d3d/d5d/f62 x:0 0 0 2024-09-13T22:56:04.702 INFO:tasks.workunit.client.1.smithi047.stdout:4/375: dwrite f4 [0,4194304] 0 2024-09-13T22:56:04.703 INFO:tasks.workunit.client.0.smithi002.stdout:2/246: creat d1/d32/d37/d3a/f4b x:0 0 0 2024-09-13T22:56:04.706 INFO:tasks.workunit.client.0.smithi002.stdout:9/308: link d8/d10/d42/f4c d8/d1e/f67 0 2024-09-13T22:56:04.708 INFO:tasks.workunit.client.0.smithi002.stdout:2/247: dwrite d1/f1f [4194304,4194304] 0 2024-09-13T22:56:04.710 INFO:tasks.workunit.client.0.smithi002.stdout:8/257: getdents d3/dc/d34 0 2024-09-13T22:56:04.712 INFO:tasks.workunit.client.1.smithi047.stdout:2/506: creat d1/df/d1d/d20/d37/d7b/fab x:0 0 0 2024-09-13T22:56:04.715 INFO:tasks.workunit.client.0.smithi002.stdout:3/324: dwrite d9/f16 [4194304,4194304] 0 2024-09-13T22:56:04.728 INFO:tasks.workunit.client.0.smithi002.stdout:5/257: sync 2024-09-13T22:56:04.731 INFO:tasks.workunit.client.1.smithi047.stdout:4/376: unlink dc/de/d23/d40/f63 0 2024-09-13T22:56:04.734 INFO:tasks.workunit.client.1.smithi047.stdout:0/391: mknod d1/c8a 0 2024-09-13T22:56:04.738 INFO:tasks.workunit.client.0.smithi002.stdout:7/202: rename d8/f24 to d8/f37 0 2024-09-13T22:56:04.739 INFO:tasks.workunit.client.0.smithi002.stdout:1/309: dwrite d1/d13/d21/f36 [0,4194304] 0 2024-09-13T22:56:04.739 INFO:tasks.workunit.client.0.smithi002.stdout:9/309: mkdir d8/d10/d1c/d68 0 2024-09-13T22:56:04.740 INFO:tasks.workunit.client.0.smithi002.stdout:7/203: write d8/d10/d11/d13/f21 [202695,103591] 0 2024-09-13T22:56:04.740 INFO:tasks.workunit.client.1.smithi047.stdout:0/392: dwrite d1/d5/d16/d47/f4d [0,4194304] 0 2024-09-13T22:56:04.741 INFO:tasks.workunit.client.0.smithi002.stdout:1/310: truncate d1/d13/d1d/f3a 214306 0 2024-09-13T22:56:04.743 INFO:tasks.workunit.client.0.smithi002.stdout:2/248: mknod d1/d7/d41/c4c 0 2024-09-13T22:56:04.744 INFO:tasks.workunit.client.0.smithi002.stdout:1/311: write d1/f24 [1303936,56678] 0 2024-09-13T22:56:04.745 INFO:tasks.workunit.client.0.smithi002.stdout:1/312: readlink d1/d13/d30/l1b 0 2024-09-13T22:56:04.747 INFO:tasks.workunit.client.0.smithi002.stdout:1/313: readlink d1/d13/d21/d39/l60 0 2024-09-13T22:56:04.749 INFO:tasks.workunit.client.0.smithi002.stdout:7/204: dwrite d8/fb [0,4194304] 0 2024-09-13T22:56:04.749 INFO:tasks.workunit.client.0.smithi002.stdout:8/258: creat d3/dc/d18/d2e/d46/f55 x:0 0 0 2024-09-13T22:56:04.751 INFO:tasks.workunit.client.0.smithi002.stdout:7/205: dread - d8/f27 zero size 2024-09-13T22:56:04.752 INFO:tasks.workunit.client.1.smithi047.stdout:0/393: dwrite d1/d5/d16/d23/d2d/f31 [4194304,4194304] 0 2024-09-13T22:56:04.753 INFO:tasks.workunit.client.0.smithi002.stdout:7/206: read d8/d10/d11/d13/f21 [477020,128186] 0 2024-09-13T22:56:04.755 INFO:tasks.workunit.client.0.smithi002.stdout:7/207: write d8/d10/d11/f2d [944977,65408] 0 2024-09-13T22:56:04.756 INFO:tasks.workunit.client.0.smithi002.stdout:7/208: fsync d8/d10/f32 0 2024-09-13T22:56:04.757 INFO:tasks.workunit.client.0.smithi002.stdout:7/209: truncate d8/d10/f2b 102216 0 2024-09-13T22:56:04.757 INFO:tasks.workunit.client.1.smithi047.stdout:6/426: write d3/d11/f3f [1499222,128183] 0 2024-09-13T22:56:04.759 INFO:tasks.workunit.client.1.smithi047.stdout:6/427: chown d3/d2c/c52 6284 1 2024-09-13T22:56:04.761 INFO:tasks.workunit.client.1.smithi047.stdout:4/377: fsync dc/d29/f41 0 2024-09-13T22:56:04.761 INFO:tasks.workunit.client.1.smithi047.stdout:1/336: truncate d0/d7/d13/f39 465152 0 2024-09-13T22:56:04.762 INFO:tasks.workunit.client.1.smithi047.stdout:4/378: chown dc/de/d23 15 1 2024-09-13T22:56:04.763 INFO:tasks.workunit.client.0.smithi002.stdout:5/258: rmdir d1/d2a/d41/d45 39 2024-09-13T22:56:04.764 INFO:tasks.workunit.client.0.smithi002.stdout:5/259: truncate d1/f13 993491 0 2024-09-13T22:56:04.764 INFO:tasks.workunit.client.1.smithi047.stdout:4/379: chown dc/d29/f35 5858305 1 2024-09-13T22:56:04.769 INFO:tasks.workunit.client.1.smithi047.stdout:6/428: mkdir d3/d77/d93 0 2024-09-13T22:56:04.772 INFO:tasks.workunit.client.0.smithi002.stdout:4/230: getdents d3/d14/d25 0 2024-09-13T22:56:04.774 INFO:tasks.workunit.client.1.smithi047.stdout:0/394: dread d1/d7/ff [0,4194304] 0 2024-09-13T22:56:04.775 INFO:tasks.workunit.client.1.smithi047.stdout:1/337: rename d0/d7/l8 to d0/d7/d10/d55/l65 0 2024-09-13T22:56:04.776 INFO:tasks.workunit.client.1.smithi047.stdout:1/338: fsync d0/d7/d14/d28/d36/f4c 0 2024-09-13T22:56:04.777 INFO:tasks.workunit.client.1.smithi047.stdout:4/380: unlink dc/d29/d4c/f5f 0 2024-09-13T22:56:04.785 INFO:tasks.workunit.client.0.smithi002.stdout:9/310: dread d8/d10/d1c/f2b [0,4194304] 0 2024-09-13T22:56:04.785 INFO:tasks.workunit.client.0.smithi002.stdout:9/311: fdatasync d8/d10/d1c/f19 0 2024-09-13T22:56:04.788 INFO:tasks.workunit.client.1.smithi047.stdout:0/395: write d1/f2 [5000188,130470] 0 2024-09-13T22:56:04.790 INFO:tasks.workunit.client.1.smithi047.stdout:0/396: chown d1/d5/d16/d23/d45/d7f/f78 24098 1 2024-09-13T22:56:04.791 INFO:tasks.workunit.client.1.smithi047.stdout:4/381: dread dc/f19 [0,4194304] 0 2024-09-13T22:56:04.792 INFO:tasks.workunit.client.0.smithi002.stdout:9/312: dwrite d8/d10/d1c/d3d/f44 [0,4194304] 0 2024-09-13T22:56:04.797 INFO:tasks.workunit.client.1.smithi047.stdout:0/397: symlink d1/d5/d16/d23/d77/l8b 0 2024-09-13T22:56:04.797 INFO:tasks.workunit.client.1.smithi047.stdout:6/429: truncate d3/f8 3730325 0 2024-09-13T22:56:04.800 INFO:tasks.workunit.client.1.smithi047.stdout:0/398: write d1/d5/d16/d23/d45/f4f [2093371,84834] 0 2024-09-13T22:56:04.802 INFO:tasks.workunit.client.1.smithi047.stdout:0/399: truncate d1/d5/d11/f85 612142 0 2024-09-13T22:56:04.803 INFO:tasks.workunit.client.1.smithi047.stdout:6/430: symlink d3/d77/d8f/l94 0 2024-09-13T22:56:04.803 INFO:tasks.workunit.client.0.smithi002.stdout:7/210: dwrite d8/f37 [0,4194304] 0 2024-09-13T22:56:04.804 INFO:tasks.workunit.client.1.smithi047.stdout:0/400: chown d1/d7/c73 1150400 1 2024-09-13T22:56:04.806 INFO:tasks.workunit.client.0.smithi002.stdout:2/249: truncate d1/d7/d8/f10 1167149 0 2024-09-13T22:56:04.807 INFO:tasks.workunit.client.0.smithi002.stdout:8/259: truncate d3/dc/d16/f4d 3502941 0 2024-09-13T22:56:04.808 INFO:tasks.workunit.client.0.smithi002.stdout:5/260: dwrite d1/f3e [4194304,4194304] 0 2024-09-13T22:56:04.808 INFO:tasks.workunit.client.1.smithi047.stdout:6/431: write d3/d11/d2b/d1c/d70/f75 [3798797,92786] 0 2024-09-13T22:56:04.809 INFO:tasks.workunit.client.0.smithi002.stdout:1/314: dread d1/d13/d30/f59 [0,4194304] 0 2024-09-13T22:56:04.809 INFO:tasks.workunit.client.0.smithi002.stdout:2/250: dread - d1/d7/d8/d2c/f44 zero size 2024-09-13T22:56:04.811 INFO:tasks.workunit.client.1.smithi047.stdout:4/382: creat dc/de/d23/f80 x:0 0 0 2024-09-13T22:56:04.817 INFO:tasks.workunit.client.0.smithi002.stdout:3/325: link d9/d15/d26/l5d d9/d3b/l74 0 2024-09-13T22:56:04.819 INFO:tasks.workunit.client.1.smithi047.stdout:6/432: symlink d3/d11/d2b/d7c/l95 0 2024-09-13T22:56:04.819 INFO:tasks.workunit.client.0.smithi002.stdout:0/259: getdents d1/d2/d10/d31 0 2024-09-13T22:56:04.820 INFO:tasks.workunit.client.1.smithi047.stdout:6/433: stat d3/d11/d2b/d4c 0 2024-09-13T22:56:04.821 INFO:tasks.workunit.client.0.smithi002.stdout:6/262: link d12/d17/f18 d12/d17/d4e/f52 0 2024-09-13T22:56:04.821 INFO:tasks.workunit.client.1.smithi047.stdout:4/383: dwrite dc/fd [0,4194304] 0 2024-09-13T22:56:04.824 INFO:tasks.workunit.client.1.smithi047.stdout:0/401: creat d1/d5/f8c x:0 0 0 2024-09-13T22:56:04.825 INFO:tasks.workunit.client.1.smithi047.stdout:4/384: truncate dc/de/d23/f80 473053 0 2024-09-13T22:56:04.826 INFO:tasks.workunit.client.1.smithi047.stdout:4/385: chown dc/de/d17/d25/d4a/f50 4499536 1 2024-09-13T22:56:04.827 INFO:tasks.workunit.client.0.smithi002.stdout:7/211: mkdir d8/d10/d11/d13/d26/d38 0 2024-09-13T22:56:04.828 INFO:tasks.workunit.client.0.smithi002.stdout:7/212: dread - d8/d10/f23 zero size 2024-09-13T22:56:04.829 INFO:tasks.workunit.client.1.smithi047.stdout:6/434: mknod d3/d11/d2b/d4c/c96 0 2024-09-13T22:56:04.832 INFO:tasks.workunit.client.1.smithi047.stdout:0/402: creat d1/d5/d11/d2f/f8d x:0 0 0 2024-09-13T22:56:04.835 INFO:tasks.workunit.client.0.smithi002.stdout:8/260: unlink d3/f4 0 2024-09-13T22:56:04.837 INFO:tasks.workunit.client.0.smithi002.stdout:9/313: symlink d8/d1e/l69 0 2024-09-13T22:56:04.842 INFO:tasks.workunit.client.0.smithi002.stdout:1/315: truncate d1/d13/d30/fa 1460700 0 2024-09-13T22:56:04.843 INFO:tasks.workunit.client.0.smithi002.stdout:9/314: dwrite d8/d10/f2f [0,4194304] 0 2024-09-13T22:56:04.843 INFO:tasks.workunit.client.0.smithi002.stdout:4/231: sync 2024-09-13T22:56:04.845 INFO:tasks.workunit.client.1.smithi047.stdout:4/386: creat dc/de/d23/f81 x:0 0 0 2024-09-13T22:56:04.849 INFO:tasks.workunit.client.0.smithi002.stdout:6/263: symlink d12/d17/d28/d3e/l53 0 2024-09-13T22:56:04.849 INFO:tasks.workunit.client.1.smithi047.stdout:4/387: creat dc/d29/d4c/f82 x:0 0 0 2024-09-13T22:56:04.849 INFO:tasks.workunit.client.0.smithi002.stdout:6/264: stat d12/d17/d28/f35 0 2024-09-13T22:56:04.850 INFO:tasks.workunit.client.0.smithi002.stdout:7/213: truncate f7 566312 0 2024-09-13T22:56:04.851 INFO:tasks.workunit.client.1.smithi047.stdout:0/403: getdents d1/d7 0 2024-09-13T22:56:04.853 INFO:tasks.workunit.client.0.smithi002.stdout:8/261: mkdir d3/dc/d18/d56 0 2024-09-13T22:56:04.855 INFO:tasks.workunit.client.0.smithi002.stdout:2/251: unlink d1/f23 0 2024-09-13T22:56:04.856 INFO:tasks.workunit.client.1.smithi047.stdout:4/388: dwrite dc/d29/d4c/f82 [0,4194304] 0 2024-09-13T22:56:04.857 INFO:tasks.workunit.client.1.smithi047.stdout:0/404: unlink d1/d5/d16/c43 0 2024-09-13T22:56:04.863 INFO:tasks.workunit.client.1.smithi047.stdout:4/389: rmdir dc/de/d17/d25/d4a 39 2024-09-13T22:56:04.868 INFO:tasks.workunit.client.0.smithi002.stdout:1/316: read d1/ff [252891,122537] 0 2024-09-13T22:56:04.868 INFO:tasks.workunit.client.0.smithi002.stdout:9/315: creat d8/d2c/f6a x:0 0 0 2024-09-13T22:56:04.868 INFO:tasks.workunit.client.0.smithi002.stdout:9/316: chown d8/d10/d1c/d3d 818 1 2024-09-13T22:56:04.869 INFO:tasks.workunit.client.0.smithi002.stdout:1/317: readlink d1/d13/d21/d39/l60 0 2024-09-13T22:56:04.869 INFO:tasks.workunit.client.0.smithi002.stdout:9/317: readlink d8/l4a 0 2024-09-13T22:56:04.872 INFO:tasks.workunit.client.0.smithi002.stdout:3/326: rmdir d9/d15/d35 39 2024-09-13T22:56:04.874 INFO:tasks.workunit.client.1.smithi047.stdout:0/405: link d1/d7/f81 d1/d5/d11/d52/f8e 0 2024-09-13T22:56:04.876 INFO:tasks.workunit.client.0.smithi002.stdout:0/260: link d1/d2/d10/d31/d32/f39 d1/d2/d10/d31/d3c/f5d 0 2024-09-13T22:56:04.877 INFO:tasks.workunit.client.0.smithi002.stdout:6/265: mknod d12/d17/d34/c54 0 2024-09-13T22:56:04.878 INFO:tasks.workunit.client.0.smithi002.stdout:7/214: mkdir d8/d10/d39 0 2024-09-13T22:56:04.879 INFO:tasks.workunit.client.0.smithi002.stdout:7/215: dread - d8/d10/f23 zero size 2024-09-13T22:56:04.880 INFO:tasks.workunit.client.1.smithi047.stdout:0/406: mkdir d1/d5/d16/d23/d2d/d8f 0 2024-09-13T22:56:04.886 INFO:tasks.workunit.client.0.smithi002.stdout:2/252: dread d1/d7/d8/f10 [0,4194304] 0 2024-09-13T22:56:04.888 INFO:tasks.workunit.client.1.smithi047.stdout:0/407: mknod d1/d5/d16/d6a/c90 0 2024-09-13T22:56:04.889 INFO:tasks.workunit.client.1.smithi047.stdout:4/390: truncate dc/de/f53 668776 0 2024-09-13T22:56:04.889 INFO:tasks.workunit.client.1.smithi047.stdout:0/408: dread - d1/d5/d11/d2f/f8d zero size 2024-09-13T22:56:04.891 INFO:tasks.workunit.client.0.smithi002.stdout:5/261: rename d1/d10/f2d to d1/d2a/d41/f5d 0 2024-09-13T22:56:04.892 INFO:tasks.workunit.client.1.smithi047.stdout:8/374: sync 2024-09-13T22:56:04.893 INFO:tasks.workunit.client.0.smithi002.stdout:9/318: creat d8/d10/d61/f6b x:0 0 0 2024-09-13T22:56:04.893 INFO:tasks.workunit.client.0.smithi002.stdout:9/319: readlink d8/d10/d1c/l65 0 2024-09-13T22:56:04.894 INFO:tasks.workunit.client.1.smithi047.stdout:8/375: chown d8/d36/f3c 1194 1 2024-09-13T22:56:04.894 INFO:tasks.workunit.client.1.smithi047.stdout:4/391: write dc/de/f18 [4847490,55844] 0 2024-09-13T22:56:04.894 INFO:tasks.workunit.client.0.smithi002.stdout:9/320: read d8/d10/d1c/d3d/f48 [2773360,99797] 0 2024-09-13T22:56:04.895 INFO:tasks.workunit.client.1.smithi047.stdout:4/392: write dc/d29/d4d/f48 [2848483,50066] 0 2024-09-13T22:56:04.895 INFO:tasks.workunit.client.0.smithi002.stdout:4/232: mknod d3/d40/d45/c48 0 2024-09-13T22:56:04.896 INFO:tasks.workunit.client.0.smithi002.stdout:9/321: truncate d8/d10/f3c 827831 0 2024-09-13T22:56:04.896 INFO:tasks.workunit.client.1.smithi047.stdout:4/393: readlink dc/de/d23/d40/l5e 0 2024-09-13T22:56:04.901 INFO:tasks.workunit.client.1.smithi047.stdout:4/394: chown dc/d29/f4e 149378833 1 2024-09-13T22:56:05.001 INFO:tasks.workunit.client.1.smithi047.stdout:8/376: symlink d8/d64/d4e/d4d/l80 0 2024-09-13T22:56:05.002 INFO:tasks.workunit.client.1.smithi047.stdout:8/377: stat d8/d64/d4e/d70 0 2024-09-13T22:56:05.003 INFO:tasks.workunit.client.1.smithi047.stdout:0/409: mkdir d1/d5/d91 0 2024-09-13T22:56:05.007 INFO:tasks.workunit.client.1.smithi047.stdout:0/410: mkdir d1/d5/d16/d6a/d92 0 2024-09-13T22:56:05.010 INFO:tasks.workunit.client.1.smithi047.stdout:0/411: creat d1/d5/d16/d47/f93 x:0 0 0 2024-09-13T22:56:05.011 INFO:tasks.workunit.client.0.smithi002.stdout:5/262: symlink d1/d2a/d5a/l5e 0 2024-09-13T22:56:05.011 INFO:tasks.workunit.client.1.smithi047.stdout:0/412: write d1/f40 [4686709,61552] 0 2024-09-13T22:56:05.018 INFO:tasks.workunit.client.0.smithi002.stdout:9/322: chown d8/d1e/f45 0 1 2024-09-13T22:56:05.018 INFO:tasks.workunit.client.0.smithi002.stdout:2/253: write d1/f1d [2434697,21922] 0 2024-09-13T22:56:05.019 INFO:tasks.workunit.client.0.smithi002.stdout:4/233: dread d3/f21 [0,4194304] 0 2024-09-13T22:56:05.019 INFO:tasks.workunit.client.1.smithi047.stdout:4/395: link dc/de/d23/f55 dc/de/d23/f83 0 2024-09-13T22:56:05.020 INFO:tasks.workunit.client.1.smithi047.stdout:4/396: chown dc/de/d39 2 1 2024-09-13T22:56:05.020 INFO:tasks.workunit.client.0.smithi002.stdout:3/327: readlink d9/d15/d26/d44/d58/l62 0 2024-09-13T22:56:05.021 INFO:tasks.workunit.client.1.smithi047.stdout:8/378: link d8/l63 d8/d64/l81 0 2024-09-13T22:56:05.021 INFO:tasks.workunit.client.1.smithi047.stdout:8/379: readlink d8/d64/d4e/d4d/l5e 0 2024-09-13T22:56:05.023 INFO:tasks.workunit.client.0.smithi002.stdout:9/323: dread d8/d10/d1c/d3d/f3e [0,4194304] 0 2024-09-13T22:56:05.024 INFO:tasks.workunit.client.0.smithi002.stdout:9/324: chown d8/d2c/f56 1821883 1 2024-09-13T22:56:05.024 INFO:tasks.workunit.client.1.smithi047.stdout:4/397: creat dc/de/d39/f84 x:0 0 0 2024-09-13T22:56:05.026 INFO:tasks.workunit.client.1.smithi047.stdout:0/413: creat d1/d5/d16/f94 x:0 0 0 2024-09-13T22:56:05.029 INFO:tasks.workunit.client.1.smithi047.stdout:8/380: rename d8/d36/d40/l79 to d8/d64/d4e/l82 0 2024-09-13T22:56:05.029 INFO:tasks.workunit.client.1.smithi047.stdout:8/381: stat d8/d3f/l50 0 2024-09-13T22:56:05.030 INFO:tasks.workunit.client.0.smithi002.stdout:0/261: write d1/d4/f21 [1169442,110679] 0 2024-09-13T22:56:05.031 INFO:tasks.workunit.client.1.smithi047.stdout:8/382: write d8/d64/f57 [6940028,124978] 0 2024-09-13T22:56:05.032 INFO:tasks.workunit.client.1.smithi047.stdout:8/383: fdatasync d8/d36/d40/f5c 0 2024-09-13T22:56:05.036 INFO:tasks.workunit.client.1.smithi047.stdout:0/414: read d1/d7/f3e [2125441,50020] 0 2024-09-13T22:56:05.038 INFO:tasks.workunit.client.1.smithi047.stdout:4/398: dwrite dc/de/d17/d25/f36 [0,4194304] 0 2024-09-13T22:56:05.040 INFO:tasks.workunit.client.0.smithi002.stdout:4/234: read d3/d14/f16 [724962,49621] 0 2024-09-13T22:56:05.040 INFO:tasks.workunit.client.1.smithi047.stdout:4/399: write dc/de/d23/d40/f62 [1050031,87869] 0 2024-09-13T22:56:05.042 INFO:tasks.workunit.client.0.smithi002.stdout:4/235: dread - d3/d14/d29/d2a/f43 zero size 2024-09-13T22:56:05.042 INFO:tasks.workunit.client.0.smithi002.stdout:5/263: dwrite d1/f3a [0,4194304] 0 2024-09-13T22:56:05.042 INFO:tasks.workunit.client.1.smithi047.stdout:8/384: rename d8/d36 to d8/d6b/d83 0 2024-09-13T22:56:05.043 INFO:tasks.workunit.client.0.smithi002.stdout:5/264: fdatasync d1/d10/f4b 0 2024-09-13T22:56:05.044 INFO:tasks.workunit.client.0.smithi002.stdout:4/236: write d3/d14/d29/d2a/f44 [597503,53861] 0 2024-09-13T22:56:05.044 INFO:tasks.workunit.client.0.smithi002.stdout:5/265: readlink d1/d10/l16 0 2024-09-13T22:56:05.045 INFO:tasks.workunit.client.1.smithi047.stdout:8/385: dread - d8/d64/d4e/d4d/f7e zero size 2024-09-13T22:56:05.048 INFO:tasks.workunit.client.0.smithi002.stdout:3/328: fdatasync d9/d15/d26/d44/f6b 0 2024-09-13T22:56:05.048 INFO:tasks.workunit.client.0.smithi002.stdout:6/266: link d12/f1c d12/d17/d28/f55 0 2024-09-13T22:56:05.049 INFO:tasks.workunit.client.0.smithi002.stdout:6/267: chown d12 1004 1 2024-09-13T22:56:05.049 INFO:tasks.workunit.client.0.smithi002.stdout:8/262: truncate d3/dc/fd 665903 0 2024-09-13T22:56:05.050 INFO:tasks.workunit.client.0.smithi002.stdout:8/263: chown d3/dc/d18/d2e/d46/l4e 968 1 2024-09-13T22:56:05.052 INFO:tasks.workunit.client.1.smithi047.stdout:4/400: dwrite dc/de/d17/d25/f7e [0,4194304] 0 2024-09-13T22:56:05.052 INFO:tasks.workunit.client.0.smithi002.stdout:1/318: rename d1/d13/d30/f59 to d1/f63 0 2024-09-13T22:56:05.055 INFO:tasks.workunit.client.0.smithi002.stdout:8/264: dwrite d3/dc/fe [0,4194304] 0 2024-09-13T22:56:05.055 INFO:tasks.workunit.client.1.smithi047.stdout:8/386: readlink d8/d64/l7d 0 2024-09-13T22:56:05.058 INFO:tasks.workunit.client.0.smithi002.stdout:2/254: mkdir d1/d4d 0 2024-09-13T22:56:05.058 INFO:tasks.workunit.client.0.smithi002.stdout:2/255: stat d1/d7/f26 0 2024-09-13T22:56:05.067 INFO:tasks.workunit.client.1.smithi047.stdout:8/387: mknod d8/d6b/d83/c84 0 2024-09-13T22:56:05.067 INFO:tasks.workunit.client.1.smithi047.stdout:0/415: dwrite d1/d7/f3e [0,4194304] 0 2024-09-13T22:56:05.070 INFO:tasks.workunit.client.0.smithi002.stdout:4/237: mkdir d3/d40/d45/d49 0 2024-09-13T22:56:05.071 INFO:tasks.workunit.client.0.smithi002.stdout:5/266: creat d1/d2a/d41/d55/f5f x:0 0 0 2024-09-13T22:56:05.077 INFO:tasks.workunit.client.1.smithi047.stdout:7/428: sync 2024-09-13T22:56:05.078 INFO:tasks.workunit.client.0.smithi002.stdout:5/267: dwrite d1/d10/f51 [0,4194304] 0 2024-09-13T22:56:05.079 INFO:tasks.workunit.client.0.smithi002.stdout:5/268: dread - d1/d2a/d41/f4d zero size 2024-09-13T22:56:05.080 INFO:tasks.workunit.client.0.smithi002.stdout:3/329: creat d9/d15/d26/d44/f75 x:0 0 0 2024-09-13T22:56:05.081 INFO:tasks.workunit.client.1.smithi047.stdout:0/416: symlink d1/d5/d16/d23/d2d/l95 0 2024-09-13T22:56:05.083 INFO:tasks.workunit.client.0.smithi002.stdout:6/268: creat d12/d17/d2a/f56 x:0 0 0 2024-09-13T22:56:05.089 INFO:tasks.workunit.client.1.smithi047.stdout:4/401: dwrite dc/de/d23/f6f [0,4194304] 0 2024-09-13T22:56:05.089 INFO:tasks.workunit.client.0.smithi002.stdout:6/269: dwrite d12/d17/f4a [0,4194304] 0 2024-09-13T22:56:05.090 INFO:tasks.workunit.client.0.smithi002.stdout:6/270: write d12/d17/d28/d3e/f49 [480439,63855] 0 2024-09-13T22:56:05.091 INFO:tasks.workunit.client.0.smithi002.stdout:7/216: rename d8/d10/d11/d13/d2e/d36 to d8/d10/d11/d3a 0 2024-09-13T22:56:05.092 INFO:tasks.workunit.client.1.smithi047.stdout:0/417: mknod d1/d5/d16/d23/c96 0 2024-09-13T22:56:05.096 INFO:tasks.workunit.client.1.smithi047.stdout:4/402: chown dc/de/d17/c32 375616 1 2024-09-13T22:56:05.098 INFO:tasks.workunit.client.0.smithi002.stdout:7/217: dwrite d8/d10/d11/d13/f34 [0,4194304] 0 2024-09-13T22:56:05.100 INFO:tasks.workunit.client.0.smithi002.stdout:7/218: truncate d8/d10/f23 920662 0 2024-09-13T22:56:05.106 INFO:tasks.workunit.client.0.smithi002.stdout:8/265: unlink d3/dc/l1c 0 2024-09-13T22:56:05.106 INFO:tasks.workunit.client.1.smithi047.stdout:7/429: rename d0/d7/da/d2e/d37/l76 to d0/d7/da/d4e/l8f 0 2024-09-13T22:56:05.107 INFO:tasks.workunit.client.0.smithi002.stdout:2/256: creat d1/d7/d8/d2c/f4e x:0 0 0 2024-09-13T22:56:05.109 INFO:tasks.workunit.client.0.smithi002.stdout:4/238: creat d3/d14/d29/d2a/f4a x:0 0 0 2024-09-13T22:56:05.109 INFO:tasks.workunit.client.1.smithi047.stdout:8/388: dwrite d8/f27 [0,4194304] 0 2024-09-13T22:56:05.111 INFO:tasks.workunit.client.0.smithi002.stdout:3/330: dread - d9/d15/d46/f5f zero size 2024-09-13T22:56:05.113 INFO:tasks.workunit.client.1.smithi047.stdout:0/418: dwrite d1/d5/d16/d23/d45/d7f/f78 [4194304,4194304] 0 2024-09-13T22:56:05.117 INFO:tasks.workunit.client.1.smithi047.stdout:8/389: symlink d8/d6b/d83/d38/l85 0 2024-09-13T22:56:05.121 INFO:tasks.workunit.client.1.smithi047.stdout:4/403: dwrite dc/de/d17/d25/d4a/f50 [4194304,4194304] 0 2024-09-13T22:56:05.123 INFO:tasks.workunit.client.0.smithi002.stdout:4/239: dread d3/fb [0,4194304] 0 2024-09-13T22:56:05.123 INFO:tasks.workunit.client.0.smithi002.stdout:6/271: symlink d12/d17/d28/d3e/l57 0 2024-09-13T22:56:05.124 INFO:tasks.workunit.client.0.smithi002.stdout:4/240: write d3/d14/d25/f28 [513357,82275] 0 2024-09-13T22:56:05.127 INFO:tasks.workunit.client.0.smithi002.stdout:1/319: symlink d1/d13/d1d/l64 0 2024-09-13T22:56:05.128 INFO:tasks.workunit.client.0.smithi002.stdout:6/272: read d12/d17/d34/f38 [235702,107111] 0 2024-09-13T22:56:05.129 INFO:tasks.workunit.client.1.smithi047.stdout:0/419: read d1/d7/f26 [26923,95119] 0 2024-09-13T22:56:05.130 INFO:tasks.workunit.client.1.smithi047.stdout:4/404: rename dc/d29/c33 to dc/de/d17/d25/d4a/c85 0 2024-09-13T22:56:05.133 INFO:tasks.workunit.client.1.smithi047.stdout:8/390: creat d8/d77/f86 x:0 0 0 2024-09-13T22:56:05.134 INFO:tasks.workunit.client.0.smithi002.stdout:6/273: dwrite d12/d17/d2a/f56 [0,4194304] 0 2024-09-13T22:56:05.136 INFO:tasks.workunit.client.0.smithi002.stdout:6/274: chown d12/d17/d28/f55 6 1 2024-09-13T22:56:05.136 INFO:tasks.workunit.client.0.smithi002.stdout:2/257: unlink d1/d7/d8/f30 0 2024-09-13T22:56:05.138 INFO:tasks.workunit.client.1.smithi047.stdout:4/405: rename dc/d29/d4d/f65 to dc/de/d23/d40/d7b/f86 0 2024-09-13T22:56:05.146 INFO:tasks.workunit.client.0.smithi002.stdout:4/241: truncate d3/f10 3254284 0 2024-09-13T22:56:05.150 INFO:tasks.workunit.client.0.smithi002.stdout:2/258: dread d1/d7/d8/f17 [0,4194304] 0 2024-09-13T22:56:05.150 INFO:tasks.workunit.client.0.smithi002.stdout:2/259: stat d1/c6 0 2024-09-13T22:56:05.151 INFO:tasks.workunit.client.0.smithi002.stdout:4/242: dread d3/fb [0,4194304] 0 2024-09-13T22:56:05.152 INFO:tasks.workunit.client.0.smithi002.stdout:5/269: write d1/f18 [5038762,72215] 0 2024-09-13T22:56:05.153 INFO:tasks.workunit.client.0.smithi002.stdout:4/243: fsync d3/d14/d29/d2a/f37 0 2024-09-13T22:56:05.154 INFO:tasks.workunit.client.1.smithi047.stdout:0/420: dwrite d1/d5/d16/d23/f25 [0,4194304] 0 2024-09-13T22:56:05.158 INFO:tasks.workunit.client.0.smithi002.stdout:6/275: write d12/d17/d2a/f32 [3792010,106861] 0 2024-09-13T22:56:05.160 INFO:tasks.workunit.client.0.smithi002.stdout:7/219: write d8/d10/f1e [3339003,7539] 0 2024-09-13T22:56:05.161 INFO:tasks.workunit.client.1.smithi047.stdout:8/391: getdents d8/d64/d4e 0 2024-09-13T22:56:05.162 INFO:tasks.workunit.client.0.smithi002.stdout:6/276: dread d12/d17/d2a/f56 [0,4194304] 0 2024-09-13T22:56:05.163 INFO:tasks.workunit.client.1.smithi047.stdout:4/406: dread dc/f2f [0,4194304] 0 2024-09-13T22:56:05.166 INFO:tasks.workunit.client.0.smithi002.stdout:2/260: read d1/d7/d35/f48 [505181,45761] 0 2024-09-13T22:56:05.166 INFO:tasks.workunit.client.1.smithi047.stdout:8/392: chown d8/d64/d4e/c46 641192 1 2024-09-13T22:56:05.167 INFO:tasks.workunit.client.1.smithi047.stdout:4/407: fdatasync dc/de/d23/f37 0 2024-09-13T22:56:05.169 INFO:tasks.workunit.client.1.smithi047.stdout:8/393: rename d8/d64/f7c to d8/d6b/f87 0 2024-09-13T22:56:05.170 INFO:tasks.workunit.client.1.smithi047.stdout:8/394: chown d8/d64/f57 60 1 2024-09-13T22:56:05.171 INFO:tasks.workunit.client.0.smithi002.stdout:4/244: write d3/d14/f26 [3483153,100510] 0 2024-09-13T22:56:05.178 INFO:tasks.workunit.client.1.smithi047.stdout:4/408: mknod dc/de/d17/d25/c87 0 2024-09-13T22:56:05.179 INFO:tasks.workunit.client.0.smithi002.stdout:9/325: rename d8/d10/d1c/d3d/c57 to d8/d1e/c6c 0 2024-09-13T22:56:05.181 INFO:tasks.workunit.client.0.smithi002.stdout:9/326: chown d8/d10/d1c/c5c 8140 1 2024-09-13T22:56:05.181 INFO:tasks.workunit.client.0.smithi002.stdout:6/277: mknod d12/d17/d2a/c58 0 2024-09-13T22:56:05.181 INFO:tasks.workunit.client.0.smithi002.stdout:9/327: chown d8/d10/d1c/c35 7269923 1 2024-09-13T22:56:05.182 INFO:tasks.workunit.client.1.smithi047.stdout:4/409: rmdir dc/de/d17 39 2024-09-13T22:56:05.182 INFO:tasks.workunit.client.0.smithi002.stdout:5/270: symlink d1/d10/l60 0 2024-09-13T22:56:05.183 INFO:tasks.workunit.client.0.smithi002.stdout:2/261: mkdir d1/d7/d8/d4f 0 2024-09-13T22:56:05.186 INFO:tasks.workunit.client.0.smithi002.stdout:4/245: fsync d3/f21 0 2024-09-13T22:56:05.187 INFO:tasks.workunit.client.0.smithi002.stdout:7/220: fsync d8/f12 0 2024-09-13T22:56:05.189 INFO:tasks.workunit.client.0.smithi002.stdout:0/262: rename d1/d2/d10/l40 to d1/d4/l5e 0 2024-09-13T22:56:05.190 INFO:tasks.workunit.client.0.smithi002.stdout:0/263: write d1/d4/f24 [3268660,75533] 0 2024-09-13T22:56:05.190 INFO:tasks.workunit.client.0.smithi002.stdout:6/278: creat d12/d17/d2a/f59 x:0 0 0 2024-09-13T22:56:05.191 INFO:tasks.workunit.client.1.smithi047.stdout:8/395: dwrite d8/d6b/d83/d40/f48 [4194304,4194304] 0 2024-09-13T22:56:05.192 INFO:tasks.workunit.client.0.smithi002.stdout:0/264: chown d1/d2/d10/d31/d3c/f43 2 1 2024-09-13T22:56:05.192 INFO:tasks.workunit.client.1.smithi047.stdout:4/410: dwrite dc/f19 [0,4194304] 0 2024-09-13T22:56:05.193 INFO:tasks.workunit.client.0.smithi002.stdout:0/265: chown d1/d2/d10/c53 13428853 1 2024-09-13T22:56:05.193 INFO:tasks.workunit.client.0.smithi002.stdout:9/328: creat d8/d2c/d50/f6d x:0 0 0 2024-09-13T22:56:05.199 INFO:tasks.workunit.client.0.smithi002.stdout:4/246: symlink d3/d14/d25/l4b 0 2024-09-13T22:56:05.199 INFO:tasks.workunit.client.0.smithi002.stdout:4/247: chown d3/d14/f16 1 1 2024-09-13T22:56:05.202 INFO:tasks.workunit.client.1.smithi047.stdout:8/396: write d8/f30 [4811546,85729] 0 2024-09-13T22:56:05.206 INFO:tasks.workunit.client.0.smithi002.stdout:1/320: rename d1/d13/d21/d39/f49 to d1/d1c/f65 0 2024-09-13T22:56:05.206 INFO:tasks.workunit.client.0.smithi002.stdout:4/248: dread d3/d14/d29/d2a/f36 [0,4194304] 0 2024-09-13T22:56:05.207 INFO:tasks.workunit.client.0.smithi002.stdout:1/321: chown d1/d13/d21/d39/l60 3170 1 2024-09-13T22:56:05.210 INFO:tasks.workunit.client.0.smithi002.stdout:6/279: creat d12/d17/d34/f5a x:0 0 0 2024-09-13T22:56:05.211 INFO:tasks.workunit.client.1.smithi047.stdout:8/397: symlink d8/d6b/d83/d38/l88 0 2024-09-13T22:56:05.212 INFO:tasks.workunit.client.0.smithi002.stdout:8/266: sync 2024-09-13T22:56:05.212 INFO:tasks.workunit.client.0.smithi002.stdout:3/331: sync 2024-09-13T22:56:05.212 INFO:tasks.workunit.client.0.smithi002.stdout:0/266: fsync d1/f14 0 2024-09-13T22:56:05.214 INFO:tasks.workunit.client.0.smithi002.stdout:4/249: dwrite d3/d14/d29/d2a/f44 [0,4194304] 0 2024-09-13T22:56:05.214 INFO:tasks.workunit.client.0.smithi002.stdout:2/262: creat d1/d4d/f50 x:0 0 0 2024-09-13T22:56:05.215 INFO:tasks.workunit.client.0.smithi002.stdout:2/263: write d1/f29 [571127,31000] 0 2024-09-13T22:56:05.216 INFO:tasks.workunit.client.1.smithi047.stdout:8/398: dread d8/d6b/d83/d40/f59 [0,4194304] 0 2024-09-13T22:56:05.221 INFO:tasks.workunit.client.0.smithi002.stdout:7/221: mknod d8/c3b 0 2024-09-13T22:56:05.222 INFO:tasks.workunit.client.0.smithi002.stdout:7/222: fdatasync d8/d10/d11/f2d 0 2024-09-13T22:56:05.223 INFO:tasks.workunit.client.1.smithi047.stdout:4/411: dwrite dc/de/d23/f55 [0,4194304] 0 2024-09-13T22:56:05.224 INFO:tasks.workunit.client.0.smithi002.stdout:9/329: rename d8/d10/f21 to d8/d10/d42/f6e 0 2024-09-13T22:56:05.225 INFO:tasks.workunit.client.1.smithi047.stdout:8/399: fsync d8/f2e 0 2024-09-13T22:56:05.227 INFO:tasks.workunit.client.0.smithi002.stdout:1/322: symlink d1/d13/d30/d31/d3d/l66 0 2024-09-13T22:56:05.228 INFO:tasks.workunit.client.1.smithi047.stdout:4/412: truncate dc/d29/f61 261689 0 2024-09-13T22:56:05.229 INFO:tasks.workunit.client.0.smithi002.stdout:6/280: rmdir d12/d17/d34/d39 39 2024-09-13T22:56:05.229 INFO:tasks.workunit.client.1.smithi047.stdout:4/413: write dc/d29/f35 [3671699,60720] 0 2024-09-13T22:56:05.233 INFO:tasks.workunit.client.1.smithi047.stdout:8/400: mkdir d8/d77/d89 0 2024-09-13T22:56:05.233 INFO:tasks.workunit.client.0.smithi002.stdout:8/267: read d3/f6 [5201721,82998] 0 2024-09-13T22:56:05.234 INFO:tasks.workunit.client.1.smithi047.stdout:8/401: write d8/d6b/d83/f3a [1615142,86197] 0 2024-09-13T22:56:05.238 INFO:tasks.workunit.client.0.smithi002.stdout:4/250: mknod d3/d40/d45/c4c 0 2024-09-13T22:56:05.238 INFO:tasks.workunit.client.1.smithi047.stdout:4/414: read f6 [3560263,114918] 0 2024-09-13T22:56:05.242 INFO:tasks.workunit.client.1.smithi047.stdout:8/402: chown d8/ca 351305073 1 2024-09-13T22:56:05.244 INFO:tasks.workunit.client.0.smithi002.stdout:6/281: dread d12/f1c [0,4194304] 0 2024-09-13T22:56:05.245 INFO:tasks.workunit.client.1.smithi047.stdout:5/312: sync 2024-09-13T22:56:05.247 INFO:tasks.workunit.client.1.smithi047.stdout:8/403: mkdir d8/d64/d8a 0 2024-09-13T22:56:05.251 INFO:tasks.workunit.client.0.smithi002.stdout:7/223: mkdir d8/d10/d11/d13/d2e/d3c 0 2024-09-13T22:56:05.253 INFO:tasks.workunit.client.1.smithi047.stdout:5/313: dwrite d19/f1c [0,4194304] 0 2024-09-13T22:56:05.254 INFO:tasks.workunit.client.1.smithi047.stdout:5/314: chown d19/d23/d32/c3e 177670 1 2024-09-13T22:56:05.255 INFO:tasks.workunit.client.0.smithi002.stdout:2/264: dread d1/f2 [0,4194304] 0 2024-09-13T22:56:05.255 INFO:tasks.workunit.client.0.smithi002.stdout:9/330: fdatasync d8/d10/d1c/d3d/f3e 0 2024-09-13T22:56:05.256 INFO:tasks.workunit.client.0.smithi002.stdout:2/265: stat d1/d7/d8/c22 0 2024-09-13T22:56:05.257 INFO:tasks.workunit.client.0.smithi002.stdout:1/323: rmdir d1/d13/d21/d40 39 2024-09-13T22:56:05.259 INFO:tasks.workunit.client.0.smithi002.stdout:2/266: write d1/d7/d8/d2c/f39 [277137,83098] 0 2024-09-13T22:56:05.259 INFO:tasks.workunit.client.0.smithi002.stdout:9/331: write d8/d10/d1c/d3d/f44 [3272665,66052] 0 2024-09-13T22:56:05.263 INFO:tasks.workunit.client.1.smithi047.stdout:5/315: dwrite d19/f36 [0,4194304] 0 2024-09-13T22:56:05.264 INFO:tasks.workunit.client.0.smithi002.stdout:9/332: write d8/d2c/f46 [1111743,32] 0 2024-09-13T22:56:05.264 INFO:tasks.workunit.client.0.smithi002.stdout:8/268: write d3/d27/d39/f3b [158784,91696] 0 2024-09-13T22:56:05.265 INFO:tasks.workunit.client.1.smithi047.stdout:5/316: dread - d19/d23/d4c/f5e zero size 2024-09-13T22:56:05.273 INFO:tasks.workunit.client.1.smithi047.stdout:4/415: truncate dc/de/d17/d25/f36 3733621 0 2024-09-13T22:56:05.273 INFO:tasks.workunit.client.1.smithi047.stdout:4/416: fsync dc/d29/f38 0 2024-09-13T22:56:05.275 INFO:tasks.workunit.client.0.smithi002.stdout:6/282: write d12/d17/d2a/f56 [4304639,103585] 0 2024-09-13T22:56:05.276 INFO:tasks.workunit.client.0.smithi002.stdout:6/283: write d12/d17/d2a/f56 [2878514,36600] 0 2024-09-13T22:56:05.276 INFO:tasks.workunit.client.1.smithi047.stdout:5/317: dwrite d19/d34/d42/f48 [0,4194304] 0 2024-09-13T22:56:05.278 INFO:tasks.workunit.client.1.smithi047.stdout:5/318: dread - d19/f4f zero size 2024-09-13T22:56:05.279 INFO:tasks.workunit.client.1.smithi047.stdout:8/404: truncate d8/f1e 2626565 0 2024-09-13T22:56:05.282 INFO:tasks.workunit.client.1.smithi047.stdout:5/319: mknod d19/d34/d42/c6f 0 2024-09-13T22:56:05.283 INFO:tasks.workunit.client.0.smithi002.stdout:6/284: fdatasync d12/d17/d2a/f56 0 2024-09-13T22:56:05.283 INFO:tasks.workunit.client.0.smithi002.stdout:0/267: dwrite d1/d2/d49/f5b [0,4194304] 0 2024-09-13T22:56:05.284 INFO:tasks.workunit.client.1.smithi047.stdout:8/405: symlink d8/d64/l8b 0 2024-09-13T22:56:05.285 INFO:tasks.workunit.client.1.smithi047.stdout:4/417: dwrite dc/de/d23/f80 [0,4194304] 0 2024-09-13T22:56:05.286 INFO:tasks.workunit.client.1.smithi047.stdout:4/418: chown dc/d29/d6c/c7d 664 1 2024-09-13T22:56:05.289 INFO:tasks.workunit.client.0.smithi002.stdout:4/251: dwrite d3/d14/f2b [0,4194304] 0 2024-09-13T22:56:05.289 INFO:tasks.workunit.client.0.smithi002.stdout:1/324: dread d1/d13/d30/d31/d3d/d5d/f4e [0,4194304] 0 2024-09-13T22:56:05.291 INFO:tasks.workunit.client.0.smithi002.stdout:4/252: write f2 [1578228,20066] 0 2024-09-13T22:56:05.291 INFO:tasks.workunit.client.0.smithi002.stdout:2/267: mkdir d1/d7/d8/d51 0 2024-09-13T22:56:05.292 INFO:tasks.workunit.client.0.smithi002.stdout:4/253: dread - d3/f3d zero size 2024-09-13T22:56:05.292 INFO:tasks.workunit.client.0.smithi002.stdout:1/325: dread - d1/f4d zero size 2024-09-13T22:56:05.293 INFO:tasks.workunit.client.0.smithi002.stdout:2/268: chown d1/d7/d8/c3f 448468 1 2024-09-13T22:56:05.295 INFO:tasks.workunit.client.0.smithi002.stdout:2/269: write d1/d32/d37/f45 [848726,102611] 0 2024-09-13T22:56:05.296 INFO:tasks.workunit.client.0.smithi002.stdout:0/268: dread d1/d4/f7 [0,4194304] 0 2024-09-13T22:56:05.296 INFO:tasks.workunit.client.1.smithi047.stdout:8/406: mkdir d8/d3f/d8c 0 2024-09-13T22:56:05.300 INFO:tasks.workunit.client.0.smithi002.stdout:0/269: dread d1/d2/d10/d31/f37 [0,4194304] 0 2024-09-13T22:56:05.302 INFO:tasks.workunit.client.1.smithi047.stdout:5/320: creat d19/d23/d32/d69/f70 x:0 0 0 2024-09-13T22:56:05.303 INFO:tasks.workunit.client.1.smithi047.stdout:5/321: dread - d19/d25/f61 zero size 2024-09-13T22:56:05.310 INFO:tasks.workunit.client.0.smithi002.stdout:0/270: dwrite d1/d4/f7 [4194304,4194304] 0 2024-09-13T22:56:05.310 INFO:tasks.workunit.client.0.smithi002.stdout:0/271: dread - d1/d2/d10/f2c zero size 2024-09-13T22:56:05.310 INFO:tasks.workunit.client.0.smithi002.stdout:0/272: write d1/f59 [396944,4630] 0 2024-09-13T22:56:05.310 INFO:tasks.workunit.client.1.smithi047.stdout:8/407: creat d8/d6b/d83/d40/f8d x:0 0 0 2024-09-13T22:56:05.313 INFO:tasks.workunit.client.1.smithi047.stdout:5/322: truncate d19/d25/f3f 784678 0 2024-09-13T22:56:05.317 INFO:tasks.workunit.client.1.smithi047.stdout:4/419: creat dc/de/f88 x:0 0 0 2024-09-13T22:56:05.318 INFO:tasks.workunit.client.1.smithi047.stdout:4/420: fdatasync dc/d29/f38 0 2024-09-13T22:56:05.319 INFO:tasks.workunit.client.1.smithi047.stdout:4/421: write dc/de/d23/d40/f62 [1198780,34868] 0 2024-09-13T22:56:05.325 INFO:tasks.workunit.client.0.smithi002.stdout:5/271: rename d1/d2a/f4c to d1/d2a/d41/d45/f61 0 2024-09-13T22:56:05.326 INFO:tasks.workunit.client.1.smithi047.stdout:8/408: symlink d8/d3f/d8c/l8e 0 2024-09-13T22:56:05.329 INFO:tasks.workunit.client.1.smithi047.stdout:4/422: mknod dc/d29/d6c/c89 0 2024-09-13T22:56:05.330 INFO:tasks.workunit.client.0.smithi002.stdout:3/332: link d9/d15/d26/l55 d9/d15/d36/l76 0 2024-09-13T22:56:05.333 INFO:tasks.workunit.client.0.smithi002.stdout:6/285: chown d12/d17/d34/d39 168 1 2024-09-13T22:56:05.333 INFO:tasks.workunit.client.0.smithi002.stdout:9/333: dwrite d8/d10/d42/f4c [0,4194304] 0 2024-09-13T22:56:05.338 INFO:tasks.workunit.client.0.smithi002.stdout:4/254: mkdir d3/d40/d45/d4d 0 2024-09-13T22:56:05.340 INFO:tasks.workunit.client.0.smithi002.stdout:4/255: fsync d3/d14/f2b 0 2024-09-13T22:56:05.343 INFO:tasks.workunit.client.0.smithi002.stdout:6/286: dwrite d12/d17/d28/f2f [0,4194304] 0 2024-09-13T22:56:05.343 INFO:tasks.workunit.client.0.smithi002.stdout:4/256: chown d3/d40/d45/c4c 381938 1 2024-09-13T22:56:05.344 INFO:tasks.workunit.client.0.smithi002.stdout:7/224: dwrite d8/d10/d11/d13/f1c [0,4194304] 0 2024-09-13T22:56:05.348 INFO:tasks.workunit.client.0.smithi002.stdout:7/225: stat d8/d10/d11/d13/d26/c2c 0 2024-09-13T22:56:05.348 INFO:tasks.workunit.client.0.smithi002.stdout:7/226: stat d8/d10/d11/d3a 0 2024-09-13T22:56:05.353 INFO:tasks.workunit.client.0.smithi002.stdout:8/269: rename d3/dc/d18/d2e/d46 to d3/d21/d57 0 2024-09-13T22:56:05.354 INFO:tasks.workunit.client.0.smithi002.stdout:8/270: chown d3/dc/f42 39256328 1 2024-09-13T22:56:05.359 INFO:tasks.workunit.client.0.smithi002.stdout:5/272: creat d1/d2a/d5a/f62 x:0 0 0 2024-09-13T22:56:05.367 INFO:tasks.workunit.client.0.smithi002.stdout:4/257: dread d3/f1e [0,4194304] 0 2024-09-13T22:56:05.369 INFO:tasks.workunit.client.0.smithi002.stdout:9/334: creat d8/d10/d1c/d3d/f6f x:0 0 0 2024-09-13T22:56:05.372 INFO:tasks.workunit.client.0.smithi002.stdout:2/270: mkdir d1/d7/d52 0 2024-09-13T22:56:05.375 INFO:tasks.workunit.client.0.smithi002.stdout:3/333: dread f3 [0,4194304] 0 2024-09-13T22:56:05.383 INFO:tasks.workunit.client.0.smithi002.stdout:7/227: mknod d8/d10/d11/d13/d2e/c3d 0 2024-09-13T22:56:05.384 INFO:tasks.workunit.client.0.smithi002.stdout:8/271: creat d3/d21/f58 x:0 0 0 2024-09-13T22:56:05.385 INFO:tasks.workunit.client.0.smithi002.stdout:5/273: unlink d1/d10/f22 0 2024-09-13T22:56:05.389 INFO:tasks.workunit.client.0.smithi002.stdout:1/326: link d1/d13/d30/d31/d3d/d5d/f37 d1/d13/d30/d31/d3b/f67 0 2024-09-13T22:56:05.389 INFO:tasks.workunit.client.0.smithi002.stdout:6/287: mknod d12/d17/c5b 0 2024-09-13T22:56:05.391 INFO:tasks.workunit.client.1.smithi047.stdout:4/423: write f6 [2073068,25129] 0 2024-09-13T22:56:05.392 INFO:tasks.workunit.client.0.smithi002.stdout:0/273: creat d1/f5f x:0 0 0 2024-09-13T22:56:05.395 INFO:tasks.workunit.client.1.smithi047.stdout:5/323: truncate d19/d34/f40 74922 0 2024-09-13T22:56:05.398 INFO:tasks.workunit.client.1.smithi047.stdout:5/324: write d19/d25/d45/f60 [393013,125305] 0 2024-09-13T22:56:05.398 INFO:tasks.workunit.client.1.smithi047.stdout:4/424: mknod dc/c8a 0 2024-09-13T22:56:05.398 INFO:tasks.workunit.client.0.smithi002.stdout:8/272: creat d3/d27/f59 x:0 0 0 2024-09-13T22:56:05.399 INFO:tasks.workunit.client.0.smithi002.stdout:8/273: chown d3 10547 1 2024-09-13T22:56:05.400 INFO:tasks.workunit.client.1.smithi047.stdout:4/425: rmdir dc/de/d17 39 2024-09-13T22:56:05.402 INFO:tasks.workunit.client.0.smithi002.stdout:2/271: getdents d1/d4a 0 2024-09-13T22:56:05.403 INFO:tasks.workunit.client.1.smithi047.stdout:5/325: rename d19/d23/d2e/d41/f54 to d19/d25/f71 0 2024-09-13T22:56:05.405 INFO:tasks.workunit.client.1.smithi047.stdout:5/326: write d19/d25/d45/f60 [649509,110998] 0 2024-09-13T22:56:05.405 INFO:tasks.workunit.client.0.smithi002.stdout:3/334: symlink d9/df/d71/l77 0 2024-09-13T22:56:05.405 INFO:tasks.workunit.client.0.smithi002.stdout:3/335: chown d9/f66 101 1 2024-09-13T22:56:05.406 INFO:tasks.workunit.client.1.smithi047.stdout:5/327: fdatasync d19/d23/d2e/f59 0 2024-09-13T22:56:05.407 INFO:tasks.workunit.client.1.smithi047.stdout:4/426: dread dc/d29/f61 [0,4194304] 0 2024-09-13T22:56:05.409 INFO:tasks.workunit.client.0.smithi002.stdout:0/274: truncate d1/d2/f29 590234 0 2024-09-13T22:56:05.409 INFO:tasks.workunit.client.0.smithi002.stdout:0/275: dread - d1/d2/f4f zero size 2024-09-13T22:56:05.410 INFO:tasks.workunit.client.0.smithi002.stdout:7/228: mkdir d8/d10/d11/d13/d2e/d3c/d3e 0 2024-09-13T22:56:05.411 INFO:tasks.workunit.client.0.smithi002.stdout:0/276: write d1/d2/d10/f3a [868114,109350] 0 2024-09-13T22:56:05.411 INFO:tasks.workunit.client.0.smithi002.stdout:8/274: creat d3/dc/d18/f5a x:0 0 0 2024-09-13T22:56:05.413 INFO:tasks.workunit.client.0.smithi002.stdout:8/275: fdatasync d3/dc/d16/f19 0 2024-09-13T22:56:05.413 INFO:tasks.workunit.client.1.smithi047.stdout:4/427: symlink dc/de/d23/d40/l8b 0 2024-09-13T22:56:05.415 INFO:tasks.workunit.client.0.smithi002.stdout:4/258: rmdir d3/d40/d45/d4d 0 2024-09-13T22:56:05.417 INFO:tasks.workunit.client.1.smithi047.stdout:4/428: dread dc/de/d23/f6f [0,4194304] 0 2024-09-13T22:56:05.418 INFO:tasks.workunit.client.0.smithi002.stdout:4/259: dread d3/f2f [0,4194304] 0 2024-09-13T22:56:05.419 INFO:tasks.workunit.client.0.smithi002.stdout:4/260: fsync f1 0 2024-09-13T22:56:05.419 INFO:tasks.workunit.client.0.smithi002.stdout:3/336: truncate d9/f1a 258307 0 2024-09-13T22:56:05.425 INFO:tasks.workunit.client.1.smithi047.stdout:4/429: read dc/de/d39/f47 [7666,59768] 0 2024-09-13T22:56:05.426 INFO:tasks.workunit.client.0.smithi002.stdout:7/229: creat d8/d10/d11/d13/d26/f3f x:0 0 0 2024-09-13T22:56:05.433 INFO:tasks.workunit.client.1.smithi047.stdout:5/328: dwrite d19/d25/f3f [0,4194304] 0 2024-09-13T22:56:05.433 INFO:tasks.workunit.client.1.smithi047.stdout:4/430: creat dc/de/d23/d40/f8c x:0 0 0 2024-09-13T22:56:05.434 INFO:tasks.workunit.client.0.smithi002.stdout:2/272: mknod d1/c53 0 2024-09-13T22:56:05.439 INFO:tasks.workunit.client.1.smithi047.stdout:5/329: symlink d19/d34/d42/d5d/l72 0 2024-09-13T22:56:05.440 INFO:tasks.workunit.client.1.smithi047.stdout:5/330: readlink d19/d34/d42/l4b 0 2024-09-13T22:56:05.441 INFO:tasks.workunit.client.0.smithi002.stdout:1/327: creat d1/d13/f68 x:0 0 0 2024-09-13T22:56:05.442 INFO:tasks.workunit.client.0.smithi002.stdout:1/328: fdatasync d1/d13/f32 0 2024-09-13T22:56:05.444 INFO:tasks.workunit.client.1.smithi047.stdout:3/425: sync 2024-09-13T22:56:05.445 INFO:tasks.workunit.client.1.smithi047.stdout:4/431: dread dc/de/d23/f3b [0,4194304] 0 2024-09-13T22:56:05.446 INFO:tasks.workunit.client.0.smithi002.stdout:6/288: creat d12/f5c x:0 0 0 2024-09-13T22:56:05.447 INFO:tasks.workunit.client.0.smithi002.stdout:7/230: creat d8/d9/f40 x:0 0 0 2024-09-13T22:56:05.449 INFO:tasks.workunit.client.0.smithi002.stdout:0/277: rename d1/d2/c33 to d1/d2/d10/d31/c60 0 2024-09-13T22:56:05.451 INFO:tasks.workunit.client.1.smithi047.stdout:4/432: mknod dc/d29/c8d 0 2024-09-13T22:56:05.452 INFO:tasks.workunit.client.0.smithi002.stdout:3/337: mknod d9/d15/c78 0 2024-09-13T22:56:05.458 INFO:tasks.workunit.client.0.smithi002.stdout:1/329: fdatasync d1/d1c/f26 0 2024-09-13T22:56:05.460 INFO:tasks.workunit.client.1.smithi047.stdout:5/331: write d19/d23/d2e/d41/f51 [1126831,66567] 0 2024-09-13T22:56:05.463 INFO:tasks.workunit.client.1.smithi047.stdout:3/426: dread d0/d3/d4/d16/d2c/f46 [0,4194304] 0 2024-09-13T22:56:05.463 INFO:tasks.workunit.client.0.smithi002.stdout:1/330: dread d1/f24 [0,4194304] 0 2024-09-13T22:56:05.464 INFO:tasks.workunit.client.1.smithi047.stdout:3/427: write d0/d25/d44/f27 [3170777,54830] 0 2024-09-13T22:56:05.465 INFO:tasks.workunit.client.0.smithi002.stdout:8/276: rename d3/dc/d16/f19 to d3/d21/f5b 0 2024-09-13T22:56:05.469 INFO:tasks.workunit.client.0.smithi002.stdout:2/273: symlink d1/l54 0 2024-09-13T22:56:05.475 INFO:tasks.workunit.client.1.smithi047.stdout:4/433: getdents dc/d29/d4d 0 2024-09-13T22:56:05.476 INFO:tasks.workunit.client.0.smithi002.stdout:7/231: mknod d8/d10/d11/d13/d2e/d3c/d3e/c41 0 2024-09-13T22:56:05.478 INFO:tasks.workunit.client.1.smithi047.stdout:4/434: mkdir dc/d29/d8e 0 2024-09-13T22:56:05.478 INFO:tasks.workunit.client.0.smithi002.stdout:0/278: write d1/d2/f18 [3994558,96105] 0 2024-09-13T22:56:05.480 INFO:tasks.workunit.client.0.smithi002.stdout:4/261: rename d3/d14/d29/d2a/f4a to d3/d40/f4e 0 2024-09-13T22:56:05.484 INFO:tasks.workunit.client.1.smithi047.stdout:5/332: dwrite d19/d34/d42/f5b [0,4194304] 0 2024-09-13T22:56:05.487 INFO:tasks.workunit.client.1.smithi047.stdout:5/333: truncate d19/d25/d45/f60 1580829 0 2024-09-13T22:56:05.489 INFO:tasks.workunit.client.1.smithi047.stdout:3/428: dwrite d0/d25/d44/f60 [0,4194304] 0 2024-09-13T22:56:05.490 INFO:tasks.workunit.client.1.smithi047.stdout:5/334: write d19/d23/d4c/f5e [5200,88190] 0 2024-09-13T22:56:05.491 INFO:tasks.workunit.client.1.smithi047.stdout:4/435: rename dc/de/d17/d25/c87 to dc/de/d17/d25/d4a/c8f 0 2024-09-13T22:56:05.494 INFO:tasks.workunit.client.1.smithi047.stdout:4/436: chown dc/d29/d6c/c7d 22 1 2024-09-13T22:56:05.496 INFO:tasks.workunit.client.1.smithi047.stdout:1/339: sync 2024-09-13T22:56:05.496 INFO:tasks.workunit.client.1.smithi047.stdout:8/409: sync 2024-09-13T22:56:05.496 INFO:tasks.workunit.client.1.smithi047.stdout:7/430: sync 2024-09-13T22:56:05.497 INFO:tasks.workunit.client.1.smithi047.stdout:9/342: sync 2024-09-13T22:56:05.497 INFO:tasks.workunit.client.1.smithi047.stdout:2/507: sync 2024-09-13T22:56:05.497 INFO:tasks.workunit.client.1.smithi047.stdout:0/421: sync 2024-09-13T22:56:05.497 INFO:tasks.workunit.client.1.smithi047.stdout:6/435: sync 2024-09-13T22:56:05.500 INFO:tasks.workunit.client.1.smithi047.stdout:5/335: dread d19/d34/d42/f5b [0,4194304] 0 2024-09-13T22:56:05.502 INFO:tasks.workunit.client.1.smithi047.stdout:3/429: symlink d0/d3/d4/d16/d32/d76/l8f 0 2024-09-13T22:56:05.502 INFO:tasks.workunit.client.1.smithi047.stdout:0/422: read - d1/d5/d16/d47/f4a zero size 2024-09-13T22:56:05.502 INFO:tasks.workunit.client.1.smithi047.stdout:4/437: mkdir dc/de/d23/d40/d7b/d90 0 2024-09-13T22:56:05.503 INFO:tasks.workunit.client.1.smithi047.stdout:9/343: mknod d1/d5f/c68 0 2024-09-13T22:56:05.504 INFO:tasks.workunit.client.1.smithi047.stdout:6/436: dread - d3/d11/f6b zero size 2024-09-13T22:56:05.506 INFO:tasks.workunit.client.1.smithi047.stdout:8/410: read - d8/d6b/d83/d38/f3b zero size 2024-09-13T22:56:05.507 INFO:tasks.workunit.client.1.smithi047.stdout:1/340: mknod d0/d7/d10/d55/c66 0 2024-09-13T22:56:05.507 INFO:tasks.workunit.client.1.smithi047.stdout:5/336: truncate d19/d25/f2b 1283547 0 2024-09-13T22:56:05.514 INFO:tasks.workunit.client.1.smithi047.stdout:2/508: truncate d1/df/d1d/d3c/f9d 296675 0 2024-09-13T22:56:05.514 INFO:tasks.workunit.client.1.smithi047.stdout:4/438: mknod dc/c91 0 2024-09-13T22:56:05.514 INFO:tasks.workunit.client.1.smithi047.stdout:7/431: dwrite d0/db/fc [0,4194304] 0 2024-09-13T22:56:05.514 INFO:tasks.workunit.client.1.smithi047.stdout:9/344: symlink d1/dc/d18/l69 0 2024-09-13T22:56:05.514 INFO:tasks.workunit.client.1.smithi047.stdout:1/341: write d0/d7/f12 [910481,23763] 0 2024-09-13T22:56:05.514 INFO:tasks.workunit.client.1.smithi047.stdout:5/337: symlink d19/d34/d42/l73 0 2024-09-13T22:56:05.514 INFO:tasks.workunit.client.1.smithi047.stdout:0/423: mkdir d1/d5/d16/d97 0 2024-09-13T22:56:05.515 INFO:tasks.workunit.client.1.smithi047.stdout:8/411: mkdir d8/d64/d4e/d4d/d8f 0 2024-09-13T22:56:05.522 INFO:tasks.workunit.client.1.smithi047.stdout:6/437: link d3/f7 d3/d11/f97 0 2024-09-13T22:56:05.527 INFO:tasks.workunit.client.1.smithi047.stdout:5/338: symlink d19/d25/l74 0 2024-09-13T22:56:05.530 INFO:tasks.workunit.client.1.smithi047.stdout:1/342: dwrite d0/d7/f37 [0,4194304] 0 2024-09-13T22:56:05.530 INFO:tasks.workunit.client.1.smithi047.stdout:5/339: chown d19/d23/d32/c3e 0 1 2024-09-13T22:56:05.531 INFO:tasks.workunit.client.1.smithi047.stdout:4/439: dwrite dc/de/f18 [4194304,4194304] 0 2024-09-13T22:56:05.534 INFO:tasks.workunit.client.1.smithi047.stdout:0/424: symlink d1/d5/d16/d6a/d92/l98 0 2024-09-13T22:56:05.534 INFO:tasks.workunit.client.1.smithi047.stdout:4/440: read dc/de/d39/f69 [165085,46215] 0 2024-09-13T22:56:05.535 INFO:tasks.workunit.client.1.smithi047.stdout:0/425: stat d1/d5/d16/c3a 0 2024-09-13T22:56:05.536 INFO:tasks.workunit.client.1.smithi047.stdout:1/343: dread - d0/d7/d14/d28/d36/f3d zero size 2024-09-13T22:56:05.537 INFO:tasks.workunit.client.1.smithi047.stdout:4/441: write dc/de/d39/f69 [266875,31390] 0 2024-09-13T22:56:05.537 INFO:tasks.workunit.client.1.smithi047.stdout:1/344: readlink d0/d7/d14/l3e 0 2024-09-13T22:56:05.539 INFO:tasks.workunit.client.1.smithi047.stdout:2/509: rename d1/df/d35/c7f to d1/cac 0 2024-09-13T22:56:05.539 INFO:tasks.workunit.client.1.smithi047.stdout:0/426: write d1/d5/d16/d23/f64 [739629,36588] 0 2024-09-13T22:56:05.540 INFO:tasks.workunit.client.0.smithi002.stdout:3/338: fsync d9/d15/d35/f3a 0 2024-09-13T22:56:05.540 INFO:tasks.workunit.client.0.smithi002.stdout:6/289: creat d12/f5d x:0 0 0 2024-09-13T22:56:05.541 INFO:tasks.workunit.client.0.smithi002.stdout:0/279: dwrite d1/d2/fd [0,4194304] 0 2024-09-13T22:56:05.543 INFO:tasks.workunit.client.0.smithi002.stdout:4/262: creat d3/d14/d25/f4f x:0 0 0 2024-09-13T22:56:05.544 INFO:tasks.workunit.client.0.smithi002.stdout:7/232: write d8/d10/d11/d13/f21 [1017610,64234] 0 2024-09-13T22:56:05.544 INFO:tasks.workunit.client.0.smithi002.stdout:2/274: mknod d1/d7/d8/d4f/c55 0 2024-09-13T22:56:05.545 INFO:tasks.workunit.client.1.smithi047.stdout:3/430: write d0/d3/d4/d16/d2c/de/d1f/d3b/d69/f7d [975044,33405] 0 2024-09-13T22:56:05.548 INFO:tasks.workunit.client.0.smithi002.stdout:1/331: creat d1/d13/d30/d31/f69 x:0 0 0 2024-09-13T22:56:05.550 INFO:tasks.workunit.client.1.smithi047.stdout:4/442: creat dc/de/d23/d40/f92 x:0 0 0 2024-09-13T22:56:05.551 INFO:tasks.workunit.client.1.smithi047.stdout:1/345: dwrite d0/d7/f37 [0,4194304] 0 2024-09-13T22:56:05.551 INFO:tasks.workunit.client.1.smithi047.stdout:7/432: write d0/d7/da/f34 [2114378,23991] 0 2024-09-13T22:56:05.551 INFO:tasks.workunit.client.1.smithi047.stdout:6/438: dread d3/d11/d2b/d4c/d30/d48/f7e [0,4194304] 0 2024-09-13T22:56:05.554 INFO:tasks.workunit.client.1.smithi047.stdout:4/443: stat dc/de/d23/d40/l8b 0 2024-09-13T22:56:05.554 INFO:tasks.workunit.client.0.smithi002.stdout:2/275: dwrite d1/d32/d37/d3a/f4b [0,4194304] 0 2024-09-13T22:56:05.556 INFO:tasks.workunit.client.1.smithi047.stdout:8/412: truncate d8/f7b 2092442 0 2024-09-13T22:56:05.557 INFO:tasks.workunit.client.1.smithi047.stdout:1/346: fdatasync d0/d7/d13/f3c 0 2024-09-13T22:56:05.558 INFO:tasks.workunit.client.0.smithi002.stdout:3/339: chown d9/d15/f30 0 1 2024-09-13T22:56:05.562 INFO:tasks.workunit.client.1.smithi047.stdout:1/347: read - d0/f5c zero size 2024-09-13T22:56:05.566 INFO:tasks.workunit.client.0.smithi002.stdout:4/263: rmdir d3/d40/d45 39 2024-09-13T22:56:05.567 INFO:tasks.workunit.client.1.smithi047.stdout:0/427: rename d1/d7/f26 to d1/d5/d16/d23/d45/f99 0 2024-09-13T22:56:05.570 INFO:tasks.workunit.client.1.smithi047.stdout:3/431: dwrite d0/d3/d4/d16/d2c/f24 [4194304,4194304] 0 2024-09-13T22:56:05.571 INFO:tasks.workunit.client.0.smithi002.stdout:7/233: mknod d8/d10/d11/c42 0 2024-09-13T22:56:05.574 INFO:tasks.workunit.client.1.smithi047.stdout:6/439: dwrite d3/d11/d2b/d4c/d30/f37 [0,4194304] 0 2024-09-13T22:56:05.574 INFO:tasks.workunit.client.1.smithi047.stdout:5/340: dread d19/d25/d45/f4d [0,4194304] 0 2024-09-13T22:56:05.575 INFO:tasks.workunit.client.1.smithi047.stdout:7/433: mknod d0/d7/da/d2e/c90 0 2024-09-13T22:56:05.575 INFO:tasks.workunit.client.1.smithi047.stdout:3/432: readlink d0/d3/d4/d16/d2c/l1b 0 2024-09-13T22:56:05.577 INFO:tasks.workunit.client.1.smithi047.stdout:5/341: chown d19/d23/d32/d69 10562197 1 2024-09-13T22:56:05.581 INFO:tasks.workunit.client.1.smithi047.stdout:4/444: creat dc/d29/d6c/f93 x:0 0 0 2024-09-13T22:56:05.585 INFO:tasks.workunit.client.0.smithi002.stdout:5/274: sync 2024-09-13T22:56:05.585 INFO:tasks.workunit.client.0.smithi002.stdout:9/335: sync 2024-09-13T22:56:05.585 INFO:tasks.workunit.client.0.smithi002.stdout:9/336: chown d8/d10/d42 3084538 1 2024-09-13T22:56:05.588 INFO:tasks.workunit.client.0.smithi002.stdout:0/280: rename d1/d4/c34 to d1/d2/d10/d31/c61 0 2024-09-13T22:56:05.589 INFO:tasks.workunit.client.1.smithi047.stdout:6/440: dwrite d3/d11/f3f [0,4194304] 0 2024-09-13T22:56:05.589 INFO:tasks.workunit.client.1.smithi047.stdout:8/413: dread d8/d64/f57 [0,4194304] 0 2024-09-13T22:56:05.589 INFO:tasks.workunit.client.0.smithi002.stdout:0/281: chown d1/d2/f18 0 1 2024-09-13T22:56:05.593 INFO:tasks.workunit.client.1.smithi047.stdout:2/510: creat d1/df/d26/d9f/fad x:0 0 0 2024-09-13T22:56:05.596 INFO:tasks.workunit.client.0.smithi002.stdout:2/276: fdatasync d1/d7/d8/f31 0 2024-09-13T22:56:05.596 INFO:tasks.workunit.client.0.smithi002.stdout:6/290: truncate fd 1888251 0 2024-09-13T22:56:05.600 INFO:tasks.workunit.client.1.smithi047.stdout:1/348: creat d0/d7/db/f67 x:0 0 0 2024-09-13T22:56:05.606 INFO:tasks.workunit.client.0.smithi002.stdout:1/332: rename d1/f9 to d1/d13/d30/d31/d3d/f6a 0 2024-09-13T22:56:05.607 INFO:tasks.workunit.client.1.smithi047.stdout:7/434: mknod d0/d7/da/d1e/c91 0 2024-09-13T22:56:05.610 INFO:tasks.workunit.client.0.smithi002.stdout:0/282: dread d1/f2d [4194304,4194304] 0 2024-09-13T22:56:05.611 INFO:tasks.workunit.client.0.smithi002.stdout:0/283: chown d1/d2/d10/d31/d32/f39 6 1 2024-09-13T22:56:05.612 INFO:tasks.workunit.client.1.smithi047.stdout:7/435: dread d0/db/fc [4194304,4194304] 0 2024-09-13T22:56:05.615 INFO:tasks.workunit.client.0.smithi002.stdout:3/340: write d9/d15/d26/f32 [978618,78668] 0 2024-09-13T22:56:05.616 INFO:tasks.workunit.client.0.smithi002.stdout:3/341: stat d9/d3b/f64 0 2024-09-13T22:56:05.618 INFO:tasks.workunit.client.0.smithi002.stdout:0/284: dwrite d1/d2/d10/d31/d3c/f47 [0,4194304] 0 2024-09-13T22:56:05.619 INFO:tasks.workunit.client.1.smithi047.stdout:8/414: creat d8/d3f/d8c/f90 x:0 0 0 2024-09-13T22:56:05.623 INFO:tasks.workunit.client.0.smithi002.stdout:7/234: truncate f7 1187289 0 2024-09-13T22:56:05.625 INFO:tasks.workunit.client.0.smithi002.stdout:5/275: symlink d1/d10/l63 0 2024-09-13T22:56:05.626 INFO:tasks.workunit.client.0.smithi002.stdout:5/276: fdatasync d1/f3a 0 2024-09-13T22:56:05.626 INFO:tasks.workunit.client.0.smithi002.stdout:5/277: dread - d1/d10/f4b zero size 2024-09-13T22:56:05.627 INFO:tasks.workunit.client.1.smithi047.stdout:6/441: write d3/f7 [309330,100397] 0 2024-09-13T22:56:05.628 INFO:tasks.workunit.client.1.smithi047.stdout:6/442: stat d3/d11/d2b/d1c/d70/d89 0 2024-09-13T22:56:05.629 INFO:tasks.workunit.client.0.smithi002.stdout:1/333: creat d1/d13/d1d/d34/f6b x:0 0 0 2024-09-13T22:56:05.630 INFO:tasks.workunit.client.0.smithi002.stdout:1/334: readlink d1/d13/d30/d31/d3d/d5d/l47 0 2024-09-13T22:56:05.630 INFO:tasks.workunit.client.1.smithi047.stdout:7/436: unlink d0/d19/f82 0 2024-09-13T22:56:05.633 INFO:tasks.workunit.client.0.smithi002.stdout:6/291: mknod d12/d17/d34/d4b/c5e 0 2024-09-13T22:56:05.634 INFO:tasks.workunit.client.0.smithi002.stdout:3/342: symlink d9/d15/d26/d44/l79 0 2024-09-13T22:56:05.635 INFO:tasks.workunit.client.1.smithi047.stdout:8/415: rename d8/d6b/d83 to d8/d64/d4e/d4d/d8f/d91 0 2024-09-13T22:56:05.636 INFO:tasks.workunit.client.0.smithi002.stdout:8/277: sync 2024-09-13T22:56:05.636 INFO:tasks.workunit.client.0.smithi002.stdout:6/292: write d12/d17/f3c [408919,51743] 0 2024-09-13T22:56:05.636 INFO:tasks.workunit.client.0.smithi002.stdout:0/285: mknod d1/d2/d10/d31/c62 0 2024-09-13T22:56:05.637 INFO:tasks.workunit.client.0.smithi002.stdout:1/335: dwrite d1/d13/d21/f5b [0,4194304] 0 2024-09-13T22:56:05.639 INFO:tasks.workunit.client.0.smithi002.stdout:1/336: write d1/f4d [93895,82675] 0 2024-09-13T22:56:05.640 INFO:tasks.workunit.client.0.smithi002.stdout:2/277: link d1/d7/d35/f43 d1/d4d/f56 0 2024-09-13T22:56:05.641 INFO:tasks.workunit.client.0.smithi002.stdout:2/278: dread - d1/d7/d8/d2c/f44 zero size 2024-09-13T22:56:05.641 INFO:tasks.workunit.client.1.smithi047.stdout:0/428: creat d1/d5/d16/f9a x:0 0 0 2024-09-13T22:56:05.644 INFO:tasks.workunit.client.1.smithi047.stdout:8/416: dwrite d8/d3f/d8c/f90 [0,4194304] 0 2024-09-13T22:56:05.644 INFO:tasks.workunit.client.0.smithi002.stdout:7/235: rmdir d8/d10/d11 39 2024-09-13T22:56:05.646 INFO:tasks.workunit.client.1.smithi047.stdout:8/417: read d8/d64/d4e/d4d/d8f/d91/d40/f59 [166096,60258] 0 2024-09-13T22:56:05.652 INFO:tasks.workunit.client.1.smithi047.stdout:6/443: mkdir d3/d11/d2b/d1c/d70/d98 0 2024-09-13T22:56:05.654 INFO:tasks.workunit.client.1.smithi047.stdout:5/342: truncate d19/f1d 2926352 0 2024-09-13T22:56:05.655 INFO:tasks.workunit.client.1.smithi047.stdout:7/437: mkdir d0/d7/da/d47/d92 0 2024-09-13T22:56:05.657 INFO:tasks.workunit.client.0.smithi002.stdout:9/337: creat d8/f70 x:0 0 0 2024-09-13T22:56:05.665 INFO:tasks.workunit.client.1.smithi047.stdout:8/418: creat d8/d64/d4e/f92 x:0 0 0 2024-09-13T22:56:05.667 INFO:tasks.workunit.client.1.smithi047.stdout:6/444: rename d3/c4b to d3/d11/d2b/d4c/d30/d48/c99 0 2024-09-13T22:56:05.668 INFO:tasks.workunit.client.1.smithi047.stdout:6/445: stat d3/d11/d2b/d4c/d30/f72 0 2024-09-13T22:56:05.684 INFO:tasks.workunit.client.1.smithi047.stdout:6/446: readlink d3/d11/l29 0 2024-09-13T22:56:05.685 INFO:tasks.workunit.client.0.smithi002.stdout:3/343: creat d9/d15/d36/f7a x:0 0 0 2024-09-13T22:56:05.686 INFO:tasks.workunit.client.1.smithi047.stdout:7/438: dread d0/d19/f77 [0,4194304] 0 2024-09-13T22:56:05.687 INFO:tasks.workunit.client.0.smithi002.stdout:2/279: symlink d1/d32/d37/l57 0 2024-09-13T22:56:05.687 INFO:tasks.workunit.client.1.smithi047.stdout:8/419: dread d8/f2b [0,4194304] 0 2024-09-13T22:56:05.687 INFO:tasks.workunit.client.1.smithi047.stdout:7/439: chown d0/d7/f15 53351 1 2024-09-13T22:56:05.688 INFO:tasks.workunit.client.0.smithi002.stdout:9/338: mknod d8/d2c/d50/c71 0 2024-09-13T22:56:05.689 INFO:tasks.workunit.client.0.smithi002.stdout:3/344: chown d9/d15/d26/f29 53133 1 2024-09-13T22:56:05.689 INFO:tasks.workunit.client.0.smithi002.stdout:5/278: symlink d1/l64 0 2024-09-13T22:56:05.689 INFO:tasks.workunit.client.1.smithi047.stdout:0/429: truncate d1/d5/d11/d2f/f38 1730979 0 2024-09-13T22:56:05.690 INFO:tasks.workunit.client.1.smithi047.stdout:0/430: chown d1/d7/l7a 1343 1 2024-09-13T22:56:05.690 INFO:tasks.workunit.client.0.smithi002.stdout:7/236: write f1 [4310395,87741] 0 2024-09-13T22:56:05.691 INFO:tasks.workunit.client.1.smithi047.stdout:1/349: link d0/d7/d10/d55/l65 d0/l68 0 2024-09-13T22:56:05.691 INFO:tasks.workunit.client.1.smithi047.stdout:0/431: chown d1/d5/d16/d23/d45/f99 162 1 2024-09-13T22:56:05.692 INFO:tasks.workunit.client.1.smithi047.stdout:0/432: stat d1/c8a 0 2024-09-13T22:56:05.692 INFO:tasks.workunit.client.0.smithi002.stdout:9/339: chown d8/d10/d53/d63/l64 30054 1 2024-09-13T22:56:05.692 INFO:tasks.workunit.client.0.smithi002.stdout:3/345: truncate d9/d3b/f64 679274 0 2024-09-13T22:56:05.693 INFO:tasks.workunit.client.0.smithi002.stdout:8/278: truncate d3/fa 2621873 0 2024-09-13T22:56:05.695 INFO:tasks.workunit.client.0.smithi002.stdout:0/286: dwrite d1/d2/d10/d31/d3c/f48 [4194304,4194304] 0 2024-09-13T22:56:05.699 INFO:tasks.workunit.client.0.smithi002.stdout:9/340: dwrite d8/d1e/f27 [0,4194304] 0 2024-09-13T22:56:05.727 INFO:tasks.workunit.client.0.smithi002.stdout:4/264: sync 2024-09-13T22:56:05.744 INFO:tasks.workunit.client.1.smithi047.stdout:9/345: sync 2024-09-13T22:56:05.744 INFO:tasks.workunit.client.1.smithi047.stdout:9/346: chown d1/dc/d14/dd/f45 4 1 2024-09-13T22:56:05.770 INFO:tasks.workunit.client.0.smithi002.stdout:2/280: symlink d1/d7/d8/d2c/l58 0 2024-09-13T22:56:05.772 INFO:tasks.workunit.client.1.smithi047.stdout:8/420: rename d8/f30 to d8/d64/d4e/d70/f93 0 2024-09-13T22:56:05.774 INFO:tasks.workunit.client.1.smithi047.stdout:7/440: mkdir d0/d7/da/d1e/d93 0 2024-09-13T22:56:05.779 INFO:tasks.workunit.client.0.smithi002.stdout:8/279: creat d3/d27/d39/f5c x:0 0 0 2024-09-13T22:56:05.779 INFO:tasks.workunit.client.0.smithi002.stdout:3/346: dread d9/d15/d35/f3a [0,4194304] 0 2024-09-13T22:56:05.780 INFO:tasks.workunit.client.0.smithi002.stdout:3/347: read - d9/d15/d46/f5f zero size 2024-09-13T22:56:05.781 INFO:tasks.workunit.client.1.smithi047.stdout:9/347: truncate d1/dc/d18/f33 204872 0 2024-09-13T22:56:05.782 INFO:tasks.workunit.client.1.smithi047.stdout:9/348: chown d1/dc/d14/dd/d54/d50/c5a 245089 1 2024-09-13T22:56:05.783 INFO:tasks.workunit.client.1.smithi047.stdout:6/447: creat d3/d77/d93/f9a x:0 0 0 2024-09-13T22:56:05.784 INFO:tasks.workunit.client.1.smithi047.stdout:9/349: truncate d1/dc/d14/dd/f3e 657316 0 2024-09-13T22:56:05.785 INFO:tasks.workunit.client.1.smithi047.stdout:6/448: write d3/d11/d2b/d4c/d30/d48/f4e [1055512,126727] 0 2024-09-13T22:56:05.787 INFO:tasks.workunit.client.0.smithi002.stdout:4/265: unlink d3/d14/d29/d2a/c39 0 2024-09-13T22:56:05.788 INFO:tasks.workunit.client.0.smithi002.stdout:4/266: truncate d3/d40/f4e 217127 0 2024-09-13T22:56:05.789 INFO:tasks.workunit.client.1.smithi047.stdout:5/343: getdents d19/d23/d2e 0 2024-09-13T22:56:05.789 INFO:tasks.workunit.client.1.smithi047.stdout:5/344: fsync d19/f1c 0 2024-09-13T22:56:05.794 INFO:tasks.workunit.client.0.smithi002.stdout:1/337: rename d1/fe to d1/d13/d1d/f6c 0 2024-09-13T22:56:05.795 INFO:tasks.workunit.client.0.smithi002.stdout:1/338: chown d1/d13/d30/d31 37 1 2024-09-13T22:56:05.798 INFO:tasks.workunit.client.1.smithi047.stdout:9/350: dread d1/dc/d14/f2f [0,4194304] 0 2024-09-13T22:56:05.799 INFO:tasks.workunit.client.1.smithi047.stdout:0/433: rename d1/d5/d16/d23/d77/f71 to d1/d5/d16/d47/f9b 0 2024-09-13T22:56:05.802 INFO:tasks.workunit.client.1.smithi047.stdout:8/421: creat d8/d64/f94 x:0 0 0 2024-09-13T22:56:05.805 INFO:tasks.workunit.client.0.smithi002.stdout:3/348: rename d9/df/f49 to d9/df/f7b 0 2024-09-13T22:56:05.809 INFO:tasks.workunit.client.1.smithi047.stdout:1/350: unlink d0/c4 0 2024-09-13T22:56:05.810 INFO:tasks.workunit.client.0.smithi002.stdout:4/267: dread d3/d14/d29/d2a/f36 [0,4194304] 0 2024-09-13T22:56:05.814 INFO:tasks.workunit.client.0.smithi002.stdout:4/268: write d3/d14/d29/d2a/f43 [517062,71036] 0 2024-09-13T22:56:05.814 INFO:tasks.workunit.client.0.smithi002.stdout:2/281: dwrite d1/f2 [0,4194304] 0 2024-09-13T22:56:05.815 INFO:tasks.workunit.client.0.smithi002.stdout:1/339: rename d1/d13/d30/d31/f4a to d1/d13/d52/f6d 0 2024-09-13T22:56:05.816 INFO:tasks.workunit.client.0.smithi002.stdout:2/282: chown d1/l24 32288 1 2024-09-13T22:56:05.818 INFO:tasks.workunit.client.0.smithi002.stdout:7/237: dwrite d8/d9/f19 [0,4194304] 0 2024-09-13T22:56:05.820 INFO:tasks.workunit.client.0.smithi002.stdout:7/238: write d8/d9/fd [3577121,101838] 0 2024-09-13T22:56:05.820 INFO:tasks.workunit.client.0.smithi002.stdout:7/239: stat d8/d9/l2f 0 2024-09-13T22:56:05.821 INFO:tasks.workunit.client.0.smithi002.stdout:4/269: dread f1 [0,4194304] 0 2024-09-13T22:56:05.821 INFO:tasks.workunit.client.0.smithi002.stdout:3/349: mkdir d9/d3b/d7c 0 2024-09-13T22:56:05.825 INFO:tasks.workunit.client.0.smithi002.stdout:0/287: creat d1/f63 x:0 0 0 2024-09-13T22:56:05.827 INFO:tasks.workunit.client.0.smithi002.stdout:0/288: write d1/d2/fd [3526295,127149] 0 2024-09-13T22:56:05.833 INFO:tasks.workunit.client.0.smithi002.stdout:2/283: mkdir d1/d7/d35/d3e/d59 0 2024-09-13T22:56:05.834 INFO:tasks.workunit.client.0.smithi002.stdout:2/284: chown d1/d7/c19 1 1 2024-09-13T22:56:05.835 INFO:tasks.workunit.client.0.smithi002.stdout:3/350: rename d9/f66 to d9/df/f7d 0 2024-09-13T22:56:05.837 INFO:tasks.workunit.client.0.smithi002.stdout:2/285: write d1/d7/d8/f27 [1787427,9766] 0 2024-09-13T22:56:05.837 INFO:tasks.workunit.client.1.smithi047.stdout:1/351: write d0/d7/f37 [4640592,5587] 0 2024-09-13T22:56:05.838 INFO:tasks.workunit.client.0.smithi002.stdout:1/340: dread d1/d13/d30/fa [0,4194304] 0 2024-09-13T22:56:05.838 INFO:tasks.workunit.client.0.smithi002.stdout:3/351: dread d9/d3b/f61 [0,4194304] 0 2024-09-13T22:56:05.840 INFO:tasks.workunit.client.1.smithi047.stdout:5/345: rename cd to d19/d25/c75 0 2024-09-13T22:56:05.841 INFO:tasks.workunit.client.1.smithi047.stdout:0/434: unlink d1/d5/d11/d83/l86 0 2024-09-13T22:56:05.843 INFO:tasks.workunit.client.1.smithi047.stdout:0/435: fdatasync d1/d7/ff 0 2024-09-13T22:56:05.843 INFO:tasks.workunit.client.0.smithi002.stdout:0/289: rename d1/d2/d10/f3a to d1/d2/d49/f64 0 2024-09-13T22:56:05.843 INFO:tasks.workunit.client.0.smithi002.stdout:2/286: dread d1/d7/d35/f48 [0,4194304] 0 2024-09-13T22:56:05.844 INFO:tasks.workunit.client.0.smithi002.stdout:0/290: readlink d1/d2/d10/d31/d3c/l54 0 2024-09-13T22:56:05.845 INFO:tasks.workunit.client.0.smithi002.stdout:1/341: mknod d1/d13/d1d/d34/d51/c6e 0 2024-09-13T22:56:05.845 INFO:tasks.workunit.client.0.smithi002.stdout:0/291: chown d1/d2/d10/d31/d3c/f47 912494108 1 2024-09-13T22:56:05.848 INFO:tasks.workunit.client.1.smithi047.stdout:1/352: symlink d0/d7/d13/l69 0 2024-09-13T22:56:05.849 INFO:tasks.workunit.client.0.smithi002.stdout:0/292: dread d1/f2d [4194304,4194304] 0 2024-09-13T22:56:05.852 INFO:tasks.workunit.client.0.smithi002.stdout:4/270: rename d3/c20 to d3/d40/d45/c50 0 2024-09-13T22:56:05.852 INFO:tasks.workunit.client.0.smithi002.stdout:4/271: read d3/d40/f4e [6479,95195] 0 2024-09-13T22:56:05.853 INFO:tasks.workunit.client.0.smithi002.stdout:4/272: chown d3/f3a 124944 1 2024-09-13T22:56:05.855 INFO:tasks.workunit.client.0.smithi002.stdout:6/293: sync 2024-09-13T22:56:05.858 INFO:tasks.workunit.client.1.smithi047.stdout:7/441: creat d0/f94 x:0 0 0 2024-09-13T22:56:05.859 INFO:tasks.workunit.client.1.smithi047.stdout:7/442: stat d0/d7/da/d2e/f4b 0 2024-09-13T22:56:05.859 INFO:tasks.workunit.client.0.smithi002.stdout:8/280: truncate d3/f6 3462454 0 2024-09-13T22:56:05.866 INFO:tasks.workunit.client.1.smithi047.stdout:7/443: dwrite d0/d7/da/d1e/f24 [0,4194304] 0 2024-09-13T22:56:05.867 INFO:tasks.workunit.client.1.smithi047.stdout:8/422: truncate d8/f7b 7692 0 2024-09-13T22:56:05.868 INFO:tasks.workunit.client.1.smithi047.stdout:8/423: read d8/d64/f47 [46129,65916] 0 2024-09-13T22:56:05.868 INFO:tasks.workunit.client.0.smithi002.stdout:0/293: creat d1/d2/d10/d31/f65 x:0 0 0 2024-09-13T22:56:05.869 INFO:tasks.workunit.client.0.smithi002.stdout:0/294: chown d1/d2/d10/d31/d32/c4d 473181240 1 2024-09-13T22:56:05.870 INFO:tasks.workunit.client.0.smithi002.stdout:3/352: truncate d9/d15/d26/f32 405760 0 2024-09-13T22:56:05.872 INFO:tasks.workunit.client.1.smithi047.stdout:9/351: write d1/dc/d18/f33 [501245,103234] 0 2024-09-13T22:56:05.874 INFO:tasks.workunit.client.1.smithi047.stdout:5/346: symlink d19/d34/d6c/l76 0 2024-09-13T22:56:05.875 INFO:tasks.workunit.client.0.smithi002.stdout:6/294: mknod d12/d17/d34/d39/c5f 0 2024-09-13T22:56:05.875 INFO:tasks.workunit.client.1.smithi047.stdout:9/352: write d1/dc/d14/dd/d54/d4e/d51/f5c [808246,45662] 0 2024-09-13T22:56:05.878 INFO:tasks.workunit.client.1.smithi047.stdout:7/444: mkdir d0/d57/d5b/d8b/d95 0 2024-09-13T22:56:05.882 INFO:tasks.workunit.client.1.smithi047.stdout:8/424: rmdir d8/d64/d4e/d4d 39 2024-09-13T22:56:05.883 INFO:tasks.workunit.client.0.smithi002.stdout:0/295: symlink d1/d2/d10/d31/l66 0 2024-09-13T22:56:05.884 INFO:tasks.workunit.client.0.smithi002.stdout:0/296: read - d1/d4/f3e zero size 2024-09-13T22:56:05.886 INFO:tasks.workunit.client.1.smithi047.stdout:0/436: symlink d1/d5/d11/d52/l9c 0 2024-09-13T22:56:05.890 INFO:tasks.workunit.client.1.smithi047.stdout:1/353: write d0/d1d/f2c [2954980,25580] 0 2024-09-13T22:56:05.890 INFO:tasks.workunit.client.0.smithi002.stdout:4/273: mknod d3/d40/c51 0 2024-09-13T22:56:05.890 INFO:tasks.workunit.client.1.smithi047.stdout:8/425: dwrite d8/f1c [0,4194304] 0 2024-09-13T22:56:05.891 INFO:tasks.workunit.client.1.smithi047.stdout:5/347: rmdir d19/d34/d6c 39 2024-09-13T22:56:05.891 INFO:tasks.workunit.client.0.smithi002.stdout:2/287: dwrite d1/f5 [4194304,4194304] 0 2024-09-13T22:56:05.892 INFO:tasks.workunit.client.0.smithi002.stdout:2/288: chown d1/d4d/f56 1553959 1 2024-09-13T22:56:05.898 INFO:tasks.workunit.client.1.smithi047.stdout:9/353: dread d1/dc/d14/f4a [4194304,4194304] 0 2024-09-13T22:56:05.898 INFO:tasks.workunit.client.0.smithi002.stdout:8/281: mknod d3/dc/c5d 0 2024-09-13T22:56:05.902 INFO:tasks.workunit.client.0.smithi002.stdout:0/297: unlink d1/d2/d10/d31/d3c/l54 0 2024-09-13T22:56:05.905 INFO:tasks.workunit.client.0.smithi002.stdout:3/353: mkdir d9/d7e 0 2024-09-13T22:56:05.905 INFO:tasks.workunit.client.0.smithi002.stdout:3/354: readlink d9/d15/d26/d44/l4d 0 2024-09-13T22:56:05.906 INFO:tasks.workunit.client.0.smithi002.stdout:4/274: creat d3/d40/d45/f52 x:0 0 0 2024-09-13T22:56:05.907 INFO:tasks.workunit.client.1.smithi047.stdout:0/437: symlink d1/d5/d16/d6a/d92/l9d 0 2024-09-13T22:56:05.908 INFO:tasks.workunit.client.0.smithi002.stdout:2/289: truncate d1/d7/d8/f31 674961 0 2024-09-13T22:56:05.908 INFO:tasks.workunit.client.0.smithi002.stdout:0/298: dwrite d1/d2/d49/f5a [4194304,4194304] 0 2024-09-13T22:56:05.910 INFO:tasks.workunit.client.0.smithi002.stdout:6/295: unlink d12/d17/f25 0 2024-09-13T22:56:05.911 INFO:tasks.workunit.client.0.smithi002.stdout:6/296: read d12/f14 [4060478,17342] 0 2024-09-13T22:56:05.912 INFO:tasks.workunit.client.1.smithi047.stdout:8/426: write d8/d64/d4e/d4d/d8f/d91/f3a [5660354,105849] 0 2024-09-13T22:56:05.913 INFO:tasks.workunit.client.0.smithi002.stdout:4/275: dwrite d3/f23 [0,4194304] 0 2024-09-13T22:56:05.913 INFO:tasks.workunit.client.0.smithi002.stdout:4/276: readlink d3/d14/d29/l3c 0 2024-09-13T22:56:05.916 INFO:tasks.workunit.client.1.smithi047.stdout:3/433: sync 2024-09-13T22:56:05.920 INFO:tasks.workunit.client.1.smithi047.stdout:3/434: write d0/d3/d4/d16/d2c/de/d1f/f8e [974053,74545] 0 2024-09-13T22:56:05.920 INFO:tasks.workunit.client.1.smithi047.stdout:5/348: rmdir d19/d34/d42 39 2024-09-13T22:56:05.926 INFO:tasks.workunit.client.1.smithi047.stdout:7/445: link d0/d19/f7c d0/d7/da/d1e/d93/f96 0 2024-09-13T22:56:05.927 INFO:tasks.workunit.client.0.smithi002.stdout:3/355: mknod d9/d15/d36/c7f 0 2024-09-13T22:56:05.928 INFO:tasks.workunit.client.0.smithi002.stdout:3/356: stat d9/d15/d26/d44/f75 0 2024-09-13T22:56:05.930 INFO:tasks.workunit.client.1.smithi047.stdout:9/354: mkdir d1/d5f/d6a 0 2024-09-13T22:56:05.931 INFO:tasks.workunit.client.0.smithi002.stdout:3/357: dread d9/d3b/f64 [0,4194304] 0 2024-09-13T22:56:05.932 INFO:tasks.workunit.client.0.smithi002.stdout:0/299: creat d1/d2/f67 x:0 0 0 2024-09-13T22:56:05.936 INFO:tasks.workunit.client.1.smithi047.stdout:1/354: creat d0/d7/d13/d5d/f6a x:0 0 0 2024-09-13T22:56:05.936 INFO:tasks.workunit.client.1.smithi047.stdout:1/355: stat d0/l68 0 2024-09-13T22:56:05.938 INFO:tasks.workunit.client.0.smithi002.stdout:8/282: unlink d3/dc/d34/c3f 0 2024-09-13T22:56:05.938 INFO:tasks.workunit.client.0.smithi002.stdout:8/283: fsync d3/dc/d16/d2f/f47 0 2024-09-13T22:56:05.940 INFO:tasks.workunit.client.1.smithi047.stdout:8/427: mknod d8/d64/d4e/d4d/d8f/d91/d38/c95 0 2024-09-13T22:56:05.941 INFO:tasks.workunit.client.0.smithi002.stdout:4/277: dread - d3/d14/f1a zero size 2024-09-13T22:56:05.941 INFO:tasks.workunit.client.0.smithi002.stdout:4/278: chown d3/d14/d25 1 1 2024-09-13T22:56:05.943 INFO:tasks.workunit.client.1.smithi047.stdout:8/428: dread d8/f1a [4194304,4194304] 0 2024-09-13T22:56:05.945 INFO:tasks.workunit.client.0.smithi002.stdout:4/279: dread d3/f21 [0,4194304] 0 2024-09-13T22:56:05.946 INFO:tasks.workunit.client.1.smithi047.stdout:7/446: rmdir d0/d57 39 2024-09-13T22:56:05.947 INFO:tasks.workunit.client.0.smithi002.stdout:2/290: creat d1/d7/d8/d51/f5a x:0 0 0 2024-09-13T22:56:05.949 INFO:tasks.workunit.client.1.smithi047.stdout:9/355: mkdir d1/dc/d14/dd/d4c/d6b 0 2024-09-13T22:56:05.950 INFO:tasks.workunit.client.1.smithi047.stdout:7/447: dread d0/db/f7e [0,4194304] 0 2024-09-13T22:56:05.951 INFO:tasks.workunit.client.0.smithi002.stdout:0/300: unlink d1/d2/d10/d31/d3c/f43 0 2024-09-13T22:56:05.951 INFO:tasks.workunit.client.0.smithi002.stdout:0/301: chown d1/d2 97686850 1 2024-09-13T22:56:05.957 INFO:tasks.workunit.client.0.smithi002.stdout:3/358: write d9/d15/f30 [1213187,124217] 0 2024-09-13T22:56:05.958 INFO:tasks.workunit.client.0.smithi002.stdout:0/302: dwrite d1/d4/f3e [0,4194304] 0 2024-09-13T22:56:05.959 INFO:tasks.workunit.client.1.smithi047.stdout:3/435: rename d0/d3/d4/d16/d2c/de/d1f/f37 to d0/d25/d44/d43/f90 0 2024-09-13T22:56:05.961 INFO:tasks.workunit.client.0.smithi002.stdout:6/297: dwrite d12/f22 [0,4194304] 0 2024-09-13T22:56:05.963 INFO:tasks.workunit.client.1.smithi047.stdout:8/429: dwrite d8/d64/f57 [0,4194304] 0 2024-09-13T22:56:05.965 INFO:tasks.workunit.client.1.smithi047.stdout:8/430: chown d8/d64/c55 714572 1 2024-09-13T22:56:05.966 INFO:tasks.workunit.client.1.smithi047.stdout:9/356: creat d1/dc/d14/dd/d54/d4e/f6c x:0 0 0 2024-09-13T22:56:05.969 INFO:tasks.workunit.client.0.smithi002.stdout:2/291: rename d1/d7/f16 to d1/d7/d35/d3e/d59/f5b 0 2024-09-13T22:56:05.970 INFO:tasks.workunit.client.0.smithi002.stdout:6/298: dwrite d12/d17/d2a/f59 [0,4194304] 0 2024-09-13T22:56:05.971 INFO:tasks.workunit.client.1.smithi047.stdout:5/349: write d19/d25/f2b [2196730,53709] 0 2024-09-13T22:56:05.974 INFO:tasks.workunit.client.1.smithi047.stdout:0/438: dwrite d1/d5/d11/d2f/f38 [0,4194304] 0 2024-09-13T22:56:05.975 INFO:tasks.workunit.client.0.smithi002.stdout:8/284: mknod d3/dc/c5e 0 2024-09-13T22:56:05.976 INFO:tasks.workunit.client.1.smithi047.stdout:1/356: getdents d0/d7/d14/d57/d62 0 2024-09-13T22:56:05.977 INFO:tasks.workunit.client.1.smithi047.stdout:1/357: write d0/d7/d14/d28/d36/f3d [433272,123544] 0 2024-09-13T22:56:05.978 INFO:tasks.workunit.client.1.smithi047.stdout:3/436: rmdir d0/d3/d4/d16/d2c/de 39 2024-09-13T22:56:05.978 INFO:tasks.workunit.client.0.smithi002.stdout:5/279: sync 2024-09-13T22:56:05.980 INFO:tasks.workunit.client.0.smithi002.stdout:5/280: write d1/d2a/d41/d45/f54 [487680,30882] 0 2024-09-13T22:56:05.982 INFO:tasks.workunit.client.1.smithi047.stdout:8/431: unlink d8/f26 0 2024-09-13T22:56:05.984 INFO:tasks.workunit.client.1.smithi047.stdout:1/358: dread d0/d7/d13/f42 [0,4194304] 0 2024-09-13T22:56:05.985 INFO:tasks.workunit.client.0.smithi002.stdout:0/303: creat d1/d2/d49/f68 x:0 0 0 2024-09-13T22:56:05.989 INFO:tasks.workunit.client.1.smithi047.stdout:9/357: dread d1/f1a [0,4194304] 0 2024-09-13T22:56:05.991 INFO:tasks.workunit.client.1.smithi047.stdout:6/449: sync 2024-09-13T22:56:05.991 INFO:tasks.workunit.client.1.smithi047.stdout:2/511: sync 2024-09-13T22:56:05.991 INFO:tasks.workunit.client.1.smithi047.stdout:4/445: sync 2024-09-13T22:56:05.992 INFO:tasks.workunit.client.1.smithi047.stdout:5/350: write d19/d25/f71 [4329198,119485] 0 2024-09-13T22:56:05.994 INFO:tasks.workunit.client.1.smithi047.stdout:5/351: read - d19/d23/f6a zero size 2024-09-13T22:56:05.995 INFO:tasks.workunit.client.1.smithi047.stdout:5/352: readlink l8 0 2024-09-13T22:56:06.000 INFO:tasks.workunit.client.0.smithi002.stdout:6/299: mknod d12/d17/d34/d39/c60 0 2024-09-13T22:56:06.000 INFO:tasks.workunit.client.0.smithi002.stdout:6/300: fdatasync d12/d17/d2a/f59 0 2024-09-13T22:56:06.002 INFO:tasks.workunit.client.1.smithi047.stdout:3/437: dread d0/d3/d4/d16/d1c/f2d [0,4194304] 0 2024-09-13T22:56:06.002 INFO:tasks.workunit.client.1.smithi047.stdout:5/353: dwrite d19/d23/d2e/f59 [0,4194304] 0 2024-09-13T22:56:06.003 INFO:tasks.workunit.client.1.smithi047.stdout:3/438: chown d0/d25/d44/d43/d85 471 1 2024-09-13T22:56:06.005 INFO:tasks.workunit.client.0.smithi002.stdout:3/359: creat d9/d3b/d7c/f80 x:0 0 0 2024-09-13T22:56:06.005 INFO:tasks.workunit.client.0.smithi002.stdout:5/281: fdatasync d1/d10/f32 0 2024-09-13T22:56:06.008 INFO:tasks.workunit.client.0.smithi002.stdout:0/304: mknod d1/d2/d10/c69 0 2024-09-13T22:56:06.009 INFO:tasks.workunit.client.1.smithi047.stdout:9/358: readlink d1/l5e 0 2024-09-13T22:56:06.010 INFO:tasks.workunit.client.1.smithi047.stdout:9/359: chown d1/f24 365195 1 2024-09-13T22:56:06.011 INFO:tasks.workunit.client.0.smithi002.stdout:4/280: creat d3/d14/f53 x:0 0 0 2024-09-13T22:56:06.012 INFO:tasks.workunit.client.1.smithi047.stdout:9/360: chown d1/c23 228970787 1 2024-09-13T22:56:06.012 INFO:tasks.workunit.client.1.smithi047.stdout:2/512: symlink d1/df/d1d/d20/d29/lae 0 2024-09-13T22:56:06.013 INFO:tasks.workunit.client.0.smithi002.stdout:9/341: sync 2024-09-13T22:56:06.013 INFO:tasks.workunit.client.0.smithi002.stdout:7/240: sync 2024-09-13T22:56:06.014 INFO:tasks.workunit.client.0.smithi002.stdout:1/342: sync 2024-09-13T22:56:06.014 INFO:tasks.workunit.client.1.smithi047.stdout:5/354: dwrite d19/d23/d32/d69/f70 [0,4194304] 0 2024-09-13T22:56:06.014 INFO:tasks.workunit.client.1.smithi047.stdout:4/446: creat dc/de/d23/d40/d7b/f94 x:0 0 0 2024-09-13T22:56:06.015 INFO:tasks.workunit.client.0.smithi002.stdout:0/305: dwrite d1/d2/f45 [0,4194304] 0 2024-09-13T22:56:06.015 INFO:tasks.workunit.client.1.smithi047.stdout:5/355: stat d19/d34/f46 0 2024-09-13T22:56:06.016 INFO:tasks.workunit.client.1.smithi047.stdout:7/448: link d0/d7/da/d47/l55 d0/d7/da/d2e/l97 0 2024-09-13T22:56:06.018 INFO:tasks.workunit.client.0.smithi002.stdout:6/301: rename d12/d17/d28/d3e/f40 to d12/d17/d4e/f61 0 2024-09-13T22:56:06.021 INFO:tasks.workunit.client.1.smithi047.stdout:0/439: unlink d1/d5/d16/c7e 0 2024-09-13T22:56:06.021 INFO:tasks.workunit.client.1.smithi047.stdout:0/440: fdatasync d1/d7/ff 0 2024-09-13T22:56:06.022 INFO:tasks.workunit.client.0.smithi002.stdout:7/241: dwrite d8/f12 [0,4194304] 0 2024-09-13T22:56:06.028 INFO:tasks.workunit.client.1.smithi047.stdout:1/359: rename d0/d1d/f41 to d0/d7/db/f6b 0 2024-09-13T22:56:06.031 INFO:tasks.workunit.client.1.smithi047.stdout:3/439: fsync d0/d25/d44/d5a/f66 0 2024-09-13T22:56:06.032 INFO:tasks.workunit.client.1.smithi047.stdout:3/440: chown d0/d3/d4/l7 13575 1 2024-09-13T22:56:06.037 INFO:tasks.workunit.client.0.smithi002.stdout:4/281: unlink d3/d14/f26 0 2024-09-13T22:56:06.044 INFO:tasks.workunit.client.0.smithi002.stdout:4/282: dwrite d3/d14/f42 [0,4194304] 0 2024-09-13T22:56:06.050 INFO:tasks.workunit.client.1.smithi047.stdout:5/356: write d19/d25/d45/f4d [4390032,122019] 0 2024-09-13T22:56:06.050 INFO:tasks.workunit.client.0.smithi002.stdout:4/283: dwrite d3/d14/f1f [4194304,4194304] 0 2024-09-13T22:56:06.051 INFO:tasks.workunit.client.1.smithi047.stdout:1/360: dread d0/d7/d14/f2a [0,4194304] 0 2024-09-13T22:56:06.052 INFO:tasks.workunit.client.0.smithi002.stdout:1/343: creat d1/d13/d1d/d34/f6f x:0 0 0 2024-09-13T22:56:06.057 INFO:tasks.workunit.client.0.smithi002.stdout:1/344: dwrite d1/d13/d1d/f29 [0,4194304] 0 2024-09-13T22:56:06.058 INFO:tasks.workunit.client.1.smithi047.stdout:0/441: symlink d1/d5/d16/d23/d2d/l9e 0 2024-09-13T22:56:06.058 INFO:tasks.workunit.client.0.smithi002.stdout:1/345: chown d1/d1c/f4f 15571 1 2024-09-13T22:56:06.060 INFO:tasks.workunit.client.0.smithi002.stdout:9/342: write d8/f37 [386606,128664] 0 2024-09-13T22:56:06.060 INFO:tasks.workunit.client.1.smithi047.stdout:8/432: creat d8/d64/d4e/d4d/d8f/d91/f96 x:0 0 0 2024-09-13T22:56:06.060 INFO:tasks.workunit.client.1.smithi047.stdout:8/433: fdatasync d8/f32 0 2024-09-13T22:56:06.062 INFO:tasks.workunit.client.1.smithi047.stdout:8/434: dread - d8/d64/d4e/d4d/d8f/d91/f96 zero size 2024-09-13T22:56:06.062 INFO:tasks.workunit.client.0.smithi002.stdout:0/306: rename d1/d2/d10/l1e to d1/d2/d10/d31/d32/l6a 0 2024-09-13T22:56:06.065 INFO:tasks.workunit.client.0.smithi002.stdout:6/302: creat d12/d17/d34/d39/f62 x:0 0 0 2024-09-13T22:56:06.067 INFO:tasks.workunit.client.0.smithi002.stdout:8/285: creat d3/dc/f5f x:0 0 0 2024-09-13T22:56:06.068 INFO:tasks.workunit.client.1.smithi047.stdout:6/450: creat d3/d11/d2b/f9b x:0 0 0 2024-09-13T22:56:06.069 INFO:tasks.workunit.client.0.smithi002.stdout:3/360: creat d9/d15/d36/d4e/d5e/f81 x:0 0 0 2024-09-13T22:56:06.069 INFO:tasks.workunit.client.0.smithi002.stdout:9/343: dwrite d8/d10/d1c/d3d/f6f [0,4194304] 0 2024-09-13T22:56:06.072 INFO:tasks.workunit.client.0.smithi002.stdout:9/344: truncate d8/d2c/f47 4361328 0 2024-09-13T22:56:06.072 INFO:tasks.workunit.client.0.smithi002.stdout:3/361: read d9/d15/d36/f38 [1230950,93090] 0 2024-09-13T22:56:06.073 INFO:tasks.workunit.client.1.smithi047.stdout:5/357: chown d19/d64/c6b 10082940 1 2024-09-13T22:56:06.074 INFO:tasks.workunit.client.0.smithi002.stdout:2/292: link d1/d7/d35/d3e/l49 d1/l5c 0 2024-09-13T22:56:06.082 INFO:tasks.workunit.client.1.smithi047.stdout:5/358: dwrite d19/d23/d2e/d41/f51 [0,4194304] 0 2024-09-13T22:56:06.085 INFO:tasks.workunit.client.1.smithi047.stdout:9/361: rename d1/dc/d14/dd/d54/l38 to d1/dc/d14/dd/d54/d50/l6d 0 2024-09-13T22:56:06.085 INFO:tasks.workunit.client.1.smithi047.stdout:6/451: rename d3 to d3/d11/d2b/d1c/d70/d98/d9c 22 2024-09-13T22:56:06.087 INFO:tasks.workunit.client.0.smithi002.stdout:7/242: dwrite d8/d9/f1a [4194304,4194304] 0 2024-09-13T22:56:06.088 INFO:tasks.workunit.client.0.smithi002.stdout:7/243: chown d8/f12 1 1 2024-09-13T22:56:06.092 INFO:tasks.workunit.client.0.smithi002.stdout:1/346: mkdir d1/d13/d21/d39/d70 0 2024-09-13T22:56:06.094 INFO:tasks.workunit.client.1.smithi047.stdout:3/441: dwrite d0/d25/d44/d43/f54 [0,4194304] 0 2024-09-13T22:56:06.097 INFO:tasks.workunit.client.1.smithi047.stdout:4/447: creat dc/de/d23/f95 x:0 0 0 2024-09-13T22:56:06.098 INFO:tasks.workunit.client.1.smithi047.stdout:6/452: dread d3/d11/d2b/d4c/d30/d48/f4e [0,4194304] 0 2024-09-13T22:56:06.101 INFO:tasks.workunit.client.0.smithi002.stdout:6/303: unlink d12/d17/d2a/c58 0 2024-09-13T22:56:06.102 INFO:tasks.workunit.client.1.smithi047.stdout:7/449: link d0/d7/f3d d0/d57/f98 0 2024-09-13T22:56:06.105 INFO:tasks.workunit.client.1.smithi047.stdout:8/435: unlink d8/f23 0 2024-09-13T22:56:06.106 INFO:tasks.workunit.client.0.smithi002.stdout:0/307: write d1/d2/d10/d31/d32/f39 [895821,46201] 0 2024-09-13T22:56:06.107 INFO:tasks.workunit.client.0.smithi002.stdout:0/308: write d1/d2/d10/f58 [780056,75692] 0 2024-09-13T22:56:06.109 INFO:tasks.workunit.client.1.smithi047.stdout:5/359: mkdir d19/d23/d2e/d41/d58/d77 0 2024-09-13T22:56:06.110 INFO:tasks.workunit.client.1.smithi047.stdout:8/436: dread d8/f27 [0,4194304] 0 2024-09-13T22:56:06.111 INFO:tasks.workunit.client.1.smithi047.stdout:9/362: symlink d1/dc/d18/l6e 0 2024-09-13T22:56:06.113 INFO:tasks.workunit.client.0.smithi002.stdout:9/345: unlink d8/d2c/d50/f6d 0 2024-09-13T22:56:06.117 INFO:tasks.workunit.client.1.smithi047.stdout:2/513: link d1/d16/f23 d1/df/d1d/da9/faf 0 2024-09-13T22:56:06.120 INFO:tasks.workunit.client.0.smithi002.stdout:4/284: getdents d3/d40/d45/d49 0 2024-09-13T22:56:06.121 INFO:tasks.workunit.client.0.smithi002.stdout:3/362: dwrite d9/df/f7d [0,4194304] 0 2024-09-13T22:56:06.124 INFO:tasks.workunit.client.1.smithi047.stdout:6/453: mkdir d3/d11/d2b/d4c/d9d 0 2024-09-13T22:56:06.125 INFO:tasks.workunit.client.1.smithi047.stdout:6/454: dread - d3/d11/d2b/f6c zero size 2024-09-13T22:56:06.125 INFO:tasks.workunit.client.0.smithi002.stdout:3/363: dread - d9/d3b/f70 zero size 2024-09-13T22:56:06.125 INFO:tasks.workunit.client.0.smithi002.stdout:7/244: chown d8/d10/d11/d13 34 1 2024-09-13T22:56:06.125 INFO:tasks.workunit.client.0.smithi002.stdout:1/347: write d1/d13/d30/f2d [2301074,22995] 0 2024-09-13T22:56:06.126 INFO:tasks.workunit.client.0.smithi002.stdout:7/245: rename d8/d10/d11/d3a to d8/d10/d11/d3a/d43 22 2024-09-13T22:56:06.126 INFO:tasks.workunit.client.0.smithi002.stdout:1/348: read - d1/f57 zero size 2024-09-13T22:56:06.126 INFO:tasks.workunit.client.1.smithi047.stdout:7/450: creat d0/d7/da/d1e/d51/f99 x:0 0 0 2024-09-13T22:56:06.127 INFO:tasks.workunit.client.0.smithi002.stdout:7/246: dread d8/d10/f1e [4194304,4194304] 0 2024-09-13T22:56:06.130 INFO:tasks.workunit.client.0.smithi002.stdout:8/286: mkdir d3/dc/d16/d60 0 2024-09-13T22:56:06.131 INFO:tasks.workunit.client.0.smithi002.stdout:8/287: read - d3/d21/f49 zero size 2024-09-13T22:56:06.131 INFO:tasks.workunit.client.1.smithi047.stdout:9/363: symlink d1/d2d/l6f 0 2024-09-13T22:56:06.132 INFO:tasks.workunit.client.0.smithi002.stdout:2/293: dwrite d1/d7/d8/f10 [0,4194304] 0 2024-09-13T22:56:06.133 INFO:tasks.workunit.client.0.smithi002.stdout:2/294: write d1/f5 [1826727,40655] 0 2024-09-13T22:56:06.133 INFO:tasks.workunit.client.0.smithi002.stdout:2/295: write d1/d7/f47 [81843,99062] 0 2024-09-13T22:56:06.134 INFO:tasks.workunit.client.1.smithi047.stdout:8/437: mknod d8/d64/d4e/d4d/d8f/d91/d38/c97 0 2024-09-13T22:56:06.137 INFO:tasks.workunit.client.0.smithi002.stdout:0/309: creat d1/d2/f6b x:0 0 0 2024-09-13T22:56:06.138 INFO:tasks.workunit.client.0.smithi002.stdout:5/282: getdents d1/d2a/d5a 0 2024-09-13T22:56:06.141 INFO:tasks.workunit.client.1.smithi047.stdout:9/364: dwrite d1/f24 [0,4194304] 0 2024-09-13T22:56:06.147 INFO:tasks.workunit.client.1.smithi047.stdout:6/455: mknod d3/d11/d2b/d1c/c9e 0 2024-09-13T22:56:06.149 INFO:tasks.workunit.client.0.smithi002.stdout:3/364: mknod d9/df/c82 0 2024-09-13T22:56:06.154 INFO:tasks.workunit.client.1.smithi047.stdout:2/514: dread d1/df/d26/f30 [0,4194304] 0 2024-09-13T22:56:06.154 INFO:tasks.workunit.client.0.smithi002.stdout:1/349: mkdir d1/d13/d30/d31/d3b/d71 0 2024-09-13T22:56:06.155 INFO:tasks.workunit.client.1.smithi047.stdout:2/515: write d1/df/d1d/d20/d37/d7b/f79 [1332689,117481] 0 2024-09-13T22:56:06.157 INFO:tasks.workunit.client.1.smithi047.stdout:9/365: unlink d1/f3f 0 2024-09-13T22:56:06.158 INFO:tasks.workunit.client.1.smithi047.stdout:9/366: chown d1/dc/d14/dd/f3e 26177468 1 2024-09-13T22:56:06.159 INFO:tasks.workunit.client.0.smithi002.stdout:1/350: dwrite d1/d13/d21/f5b [0,4194304] 0 2024-09-13T22:56:06.160 INFO:tasks.workunit.client.0.smithi002.stdout:1/351: readlink d1/d13/l22 0 2024-09-13T22:56:06.161 INFO:tasks.workunit.client.1.smithi047.stdout:3/442: rename d0/d25/d44/d5a to d0/d3/d4/d91 0 2024-09-13T22:56:06.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:05 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:06.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:05 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:06.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:05 smithi047 ceph-mon[34560]: pgmap v13: 65 pgs: 65 active+clean; 1.1 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 14 MiB/s rd, 149 MiB/s wr, 263 op/s 2024-09-13T22:56:06.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:05 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:06.163 INFO:tasks.workunit.client.1.smithi047.stdout:3/443: write d0/d25/d44/d43/d3a/f6d [3256883,113341] 0 2024-09-13T22:56:06.163 INFO:tasks.workunit.client.1.smithi047.stdout:4/448: creat dc/de/d23/f96 x:0 0 0 2024-09-13T22:56:06.167 INFO:tasks.workunit.client.0.smithi002.stdout:4/285: dwrite d3/f1e [0,4194304] 0 2024-09-13T22:56:06.167 INFO:tasks.workunit.client.0.smithi002.stdout:4/286: read d3/f24 [3825346,65339] 0 2024-09-13T22:56:06.168 INFO:tasks.workunit.client.0.smithi002.stdout:8/288: chown d3/f38 124732 1 2024-09-13T22:56:06.168 INFO:tasks.workunit.client.0.smithi002.stdout:4/287: fdatasync f2 0 2024-09-13T22:56:06.168 INFO:tasks.workunit.client.1.smithi047.stdout:6/456: dread d3/d11/d2b/d4c/d30/d48/f4e [0,4194304] 0 2024-09-13T22:56:06.170 INFO:tasks.workunit.client.1.smithi047.stdout:3/444: read d0/d25/d44/d43/f6b [472938,47402] 0 2024-09-13T22:56:06.179 INFO:tasks.workunit.client.0.smithi002.stdout:0/310: mkdir d1/d2/d6c 0 2024-09-13T22:56:06.180 INFO:tasks.workunit.client.0.smithi002.stdout:0/311: write d1/d2/d10/f58 [71117,25861] 0 2024-09-13T22:56:06.181 INFO:tasks.workunit.client.0.smithi002.stdout:5/283: creat d1/d2a/d5a/f65 x:0 0 0 2024-09-13T22:56:06.181 INFO:tasks.workunit.client.0.smithi002.stdout:2/296: write d1/f15 [818021,109855] 0 2024-09-13T22:56:06.182 INFO:tasks.workunit.client.0.smithi002.stdout:5/284: stat d1/d2a 0 2024-09-13T22:56:06.183 INFO:tasks.workunit.client.1.smithi047.stdout:2/516: unlink d1/df/d1d/d2e/d5e/f96 0 2024-09-13T22:56:06.184 INFO:tasks.workunit.client.0.smithi002.stdout:9/346: mknod d8/d10/d1c/d68/c72 0 2024-09-13T22:56:06.185 INFO:tasks.workunit.client.0.smithi002.stdout:5/285: write d1/d10/f51 [3754462,83881] 0 2024-09-13T22:56:06.187 INFO:tasks.workunit.client.1.smithi047.stdout:7/451: rename d0/d7/c83 to d0/d7/da/d1e/c9a 0 2024-09-13T22:56:06.189 INFO:tasks.workunit.client.0.smithi002.stdout:2/297: dwrite d1/d7/d8/f33 [0,4194304] 0 2024-09-13T22:56:06.189 INFO:tasks.workunit.client.0.smithi002.stdout:1/352: dread d1/d13/d30/d31/d3b/f67 [4194304,4194304] 0 2024-09-13T22:56:06.189 INFO:tasks.workunit.client.1.smithi047.stdout:7/452: dread - d0/d7/da/d1e/d51/f99 zero size 2024-09-13T22:56:06.190 INFO:tasks.workunit.client.0.smithi002.stdout:3/365: rename d9/d15/d26/d44/d58 to d9/d3b/d53/d83 0 2024-09-13T22:56:06.191 INFO:tasks.workunit.client.1.smithi047.stdout:9/367: dwrite d1/dc/d14/f16 [0,4194304] 0 2024-09-13T22:56:06.195 INFO:tasks.workunit.client.1.smithi047.stdout:6/457: unlink d3/d11/d2b/d76/c8b 0 2024-09-13T22:56:06.198 INFO:tasks.workunit.client.1.smithi047.stdout:6/458: stat d3/d11/d2b/d4c/d30/f37 0 2024-09-13T22:56:06.198 INFO:tasks.workunit.client.0.smithi002.stdout:2/298: dwrite d1/d7/d8/f1b [0,4194304] 0 2024-09-13T22:56:06.198 INFO:tasks.workunit.client.0.smithi002.stdout:6/304: link d12/f22 d12/f63 0 2024-09-13T22:56:06.200 INFO:tasks.workunit.client.1.smithi047.stdout:8/438: rmdir d8/d64/d8a 0 2024-09-13T22:56:06.203 INFO:tasks.workunit.client.1.smithi047.stdout:9/368: dwrite d1/d2d/f56 [0,4194304] 0 2024-09-13T22:56:06.204 INFO:tasks.workunit.client.1.smithi047.stdout:8/439: write d8/d64/d4e/d4d/d8f/d91/f96 [273819,43428] 0 2024-09-13T22:56:06.208 INFO:tasks.workunit.client.1.smithi047.stdout:2/517: mkdir d1/d16/d40/d57/db0 0 2024-09-13T22:56:06.210 INFO:tasks.workunit.client.1.smithi047.stdout:5/360: rename d19/l1b to d19/d34/d6c/l78 0 2024-09-13T22:56:06.212 INFO:tasks.workunit.client.1.smithi047.stdout:2/518: dread d1/df/d1d/d20/f8f [0,4194304] 0 2024-09-13T22:56:06.214 INFO:tasks.workunit.client.1.smithi047.stdout:7/453: mknod d0/d7/da/d4e/c9b 0 2024-09-13T22:56:06.218 INFO:tasks.workunit.client.1.smithi047.stdout:2/519: dread d1/d16/f7c [0,4194304] 0 2024-09-13T22:56:06.219 INFO:tasks.workunit.client.1.smithi047.stdout:7/454: dread d0/d19/f77 [0,4194304] 0 2024-09-13T22:56:06.221 INFO:tasks.workunit.client.0.smithi002.stdout:7/247: truncate d8/d9/fd 6262613 0 2024-09-13T22:56:06.223 INFO:tasks.workunit.client.0.smithi002.stdout:7/248: stat d8/d9/f40 0 2024-09-13T22:56:06.223 INFO:tasks.workunit.client.0.smithi002.stdout:0/312: rmdir d1/d2/d49 39 2024-09-13T22:56:06.224 INFO:tasks.workunit.client.0.smithi002.stdout:7/249: write d8/d10/d11/d13/f1c [1231276,21962] 0 2024-09-13T22:56:06.227 INFO:tasks.workunit.client.0.smithi002.stdout:5/286: symlink d1/d2a/l66 0 2024-09-13T22:56:06.230 INFO:tasks.workunit.client.0.smithi002.stdout:3/366: mknod d9/d15/d46/c84 0 2024-09-13T22:56:06.230 INFO:tasks.workunit.client.0.smithi002.stdout:8/289: dread d3/f36 [0,4194304] 0 2024-09-13T22:56:06.231 INFO:tasks.workunit.client.1.smithi047.stdout:9/369: dread d1/dc/f47 [0,4194304] 0 2024-09-13T22:56:06.232 INFO:tasks.workunit.client.0.smithi002.stdout:0/313: dwrite d1/f14 [0,4194304] 0 2024-09-13T22:56:06.235 INFO:tasks.workunit.client.0.smithi002.stdout:2/299: creat d1/d7/d8/f5d x:0 0 0 2024-09-13T22:56:06.237 INFO:tasks.workunit.client.0.smithi002.stdout:6/305: chown d12/d17/d4e/f52 1 1 2024-09-13T22:56:06.239 INFO:tasks.workunit.client.1.smithi047.stdout:7/455: dread d0/d19/f3a [0,4194304] 0 2024-09-13T22:56:06.242 INFO:tasks.workunit.client.0.smithi002.stdout:2/300: dread d1/d32/d37/d3a/f4b [0,4194304] 0 2024-09-13T22:56:06.242 INFO:tasks.workunit.client.0.smithi002.stdout:6/306: dread d12/f22 [0,4194304] 0 2024-09-13T22:56:06.244 INFO:tasks.workunit.client.0.smithi002.stdout:5/287: dread d1/d2a/d41/f5d [0,4194304] 0 2024-09-13T22:56:06.245 INFO:tasks.workunit.client.0.smithi002.stdout:7/250: rmdir d8/d10 39 2024-09-13T22:56:06.247 INFO:tasks.workunit.client.0.smithi002.stdout:3/367: creat d9/d15/d26/f85 x:0 0 0 2024-09-13T22:56:06.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:05 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:06.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:05 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:06.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:05 smithi002 ceph-mon[27637]: pgmap v13: 65 pgs: 65 active+clean; 1.1 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 14 MiB/s rd, 149 MiB/s wr, 263 op/s 2024-09-13T22:56:06.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:05 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:06.250 INFO:tasks.workunit.client.1.smithi047.stdout:2/520: truncate d1/df/d1d/d20/f8f 88974 0 2024-09-13T22:56:06.251 INFO:tasks.workunit.client.1.smithi047.stdout:2/521: fsync d1/df/d35/f78 0 2024-09-13T22:56:06.252 INFO:tasks.workunit.client.1.smithi047.stdout:5/361: symlink d19/d23/l79 0 2024-09-13T22:56:06.258 INFO:tasks.workunit.client.0.smithi002.stdout:4/288: rmdir d3/d40/d45/d49 0 2024-09-13T22:56:06.259 INFO:tasks.workunit.client.0.smithi002.stdout:1/353: write d1/d13/d30/d31/d3d/f6a [4449682,3023] 0 2024-09-13T22:56:06.262 INFO:tasks.workunit.client.1.smithi047.stdout:7/456: truncate d0/db/fc 2090703 0 2024-09-13T22:56:06.264 INFO:tasks.workunit.client.0.smithi002.stdout:2/301: mkdir d1/d7/d35/d3e/d5e 0 2024-09-13T22:56:06.264 INFO:tasks.workunit.client.0.smithi002.stdout:2/302: chown d1/d7/d8/d2c/f39 836 1 2024-09-13T22:56:06.265 INFO:tasks.workunit.client.1.smithi047.stdout:6/459: link d3/d11/d2b/d4c/d30/c7f d3/d77/c9f 0 2024-09-13T22:56:06.266 INFO:tasks.workunit.client.0.smithi002.stdout:2/303: fdatasync d1/d4d/f50 0 2024-09-13T22:56:06.267 INFO:tasks.workunit.client.0.smithi002.stdout:6/307: fdatasync d12/d17/d28/f2f 0 2024-09-13T22:56:06.269 INFO:tasks.workunit.client.1.smithi047.stdout:4/449: rename dc/de/d17/f1e to dc/de/f97 0 2024-09-13T22:56:06.271 INFO:tasks.workunit.client.0.smithi002.stdout:7/251: write d8/d10/f2a [3892882,37864] 0 2024-09-13T22:56:06.273 INFO:tasks.workunit.client.1.smithi047.stdout:2/522: stat d1/de/l32 0 2024-09-13T22:56:06.274 INFO:tasks.workunit.client.1.smithi047.stdout:2/523: chown d1/df/d1d/l66 3656 1 2024-09-13T22:56:06.279 INFO:tasks.workunit.client.1.smithi047.stdout:6/460: dread d3/d11/d2b/d4c/d30/f44 [0,4194304] 0 2024-09-13T22:56:06.283 INFO:tasks.workunit.client.1.smithi047.stdout:8/440: getdents d8/d3f 0 2024-09-13T22:56:06.285 INFO:tasks.workunit.client.1.smithi047.stdout:3/445: rename d0/f58 to d0/d3/d4/d16/d1c/f92 0 2024-09-13T22:56:06.286 INFO:tasks.workunit.client.0.smithi002.stdout:1/354: truncate d1/d13/d21/d40/f5c 84732 0 2024-09-13T22:56:06.287 INFO:tasks.workunit.client.0.smithi002.stdout:2/304: symlink d1/d7/d35/d3e/d59/l5f 0 2024-09-13T22:56:06.287 INFO:tasks.workunit.client.1.smithi047.stdout:5/362: mknod d19/d34/d42/c7a 0 2024-09-13T22:56:06.288 INFO:tasks.workunit.client.1.smithi047.stdout:5/363: stat d19/d25/f71 0 2024-09-13T22:56:06.289 INFO:tasks.workunit.client.1.smithi047.stdout:2/524: creat d1/df/d1d/d20/d37/fb1 x:0 0 0 2024-09-13T22:56:06.290 INFO:tasks.workunit.client.0.smithi002.stdout:5/288: symlink d1/d2a/d41/d55/d56/l67 0 2024-09-13T22:56:06.291 INFO:tasks.workunit.client.1.smithi047.stdout:1/361: sync 2024-09-13T22:56:06.292 INFO:tasks.workunit.client.1.smithi047.stdout:1/362: dread - d0/f5a zero size 2024-09-13T22:56:06.293 INFO:tasks.workunit.client.1.smithi047.stdout:6/461: fsync d3/d11/d2b/d4c/d30/f5d 0 2024-09-13T22:56:06.294 INFO:tasks.workunit.client.1.smithi047.stdout:1/363: fdatasync d0/d7/db/f58 0 2024-09-13T22:56:06.294 INFO:tasks.workunit.client.1.smithi047.stdout:6/462: write d3/d11/d74/f85 [245312,61010] 0 2024-09-13T22:56:06.295 INFO:tasks.workunit.client.0.smithi002.stdout:7/252: unlink d8/f37 0 2024-09-13T22:56:06.295 INFO:tasks.workunit.client.0.smithi002.stdout:7/253: readlink d8/d9/l2f 0 2024-09-13T22:56:06.296 INFO:tasks.workunit.client.0.smithi002.stdout:7/254: chown d8/d10/d11/l14 531742192 1 2024-09-13T22:56:06.296 INFO:tasks.workunit.client.1.smithi047.stdout:6/463: truncate d3/d11/d2b/f9b 900224 0 2024-09-13T22:56:06.297 INFO:tasks.workunit.client.1.smithi047.stdout:6/464: stat d3/d77/d93/f9a 0 2024-09-13T22:56:06.298 INFO:tasks.workunit.client.0.smithi002.stdout:3/368: getdents d9/d7e 0 2024-09-13T22:56:06.299 INFO:tasks.workunit.client.1.smithi047.stdout:8/441: rmdir d8/d64/d4e 39 2024-09-13T22:56:06.300 INFO:tasks.workunit.client.0.smithi002.stdout:7/255: dread d8/d9/f1a [4194304,4194304] 0 2024-09-13T22:56:06.301 INFO:tasks.workunit.client.0.smithi002.stdout:0/314: link d1/d2/d10/d31/f41 d1/d2/f6d 0 2024-09-13T22:56:06.303 INFO:tasks.workunit.client.0.smithi002.stdout:4/289: mknod d3/c54 0 2024-09-13T22:56:06.304 INFO:tasks.workunit.client.0.smithi002.stdout:4/290: dread - d3/d14/d29/d2a/f37 zero size 2024-09-13T22:56:06.305 INFO:tasks.workunit.client.1.smithi047.stdout:5/364: rmdir d19/d34/d6c 39 2024-09-13T22:56:06.305 INFO:tasks.workunit.client.0.smithi002.stdout:4/291: read d3/d14/d29/d2a/f43 [229036,50131] 0 2024-09-13T22:56:06.307 INFO:tasks.workunit.client.1.smithi047.stdout:9/370: getdents d1/d2d 0 2024-09-13T22:56:06.309 INFO:tasks.workunit.client.1.smithi047.stdout:9/371: write d1/dc/d14/dd/d54/d4e/d51/f5c [1525224,21530] 0 2024-09-13T22:56:06.314 INFO:tasks.workunit.client.1.smithi047.stdout:6/465: symlink d3/d11/d2b/d4c/d30/d48/la0 0 2024-09-13T22:56:06.315 INFO:tasks.workunit.client.0.smithi002.stdout:5/289: dwrite d1/d10/f3d [0,4194304] 0 2024-09-13T22:56:06.316 INFO:tasks.workunit.client.0.smithi002.stdout:3/369: rename d9/d3b/c73 to d9/d15/d26/c86 0 2024-09-13T22:56:06.318 INFO:tasks.workunit.client.0.smithi002.stdout:7/256: mkdir d8/d10/d11/d3a/d44 0 2024-09-13T22:56:06.320 INFO:tasks.workunit.client.1.smithi047.stdout:7/457: rename d0/d19/c1b to d0/d7/da/d1e/d51/c9c 0 2024-09-13T22:56:06.320 INFO:tasks.workunit.client.0.smithi002.stdout:7/257: write d8/d10/d11/d13/f1c [623610,95424] 0 2024-09-13T22:56:06.321 INFO:tasks.workunit.client.0.smithi002.stdout:7/258: read d8/d10/f2a [2271822,75209] 0 2024-09-13T22:56:06.322 INFO:tasks.workunit.client.0.smithi002.stdout:0/315: stat d1/d2/c3f 0 2024-09-13T22:56:06.322 INFO:tasks.workunit.client.1.smithi047.stdout:3/446: rmdir d0/d3/d4/d16/d2c/de 39 2024-09-13T22:56:06.325 INFO:tasks.workunit.client.0.smithi002.stdout:1/355: creat d1/d13/d21/d39/d70/f72 x:0 0 0 2024-09-13T22:56:06.325 INFO:tasks.workunit.client.1.smithi047.stdout:1/364: write d0/d7/db/f38 [6395901,23421] 0 2024-09-13T22:56:06.330 INFO:tasks.workunit.client.1.smithi047.stdout:5/365: creat d19/d23/d4c/f7b x:0 0 0 2024-09-13T22:56:06.330 INFO:tasks.workunit.client.1.smithi047.stdout:2/525: creat d1/df/d1d/d20/d37/d85/fb2 x:0 0 0 2024-09-13T22:56:06.331 INFO:tasks.workunit.client.1.smithi047.stdout:5/366: read d19/d34/f46 [2135714,115017] 0 2024-09-13T22:56:06.335 INFO:tasks.workunit.client.0.smithi002.stdout:5/290: unlink d1/c5 0 2024-09-13T22:56:06.337 INFO:tasks.workunit.client.1.smithi047.stdout:8/442: mkdir d8/d64/d4e/d70/d98 0 2024-09-13T22:56:06.337 INFO:tasks.workunit.client.1.smithi047.stdout:2/526: dwrite d1/df/d1d/d20/f2c [0,4194304] 0 2024-09-13T22:56:06.338 INFO:tasks.workunit.client.1.smithi047.stdout:2/527: chown d1/df/d35/f78 167 1 2024-09-13T22:56:06.339 INFO:tasks.workunit.client.0.smithi002.stdout:1/356: dread d1/f27 [0,4194304] 0 2024-09-13T22:56:06.346 INFO:tasks.workunit.client.0.smithi002.stdout:1/357: dwrite d1/d13/d1d/f3a [0,4194304] 0 2024-09-13T22:56:06.353 INFO:tasks.workunit.client.0.smithi002.stdout:4/292: mknod d3/c55 0 2024-09-13T22:56:06.353 INFO:tasks.workunit.client.0.smithi002.stdout:4/293: chown f1 2545823 1 2024-09-13T22:56:06.355 INFO:tasks.workunit.client.0.smithi002.stdout:2/305: link d1/c6 d1/d32/c60 0 2024-09-13T22:56:06.356 INFO:tasks.workunit.client.0.smithi002.stdout:8/290: sync 2024-09-13T22:56:06.356 INFO:tasks.workunit.client.0.smithi002.stdout:9/347: sync 2024-09-13T22:56:06.357 INFO:tasks.workunit.client.0.smithi002.stdout:9/348: stat d8/d10/l32 0 2024-09-13T22:56:06.357 INFO:tasks.workunit.client.0.smithi002.stdout:6/308: getdents d12/d17/d34/d4b 0 2024-09-13T22:56:06.358 INFO:tasks.workunit.client.0.smithi002.stdout:4/294: dread f2 [0,4194304] 0 2024-09-13T22:56:06.361 INFO:tasks.workunit.client.0.smithi002.stdout:3/370: fsync d9/d15/f2f 0 2024-09-13T22:56:06.366 INFO:tasks.workunit.client.0.smithi002.stdout:1/358: mkdir d1/d13/d30/d73 0 2024-09-13T22:56:06.372 INFO:tasks.workunit.client.0.smithi002.stdout:2/306: truncate d1/d7/d8/f17 3567971 0 2024-09-13T22:56:06.376 INFO:tasks.workunit.client.1.smithi047.stdout:9/372: mknod d1/dc/d14/dd/d54/d50/d60/c70 0 2024-09-13T22:56:06.377 INFO:tasks.workunit.client.0.smithi002.stdout:5/291: creat d1/d2a/d41/d45/d4f/f68 x:0 0 0 2024-09-13T22:56:06.378 INFO:tasks.workunit.client.1.smithi047.stdout:1/365: rename d0/d7/d10/f33 to d0/d7/d10/f6c 0 2024-09-13T22:56:06.380 INFO:tasks.workunit.client.1.smithi047.stdout:0/442: sync 2024-09-13T22:56:06.383 INFO:tasks.workunit.client.0.smithi002.stdout:7/259: creat d8/d10/f45 x:0 0 0 2024-09-13T22:56:06.388 INFO:tasks.workunit.client.0.smithi002.stdout:0/316: creat d1/d2/f6e x:0 0 0 2024-09-13T22:56:06.389 INFO:tasks.workunit.client.1.smithi047.stdout:0/443: dwrite d1/d5/f8c [0,4194304] 0 2024-09-13T22:56:06.389 INFO:tasks.workunit.client.1.smithi047.stdout:1/366: dread d0/d1d/f2c [0,4194304] 0 2024-09-13T22:56:06.392 INFO:tasks.workunit.client.0.smithi002.stdout:2/307: creat d1/d4a/f61 x:0 0 0 2024-09-13T22:56:06.393 INFO:tasks.workunit.client.1.smithi047.stdout:7/458: symlink d0/d7/l9d 0 2024-09-13T22:56:06.395 INFO:tasks.workunit.client.0.smithi002.stdout:6/309: mknod d12/d17/c64 0 2024-09-13T22:56:06.396 INFO:tasks.workunit.client.0.smithi002.stdout:9/349: dwrite d8/d10/d42/f4d [0,4194304] 0 2024-09-13T22:56:06.401 INFO:tasks.workunit.client.0.smithi002.stdout:5/292: mkdir d1/d2a/d69 0 2024-09-13T22:56:06.405 INFO:tasks.workunit.client.1.smithi047.stdout:9/373: dwrite d1/dc/d14/f17 [0,4194304] 0 2024-09-13T22:56:06.406 INFO:tasks.workunit.client.1.smithi047.stdout:6/466: creat d3/d11/fa1 x:0 0 0 2024-09-13T22:56:06.408 INFO:tasks.workunit.client.1.smithi047.stdout:6/467: write d3/d11/d2b/d1c/f1e [7269021,24106] 0 2024-09-13T22:56:06.415 INFO:tasks.workunit.client.1.smithi047.stdout:2/528: mknod d1/d16/d40/d57/db0/cb3 0 2024-09-13T22:56:06.417 INFO:tasks.workunit.client.0.smithi002.stdout:8/291: link d3/dc/f42 d3/f61 0 2024-09-13T22:56:06.420 INFO:tasks.workunit.client.1.smithi047.stdout:1/367: read d0/d1d/f2e [493323,52565] 0 2024-09-13T22:56:06.420 INFO:tasks.workunit.client.1.smithi047.stdout:3/447: dwrite d0/d3/d4/d16/d2c/de/f80 [0,4194304] 0 2024-09-13T22:56:06.422 INFO:tasks.workunit.client.1.smithi047.stdout:4/450: rename dc/c91 to dc/de/c98 0 2024-09-13T22:56:06.422 INFO:tasks.workunit.client.1.smithi047.stdout:4/451: chown dc/de/d23 0 1 2024-09-13T22:56:06.423 INFO:tasks.workunit.client.0.smithi002.stdout:2/308: symlink d1/d4d/l62 0 2024-09-13T22:56:06.424 INFO:tasks.workunit.client.1.smithi047.stdout:4/452: truncate dc/de/d23/f81 584007 0 2024-09-13T22:56:06.424 INFO:tasks.workunit.client.0.smithi002.stdout:1/359: truncate d1/f27 3427308 0 2024-09-13T22:56:06.424 INFO:tasks.workunit.client.0.smithi002.stdout:1/360: stat d1/d13/d1d/d34/f35 0 2024-09-13T22:56:06.426 INFO:tasks.workunit.client.0.smithi002.stdout:9/350: symlink d8/d10/d1c/l73 0 2024-09-13T22:56:06.430 INFO:tasks.workunit.client.1.smithi047.stdout:8/443: dwrite d8/f1f [0,4194304] 0 2024-09-13T22:56:06.432 INFO:tasks.workunit.client.1.smithi047.stdout:8/444: write d8/d64/f57 [3567210,111260] 0 2024-09-13T22:56:06.432 INFO:tasks.workunit.client.1.smithi047.stdout:9/374: rmdir d1/dc/d18 39 2024-09-13T22:56:06.445 INFO:tasks.workunit.client.0.smithi002.stdout:5/293: dread d1/d10/f35 [0,4194304] 0 2024-09-13T22:56:06.449 INFO:tasks.workunit.client.0.smithi002.stdout:8/292: dread d3/dc/fd [0,4194304] 0 2024-09-13T22:56:06.449 INFO:tasks.workunit.client.0.smithi002.stdout:7/260: write d8/d9/fd [1712356,68619] 0 2024-09-13T22:56:06.449 INFO:tasks.workunit.client.1.smithi047.stdout:6/468: dread d3/d11/d2b/f6f [0,4194304] 0 2024-09-13T22:56:06.450 INFO:tasks.workunit.client.0.smithi002.stdout:7/261: write d8/d9/fd [2154481,12290] 0 2024-09-13T22:56:06.450 INFO:tasks.workunit.client.0.smithi002.stdout:8/293: truncate d3/dc/d18/f5a 627214 0 2024-09-13T22:56:06.450 INFO:tasks.workunit.client.0.smithi002.stdout:9/351: mkdir d8/d10/d1c/d68/d74 0 2024-09-13T22:56:06.452 INFO:tasks.workunit.client.0.smithi002.stdout:7/262: write d8/d10/f45 [841122,113110] 0 2024-09-13T22:56:06.452 INFO:tasks.workunit.client.1.smithi047.stdout:6/469: truncate d3/d11/d2b/d4c/d30/d48/f7d 326491 0 2024-09-13T22:56:06.452 INFO:tasks.workunit.client.1.smithi047.stdout:3/448: read d0/d3/d4/d16/d2c/f20 [4190833,109770] 0 2024-09-13T22:56:06.453 INFO:tasks.workunit.client.0.smithi002.stdout:7/263: stat d8/l17 0 2024-09-13T22:56:06.453 INFO:tasks.workunit.client.1.smithi047.stdout:2/529: write d1/df/d1d/d20/d2b/f75 [994940,27129] 0 2024-09-13T22:56:06.454 INFO:tasks.workunit.client.0.smithi002.stdout:8/294: dread d3/d27/f32 [0,4194304] 0 2024-09-13T22:56:06.455 INFO:tasks.workunit.client.0.smithi002.stdout:4/295: getdents d3/d14/d29/d2a 0 2024-09-13T22:56:06.456 INFO:tasks.workunit.client.1.smithi047.stdout:2/530: write d1/df/d1d/d20/d37/d85/fb2 [298759,43521] 0 2024-09-13T22:56:06.457 INFO:tasks.workunit.client.1.smithi047.stdout:3/449: truncate d0/d25/d44/d43/d3a/f6d 4689986 0 2024-09-13T22:56:06.459 INFO:tasks.workunit.client.0.smithi002.stdout:3/371: link d9/d15/d51/l3e d9/df/l87 0 2024-09-13T22:56:06.462 INFO:tasks.workunit.client.1.smithi047.stdout:5/367: getdents d19/d34/d42/d5d 0 2024-09-13T22:56:06.464 INFO:tasks.workunit.client.0.smithi002.stdout:0/317: creat d1/f6f x:0 0 0 2024-09-13T22:56:06.465 INFO:tasks.workunit.client.1.smithi047.stdout:3/450: dwrite d0/f12 [0,4194304] 0 2024-09-13T22:56:06.468 INFO:tasks.workunit.client.1.smithi047.stdout:9/375: symlink d1/dc/d14/dd/d54/d4e/d51/l71 0 2024-09-13T22:56:06.470 INFO:tasks.workunit.client.1.smithi047.stdout:0/444: truncate d1/d5/d16/d23/f64 228352 0 2024-09-13T22:56:06.471 INFO:tasks.workunit.client.0.smithi002.stdout:0/318: dwrite d1/d4/f21 [0,4194304] 0 2024-09-13T22:56:06.471 INFO:tasks.workunit.client.0.smithi002.stdout:0/319: chown d1/f1a 2366 1 2024-09-13T22:56:06.472 INFO:tasks.workunit.client.1.smithi047.stdout:0/445: read d1/f4 [679096,19103] 0 2024-09-13T22:56:06.473 INFO:tasks.workunit.client.1.smithi047.stdout:1/368: mknod d0/d1d/c6d 0 2024-09-13T22:56:06.475 INFO:tasks.workunit.client.1.smithi047.stdout:7/459: rename d0/d7/c38 to d0/d7/da/d2e/c9e 0 2024-09-13T22:56:06.481 INFO:tasks.workunit.client.1.smithi047.stdout:2/531: mkdir d1/de/db4 0 2024-09-13T22:56:06.481 INFO:tasks.workunit.client.1.smithi047.stdout:8/445: write d8/d64/f47 [1042905,21547] 0 2024-09-13T22:56:06.484 INFO:tasks.workunit.client.0.smithi002.stdout:7/264: mkdir d8/d9/d46 0 2024-09-13T22:56:06.488 INFO:tasks.workunit.client.0.smithi002.stdout:2/309: dwrite d1/d7/d8/f17 [0,4194304] 0 2024-09-13T22:56:06.490 INFO:tasks.workunit.client.1.smithi047.stdout:8/446: dwrite d8/d64/d4e/f92 [0,4194304] 0 2024-09-13T22:56:06.490 INFO:tasks.workunit.client.0.smithi002.stdout:2/310: write d1/d7/d8/f17 [4746071,45425] 0 2024-09-13T22:56:06.491 INFO:tasks.workunit.client.1.smithi047.stdout:3/451: creat d0/d3/d4/d16/d32/d42/d79/f93 x:0 0 0 2024-09-13T22:56:06.492 INFO:tasks.workunit.client.1.smithi047.stdout:3/452: dread - d0/d3/d4/d91/f8b zero size 2024-09-13T22:56:06.497 INFO:tasks.workunit.client.1.smithi047.stdout:0/446: dread d1/d5/d16/d47/f4d [0,4194304] 0 2024-09-13T22:56:06.498 INFO:tasks.workunit.client.1.smithi047.stdout:0/447: chown d1/d5/d16/d6a 36789 1 2024-09-13T22:56:06.501 INFO:tasks.workunit.client.1.smithi047.stdout:1/369: creat d0/d7/d14/d57/f6e x:0 0 0 2024-09-13T22:56:06.503 INFO:tasks.workunit.client.1.smithi047.stdout:7/460: unlink d0/d7/da/d4e/c61 0 2024-09-13T22:56:06.505 INFO:tasks.workunit.client.1.smithi047.stdout:6/470: rename d3/d11/d2b/f6c to d3/d11/d2b/d76/fa2 0 2024-09-13T22:56:06.506 INFO:tasks.workunit.client.1.smithi047.stdout:2/532: mknod d1/df/d1d/d20/d37/cb5 0 2024-09-13T22:56:06.507 INFO:tasks.workunit.client.1.smithi047.stdout:4/453: creat dc/de/d23/f99 x:0 0 0 2024-09-13T22:56:06.508 INFO:tasks.workunit.client.1.smithi047.stdout:4/454: write dc/de/d39/f84 [348891,32492] 0 2024-09-13T22:56:06.509 INFO:tasks.workunit.client.0.smithi002.stdout:0/320: creat d1/d2/d10/d31/d3c/f70 x:0 0 0 2024-09-13T22:56:06.509 INFO:tasks.workunit.client.0.smithi002.stdout:2/311: dread d1/f1f [4194304,4194304] 0 2024-09-13T22:56:06.511 INFO:tasks.workunit.client.0.smithi002.stdout:6/310: getdents d12/d17/d28 0 2024-09-13T22:56:06.513 INFO:tasks.workunit.client.1.smithi047.stdout:9/376: mkdir d1/dc/d18/d72 0 2024-09-13T22:56:06.514 INFO:tasks.workunit.client.1.smithi047.stdout:9/377: fdatasync d1/dc/d18/f33 0 2024-09-13T22:56:06.518 INFO:tasks.workunit.client.1.smithi047.stdout:0/448: rmdir d1/d5 39 2024-09-13T22:56:06.520 INFO:tasks.workunit.client.0.smithi002.stdout:8/295: unlink d3/l1e 0 2024-09-13T22:56:06.523 INFO:tasks.workunit.client.0.smithi002.stdout:3/372: creat d9/d7e/f88 x:0 0 0 2024-09-13T22:56:06.525 INFO:tasks.workunit.client.1.smithi047.stdout:7/461: fsync d0/d7/da/d4e/f66 0 2024-09-13T22:56:06.525 INFO:tasks.workunit.client.1.smithi047.stdout:5/368: write d19/f1d [2192841,90319] 0 2024-09-13T22:56:06.526 INFO:tasks.workunit.client.0.smithi002.stdout:1/361: getdents d1/d13/d1d 0 2024-09-13T22:56:06.528 INFO:tasks.workunit.client.1.smithi047.stdout:6/471: creat d3/d77/d93/fa3 x:0 0 0 2024-09-13T22:56:06.530 INFO:tasks.workunit.client.0.smithi002.stdout:0/321: mknod d1/d2/d10/c71 0 2024-09-13T22:56:06.530 INFO:tasks.workunit.client.0.smithi002.stdout:7/265: write d8/d10/f1e [4122419,51660] 0 2024-09-13T22:56:06.531 INFO:tasks.workunit.client.0.smithi002.stdout:7/266: chown d8/d10/d11/d13/d26 24578103 1 2024-09-13T22:56:06.531 INFO:tasks.workunit.client.1.smithi047.stdout:2/533: mkdir d1/df/d1d/d20/d37/d7b/db6 0 2024-09-13T22:56:06.532 INFO:tasks.workunit.client.0.smithi002.stdout:7/267: truncate d8/d9/f40 554389 0 2024-09-13T22:56:06.532 INFO:tasks.workunit.client.0.smithi002.stdout:2/312: symlink d1/d7/d35/d3e/l63 0 2024-09-13T22:56:06.533 INFO:tasks.workunit.client.1.smithi047.stdout:3/453: dwrite d0/d25/d34/f41 [0,4194304] 0 2024-09-13T22:56:06.534 INFO:tasks.workunit.client.1.smithi047.stdout:3/454: fsync d0/d25/d44/d43/f54 0 2024-09-13T22:56:06.534 INFO:tasks.workunit.client.1.smithi047.stdout:4/455: creat dc/de/d23/d40/f9a x:0 0 0 2024-09-13T22:56:06.536 INFO:tasks.workunit.client.0.smithi002.stdout:9/352: creat d8/f75 x:0 0 0 2024-09-13T22:56:06.539 INFO:tasks.workunit.client.0.smithi002.stdout:7/268: dwrite d8/d10/f2b [0,4194304] 0 2024-09-13T22:56:06.540 INFO:tasks.workunit.client.1.smithi047.stdout:3/455: dread d0/d25/d34/f4b [0,4194304] 0 2024-09-13T22:56:06.541 INFO:tasks.workunit.client.0.smithi002.stdout:6/311: unlink d12/d17/d34/d39/c5f 0 2024-09-13T22:56:06.542 INFO:tasks.workunit.client.0.smithi002.stdout:2/313: dwrite d1/d7/d8/f33 [0,4194304] 0 2024-09-13T22:56:06.543 INFO:tasks.workunit.client.1.smithi047.stdout:4/456: dwrite dc/de/d23/f55 [0,4194304] 0 2024-09-13T22:56:06.543 INFO:tasks.workunit.client.0.smithi002.stdout:7/269: truncate d8/d10/f23 1291404 0 2024-09-13T22:56:06.545 INFO:tasks.workunit.client.0.smithi002.stdout:6/312: read d12/d17/d28/d3e/f49 [13907,98002] 0 2024-09-13T22:56:06.545 INFO:tasks.workunit.client.1.smithi047.stdout:3/456: read d0/d25/d44/d43/d3a/f6d [3362486,75132] 0 2024-09-13T22:56:06.546 INFO:tasks.workunit.client.0.smithi002.stdout:2/314: stat d1/d32/d37/d3a/f4b 0 2024-09-13T22:56:06.547 INFO:tasks.workunit.client.0.smithi002.stdout:2/315: chown d1/d7/d8/f1b 1 1 2024-09-13T22:56:06.547 INFO:tasks.workunit.client.0.smithi002.stdout:8/296: creat d3/d27/f62 x:0 0 0 2024-09-13T22:56:06.551 INFO:tasks.workunit.client.0.smithi002.stdout:8/297: dread d3/dc/fd [0,4194304] 0 2024-09-13T22:56:06.552 INFO:tasks.workunit.client.0.smithi002.stdout:5/294: rename d1/d10/l1a to d1/d2a/d41/l6a 0 2024-09-13T22:56:06.554 INFO:tasks.workunit.client.1.smithi047.stdout:7/462: unlink d0/d19/f7f 0 2024-09-13T22:56:06.555 INFO:tasks.workunit.client.0.smithi002.stdout:5/295: write d1/d10/f3d [569970,37924] 0 2024-09-13T22:56:06.555 INFO:tasks.workunit.client.0.smithi002.stdout:2/316: dwrite d1/f5 [0,4194304] 0 2024-09-13T22:56:06.556 INFO:tasks.workunit.client.1.smithi047.stdout:5/369: creat d19/d23/d4c/f7c x:0 0 0 2024-09-13T22:56:06.556 INFO:tasks.workunit.client.1.smithi047.stdout:5/370: dread - d19/d25/f61 zero size 2024-09-13T22:56:06.559 INFO:tasks.workunit.client.0.smithi002.stdout:5/296: chown d1/f3a 7 1 2024-09-13T22:56:06.562 INFO:tasks.workunit.client.1.smithi047.stdout:5/371: dread d19/d25/d45/f4d [0,4194304] 0 2024-09-13T22:56:06.565 INFO:tasks.workunit.client.1.smithi047.stdout:5/372: read d19/d23/d4c/f52 [3781181,45633] 0 2024-09-13T22:56:06.566 INFO:tasks.workunit.client.1.smithi047.stdout:5/373: truncate d19/d34/d42/d5d/f6e 776743 0 2024-09-13T22:56:06.571 INFO:tasks.workunit.client.0.smithi002.stdout:9/353: dread - d8/d1e/f41 zero size 2024-09-13T22:56:06.576 INFO:tasks.workunit.client.1.smithi047.stdout:4/457: stat dc/de/f14 0 2024-09-13T22:56:06.578 INFO:tasks.workunit.client.0.smithi002.stdout:9/354: dwrite d8/d1e/f45 [4194304,4194304] 0 2024-09-13T22:56:06.579 INFO:tasks.workunit.client.1.smithi047.stdout:4/458: dread dc/de/f18 [4194304,4194304] 0 2024-09-13T22:56:06.583 INFO:tasks.workunit.client.0.smithi002.stdout:6/313: symlink d12/d17/d4e/l65 0 2024-09-13T22:56:06.584 INFO:tasks.workunit.client.0.smithi002.stdout:6/314: fsync d12/d17/d2a/f56 0 2024-09-13T22:56:06.584 INFO:tasks.workunit.client.0.smithi002.stdout:6/315: chown d12/f51 171 1 2024-09-13T22:56:06.585 INFO:tasks.workunit.client.1.smithi047.stdout:0/449: mknod d1/d5/d16/d23/d2d/c9f 0 2024-09-13T22:56:06.586 INFO:tasks.workunit.client.1.smithi047.stdout:3/457: dread d0/d3/d4/d16/f4e [0,4194304] 0 2024-09-13T22:56:06.587 INFO:tasks.workunit.client.1.smithi047.stdout:3/458: chown d0/d3/d4/d16/d2c/de/c38 56 1 2024-09-13T22:56:06.590 INFO:tasks.workunit.client.1.smithi047.stdout:9/378: truncate d1/dc/d18/f48 1221273 0 2024-09-13T22:56:06.591 INFO:tasks.workunit.client.0.smithi002.stdout:4/296: getdents d3/d14 0 2024-09-13T22:56:06.592 INFO:tasks.workunit.client.0.smithi002.stdout:4/297: chown d3/f23 443050019 1 2024-09-13T22:56:06.592 INFO:tasks.workunit.client.0.smithi002.stdout:3/373: mkdir d9/df/d60/d89 0 2024-09-13T22:56:06.593 INFO:tasks.workunit.client.0.smithi002.stdout:4/298: dread - d3/f3d zero size 2024-09-13T22:56:06.596 INFO:tasks.workunit.client.0.smithi002.stdout:7/270: dwrite f7 [0,4194304] 0 2024-09-13T22:56:06.596 INFO:tasks.workunit.client.0.smithi002.stdout:0/322: getdents d1/d2/d6c 0 2024-09-13T22:56:06.596 INFO:tasks.workunit.client.0.smithi002.stdout:7/271: write d8/d9/f19 [3849880,70209] 0 2024-09-13T22:56:06.597 INFO:tasks.workunit.client.0.smithi002.stdout:0/323: fdatasync d1/d2/fd 0 2024-09-13T22:56:06.597 INFO:tasks.workunit.client.0.smithi002.stdout:5/297: fsync d1/d2a/d41/f5d 0 2024-09-13T22:56:06.598 INFO:tasks.workunit.client.0.smithi002.stdout:5/298: chown d1/f18 6917925 1 2024-09-13T22:56:06.601 INFO:tasks.workunit.client.0.smithi002.stdout:9/355: creat d8/d10/d42/f76 x:0 0 0 2024-09-13T22:56:06.603 INFO:tasks.workunit.client.0.smithi002.stdout:9/356: dread d8/d10/f3c [0,4194304] 0 2024-09-13T22:56:06.603 INFO:tasks.workunit.client.0.smithi002.stdout:6/316: creat d12/d17/d28/f66 x:0 0 0 2024-09-13T22:56:06.604 INFO:tasks.workunit.client.0.smithi002.stdout:9/357: chown d8/d1e/f27 5 1 2024-09-13T22:56:06.605 INFO:tasks.workunit.client.0.smithi002.stdout:9/358: chown d8/d1e/f36 4228567 1 2024-09-13T22:56:06.606 INFO:tasks.workunit.client.0.smithi002.stdout:8/298: fdatasync d3/d21/f49 0 2024-09-13T22:56:06.608 INFO:tasks.workunit.client.0.smithi002.stdout:4/299: mknod d3/d14/d25/c56 0 2024-09-13T22:56:06.664 INFO:tasks.workunit.client.1.smithi047.stdout:1/370: getdents d0/d7/d14/d28/d36 0 2024-09-13T22:56:06.664 INFO:tasks.workunit.client.1.smithi047.stdout:3/459: chown d0/d3/d4/d91/c74 0 1 2024-09-13T22:56:06.665 INFO:tasks.workunit.client.0.smithi002.stdout:1/362: link d1/d1c/f65 d1/d13/d30/d31/f74 0 2024-09-13T22:56:06.666 INFO:tasks.workunit.client.1.smithi047.stdout:1/371: write d0/d7/f12 [4783475,103951] 0 2024-09-13T22:56:06.671 INFO:tasks.workunit.client.1.smithi047.stdout:9/379: unlink d1/dc/d14/dd/d54/d4e/d51/l71 0 2024-09-13T22:56:06.673 INFO:tasks.workunit.client.1.smithi047.stdout:7/463: symlink d0/d7/da/d1e/d93/l9f 0 2024-09-13T22:56:06.673 INFO:tasks.workunit.client.1.smithi047.stdout:7/464: chown d0/d7/da/d4e/f70 30817947 1 2024-09-13T22:56:06.675 INFO:tasks.workunit.client.0.smithi002.stdout:2/317: link d1/d32/d37/f45 d1/d7/d35/d3e/d59/f64 0 2024-09-13T22:56:06.683 INFO:tasks.workunit.client.1.smithi047.stdout:0/450: dwrite d1/d5/d16/d23/f42 [0,4194304] 0 2024-09-13T22:56:06.683 INFO:tasks.workunit.client.0.smithi002.stdout:5/299: mkdir d1/d2a/d6b 0 2024-09-13T22:56:06.685 INFO:tasks.workunit.client.1.smithi047.stdout:0/451: read d1/d5/d11/f35 [1473835,69442] 0 2024-09-13T22:56:06.686 INFO:tasks.workunit.client.1.smithi047.stdout:0/452: fsync d1/d5/f24 0 2024-09-13T22:56:06.689 INFO:tasks.workunit.client.1.smithi047.stdout:4/459: mkdir dc/de/d17/d25/d9b 0 2024-09-13T22:56:06.693 INFO:tasks.workunit.client.1.smithi047.stdout:5/374: truncate d19/d25/d45/f60 1172127 0 2024-09-13T22:56:06.698 INFO:tasks.workunit.client.1.smithi047.stdout:1/372: rename d0/d7/l21 to d0/d7/d14/l6f 0 2024-09-13T22:56:06.699 INFO:tasks.workunit.client.1.smithi047.stdout:1/373: write d0/d7/d10/f49 [829295,29703] 0 2024-09-13T22:56:06.700 INFO:tasks.workunit.client.1.smithi047.stdout:7/465: fsync d0/d7/f3d 0 2024-09-13T22:56:06.704 INFO:tasks.workunit.client.1.smithi047.stdout:6/472: link d3/d11/d2b/d4c/d30/f47 d3/d77/d93/fa4 0 2024-09-13T22:56:06.714 INFO:tasks.workunit.client.1.smithi047.stdout:0/453: mknod d1/d5/d16/d6a/d92/ca0 0 2024-09-13T22:56:06.715 INFO:tasks.workunit.client.1.smithi047.stdout:0/454: readlink d1/d5/d11/d2f/l6f 0 2024-09-13T22:56:06.715 INFO:tasks.workunit.client.0.smithi002.stdout:8/299: symlink d3/d27/l63 0 2024-09-13T22:56:06.716 INFO:tasks.workunit.client.1.smithi047.stdout:0/455: write d1/d7/fe [3501733,74268] 0 2024-09-13T22:56:06.716 INFO:tasks.workunit.client.0.smithi002.stdout:7/272: mknod d8/d10/d39/c47 0 2024-09-13T22:56:06.716 INFO:tasks.workunit.client.0.smithi002.stdout:5/300: rename d1/d57/l5c to d1/d2a/d5a/l6c 0 2024-09-13T22:56:06.716 INFO:tasks.workunit.client.0.smithi002.stdout:4/300: write d3/d40/f4e [874475,82319] 0 2024-09-13T22:56:06.717 INFO:tasks.workunit.client.1.smithi047.stdout:4/460: symlink dc/d29/l9c 0 2024-09-13T22:56:06.718 INFO:tasks.workunit.client.0.smithi002.stdout:8/300: dread d3/dc/f26 [0,4194304] 0 2024-09-13T22:56:06.718 INFO:tasks.workunit.client.0.smithi002.stdout:4/301: truncate d3/d14/d25/f4f 951706 0 2024-09-13T22:56:06.719 INFO:tasks.workunit.client.1.smithi047.stdout:4/461: chown dc/c8a 1 1 2024-09-13T22:56:06.719 INFO:tasks.workunit.client.0.smithi002.stdout:8/301: chown d3/dc/d18/f23 160 1 2024-09-13T22:56:06.724 INFO:tasks.workunit.client.1.smithi047.stdout:9/380: truncate d1/d2d/f31 149069 0 2024-09-13T22:56:06.725 INFO:tasks.workunit.client.1.smithi047.stdout:1/374: mkdir d0/d7/d14/d28/d36/d70 0 2024-09-13T22:56:06.728 INFO:tasks.workunit.client.1.smithi047.stdout:7/466: write d0/d57/f98 [4264834,64313] 0 2024-09-13T22:56:06.730 INFO:tasks.workunit.client.0.smithi002.stdout:3/374: getdents d9/d15/d36/d4e 0 2024-09-13T22:56:06.730 INFO:tasks.workunit.client.1.smithi047.stdout:6/473: chown d3/d11/c3e 6 1 2024-09-13T22:56:06.731 INFO:tasks.workunit.client.1.smithi047.stdout:6/474: chown d3/d2c/d55/c58 85948121 1 2024-09-13T22:56:06.732 INFO:tasks.workunit.client.1.smithi047.stdout:6/475: dread - d3/d11/fa1 zero size 2024-09-13T22:56:06.733 INFO:tasks.workunit.client.1.smithi047.stdout:6/476: write d3/d77/d93/f9a [71472,121175] 0 2024-09-13T22:56:06.736 INFO:tasks.workunit.client.1.smithi047.stdout:0/456: creat d1/d5/d16/d23/d77/fa1 x:0 0 0 2024-09-13T22:56:06.737 INFO:tasks.workunit.client.1.smithi047.stdout:4/462: mknod dc/de/d17/d25/d4a/c9d 0 2024-09-13T22:56:06.739 INFO:tasks.workunit.client.0.smithi002.stdout:4/302: creat d3/d14/d29/d2a/d30/f57 x:0 0 0 2024-09-13T22:56:06.741 INFO:tasks.workunit.client.0.smithi002.stdout:6/317: mkdir d12/d17/d28/d67 0 2024-09-13T22:56:06.743 INFO:tasks.workunit.client.1.smithi047.stdout:3/460: link d0/d3/d4/d16/d2c/de/f8c d0/d3/d4/d16/f94 0 2024-09-13T22:56:06.744 INFO:tasks.workunit.client.1.smithi047.stdout:0/457: dwrite d1/d7/f18 [0,4194304] 0 2024-09-13T22:56:06.745 INFO:tasks.workunit.client.1.smithi047.stdout:9/381: symlink d1/d2d/l73 0 2024-09-13T22:56:06.747 INFO:tasks.workunit.client.0.smithi002.stdout:8/302: rename d3/d21/f49 to d3/dc/d16/d60/f64 0 2024-09-13T22:56:06.748 INFO:tasks.workunit.client.1.smithi047.stdout:1/375: mkdir d0/d7/d14/d71 0 2024-09-13T22:56:06.751 INFO:tasks.workunit.client.0.smithi002.stdout:3/375: symlink d9/d15/d36/l8a 0 2024-09-13T22:56:06.752 INFO:tasks.workunit.client.0.smithi002.stdout:3/376: chown d9/d15/d36/d4e 185 1 2024-09-13T22:56:06.753 INFO:tasks.workunit.client.0.smithi002.stdout:3/377: chown d9/d15/d26/d44/f75 3 1 2024-09-13T22:56:06.754 INFO:tasks.workunit.client.1.smithi047.stdout:7/467: creat d0/d7/da/d2e/fa0 x:0 0 0 2024-09-13T22:56:06.755 INFO:tasks.workunit.client.0.smithi002.stdout:0/324: link d1/d2/d10/d31/d32/c4d d1/d2/c72 0 2024-09-13T22:56:06.755 INFO:tasks.workunit.client.0.smithi002.stdout:4/303: dread d3/d14/d29/d2a/f44 [0,4194304] 0 2024-09-13T22:56:06.756 INFO:tasks.workunit.client.1.smithi047.stdout:6/477: readlink d3/d11/l43 0 2024-09-13T22:56:06.760 INFO:tasks.workunit.client.0.smithi002.stdout:5/301: truncate d1/f3a 141865 0 2024-09-13T22:56:06.761 INFO:tasks.workunit.client.1.smithi047.stdout:5/375: link d19/l27 d19/d34/d42/d5d/l7d 0 2024-09-13T22:56:06.764 INFO:tasks.workunit.client.1.smithi047.stdout:6/478: dwrite d3/d11/d2b/d4c/d30/d48/f7d [0,4194304] 0 2024-09-13T22:56:06.766 INFO:tasks.workunit.client.1.smithi047.stdout:0/458: rmdir d1/d5/d11 39 2024-09-13T22:56:06.771 INFO:tasks.workunit.client.0.smithi002.stdout:6/318: creat d12/d17/d34/d4b/f68 x:0 0 0 2024-09-13T22:56:06.772 INFO:tasks.workunit.client.0.smithi002.stdout:9/359: getdents d8/d10 0 2024-09-13T22:56:06.775 INFO:tasks.workunit.client.1.smithi047.stdout:7/468: creat d0/d7/da/d47/fa1 x:0 0 0 2024-09-13T22:56:06.776 INFO:tasks.workunit.client.0.smithi002.stdout:7/273: truncate d8/f12 2118483 0 2024-09-13T22:56:06.777 INFO:tasks.workunit.client.0.smithi002.stdout:8/303: readlink d3/d21/d57/l4e 0 2024-09-13T22:56:06.778 INFO:tasks.workunit.client.0.smithi002.stdout:2/318: getdents d1/d7/d8/d4f 0 2024-09-13T22:56:06.781 INFO:tasks.workunit.client.1.smithi047.stdout:3/461: mkdir d0/d25/d95 0 2024-09-13T22:56:06.782 INFO:tasks.workunit.client.0.smithi002.stdout:4/304: creat d3/d14/d29/d2a/d30/f58 x:0 0 0 2024-09-13T22:56:06.784 INFO:tasks.workunit.client.0.smithi002.stdout:4/305: fdatasync d3/f3a 0 2024-09-13T22:56:06.784 INFO:tasks.workunit.client.0.smithi002.stdout:5/302: creat d1/d2a/d5a/f6d x:0 0 0 2024-09-13T22:56:06.785 INFO:tasks.workunit.client.1.smithi047.stdout:9/382: truncate d1/f44 820924 0 2024-09-13T22:56:06.786 INFO:tasks.workunit.client.0.smithi002.stdout:2/319: dwrite d1/d7/d8/d2c/f44 [0,4194304] 0 2024-09-13T22:56:06.789 INFO:tasks.workunit.client.0.smithi002.stdout:6/319: fdatasync d12/f22 0 2024-09-13T22:56:06.794 INFO:tasks.workunit.client.0.smithi002.stdout:0/325: write d1/d2/d10/d31/f41 [1114074,81774] 0 2024-09-13T22:56:06.795 INFO:tasks.workunit.client.1.smithi047.stdout:7/469: fsync d0/d7/f14 0 2024-09-13T22:56:06.798 INFO:tasks.workunit.client.1.smithi047.stdout:4/463: creat dc/f9e x:0 0 0 2024-09-13T22:56:06.800 INFO:tasks.workunit.client.0.smithi002.stdout:3/378: dwrite d9/d15/d35/f52 [0,4194304] 0 2024-09-13T22:56:06.800 INFO:tasks.workunit.client.1.smithi047.stdout:5/376: mknod d19/d23/c7e 0 2024-09-13T22:56:06.801 INFO:tasks.workunit.client.1.smithi047.stdout:5/377: readlink lb 0 2024-09-13T22:56:06.803 INFO:tasks.workunit.client.1.smithi047.stdout:1/376: truncate d0/d7/db/f3a 3220027 0 2024-09-13T22:56:06.806 INFO:tasks.workunit.client.0.smithi002.stdout:1/363: sync 2024-09-13T22:56:06.806 INFO:tasks.workunit.client.0.smithi002.stdout:4/306: rmdir d3/d14 39 2024-09-13T22:56:06.806 INFO:tasks.workunit.client.0.smithi002.stdout:0/326: dwrite d1/d4/f3e [0,4194304] 0 2024-09-13T22:56:06.808 INFO:tasks.workunit.client.1.smithi047.stdout:0/459: truncate d1/f4 3491405 0 2024-09-13T22:56:06.809 INFO:tasks.workunit.client.0.smithi002.stdout:0/327: write d1/d4/f35 [648338,100845] 0 2024-09-13T22:56:06.810 INFO:tasks.workunit.client.1.smithi047.stdout:9/383: unlink d1/d5f/f64 0 2024-09-13T22:56:06.813 INFO:tasks.workunit.client.0.smithi002.stdout:3/379: dwrite d9/d7e/f88 [0,4194304] 0 2024-09-13T22:56:06.813 INFO:tasks.workunit.client.0.smithi002.stdout:2/320: dread d1/f18 [0,4194304] 0 2024-09-13T22:56:06.815 INFO:tasks.workunit.client.0.smithi002.stdout:3/380: truncate d9/f68 476288 0 2024-09-13T22:56:06.816 INFO:tasks.workunit.client.0.smithi002.stdout:2/321: fsync d1/d7/d8/d2c/f4e 0 2024-09-13T22:56:06.821 INFO:tasks.workunit.client.0.smithi002.stdout:9/360: mknod d8/d1e/c77 0 2024-09-13T22:56:06.821 INFO:tasks.workunit.client.0.smithi002.stdout:0/328: dwrite d1/fa [0,4194304] 0 2024-09-13T22:56:06.822 INFO:tasks.workunit.client.0.smithi002.stdout:9/361: dread - d8/d10/f59 zero size 2024-09-13T22:56:06.823 INFO:tasks.workunit.client.1.smithi047.stdout:3/462: dwrite d0/d25/d44/f49 [0,4194304] 0 2024-09-13T22:56:06.826 INFO:tasks.workunit.client.1.smithi047.stdout:6/479: creat d3/fa5 x:0 0 0 2024-09-13T22:56:06.829 INFO:tasks.workunit.client.1.smithi047.stdout:1/377: mkdir d0/d7/d14/d57/d72 0 2024-09-13T22:56:06.830 INFO:tasks.workunit.client.1.smithi047.stdout:1/378: write d0/d7/d13/f56 [856651,957] 0 2024-09-13T22:56:06.834 INFO:tasks.workunit.client.0.smithi002.stdout:8/304: symlink d3/dc/d16/l65 0 2024-09-13T22:56:06.835 INFO:tasks.workunit.client.0.smithi002.stdout:8/305: readlink d3/d27/l63 0 2024-09-13T22:56:06.835 INFO:tasks.workunit.client.0.smithi002.stdout:8/306: dread - d3/f38 zero size 2024-09-13T22:56:06.836 INFO:tasks.workunit.client.0.smithi002.stdout:8/307: dread d3/dc/fd [0,4194304] 0 2024-09-13T22:56:06.839 INFO:tasks.workunit.client.0.smithi002.stdout:5/303: symlink d1/d2a/d69/l6e 0 2024-09-13T22:56:06.840 INFO:tasks.workunit.client.0.smithi002.stdout:5/304: stat d1/d2a/d41/d45/l47 0 2024-09-13T22:56:06.840 INFO:tasks.workunit.client.1.smithi047.stdout:7/470: mkdir d0/da2 0 2024-09-13T22:56:06.843 INFO:tasks.workunit.client.1.smithi047.stdout:4/464: truncate dc/d29/f38 97620 0 2024-09-13T22:56:06.846 INFO:tasks.workunit.client.1.smithi047.stdout:3/463: creat d0/d3/f96 x:0 0 0 2024-09-13T22:56:06.847 INFO:tasks.workunit.client.0.smithi002.stdout:2/322: symlink d1/d32/l65 0 2024-09-13T22:56:06.849 INFO:tasks.workunit.client.0.smithi002.stdout:2/323: dread d1/f14 [4194304,4194304] 0 2024-09-13T22:56:06.850 INFO:tasks.workunit.client.0.smithi002.stdout:3/381: rename d9/f5a to d9/d15/d36/d4e/f8b 0 2024-09-13T22:56:06.855 INFO:tasks.workunit.client.0.smithi002.stdout:7/274: fdatasync d8/f12 0 2024-09-13T22:56:06.856 INFO:tasks.workunit.client.0.smithi002.stdout:2/324: dwrite d1/d7/d8/f27 [0,4194304] 0 2024-09-13T22:56:06.856 INFO:tasks.workunit.client.0.smithi002.stdout:4/307: symlink d3/l59 0 2024-09-13T22:56:06.862 INFO:tasks.workunit.client.1.smithi047.stdout:4/465: creat dc/de/d17/d25/d4a/f9f x:0 0 0 2024-09-13T22:56:06.862 INFO:tasks.workunit.client.0.smithi002.stdout:6/320: dwrite f1 [0,4194304] 0 2024-09-13T22:56:06.863 INFO:tasks.workunit.client.0.smithi002.stdout:6/321: chown d12/d17/d4e 3 1 2024-09-13T22:56:06.864 INFO:tasks.workunit.client.0.smithi002.stdout:2/325: dread d1/d7/d35/d3e/d59/f5b [0,4194304] 0 2024-09-13T22:56:06.865 INFO:tasks.workunit.client.0.smithi002.stdout:2/326: fsync d1/f29 0 2024-09-13T22:56:06.867 INFO:tasks.workunit.client.1.smithi047.stdout:3/464: unlink d0/d3/d65/f71 0 2024-09-13T22:56:06.867 INFO:tasks.workunit.client.0.smithi002.stdout:2/327: write d1/d7/d8/f17 [904150,64928] 0 2024-09-13T22:56:06.868 INFO:tasks.workunit.client.0.smithi002.stdout:1/364: link d1/d13/d52/f6d d1/d13/d1d/f75 0 2024-09-13T22:56:06.870 INFO:tasks.workunit.client.1.smithi047.stdout:7/471: dread d0/d7/da/d4e/f66 [0,4194304] 0 2024-09-13T22:56:06.870 INFO:tasks.workunit.client.1.smithi047.stdout:1/379: mknod d0/d1d/c73 0 2024-09-13T22:56:06.871 INFO:tasks.workunit.client.1.smithi047.stdout:9/384: dwrite d1/d2d/f31 [0,4194304] 0 2024-09-13T22:56:06.873 INFO:tasks.workunit.client.0.smithi002.stdout:8/308: write d3/f36 [4914220,66518] 0 2024-09-13T22:56:06.873 INFO:tasks.workunit.client.1.smithi047.stdout:1/380: dread - d0/d7/d14/d28/d36/f4c zero size 2024-09-13T22:56:06.873 INFO:tasks.workunit.client.1.smithi047.stdout:7/472: fsync d0/d7/da/f74 0 2024-09-13T22:56:06.874 INFO:tasks.workunit.client.0.smithi002.stdout:8/309: read - d3/d27/f59 zero size 2024-09-13T22:56:06.875 INFO:tasks.workunit.client.0.smithi002.stdout:8/310: write d3/d27/d39/f5c [108164,21767] 0 2024-09-13T22:56:06.876 INFO:tasks.workunit.client.1.smithi047.stdout:1/381: chown d0/d7/db/f38 0 1 2024-09-13T22:56:06.878 INFO:tasks.workunit.client.1.smithi047.stdout:1/382: truncate d0/d7/f4e 154544 0 2024-09-13T22:56:06.880 INFO:tasks.workunit.client.1.smithi047.stdout:9/385: dread d1/dc/d14/f4a [4194304,4194304] 0 2024-09-13T22:56:06.881 INFO:tasks.workunit.client.0.smithi002.stdout:9/362: rename d8/d10/d61/f66 to d8/d2c/f78 0 2024-09-13T22:56:06.890 INFO:tasks.workunit.client.0.smithi002.stdout:4/308: dread d3/d14/d29/d2a/f2d [0,4194304] 0 2024-09-13T22:56:06.893 INFO:tasks.workunit.client.0.smithi002.stdout:5/305: mknod d1/c6f 0 2024-09-13T22:56:06.894 INFO:tasks.workunit.client.1.smithi047.stdout:1/383: readlink d0/d7/d14/l52 0 2024-09-13T22:56:06.895 INFO:tasks.workunit.client.0.smithi002.stdout:5/306: chown d1/d2a/d5a/f62 7 1 2024-09-13T22:56:06.896 INFO:tasks.workunit.client.0.smithi002.stdout:4/309: dwrite d3/f23 [4194304,4194304] 0 2024-09-13T22:56:06.897 INFO:tasks.workunit.client.1.smithi047.stdout:3/465: dread d0/d3/d4/f3e [0,4194304] 0 2024-09-13T22:56:06.898 INFO:tasks.workunit.client.0.smithi002.stdout:0/329: truncate d1/d2/d10/d31/f46 288385 0 2024-09-13T22:56:06.899 INFO:tasks.workunit.client.1.smithi047.stdout:3/466: write d0/d3/f96 [283344,42466] 0 2024-09-13T22:56:06.901 INFO:tasks.workunit.client.1.smithi047.stdout:9/386: symlink d1/dc/d14/dd/d54/d4e/l74 0 2024-09-13T22:56:06.902 INFO:tasks.workunit.client.1.smithi047.stdout:3/467: chown d0/d3/d4/d16/f4e 9 1 2024-09-13T22:56:06.902 INFO:tasks.workunit.client.1.smithi047.stdout:1/384: dwrite d0/d7/f64 [0,4194304] 0 2024-09-13T22:56:06.903 INFO:tasks.workunit.client.1.smithi047.stdout:0/460: getdents d1/d5/d11/d52 0 2024-09-13T22:56:06.903 INFO:tasks.workunit.client.0.smithi002.stdout:2/328: symlink d1/d7/d35/l66 0 2024-09-13T22:56:06.912 INFO:tasks.workunit.client.1.smithi047.stdout:7/473: rmdir d0/d7/da/d1e 39 2024-09-13T22:56:06.915 INFO:tasks.workunit.client.1.smithi047.stdout:9/387: dread d1/dc/d14/dd/d54/d4e/d51/f5d [0,4194304] 0 2024-09-13T22:56:06.918 INFO:tasks.workunit.client.1.smithi047.stdout:0/461: creat d1/d5/d16/d6a/d92/fa2 x:0 0 0 2024-09-13T22:56:06.919 INFO:tasks.workunit.client.0.smithi002.stdout:9/363: write d8/d1e/f41 [551964,45795] 0 2024-09-13T22:56:06.919 INFO:tasks.workunit.client.0.smithi002.stdout:9/364: chown c3 2100 1 2024-09-13T22:56:06.919 INFO:tasks.workunit.client.0.smithi002.stdout:9/365: truncate d8/f75 13359 0 2024-09-13T22:56:06.920 INFO:tasks.workunit.client.1.smithi047.stdout:1/385: fsync d0/d7/f44 0 2024-09-13T22:56:06.920 INFO:tasks.workunit.client.0.smithi002.stdout:9/366: chown d8/d10/d1c/d3d 11 1 2024-09-13T22:56:06.924 INFO:tasks.workunit.client.1.smithi047.stdout:3/468: rename d0/f84 to d0/d3/d4/d16/d2c/de/f97 0 2024-09-13T22:56:06.929 INFO:tasks.workunit.client.1.smithi047.stdout:4/466: getdents dc/de/d39 0 2024-09-13T22:56:06.931 INFO:tasks.workunit.client.1.smithi047.stdout:0/462: dread d1/d5/d16/d23/d45/f99 [0,4194304] 0 2024-09-13T22:56:06.933 INFO:tasks.workunit.client.1.smithi047.stdout:1/386: creat d0/d7/f74 x:0 0 0 2024-09-13T22:56:06.937 INFO:tasks.workunit.client.1.smithi047.stdout:9/388: rename d1/dc/d14/dd/l3a to d1/l75 0 2024-09-13T22:56:06.939 INFO:tasks.workunit.client.0.smithi002.stdout:7/275: truncate d8/fb 3660328 0 2024-09-13T22:56:06.939 INFO:tasks.workunit.client.0.smithi002.stdout:7/276: stat d8/f27 0 2024-09-13T22:56:06.940 INFO:tasks.workunit.client.1.smithi047.stdout:3/469: creat d0/f98 x:0 0 0 2024-09-13T22:56:06.942 INFO:tasks.workunit.client.0.smithi002.stdout:6/322: creat d12/d17/d28/d3e/f69 x:0 0 0 2024-09-13T22:56:06.943 INFO:tasks.workunit.client.1.smithi047.stdout:7/474: truncate d0/d7/da/d1e/d51/f99 17676 0 2024-09-13T22:56:06.944 INFO:tasks.workunit.client.1.smithi047.stdout:7/475: chown d0/d57/d5b/d8b 52677 1 2024-09-13T22:56:06.944 INFO:tasks.workunit.client.0.smithi002.stdout:0/330: symlink d1/d2/d10/d31/d32/l73 0 2024-09-13T22:56:06.945 INFO:tasks.workunit.client.1.smithi047.stdout:7/476: dread - d0/d7/da/d47/fa1 zero size 2024-09-13T22:56:06.946 INFO:tasks.workunit.client.0.smithi002.stdout:2/329: symlink d1/d32/d37/d3a/l67 0 2024-09-13T22:56:06.947 INFO:tasks.workunit.client.1.smithi047.stdout:0/463: symlink d1/d5/d16/d23/la3 0 2024-09-13T22:56:06.951 INFO:tasks.workunit.client.0.smithi002.stdout:9/367: creat d8/d2c/f79 x:0 0 0 2024-09-13T22:56:06.952 INFO:tasks.workunit.client.0.smithi002.stdout:2/330: dread d1/d7/f26 [0,4194304] 0 2024-09-13T22:56:06.952 INFO:tasks.workunit.client.0.smithi002.stdout:3/382: rmdir d9/d15/d6c 0 2024-09-13T22:56:06.953 INFO:tasks.workunit.client.1.smithi047.stdout:7/477: creat d0/d7/da/d1e/d51/fa3 x:0 0 0 2024-09-13T22:56:06.953 INFO:tasks.workunit.client.1.smithi047.stdout:7/478: write d0/db/f4c [2648697,118658] 0 2024-09-13T22:56:06.954 INFO:tasks.workunit.client.1.smithi047.stdout:7/479: chown d0/d19 15817003 1 2024-09-13T22:56:06.957 INFO:tasks.workunit.client.0.smithi002.stdout:3/383: dwrite d9/d15/d35/f52 [0,4194304] 0 2024-09-13T22:56:06.958 INFO:tasks.workunit.client.1.smithi047.stdout:1/387: rename d0/d1d/d5b to d0/d7/d75 0 2024-09-13T22:56:06.959 INFO:tasks.workunit.client.1.smithi047.stdout:1/388: readlink d0/d7/d10/l47 0 2024-09-13T22:56:06.965 INFO:tasks.workunit.client.1.smithi047.stdout:1/389: dread d0/d7/db/f58 [0,4194304] 0 2024-09-13T22:56:06.969 INFO:tasks.workunit.client.0.smithi002.stdout:7/277: rename d8/f12 to d8/d10/d11/d13/d2e/d3c/f48 0 2024-09-13T22:56:06.970 INFO:tasks.workunit.client.1.smithi047.stdout:0/464: symlink d1/la4 0 2024-09-13T22:56:06.972 INFO:tasks.workunit.client.1.smithi047.stdout:3/470: write d0/d25/d44/d43/f30 [4642394,90376] 0 2024-09-13T22:56:06.974 INFO:tasks.workunit.client.0.smithi002.stdout:0/331: rmdir d1/d4 39 2024-09-13T22:56:07.011 INFO:tasks.workunit.client.1.smithi047.stdout:0/465: dwrite d1/d7/ff [0,4194304] 0 2024-09-13T22:56:07.011 INFO:tasks.workunit.client.1.smithi047.stdout:4/467: link dc/d29/d4d/c71 dc/de/d17/d25/ca0 0 2024-09-13T22:56:07.011 INFO:tasks.workunit.client.1.smithi047.stdout:3/471: unlink d0/d3/d4/d16/d32/d42/f59 0 2024-09-13T22:56:07.011 INFO:tasks.workunit.client.1.smithi047.stdout:9/389: rename d1/dc/d14/c27 to d1/d2d/c76 0 2024-09-13T22:56:07.011 INFO:tasks.workunit.client.1.smithi047.stdout:3/472: dwrite d0/d25/d44/f27 [0,4194304] 0 2024-09-13T22:56:07.011 INFO:tasks.workunit.client.0.smithi002.stdout:7/278: dread d8/d10/f32 [0,4194304] 0 2024-09-13T22:56:07.012 INFO:tasks.workunit.client.0.smithi002.stdout:1/365: mkdir d1/d13/d1d/d76 0 2024-09-13T22:56:07.012 INFO:tasks.workunit.client.0.smithi002.stdout:7/279: dwrite f7 [4194304,4194304] 0 2024-09-13T22:56:07.012 INFO:tasks.workunit.client.0.smithi002.stdout:7/280: write d8/d10/d11/d13/f34 [3224285,59405] 0 2024-09-13T22:56:07.012 INFO:tasks.workunit.client.0.smithi002.stdout:9/368: unlink d8/d1e/l69 0 2024-09-13T22:56:07.012 INFO:tasks.workunit.client.0.smithi002.stdout:3/384: write d9/d15/f42 [793754,109] 0 2024-09-13T22:56:07.013 INFO:tasks.workunit.client.0.smithi002.stdout:5/307: creat d1/d2a/d41/f70 x:0 0 0 2024-09-13T22:56:07.013 INFO:tasks.workunit.client.0.smithi002.stdout:4/310: getdents d3/d14/d29/d2a 0 2024-09-13T22:56:07.013 INFO:tasks.workunit.client.0.smithi002.stdout:0/332: symlink d1/d2/d10/d31/d32/l74 0 2024-09-13T22:56:07.013 INFO:tasks.workunit.client.1.smithi047.stdout:4/468: dread dc/de/d17/f1b [0,4194304] 0 2024-09-13T22:56:07.014 INFO:tasks.workunit.client.1.smithi047.stdout:7/480: dwrite d0/d7/da/d1e/f86 [0,4194304] 0 2024-09-13T22:56:07.016 INFO:tasks.workunit.client.1.smithi047.stdout:1/390: rmdir d0/d7/d14/d28/d36/d70 0 2024-09-13T22:56:07.017 INFO:tasks.workunit.client.1.smithi047.stdout:1/391: fsync d0/d7/d13/d2d/f59 0 2024-09-13T22:56:07.018 INFO:tasks.workunit.client.1.smithi047.stdout:0/466: link d1/f17 d1/d5/d16/d23/d2d/fa5 0 2024-09-13T22:56:07.019 INFO:tasks.workunit.client.0.smithi002.stdout:8/311: getdents d3/dc/d16/d2f 0 2024-09-13T22:56:07.023 INFO:tasks.workunit.client.1.smithi047.stdout:4/469: fdatasync dc/f2f 0 2024-09-13T22:56:07.023 INFO:tasks.workunit.client.1.smithi047.stdout:3/473: dwrite d0/d25/d44/d43/d3a/f78 [0,4194304] 0 2024-09-13T22:56:07.025 INFO:tasks.workunit.client.1.smithi047.stdout:4/470: chown dc/d29/d4d/f48 0 1 2024-09-13T22:56:07.026 INFO:tasks.workunit.client.1.smithi047.stdout:7/481: rename d0/d7/da/d1e/d51/c84 to d0/d57/d5b/d5c/ca4 0 2024-09-13T22:56:07.029 INFO:tasks.workunit.client.1.smithi047.stdout:1/392: readlink d0/d7/d14/l6f 0 2024-09-13T22:56:07.030 INFO:tasks.workunit.client.1.smithi047.stdout:1/393: fdatasync d0/d7/d10/f43 0 2024-09-13T22:56:07.031 INFO:tasks.workunit.client.1.smithi047.stdout:1/394: fdatasync d0/f4f 0 2024-09-13T22:56:07.040 INFO:tasks.workunit.client.1.smithi047.stdout:0/467: dwrite d1/d5/d16/d23/f25 [0,4194304] 0 2024-09-13T22:56:07.041 INFO:tasks.workunit.client.0.smithi002.stdout:6/323: rename d12/f43 to d12/f6a 0 2024-09-13T22:56:07.042 INFO:tasks.workunit.client.0.smithi002.stdout:1/366: dwrite d1/d13/d30/d31/f74 [0,4194304] 0 2024-09-13T22:56:07.042 INFO:tasks.workunit.client.0.smithi002.stdout:1/367: readlink d1/d1c/l20 0 2024-09-13T22:56:07.043 INFO:tasks.workunit.client.0.smithi002.stdout:1/368: chown d1/d13/d30/d31/d3b 366846 1 2024-09-13T22:56:07.044 INFO:tasks.workunit.client.0.smithi002.stdout:1/369: chown d1/fb 2088 1 2024-09-13T22:56:07.046 INFO:tasks.workunit.client.0.smithi002.stdout:4/311: write d3/d14/f1d [1351755,64594] 0 2024-09-13T22:56:07.047 INFO:tasks.workunit.client.0.smithi002.stdout:4/312: write d3/d14/f2b [5007452,15957] 0 2024-09-13T22:56:07.048 INFO:tasks.workunit.client.0.smithi002.stdout:8/312: mknod d3/d21/d57/c66 0 2024-09-13T22:56:07.049 INFO:tasks.workunit.client.0.smithi002.stdout:8/313: chown d3/dc/c5d 419 1 2024-09-13T22:56:07.050 INFO:tasks.workunit.client.0.smithi002.stdout:8/314: dread - d3/dc/d16/f50 zero size 2024-09-13T22:56:07.050 INFO:tasks.workunit.client.1.smithi047.stdout:9/390: getdents d1/dc/d14/dd/d54/d50/d5b 0 2024-09-13T22:56:07.053 INFO:tasks.workunit.client.0.smithi002.stdout:9/369: mknod d8/c7a 0 2024-09-13T22:56:07.055 INFO:tasks.workunit.client.1.smithi047.stdout:1/395: unlink d0/d7/d10/d55/c66 0 2024-09-13T22:56:07.058 INFO:tasks.workunit.client.1.smithi047.stdout:0/468: dread d1/d5/d16/f63 [0,4194304] 0 2024-09-13T22:56:07.059 INFO:tasks.workunit.client.1.smithi047.stdout:3/474: creat d0/d3/d4/d16/d73/d86/f99 x:0 0 0 2024-09-13T22:56:07.061 INFO:tasks.workunit.client.0.smithi002.stdout:5/308: creat d1/d2a/d6b/f71 x:0 0 0 2024-09-13T22:56:07.062 INFO:tasks.workunit.client.0.smithi002.stdout:5/309: truncate d1/d10/f32 1669593 0 2024-09-13T22:56:07.064 INFO:tasks.workunit.client.0.smithi002.stdout:2/331: rename d1/d7/d8/f17 to d1/d7/f68 0 2024-09-13T22:56:07.064 INFO:tasks.workunit.client.0.smithi002.stdout:2/332: chown d1/c53 409896518 1 2024-09-13T22:56:07.065 INFO:tasks.workunit.client.0.smithi002.stdout:2/333: truncate d1/d32/d37/f45 1561938 0 2024-09-13T22:56:07.069 INFO:tasks.workunit.client.1.smithi047.stdout:1/396: unlink d0/d7/d14/f27 0 2024-09-13T22:56:07.070 INFO:tasks.workunit.client.0.smithi002.stdout:3/385: truncate d9/d15/f30 674082 0 2024-09-13T22:56:07.070 INFO:tasks.workunit.client.0.smithi002.stdout:3/386: stat d9/d15/d36/f7a 0 2024-09-13T22:56:07.072 INFO:tasks.workunit.client.1.smithi047.stdout:0/469: read d1/f36 [161818,44067] 0 2024-09-13T22:56:07.074 INFO:tasks.workunit.client.1.smithi047.stdout:0/470: chown d1/d5/d16/d23/d45/f4f 22 1 2024-09-13T22:56:07.074 INFO:tasks.workunit.client.0.smithi002.stdout:1/370: creat d1/d13/d21/d39/f77 x:0 0 0 2024-09-13T22:56:07.075 INFO:tasks.workunit.client.0.smithi002.stdout:1/371: readlink d1/d13/d30/d31/d3d/l66 0 2024-09-13T22:56:07.076 INFO:tasks.workunit.client.1.smithi047.stdout:0/471: chown d1/d5/d16/d47/l53 4454 1 2024-09-13T22:56:07.076 INFO:tasks.workunit.client.1.smithi047.stdout:3/475: fdatasync d0/d3/d4/d16/f4e 0 2024-09-13T22:56:07.077 INFO:tasks.workunit.client.0.smithi002.stdout:4/313: creat d3/d14/d25/f5a x:0 0 0 2024-09-13T22:56:07.078 INFO:tasks.workunit.client.1.smithi047.stdout:3/476: stat d0/d25/d44/d43/d85/c8a 0 2024-09-13T22:56:07.078 INFO:tasks.workunit.client.1.smithi047.stdout:4/471: link dc/de/d17/c32 dc/d29/d8e/ca1 0 2024-09-13T22:56:07.079 INFO:tasks.workunit.client.1.smithi047.stdout:0/472: truncate d1/d5/d16/d47/f4a 734783 0 2024-09-13T22:56:07.079 INFO:tasks.workunit.client.0.smithi002.stdout:4/314: dread d3/f23 [0,4194304] 0 2024-09-13T22:56:07.080 INFO:tasks.workunit.client.0.smithi002.stdout:7/281: creat d8/d10/f49 x:0 0 0 2024-09-13T22:56:07.082 INFO:tasks.workunit.client.1.smithi047.stdout:7/482: dwrite d0/d7/da/d1e/f22 [0,4194304] 0 2024-09-13T22:56:07.084 INFO:tasks.workunit.client.0.smithi002.stdout:8/315: creat d3/dc/d18/f67 x:0 0 0 2024-09-13T22:56:07.086 INFO:tasks.workunit.client.0.smithi002.stdout:8/316: write d3/dc/d18/f5a [1202796,30570] 0 2024-09-13T22:56:07.086 INFO:tasks.workunit.client.0.smithi002.stdout:8/317: fsync d3/d27/d39/f5c 0 2024-09-13T22:56:07.087 INFO:tasks.workunit.client.1.smithi047.stdout:9/391: mknod d1/dc/c77 0 2024-09-13T22:56:07.093 INFO:tasks.workunit.client.1.smithi047.stdout:9/392: dwrite d1/f25 [0,4194304] 0 2024-09-13T22:56:07.096 INFO:tasks.workunit.client.1.smithi047.stdout:9/393: dread d1/dc/d14/dd/d54/d4e/d51/f5d [0,4194304] 0 2024-09-13T22:56:07.097 INFO:tasks.workunit.client.0.smithi002.stdout:0/333: rename d1/d2/d10 to d1/d4/d75 0 2024-09-13T22:56:07.099 INFO:tasks.workunit.client.0.smithi002.stdout:2/334: mknod d1/d4d/c69 0 2024-09-13T22:56:07.102 INFO:tasks.workunit.client.0.smithi002.stdout:3/387: creat d9/d15/d26/f8c x:0 0 0 2024-09-13T22:56:07.103 INFO:tasks.workunit.client.1.smithi047.stdout:7/483: truncate d0/d7/f14 540078 0 2024-09-13T22:56:07.105 INFO:tasks.workunit.client.1.smithi047.stdout:3/477: rename d0/d25/d44/d43/d3a/f78 to d0/d25/d44/d43/f9a 0 2024-09-13T22:56:07.107 INFO:tasks.workunit.client.1.smithi047.stdout:1/397: dwrite d0/d7/d14/d28/d36/f32 [0,4194304] 0 2024-09-13T22:56:07.108 INFO:tasks.workunit.client.1.smithi047.stdout:1/398: write d0/d7/f64 [4091039,16796] 0 2024-09-13T22:56:07.109 INFO:tasks.workunit.client.1.smithi047.stdout:7/484: read d0/d7/f3c [1877710,114594] 0 2024-09-13T22:56:07.112 INFO:tasks.workunit.client.1.smithi047.stdout:1/399: fdatasync d0/d7/f12 0 2024-09-13T22:56:07.113 INFO:tasks.workunit.client.0.smithi002.stdout:4/315: creat d3/d14/f5b x:0 0 0 2024-09-13T22:56:07.113 INFO:tasks.workunit.client.1.smithi047.stdout:4/472: write dc/de/f14 [3958188,116002] 0 2024-09-13T22:56:07.117 INFO:tasks.workunit.client.1.smithi047.stdout:3/478: dwrite d0/d3/f96 [0,4194304] 0 2024-09-13T22:56:07.123 INFO:tasks.workunit.client.0.smithi002.stdout:9/370: link d8/d10/d1c/d3d/f44 d8/d10/d1c/d3d/f7b 0 2024-09-13T22:56:07.125 INFO:tasks.workunit.client.0.smithi002.stdout:9/371: fsync d8/d10/d1c/d3d/f6f 0 2024-09-13T22:56:07.127 INFO:tasks.workunit.client.1.smithi047.stdout:7/485: dread d0/d7/f4a [0,4194304] 0 2024-09-13T22:56:07.128 INFO:tasks.workunit.client.0.smithi002.stdout:5/310: rename d1/f49 to d1/d2a/d6b/f72 0 2024-09-13T22:56:07.129 INFO:tasks.workunit.client.0.smithi002.stdout:5/311: chown c0 1707177 1 2024-09-13T22:56:07.132 INFO:tasks.workunit.client.0.smithi002.stdout:0/334: mkdir d1/d4/d75/d76 0 2024-09-13T22:56:07.134 INFO:tasks.workunit.client.0.smithi002.stdout:8/318: dread d3/dc/d18/f2d [0,4194304] 0 2024-09-13T22:56:07.138 INFO:tasks.workunit.client.0.smithi002.stdout:3/388: symlink d9/d15/d36/d4e/d5e/l8d 0 2024-09-13T22:56:07.141 INFO:tasks.workunit.client.1.smithi047.stdout:9/394: symlink d1/d5f/d6a/l78 0 2024-09-13T22:56:07.142 INFO:tasks.workunit.client.0.smithi002.stdout:1/372: dread d1/d13/d1d/f29 [0,4194304] 0 2024-09-13T22:56:07.142 INFO:tasks.workunit.client.0.smithi002.stdout:1/373: chown d1/d1c/c5a 2 1 2024-09-13T22:56:07.143 INFO:tasks.workunit.client.1.smithi047.stdout:4/473: mknod dc/d29/d4d/ca2 0 2024-09-13T22:56:07.146 INFO:tasks.workunit.client.1.smithi047.stdout:7/486: rename d0/d19/f3f to d0/d7/da/d2e/d37/fa5 0 2024-09-13T22:56:07.149 INFO:tasks.workunit.client.1.smithi047.stdout:1/400: mkdir d0/d7/d14/d57/d62/d76 0 2024-09-13T22:56:07.150 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:06 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:07.151 INFO:tasks.workunit.client.0.smithi002.stdout:7/282: rename d8/d10/f49 to d8/d10/d39/f4a 0 2024-09-13T22:56:07.152 INFO:tasks.workunit.client.0.smithi002.stdout:7/283: chown d8/d10/d11/d13/d2e 6789542 1 2024-09-13T22:56:07.152 INFO:tasks.workunit.client.0.smithi002.stdout:7/284: chown d8/d10/l35 82369851 1 2024-09-13T22:56:07.152 INFO:tasks.workunit.client.1.smithi047.stdout:9/395: mkdir d1/dc/d14/dd/d54/d4e/d51/d79 0 2024-09-13T22:56:07.153 INFO:tasks.workunit.client.0.smithi002.stdout:7/285: readlink d8/d10/d11/d13/l18 0 2024-09-13T22:56:07.155 INFO:tasks.workunit.client.0.smithi002.stdout:0/335: rmdir d1/d4/d75 39 2024-09-13T22:56:07.156 INFO:tasks.workunit.client.0.smithi002.stdout:0/336: chown d1/d2/d6c 917119 1 2024-09-13T22:56:07.156 INFO:tasks.workunit.client.1.smithi047.stdout:3/479: symlink d0/d25/l9b 0 2024-09-13T22:56:07.159 INFO:tasks.workunit.client.1.smithi047.stdout:9/396: dwrite d1/dc/d14/f13 [0,4194304] 0 2024-09-13T22:56:07.160 INFO:tasks.workunit.client.0.smithi002.stdout:8/319: readlink d3/l12 0 2024-09-13T22:56:07.162 INFO:tasks.workunit.client.1.smithi047.stdout:1/401: truncate d0/d7/f44 864472 0 2024-09-13T22:56:07.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:06 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:07.164 INFO:tasks.workunit.client.0.smithi002.stdout:6/324: getdents d12/d17/d2a 0 2024-09-13T22:56:07.167 INFO:tasks.workunit.client.0.smithi002.stdout:8/320: dwrite d3/dc/f5f [0,4194304] 0 2024-09-13T22:56:07.167 INFO:tasks.workunit.client.1.smithi047.stdout:9/397: dwrite d1/dc/d14/f13 [0,4194304] 0 2024-09-13T22:56:07.169 INFO:tasks.workunit.client.1.smithi047.stdout:4/474: mkdir dc/da3 0 2024-09-13T22:56:07.172 INFO:tasks.workunit.client.0.smithi002.stdout:4/316: chown d3/d14/d25 19621049 1 2024-09-13T22:56:07.174 INFO:tasks.workunit.client.0.smithi002.stdout:5/312: dwrite d1/f2f [0,4194304] 0 2024-09-13T22:56:07.174 INFO:tasks.workunit.client.1.smithi047.stdout:4/475: creat dc/de/d17/d25/d4a/fa4 x:0 0 0 2024-09-13T22:56:07.175 INFO:tasks.workunit.client.1.smithi047.stdout:4/476: chown dc/de/f18 755905830 1 2024-09-13T22:56:07.176 INFO:tasks.workunit.client.1.smithi047.stdout:9/398: mknod d1/dc/d14/dd/d4c/d6b/c7a 0 2024-09-13T22:56:07.178 INFO:tasks.workunit.client.0.smithi002.stdout:2/335: creat d1/f6a x:0 0 0 2024-09-13T22:56:07.180 INFO:tasks.workunit.client.1.smithi047.stdout:9/399: read d1/f5 [3883202,82355] 0 2024-09-13T22:56:07.181 INFO:tasks.workunit.client.1.smithi047.stdout:4/477: mkdir dc/da5 0 2024-09-13T22:56:07.183 INFO:tasks.workunit.client.1.smithi047.stdout:4/478: fsync dc/de/d23/d40/d7b/f94 0 2024-09-13T22:56:07.184 INFO:tasks.workunit.client.1.smithi047.stdout:4/479: read dc/de/d17/f1b [839878,31382] 0 2024-09-13T22:56:07.185 INFO:tasks.workunit.client.1.smithi047.stdout:4/480: readlink dc/de/d17/l6e 0 2024-09-13T22:56:07.194 INFO:tasks.workunit.client.0.smithi002.stdout:1/374: dread d1/d13/d1d/f6c [0,4194304] 0 2024-09-13T22:56:07.194 INFO:tasks.workunit.client.1.smithi047.stdout:4/481: mkdir dc/de/d23/d40/d7b/d90/da6 0 2024-09-13T22:56:07.194 INFO:tasks.workunit.client.1.smithi047.stdout:7/487: write d0/db/fc [2813713,20681] 0 2024-09-13T22:56:07.196 INFO:tasks.workunit.client.1.smithi047.stdout:9/400: dread d1/dc/d18/f35 [0,4194304] 0 2024-09-13T22:56:07.198 INFO:tasks.workunit.client.0.smithi002.stdout:7/286: creat d8/d9/d46/f4b x:0 0 0 2024-09-13T22:56:07.199 INFO:tasks.workunit.client.1.smithi047.stdout:1/402: dread d0/d7/f44 [0,4194304] 0 2024-09-13T22:56:07.199 INFO:tasks.workunit.client.0.smithi002.stdout:7/287: chown d8/d10/d11/d13/d26 8252182 1 2024-09-13T22:56:07.200 INFO:tasks.workunit.client.1.smithi047.stdout:1/403: write d0/d7/db/f67 [704654,45379] 0 2024-09-13T22:56:07.200 INFO:tasks.workunit.client.0.smithi002.stdout:1/375: dwrite d1/d13/d30/f2d [0,4194304] 0 2024-09-13T22:56:07.201 INFO:tasks.workunit.client.0.smithi002.stdout:5/313: creat d1/d2a/d69/f73 x:0 0 0 2024-09-13T22:56:07.202 INFO:tasks.workunit.client.1.smithi047.stdout:7/488: truncate d0/db/f7e 1671201 0 2024-09-13T22:56:07.204 INFO:tasks.workunit.client.0.smithi002.stdout:0/337: rename d1/d2/lc to d1/d2/d49/l77 0 2024-09-13T22:56:07.205 INFO:tasks.workunit.client.1.smithi047.stdout:9/401: creat d1/dc/d14/dd/d54/d4e/f7b x:0 0 0 2024-09-13T22:56:07.210 INFO:tasks.workunit.client.0.smithi002.stdout:6/325: dwrite fa [0,4194304] 0 2024-09-13T22:56:07.212 INFO:tasks.workunit.client.1.smithi047.stdout:1/404: mknod d0/d7/c77 0 2024-09-13T22:56:07.212 INFO:tasks.workunit.client.0.smithi002.stdout:8/321: getdents d3/dc/d18/d56 0 2024-09-13T22:56:07.213 INFO:tasks.workunit.client.1.smithi047.stdout:1/405: write d0/f4f [829767,16555] 0 2024-09-13T22:56:07.214 INFO:tasks.workunit.client.1.smithi047.stdout:1/406: chown d0/l51 14437437 1 2024-09-13T22:56:07.214 INFO:tasks.workunit.client.1.smithi047.stdout:7/489: mkdir d0/d57/da6 0 2024-09-13T22:56:07.215 INFO:tasks.workunit.client.0.smithi002.stdout:3/389: dwrite d9/d15/d26/f32 [0,4194304] 0 2024-09-13T22:56:07.216 INFO:tasks.workunit.client.0.smithi002.stdout:9/372: link d8/lb d8/d1e/l7c 0 2024-09-13T22:56:07.217 INFO:tasks.workunit.client.0.smithi002.stdout:3/390: chown d9/d3b/f70 3923633 1 2024-09-13T22:56:07.218 INFO:tasks.workunit.client.0.smithi002.stdout:3/391: write d9/d15/d35/f52 [810260,35858] 0 2024-09-13T22:56:07.219 INFO:tasks.workunit.client.1.smithi047.stdout:1/407: read d0/f4f [166029,130565] 0 2024-09-13T22:56:07.219 INFO:tasks.workunit.client.1.smithi047.stdout:4/482: dread dc/de/f26 [0,4194304] 0 2024-09-13T22:56:07.225 INFO:tasks.workunit.client.1.smithi047.stdout:4/483: dread dc/de/f14 [0,4194304] 0 2024-09-13T22:56:07.227 INFO:tasks.workunit.client.0.smithi002.stdout:7/288: mkdir d8/d10/d11/d13/d26/d4c 0 2024-09-13T22:56:07.231 INFO:tasks.workunit.client.1.smithi047.stdout:9/402: symlink d1/dc/d14/dd/l7c 0 2024-09-13T22:56:07.239 INFO:tasks.workunit.client.0.smithi002.stdout:6/326: rename d12/d17/d28/d3e to d12/d17/d28/d67/d6b 0 2024-09-13T22:56:07.241 INFO:tasks.workunit.client.1.smithi047.stdout:1/408: write d0/f5 [851671,19655] 0 2024-09-13T22:56:07.241 INFO:tasks.workunit.client.0.smithi002.stdout:8/322: read - d3/d21/f58 zero size 2024-09-13T22:56:07.242 INFO:tasks.workunit.client.0.smithi002.stdout:4/317: dwrite d3/d14/f16 [0,4194304] 0 2024-09-13T22:56:07.242 INFO:tasks.workunit.client.0.smithi002.stdout:8/323: chown d3/fa 11839 1 2024-09-13T22:56:07.243 INFO:tasks.workunit.client.0.smithi002.stdout:9/373: creat d8/d10/d1c/d3d/f7d x:0 0 0 2024-09-13T22:56:07.243 INFO:tasks.workunit.client.1.smithi047.stdout:1/409: dread d0/d7/f4e [0,4194304] 0 2024-09-13T22:56:07.244 INFO:tasks.workunit.client.1.smithi047.stdout:4/484: mknod dc/ca7 0 2024-09-13T22:56:07.245 INFO:tasks.workunit.client.1.smithi047.stdout:7/490: dwrite d0/f81 [0,4194304] 0 2024-09-13T22:56:07.246 INFO:tasks.workunit.client.0.smithi002.stdout:3/392: unlink d9/d15/d26/l55 0 2024-09-13T22:56:07.247 INFO:tasks.workunit.client.1.smithi047.stdout:9/403: creat d1/dc/d14/dd/d54/d4e/d51/d79/f7d x:0 0 0 2024-09-13T22:56:07.248 INFO:tasks.workunit.client.0.smithi002.stdout:3/393: write d9/d15/d26/f85 [490628,115953] 0 2024-09-13T22:56:07.250 INFO:tasks.workunit.client.1.smithi047.stdout:1/410: dread - d0/d1d/f60 zero size 2024-09-13T22:56:07.251 INFO:tasks.workunit.client.0.smithi002.stdout:7/289: write f1 [379570,125332] 0 2024-09-13T22:56:07.251 INFO:tasks.workunit.client.1.smithi047.stdout:4/485: mknod dc/d29/d6c/ca8 0 2024-09-13T22:56:07.252 INFO:tasks.workunit.client.1.smithi047.stdout:4/486: stat dc/de/d23/f3b 0 2024-09-13T22:56:07.253 INFO:tasks.workunit.client.1.smithi047.stdout:7/491: creat d0/d7/da/d1e/d51/fa7 x:0 0 0 2024-09-13T22:56:07.253 INFO:tasks.workunit.client.1.smithi047.stdout:9/404: dread d1/f1a [0,4194304] 0 2024-09-13T22:56:07.254 INFO:tasks.workunit.client.1.smithi047.stdout:4/487: stat dc/de/d17/d25/d4a/fa4 0 2024-09-13T22:56:07.257 INFO:tasks.workunit.client.0.smithi002.stdout:0/338: rename d1/d2/l36 to d1/d4/d75/d76/l78 0 2024-09-13T22:56:07.259 INFO:tasks.workunit.client.1.smithi047.stdout:7/492: unlink d0/d57/d5b/d5c/c80 0 2024-09-13T22:56:07.259 INFO:tasks.workunit.client.0.smithi002.stdout:3/394: dwrite d9/d15/d46/f6f [0,4194304] 0 2024-09-13T22:56:07.260 INFO:tasks.workunit.client.1.smithi047.stdout:4/488: creat dc/de/d23/d40/fa9 x:0 0 0 2024-09-13T22:56:07.261 INFO:tasks.workunit.client.0.smithi002.stdout:1/376: creat d1/d13/d30/d31/f78 x:0 0 0 2024-09-13T22:56:07.264 INFO:tasks.workunit.client.1.smithi047.stdout:1/411: symlink d0/d1d/l78 0 2024-09-13T22:56:07.264 INFO:tasks.workunit.client.0.smithi002.stdout:5/314: creat d1/d2a/d41/f74 x:0 0 0 2024-09-13T22:56:07.265 INFO:tasks.workunit.client.0.smithi002.stdout:2/336: getdents d1/d7/d8/d2c 0 2024-09-13T22:56:07.267 INFO:tasks.workunit.client.1.smithi047.stdout:7/493: rename d0/d19/f3a to d0/d57/d5b/d8b/fa8 0 2024-09-13T22:56:07.267 INFO:tasks.workunit.client.1.smithi047.stdout:1/412: chown d0/d7/d14/d28/d36/c4a 57991 1 2024-09-13T22:56:07.269 INFO:tasks.workunit.client.1.smithi047.stdout:1/413: dread - d0/d1d/f60 zero size 2024-09-13T22:56:07.269 INFO:tasks.workunit.client.1.smithi047.stdout:4/489: dwrite dc/de/d17/d25/f7e [4194304,4194304] 0 2024-09-13T22:56:07.270 INFO:tasks.workunit.client.0.smithi002.stdout:9/374: dread d8/d10/d42/f6e [0,4194304] 0 2024-09-13T22:56:07.270 INFO:tasks.workunit.client.0.smithi002.stdout:7/290: symlink d8/d10/d11/d13/d2e/l4d 0 2024-09-13T22:56:07.271 INFO:tasks.workunit.client.0.smithi002.stdout:6/327: dwrite d12/d17/d28/f35 [0,4194304] 0 2024-09-13T22:56:07.275 INFO:tasks.workunit.client.1.smithi047.stdout:4/490: rmdir dc/d29 39 2024-09-13T22:56:07.277 INFO:tasks.workunit.client.1.smithi047.stdout:4/491: write f8 [3792080,66932] 0 2024-09-13T22:56:07.279 INFO:tasks.workunit.client.0.smithi002.stdout:8/324: fdatasync d3/f8 0 2024-09-13T22:56:07.279 INFO:tasks.workunit.client.1.smithi047.stdout:1/414: dwrite d0/f5a [0,4194304] 0 2024-09-13T22:56:07.280 INFO:tasks.workunit.client.0.smithi002.stdout:6/328: dwrite fa [4194304,4194304] 0 2024-09-13T22:56:07.289 INFO:tasks.workunit.client.0.smithi002.stdout:4/318: unlink d3/d14/d29/d2a/d30/c38 0 2024-09-13T22:56:07.294 INFO:tasks.workunit.client.0.smithi002.stdout:5/315: stat d1/d2a/d5a/l6c 0 2024-09-13T22:56:07.294 INFO:tasks.workunit.client.0.smithi002.stdout:3/395: read d9/f2a [26324,44689] 0 2024-09-13T22:56:07.294 INFO:tasks.workunit.client.0.smithi002.stdout:6/329: read d12/d17/d2a/f59 [602614,69520] 0 2024-09-13T22:56:07.294 INFO:tasks.workunit.client.0.smithi002.stdout:8/325: dwrite d3/dc/d16/f50 [0,4194304] 0 2024-09-13T22:56:07.294 INFO:tasks.workunit.client.0.smithi002.stdout:4/319: write d3/f3d [801618,45431] 0 2024-09-13T22:56:07.294 INFO:tasks.workunit.client.0.smithi002.stdout:2/337: mkdir d1/d7/d35/d3e/d59/d6b 0 2024-09-13T22:56:07.296 INFO:tasks.workunit.client.1.smithi047.stdout:9/405: dwrite d1/dc/d14/dd/d54/f37 [0,4194304] 0 2024-09-13T22:56:07.297 INFO:tasks.workunit.client.1.smithi047.stdout:1/415: mkdir d0/d7/db/d79 0 2024-09-13T22:56:07.297 INFO:tasks.workunit.client.0.smithi002.stdout:8/326: readlink d3/dc/d34/l4a 0 2024-09-13T22:56:07.298 INFO:tasks.workunit.client.0.smithi002.stdout:4/320: read - d3/d14/d29/d2a/f37 zero size 2024-09-13T22:56:07.299 INFO:tasks.workunit.client.0.smithi002.stdout:8/327: chown d3/dc/d16/d2f/f47 6041953 1 2024-09-13T22:56:07.300 INFO:tasks.workunit.client.1.smithi047.stdout:4/492: symlink dc/de/d23/d40/d7b/d90/da6/laa 0 2024-09-13T22:56:07.300 INFO:tasks.workunit.client.0.smithi002.stdout:8/328: chown d3/dc/d16/d60 14919957 1 2024-09-13T22:56:07.300 INFO:tasks.workunit.client.0.smithi002.stdout:9/375: creat d8/d10/d1c/d3d/f7e x:0 0 0 2024-09-13T22:56:07.301 INFO:tasks.workunit.client.1.smithi047.stdout:4/493: write dc/f9e [37251,56485] 0 2024-09-13T22:56:07.302 INFO:tasks.workunit.client.1.smithi047.stdout:9/406: dread d1/dc/d14/dd/d54/f37 [0,4194304] 0 2024-09-13T22:56:07.303 INFO:tasks.workunit.client.1.smithi047.stdout:1/416: symlink d0/d7/db/l7a 0 2024-09-13T22:56:07.309 INFO:tasks.workunit.client.1.smithi047.stdout:9/407: truncate d1/dc/f43 385070 0 2024-09-13T22:56:07.312 INFO:tasks.workunit.client.1.smithi047.stdout:9/408: rmdir d1/dc/d14/dd/d4c 39 2024-09-13T22:56:07.314 INFO:tasks.workunit.client.1.smithi047.stdout:7/494: truncate d0/db/fc 1237968 0 2024-09-13T22:56:07.315 INFO:tasks.workunit.client.0.smithi002.stdout:8/329: dwrite d3/dc/d18/f5a [0,4194304] 0 2024-09-13T22:56:07.315 INFO:tasks.workunit.client.0.smithi002.stdout:4/321: creat d3/d14/d25/f5c x:0 0 0 2024-09-13T22:56:07.317 INFO:tasks.workunit.client.1.smithi047.stdout:9/409: rename d1/d2d/f31 to d1/dc/d18/d72/f7e 0 2024-09-13T22:56:07.318 INFO:tasks.workunit.client.0.smithi002.stdout:9/376: dwrite d8/d10/d1c/d3d/f7d [0,4194304] 0 2024-09-13T22:56:07.318 INFO:tasks.workunit.client.0.smithi002.stdout:8/330: dread - d3/d27/f62 zero size 2024-09-13T22:56:07.326 INFO:tasks.workunit.client.1.smithi047.stdout:1/417: getdents d0/d7/d13/d5d 0 2024-09-13T22:56:07.332 INFO:tasks.workunit.client.0.smithi002.stdout:2/338: link d1/d7/d8/f1e d1/d4a/f6c 0 2024-09-13T22:56:07.336 INFO:tasks.workunit.client.0.smithi002.stdout:3/396: mknod d9/c8e 0 2024-09-13T22:56:07.339 INFO:tasks.workunit.client.1.smithi047.stdout:1/418: truncate d0/d1d/f2c 3801562 0 2024-09-13T22:56:07.340 INFO:tasks.workunit.client.1.smithi047.stdout:4/494: dwrite dc/de/d23/f42 [0,4194304] 0 2024-09-13T22:56:07.341 INFO:tasks.workunit.client.0.smithi002.stdout:7/291: truncate d8/d10/f1e 1516108 0 2024-09-13T22:56:07.344 INFO:tasks.workunit.client.0.smithi002.stdout:9/377: creat d8/d10/d42/f7f x:0 0 0 2024-09-13T22:56:07.345 INFO:tasks.workunit.client.1.smithi047.stdout:7/495: write d0/d7/da/d4e/f66 [2780011,114149] 0 2024-09-13T22:56:07.348 INFO:tasks.workunit.client.0.smithi002.stdout:0/339: rename d1/d2/c51 to d1/d4/c79 0 2024-09-13T22:56:07.350 INFO:tasks.workunit.client.0.smithi002.stdout:0/340: write d1/d2/d49/f5b [7365439,3549] 0 2024-09-13T22:56:07.350 INFO:tasks.workunit.client.0.smithi002.stdout:2/339: symlink d1/d7/d41/l6d 0 2024-09-13T22:56:07.351 INFO:tasks.workunit.client.0.smithi002.stdout:0/341: fdatasync d1/d4/d75/d31/f41 0 2024-09-13T22:56:07.354 INFO:tasks.workunit.client.0.smithi002.stdout:5/316: creat d1/d10/f75 x:0 0 0 2024-09-13T22:56:07.360 INFO:tasks.workunit.client.0.smithi002.stdout:1/377: rename d1/d13/l17 to d1/d13/d1d/d76/l79 0 2024-09-13T22:56:07.363 INFO:tasks.workunit.client.0.smithi002.stdout:2/340: unlink d1/d7/d8/c3f 0 2024-09-13T22:56:07.367 INFO:tasks.workunit.client.0.smithi002.stdout:4/322: creat d3/f5d x:0 0 0 2024-09-13T22:56:07.369 INFO:tasks.workunit.client.1.smithi047.stdout:9/410: link d1/d2d/f56 d1/d2d/f7f 0 2024-09-13T22:56:07.372 INFO:tasks.workunit.client.0.smithi002.stdout:1/378: dread d1/d13/d30/f53 [0,4194304] 0 2024-09-13T22:56:07.376 INFO:tasks.workunit.client.1.smithi047.stdout:7/496: dread d0/db/f7e [0,4194304] 0 2024-09-13T22:56:07.377 INFO:tasks.workunit.client.1.smithi047.stdout:7/497: chown d0/d57 21 1 2024-09-13T22:56:07.377 INFO:tasks.workunit.client.1.smithi047.stdout:7/498: fdatasync d0/d19/f2d 0 2024-09-13T22:56:07.383 INFO:tasks.workunit.client.1.smithi047.stdout:9/411: rename d1/d2d/l73 to d1/d2d/l80 0 2024-09-13T22:56:07.384 INFO:tasks.workunit.client.0.smithi002.stdout:3/397: truncate f5 2103095 0 2024-09-13T22:56:07.384 INFO:tasks.workunit.client.0.smithi002.stdout:3/398: stat d9/df/f6d 0 2024-09-13T22:56:07.385 INFO:tasks.workunit.client.1.smithi047.stdout:1/419: creat d0/d7/db/d79/f7b x:0 0 0 2024-09-13T22:56:07.387 INFO:tasks.workunit.client.0.smithi002.stdout:4/323: mkdir d3/d14/d25/d5e 0 2024-09-13T22:56:07.389 INFO:tasks.workunit.client.0.smithi002.stdout:9/378: link d8/d10/d1c/l23 d8/d10/d1c/d68/d74/l80 0 2024-09-13T22:56:07.395 INFO:tasks.workunit.client.0.smithi002.stdout:9/379: dwrite d8/d10/d1c/d3d/f7d [0,4194304] 0 2024-09-13T22:56:07.397 INFO:tasks.workunit.client.1.smithi047.stdout:1/420: mknod d0/d7/d14/d28/d36/c7c 0 2024-09-13T22:56:07.398 INFO:tasks.workunit.client.1.smithi047.stdout:1/421: write d0/f5 [5311245,101627] 0 2024-09-13T22:56:07.400 INFO:tasks.workunit.client.1.smithi047.stdout:1/422: dread - d0/d7/f74 zero size 2024-09-13T22:56:07.400 INFO:tasks.workunit.client.0.smithi002.stdout:3/399: creat d9/d15/d26/f8f x:0 0 0 2024-09-13T22:56:07.401 INFO:tasks.workunit.client.1.smithi047.stdout:1/423: stat d0/d7/c77 0 2024-09-13T22:56:07.402 INFO:tasks.workunit.client.0.smithi002.stdout:5/317: truncate d1/f12 687371 0 2024-09-13T22:56:07.404 INFO:tasks.workunit.client.1.smithi047.stdout:7/499: creat d0/d7/fa9 x:0 0 0 2024-09-13T22:56:07.404 INFO:tasks.workunit.client.1.smithi047.stdout:4/495: dwrite dc/de/d23/f37 [0,4194304] 0 2024-09-13T22:56:07.405 INFO:tasks.workunit.client.0.smithi002.stdout:2/341: dwrite d1/f1f [8388608,4194304] 0 2024-09-13T22:56:07.406 INFO:tasks.workunit.client.1.smithi047.stdout:7/500: write d0/d19/f2d [736271,60454] 0 2024-09-13T22:56:07.411 INFO:tasks.workunit.client.0.smithi002.stdout:3/400: dwrite d9/d15/d35/f52 [0,4194304] 0 2024-09-13T22:56:07.413 INFO:tasks.workunit.client.1.smithi047.stdout:7/501: mknod d0/d7/da/d4e/caa 0 2024-09-13T22:56:07.413 INFO:tasks.workunit.client.1.smithi047.stdout:4/496: dwrite dc/de/d23/d40/f59 [0,4194304] 0 2024-09-13T22:56:07.414 INFO:tasks.workunit.client.0.smithi002.stdout:1/379: creat d1/d13/d1d/d34/f7a x:0 0 0 2024-09-13T22:56:07.415 INFO:tasks.workunit.client.1.smithi047.stdout:4/497: fsync dc/de/d17/d25/d4a/fa4 0 2024-09-13T22:56:07.416 INFO:tasks.workunit.client.0.smithi002.stdout:1/380: readlink d1/d1c/l20 0 2024-09-13T22:56:07.416 INFO:tasks.workunit.client.0.smithi002.stdout:9/380: creat d8/d10/d61/f81 x:0 0 0 2024-09-13T22:56:07.422 INFO:tasks.workunit.client.0.smithi002.stdout:4/324: creat d3/d14/d25/d5e/f5f x:0 0 0 2024-09-13T22:56:07.422 INFO:tasks.workunit.client.0.smithi002.stdout:2/342: dwrite d1/f1f [4194304,4194304] 0 2024-09-13T22:56:07.426 INFO:tasks.workunit.client.0.smithi002.stdout:2/343: write d1/d7/d8/d2c/f39 [762318,12394] 0 2024-09-13T22:56:07.428 INFO:tasks.workunit.client.0.smithi002.stdout:9/381: dwrite d8/d1e/f22 [4194304,4194304] 0 2024-09-13T22:56:07.431 INFO:tasks.workunit.client.1.smithi047.stdout:2/534: sync 2024-09-13T22:56:07.431 INFO:tasks.workunit.client.1.smithi047.stdout:8/447: sync 2024-09-13T22:56:07.432 INFO:tasks.workunit.client.0.smithi002.stdout:3/401: truncate d9/d15/d35/f3a 1003355 0 2024-09-13T22:56:07.435 INFO:tasks.workunit.client.0.smithi002.stdout:3/402: write d9/d15/d26/f32 [5047249,20485] 0 2024-09-13T22:56:07.436 INFO:tasks.workunit.client.1.smithi047.stdout:4/498: dread f6 [0,4194304] 0 2024-09-13T22:56:07.436 INFO:tasks.workunit.client.0.smithi002.stdout:6/330: rename d12/d17/d28/f55 to d12/d17/d34/f6c 0 2024-09-13T22:56:07.437 INFO:tasks.workunit.client.1.smithi047.stdout:4/499: readlink dc/de/d23/l34 0 2024-09-13T22:56:07.438 INFO:tasks.workunit.client.0.smithi002.stdout:3/403: write d9/fd [1200764,1518] 0 2024-09-13T22:56:07.438 INFO:tasks.workunit.client.0.smithi002.stdout:9/382: dread d8/d10/d1c/d3d/f7b [4194304,4194304] 0 2024-09-13T22:56:07.441 INFO:tasks.workunit.client.1.smithi047.stdout:8/448: creat d8/d6b/f99 x:0 0 0 2024-09-13T22:56:07.442 INFO:tasks.workunit.client.0.smithi002.stdout:2/344: dwrite d1/d7/d8/d2c/f39 [0,4194304] 0 2024-09-13T22:56:07.444 INFO:tasks.workunit.client.0.smithi002.stdout:4/325: creat d3/d14/d29/d2a/f60 x:0 0 0 2024-09-13T22:56:07.450 INFO:tasks.workunit.client.1.smithi047.stdout:4/500: mkdir dc/de/d23/d40/d7b/dab 0 2024-09-13T22:56:07.548 INFO:tasks.workunit.client.0.smithi002.stdout:8/331: sync 2024-09-13T22:56:07.548 INFO:tasks.workunit.client.0.smithi002.stdout:8/332: fsync d3/dc/f42 0 2024-09-13T22:56:07.549 INFO:tasks.workunit.client.0.smithi002.stdout:8/333: chown d3/f8 124250240 1 2024-09-13T22:56:07.552 INFO:tasks.workunit.client.0.smithi002.stdout:8/334: dread d3/dc/d16/f50 [0,4194304] 0 2024-09-13T22:56:07.557 INFO:tasks.workunit.client.0.smithi002.stdout:8/335: dwrite d3/dc/d18/f5a [0,4194304] 0 2024-09-13T22:56:07.594 INFO:tasks.workunit.client.1.smithi047.stdout:7/502: dwrite d0/d7/da/d1e/f68 [0,4194304] 0 2024-09-13T22:56:07.595 INFO:tasks.workunit.client.1.smithi047.stdout:4/501: mknod dc/de/d17/d70/cac 0 2024-09-13T22:56:07.603 INFO:tasks.workunit.client.1.smithi047.stdout:8/449: mknod d8/d64/d4e/d4d/d8f/d91/d40/c9a 0 2024-09-13T22:56:07.603 INFO:tasks.workunit.client.1.smithi047.stdout:2/535: write d1/de/f5b [1460590,12462] 0 2024-09-13T22:56:07.608 INFO:tasks.workunit.client.0.smithi002.stdout:9/383: symlink d8/d10/d1c/d3d/l82 0 2024-09-13T22:56:07.608 INFO:tasks.workunit.client.0.smithi002.stdout:5/318: write d1/f3a [657997,71146] 0 2024-09-13T22:56:07.610 INFO:tasks.workunit.client.0.smithi002.stdout:9/384: write d8/d1e/f67 [5059097,8287] 0 2024-09-13T22:56:07.610 INFO:tasks.workunit.client.0.smithi002.stdout:7/292: truncate d8/d10/f1e 638574 0 2024-09-13T22:56:07.611 INFO:tasks.workunit.client.1.smithi047.stdout:8/450: symlink d8/d64/d4e/d4d/d8f/l9b 0 2024-09-13T22:56:07.612 INFO:tasks.workunit.client.1.smithi047.stdout:8/451: chown d8/d64/d4e/d70/d98 3321 1 2024-09-13T22:56:07.612 INFO:tasks.workunit.client.0.smithi002.stdout:9/385: truncate d8/d2c/f6a 373182 0 2024-09-13T22:56:07.613 INFO:tasks.workunit.client.0.smithi002.stdout:4/326: creat d3/d14/d25/f61 x:0 0 0 2024-09-13T22:56:07.613 INFO:tasks.workunit.client.1.smithi047.stdout:4/502: creat dc/d29/d6c/fad x:0 0 0 2024-09-13T22:56:07.614 INFO:tasks.workunit.client.1.smithi047.stdout:4/503: dread - dc/d29/d4d/f7c zero size 2024-09-13T22:56:07.615 INFO:tasks.workunit.client.1.smithi047.stdout:7/503: symlink d0/d7/da/d47/d92/lab 0 2024-09-13T22:56:07.616 INFO:tasks.workunit.client.1.smithi047.stdout:7/504: chown d0/d57/d5b/l72 14 1 2024-09-13T22:56:07.620 INFO:tasks.workunit.client.1.smithi047.stdout:8/452: creat d8/d64/d4e/d70/f9c x:0 0 0 2024-09-13T22:56:07.621 INFO:tasks.workunit.client.0.smithi002.stdout:7/293: dread d8/d10/d11/d13/d2e/d3c/f48 [0,4194304] 0 2024-09-13T22:56:07.621 INFO:tasks.workunit.client.0.smithi002.stdout:7/294: read - d8/f27 zero size 2024-09-13T22:56:07.622 INFO:tasks.workunit.client.1.smithi047.stdout:4/504: rmdir dc/de/d17/d70 39 2024-09-13T22:56:07.622 INFO:tasks.workunit.client.0.smithi002.stdout:7/295: write f7 [7470792,86326] 0 2024-09-13T22:56:07.623 INFO:tasks.workunit.client.1.smithi047.stdout:7/505: dwrite d0/f29 [0,4194304] 0 2024-09-13T22:56:07.625 INFO:tasks.workunit.client.1.smithi047.stdout:7/506: stat d0/d7/da/d4e/f4f 0 2024-09-13T22:56:07.629 INFO:tasks.workunit.client.1.smithi047.stdout:4/505: dread dc/de/d23/f55 [0,4194304] 0 2024-09-13T22:56:07.631 INFO:tasks.workunit.client.0.smithi002.stdout:6/331: dwrite d12/d17/f4a [4194304,4194304] 0 2024-09-13T22:56:07.632 INFO:tasks.workunit.client.1.smithi047.stdout:8/453: dread d8/d64/d4e/d4d/d8f/d91/d38/f44 [0,4194304] 0 2024-09-13T22:56:07.632 INFO:tasks.workunit.client.0.smithi002.stdout:6/332: read f5 [785980,108220] 0 2024-09-13T22:56:07.637 INFO:tasks.workunit.client.1.smithi047.stdout:2/536: dwrite d1/df/f1b [0,4194304] 0 2024-09-13T22:56:07.642 INFO:tasks.workunit.client.0.smithi002.stdout:4/327: write d3/d14/f2b [99267,29304] 0 2024-09-13T22:56:07.645 INFO:tasks.workunit.client.1.smithi047.stdout:2/537: unlink d1/de/d17/l60 0 2024-09-13T22:56:07.648 INFO:tasks.workunit.client.0.smithi002.stdout:8/336: unlink d3/dc/d16/d2f/c3d 0 2024-09-13T22:56:07.649 INFO:tasks.workunit.client.1.smithi047.stdout:7/507: creat d0/d7/da/d1e/fac x:0 0 0 2024-09-13T22:56:07.651 INFO:tasks.workunit.client.0.smithi002.stdout:0/342: rename d1/f14 to d1/d2/f7a 0 2024-09-13T22:56:07.654 INFO:tasks.workunit.client.1.smithi047.stdout:2/538: dread d1/df/d1d/d20/f8f [0,4194304] 0 2024-09-13T22:56:07.654 INFO:tasks.workunit.client.1.smithi047.stdout:7/508: chown d0/d7/da/d1e/c9a 493983 1 2024-09-13T22:56:07.655 INFO:tasks.workunit.client.1.smithi047.stdout:7/509: dread - d0/d7/da/d4e/f70 zero size 2024-09-13T22:56:07.657 INFO:tasks.workunit.client.0.smithi002.stdout:3/404: creat d9/d15/d36/d4e/d5e/f90 x:0 0 0 2024-09-13T22:56:07.658 INFO:tasks.workunit.client.0.smithi002.stdout:3/405: readlink d9/d15/d26/d44/l79 0 2024-09-13T22:56:07.659 INFO:tasks.workunit.client.1.smithi047.stdout:4/506: dwrite dc/d29/f41 [0,4194304] 0 2024-09-13T22:56:07.664 INFO:tasks.workunit.client.1.smithi047.stdout:2/539: creat d1/d16/d40/d57/db0/fb7 x:0 0 0 2024-09-13T22:56:07.665 INFO:tasks.workunit.client.1.smithi047.stdout:2/540: fdatasync d1/df/d1d/d20/d37/fb1 0 2024-09-13T22:56:07.666 INFO:tasks.workunit.client.0.smithi002.stdout:6/333: dread d12/f63 [0,4194304] 0 2024-09-13T22:56:07.666 INFO:tasks.workunit.client.1.smithi047.stdout:2/541: truncate d1/de/f83 937484 0 2024-09-13T22:56:07.667 INFO:tasks.workunit.client.1.smithi047.stdout:8/454: getdents d8/d64/d4e/d70 0 2024-09-13T22:56:07.670 INFO:tasks.workunit.client.1.smithi047.stdout:7/510: write d0/d57/d5b/d8b/fa8 [4550112,10817] 0 2024-09-13T22:56:07.671 INFO:tasks.workunit.client.1.smithi047.stdout:4/507: truncate dc/de/d23/f64 1998460 0 2024-09-13T22:56:07.673 INFO:tasks.workunit.client.0.smithi002.stdout:8/337: creat d3/d21/d57/f68 x:0 0 0 2024-09-13T22:56:07.673 INFO:tasks.workunit.client.1.smithi047.stdout:2/542: fsync d1/df/d1d/d2e/fa7 0 2024-09-13T22:56:07.675 INFO:tasks.workunit.client.1.smithi047.stdout:8/455: mkdir d8/d64/d4e/d4d/d8f/d9d 0 2024-09-13T22:56:07.676 INFO:tasks.workunit.client.0.smithi002.stdout:1/381: rename d1/d13/c23 to d1/d13/d1d/d34/c7b 0 2024-09-13T22:56:07.677 INFO:tasks.workunit.client.1.smithi047.stdout:7/511: symlink d0/d57/d5b/lad 0 2024-09-13T22:56:07.678 INFO:tasks.workunit.client.1.smithi047.stdout:4/508: unlink dc/de/d23/f37 0 2024-09-13T22:56:07.679 INFO:tasks.workunit.client.0.smithi002.stdout:4/328: dread d3/f10 [0,4194304] 0 2024-09-13T22:56:07.683 INFO:tasks.workunit.client.0.smithi002.stdout:0/343: dwrite d1/d2/d49/f64 [0,4194304] 0 2024-09-13T22:56:07.687 INFO:tasks.workunit.client.0.smithi002.stdout:6/334: creat d12/d17/d28/d67/f6d x:0 0 0 2024-09-13T22:56:07.688 INFO:tasks.workunit.client.0.smithi002.stdout:6/335: write fa [1027604,112028] 0 2024-09-13T22:56:07.692 INFO:tasks.workunit.client.0.smithi002.stdout:9/386: link d8/d1e/f34 d8/d10/d1c/f83 0 2024-09-13T22:56:07.693 INFO:tasks.workunit.client.0.smithi002.stdout:9/387: write d8/d10/d1c/d3d/f7e [219626,10437] 0 2024-09-13T22:56:07.694 INFO:tasks.workunit.client.0.smithi002.stdout:8/338: rmdir d3/dc/d16 39 2024-09-13T22:56:07.695 INFO:tasks.workunit.client.1.smithi047.stdout:2/543: link d1/de/f83 d1/df/d1d/d20/d37/d7b/d80/fb8 0 2024-09-13T22:56:07.697 INFO:tasks.workunit.client.1.smithi047.stdout:2/544: write d1/d16/d40/d57/db0/fb7 [673327,128316] 0 2024-09-13T22:56:07.698 INFO:tasks.workunit.client.1.smithi047.stdout:2/545: chown d1/df/d1d/d20/d29/f52 7976169 1 2024-09-13T22:56:07.699 INFO:tasks.workunit.client.1.smithi047.stdout:2/546: fdatasync d1/df/f9e 0 2024-09-13T22:56:07.699 INFO:tasks.workunit.client.0.smithi002.stdout:2/345: rename d1/l3b to d1/d7/d35/d3e/d59/d6b/l6e 0 2024-09-13T22:56:07.701 INFO:tasks.workunit.client.1.smithi047.stdout:5/378: sync 2024-09-13T22:56:07.701 INFO:tasks.workunit.client.1.smithi047.stdout:4/509: mkdir dc/de/d23/d40/d7b/dab/dae 0 2024-09-13T22:56:07.702 INFO:tasks.workunit.client.1.smithi047.stdout:5/379: chown d19/d23/l79 20213352 1 2024-09-13T22:56:07.702 INFO:tasks.workunit.client.0.smithi002.stdout:8/339: dwrite d3/dc/d18/f67 [0,4194304] 0 2024-09-13T22:56:07.703 INFO:tasks.workunit.client.0.smithi002.stdout:3/406: mkdir d9/d91 0 2024-09-13T22:56:07.704 INFO:tasks.workunit.client.0.smithi002.stdout:8/340: write d3/d21/d57/f68 [74857,36191] 0 2024-09-13T22:56:07.705 INFO:tasks.workunit.client.1.smithi047.stdout:8/456: creat d8/f9e x:0 0 0 2024-09-13T22:56:07.707 INFO:tasks.workunit.client.1.smithi047.stdout:2/547: rmdir d1/d16/d40/d57 39 2024-09-13T22:56:07.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.705+0000 7f7b48b77700 1 -- 172.21.15.2:0/251642563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b440fef60 msgr2=0x7f7b440ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:07.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.705+0000 7f7b48b77700 1 --2- 172.21.15.2:0/251642563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b440fef60 0x7f7b440ff380 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009870 tx=0x7f7b34009b80 comp rx=0 tx=0).stop 2024-09-13T22:56:07.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.707+0000 7f7b48b77700 1 -- 172.21.15.2:0/251642563 shutdown_connections 2024-09-13T22:56:07.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.707+0000 7f7b48b77700 1 --2- 172.21.15.2:0/251642563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b44101f40 0x7f7b441023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:07.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.707+0000 7f7b48b77700 1 --2- 172.21.15.2:0/251642563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b440fef60 0x7f7b440ff380 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:07.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.707+0000 7f7b48b77700 1 -- 172.21.15.2:0/251642563 >> 172.21.15.2:0/251642563 conn(0x7f7b440fa8c0 msgr2=0x7f7b440fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:07.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.707+0000 7f7b48b77700 1 -- 172.21.15.2:0/251642563 shutdown_connections 2024-09-13T22:56:07.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.708+0000 7f7b48b77700 1 -- 172.21.15.2:0/251642563 wait complete. 2024-09-13T22:56:07.709 INFO:tasks.workunit.client.1.smithi047.stdout:4/510: dwrite dc/f9e [0,4194304] 0 2024-09-13T22:56:07.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.709+0000 7f7b48b77700 1 Processor -- start 2024-09-13T22:56:07.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.709+0000 7f7b48b77700 1 -- start start 2024-09-13T22:56:07.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.709+0000 7f7b48b77700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b440fef60 0x7f7b44196500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:07.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.709+0000 7f7b48b77700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b44101f40 0x7f7b44196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:07.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.709+0000 7f7b48b77700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b44197060 con 0x7f7b440fef60 2024-09-13T22:56:07.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.709+0000 7f7b48b77700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b441971a0 con 0x7f7b44101f40 2024-09-13T22:56:07.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.710+0000 7f7b4259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b440fef60 0x7f7b44196500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:07.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.710+0000 7f7b4259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b440fef60 0x7f7b44196500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52254/0 (socket says 172.21.15.2:52254) 2024-09-13T22:56:07.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.710+0000 7f7b4259c700 1 -- 172.21.15.2:0/200040352 learned_addr learned my addr 172.21.15.2:0/200040352 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:56:07.712 INFO:tasks.workunit.client.0.smithi002.stdout:0/344: unlink d1/f59 0 2024-09-13T22:56:07.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.710+0000 7f7b41d9b700 1 --2- 172.21.15.2:0/200040352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b44101f40 0x7f7b44196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:07.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.710+0000 7f7b4259c700 1 -- 172.21.15.2:0/200040352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b44101f40 msgr2=0x7f7b44196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:07.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.710+0000 7f7b4259c700 1 --2- 172.21.15.2:0/200040352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b44101f40 0x7f7b44196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:07.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.710+0000 7f7b4259c700 1 -- 172.21.15.2:0/200040352 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b34009520 con 0x7f7b440fef60 2024-09-13T22:56:07.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.711+0000 7f7b4259c700 1 --2- 172.21.15.2:0/200040352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b440fef60 0x7f7b44196500 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009230 tx=0x7f7b3400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:07.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.711+0000 7f7b337fe700 1 -- 172.21.15.2:0/200040352 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b3401c070 con 0x7f7b440fef60 2024-09-13T22:56:07.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.711+0000 7f7b48b77700 1 -- 172.21.15.2:0/200040352 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4419bbf0 con 0x7f7b440fef60 2024-09-13T22:56:07.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.711+0000 7f7b48b77700 1 -- 172.21.15.2:0/200040352 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4419c0e0 con 0x7f7b440fef60 2024-09-13T22:56:07.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.711+0000 7f7b337fe700 1 -- 172.21.15.2:0/200040352 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7b3400fe10 con 0x7f7b440fef60 2024-09-13T22:56:07.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.711+0000 7f7b337fe700 1 -- 172.21.15.2:0/200040352 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b3402c440 con 0x7f7b440fef60 2024-09-13T22:56:07.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.713+0000 7f7b48b77700 1 -- 172.21.15.2:0/200040352 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b44109800 con 0x7f7b440fef60 2024-09-13T22:56:07.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.713+0000 7f7b337fe700 1 -- 172.21.15.2:0/200040352 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) v1 ==== 91460+0+0 (secure 0 0 0) 0x7f7b34020070 con 0x7f7b440fef60 2024-09-13T22:56:07.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.714+0000 7f7b337fe700 1 --2- 172.21.15.2:0/200040352 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f7b2c06d530 0x7f7b2c06f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:07.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.714+0000 7f7b337fe700 1 -- 172.21.15.2:0/200040352 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f7b3408df60 con 0x7f7b440fef60 2024-09-13T22:56:07.716 INFO:tasks.workunit.client.1.smithi047.stdout:5/380: symlink d19/d23/d4c/l7f 0 2024-09-13T22:56:07.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.716+0000 7f7b41d9b700 1 --2- 172.21.15.2:0/200040352 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f7b2c06d530 0x7f7b2c06f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:07.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.717+0000 7f7b41d9b700 1 --2- 172.21.15.2:0/200040352 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f7b2c06d530 0x7f7b2c06f9f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7b38005fd0 tx=0x7f7b38009310 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:07.722 INFO:tasks.workunit.client.1.smithi047.stdout:4/511: write dc/de/f97 [410064,111557] 0 2024-09-13T22:56:07.723 INFO:tasks.workunit.client.0.smithi002.stdout:0/345: dread d1/d2/f19 [0,4194304] 0 2024-09-13T22:56:07.724 INFO:tasks.workunit.client.1.smithi047.stdout:5/381: mkdir d19/d34/d42/d5d/d80 0 2024-09-13T22:56:07.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:07.724+0000 7f7b337fe700 1 -- 172.21.15.2:0/200040352 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f7b340c29f0 con 0x7f7b440fef60 2024-09-13T22:56:07.727 INFO:tasks.workunit.client.1.smithi047.stdout:2/548: write d1/df/d26/d4b/f76 [845666,101866] 0 2024-09-13T22:56:07.728 INFO:tasks.workunit.client.1.smithi047.stdout:2/549: read - d1/df/d35/f78 zero size 2024-09-13T22:56:07.731 INFO:tasks.workunit.client.1.smithi047.stdout:5/382: unlink d19/f1c 0 2024-09-13T22:56:07.732 INFO:tasks.workunit.client.1.smithi047.stdout:8/457: creat d8/d64/f9f x:0 0 0 2024-09-13T22:56:07.733 INFO:tasks.workunit.client.1.smithi047.stdout:8/458: readlink d8/d64/d4e/d4d/l5e 0 2024-09-13T22:56:07.738 INFO:tasks.workunit.client.1.smithi047.stdout:5/383: dread d19/d25/f2b [0,4194304] 0 2024-09-13T22:56:07.740 INFO:tasks.workunit.client.1.smithi047.stdout:4/512: dread dc/d29/d4c/f82 [0,4194304] 0 2024-09-13T22:56:07.741 INFO:tasks.workunit.client.0.smithi002.stdout:2/346: creat d1/d32/d37/d3a/f6f x:0 0 0 2024-09-13T22:56:07.743 INFO:tasks.workunit.client.0.smithi002.stdout:4/329: mkdir d3/d62 0 2024-09-13T22:56:07.744 INFO:tasks.workunit.client.1.smithi047.stdout:8/459: mknod d8/d6b/ca0 0 2024-09-13T22:56:07.746 INFO:tasks.workunit.client.1.smithi047.stdout:2/550: mknod d1/d16/d40/d57/db0/cb9 0 2024-09-13T22:56:07.748 INFO:tasks.workunit.client.1.smithi047.stdout:2/551: dread d1/df/d1d/d3c/f9d [0,4194304] 0 2024-09-13T22:56:07.748 INFO:tasks.workunit.client.1.smithi047.stdout:5/384: creat d19/d23/d2e/d41/f81 x:0 0 0 2024-09-13T22:56:07.749 INFO:tasks.workunit.client.1.smithi047.stdout:5/385: dread - d19/d25/f61 zero size 2024-09-13T22:56:07.750 INFO:tasks.workunit.client.1.smithi047.stdout:5/386: chown c18 12773138 1 2024-09-13T22:56:07.751 INFO:tasks.workunit.client.1.smithi047.stdout:4/513: symlink dc/de/d23/d40/d7b/d90/laf 0 2024-09-13T22:56:07.756 INFO:tasks.workunit.client.0.smithi002.stdout:9/388: dwrite d8/d10/d1c/f83 [4194304,4194304] 0 2024-09-13T22:56:07.756 INFO:tasks.workunit.client.0.smithi002.stdout:8/341: dwrite d3/f5 [0,4194304] 0 2024-09-13T22:56:07.758 INFO:tasks.workunit.client.0.smithi002.stdout:2/347: unlink d1/l54 0 2024-09-13T22:56:07.761 INFO:tasks.workunit.client.1.smithi047.stdout:5/387: mknod d19/d64/c82 0 2024-09-13T22:56:07.762 INFO:tasks.workunit.client.0.smithi002.stdout:4/330: dread d3/f1e [0,4194304] 0 2024-09-13T22:56:07.763 INFO:tasks.workunit.client.0.smithi002.stdout:6/336: creat d12/d17/f6e x:0 0 0 2024-09-13T22:56:07.764 INFO:tasks.workunit.client.0.smithi002.stdout:3/407: dread d9/d15/d51/f18 [0,4194304] 0 2024-09-13T22:56:07.765 INFO:tasks.workunit.client.1.smithi047.stdout:8/460: chown d8/d64/d4e/d4d/d8f/d91/d40/c5f 0 1 2024-09-13T22:56:07.765 INFO:tasks.workunit.client.0.smithi002.stdout:4/331: write d3/d14/d25/f4f [1030970,54690] 0 2024-09-13T22:56:07.766 INFO:tasks.workunit.client.0.smithi002.stdout:3/408: write d9/d15/d46/f5f [190009,60332] 0 2024-09-13T22:56:07.766 INFO:tasks.workunit.client.0.smithi002.stdout:5/319: rename d1/d2a/d5a/f65 to d1/d2a/d41/d45/f76 0 2024-09-13T22:56:07.767 INFO:tasks.workunit.client.0.smithi002.stdout:6/337: truncate d12/f6a 489087 0 2024-09-13T22:56:07.768 INFO:tasks.workunit.client.0.smithi002.stdout:9/389: fsync d8/d2c/f78 0 2024-09-13T22:56:07.772 INFO:tasks.workunit.client.1.smithi047.stdout:8/461: read d8/f7b [2181,56792] 0 2024-09-13T22:56:07.772 INFO:tasks.workunit.client.0.smithi002.stdout:5/320: read d1/d10/f3d [3020959,79676] 0 2024-09-13T22:56:07.773 INFO:tasks.workunit.client.1.smithi047.stdout:5/388: mkdir d19/d83 0 2024-09-13T22:56:07.775 INFO:tasks.workunit.client.0.smithi002.stdout:6/338: creat d12/d17/d2a/f6f x:0 0 0 2024-09-13T22:56:07.775 INFO:tasks.workunit.client.1.smithi047.stdout:2/552: link d1/df/d1d/d20/d54/f5c d1/df/d26/d4b/fba 0 2024-09-13T22:56:07.777 INFO:tasks.workunit.client.0.smithi002.stdout:7/296: rename d8/d9/f28 to d8/d10/d11/d13/d26/d4c/f4e 0 2024-09-13T22:56:07.778 INFO:tasks.workunit.client.1.smithi047.stdout:5/389: write d19/d34/d42/f5b [2287539,98890] 0 2024-09-13T22:56:07.780 INFO:tasks.workunit.client.1.smithi047.stdout:8/462: creat d8/d64/d4e/d4d/d8f/d91/d78/fa1 x:0 0 0 2024-09-13T22:56:07.781 INFO:tasks.workunit.client.0.smithi002.stdout:9/390: mkdir d8/d10/d1c/d68/d84 0 2024-09-13T22:56:07.782 INFO:tasks.workunit.client.1.smithi047.stdout:2/553: truncate d1/d16/f6a 283063 0 2024-09-13T22:56:07.783 INFO:tasks.workunit.client.0.smithi002.stdout:3/409: fsync d9/d15/d51/f2e 0 2024-09-13T22:56:07.785 INFO:tasks.workunit.client.1.smithi047.stdout:8/463: chown d8/c11 3030091 1 2024-09-13T22:56:07.786 INFO:tasks.workunit.client.0.smithi002.stdout:5/321: symlink d1/d2a/d6b/l77 0 2024-09-13T22:56:07.788 INFO:tasks.workunit.client.1.smithi047.stdout:2/554: unlink d1/df/d1d/d20/d2b/f34 0 2024-09-13T22:56:07.792 INFO:tasks.workunit.client.1.smithi047.stdout:8/464: chown d8/d64/d4e/d4d/d8f/d91/d40/f48 59 1 2024-09-13T22:56:07.793 INFO:tasks.workunit.client.1.smithi047.stdout:8/465: stat d8/d64/d4e/d4d/d8f/l9b 0 2024-09-13T22:56:07.794 INFO:tasks.workunit.client.1.smithi047.stdout:4/514: truncate f8 2734240 0 2024-09-13T22:56:07.794 INFO:tasks.workunit.client.0.smithi002.stdout:6/339: dwrite d12/d17/f1e [0,4194304] 0 2024-09-13T22:56:07.795 INFO:tasks.workunit.client.1.smithi047.stdout:2/555: creat d1/df/d1d/d20/d37/fbb x:0 0 0 2024-09-13T22:56:07.795 INFO:tasks.workunit.client.0.smithi002.stdout:2/348: write d1/d7/d8/f1a [1368262,81985] 0 2024-09-13T22:56:07.796 INFO:tasks.workunit.client.1.smithi047.stdout:5/390: link l14 d19/d23/d2e/d41/l84 0 2024-09-13T22:56:07.797 INFO:tasks.workunit.client.0.smithi002.stdout:6/340: write d12/d17/d34/d39/f62 [113855,6944] 0 2024-09-13T22:56:07.799 INFO:tasks.workunit.client.0.smithi002.stdout:2/349: dread - d1/d7/d8/f5d zero size 2024-09-13T22:56:07.800 INFO:tasks.workunit.client.0.smithi002.stdout:1/382: rename d1/l45 to d1/d13/d1d/d76/l7c 0 2024-09-13T22:56:07.801 INFO:tasks.workunit.client.1.smithi047.stdout:8/466: stat d8/c31 0 2024-09-13T22:56:07.804 INFO:tasks.workunit.client.1.smithi047.stdout:5/391: dwrite d19/d34/d42/f5b [0,4194304] 0 2024-09-13T22:56:07.806 INFO:tasks.workunit.client.1.smithi047.stdout:2/556: fsync d1/df/d26/f30 0 2024-09-13T22:56:07.809 INFO:tasks.workunit.client.0.smithi002.stdout:3/410: truncate d9/d15/d51/f37 33243 0 2024-09-13T22:56:07.811 INFO:tasks.workunit.client.1.smithi047.stdout:5/392: mkdir d19/d25/d85 0 2024-09-13T22:56:07.811 INFO:tasks.workunit.client.1.smithi047.stdout:5/393: write d19/f43 [2222703,48365] 0 2024-09-13T22:56:07.812 INFO:tasks.workunit.client.0.smithi002.stdout:7/297: mknod d8/c4f 0 2024-09-13T22:56:07.812 INFO:tasks.workunit.client.1.smithi047.stdout:5/394: dread - d19/d23/d4c/f67 zero size 2024-09-13T22:56:07.813 INFO:tasks.workunit.client.0.smithi002.stdout:6/341: creat d12/d17/d28/d67/f70 x:0 0 0 2024-09-13T22:56:07.814 INFO:tasks.workunit.client.1.smithi047.stdout:5/395: truncate d19/f4f 658135 0 2024-09-13T22:56:07.814 INFO:tasks.workunit.client.1.smithi047.stdout:2/557: truncate d1/df/d1d/da9/faf 785567 0 2024-09-13T22:56:07.814 INFO:tasks.workunit.client.1.smithi047.stdout:5/396: chown d19/d64/c82 15 1 2024-09-13T22:56:07.815 INFO:tasks.workunit.client.0.smithi002.stdout:2/350: creat d1/d7/d35/d3e/d59/f70 x:0 0 0 2024-09-13T22:56:07.820 INFO:tasks.workunit.client.0.smithi002.stdout:0/346: rename d1/d4/d75/d31/d32/l73 to d1/d2/d6c/l7b 0 2024-09-13T22:56:07.820 INFO:tasks.workunit.client.1.smithi047.stdout:2/558: creat d1/df/d1d/d20/d37/d7a/fbc x:0 0 0 2024-09-13T22:56:07.822 INFO:tasks.workunit.client.0.smithi002.stdout:0/347: chown d1/f63 1516 1 2024-09-13T22:56:07.824 INFO:tasks.workunit.client.0.smithi002.stdout:8/342: getdents d3/d21 0 2024-09-13T22:56:07.825 INFO:tasks.workunit.client.1.smithi047.stdout:5/397: rename d19/d23/d2e/d41/f81 to d19/d34/d42/d5d/f86 0 2024-09-13T22:56:07.827 INFO:tasks.workunit.client.1.smithi047.stdout:5/398: read d19/d23/f3a [441264,28658] 0 2024-09-13T22:56:07.828 INFO:tasks.workunit.client.0.smithi002.stdout:2/351: dwrite d1/d7/d8/d2c/f39 [0,4194304] 0 2024-09-13T22:56:07.828 INFO:tasks.workunit.client.0.smithi002.stdout:9/391: symlink d8/d10/d1c/d68/d84/l85 0 2024-09-13T22:56:07.829 INFO:tasks.workunit.client.1.smithi047.stdout:8/467: link d8/d64/d4e/d4d/l80 d8/d64/d4e/d4d/d8f/d91/d38/la2 0 2024-09-13T22:56:07.833 INFO:tasks.workunit.client.0.smithi002.stdout:1/383: dwrite d1/d13/d1d/f3a [4194304,4194304] 0 2024-09-13T22:56:07.833 INFO:tasks.workunit.client.0.smithi002.stdout:9/392: readlink d8/d10/d1c/l65 0 2024-09-13T22:56:07.837 INFO:tasks.workunit.client.1.smithi047.stdout:4/515: truncate dc/de/f14 1522219 0 2024-09-13T22:56:07.840 INFO:tasks.workunit.client.1.smithi047.stdout:5/399: symlink d19/d34/d42/l87 0 2024-09-13T22:56:07.840 INFO:tasks.workunit.client.0.smithi002.stdout:0/348: dwrite d1/fa [4194304,4194304] 0 2024-09-13T22:56:07.841 INFO:tasks.workunit.client.1.smithi047.stdout:5/400: write d19/f1d [1031549,120450] 0 2024-09-13T22:56:07.842 INFO:tasks.workunit.client.0.smithi002.stdout:0/349: write d1/f6f [329514,115003] 0 2024-09-13T22:56:07.845 INFO:tasks.workunit.client.0.smithi002.stdout:5/322: dread d1/d10/f35 [0,4194304] 0 2024-09-13T22:56:07.849 INFO:tasks.workunit.client.0.smithi002.stdout:1/384: mkdir d1/d1c/d7d 0 2024-09-13T22:56:07.850 INFO:tasks.workunit.client.0.smithi002.stdout:6/342: symlink d12/d17/l71 0 2024-09-13T22:56:07.851 INFO:tasks.workunit.client.0.smithi002.stdout:6/343: chown d12/d17/c64 65765858 1 2024-09-13T22:56:07.852 INFO:tasks.workunit.client.1.smithi047.stdout:8/468: mkdir d8/da3 0 2024-09-13T22:56:07.852 INFO:tasks.workunit.client.0.smithi002.stdout:9/393: rmdir d8/d10/d1c 39 2024-09-13T22:56:07.855 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:07 smithi002 ceph-mon[27637]: pgmap v14: 65 pgs: 65 active+clean; 1.6 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 42 MiB/s rd, 239 MiB/s wr, 447 op/s 2024-09-13T22:56:07.857 INFO:tasks.workunit.client.1.smithi047.stdout:2/559: dread d1/df/d1d/d20/d37/d7b/f86 [4194304,4194304] 0 2024-09-13T22:56:07.857 INFO:tasks.workunit.client.0.smithi002.stdout:4/332: rename d3/d14/f1f to d3/d14/d29/d2a/f63 0 2024-09-13T22:56:07.859 INFO:tasks.workunit.client.0.smithi002.stdout:0/350: mknod d1/d4/d75/c7c 0 2024-09-13T22:56:07.862 INFO:tasks.workunit.client.1.smithi047.stdout:8/469: read d8/d64/d4e/d4d/d8f/d91/f3c [3765635,57859] 0 2024-09-13T22:56:07.864 INFO:tasks.workunit.client.0.smithi002.stdout:5/323: chown d1/f12 31 1 2024-09-13T22:56:07.866 INFO:tasks.workunit.client.0.smithi002.stdout:3/411: link f3 d9/d15/d51/f92 0 2024-09-13T22:56:07.868 INFO:tasks.workunit.client.0.smithi002.stdout:3/412: truncate d9/d15/d26/d44/f6b 929190 0 2024-09-13T22:56:07.870 INFO:tasks.workunit.client.1.smithi047.stdout:8/470: fdatasync d8/f7b 0 2024-09-13T22:56:07.872 INFO:tasks.workunit.client.1.smithi047.stdout:2/560: mknod d1/d16/d40/cbd 0 2024-09-13T22:56:07.878 INFO:tasks.workunit.client.0.smithi002.stdout:3/413: dwrite d9/df/f6d [0,4194304] 0 2024-09-13T22:56:07.879 INFO:tasks.workunit.client.0.smithi002.stdout:1/385: rename d1/d13/d30/d31/f78 to d1/d13/d30/f7e 0 2024-09-13T22:56:07.879 INFO:tasks.workunit.client.1.smithi047.stdout:8/471: fsync d8/d64/d4e/d4d/d8f/d91/d38/f44 0 2024-09-13T22:56:07.882 INFO:tasks.workunit.client.0.smithi002.stdout:0/351: mkdir d1/d2/d49/d7d 0 2024-09-13T22:56:07.884 INFO:tasks.workunit.client.0.smithi002.stdout:5/324: mkdir d1/d2a/d41/d45/d4f/d78 0 2024-09-13T22:56:07.885 INFO:tasks.workunit.client.0.smithi002.stdout:8/343: write d3/dc/f13 [4203876,125520] 0 2024-09-13T22:56:07.891 INFO:tasks.workunit.client.1.smithi047.stdout:8/472: mknod d8/d64/d4e/d4d/d8f/d91/d38/d7a/ca4 0 2024-09-13T22:56:07.894 INFO:tasks.workunit.client.1.smithi047.stdout:4/516: truncate dc/de/f18 4747749 0 2024-09-13T22:56:07.897 INFO:tasks.workunit.client.1.smithi047.stdout:5/401: write d19/d25/f38 [2099191,22742] 0 2024-09-13T22:56:07.911 INFO:tasks.workunit.client.1.smithi047.stdout:0/473: sync 2024-09-13T22:56:07.911 INFO:tasks.workunit.client.1.smithi047.stdout:9/412: sync 2024-09-13T22:56:07.911 INFO:tasks.workunit.client.1.smithi047.stdout:1/424: sync 2024-09-13T22:56:07.912 INFO:tasks.workunit.client.1.smithi047.stdout:6/480: sync 2024-09-13T22:56:07.912 INFO:tasks.workunit.client.1.smithi047.stdout:3/480: sync 2024-09-13T22:56:07.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:07 smithi047 ceph-mon[34560]: pgmap v14: 65 pgs: 65 active+clean; 1.6 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 42 MiB/s rd, 239 MiB/s wr, 447 op/s 2024-09-13T22:56:07.912 INFO:tasks.workunit.client.1.smithi047.stdout:4/517: mkdir dc/d29/d4c/db0 0 2024-09-13T22:56:07.913 INFO:tasks.workunit.client.1.smithi047.stdout:1/425: readlink d0/d7/d14/d28/d36/l1c 0 2024-09-13T22:56:07.915 INFO:tasks.workunit.client.1.smithi047.stdout:4/518: write dc/d29/d6c/f93 [262822,75893] 0 2024-09-13T22:56:07.917 INFO:tasks.workunit.client.1.smithi047.stdout:5/402: creat d19/d34/d42/f88 x:0 0 0 2024-09-13T22:56:07.917 INFO:tasks.workunit.client.0.smithi002.stdout:6/344: dwrite d12/d17/d28/d67/d6b/f49 [0,4194304] 0 2024-09-13T22:56:07.922 INFO:tasks.workunit.client.1.smithi047.stdout:9/413: creat d1/d2d/f81 x:0 0 0 2024-09-13T22:56:07.925 INFO:tasks.workunit.client.0.smithi002.stdout:1/386: creat d1/d1c/d7d/f7f x:0 0 0 2024-09-13T22:56:07.925 INFO:tasks.workunit.client.0.smithi002.stdout:1/387: chown d1/d13/d1d/d34/f7a 8282559 1 2024-09-13T22:56:07.926 INFO:tasks.workunit.client.1.smithi047.stdout:3/481: mkdir d0/d3/d4/d16/d32/d42/d79/d9c 0 2024-09-13T22:56:07.931 INFO:tasks.workunit.client.1.smithi047.stdout:6/481: rename d3/d11/fa1 to d3/d11/d2b/d1c/d4d/fa6 0 2024-09-13T22:56:07.931 INFO:tasks.workunit.client.1.smithi047.stdout:4/519: dread dc/de/f97 [0,4194304] 0 2024-09-13T22:56:07.933 INFO:tasks.workunit.client.1.smithi047.stdout:2/561: write d1/f1a [6208216,67619] 0 2024-09-13T22:56:07.933 INFO:tasks.workunit.client.0.smithi002.stdout:5/325: creat d1/d2a/d41/d45/d4f/d78/f79 x:0 0 0 2024-09-13T22:56:07.938 INFO:tasks.workunit.client.1.smithi047.stdout:6/482: dwrite d3/d11/d2b/d4c/d30/f37 [0,4194304] 0 2024-09-13T22:56:07.939 INFO:tasks.workunit.client.0.smithi002.stdout:0/352: write d1/d2/f1d [2064238,29619] 0 2024-09-13T22:56:07.941 INFO:tasks.workunit.client.0.smithi002.stdout:5/326: dwrite d1/d2a/d5a/f6d [0,4194304] 0 2024-09-13T22:56:07.943 INFO:tasks.workunit.client.1.smithi047.stdout:9/414: mkdir d1/dc/d18/d82 0 2024-09-13T22:56:07.947 INFO:tasks.workunit.client.0.smithi002.stdout:3/414: truncate d9/d15/d36/d4e/f8b 190624 0 2024-09-13T22:56:07.949 INFO:tasks.workunit.client.1.smithi047.stdout:0/474: dwrite d1/d5/d16/f63 [0,4194304] 0 2024-09-13T22:56:07.951 INFO:tasks.workunit.client.1.smithi047.stdout:0/475: fdatasync d1/d7/f4b 0 2024-09-13T22:56:07.952 INFO:tasks.workunit.client.1.smithi047.stdout:9/415: dread d1/dc/d18/f35 [0,4194304] 0 2024-09-13T22:56:07.954 INFO:tasks.workunit.client.0.smithi002.stdout:8/344: creat d3/f69 x:0 0 0 2024-09-13T22:56:07.959 INFO:tasks.workunit.client.1.smithi047.stdout:4/520: rename dc/de/d17/d25/f7e to dc/d29/d6c/fb1 0 2024-09-13T22:56:07.965 INFO:tasks.workunit.client.0.smithi002.stdout:9/394: link d8/d10/d61/f81 d8/d10/d53/d63/f86 0 2024-09-13T22:56:07.966 INFO:tasks.workunit.client.1.smithi047.stdout:5/403: symlink d19/d23/l89 0 2024-09-13T22:56:07.967 INFO:tasks.workunit.client.1.smithi047.stdout:5/404: write d19/d23/d2e/d41/f51 [533361,45768] 0 2024-09-13T22:56:07.967 INFO:tasks.workunit.client.0.smithi002.stdout:5/327: creat d1/d2a/d41/d55/f7a x:0 0 0 2024-09-13T22:56:07.972 INFO:tasks.workunit.client.1.smithi047.stdout:0/476: dread d1/d5/d16/f3c [0,4194304] 0 2024-09-13T22:56:07.972 INFO:tasks.workunit.client.0.smithi002.stdout:4/333: link d3/d14/d25/d5e/f5f d3/d14/d25/d5e/f64 0 2024-09-13T22:56:07.973 INFO:tasks.workunit.client.0.smithi002.stdout:9/395: dwrite d8/d1e/f41 [0,4194304] 0 2024-09-13T22:56:07.973 INFO:tasks.workunit.client.0.smithi002.stdout:1/388: mkdir d1/d13/d30/d31/d3b/d71/d80 0 2024-09-13T22:56:07.973 INFO:tasks.workunit.client.0.smithi002.stdout:1/389: chown d1/d13/d30/d31/d3d/f48 149 1 2024-09-13T22:56:07.977 INFO:tasks.workunit.client.1.smithi047.stdout:1/426: link d0/d7/db/l7a d0/d7/d75/l7d 0 2024-09-13T22:56:07.979 INFO:tasks.workunit.client.0.smithi002.stdout:0/353: mkdir d1/d7e 0 2024-09-13T22:56:07.984 INFO:tasks.workunit.client.0.smithi002.stdout:0/354: dwrite d1/d2/f6d [0,4194304] 0 2024-09-13T22:56:07.989 INFO:tasks.workunit.client.1.smithi047.stdout:2/562: rename d1/df/f3f to d1/d16/d40/d57/fbe 0 2024-09-13T22:56:07.989 INFO:tasks.workunit.client.1.smithi047.stdout:2/563: dread - d1/df/d26/f9c zero size 2024-09-13T22:56:07.990 INFO:tasks.workunit.client.0.smithi002.stdout:4/334: chown d3/d14/d29/d2a/d30/f58 4 1 2024-09-13T22:56:07.992 INFO:tasks.workunit.client.1.smithi047.stdout:2/564: write d1/df/d1d/d20/d37/fbb [189340,24382] 0 2024-09-13T22:56:07.992 INFO:tasks.workunit.client.1.smithi047.stdout:4/521: unlink dc/de/d23/d40/fa9 0 2024-09-13T22:56:07.994 INFO:tasks.workunit.client.0.smithi002.stdout:9/396: mkdir d8/d10/d53/d63/d87 0 2024-09-13T22:56:07.996 INFO:tasks.workunit.client.0.smithi002.stdout:1/390: symlink d1/d13/d1d/d76/l81 0 2024-09-13T22:56:07.996 INFO:tasks.workunit.client.1.smithi047.stdout:6/483: getdents d3/d11/d2b/d1c/d70/d98 0 2024-09-13T22:56:08.000 INFO:tasks.workunit.client.0.smithi002.stdout:3/415: dwrite d9/f2a [0,4194304] 0 2024-09-13T22:56:08.003 INFO:tasks.workunit.client.0.smithi002.stdout:6/345: link d12/d17/d34/d39/l47 d12/l72 0 2024-09-13T22:56:08.004 INFO:tasks.workunit.client.0.smithi002.stdout:6/346: read d12/d17/f18 [209825,94214] 0 2024-09-13T22:56:08.005 INFO:tasks.workunit.client.0.smithi002.stdout:6/347: chown d12/d17/d2a/c30 5807620 1 2024-09-13T22:56:08.006 INFO:tasks.workunit.client.1.smithi047.stdout:9/416: rename d1/dc/d14/dd/f45 to d1/d2d/f83 0 2024-09-13T22:56:08.006 INFO:tasks.workunit.client.0.smithi002.stdout:7/298: sync 2024-09-13T22:56:08.007 INFO:tasks.workunit.client.0.smithi002.stdout:6/348: write d12/d17/f6e [194153,54792] 0 2024-09-13T22:56:08.007 INFO:tasks.workunit.client.1.smithi047.stdout:9/417: chown d1/dc/d14/dd/l7c 5 1 2024-09-13T22:56:08.009 INFO:tasks.workunit.client.0.smithi002.stdout:0/355: symlink d1/d4/d75/d31/d3c/l7f 0 2024-09-13T22:56:08.010 INFO:tasks.workunit.client.0.smithi002.stdout:0/356: fsync d1/d4/f7 0 2024-09-13T22:56:08.013 INFO:tasks.workunit.client.1.smithi047.stdout:6/484: creat d3/d11/d2b/d4c/d30/fa7 x:0 0 0 2024-09-13T22:56:08.013 INFO:tasks.workunit.client.0.smithi002.stdout:4/335: write d3/d14/f16 [4541867,70524] 0 2024-09-13T22:56:08.016 INFO:tasks.workunit.client.0.smithi002.stdout:1/391: fdatasync d1/d13/f3f 0 2024-09-13T22:56:08.017 INFO:tasks.workunit.client.1.smithi047.stdout:3/482: getdents d0/d25 0 2024-09-13T22:56:08.018 INFO:tasks.workunit.client.0.smithi002.stdout:8/345: mknod d3/dc/d34/c6a 0 2024-09-13T22:56:08.020 INFO:tasks.workunit.client.0.smithi002.stdout:3/416: unlink d9/d15/d26/d44/f75 0 2024-09-13T22:56:08.020 INFO:tasks.workunit.client.0.smithi002.stdout:6/349: dwrite d12/d17/d28/f66 [0,4194304] 0 2024-09-13T22:56:08.021 INFO:tasks.workunit.client.0.smithi002.stdout:7/299: dwrite d8/d10/d11/f2d [0,4194304] 0 2024-09-13T22:56:08.021 INFO:tasks.workunit.client.1.smithi047.stdout:1/427: rename d0/d7/d14/f18 to d0/d7/d14/d71/f7e 0 2024-09-13T22:56:08.021 INFO:tasks.workunit.client.0.smithi002.stdout:5/328: link d1/l58 d1/d2a/d41/d45/d4f/d78/l7b 0 2024-09-13T22:56:08.022 INFO:tasks.workunit.client.0.smithi002.stdout:8/346: chown d3/dc/f42 1799612 1 2024-09-13T22:56:08.024 INFO:tasks.workunit.client.1.smithi047.stdout:2/565: creat d1/df/d35/d8b/fbf x:0 0 0 2024-09-13T22:56:08.024 INFO:tasks.workunit.client.0.smithi002.stdout:8/347: write d3/dc/fe [2231048,65629] 0 2024-09-13T22:56:08.025 INFO:tasks.workunit.client.1.smithi047.stdout:3/483: dread d0/d3/d4/d16/d2c/de/f8c [0,4194304] 0 2024-09-13T22:56:08.029 INFO:tasks.workunit.client.1.smithi047.stdout:5/405: truncate d19/d34/d42/f5b 1459707 0 2024-09-13T22:56:08.030 INFO:tasks.workunit.client.1.smithi047.stdout:5/406: chown d19/d64 3016059 1 2024-09-13T22:56:08.030 INFO:tasks.workunit.client.1.smithi047.stdout:5/407: fdatasync d19/d25/f61 0 2024-09-13T22:56:08.032 INFO:tasks.workunit.client.1.smithi047.stdout:6/485: creat d3/d11/d2b/d1c/fa8 x:0 0 0 2024-09-13T22:56:08.033 INFO:tasks.workunit.client.0.smithi002.stdout:0/357: chown d1/d2/d6c/l7b 3 1 2024-09-13T22:56:08.033 INFO:tasks.workunit.client.0.smithi002.stdout:9/397: symlink d8/d10/d1c/d3d/l88 0 2024-09-13T22:56:08.034 INFO:tasks.workunit.client.0.smithi002.stdout:6/350: dwrite d12/f51 [0,4194304] 0 2024-09-13T22:56:08.036 INFO:tasks.workunit.client.1.smithi047.stdout:9/418: rename d1/dc/d14/dd/d54/l49 to d1/d2d/l84 0 2024-09-13T22:56:08.037 INFO:tasks.workunit.client.0.smithi002.stdout:4/336: fsync d3/d14/d29/d2a/f2d 0 2024-09-13T22:56:08.042 INFO:tasks.workunit.client.1.smithi047.stdout:5/408: symlink d19/d25/l8a 0 2024-09-13T22:56:08.043 INFO:tasks.workunit.client.0.smithi002.stdout:5/329: symlink d1/d2a/d41/d55/d56/l7c 0 2024-09-13T22:56:08.043 INFO:tasks.workunit.client.0.smithi002.stdout:3/417: chown d9/d15/d51/f37 6 1 2024-09-13T22:56:08.044 INFO:tasks.workunit.client.1.smithi047.stdout:6/486: creat d3/d77/fa9 x:0 0 0 2024-09-13T22:56:08.044 INFO:tasks.workunit.client.0.smithi002.stdout:7/300: rmdir d8/d10/d11/d13/d26/d4c 39 2024-09-13T22:56:08.046 INFO:tasks.workunit.client.0.smithi002.stdout:8/348: creat d3/dc/d18/d2e/f6b x:0 0 0 2024-09-13T22:56:08.047 INFO:tasks.workunit.client.1.smithi047.stdout:0/477: getdents d1/d5/d16/d6a/d92 0 2024-09-13T22:56:08.051 INFO:tasks.workunit.client.0.smithi002.stdout:0/358: dread d1/d4/f35 [0,4194304] 0 2024-09-13T22:56:08.051 INFO:tasks.workunit.client.1.smithi047.stdout:6/487: dwrite d3/d77/d93/f9a [0,4194304] 0 2024-09-13T22:56:08.052 INFO:tasks.workunit.client.0.smithi002.stdout:9/398: dwrite d8/f75 [0,4194304] 0 2024-09-13T22:56:08.053 INFO:tasks.workunit.client.1.smithi047.stdout:1/428: mkdir d0/d1d/d7f 0 2024-09-13T22:56:08.054 INFO:tasks.workunit.client.1.smithi047.stdout:1/429: dread - d0/d7/f74 zero size 2024-09-13T22:56:08.054 INFO:tasks.workunit.client.0.smithi002.stdout:7/301: dread d8/d10/d11/d13/f1c [4194304,4194304] 0 2024-09-13T22:56:08.056 INFO:tasks.workunit.client.0.smithi002.stdout:7/302: write d8/d10/f23 [1084862,125413] 0 2024-09-13T22:56:08.057 INFO:tasks.workunit.client.1.smithi047.stdout:2/566: unlink d1/d16/d40/d57/l98 0 2024-09-13T22:56:08.059 INFO:tasks.workunit.client.1.smithi047.stdout:2/567: chown d1/df/d1d/d20/d37/d7a/f84 9 1 2024-09-13T22:56:08.059 INFO:tasks.workunit.client.1.smithi047.stdout:4/522: truncate f4 3643330 0 2024-09-13T22:56:08.063 INFO:tasks.workunit.client.1.smithi047.stdout:3/484: mknod d0/d3/d4/d16/d32/d42/d79/d9c/c9d 0 2024-09-13T22:56:08.066 INFO:tasks.workunit.client.1.smithi047.stdout:6/488: fsync d3/d77/d93/f9a 0 2024-09-13T22:56:08.067 INFO:tasks.workunit.client.0.smithi002.stdout:6/351: rmdir d12/d17/d28/d67/d6b 39 2024-09-13T22:56:08.071 INFO:tasks.workunit.client.1.smithi047.stdout:3/485: dwrite d0/d3/d4/d16/d2c/de/f80 [0,4194304] 0 2024-09-13T22:56:08.071 INFO:tasks.workunit.client.0.smithi002.stdout:4/337: creat d3/d14/d25/d5e/f65 x:0 0 0 2024-09-13T22:56:08.073 INFO:tasks.workunit.client.1.smithi047.stdout:0/478: rename d1/d5/d16/d47/f9b to d1/d5/d16/d23/d77/fa6 0 2024-09-13T22:56:08.076 INFO:tasks.workunit.client.0.smithi002.stdout:5/330: readlink d1/d10/l25 0 2024-09-13T22:56:08.079 INFO:tasks.workunit.client.1.smithi047.stdout:1/430: creat d0/d7/f80 x:0 0 0 2024-09-13T22:56:08.082 INFO:tasks.workunit.client.1.smithi047.stdout:7/512: sync 2024-09-13T22:56:08.084 INFO:tasks.workunit.client.0.smithi002.stdout:1/392: dwrite d1/d13/d1d/d34/f35 [0,4194304] 0 2024-09-13T22:56:08.086 INFO:tasks.workunit.client.0.smithi002.stdout:3/418: rename d9/d15/d26/d44 to d9/d15/d26/d93 0 2024-09-13T22:56:08.086 INFO:tasks.workunit.client.1.smithi047.stdout:4/523: dwrite dc/de/d23/f83 [0,4194304] 0 2024-09-13T22:56:08.086 INFO:tasks.workunit.client.1.smithi047.stdout:5/409: truncate d19/d25/d45/f60 1294523 0 2024-09-13T22:56:08.087 INFO:tasks.workunit.client.1.smithi047.stdout:5/410: dread - d19/d23/d4c/f67 zero size 2024-09-13T22:56:08.088 INFO:tasks.workunit.client.1.smithi047.stdout:5/411: chown l8 1 1 2024-09-13T22:56:08.089 INFO:tasks.workunit.client.0.smithi002.stdout:5/331: dwrite d1/d2a/d41/f74 [0,4194304] 0 2024-09-13T22:56:08.089 INFO:tasks.workunit.client.0.smithi002.stdout:1/393: dread - d1/d1c/d7d/f7f zero size 2024-09-13T22:56:08.089 INFO:tasks.workunit.client.0.smithi002.stdout:0/359: creat d1/d4/d75/d31/d3c/f80 x:0 0 0 2024-09-13T22:56:08.090 INFO:tasks.workunit.client.1.smithi047.stdout:6/489: mknod d3/d11/d2b/d4c/d30/caa 0 2024-09-13T22:56:08.091 INFO:tasks.workunit.client.0.smithi002.stdout:5/332: fdatasync d1/d10/f32 0 2024-09-13T22:56:08.095 INFO:tasks.workunit.client.1.smithi047.stdout:3/486: creat d0/d3/d4/d16/d32/d42/f9e x:0 0 0 2024-09-13T22:56:08.099 INFO:tasks.workunit.client.0.smithi002.stdout:7/303: mkdir d8/d10/d11/d13/d2e/d50 0 2024-09-13T22:56:08.100 INFO:tasks.workunit.client.0.smithi002.stdout:1/394: dread d1/ff [0,4194304] 0 2024-09-13T22:56:08.100 INFO:tasks.workunit.client.0.smithi002.stdout:7/304: stat d8/d10/f2a 0 2024-09-13T22:56:08.105 INFO:tasks.workunit.client.0.smithi002.stdout:4/338: mkdir d3/d40/d45/d66 0 2024-09-13T22:56:08.107 INFO:tasks.workunit.client.1.smithi047.stdout:1/431: read d0/d1d/f2c [2678074,40903] 0 2024-09-13T22:56:08.108 INFO:tasks.workunit.client.1.smithi047.stdout:1/432: readlink d0/d7/d14/l40 0 2024-09-13T22:56:08.109 INFO:tasks.workunit.client.1.smithi047.stdout:7/513: symlink d0/d57/d5b/lae 0 2024-09-13T22:56:08.111 INFO:tasks.workunit.client.1.smithi047.stdout:5/412: mknod d19/d23/d2e/d41/c8b 0 2024-09-13T22:56:08.112 INFO:tasks.workunit.client.1.smithi047.stdout:5/413: truncate d19/d34/d42/f88 626482 0 2024-09-13T22:56:08.113 INFO:tasks.workunit.client.1.smithi047.stdout:5/414: write d19/d23/d2e/d41/f51 [4449342,78358] 0 2024-09-13T22:56:08.114 INFO:tasks.workunit.client.1.smithi047.stdout:3/487: fdatasync d0/d3/d4/f9 0 2024-09-13T22:56:08.120 INFO:tasks.workunit.client.0.smithi002.stdout:5/333: creat d1/d2a/f7d x:0 0 0 2024-09-13T22:56:08.124 INFO:tasks.workunit.client.1.smithi047.stdout:7/514: write d0/d7/f2c [489643,2395] 0 2024-09-13T22:56:08.127 INFO:tasks.workunit.client.0.smithi002.stdout:5/334: dwrite d1/d2a/d69/f73 [0,4194304] 0 2024-09-13T22:56:08.130 INFO:tasks.workunit.client.0.smithi002.stdout:8/349: creat d3/dc/d16/d4b/f6c x:0 0 0 2024-09-13T22:56:08.131 INFO:tasks.workunit.client.0.smithi002.stdout:0/360: mkdir d1/d2/d81 0 2024-09-13T22:56:08.131 INFO:tasks.workunit.client.0.smithi002.stdout:3/419: dread d9/d15/d26/f29 [0,4194304] 0 2024-09-13T22:56:08.131 INFO:tasks.workunit.client.0.smithi002.stdout:0/361: write d1/d4/f7 [6409395,26742] 0 2024-09-13T22:56:08.134 INFO:tasks.workunit.client.0.smithi002.stdout:1/395: link d1/d1c/f4c d1/d13/d1d/d34/d51/f82 0 2024-09-13T22:56:08.135 INFO:tasks.workunit.client.0.smithi002.stdout:1/396: dread - d1/d13/d1d/d34/f6b zero size 2024-09-13T22:56:08.137 INFO:tasks.workunit.client.0.smithi002.stdout:4/339: write d3/fb [1599626,123409] 0 2024-09-13T22:56:08.138 INFO:tasks.workunit.client.1.smithi047.stdout:2/568: rename d1/df/d1d/d20/d29/c44 to d1/d16/d40/cc0 0 2024-09-13T22:56:08.140 INFO:tasks.workunit.client.0.smithi002.stdout:6/352: creat d12/d17/d34/f73 x:0 0 0 2024-09-13T22:56:08.141 INFO:tasks.workunit.client.0.smithi002.stdout:5/335: unlink d1/f12 0 2024-09-13T22:56:08.141 INFO:tasks.workunit.client.1.smithi047.stdout:9/419: link d1/dc/f43 d1/dc/d14/dd/f85 0 2024-09-13T22:56:08.142 INFO:tasks.workunit.client.1.smithi047.stdout:9/420: readlink d1/la 0 2024-09-13T22:56:08.142 INFO:tasks.workunit.client.0.smithi002.stdout:5/336: write d1/d2a/d5a/f62 [225588,121869] 0 2024-09-13T22:56:08.143 INFO:tasks.workunit.client.0.smithi002.stdout:8/350: mknod d3/d21/c6d 0 2024-09-13T22:56:08.144 INFO:tasks.workunit.client.0.smithi002.stdout:8/351: chown d3/dc/f42 349877 1 2024-09-13T22:56:08.145 INFO:tasks.workunit.client.0.smithi002.stdout:3/420: mknod d9/d15/d35/c94 0 2024-09-13T22:56:08.145 INFO:tasks.workunit.client.1.smithi047.stdout:4/524: creat dc/de/fb2 x:0 0 0 2024-09-13T22:56:08.146 INFO:tasks.workunit.client.1.smithi047.stdout:4/525: write fb [3992844,98025] 0 2024-09-13T22:56:08.150 INFO:tasks.workunit.client.1.smithi047.stdout:3/488: symlink d0/d25/d95/l9f 0 2024-09-13T22:56:08.153 INFO:tasks.workunit.client.0.smithi002.stdout:4/340: readlink d3/d14/l47 0 2024-09-13T22:56:08.155 INFO:tasks.workunit.client.1.smithi047.stdout:2/569: rmdir d1/de/d17 39 2024-09-13T22:56:08.157 INFO:tasks.workunit.client.1.smithi047.stdout:1/433: write d0/d7/db/f3a [1938036,6351] 0 2024-09-13T22:56:08.158 INFO:tasks.workunit.client.1.smithi047.stdout:0/479: getdents d1/d5/d16/d23/d45/d7f 0 2024-09-13T22:56:08.160 INFO:tasks.workunit.client.0.smithi002.stdout:5/337: symlink d1/d2a/d69/l7e 0 2024-09-13T22:56:08.160 INFO:tasks.workunit.client.0.smithi002.stdout:5/338: chown d1/fe 3432710 1 2024-09-13T22:56:08.161 INFO:tasks.workunit.client.0.smithi002.stdout:2/352: sync 2024-09-13T22:56:08.162 INFO:tasks.workunit.client.0.smithi002.stdout:3/421: mkdir d9/d3b/d53/d95 0 2024-09-13T22:56:08.163 INFO:tasks.workunit.client.0.smithi002.stdout:0/362: mknod d1/d2/c82 0 2024-09-13T22:56:08.164 INFO:tasks.workunit.client.0.smithi002.stdout:7/305: write d8/d10/d11/d13/d26/d4c/f4e [300062,70426] 0 2024-09-13T22:56:08.167 INFO:tasks.workunit.client.1.smithi047.stdout:3/489: truncate d0/d3/d4/d16/d1c/f82 806936 0 2024-09-13T22:56:08.168 INFO:tasks.workunit.client.1.smithi047.stdout:6/490: rename d3/d11/c16 to d3/d11/d2b/d4c/d9d/cab 0 2024-09-13T22:56:08.169 INFO:tasks.workunit.client.1.smithi047.stdout:3/490: chown d0/d3/d4/d16/d32/d76/f7f 12018612 1 2024-09-13T22:56:08.171 INFO:tasks.workunit.client.1.smithi047.stdout:4/526: dwrite dc/d29/d6c/fb1 [4194304,4194304] 0 2024-09-13T22:56:08.172 INFO:tasks.workunit.client.1.smithi047.stdout:3/491: read d0/d25/d44/f27 [1358216,55876] 0 2024-09-13T22:56:08.173 INFO:tasks.workunit.client.1.smithi047.stdout:1/434: dread d0/d7/d13/f42 [0,4194304] 0 2024-09-13T22:56:08.173 INFO:tasks.workunit.client.0.smithi002.stdout:3/422: creat d9/d15/d35/f96 x:0 0 0 2024-09-13T22:56:08.174 INFO:tasks.workunit.client.1.smithi047.stdout:0/480: symlink d1/d5/d16/d23/d45/d7f/la7 0 2024-09-13T22:56:08.175 INFO:tasks.workunit.client.1.smithi047.stdout:4/527: chown dc/de/d17/f1b 19754893 1 2024-09-13T22:56:08.177 INFO:tasks.workunit.client.1.smithi047.stdout:0/481: dread - d1/d5/d16/d6a/d92/fa2 zero size 2024-09-13T22:56:08.179 INFO:tasks.workunit.client.1.smithi047.stdout:5/415: rename d19/d25/d45/f47 to d19/d34/d42/d5d/f8c 0 2024-09-13T22:56:08.183 INFO:tasks.workunit.client.0.smithi002.stdout:0/363: dwrite d1/d2/f19 [4194304,4194304] 0 2024-09-13T22:56:08.184 INFO:tasks.workunit.client.0.smithi002.stdout:0/364: fdatasync d1/d4/d75/d31/f65 0 2024-09-13T22:56:08.185 INFO:tasks.workunit.client.1.smithi047.stdout:6/491: mkdir d3/d11/d2b/d4c/d9d/dac 0 2024-09-13T22:56:08.185 INFO:tasks.workunit.client.0.smithi002.stdout:1/397: rename d1/d13/d1d/d34/d51/c5f to d1/d13/d21/c83 0 2024-09-13T22:56:08.186 INFO:tasks.workunit.client.1.smithi047.stdout:5/416: dwrite d19/d23/d2e/d41/f51 [0,4194304] 0 2024-09-13T22:56:08.186 INFO:tasks.workunit.client.1.smithi047.stdout:6/492: readlink d3/d11/d2b/d1c/l88 0 2024-09-13T22:56:08.187 INFO:tasks.workunit.client.1.smithi047.stdout:7/515: link d0/db/f50 d0/faf 0 2024-09-13T22:56:08.187 INFO:tasks.workunit.client.1.smithi047.stdout:6/493: readlink d3/d77/l8c 0 2024-09-13T22:56:08.190 INFO:tasks.workunit.client.1.smithi047.stdout:7/516: write d0/f29 [494502,93576] 0 2024-09-13T22:56:08.191 INFO:tasks.workunit.client.0.smithi002.stdout:2/353: link d1/d7/d8/f27 d1/d4d/f71 0 2024-09-13T22:56:08.192 INFO:tasks.workunit.client.1.smithi047.stdout:2/570: dread d1/df/d26/d4b/f5a [4194304,4194304] 0 2024-09-13T22:56:08.194 INFO:tasks.workunit.client.0.smithi002.stdout:7/306: truncate d8/fb 717748 0 2024-09-13T22:56:08.196 INFO:tasks.workunit.client.1.smithi047.stdout:7/517: chown d0/d7/da/d47/l7d 826 1 2024-09-13T22:56:08.198 INFO:tasks.workunit.client.1.smithi047.stdout:3/492: rename d0/d3/d4/d16/d32/d76/f7f to d0/d25/d44/d43/d85/fa0 0 2024-09-13T22:56:08.199 INFO:tasks.workunit.client.0.smithi002.stdout:0/365: symlink d1/d2/d49/l83 0 2024-09-13T22:56:08.200 INFO:tasks.workunit.client.1.smithi047.stdout:1/435: dwrite d0/d7/db/f6b [0,4194304] 0 2024-09-13T22:56:08.200 INFO:tasks.workunit.client.0.smithi002.stdout:6/353: getdents d12/d17/d4e 0 2024-09-13T22:56:08.205 INFO:tasks.workunit.client.0.smithi002.stdout:1/398: unlink d1/f57 0 2024-09-13T22:56:08.207 INFO:tasks.workunit.client.0.smithi002.stdout:0/366: dwrite d1/f5f [0,4194304] 0 2024-09-13T22:56:08.210 INFO:tasks.workunit.client.0.smithi002.stdout:4/341: rename d3/d14/d29/d2a/c46 to d3/d14/d29/d2a/d30/c67 0 2024-09-13T22:56:08.210 INFO:tasks.workunit.client.0.smithi002.stdout:3/423: dread d9/d15/d36/f38 [0,4194304] 0 2024-09-13T22:56:08.218 INFO:tasks.workunit.client.0.smithi002.stdout:2/354: mknod d1/d7/d8/d51/c72 0 2024-09-13T22:56:08.220 INFO:tasks.workunit.client.1.smithi047.stdout:2/571: dread d1/df/d1d/d20/f2c [0,4194304] 0 2024-09-13T22:56:08.222 INFO:tasks.workunit.client.1.smithi047.stdout:5/417: dwrite d19/d34/d42/d5d/f8c [0,4194304] 0 2024-09-13T22:56:08.223 INFO:tasks.workunit.client.1.smithi047.stdout:6/494: dread d3/d11/d2b/d1c/d70/f75 [0,4194304] 0 2024-09-13T22:56:08.233 INFO:tasks.workunit.client.1.smithi047.stdout:7/518: fsync d0/d19/f77 0 2024-09-13T22:56:08.234 INFO:tasks.workunit.client.0.smithi002.stdout:1/399: mknod d1/d13/d1d/d34/d51/c84 0 2024-09-13T22:56:08.235 INFO:tasks.workunit.client.1.smithi047.stdout:1/436: unlink d0/d7/f37 0 2024-09-13T22:56:08.237 INFO:tasks.workunit.client.0.smithi002.stdout:0/367: creat d1/d2/d6c/f84 x:0 0 0 2024-09-13T22:56:08.238 INFO:tasks.workunit.client.1.smithi047.stdout:1/437: read - d0/d7/d13/d2d/f59 zero size 2024-09-13T22:56:08.238 INFO:tasks.workunit.client.0.smithi002.stdout:0/368: write d1/d2/f4f [82516,89746] 0 2024-09-13T22:56:08.241 INFO:tasks.workunit.client.1.smithi047.stdout:7/519: dwrite d0/d7/da/d1e/d51/fa3 [0,4194304] 0 2024-09-13T22:56:08.242 INFO:tasks.workunit.client.0.smithi002.stdout:5/339: getdents d1/d2a/d41/d55/d56 0 2024-09-13T22:56:08.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.242+0000 7f7b48b77700 1 -- 172.21.15.2:0/200040352 --> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b44106890 con 0x7f7b2c06d530 2024-09-13T22:56:08.243 INFO:tasks.workunit.client.0.smithi002.stdout:5/340: stat d1/d57 0 2024-09-13T22:56:08.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.244+0000 7f7b337fe700 1 -- 172.21.15.2:0/200040352 <== mgr.14590 v2:172.21.15.47:6828/1914885837 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f7b44106890 con 0x7f7b2c06d530 2024-09-13T22:56:08.246 INFO:tasks.workunit.client.0.smithi002.stdout:2/355: chown d1/l25 14445605 1 2024-09-13T22:56:08.248 INFO:tasks.workunit.client.0.smithi002.stdout:4/342: dwrite d3/d14/d29/d2a/f63 [0,4194304] 0 2024-09-13T22:56:08.250 INFO:tasks.workunit.client.1.smithi047.stdout:4/528: rename dc/de/c98 to dc/de/d23/d40/d7b/dab/cb3 0 2024-09-13T22:56:08.250 INFO:tasks.workunit.client.0.smithi002.stdout:4/343: write d3/f2f [3159228,28190] 0 2024-09-13T22:56:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.250+0000 7f7b48b77700 1 -- 172.21.15.2:0/200040352 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f7b2c06d530 msgr2=0x7f7b2c06f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.250+0000 7f7b48b77700 1 --2- 172.21.15.2:0/200040352 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f7b2c06d530 0x7f7b2c06f9f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7b38005fd0 tx=0x7f7b38009310 comp rx=0 tx=0).stop 2024-09-13T22:56:08.251 INFO:tasks.workunit.client.0.smithi002.stdout:1/400: mknod d1/d13/d30/d31/d3b/c85 0 2024-09-13T22:56:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.250+0000 7f7b48b77700 1 -- 172.21.15.2:0/200040352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b440fef60 msgr2=0x7f7b44196500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.250+0000 7f7b48b77700 1 --2- 172.21.15.2:0/200040352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b440fef60 0x7f7b44196500 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009230 tx=0x7f7b3400f740 comp rx=0 tx=0).stop 2024-09-13T22:56:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.250+0000 7f7b48b77700 1 -- 172.21.15.2:0/200040352 shutdown_connections 2024-09-13T22:56:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.251+0000 7f7b48b77700 1 --2- 172.21.15.2:0/200040352 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f7b2c06d530 0x7f7b2c06f9f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.251+0000 7f7b48b77700 1 --2- 172.21.15.2:0/200040352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b440fef60 0x7f7b44196500 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.251+0000 7f7b48b77700 1 --2- 172.21.15.2:0/200040352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b44101f40 0x7f7b44196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.251+0000 7f7b48b77700 1 -- 172.21.15.2:0/200040352 >> 172.21.15.2:0/200040352 conn(0x7f7b440fa8c0 msgr2=0x7f7b44105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.251+0000 7f7b48b77700 1 -- 172.21.15.2:0/200040352 shutdown_connections 2024-09-13T22:56:08.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.251+0000 7f7b48b77700 1 -- 172.21.15.2:0/200040352 wait complete. 2024-09-13T22:56:08.253 INFO:tasks.workunit.client.0.smithi002.stdout:0/369: chown d1/d4/d75/l52 3 1 2024-09-13T22:56:08.253 INFO:tasks.workunit.client.0.smithi002.stdout:1/401: dread - d1/d13/f68 zero size 2024-09-13T22:56:08.254 INFO:tasks.workunit.client.0.smithi002.stdout:3/424: creat d9/d91/f97 x:0 0 0 2024-09-13T22:56:08.254 INFO:tasks.workunit.client.1.smithi047.stdout:1/438: dread d0/d7/d13/f56 [0,4194304] 0 2024-09-13T22:56:08.257 INFO:tasks.workunit.client.0.smithi002.stdout:3/425: readlink d9/d15/d51/l45 0 2024-09-13T22:56:08.258 INFO:tasks.workunit.client.0.smithi002.stdout:1/402: readlink d1/d13/d30/d31/d3d/d5d/l42 0 2024-09-13T22:56:08.259 INFO:tasks.workunit.client.0.smithi002.stdout:5/341: dwrite d1/d2a/d41/f74 [4194304,4194304] 0 2024-09-13T22:56:08.259 INFO:tasks.workunit.client.0.smithi002.stdout:7/307: rmdir d8/d10/d11/d3a/d44 0 2024-09-13T22:56:08.261 INFO:tasks.workunit.client.0.smithi002.stdout:9/399: sync 2024-09-13T22:56:08.262 INFO:tasks.workunit.client.1.smithi047.stdout:2/572: fdatasync d1/d16/f6a 0 2024-09-13T22:56:08.262 INFO:tasks.workunit.client.0.smithi002.stdout:1/403: write d1/d13/f68 [174378,25616] 0 2024-09-13T22:56:08.264 INFO:tasks.workunit.client.1.smithi047.stdout:5/418: unlink d19/d23/d2e/d41/l84 0 2024-09-13T22:56:08.266 INFO:tasks.workunit.client.0.smithi002.stdout:3/426: truncate d9/d15/d35/f96 774989 0 2024-09-13T22:56:08.266 INFO:tasks.workunit.client.0.smithi002.stdout:6/354: creat d12/f74 x:0 0 0 2024-09-13T22:56:08.271 INFO:tasks.workunit.client.1.smithi047.stdout:0/482: rename d1/d5/d11/c87 to d1/d7/ca8 0 2024-09-13T22:56:08.271 INFO:tasks.workunit.client.0.smithi002.stdout:9/400: chown d8/d10/d1c/d3d/l82 3984059 1 2024-09-13T22:56:08.272 INFO:tasks.workunit.client.1.smithi047.stdout:6/495: dwrite d3/d11/d2b/f6f [0,4194304] 0 2024-09-13T22:56:08.272 INFO:tasks.workunit.client.0.smithi002.stdout:4/344: dwrite d3/f3d [0,4194304] 0 2024-09-13T22:56:08.273 INFO:tasks.workunit.client.0.smithi002.stdout:0/370: creat d1/d4/d75/d76/f85 x:0 0 0 2024-09-13T22:56:08.277 INFO:tasks.workunit.client.0.smithi002.stdout:2/356: dwrite d1/d7/f68 [0,4194304] 0 2024-09-13T22:56:08.277 INFO:tasks.workunit.client.0.smithi002.stdout:0/371: chown d1/d2/f18 2373326 1 2024-09-13T22:56:08.278 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T22:56:08.279 INFO:tasks.workunit.client.0.smithi002.stdout:5/342: dwrite d1/d10/f50 [4194304,4194304] 0 2024-09-13T22:56:08.279 INFO:tasks.workunit.client.1.smithi047.stdout:3/493: link d0/c48 d0/d25/d44/d43/d3a/d81/ca1 0 2024-09-13T22:56:08.279 INFO:tasks.workunit.client.0.smithi002.stdout:0/372: dread - d1/d4/d75/f2c zero size 2024-09-13T22:56:08.282 INFO:tasks.workunit.client.0.smithi002.stdout:6/355: stat d12/d17/d28/f2f 0 2024-09-13T22:56:08.285 INFO:tasks.workunit.client.0.smithi002.stdout:3/427: mkdir d9/d15/d51/d98 0 2024-09-13T22:56:08.290 INFO:tasks.workunit.client.1.smithi047.stdout:2/573: rmdir d1/d16 39 2024-09-13T22:56:08.291 INFO:tasks.workunit.client.0.smithi002.stdout:9/401: rmdir d8 39 2024-09-13T22:56:08.292 INFO:tasks.workunit.client.0.smithi002.stdout:4/345: symlink d3/d40/d45/l68 0 2024-09-13T22:56:08.296 INFO:tasks.workunit.client.1.smithi047.stdout:2/574: dwrite d1/f1a [4194304,4194304] 0 2024-09-13T22:56:08.296 INFO:tasks.workunit.client.1.smithi047.stdout:6/496: creat d3/d11/d2b/d4c/d30/d48/fad x:0 0 0 2024-09-13T22:56:08.297 INFO:tasks.workunit.client.0.smithi002.stdout:0/373: creat d1/d2/d49/f86 x:0 0 0 2024-09-13T22:56:08.297 INFO:tasks.workunit.client.1.smithi047.stdout:1/439: mknod d0/d7/d14/d57/d72/c81 0 2024-09-13T22:56:08.298 INFO:tasks.workunit.client.1.smithi047.stdout:3/494: symlink d0/d25/d44/d43/d3a/la2 0 2024-09-13T22:56:08.309 INFO:tasks.workunit.client.1.smithi047.stdout:0/483: mkdir d1/d5/d91/da9 0 2024-09-13T22:56:08.310 INFO:tasks.workunit.client.0.smithi002.stdout:4/346: mkdir d3/d14/d25/d69 0 2024-09-13T22:56:08.311 INFO:tasks.workunit.client.0.smithi002.stdout:4/347: write d3/d14/d25/d5e/f65 [54522,62874] 0 2024-09-13T22:56:08.313 INFO:tasks.workunit.client.0.smithi002.stdout:7/308: write d8/d9/f19 [4542013,126004] 0 2024-09-13T22:56:08.314 INFO:tasks.workunit.client.1.smithi047.stdout:6/497: symlink d3/d11/d2b/d4c/d9d/lae 0 2024-09-13T22:56:08.316 INFO:tasks.workunit.client.1.smithi047.stdout:1/440: write d0/d7/d10/f6c [2199349,96801] 0 2024-09-13T22:56:08.317 INFO:tasks.workunit.client.1.smithi047.stdout:5/419: write d19/d25/d45/f4e [2740192,76674] 0 2024-09-13T22:56:08.319 INFO:tasks.workunit.client.1.smithi047.stdout:3/495: mkdir d0/d25/da3 0 2024-09-13T22:56:08.319 INFO:tasks.workunit.client.1.smithi047.stdout:1/441: dread - d0/d7/d13/d5d/f6a zero size 2024-09-13T22:56:08.320 INFO:tasks.workunit.client.0.smithi002.stdout:3/428: mknod d9/c99 0 2024-09-13T22:56:08.322 INFO:tasks.workunit.client.1.smithi047.stdout:7/520: dwrite d0/faf [0,4194304] 0 2024-09-13T22:56:08.323 INFO:tasks.workunit.client.0.smithi002.stdout:9/402: symlink d8/d10/d53/l89 0 2024-09-13T22:56:08.326 INFO:tasks.workunit.client.0.smithi002.stdout:1/404: rename d1/d13/d1d/d76 to d1/d13/d30/d31/d86 0 2024-09-13T22:56:08.327 INFO:tasks.workunit.client.1.smithi047.stdout:6/498: mkdir d3/d11/d2b/d76/daf 0 2024-09-13T22:56:08.328 INFO:tasks.workunit.client.0.smithi002.stdout:1/405: write d1/d13/d21/d39/f77 [1000465,124931] 0 2024-09-13T22:56:08.328 INFO:tasks.workunit.client.1.smithi047.stdout:6/499: read - d3/d77/d93/fa3 zero size 2024-09-13T22:56:08.329 INFO:tasks.workunit.client.0.smithi002.stdout:4/348: write d3/d14/f1a [446877,68464] 0 2024-09-13T22:56:08.331 INFO:tasks.workunit.client.0.smithi002.stdout:2/357: truncate d1/d7/d8/d2c/f39 4068223 0 2024-09-13T22:56:08.331 INFO:tasks.workunit.client.0.smithi002.stdout:8/352: sync 2024-09-13T22:56:08.332 INFO:tasks.workunit.client.0.smithi002.stdout:4/349: read d3/d14/d25/f28 [270225,123465] 0 2024-09-13T22:56:08.332 INFO:tasks.workunit.client.0.smithi002.stdout:7/309: mkdir d8/d9/d51 0 2024-09-13T22:56:08.336 INFO:tasks.workunit.client.0.smithi002.stdout:4/350: read d3/d14/d29/d2a/f2d [187203,34939] 0 2024-09-13T22:56:08.337 INFO:tasks.workunit.client.0.smithi002.stdout:3/429: mknod d9/df/c9a 0 2024-09-13T22:56:08.338 INFO:tasks.workunit.client.1.smithi047.stdout:1/442: fsync d0/d1d/f2e 0 2024-09-13T22:56:08.339 INFO:tasks.workunit.client.0.smithi002.stdout:4/351: readlink d3/d14/d29/l3c 0 2024-09-13T22:56:08.339 INFO:tasks.workunit.client.0.smithi002.stdout:9/403: creat d8/d10/d1c/d68/d84/f8a x:0 0 0 2024-09-13T22:56:08.341 INFO:tasks.workunit.client.0.smithi002.stdout:4/352: chown d3/d40/d45/c48 78916 1 2024-09-13T22:56:08.342 INFO:tasks.workunit.client.0.smithi002.stdout:2/358: dwrite d1/d7/d8/d2c/f2d [0,4194304] 0 2024-09-13T22:56:08.342 INFO:tasks.workunit.client.0.smithi002.stdout:0/374: rename d1/d4/d75/l52 to d1/d2/d81/l87 0 2024-09-13T22:56:08.343 INFO:tasks.workunit.client.1.smithi047.stdout:2/575: link d1/d16/d40/d57/db0/fb7 d1/df/d26/d9f/fc1 0 2024-09-13T22:56:08.343 INFO:tasks.workunit.client.0.smithi002.stdout:2/359: chown d1/d7/d8/l20 40 1 2024-09-13T22:56:08.344 INFO:tasks.workunit.client.0.smithi002.stdout:1/406: readlink d1/d13/d1d/l64 0 2024-09-13T22:56:08.346 INFO:tasks.workunit.client.1.smithi047.stdout:6/500: creat d3/d2c/fb0 x:0 0 0 2024-09-13T22:56:08.348 INFO:tasks.workunit.client.1.smithi047.stdout:6/501: chown d3/f26 108957 1 2024-09-13T22:56:08.349 INFO:tasks.workunit.client.0.smithi002.stdout:4/353: dread d3/d40/f4e [0,4194304] 0 2024-09-13T22:56:08.349 INFO:tasks.workunit.client.0.smithi002.stdout:2/360: truncate d1/d7/d8/d51/f5a 151970 0 2024-09-13T22:56:08.351 INFO:tasks.workunit.client.1.smithi047.stdout:0/484: dwrite d1/d5/d16/d23/d2d/f5e [0,4194304] 0 2024-09-13T22:56:08.351 INFO:tasks.workunit.client.1.smithi047.stdout:5/420: creat d19/d34/d6c/f8d x:0 0 0 2024-09-13T22:56:08.352 INFO:tasks.workunit.client.0.smithi002.stdout:4/354: write d3/d14/d25/f61 [943906,93289] 0 2024-09-13T22:56:08.352 INFO:tasks.workunit.client.1.smithi047.stdout:2/576: dread d1/d16/d40/d57/db0/fb7 [0,4194304] 0 2024-09-13T22:56:08.352 INFO:tasks.workunit.client.1.smithi047.stdout:0/485: chown d1/d5/d91 322396 1 2024-09-13T22:56:08.353 INFO:tasks.workunit.client.1.smithi047.stdout:0/486: dread - d1/d5/d16/f94 zero size 2024-09-13T22:56:08.354 INFO:tasks.workunit.client.1.smithi047.stdout:2/577: stat d1/df/d35/f45 0 2024-09-13T22:56:08.354 INFO:tasks.workunit.client.1.smithi047.stdout:0/487: dread - d1/d5/d11/d2f/f8d zero size 2024-09-13T22:56:08.355 INFO:tasks.workunit.client.0.smithi002.stdout:6/356: getdents d12/d17/d34/d4b 0 2024-09-13T22:56:08.356 INFO:tasks.workunit.client.1.smithi047.stdout:0/488: fdatasync d1/d7/f3e 0 2024-09-13T22:56:08.357 INFO:tasks.workunit.client.1.smithi047.stdout:0/489: stat d1/f40 0 2024-09-13T22:56:08.359 INFO:tasks.workunit.client.1.smithi047.stdout:0/490: write d1/d5/d16/d47/f93 [638244,123234] 0 2024-09-13T22:56:08.359 INFO:tasks.workunit.client.0.smithi002.stdout:8/353: dwrite d3/f4f [0,4194304] 0 2024-09-13T22:56:08.359 INFO:tasks.workunit.client.0.smithi002.stdout:5/343: getdents d1/d2a/d6b 0 2024-09-13T22:56:08.362 INFO:tasks.workunit.client.0.smithi002.stdout:8/354: write d3/dc/d18/f5a [3669293,50765] 0 2024-09-13T22:56:08.368 INFO:tasks.workunit.client.0.smithi002.stdout:0/375: dread d1/d4/f7 [4194304,4194304] 0 2024-09-13T22:56:08.370 INFO:tasks.workunit.client.1.smithi047.stdout:5/421: dread d19/f36 [0,4194304] 0 2024-09-13T22:56:08.371 INFO:tasks.workunit.client.0.smithi002.stdout:9/404: creat d8/d10/d53/d63/f8b x:0 0 0 2024-09-13T22:56:08.378 INFO:tasks.workunit.client.0.smithi002.stdout:2/361: creat d1/d32/d37/f73 x:0 0 0 2024-09-13T22:56:08.382 INFO:tasks.workunit.client.0.smithi002.stdout:7/310: mkdir d8/d10/d11/d13/d2e/d50/d52 0 2024-09-13T22:56:08.383 INFO:tasks.workunit.client.0.smithi002.stdout:7/311: fdatasync d8/d9/f40 0 2024-09-13T22:56:08.383 INFO:tasks.workunit.client.0.smithi002.stdout:7/312: chown d8/l30 0 1 2024-09-13T22:56:08.384 INFO:tasks.workunit.client.0.smithi002.stdout:5/344: rename d1/d2a/d41/d45/d4f/c52 to d1/d57/c7f 0 2024-09-13T22:56:08.385 INFO:tasks.workunit.client.0.smithi002.stdout:8/355: truncate d3/dc/d16/f4d 1016588 0 2024-09-13T22:56:08.393 INFO:tasks.workunit.client.0.smithi002.stdout:6/357: write d12/f63 [4669191,49873] 0 2024-09-13T22:56:08.395 INFO:tasks.workunit.client.0.smithi002.stdout:6/358: truncate d12/d17/f6e 858546 0 2024-09-13T22:56:08.398 INFO:tasks.workunit.client.0.smithi002.stdout:2/362: creat d1/d4d/f74 x:0 0 0 2024-09-13T22:56:08.400 INFO:tasks.workunit.client.1.smithi047.stdout:1/443: fdatasync d0/d7/f4e 0 2024-09-13T22:56:08.401 INFO:tasks.workunit.client.1.smithi047.stdout:1/444: chown d0/d7/d13/d5d/f6a 57 1 2024-09-13T22:56:08.401 INFO:tasks.workunit.client.1.smithi047.stdout:1/445: fsync d0/d7/d13/f3c 0 2024-09-13T22:56:08.402 INFO:tasks.workunit.client.0.smithi002.stdout:3/430: truncate d9/d15/f42 2776639 0 2024-09-13T22:56:08.403 INFO:tasks.workunit.client.1.smithi047.stdout:3/496: write d0/d25/d44/d43/f30 [5347894,45471] 0 2024-09-13T22:56:08.404 INFO:tasks.workunit.client.0.smithi002.stdout:3/431: write d9/d15/d46/f5f [553147,66405] 0 2024-09-13T22:56:08.404 INFO:tasks.workunit.client.0.smithi002.stdout:5/345: mknod d1/d2a/d41/d55/c80 0 2024-09-13T22:56:08.404 INFO:tasks.workunit.client.0.smithi002.stdout:7/313: dread f1 [0,4194304] 0 2024-09-13T22:56:08.405 INFO:tasks.workunit.client.0.smithi002.stdout:7/314: stat d8/d9/d51 0 2024-09-13T22:56:08.406 INFO:tasks.workunit.client.0.smithi002.stdout:5/346: truncate d1/d2a/d41/f46 5197357 0 2024-09-13T22:56:08.407 INFO:tasks.workunit.client.0.smithi002.stdout:8/356: mkdir d3/dc/d51/d6e 0 2024-09-13T22:56:08.408 INFO:tasks.workunit.client.0.smithi002.stdout:7/315: write d8/d9/f19 [2050222,30922] 0 2024-09-13T22:56:08.409 INFO:tasks.workunit.client.0.smithi002.stdout:0/376: creat d1/d2/d49/d7d/f88 x:0 0 0 2024-09-13T22:56:08.410 INFO:tasks.workunit.client.0.smithi002.stdout:0/377: read - d1/d4/d75/d31/f65 zero size 2024-09-13T22:56:08.410 INFO:tasks.workunit.client.0.smithi002.stdout:9/405: truncate d8/d10/f3f 5024947 0 2024-09-13T22:56:08.412 INFO:tasks.workunit.client.1.smithi047.stdout:8/473: sync 2024-09-13T22:56:08.413 INFO:tasks.workunit.client.0.smithi002.stdout:1/407: link d1/d13/d1d/d34/l61 d1/d13/d30/d31/d86/l87 0 2024-09-13T22:56:08.413 INFO:tasks.workunit.client.1.smithi047.stdout:8/474: readlink d8/d64/d4e/d4d/d8f/d91/l76 0 2024-09-13T22:56:08.416 INFO:tasks.workunit.client.1.smithi047.stdout:3/497: dread d0/d3/d4/d16/d2c/f24 [0,4194304] 0 2024-09-13T22:56:08.416 INFO:tasks.workunit.client.0.smithi002.stdout:2/363: mkdir d1/d7/d35/d3e/d59/d6b/d75 0 2024-09-13T22:56:08.416 INFO:tasks.workunit.client.0.smithi002.stdout:2/364: dread - d1/d7/d8/f1e zero size 2024-09-13T22:56:08.421 INFO:tasks.workunit.client.0.smithi002.stdout:3/432: creat d9/d15/d46/f9b x:0 0 0 2024-09-13T22:56:08.422 INFO:tasks.workunit.client.1.smithi047.stdout:5/422: write d19/d34/f46 [3650593,101943] 0 2024-09-13T22:56:08.422 INFO:tasks.workunit.client.0.smithi002.stdout:3/433: readlink d9/df/d71/l77 0 2024-09-13T22:56:08.424 INFO:tasks.workunit.client.0.smithi002.stdout:8/357: dread d3/f61 [0,4194304] 0 2024-09-13T22:56:08.424 INFO:tasks.workunit.client.1.smithi047.stdout:5/423: dread d19/d34/d42/d5d/f6e [0,4194304] 0 2024-09-13T22:56:08.426 INFO:tasks.workunit.client.0.smithi002.stdout:5/347: mkdir d1/d2a/d41/d55/d56/d81 0 2024-09-13T22:56:08.427 INFO:tasks.workunit.client.0.smithi002.stdout:5/348: chown d1/d2a/d41/f74 2171463 1 2024-09-13T22:56:08.429 INFO:tasks.workunit.client.0.smithi002.stdout:7/316: unlink d8/d10/d11/d13/d2e/l4d 0 2024-09-13T22:56:08.429 INFO:tasks.workunit.client.0.smithi002.stdout:5/349: write d1/f3e [3040093,107284] 0 2024-09-13T22:56:08.430 INFO:tasks.workunit.client.0.smithi002.stdout:8/358: dwrite d3/f61 [0,4194304] 0 2024-09-13T22:56:08.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.430+0000 7ff3292bb700 1 -- 172.21.15.2:0/1055150658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3240fef60 msgr2=0x7ff3240ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:08.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.430+0000 7ff3292bb700 1 --2- 172.21.15.2:0/1055150658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3240fef60 0x7ff3240ff380 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff314009910 tx=0x7ff314009c20 comp rx=0 tx=0).stop 2024-09-13T22:56:08.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.430+0000 7ff3292bb700 1 -- 172.21.15.2:0/1055150658 shutdown_connections 2024-09-13T22:56:08.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.430+0000 7ff3292bb700 1 --2- 172.21.15.2:0/1055150658 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff324101f40 0x7ff3241023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:08.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.430+0000 7ff3292bb700 1 --2- 172.21.15.2:0/1055150658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3240fef60 0x7ff3240ff380 secure :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff314009910 tx=0x7ff314009c20 comp rx=0 tx=0).stop 2024-09-13T22:56:08.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.430+0000 7ff3292bb700 1 -- 172.21.15.2:0/1055150658 >> 172.21.15.2:0/1055150658 conn(0x7ff3240fa8c0 msgr2=0x7ff3240fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:08.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.431+0000 7ff3292bb700 1 -- 172.21.15.2:0/1055150658 shutdown_connections 2024-09-13T22:56:08.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.431+0000 7ff3292bb700 1 -- 172.21.15.2:0/1055150658 wait complete. 2024-09-13T22:56:08.433 INFO:tasks.workunit.client.1.smithi047.stdout:6/502: dwrite d3/d11/d2b/d1c/f56 [0,4194304] 0 2024-09-13T22:56:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.432+0000 7ff3292bb700 1 Processor -- start 2024-09-13T22:56:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.432+0000 7ff3292bb700 1 -- start start 2024-09-13T22:56:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.433+0000 7ff3292bb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff324101f40 0x7ff32419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.433+0000 7ff3292bb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff32419d290 0x7ff3241a2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.433+0000 7ff3292bb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32419d7a0 con 0x7ff324101f40 2024-09-13T22:56:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.433+0000 7ff3292bb700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32419d910 con 0x7ff32419d290 2024-09-13T22:56:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.433+0000 7ff322ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff324101f40 0x7ff32419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:08.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.433+0000 7ff322ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff324101f40 0x7ff32419cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52280/0 (socket says 172.21.15.2:52280) 2024-09-13T22:56:08.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.433+0000 7ff322ffd700 1 -- 172.21.15.2:0/2318256125 learned_addr learned my addr 172.21.15.2:0/2318256125 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:56:08.435 INFO:tasks.workunit.client.1.smithi047.stdout:1/446: write d0/d1d/f2e [791848,89038] 0 2024-09-13T22:56:08.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.434+0000 7ff3227fc700 1 --2- 172.21.15.2:0/2318256125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff32419d290 0x7ff3241a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:08.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.434+0000 7ff322ffd700 1 -- 172.21.15.2:0/2318256125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff32419d290 msgr2=0x7ff3241a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:08.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.434+0000 7ff322ffd700 1 --2- 172.21.15.2:0/2318256125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff32419d290 0x7ff3241a2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:08.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.434+0000 7ff322ffd700 1 -- 172.21.15.2:0/2318256125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3140095f0 con 0x7ff324101f40 2024-09-13T22:56:08.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.434+0000 7ff3227fc700 1 --2- 172.21.15.2:0/2318256125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff32419d290 0x7ff3241a2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:56:08.436 INFO:tasks.workunit.client.0.smithi002.stdout:0/378: mknod d1/d4/d75/d76/c89 0 2024-09-13T22:56:08.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.434+0000 7ff322ffd700 1 --2- 172.21.15.2:0/2318256125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff324101f40 0x7ff32419cd50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff324068380 tx=0x7ff31400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:08.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.435+0000 7ff30bfff700 1 -- 172.21.15.2:0/2318256125 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff31401d070 con 0x7ff324101f40 2024-09-13T22:56:08.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.435+0000 7ff30bfff700 1 -- 172.21.15.2:0/2318256125 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff314005dc0 con 0x7ff324101f40 2024-09-13T22:56:08.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.435+0000 7ff30bfff700 1 -- 172.21.15.2:0/2318256125 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff314017630 con 0x7ff324101f40 2024-09-13T22:56:08.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.436+0000 7ff3292bb700 1 -- 172.21.15.2:0/2318256125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3241a2840 con 0x7ff324101f40 2024-09-13T22:56:08.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.436+0000 7ff3292bb700 1 -- 172.21.15.2:0/2318256125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3241a2c70 con 0x7ff324101f40 2024-09-13T22:56:08.438 INFO:tasks.workunit.client.1.smithi047.stdout:2/578: write d1/df/d1d/d20/d37/d7b/d80/fb8 [1140286,1326] 0 2024-09-13T22:56:08.438 INFO:tasks.workunit.client.1.smithi047.stdout:5/424: dread d19/f1d [0,4194304] 0 2024-09-13T22:56:08.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.441+0000 7ff30bfff700 1 -- 172.21.15.2:0/2318256125 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) v1 ==== 91460+0+0 (secure 0 0 0) 0x7ff3140038a0 con 0x7ff324101f40 2024-09-13T22:56:08.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.441+0000 7ff3292bb700 1 -- 172.21.15.2:0/2318256125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff324106020 con 0x7ff324101f40 2024-09-13T22:56:08.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.441+0000 7ff30bfff700 1 --2- 172.21.15.2:0/2318256125 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7ff30c06d630 0x7ff30c06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:08.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.442+0000 7ff30bfff700 1 -- 172.21.15.2:0/2318256125 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff31408e200 con 0x7ff324101f40 2024-09-13T22:56:08.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.442+0000 7ff3227fc700 1 --2- 172.21.15.2:0/2318256125 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7ff30c06d630 0x7ff30c06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:08.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.443+0000 7ff3227fc700 1 --2- 172.21.15.2:0/2318256125 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7ff30c06d630 0x7ff30c06faf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff318009be0 tx=0x7ff318009260 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:08.444 INFO:tasks.workunit.client.1.smithi047.stdout:8/475: rename d8/d3f/l50 to d8/d64/d4e/d70/d98/la5 0 2024-09-13T22:56:08.446 INFO:tasks.workunit.client.0.smithi002.stdout:7/317: dwrite d8/d10/d11/d13/d26/f3f [0,4194304] 0 2024-09-13T22:56:08.448 INFO:tasks.workunit.client.0.smithi002.stdout:8/359: dwrite d3/d27/f59 [0,4194304] 0 2024-09-13T22:56:08.450 INFO:tasks.workunit.client.0.smithi002.stdout:3/434: read d9/d15/d51/f92 [2362766,110026] 0 2024-09-13T22:56:08.454 INFO:tasks.workunit.client.0.smithi002.stdout:2/365: dread d1/d7/d8/d2c/f39 [0,4194304] 0 2024-09-13T22:56:08.454 INFO:tasks.workunit.client.0.smithi002.stdout:3/435: write d9/f2a [1197459,83683] 0 2024-09-13T22:56:08.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.454+0000 7ff30bfff700 1 -- 172.21.15.2:0/2318256125 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7ff31405b390 con 0x7ff324101f40 2024-09-13T22:56:08.456 INFO:tasks.workunit.client.0.smithi002.stdout:5/350: rename d1/d2a/d41/d45/d4f/f68 to d1/d2a/d41/d55/d56/d81/f82 0 2024-09-13T22:56:08.458 INFO:tasks.workunit.client.0.smithi002.stdout:5/351: write d1/d2a/d41/f46 [1056648,117764] 0 2024-09-13T22:56:08.460 INFO:tasks.workunit.client.0.smithi002.stdout:5/352: write d1/d10/f4b [354162,59131] 0 2024-09-13T22:56:08.461 INFO:tasks.workunit.client.0.smithi002.stdout:5/353: fsync d1/d10/f51 0 2024-09-13T22:56:08.462 INFO:tasks.workunit.client.0.smithi002.stdout:1/408: truncate d1/d13/d1d/d34/d51/f82 167832 0 2024-09-13T22:56:08.463 INFO:tasks.workunit.client.0.smithi002.stdout:5/354: truncate d1/d2a/d41/d45/f61 640398 0 2024-09-13T22:56:08.464 INFO:tasks.workunit.client.0.smithi002.stdout:5/355: dread - d1/d2a/d41/f70 zero size 2024-09-13T22:56:08.466 INFO:tasks.workunit.client.1.smithi047.stdout:3/498: write d0/d3/d4/d16/f4e [107,128684] 0 2024-09-13T22:56:08.467 INFO:tasks.workunit.client.1.smithi047.stdout:1/447: mknod d0/d7/d13/c82 0 2024-09-13T22:56:08.468 INFO:tasks.workunit.client.1.smithi047.stdout:1/448: read - d0/d7/d14/d28/d36/f4c zero size 2024-09-13T22:56:08.471 INFO:tasks.workunit.client.0.smithi002.stdout:7/318: creat d8/d10/d11/d13/d26/d4c/f53 x:0 0 0 2024-09-13T22:56:08.476 INFO:tasks.workunit.client.1.smithi047.stdout:8/476: rmdir d8/d64/d4e/d4d/d8f/d91/d38 39 2024-09-13T22:56:08.481 INFO:tasks.workunit.client.0.smithi002.stdout:7/319: dread d8/d10/f45 [0,4194304] 0 2024-09-13T22:56:08.482 INFO:tasks.workunit.client.0.smithi002.stdout:4/355: sync 2024-09-13T22:56:08.483 INFO:tasks.workunit.client.0.smithi002.stdout:3/436: rename d9/f16 to d9/d3b/d7c/f9c 0 2024-09-13T22:56:08.483 INFO:tasks.workunit.client.0.smithi002.stdout:4/356: stat d3/d14/d29/d2a/f36 0 2024-09-13T22:56:08.485 INFO:tasks.workunit.client.0.smithi002.stdout:4/357: write d3/d40/d45/f52 [765305,81102] 0 2024-09-13T22:56:08.490 INFO:tasks.workunit.client.1.smithi047.stdout:7/521: link d0/d19/c25 d0/d7/da/d1e/cb0 0 2024-09-13T22:56:08.491 INFO:tasks.workunit.client.0.smithi002.stdout:5/356: creat d1/d2a/d41/d55/f83 x:0 0 0 2024-09-13T22:56:08.492 INFO:tasks.workunit.client.0.smithi002.stdout:8/360: unlink d3/dc/f26 0 2024-09-13T22:56:08.492 INFO:tasks.workunit.client.1.smithi047.stdout:5/425: mkdir d19/d34/d8e 0 2024-09-13T22:56:08.492 INFO:tasks.workunit.client.1.smithi047.stdout:5/426: fsync d19/f43 0 2024-09-13T22:56:08.494 INFO:tasks.workunit.client.0.smithi002.stdout:4/358: dwrite d3/d14/d25/f5c [0,4194304] 0 2024-09-13T22:56:08.495 INFO:tasks.workunit.client.0.smithi002.stdout:8/361: write d3/dc/d18/d2e/f6b [100295,29492] 0 2024-09-13T22:56:08.497 INFO:tasks.workunit.client.0.smithi002.stdout:2/366: creat d1/d7/d35/d3e/d5e/f76 x:0 0 0 2024-09-13T22:56:08.499 INFO:tasks.workunit.client.1.smithi047.stdout:0/491: link d1/d5/d16/d6a/d92/l9d d1/d5/laa 0 2024-09-13T22:56:08.499 INFO:tasks.workunit.client.1.smithi047.stdout:1/449: dwrite d0/d7/d14/d71/f7e [0,4194304] 0 2024-09-13T22:56:08.500 INFO:tasks.workunit.client.1.smithi047.stdout:1/450: stat d0/f5 0 2024-09-13T22:56:08.501 INFO:tasks.workunit.client.1.smithi047.stdout:0/492: readlink d1/d5/d11/d52/l9c 0 2024-09-13T22:56:08.503 INFO:tasks.workunit.client.1.smithi047.stdout:1/451: stat d0/d1d/c73 0 2024-09-13T22:56:08.509 INFO:tasks.workunit.client.0.smithi002.stdout:1/409: link d1/fb d1/d13/d21/d39/d70/f88 0 2024-09-13T22:56:08.511 INFO:tasks.workunit.client.0.smithi002.stdout:1/410: chown d1/d13/d1d/d34/f35 4 1 2024-09-13T22:56:08.511 INFO:tasks.workunit.client.1.smithi047.stdout:0/493: dwrite d1/d5/d11/f85 [0,4194304] 0 2024-09-13T22:56:08.513 INFO:tasks.workunit.client.0.smithi002.stdout:9/406: dwrite d8/d10/d42/f51 [0,4194304] 0 2024-09-13T22:56:08.513 INFO:tasks.workunit.client.1.smithi047.stdout:2/579: link d1/df/c65 d1/d16/cc2 0 2024-09-13T22:56:08.516 INFO:tasks.workunit.client.0.smithi002.stdout:5/357: creat d1/d2a/d41/d55/f84 x:0 0 0 2024-09-13T22:56:08.517 INFO:tasks.workunit.client.0.smithi002.stdout:5/358: chown d1/d2a/l66 1851929 1 2024-09-13T22:56:08.517 INFO:tasks.workunit.client.1.smithi047.stdout:1/452: dwrite d0/d7/db/f58 [0,4194304] 0 2024-09-13T22:56:08.517 INFO:tasks.workunit.client.1.smithi047.stdout:2/580: truncate d1/df/d26/f9c 154289 0 2024-09-13T22:56:08.518 INFO:tasks.workunit.client.0.smithi002.stdout:5/359: chown d1/d2a/d41/d55/d56/d81 39982117 1 2024-09-13T22:56:08.519 INFO:tasks.workunit.client.1.smithi047.stdout:1/453: truncate d0/d7/db/f67 1157468 0 2024-09-13T22:56:08.519 INFO:tasks.workunit.client.0.smithi002.stdout:5/360: write d1/f2f [465964,94966] 0 2024-09-13T22:56:08.525 INFO:tasks.workunit.client.0.smithi002.stdout:8/362: unlink d3/f38 0 2024-09-13T22:56:08.527 INFO:tasks.workunit.client.0.smithi002.stdout:4/359: truncate d3/d40/f4e 1565569 0 2024-09-13T22:56:08.529 INFO:tasks.workunit.client.0.smithi002.stdout:2/367: rmdir d1/d7/d8 39 2024-09-13T22:56:08.530 INFO:tasks.workunit.client.1.smithi047.stdout:3/499: link d0/d3/d4/l35 d0/d3/d4/d16/d2c/d7e/la4 0 2024-09-13T22:56:08.531 INFO:tasks.workunit.client.1.smithi047.stdout:3/500: chown d0/d3/d4/d16/d2c/de/f77 15361 1 2024-09-13T22:56:08.532 INFO:tasks.workunit.client.1.smithi047.stdout:3/501: chown d0/d3/d4/d16/f61 29 1 2024-09-13T22:56:08.532 INFO:tasks.workunit.client.0.smithi002.stdout:7/320: dread d8/d9/f1a [0,4194304] 0 2024-09-13T22:56:08.532 INFO:tasks.workunit.client.0.smithi002.stdout:3/437: truncate d9/d3b/f67 468248 0 2024-09-13T22:56:08.534 INFO:tasks.workunit.client.0.smithi002.stdout:1/411: dread d1/d13/d21/f5b [0,4194304] 0 2024-09-13T22:56:08.535 INFO:tasks.workunit.client.1.smithi047.stdout:3/502: dread d0/d3/f96 [0,4194304] 0 2024-09-13T22:56:08.536 INFO:tasks.workunit.client.1.smithi047.stdout:5/427: creat d19/d34/d8e/f8f x:0 0 0 2024-09-13T22:56:08.538 INFO:tasks.workunit.client.1.smithi047.stdout:0/494: symlink d1/d5/d16/d47/lab 0 2024-09-13T22:56:08.539 INFO:tasks.workunit.client.1.smithi047.stdout:0/495: write d1/d7/f18 [1559586,89878] 0 2024-09-13T22:56:08.540 INFO:tasks.workunit.client.0.smithi002.stdout:6/359: sync 2024-09-13T22:56:08.540 INFO:tasks.workunit.client.0.smithi002.stdout:0/379: sync 2024-09-13T22:56:08.541 INFO:tasks.workunit.client.1.smithi047.stdout:0/496: read d1/d7/f1d [2597746,33657] 0 2024-09-13T22:56:08.543 INFO:tasks.workunit.client.0.smithi002.stdout:0/380: chown d1/d2/d49/f64 592093 1 2024-09-13T22:56:08.544 INFO:tasks.workunit.client.1.smithi047.stdout:1/454: symlink d0/d7/db/d79/l83 0 2024-09-13T22:56:08.545 INFO:tasks.workunit.client.1.smithi047.stdout:1/455: write d0/f5a [4443770,58354] 0 2024-09-13T22:56:08.546 INFO:tasks.workunit.client.0.smithi002.stdout:3/438: dwrite d9/d15/d36/d4e/d5e/f81 [0,4194304] 0 2024-09-13T22:56:08.549 INFO:tasks.workunit.client.0.smithi002.stdout:8/363: mkdir d3/dc/d18/d6f 0 2024-09-13T22:56:08.550 INFO:tasks.workunit.client.1.smithi047.stdout:8/477: write d8/d64/d4e/d4d/d8f/d91/d38/f3b [502304,37938] 0 2024-09-13T22:56:08.550 INFO:tasks.workunit.client.0.smithi002.stdout:8/364: fdatasync d3/dc/d18/f23 0 2024-09-13T22:56:08.553 INFO:tasks.workunit.client.1.smithi047.stdout:5/428: mkdir d19/d25/d90 0 2024-09-13T22:56:08.554 INFO:tasks.workunit.client.1.smithi047.stdout:1/456: dwrite d0/d7/db/f3a [0,4194304] 0 2024-09-13T22:56:08.556 INFO:tasks.workunit.client.1.smithi047.stdout:1/457: chown d0/d7/d14/d28 16 1 2024-09-13T22:56:08.558 INFO:tasks.workunit.client.1.smithi047.stdout:1/458: write d0/d7/db/f6b [3749777,47182] 0 2024-09-13T22:56:08.560 INFO:tasks.workunit.client.1.smithi047.stdout:1/459: truncate d0/d7/db/d79/f7b 1025989 0 2024-09-13T22:56:08.567 INFO:tasks.workunit.client.0.smithi002.stdout:6/360: mknod d12/d17/d34/d4b/c75 0 2024-09-13T22:56:08.569 INFO:tasks.workunit.client.1.smithi047.stdout:0/497: truncate d1/d5/f74 882969 0 2024-09-13T22:56:08.573 INFO:tasks.workunit.client.0.smithi002.stdout:0/381: rmdir d1 39 2024-09-13T22:56:08.575 INFO:tasks.workunit.client.1.smithi047.stdout:7/522: rename d0/d7/da/d1e/l75 to d0/d7/lb1 0 2024-09-13T22:56:08.576 INFO:tasks.workunit.client.1.smithi047.stdout:7/523: readlink d0/d57/d5b/l72 0 2024-09-13T22:56:08.576 INFO:tasks.workunit.client.0.smithi002.stdout:3/439: truncate d9/fb 2014670 0 2024-09-13T22:56:08.578 INFO:tasks.workunit.client.1.smithi047.stdout:2/581: truncate d1/de/f5b 213792 0 2024-09-13T22:56:08.580 INFO:tasks.workunit.client.1.smithi047.stdout:8/478: mkdir d8/d3f/d8c/da6 0 2024-09-13T22:56:08.580 INFO:tasks.workunit.client.0.smithi002.stdout:2/368: dwrite d1/d32/d37/f45 [0,4194304] 0 2024-09-13T22:56:08.581 INFO:tasks.workunit.client.1.smithi047.stdout:3/503: dwrite d0/d3/d4/d16/d2c/de/d3d/f6e [0,4194304] 0 2024-09-13T22:56:08.583 INFO:tasks.workunit.client.1.smithi047.stdout:5/429: creat d19/d34/d8e/f91 x:0 0 0 2024-09-13T22:56:08.584 INFO:tasks.workunit.client.0.smithi002.stdout:9/407: dwrite d8/d10/f3c [0,4194304] 0 2024-09-13T22:56:08.592 INFO:tasks.workunit.client.1.smithi047.stdout:1/460: truncate d0/f4f 1572090 0 2024-09-13T22:56:08.593 INFO:tasks.workunit.client.1.smithi047.stdout:1/461: fdatasync d0/d7/f80 0 2024-09-13T22:56:08.595 INFO:tasks.workunit.client.1.smithi047.stdout:4/529: sync 2024-09-13T22:56:08.595 INFO:tasks.workunit.client.1.smithi047.stdout:9/421: sync 2024-09-13T22:56:08.597 INFO:tasks.workunit.client.1.smithi047.stdout:7/524: read d0/d7/da/d2e/d37/f43 [871299,57956] 0 2024-09-13T22:56:08.599 INFO:tasks.workunit.client.0.smithi002.stdout:6/361: creat d12/d17/d34/d4b/f76 x:0 0 0 2024-09-13T22:56:08.601 INFO:tasks.workunit.client.0.smithi002.stdout:6/362: read d12/d17/d2a/f32 [1531471,69923] 0 2024-09-13T22:56:08.601 INFO:tasks.workunit.client.0.smithi002.stdout:6/363: readlink l3 0 2024-09-13T22:56:08.606 INFO:tasks.workunit.client.1.smithi047.stdout:8/479: read d8/f9 [1086918,113597] 0 2024-09-13T22:56:08.607 INFO:tasks.workunit.client.0.smithi002.stdout:3/440: unlink d9/f2a 0 2024-09-13T22:56:08.611 INFO:tasks.workunit.client.0.smithi002.stdout:7/321: truncate d8/d9/f19 2462688 0 2024-09-13T22:56:08.611 INFO:tasks.workunit.client.0.smithi002.stdout:0/382: dwrite d1/d4/d75/f2c [0,4194304] 0 2024-09-13T22:56:08.612 INFO:tasks.workunit.client.0.smithi002.stdout:8/365: symlink d3/dc/d51/d6e/l70 0 2024-09-13T22:56:08.613 INFO:tasks.workunit.client.0.smithi002.stdout:0/383: dread - d1/d4/d75/d76/f85 zero size 2024-09-13T22:56:08.613 INFO:tasks.workunit.client.1.smithi047.stdout:5/430: unlink d19/d25/f71 0 2024-09-13T22:56:08.614 INFO:tasks.workunit.client.0.smithi002.stdout:8/366: write d3/d27/d39/f5c [597193,76370] 0 2024-09-13T22:56:08.617 INFO:tasks.workunit.client.0.smithi002.stdout:8/367: write d3/dc/f22 [3075130,101115] 0 2024-09-13T22:56:08.620 INFO:tasks.workunit.client.1.smithi047.stdout:0/498: fdatasync d1/d5/d16/d23/d2d/f55 0 2024-09-13T22:56:08.624 INFO:tasks.workunit.client.0.smithi002.stdout:2/369: creat d1/d4a/f77 x:0 0 0 2024-09-13T22:56:08.625 INFO:tasks.workunit.client.1.smithi047.stdout:9/422: symlink d1/d5f/d6a/l86 0 2024-09-13T22:56:08.626 INFO:tasks.workunit.client.0.smithi002.stdout:9/408: symlink d8/d10/d1c/d68/d84/l8c 0 2024-09-13T22:56:08.630 INFO:tasks.workunit.client.1.smithi047.stdout:3/504: dwrite d0/d25/d44/f1e [4194304,4194304] 0 2024-09-13T22:56:08.632 INFO:tasks.workunit.client.1.smithi047.stdout:2/582: unlink d1/l87 0 2024-09-13T22:56:08.635 INFO:tasks.workunit.client.0.smithi002.stdout:5/361: getdents d1/d10 0 2024-09-13T22:56:08.636 INFO:tasks.workunit.client.0.smithi002.stdout:5/362: chown d1/f43 127 1 2024-09-13T22:56:08.636 INFO:tasks.workunit.client.0.smithi002.stdout:5/363: chown d1/d10/f32 485 1 2024-09-13T22:56:08.638 INFO:tasks.workunit.client.1.smithi047.stdout:8/480: mkdir d8/d64/d4e/d70/da7 0 2024-09-13T22:56:08.643 INFO:tasks.workunit.client.0.smithi002.stdout:3/441: creat d9/d15/d35/f9d x:0 0 0 2024-09-13T22:56:08.645 INFO:tasks.workunit.client.1.smithi047.stdout:5/431: symlink d19/d23/d2e/l92 0 2024-09-13T22:56:08.647 INFO:tasks.workunit.client.0.smithi002.stdout:4/360: link d3/d40/f4e d3/d14/d29/d2a/f6a 0 2024-09-13T22:56:08.650 INFO:tasks.workunit.client.0.smithi002.stdout:0/384: rename d1/d2/d49/f5a to d1/d7e/f8a 0 2024-09-13T22:56:08.651 INFO:tasks.workunit.client.0.smithi002.stdout:7/322: truncate d8/d10/d11/d13/d2e/d3c/f48 1576586 0 2024-09-13T22:56:08.652 INFO:tasks.workunit.client.0.smithi002.stdout:0/385: chown d1/d4/f35 7362 1 2024-09-13T22:56:08.653 INFO:tasks.workunit.client.0.smithi002.stdout:8/368: creat d3/dc/d16/d2f/f71 x:0 0 0 2024-09-13T22:56:08.655 INFO:tasks.workunit.client.0.smithi002.stdout:2/370: truncate d1/d7/d8/f5d 696954 0 2024-09-13T22:56:08.655 INFO:tasks.workunit.client.0.smithi002.stdout:5/364: rmdir d1/d2a/d6b 39 2024-09-13T22:56:08.656 INFO:tasks.workunit.client.0.smithi002.stdout:5/365: write d1/d10/f51 [2142512,39678] 0 2024-09-13T22:56:08.657 INFO:tasks.workunit.client.1.smithi047.stdout:3/505: rename d0/d25/d44/d43/f9a to d0/d3/d4/d91/d8d/fa5 0 2024-09-13T22:56:08.658 INFO:tasks.workunit.client.0.smithi002.stdout:6/364: symlink d12/d17/d28/d67/d6b/l77 0 2024-09-13T22:56:08.659 INFO:tasks.workunit.client.0.smithi002.stdout:3/442: dread d9/d15/d46/f6f [0,4194304] 0 2024-09-13T22:56:08.665 INFO:tasks.workunit.client.1.smithi047.stdout:5/432: creat d19/d64/f93 x:0 0 0 2024-09-13T22:56:08.667 INFO:tasks.workunit.client.0.smithi002.stdout:4/361: rename d3/d14/d25/f28 to d3/d14/d29/d2a/d30/f6b 0 2024-09-13T22:56:08.669 INFO:tasks.workunit.client.0.smithi002.stdout:7/323: creat d8/d9/f54 x:0 0 0 2024-09-13T22:56:08.672 INFO:tasks.workunit.client.0.smithi002.stdout:0/386: mkdir d1/d2/d6c/d8b 0 2024-09-13T22:56:08.708 INFO:tasks.workunit.client.0.smithi002.stdout:1/412: sync 2024-09-13T22:56:08.718 INFO:tasks.workunit.client.0.smithi002.stdout:8/369: mkdir d3/dc/d16/d4b/d72 0 2024-09-13T22:56:08.719 INFO:tasks.workunit.client.1.smithi047.stdout:9/423: mknod d1/dc/d14/dd/d4c/c87 0 2024-09-13T22:56:08.720 INFO:tasks.workunit.client.1.smithi047.stdout:9/424: chown d1/dc/d18/d72/f7e 1331140 1 2024-09-13T22:56:08.721 INFO:tasks.workunit.client.0.smithi002.stdout:5/366: creat d1/d2a/d41/d55/d56/f85 x:0 0 0 2024-09-13T22:56:08.725 INFO:tasks.workunit.client.0.smithi002.stdout:3/443: symlink d9/d7e/l9e 0 2024-09-13T22:56:08.726 INFO:tasks.workunit.client.1.smithi047.stdout:3/506: fsync d0/f5c 0 2024-09-13T22:56:08.727 INFO:tasks.workunit.client.0.smithi002.stdout:3/444: chown d9/d3b/d53/d83/l62 1 1 2024-09-13T22:56:08.731 INFO:tasks.workunit.client.0.smithi002.stdout:2/371: rename d1/d32/d37/d3a to d1/d7/d35/d78 0 2024-09-13T22:56:08.732 INFO:tasks.workunit.client.1.smithi047.stdout:8/481: creat d8/d64/d4e/d70/da7/fa8 x:0 0 0 2024-09-13T22:56:08.739 INFO:tasks.workunit.client.1.smithi047.stdout:3/507: dread d0/d25/d44/d43/f54 [0,4194304] 0 2024-09-13T22:56:08.739 INFO:tasks.workunit.client.1.smithi047.stdout:6/503: sync 2024-09-13T22:56:08.741 INFO:tasks.workunit.client.1.smithi047.stdout:6/504: write d3/d11/d2b/d1c/d4d/f84 [36866,108487] 0 2024-09-13T22:56:08.741 INFO:tasks.workunit.client.1.smithi047.stdout:1/462: getdents d0/d7/d14/d71 0 2024-09-13T22:56:08.745 INFO:tasks.workunit.client.1.smithi047.stdout:0/499: creat d1/d5/d16/fac x:0 0 0 2024-09-13T22:56:08.747 INFO:tasks.workunit.client.1.smithi047.stdout:9/425: symlink d1/dc/d14/dd/d54/d50/l88 0 2024-09-13T22:56:08.750 INFO:tasks.workunit.client.1.smithi047.stdout:2/583: mkdir d1/d8a/da6/dc3 0 2024-09-13T22:56:08.752 INFO:tasks.workunit.client.1.smithi047.stdout:2/584: write d1/df/d26/d9f/fad [659002,66411] 0 2024-09-13T22:56:08.758 INFO:tasks.workunit.client.1.smithi047.stdout:3/508: creat d0/d3/d4/d16/d32/d42/fa6 x:0 0 0 2024-09-13T22:56:08.759 INFO:tasks.workunit.client.1.smithi047.stdout:3/509: read - d0/d25/d44/f87 zero size 2024-09-13T22:56:08.760 INFO:tasks.workunit.client.1.smithi047.stdout:1/463: unlink d0/d7/d13/d2d/f59 0 2024-09-13T22:56:08.761 INFO:tasks.workunit.client.1.smithi047.stdout:1/464: chown d0/d7/d13/d5d 170069363 1 2024-09-13T22:56:08.765 INFO:tasks.workunit.client.1.smithi047.stdout:8/482: dread d8/f1a [0,4194304] 0 2024-09-13T22:56:08.765 INFO:tasks.workunit.client.1.smithi047.stdout:0/500: truncate d1/d5/d16/d23/d2d/f5a 99674 0 2024-09-13T22:56:08.779 INFO:tasks.workunit.client.1.smithi047.stdout:8/483: mkdir d8/d6b/da9 0 2024-09-13T22:56:08.781 INFO:tasks.workunit.client.1.smithi047.stdout:0/501: rename d1/c8a to d1/d5/d11/d2f/cad 0 2024-09-13T22:56:08.785 INFO:tasks.workunit.client.1.smithi047.stdout:0/502: dread d1/d5/d16/f63 [0,4194304] 0 2024-09-13T22:56:08.790 INFO:tasks.workunit.client.1.smithi047.stdout:2/585: link d1/df/d26/d9f/fad d1/d8a/da6/fc4 0 2024-09-13T22:56:08.792 INFO:tasks.workunit.client.0.smithi002.stdout:0/387: creat d1/d2/d6c/d8b/f8c x:0 0 0 2024-09-13T22:56:08.796 INFO:tasks.workunit.client.0.smithi002.stdout:1/413: symlink d1/d13/d30/d31/d3b/d71/d80/l89 0 2024-09-13T22:56:08.796 INFO:tasks.workunit.client.0.smithi002.stdout:3/445: dread d9/df/f23 [0,4194304] 0 2024-09-13T22:56:08.797 INFO:tasks.workunit.client.0.smithi002.stdout:8/370: mkdir d3/dc/d16/d4b/d72/d73 0 2024-09-13T22:56:08.804 INFO:tasks.workunit.client.1.smithi047.stdout:0/503: read d1/d7/f1d [4338256,87086] 0 2024-09-13T22:56:08.805 INFO:tasks.workunit.client.0.smithi002.stdout:0/388: rename d1/d2/d49/f86 to d1/d4/d75/d31/f8d 0 2024-09-13T22:56:08.806 INFO:tasks.workunit.client.0.smithi002.stdout:0/389: write d1/d4/d75/d31/f65 [192501,47141] 0 2024-09-13T22:56:08.806 INFO:tasks.workunit.client.1.smithi047.stdout:2/586: fsync d1/df/d1d/d3c/f9d 0 2024-09-13T22:56:08.807 INFO:tasks.workunit.client.0.smithi002.stdout:0/390: stat d1/d2/d49/f68 0 2024-09-13T22:56:08.808 INFO:tasks.workunit.client.0.smithi002.stdout:0/391: read d1/f17 [298908,62823] 0 2024-09-13T22:56:08.809 INFO:tasks.workunit.client.0.smithi002.stdout:1/414: fdatasync d1/fb 0 2024-09-13T22:56:08.810 INFO:tasks.workunit.client.1.smithi047.stdout:0/504: dwrite d1/d5/d11/d2f/f38 [4194304,4194304] 0 2024-09-13T22:56:08.811 INFO:tasks.workunit.client.1.smithi047.stdout:0/505: chown d1/d5/d11/d83 0 1 2024-09-13T22:56:08.815 INFO:tasks.workunit.client.1.smithi047.stdout:8/484: symlink d8/da3/laa 0 2024-09-13T22:56:08.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.814+0000 7ff3292bb700 1 -- 172.21.15.2:0/2318256125 --> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3240611d0 con 0x7ff30c06d630 2024-09-13T22:56:08.815 INFO:tasks.workunit.client.1.smithi047.stdout:8/485: fdatasync d8/d64/d4e/d4d/d8f/d91/f3a 0 2024-09-13T22:56:08.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.816+0000 7ff30bfff700 1 -- 172.21.15.2:0/2318256125 <== mgr.14590 v2:172.21.15.47:6828/1914885837 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7ff3240611d0 con 0x7ff30c06d630 2024-09-13T22:56:08.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.820+0000 7ff3292bb700 1 -- 172.21.15.2:0/2318256125 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7ff30c06d630 msgr2=0x7ff30c06faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:08.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.820+0000 7ff3292bb700 1 --2- 172.21.15.2:0/2318256125 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7ff30c06d630 0x7ff30c06faf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff318009be0 tx=0x7ff318009260 comp rx=0 tx=0).stop 2024-09-13T22:56:08.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.820+0000 7ff3292bb700 1 -- 172.21.15.2:0/2318256125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff324101f40 msgr2=0x7ff32419cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:08.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.820+0000 7ff3292bb700 1 --2- 172.21.15.2:0/2318256125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff324101f40 0x7ff32419cd50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff324068380 tx=0x7ff31400f740 comp rx=0 tx=0).stop 2024-09-13T22:56:08.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.820+0000 7ff3292bb700 1 -- 172.21.15.2:0/2318256125 shutdown_connections 2024-09-13T22:56:08.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.820+0000 7ff3292bb700 1 --2- 172.21.15.2:0/2318256125 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7ff30c06d630 0x7ff30c06faf0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:08.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.820+0000 7ff3292bb700 1 --2- 172.21.15.2:0/2318256125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff324101f40 0x7ff32419cd50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:08.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.820+0000 7ff3292bb700 1 --2- 172.21.15.2:0/2318256125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff32419d290 0x7ff3241a2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:08.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.820+0000 7ff3292bb700 1 -- 172.21.15.2:0/2318256125 >> 172.21.15.2:0/2318256125 conn(0x7ff3240fa8c0 msgr2=0x7ff324103160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:08.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.820+0000 7ff3292bb700 1 -- 172.21.15.2:0/2318256125 shutdown_connections 2024-09-13T22:56:08.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.820+0000 7ff3292bb700 1 -- 172.21.15.2:0/2318256125 wait complete. 2024-09-13T22:56:08.824 INFO:tasks.workunit.client.0.smithi002.stdout:6/365: write d12/f2b [772217,128248] 0 2024-09-13T22:56:08.824 INFO:tasks.workunit.client.0.smithi002.stdout:0/392: chown d1/c25 6301 1 2024-09-13T22:56:08.825 INFO:tasks.workunit.client.1.smithi047.stdout:3/510: getdents d0/d3/d4/d16 0 2024-09-13T22:56:08.827 INFO:tasks.workunit.client.1.smithi047.stdout:1/465: getdents d0/d7/d14/d57/d72 0 2024-09-13T22:56:08.828 INFO:tasks.workunit.client.0.smithi002.stdout:1/415: chown d1/f27 488 1 2024-09-13T22:56:08.829 INFO:tasks.workunit.client.1.smithi047.stdout:0/506: unlink d1/c3b 0 2024-09-13T22:56:08.833 INFO:tasks.workunit.client.0.smithi002.stdout:9/409: sync 2024-09-13T22:56:08.855 INFO:tasks.workunit.client.1.smithi047.stdout:4/530: sync 2024-09-13T22:56:08.857 INFO:tasks.workunit.client.0.smithi002.stdout:8/371: readlink d3/d21/d57/l4e 0 2024-09-13T22:56:08.857 INFO:tasks.workunit.client.1.smithi047.stdout:8/486: rmdir d8/d64/d4e/d70 39 2024-09-13T22:56:08.859 INFO:tasks.workunit.client.0.smithi002.stdout:5/367: getdents d1/d57 0 2024-09-13T22:56:08.860 INFO:tasks.workunit.client.0.smithi002.stdout:2/372: sync 2024-09-13T22:56:08.862 INFO:tasks.workunit.client.0.smithi002.stdout:6/366: creat d12/d17/d28/d67/d6b/f78 x:0 0 0 2024-09-13T22:56:08.863 INFO:tasks.workunit.client.0.smithi002.stdout:4/362: dwrite d3/d40/f4e [0,4194304] 0 2024-09-13T22:56:08.864 INFO:tasks.workunit.client.0.smithi002.stdout:6/367: chown d12/d17/d28/d67/f6d 4496 1 2024-09-13T22:56:08.866 INFO:tasks.workunit.client.1.smithi047.stdout:0/507: unlink d1/d5/d16/f3c 0 2024-09-13T22:56:08.866 INFO:tasks.workunit.client.0.smithi002.stdout:0/393: rename d1/d4/d75/d31/c61 to d1/d2/d49/c8e 0 2024-09-13T22:56:08.868 INFO:tasks.workunit.client.1.smithi047.stdout:4/531: chown dc/de/f53 0 1 2024-09-13T22:56:08.873 INFO:tasks.workunit.client.1.smithi047.stdout:8/487: creat d8/d3f/d8c/fab x:0 0 0 2024-09-13T22:56:08.874 INFO:tasks.workunit.client.1.smithi047.stdout:4/532: dread dc/d29/f41 [0,4194304] 0 2024-09-13T22:56:08.876 INFO:tasks.workunit.client.1.smithi047.stdout:4/533: write dc/d29/f35 [4646916,24302] 0 2024-09-13T22:56:08.877 INFO:tasks.workunit.client.0.smithi002.stdout:8/372: creat d3/dc/d16/d60/f74 x:0 0 0 2024-09-13T22:56:08.880 INFO:tasks.workunit.client.0.smithi002.stdout:5/368: fsync d1/d2a/d41/d55/d56/d81/f82 0 2024-09-13T22:56:08.880 INFO:tasks.workunit.client.0.smithi002.stdout:1/416: dread d1/d13/f3f [0,4194304] 0 2024-09-13T22:56:08.882 INFO:tasks.workunit.client.0.smithi002.stdout:2/373: mkdir d1/d32/d37/d79 0 2024-09-13T22:56:08.885 INFO:tasks.workunit.client.1.smithi047.stdout:2/587: rename d1/df/d26/f6d to d1/de/fc5 0 2024-09-13T22:56:08.886 INFO:tasks.workunit.client.1.smithi047.stdout:2/588: write d1/df/d1d/d20/d2b/f41 [5989483,85553] 0 2024-09-13T22:56:08.891 INFO:tasks.workunit.client.1.smithi047.stdout:2/589: truncate d1/df/d1d/d20/d37/d7a/fbc 338322 0 2024-09-13T22:56:08.891 INFO:tasks.workunit.client.0.smithi002.stdout:0/394: rename d1/d4/d75/d31/d3c to d1/d2/d81/d8f 0 2024-09-13T22:56:08.891 INFO:tasks.workunit.client.1.smithi047.stdout:5/433: dwrite d19/d25/d45/f60 [0,4194304] 0 2024-09-13T22:56:08.896 INFO:tasks.workunit.client.0.smithi002.stdout:3/446: link d9/d15/d36/d4e/f8b d9/d15/d36/d4e/f9f 0 2024-09-13T22:56:08.899 INFO:tasks.workunit.client.1.smithi047.stdout:0/508: unlink d1/d5/d16/d23/f64 0 2024-09-13T22:56:08.900 INFO:tasks.workunit.client.1.smithi047.stdout:0/509: fsync d1/d7/f6c 0 2024-09-13T22:56:08.901 INFO:tasks.workunit.client.1.smithi047.stdout:0/510: write d1/d7/f3e [3607376,59098] 0 2024-09-13T22:56:08.902 INFO:tasks.workunit.client.1.smithi047.stdout:6/505: write d3/d11/d2b/d4c/d30/f44 [48351,93414] 0 2024-09-13T22:56:08.903 INFO:tasks.workunit.client.0.smithi002.stdout:6/368: dread d12/f21 [0,4194304] 0 2024-09-13T22:56:08.904 INFO:tasks.workunit.client.0.smithi002.stdout:8/373: chown d3/d21/f44 52 1 2024-09-13T22:56:08.905 INFO:tasks.workunit.client.0.smithi002.stdout:3/447: dwrite d9/d15/d35/f9d [0,4194304] 0 2024-09-13T22:56:08.905 INFO:tasks.workunit.client.0.smithi002.stdout:6/369: fsync d12/f63 0 2024-09-13T22:56:08.906 INFO:tasks.workunit.client.0.smithi002.stdout:1/417: symlink d1/d1c/l8a 0 2024-09-13T22:56:08.906 INFO:tasks.workunit.client.0.smithi002.stdout:6/370: fsync f5 0 2024-09-13T22:56:08.907 INFO:tasks.workunit.client.0.smithi002.stdout:8/374: dread - d3/dc/d16/d4b/f6c zero size 2024-09-13T22:56:08.909 INFO:tasks.workunit.client.1.smithi047.stdout:0/511: dwrite d1/d5/f59 [0,4194304] 0 2024-09-13T22:56:08.910 INFO:tasks.workunit.client.1.smithi047.stdout:4/534: dread dc/de/f3f [0,4194304] 0 2024-09-13T22:56:08.911 INFO:tasks.workunit.client.0.smithi002.stdout:5/369: mkdir d1/d2a/d41/d55/d56/d86 0 2024-09-13T22:56:08.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:08 smithi047 ceph-mon[34560]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:08.913 INFO:tasks.workunit.client.0.smithi002.stdout:2/374: creat d1/d7/d41/f7a x:0 0 0 2024-09-13T22:56:08.923 INFO:tasks.workunit.client.0.smithi002.stdout:9/410: link d8/d1e/f25 d8/d10/d61/f8d 0 2024-09-13T22:56:08.923 INFO:tasks.workunit.client.0.smithi002.stdout:0/395: dread d1/d2/f29 [0,4194304] 0 2024-09-13T22:56:08.924 INFO:tasks.workunit.client.1.smithi047.stdout:2/590: dwrite d1/df/d26/d9f/fad [0,4194304] 0 2024-09-13T22:56:08.924 INFO:tasks.workunit.client.1.smithi047.stdout:2/591: chown d1/d16/f7c 470069072 1 2024-09-13T22:56:08.926 INFO:tasks.workunit.client.0.smithi002.stdout:8/375: dread d3/dc/f5f [0,4194304] 0 2024-09-13T22:56:08.928 INFO:tasks.workunit.client.0.smithi002.stdout:8/376: stat d3/dc/d18/d2e 0 2024-09-13T22:56:08.928 INFO:tasks.workunit.client.1.smithi047.stdout:7/525: creat d0/fb2 x:0 0 0 2024-09-13T22:56:08.934 INFO:tasks.workunit.client.1.smithi047.stdout:9/426: truncate d1/dc/d14/dd/d54/d4e/d51/f53 691439 0 2024-09-13T22:56:08.935 INFO:tasks.workunit.client.1.smithi047.stdout:7/526: dwrite d0/d7/fa9 [0,4194304] 0 2024-09-13T22:56:08.936 INFO:tasks.workunit.client.0.smithi002.stdout:3/448: symlink d9/d15/d36/d4e/d5e/la0 0 2024-09-13T22:56:08.936 INFO:tasks.workunit.client.1.smithi047.stdout:7/527: stat d0/d7/f36 0 2024-09-13T22:56:08.939 INFO:tasks.workunit.client.1.smithi047.stdout:6/506: truncate d3/d11/d2b/d1c/d4d/d69/f90 4811847 0 2024-09-13T22:56:08.940 INFO:tasks.workunit.client.0.smithi002.stdout:1/418: dread d1/f24 [0,4194304] 0 2024-09-13T22:56:08.942 INFO:tasks.workunit.client.1.smithi047.stdout:8/488: link d8/d64/d4e/d4d/d8f/d91/d38/c41 d8/d64/d4e/d4d/d8f/d91/d40/cac 0 2024-09-13T22:56:08.942 INFO:tasks.workunit.client.0.smithi002.stdout:6/371: rename d12/d17/d28/d67/d6b/l57 to d12/d17/d34/d39/l79 0 2024-09-13T22:56:08.943 INFO:tasks.workunit.client.0.smithi002.stdout:5/370: fsync d1/d2a/d41/d45/f48 0 2024-09-13T22:56:08.944 INFO:tasks.workunit.client.1.smithi047.stdout:8/489: truncate d8/d64/d4e/d4d/d8f/d91/f96 1273464 0 2024-09-13T22:56:08.945 INFO:tasks.workunit.client.0.smithi002.stdout:2/375: rmdir d1/d7/d35/d3e 39 2024-09-13T22:56:08.945 INFO:tasks.workunit.client.0.smithi002.stdout:7/324: dwrite d8/d10/d11/d13/f1c [0,4194304] 0 2024-09-13T22:56:08.949 INFO:tasks.workunit.client.0.smithi002.stdout:2/376: dread d1/d7/d8/d51/f5a [0,4194304] 0 2024-09-13T22:56:08.950 INFO:tasks.workunit.client.1.smithi047.stdout:5/434: unlink d19/d25/f61 0 2024-09-13T22:56:08.952 INFO:tasks.workunit.client.0.smithi002.stdout:6/372: dwrite d12/f22 [0,4194304] 0 2024-09-13T22:56:08.958 INFO:tasks.workunit.client.1.smithi047.stdout:7/528: rename d0/d7/f1d to d0/d57/da6/fb3 0 2024-09-13T22:56:08.960 INFO:tasks.workunit.client.0.smithi002.stdout:0/396: symlink d1/d4/d75/d31/l90 0 2024-09-13T22:56:08.961 INFO:tasks.workunit.client.1.smithi047.stdout:6/507: unlink d3/d11/f40 0 2024-09-13T22:56:08.963 INFO:tasks.workunit.client.0.smithi002.stdout:8/377: symlink d3/dc/d18/d2e/l75 0 2024-09-13T22:56:08.965 INFO:tasks.workunit.client.1.smithi047.stdout:0/512: rmdir d1/d5/d16/d23/d2d/d8f 0 2024-09-13T22:56:08.967 INFO:tasks.workunit.client.0.smithi002.stdout:3/449: write d9/d3b/d7c/f9c [8410324,121743] 0 2024-09-13T22:56:08.971 INFO:tasks.workunit.client.1.smithi047.stdout:5/435: unlink d19/d34/d42/l73 0 2024-09-13T22:56:08.973 INFO:tasks.workunit.client.0.smithi002.stdout:1/419: creat d1/d13/d30/d31/d3d/f8b x:0 0 0 2024-09-13T22:56:08.974 INFO:tasks.workunit.client.0.smithi002.stdout:4/363: creat d3/d14/f6c x:0 0 0 2024-09-13T22:56:08.974 INFO:tasks.workunit.client.0.smithi002.stdout:5/371: rmdir d1/d2a 39 2024-09-13T22:56:08.976 INFO:tasks.workunit.client.1.smithi047.stdout:7/529: rename d0/d7/f15 to d0/d57/d5b/fb4 0 2024-09-13T22:56:08.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.978+0000 7fefcb6bb700 1 -- 172.21.15.2:0/4259815355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefc40ffdb0 msgr2=0x7fefc4100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:08.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.978+0000 7fefcb6bb700 1 --2- 172.21.15.2:0/4259815355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefc40ffdb0 0x7fefc4100230 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fefb4009910 tx=0x7fefb4009c20 comp rx=0 tx=0).stop 2024-09-13T22:56:08.979 INFO:tasks.workunit.client.0.smithi002.stdout:2/377: creat d1/d32/d37/f7b x:0 0 0 2024-09-13T22:56:08.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.978+0000 7fefcb6bb700 1 -- 172.21.15.2:0/4259815355 shutdown_connections 2024-09-13T22:56:08.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.978+0000 7fefcb6bb700 1 --2- 172.21.15.2:0/4259815355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefc40ffdb0 0x7fefc4100230 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:08.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.978+0000 7fefcb6bb700 1 --2- 172.21.15.2:0/4259815355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefc4101150 0x7fefc4101570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:08.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.978+0000 7fefcb6bb700 1 -- 172.21.15.2:0/4259815355 >> 172.21.15.2:0/4259815355 conn(0x7fefc40fa8c0 msgr2=0x7fefc40fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:08.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.979+0000 7fefcb6bb700 1 -- 172.21.15.2:0/4259815355 shutdown_connections 2024-09-13T22:56:08.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.979+0000 7fefcb6bb700 1 -- 172.21.15.2:0/4259815355 wait complete. 2024-09-13T22:56:08.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.979+0000 7fefcb6bb700 1 Processor -- start 2024-09-13T22:56:08.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.979+0000 7fefcb6bb700 1 -- start start 2024-09-13T22:56:08.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.979+0000 7fefcb6bb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefc40ffdb0 0x7fefc40ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:08.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.979+0000 7fefcb6bb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefc4101150 0x7fefc419b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:08.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.979+0000 7fefcb6bb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc419b7b0 con 0x7fefc4101150 2024-09-13T22:56:08.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.979+0000 7fefcb6bb700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc419b920 con 0x7fefc40ffdb0 2024-09-13T22:56:08.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.980+0000 7fefc8c56700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefc4101150 0x7fefc419b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:08.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.980+0000 7fefc9457700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefc40ffdb0 0x7fefc40ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:08.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.980+0000 7fefc9457700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefc40ffdb0 0x7fefc40ff820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.2:56318/0 (socket says 172.21.15.2:56318) 2024-09-13T22:56:08.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.980+0000 7fefc9457700 1 -- 172.21.15.2:0/1013708949 learned_addr learned my addr 172.21.15.2:0/1013708949 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:56:08.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.980+0000 7fefc8c56700 1 -- 172.21.15.2:0/1013708949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefc40ffdb0 msgr2=0x7fefc40ff820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:08.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.980+0000 7fefc8c56700 1 --2- 172.21.15.2:0/1013708949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefc40ffdb0 0x7fefc40ff820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:08.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.980+0000 7fefc8c56700 1 -- 172.21.15.2:0/1013708949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb40095f0 con 0x7fefc4101150 2024-09-13T22:56:08.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.980+0000 7fefc9457700 1 --2- 172.21.15.2:0/1013708949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefc40ffdb0 0x7fefc40ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T22:56:08.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.980+0000 7fefc8c56700 1 --2- 172.21.15.2:0/1013708949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefc4101150 0x7fefc419b1e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fefb4009910 tx=0x7fefb400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:08.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.981+0000 7fefba7fc700 1 -- 172.21.15.2:0/1013708949 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefb401d070 con 0x7fefc4101150 2024-09-13T22:56:08.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.981+0000 7fefcb6bb700 1 -- 172.21.15.2:0/1013708949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc419bba0 con 0x7fefc4101150 2024-09-13T22:56:08.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.981+0000 7fefba7fc700 1 -- 172.21.15.2:0/1013708949 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fefb4005dc0 con 0x7fefc4101150 2024-09-13T22:56:08.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.981+0000 7fefba7fc700 1 -- 172.21.15.2:0/1013708949 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefb4017630 con 0x7fefc4101150 2024-09-13T22:56:08.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.981+0000 7fefcb6bb700 1 -- 172.21.15.2:0/1013708949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc419c090 con 0x7fefc4101150 2024-09-13T22:56:08.984 INFO:tasks.workunit.client.1.smithi047.stdout:6/508: write d3/d11/d2b/d1c/d4d/fa6 [127224,106650] 0 2024-09-13T22:56:08.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.982+0000 7fefcb6bb700 1 -- 172.21.15.2:0/1013708949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc41086f0 con 0x7fefc4101150 2024-09-13T22:56:08.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.983+0000 7fefba7fc700 1 -- 172.21.15.2:0/1013708949 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) v1 ==== 91460+0+0 (secure 0 0 0) 0x7fefb40038a0 con 0x7fefc4101150 2024-09-13T22:56:08.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.983+0000 7fefba7fc700 1 --2- 172.21.15.2:0/1013708949 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7fefb006d530 0x7fefb006f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:08.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.984+0000 7fefba7fc700 1 -- 172.21.15.2:0/1013708949 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fefb408e270 con 0x7fefc4101150 2024-09-13T22:56:08.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.984+0000 7fefc9457700 1 --2- 172.21.15.2:0/1013708949 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7fefb006d530 0x7fefb006f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:08.986 INFO:tasks.workunit.client.0.smithi002.stdout:9/411: unlink d8/d10/f2f 0 2024-09-13T22:56:08.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.984+0000 7fefc9457700 1 --2- 172.21.15.2:0/1013708949 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7fefb006d530 0x7fefb006f9f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fefc0011550 tx=0x7fefc0009260 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:08.988 INFO:tasks.workunit.client.1.smithi047.stdout:1/466: dwrite d0/d7/d13/f56 [0,4194304] 0 2024-09-13T22:56:08.989 INFO:tasks.workunit.client.0.smithi002.stdout:0/397: creat d1/d2/d6c/f91 x:0 0 0 2024-09-13T22:56:08.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:08.989+0000 7fefba7fc700 1 -- 172.21.15.2:0/1013708949 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7fefb405b300 con 0x7fefc4101150 2024-09-13T22:56:08.991 INFO:tasks.workunit.client.0.smithi002.stdout:8/378: symlink d3/dc/d16/d60/l76 0 2024-09-13T22:56:08.992 INFO:tasks.workunit.client.0.smithi002.stdout:9/412: dwrite d8/d10/d1c/d3d/f7e [0,4194304] 0 2024-09-13T22:56:08.993 INFO:tasks.workunit.client.1.smithi047.stdout:7/530: dread d0/d7/f14 [0,4194304] 0 2024-09-13T22:56:08.997 INFO:tasks.workunit.client.0.smithi002.stdout:4/364: fdatasync d3/d14/d29/d2a/d30/f58 0 2024-09-13T22:56:08.997 INFO:tasks.workunit.client.1.smithi047.stdout:6/509: creat d3/d11/d2b/d1c/d4d/d69/fb1 x:0 0 0 2024-09-13T22:56:09.001 INFO:tasks.workunit.client.0.smithi002.stdout:5/372: dread d1/d2a/d41/d45/f48 [0,4194304] 0 2024-09-13T22:56:09.004 INFO:tasks.workunit.client.0.smithi002.stdout:9/413: dread f0 [0,4194304] 0 2024-09-13T22:56:09.005 INFO:tasks.workunit.client.0.smithi002.stdout:9/414: truncate d8/f70 14339 0 2024-09-13T22:56:09.008 INFO:tasks.workunit.client.1.smithi047.stdout:9/427: link d1/dc/d14/dd/d54/d50/l6d d1/d5f/d6a/l89 0 2024-09-13T22:56:09.010 INFO:tasks.workunit.client.0.smithi002.stdout:4/365: dread d3/f1e [0,4194304] 0 2024-09-13T22:56:09.011 INFO:tasks.workunit.client.1.smithi047.stdout:5/436: dwrite d19/d23/d2e/d41/f51 [4194304,4194304] 0 2024-09-13T22:56:09.011 INFO:tasks.workunit.client.0.smithi002.stdout:7/325: link d8/d9/f54 d8/d10/d11/d13/d2e/d50/f55 0 2024-09-13T22:56:09.014 INFO:tasks.workunit.client.0.smithi002.stdout:6/373: link d12/f14 d12/d17/d34/d4b/f7a 0 2024-09-13T22:56:09.015 INFO:tasks.workunit.client.1.smithi047.stdout:7/531: readlink d0/d7/da/l41 0 2024-09-13T22:56:09.020 INFO:tasks.workunit.client.1.smithi047.stdout:0/513: rmdir d1/d5/d91/da9 0 2024-09-13T22:56:09.021 INFO:tasks.workunit.client.0.smithi002.stdout:8/379: rmdir d3/d21/d57 39 2024-09-13T22:56:09.022 INFO:tasks.workunit.client.0.smithi002.stdout:8/380: readlink d3/l12 0 2024-09-13T22:56:09.024 INFO:tasks.workunit.client.0.smithi002.stdout:0/398: rename d1/d4/d75/c71 to d1/d4/d75/d31/d32/c92 0 2024-09-13T22:56:09.025 INFO:tasks.workunit.client.1.smithi047.stdout:9/428: symlink d1/dc/d14/dd/d54/d4e/l8a 0 2024-09-13T22:56:09.027 INFO:tasks.workunit.client.0.smithi002.stdout:3/450: symlink d9/d3b/d53/d95/la1 0 2024-09-13T22:56:09.030 INFO:tasks.workunit.client.0.smithi002.stdout:5/373: unlink d1/d2a/d41/d55/d56/l67 0 2024-09-13T22:56:09.031 INFO:tasks.workunit.client.0.smithi002.stdout:5/374: dread - d1/d2a/d41/d55/f5f zero size 2024-09-13T22:56:09.031 INFO:tasks.workunit.client.0.smithi002.stdout:3/451: dread d9/d15/d35/f9d [0,4194304] 0 2024-09-13T22:56:09.032 INFO:tasks.workunit.client.1.smithi047.stdout:9/429: dwrite d1/dc/d14/dd/d54/d4e/f7b [0,4194304] 0 2024-09-13T22:56:09.034 INFO:tasks.workunit.client.0.smithi002.stdout:9/415: mknod d8/d2c/d50/c8e 0 2024-09-13T22:56:09.035 INFO:tasks.workunit.client.1.smithi047.stdout:7/532: chown d0/d7/da/d1e/c2f 4 1 2024-09-13T22:56:09.037 INFO:tasks.workunit.client.0.smithi002.stdout:2/378: creat d1/d32/d37/d79/f7c x:0 0 0 2024-09-13T22:56:09.042 INFO:tasks.workunit.client.1.smithi047.stdout:4/535: write dc/d29/f61 [5157015,46559] 0 2024-09-13T22:56:09.047 INFO:tasks.workunit.client.1.smithi047.stdout:9/430: mknod d1/dc/d14/dd/d54/d4e/d51/c8b 0 2024-09-13T22:56:09.049 INFO:tasks.workunit.client.1.smithi047.stdout:7/533: rename d0/d7/da/d2e/d37 to d0/d7/da/d2e/db5 0 2024-09-13T22:56:09.054 INFO:tasks.workunit.client.1.smithi047.stdout:6/510: link d3/d11/d2b/d1c/c4a d3/d11/d2b/d1c/d70/d89/d8e/cb2 0 2024-09-13T22:56:09.055 INFO:tasks.workunit.client.1.smithi047.stdout:6/511: chown d3/d11/d2b/d4c/l65 11428155 1 2024-09-13T22:56:09.057 INFO:tasks.workunit.client.1.smithi047.stdout:5/437: link d19/d23/d2e/d41/c8b d19/d23/d4c/c94 0 2024-09-13T22:56:09.057 INFO:tasks.workunit.client.0.smithi002.stdout:9/416: rmdir d8/d10/d1c 39 2024-09-13T22:56:09.058 INFO:tasks.workunit.client.1.smithi047.stdout:5/438: fdatasync d19/d25/f38 0 2024-09-13T22:56:09.062 INFO:tasks.workunit.client.0.smithi002.stdout:7/326: link d8/d10/f2b d8/d10/d11/d13/d2e/d3c/f56 0 2024-09-13T22:56:09.062 INFO:tasks.workunit.client.0.smithi002.stdout:7/327: fsync d8/d10/d11/f2d 0 2024-09-13T22:56:09.065 INFO:tasks.workunit.client.1.smithi047.stdout:7/534: mkdir d0/d57/d5b/d5c/db6 0 2024-09-13T22:56:09.066 INFO:tasks.workunit.client.1.smithi047.stdout:7/535: fdatasync d0/d7/fa9 0 2024-09-13T22:56:09.067 INFO:tasks.workunit.client.1.smithi047.stdout:6/512: creat d3/d11/d74/fb3 x:0 0 0 2024-09-13T22:56:09.068 INFO:tasks.workunit.client.0.smithi002.stdout:0/399: mknod d1/d2/c93 0 2024-09-13T22:56:09.073 INFO:tasks.workunit.client.0.smithi002.stdout:5/375: getdents d1/d10 0 2024-09-13T22:56:09.074 INFO:tasks.workunit.client.1.smithi047.stdout:7/536: dread d0/d7/da/d4e/f66 [0,4194304] 0 2024-09-13T22:56:09.075 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:08 smithi002 ceph-mon[27637]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:09.076 INFO:tasks.workunit.client.0.smithi002.stdout:9/417: write d8/d10/d1c/d3d/f7d [4909238,115318] 0 2024-09-13T22:56:09.078 INFO:tasks.workunit.client.0.smithi002.stdout:2/379: mkdir d1/d7d 0 2024-09-13T22:56:09.079 INFO:tasks.workunit.client.0.smithi002.stdout:2/380: chown d1/f5 163 1 2024-09-13T22:56:09.080 INFO:tasks.workunit.client.0.smithi002.stdout:2/381: dread - d1/d32/d37/f73 zero size 2024-09-13T22:56:09.082 INFO:tasks.workunit.client.0.smithi002.stdout:7/328: creat d8/d9/f57 x:0 0 0 2024-09-13T22:56:09.084 INFO:tasks.workunit.client.0.smithi002.stdout:6/374: creat d12/d17/d34/f7b x:0 0 0 2024-09-13T22:56:09.085 INFO:tasks.workunit.client.0.smithi002.stdout:6/375: write f1 [4102804,126726] 0 2024-09-13T22:56:09.090 INFO:tasks.workunit.client.0.smithi002.stdout:3/452: rename d9/d15/d26/d93/l4d to d9/la2 0 2024-09-13T22:56:09.091 INFO:tasks.workunit.client.1.smithi047.stdout:4/536: rmdir dc/d29/d4c/db0 0 2024-09-13T22:56:09.094 INFO:tasks.workunit.client.1.smithi047.stdout:9/431: rename d1/dc/d14/dd/d54/d4e/f6c to d1/dc/d14/dd/d54/f8c 0 2024-09-13T22:56:09.095 INFO:tasks.workunit.client.0.smithi002.stdout:2/382: mknod d1/d7/d8/d2c/c7e 0 2024-09-13T22:56:09.099 INFO:tasks.workunit.client.0.smithi002.stdout:6/376: symlink d12/d17/d4e/l7c 0 2024-09-13T22:56:09.103 INFO:tasks.workunit.client.0.smithi002.stdout:5/376: rename d1/l14 to d1/d57/l87 0 2024-09-13T22:56:09.104 INFO:tasks.workunit.client.0.smithi002.stdout:3/453: symlink d9/d91/la3 0 2024-09-13T22:56:09.129 INFO:tasks.workunit.client.0.smithi002.stdout:8/381: link d3/d27/c2c d3/dc/d34/c77 0 2024-09-13T22:56:09.131 INFO:tasks.workunit.client.0.smithi002.stdout:0/400: write d1/d4/f7 [6843117,104303] 0 2024-09-13T22:56:09.132 INFO:tasks.workunit.client.0.smithi002.stdout:9/418: rename d8/d10/l5e to d8/d10/d53/l8f 0 2024-09-13T22:56:09.133 INFO:tasks.workunit.client.0.smithi002.stdout:8/382: truncate d3/dc/d16/d60/f74 452021 0 2024-09-13T22:56:09.135 INFO:tasks.workunit.client.0.smithi002.stdout:8/383: write d3/f4f [4579487,83177] 0 2024-09-13T22:56:09.138 INFO:tasks.workunit.client.0.smithi002.stdout:5/377: rename d1/d2a/d41 to d1/d2a/d6b/d88 0 2024-09-13T22:56:09.139 INFO:tasks.workunit.client.0.smithi002.stdout:5/378: readlink d1/d10/l3b 0 2024-09-13T22:56:09.139 INFO:tasks.workunit.client.0.smithi002.stdout:0/401: mknod d1/d2/d81/d8f/c94 0 2024-09-13T22:56:09.140 INFO:tasks.workunit.client.0.smithi002.stdout:5/379: chown d1/d10/f51 7882 1 2024-09-13T22:56:09.141 INFO:tasks.workunit.client.0.smithi002.stdout:3/454: link d9/d15/d36/d4e/f9f d9/d15/d51/d98/fa4 0 2024-09-13T22:56:09.143 INFO:tasks.workunit.client.0.smithi002.stdout:0/402: mknod d1/d2/d81/d8f/c95 0 2024-09-13T22:56:09.144 INFO:tasks.workunit.client.0.smithi002.stdout:9/419: creat d8/d10/d53/d63/d87/f90 x:0 0 0 2024-09-13T22:56:09.146 INFO:tasks.workunit.client.0.smithi002.stdout:9/420: dread - d8/d10/d42/f76 zero size 2024-09-13T22:56:09.147 INFO:tasks.workunit.client.0.smithi002.stdout:5/380: symlink d1/d2a/d6b/d88/d55/d56/d86/l89 0 2024-09-13T22:56:09.148 INFO:tasks.workunit.client.0.smithi002.stdout:3/455: dwrite d9/fd [0,4194304] 0 2024-09-13T22:56:09.152 INFO:tasks.workunit.client.0.smithi002.stdout:5/381: rmdir d1/d2a/d6b/d88/d45/d4f 39 2024-09-13T22:56:09.154 INFO:tasks.workunit.client.0.smithi002.stdout:3/456: rename d9/d15/d51/d98 to d9/d3b/da5 0 2024-09-13T22:56:09.157 INFO:tasks.workunit.client.0.smithi002.stdout:9/421: getdents d8/d10 0 2024-09-13T22:56:09.158 INFO:tasks.workunit.client.0.smithi002.stdout:0/403: dwrite d1/d4/d75/d31/d32/f50 [0,4194304] 0 2024-09-13T22:56:09.159 INFO:tasks.workunit.client.0.smithi002.stdout:9/422: readlink d8/d10/l33 0 2024-09-13T22:56:09.160 INFO:tasks.workunit.client.0.smithi002.stdout:0/404: truncate d1/f6f 778344 0 2024-09-13T22:56:09.162 INFO:tasks.workunit.client.0.smithi002.stdout:5/382: creat d1/d2a/d6b/d88/d45/f8a x:0 0 0 2024-09-13T22:56:09.164 INFO:tasks.workunit.client.0.smithi002.stdout:9/423: mkdir d8/d91 0 2024-09-13T22:56:09.169 INFO:tasks.workunit.client.0.smithi002.stdout:5/383: mkdir d1/d2a/d6b/d88/d45/d4f/d78/d8b 0 2024-09-13T22:56:09.173 INFO:tasks.workunit.client.0.smithi002.stdout:0/405: dwrite d1/d2/d81/d8f/f70 [0,4194304] 0 2024-09-13T22:56:09.173 INFO:tasks.workunit.client.0.smithi002.stdout:5/384: write d1/d2a/f7d [957249,8030] 0 2024-09-13T22:56:09.175 INFO:tasks.workunit.client.0.smithi002.stdout:3/457: dwrite d9/f1a [0,4194304] 0 2024-09-13T22:56:09.184 INFO:tasks.workunit.client.0.smithi002.stdout:3/458: getdents d9/d15/d46 0 2024-09-13T22:56:09.185 INFO:tasks.workunit.client.0.smithi002.stdout:0/406: link d1/d2/fd d1/d4/f96 0 2024-09-13T22:56:09.188 INFO:tasks.workunit.client.0.smithi002.stdout:0/407: truncate d1/d2/f6e 862178 0 2024-09-13T22:56:09.188 INFO:tasks.workunit.client.0.smithi002.stdout:5/385: dwrite d1/fe [0,4194304] 0 2024-09-13T22:56:09.190 INFO:tasks.workunit.client.0.smithi002.stdout:9/424: dread d8/d1e/f45 [0,4194304] 0 2024-09-13T22:56:09.193 INFO:tasks.workunit.client.0.smithi002.stdout:5/386: rename d1/f3f to d1/d2a/d5a/f8c 0 2024-09-13T22:56:09.194 INFO:tasks.workunit.client.0.smithi002.stdout:5/387: chown d1/d2a/d6b/d88/d45/f48 1071008828 1 2024-09-13T22:56:09.196 INFO:tasks.workunit.client.0.smithi002.stdout:0/408: creat d1/d2/d6c/d8b/f97 x:0 0 0 2024-09-13T22:56:09.197 INFO:tasks.workunit.client.0.smithi002.stdout:9/425: creat d8/d10/d1c/d3d/f92 x:0 0 0 2024-09-13T22:56:09.197 INFO:tasks.workunit.client.0.smithi002.stdout:3/459: write f5 [2709603,69373] 0 2024-09-13T22:56:09.198 INFO:tasks.workunit.client.0.smithi002.stdout:5/388: symlink d1/d2a/d6b/d88/d55/d56/l8d 0 2024-09-13T22:56:09.199 INFO:tasks.workunit.client.0.smithi002.stdout:0/409: mknod d1/d2/d6c/d8b/c98 0 2024-09-13T22:56:09.199 INFO:tasks.workunit.client.0.smithi002.stdout:9/426: symlink d8/d10/d1c/d3d/l93 0 2024-09-13T22:56:09.203 INFO:tasks.workunit.client.0.smithi002.stdout:0/410: symlink d1/l99 0 2024-09-13T22:56:09.203 INFO:tasks.workunit.client.0.smithi002.stdout:9/427: mkdir d8/d10/d53/d94 0 2024-09-13T22:56:09.205 INFO:tasks.workunit.client.0.smithi002.stdout:0/411: creat d1/d2/d49/d7d/f9a x:0 0 0 2024-09-13T22:56:09.208 INFO:tasks.workunit.client.0.smithi002.stdout:0/412: dread - d1/d2/d6c/d8b/f8c zero size 2024-09-13T22:56:09.208 INFO:tasks.workunit.client.0.smithi002.stdout:5/389: truncate d1/f43 519738 0 2024-09-13T22:56:09.208 INFO:tasks.workunit.client.0.smithi002.stdout:3/460: write d9/d15/d35/f3a [665735,88700] 0 2024-09-13T22:56:09.210 INFO:tasks.workunit.client.0.smithi002.stdout:5/390: fdatasync d1/d2a/d6b/d88/f4d 0 2024-09-13T22:56:09.210 INFO:tasks.workunit.client.0.smithi002.stdout:0/413: write d1/d4/d75/d31/f41 [4302471,58750] 0 2024-09-13T22:56:09.212 INFO:tasks.workunit.client.0.smithi002.stdout:9/428: dwrite d8/d1e/f67 [0,4194304] 0 2024-09-13T22:56:09.212 INFO:tasks.workunit.client.0.smithi002.stdout:5/391: readlink d1/d2a/l34 0 2024-09-13T22:56:09.212 INFO:tasks.workunit.client.0.smithi002.stdout:3/461: mknod d9/ca6 0 2024-09-13T22:56:09.215 INFO:tasks.workunit.client.1.smithi047.stdout:7/537: mkdir d0/d7/da/d1e/d93/db7 0 2024-09-13T22:56:09.216 INFO:tasks.workunit.client.0.smithi002.stdout:0/414: mknod d1/d2/c9b 0 2024-09-13T22:56:09.217 INFO:tasks.workunit.client.0.smithi002.stdout:1/420: sync 2024-09-13T22:56:09.217 INFO:tasks.workunit.client.1.smithi047.stdout:6/513: write d3/d11/f3f [4237137,31772] 0 2024-09-13T22:56:09.218 INFO:tasks.workunit.client.0.smithi002.stdout:0/415: truncate d1/d2/f67 475165 0 2024-09-13T22:56:09.219 INFO:tasks.workunit.client.1.smithi047.stdout:7/538: write d0/f29 [3961008,52972] 0 2024-09-13T22:56:09.219 INFO:tasks.workunit.client.0.smithi002.stdout:3/462: unlink d9/d15/d36/f7a 0 2024-09-13T22:56:09.222 INFO:tasks.workunit.client.0.smithi002.stdout:9/429: mknod d8/d10/d53/c95 0 2024-09-13T22:56:09.224 INFO:tasks.workunit.client.0.smithi002.stdout:5/392: rename d1/f13 to d1/d2a/d6b/d88/d45/d4f/d78/d8b/f8e 0 2024-09-13T22:56:09.225 INFO:tasks.workunit.client.1.smithi047.stdout:5/439: dwrite d19/d23/d32/f55 [0,4194304] 0 2024-09-13T22:56:09.225 INFO:tasks.workunit.client.0.smithi002.stdout:5/393: readlink d1/d2a/d6b/d88/d45/l47 0 2024-09-13T22:56:09.227 INFO:tasks.workunit.client.1.smithi047.stdout:0/514: dwrite d1/d5/d16/d23/d2d/f5a [0,4194304] 0 2024-09-13T22:56:09.231 INFO:tasks.workunit.client.0.smithi002.stdout:0/416: creat d1/d2/d49/d7d/f9c x:0 0 0 2024-09-13T22:56:09.232 INFO:tasks.workunit.client.1.smithi047.stdout:4/537: rename f8 to dc/d29/d4d/fb4 0 2024-09-13T22:56:09.239 INFO:tasks.workunit.client.1.smithi047.stdout:5/440: write d19/f36 [1855404,104882] 0 2024-09-13T22:56:09.239 INFO:tasks.workunit.client.0.smithi002.stdout:0/417: mkdir d1/d7e/d9d 0 2024-09-13T22:56:09.240 INFO:tasks.workunit.client.0.smithi002.stdout:0/418: truncate d1/f6f 1733449 0 2024-09-13T22:56:09.240 INFO:tasks.workunit.client.1.smithi047.stdout:9/432: mkdir d1/dc/d14/dd/d54/d8d 0 2024-09-13T22:56:09.244 INFO:tasks.workunit.client.0.smithi002.stdout:1/421: rename d1/fb to d1/d13/d21/f8c 0 2024-09-13T22:56:09.245 INFO:tasks.workunit.client.1.smithi047.stdout:5/441: truncate d19/d25/f2b 2448522 0 2024-09-13T22:56:09.247 INFO:tasks.workunit.client.1.smithi047.stdout:9/433: fdatasync d1/dc/f43 0 2024-09-13T22:56:09.249 INFO:tasks.workunit.client.0.smithi002.stdout:3/463: rename d9/d3b/l74 to d9/df/d60/la7 0 2024-09-13T22:56:09.253 INFO:tasks.workunit.client.1.smithi047.stdout:0/515: dread d1/d5/d16/d23/d2d/f31 [0,4194304] 0 2024-09-13T22:56:09.255 INFO:tasks.workunit.client.1.smithi047.stdout:5/442: chown d19/d23/d2e/c2f 5 1 2024-09-13T22:56:09.256 INFO:tasks.workunit.client.1.smithi047.stdout:5/443: fdatasync d19/d34/d8e/f8f 0 2024-09-13T22:56:09.257 INFO:tasks.workunit.client.1.smithi047.stdout:9/434: read d1/dc/f15 [609561,89226] 0 2024-09-13T22:56:09.258 INFO:tasks.workunit.client.1.smithi047.stdout:9/435: stat d1/dc/d14/dd/d54/d4e/d51/d79 0 2024-09-13T22:56:09.259 INFO:tasks.workunit.client.1.smithi047.stdout:0/516: creat d1/d5/d16/d23/fae x:0 0 0 2024-09-13T22:56:09.260 INFO:tasks.workunit.client.1.smithi047.stdout:4/538: link dc/de/d23/d40/c60 dc/de/d17/d25/d9b/cb5 0 2024-09-13T22:56:09.260 INFO:tasks.workunit.client.1.smithi047.stdout:9/436: dread - d1/dc/d14/dd/d54/f8c zero size 2024-09-13T22:56:09.263 INFO:tasks.workunit.client.1.smithi047.stdout:5/444: write d19/d34/d42/d5d/f86 [988198,116770] 0 2024-09-13T22:56:09.263 INFO:tasks.workunit.client.1.smithi047.stdout:9/437: chown d1/dc/d14/dd/d54/f4f 13 1 2024-09-13T22:56:09.264 INFO:tasks.workunit.client.1.smithi047.stdout:4/539: rmdir dc/d29/d8e 39 2024-09-13T22:56:09.269 INFO:tasks.workunit.client.1.smithi047.stdout:5/445: mknod d19/d64/c95 0 2024-09-13T22:56:09.269 INFO:tasks.workunit.client.1.smithi047.stdout:0/517: dread d1/d5/d11/d2f/f38 [4194304,4194304] 0 2024-09-13T22:56:09.272 INFO:tasks.workunit.client.1.smithi047.stdout:5/446: fdatasync d19/f43 0 2024-09-13T22:56:09.272 INFO:tasks.workunit.client.1.smithi047.stdout:7/539: dwrite d0/d7/f6 [0,4194304] 0 2024-09-13T22:56:09.273 INFO:tasks.workunit.client.1.smithi047.stdout:6/514: dwrite d3/d11/d2b/d4c/d30/d48/f7e [0,4194304] 0 2024-09-13T22:56:09.280 INFO:tasks.workunit.client.1.smithi047.stdout:4/540: creat dc/de/d23/d40/d7b/d90/da6/fb6 x:0 0 0 2024-09-13T22:56:09.282 INFO:tasks.workunit.client.1.smithi047.stdout:5/447: symlink d19/d34/d6c/l96 0 2024-09-13T22:56:09.285 INFO:tasks.workunit.client.1.smithi047.stdout:7/540: creat d0/d57/d5b/d8b/fb8 x:0 0 0 2024-09-13T22:56:09.286 INFO:tasks.workunit.client.1.smithi047.stdout:4/541: creat dc/d29/d6c/fb7 x:0 0 0 2024-09-13T22:56:09.287 INFO:tasks.workunit.client.0.smithi002.stdout:1/422: creat d1/d13/d1d/d34/d51/f8d x:0 0 0 2024-09-13T22:56:09.288 INFO:tasks.workunit.client.0.smithi002.stdout:1/423: write d1/d13/d1d/f3a [1293614,33041] 0 2024-09-13T22:56:09.289 INFO:tasks.workunit.client.1.smithi047.stdout:4/542: chown dc/d29/d4d/f48 204698864 1 2024-09-13T22:56:09.290 INFO:tasks.workunit.client.0.smithi002.stdout:9/430: rename d8/d10/d53/d63 to d8/d91/d96 0 2024-09-13T22:56:09.291 INFO:tasks.workunit.client.1.smithi047.stdout:9/438: truncate d1/dc/f47 1775866 0 2024-09-13T22:56:09.292 INFO:tasks.workunit.client.1.smithi047.stdout:5/448: dwrite d19/d23/d4c/f7b [0,4194304] 0 2024-09-13T22:56:09.293 INFO:tasks.workunit.client.1.smithi047.stdout:9/439: stat d1/dc/d14/f2f 0 2024-09-13T22:56:09.294 INFO:tasks.workunit.client.0.smithi002.stdout:3/464: symlink d9/d15/d46/la8 0 2024-09-13T22:56:09.295 INFO:tasks.workunit.client.1.smithi047.stdout:7/541: dread d0/d7/da/d1e/d51/fa3 [0,4194304] 0 2024-09-13T22:56:09.295 INFO:tasks.workunit.client.1.smithi047.stdout:5/449: chown d19/d23/d2e/d41/d58/c68 79 1 2024-09-13T22:56:09.295 INFO:tasks.workunit.client.1.smithi047.stdout:9/440: chown d1/dc/d14/f4a 0 1 2024-09-13T22:56:09.297 INFO:tasks.workunit.client.1.smithi047.stdout:5/450: fdatasync d19/d64/f93 0 2024-09-13T22:56:09.299 INFO:tasks.workunit.client.1.smithi047.stdout:6/515: dread d3/f42 [0,4194304] 0 2024-09-13T22:56:09.301 INFO:tasks.workunit.client.1.smithi047.stdout:3/511: sync 2024-09-13T22:56:09.305 INFO:tasks.workunit.client.0.smithi002.stdout:9/431: mknod d8/d2c/c97 0 2024-09-13T22:56:09.306 INFO:tasks.workunit.client.1.smithi047.stdout:0/518: truncate d1/d5/d16/d23/d45/d7f/f78 2075296 0 2024-09-13T22:56:09.307 INFO:tasks.workunit.client.0.smithi002.stdout:9/432: chown d8/d1e/c5d 0 1 2024-09-13T22:56:09.307 INFO:tasks.workunit.client.0.smithi002.stdout:9/433: chown d8/d1e/f67 6 1 2024-09-13T22:56:09.308 INFO:tasks.workunit.client.0.smithi002.stdout:3/465: symlink d9/d15/d36/d4e/la9 0 2024-09-13T22:56:09.311 INFO:tasks.workunit.client.1.smithi047.stdout:0/519: dread - d1/f6e zero size 2024-09-13T22:56:09.316 INFO:tasks.workunit.client.1.smithi047.stdout:7/542: rename d0/f81 to d0/d7/fb9 0 2024-09-13T22:56:09.319 INFO:tasks.workunit.client.1.smithi047.stdout:0/520: creat d1/d5/d16/d23/d45/d7f/faf x:0 0 0 2024-09-13T22:56:09.320 INFO:tasks.workunit.client.1.smithi047.stdout:6/516: write d3/d11/d2b/d1c/f20 [2890396,95389] 0 2024-09-13T22:56:09.321 INFO:tasks.workunit.client.1.smithi047.stdout:6/517: chown d3/d11/d2b/d4c/c67 398650087 1 2024-09-13T22:56:09.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.321+0000 7fefcb6bb700 1 -- 172.21.15.2:0/1013708949 --> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fefc4105710 con 0x7fefb006d530 2024-09-13T22:56:09.325 INFO:tasks.workunit.client.1.smithi047.stdout:4/543: rename dc/de/f53 to dc/de/d17/d70/fb8 0 2024-09-13T22:56:09.329 INFO:tasks.workunit.client.1.smithi047.stdout:4/544: write dc/d29/d4c/f79 [426845,84126] 0 2024-09-13T22:56:09.331 INFO:tasks.workunit.client.1.smithi047.stdout:3/512: dwrite d0/d3/d4/f4c [4194304,4194304] 0 2024-09-13T22:56:09.331 INFO:tasks.workunit.client.0.smithi002.stdout:4/366: sync 2024-09-13T22:56:09.332 INFO:tasks.workunit.client.1.smithi047.stdout:7/543: dread d0/db/fc [0,4194304] 0 2024-09-13T22:56:09.332 INFO:tasks.workunit.client.1.smithi047.stdout:4/545: fdatasync dc/d29/f61 0 2024-09-13T22:56:09.333 INFO:tasks.workunit.client.0.smithi002.stdout:1/424: write d1/ff [1998064,121606] 0 2024-09-13T22:56:09.334 INFO:tasks.workunit.client.1.smithi047.stdout:7/544: read d0/faf [3225501,2948] 0 2024-09-13T22:56:09.336 INFO:tasks.workunit.client.1.smithi047.stdout:6/518: dwrite d3/d11/d2b/d4c/f36 [0,4194304] 0 2024-09-13T22:56:09.339 INFO:tasks.workunit.client.0.smithi002.stdout:9/434: dwrite d8/d2c/f58 [0,4194304] 0 2024-09-13T22:56:09.343 INFO:tasks.workunit.client.0.smithi002.stdout:3/466: rename l2 to d9/d3b/d7c/laa 0 2024-09-13T22:56:09.343 INFO:tasks.workunit.client.1.smithi047.stdout:6/519: chown d3/d11/d2b/d4c/l65 0 1 2024-09-13T22:56:09.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.343+0000 7fefba7fc700 1 -- 172.21.15.2:0/1013708949 <== mgr.14590 v2:172.21.15.47:6828/1914885837 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fefc4105710 con 0x7fefb006d530 2024-09-13T22:56:09.344 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:56:09.344 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (7m) 15s ago 8m 26.2M - 0.25.0 c8568f914cd2 76a1576b4f53 2024-09-13T22:56:09.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (8m) 15s ago 8m 7629k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T22:56:09.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (7m) 4s ago 7m 7625k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T22:56:09.345 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (8m) 15s ago 8m 6665k - 18.2.1 5be31c24972a de910e0c5157 2024-09-13T22:56:09.345 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (7m) 4s ago 7m 6651k - 18.2.1 5be31c24972a 9f4bcfa66588 2024-09-13T22:56:09.345 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (6m) 15s ago 8m 83.8M - 9.4.7 954c08fa6188 39f4cfdc98d7 2024-09-13T22:56:09.345 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (2m) 15s ago 2m 13.1M - 18.2.1 5be31c24972a 59e9c88c31ca 2024-09-13T22:56:09.345 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (2m) 15s ago 2m 211M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T22:56:09.345 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (2m) 4s ago 2m 196M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T22:56:09.345 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (2m) 4s ago 2m 16.2M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T22:56:09.345 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:9283,8765,8443 running (9m) 15s ago 9m 221M - 18.2.1 5be31c24972a 04da5b94f858 2024-09-13T22:56:09.345 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (50s) 4s ago 7m 479M - 19.1.1-324-gecab7be5 0652ff2b5d78 5426cb59db1c 2024-09-13T22:56:09.345 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (9m) 15s ago 9m 49.2M 2048M 18.2.1 5be31c24972a de11be74385d 2024-09-13T22:56:09.345 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (7m) 4s ago 7m 39.6M 2048M 18.2.1 5be31c24972a 5642284a23bf 2024-09-13T22:56:09.345 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (8m) 15s ago 8m 15.5M - 1.5.0 0da6a335fe13 427e04f7ded9 2024-09-13T22:56:09.346 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (7m) 4s ago 7m 15.5M - 1.5.0 0da6a335fe13 07935c82b1d6 2024-09-13T22:56:09.346 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (6m) 15s ago 6m 88.7M 1217M 18.2.1 5be31c24972a 1e1f6936c402 2024-09-13T22:56:09.346 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (6m) 15s ago 6m 95.8M 1217M 18.2.1 5be31c24972a f0ac78c34831 2024-09-13T22:56:09.346 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (5m) 15s ago 5m 102M 1217M 18.2.1 5be31c24972a 9a2f4f6decfb 2024-09-13T22:56:09.346 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (5m) 4s ago 5m 107M 4972M 18.2.1 5be31c24972a fb455cc4c571 2024-09-13T22:56:09.346 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (4m) 4s ago 4m 100M 4972M 18.2.1 5be31c24972a f1bdc2c50535 2024-09-13T22:56:09.346 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (4m) 4s ago 4m 91.1M 4972M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T22:56:09.346 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (6m) 15s ago 8m 60.9M - 2.43.0 a07b618ecd1d f0199b20cefc 2024-09-13T22:56:09.347 INFO:tasks.workunit.client.1.smithi047.stdout:3/513: dwrite d0/d3/d4/f4c [0,4194304] 0 2024-09-13T22:56:09.347 INFO:tasks.workunit.client.0.smithi002.stdout:4/367: symlink d3/d14/d29/d2a/d30/l6d 0 2024-09-13T22:56:09.347 INFO:tasks.workunit.client.0.smithi002.stdout:4/368: dread - d3/d14/d29/d2a/f37 zero size 2024-09-13T22:56:09.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.347+0000 7fefcb6bb700 1 -- 172.21.15.2:0/1013708949 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7fefb006d530 msgr2=0x7fefb006f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:09.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.347+0000 7fefcb6bb700 1 --2- 172.21.15.2:0/1013708949 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7fefb006d530 0x7fefb006f9f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fefc0011550 tx=0x7fefc0009260 comp rx=0 tx=0).stop 2024-09-13T22:56:09.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.347+0000 7fefcb6bb700 1 -- 172.21.15.2:0/1013708949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefc4101150 msgr2=0x7fefc419b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:09.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.347+0000 7fefcb6bb700 1 --2- 172.21.15.2:0/1013708949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefc4101150 0x7fefc419b1e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fefb4009910 tx=0x7fefb400f690 comp rx=0 tx=0).stop 2024-09-13T22:56:09.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.347+0000 7fefcb6bb700 1 -- 172.21.15.2:0/1013708949 shutdown_connections 2024-09-13T22:56:09.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.347+0000 7fefcb6bb700 1 --2- 172.21.15.2:0/1013708949 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7fefb006d530 0x7fefb006f9f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:09.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.347+0000 7fefcb6bb700 1 --2- 172.21.15.2:0/1013708949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fefc40ffdb0 0x7fefc40ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:09.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.347+0000 7fefcb6bb700 1 --2- 172.21.15.2:0/1013708949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefc4101150 0x7fefc419b1e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:09.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.347+0000 7fefcb6bb700 1 -- 172.21.15.2:0/1013708949 >> 172.21.15.2:0/1013708949 conn(0x7fefc40fa8c0 msgr2=0x7fefc4103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:09.349 INFO:tasks.workunit.client.0.smithi002.stdout:4/369: chown d3/f24 81498 1 2024-09-13T22:56:09.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.348+0000 7fefcb6bb700 1 -- 172.21.15.2:0/1013708949 shutdown_connections 2024-09-13T22:56:09.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.348+0000 7fefcb6bb700 1 -- 172.21.15.2:0/1013708949 wait complete. 2024-09-13T22:56:09.351 INFO:tasks.workunit.client.0.smithi002.stdout:9/435: rename d8/d10/d42/c4f to d8/d10/d1c/c98 0 2024-09-13T22:56:09.351 INFO:tasks.workunit.client.1.smithi047.stdout:7/545: mknod d0/d7/da/d2e/db5/cba 0 2024-09-13T22:56:09.355 INFO:tasks.workunit.client.0.smithi002.stdout:3/467: read d9/d15/f42 [1647697,44937] 0 2024-09-13T22:56:09.358 INFO:tasks.workunit.client.0.smithi002.stdout:9/436: dwrite d8/d1e/f22 [4194304,4194304] 0 2024-09-13T22:56:09.359 INFO:tasks.workunit.client.0.smithi002.stdout:3/468: creat d9/d91/fab x:0 0 0 2024-09-13T22:56:09.360 INFO:tasks.workunit.client.0.smithi002.stdout:4/370: rmdir d3/d40/d45/d66 0 2024-09-13T22:56:09.362 INFO:tasks.workunit.client.0.smithi002.stdout:9/437: symlink d8/d91/d96/l99 0 2024-09-13T22:56:09.366 INFO:tasks.workunit.client.0.smithi002.stdout:9/438: creat d8/d10/d53/f9a x:0 0 0 2024-09-13T22:56:09.370 INFO:tasks.workunit.client.0.smithi002.stdout:9/439: truncate d8/d1e/f45 8123700 0 2024-09-13T22:56:09.371 INFO:tasks.workunit.client.0.smithi002.stdout:9/440: chown d8/d10/d1c/l65 847075821 1 2024-09-13T22:56:09.376 INFO:tasks.workunit.client.1.smithi047.stdout:4/546: mkdir dc/de/db9 0 2024-09-13T22:56:09.376 INFO:tasks.workunit.client.1.smithi047.stdout:7/546: creat d0/d7/da/d1e/d51/fbb x:0 0 0 2024-09-13T22:56:09.378 INFO:tasks.workunit.client.1.smithi047.stdout:3/514: getdents d0/d25/d95 0 2024-09-13T22:56:09.379 INFO:tasks.workunit.client.1.smithi047.stdout:7/547: creat d0/d57/d5b/d8b/fbc x:0 0 0 2024-09-13T22:56:09.381 INFO:tasks.workunit.client.1.smithi047.stdout:4/547: link dc/de/d17/d25/d4a/l76 dc/de/d39/lba 0 2024-09-13T22:56:09.384 INFO:tasks.workunit.client.1.smithi047.stdout:4/548: creat dc/de/d39/fbb x:0 0 0 2024-09-13T22:56:09.384 INFO:tasks.workunit.client.1.smithi047.stdout:7/548: dread d0/d7/f3c [0,4194304] 0 2024-09-13T22:56:09.389 INFO:tasks.workunit.client.1.smithi047.stdout:4/549: dwrite dc/de/d23/f96 [0,4194304] 0 2024-09-13T22:56:09.391 INFO:tasks.workunit.client.1.smithi047.stdout:4/550: truncate dc/de/d39/fbb 204994 0 2024-09-13T22:56:09.396 INFO:tasks.workunit.client.1.smithi047.stdout:4/551: dwrite fb [0,4194304] 0 2024-09-13T22:56:09.400 INFO:tasks.workunit.client.1.smithi047.stdout:4/552: mknod dc/d29/d8e/cbc 0 2024-09-13T22:56:09.401 INFO:tasks.workunit.client.1.smithi047.stdout:4/553: chown dc/d29/l58 2867 1 2024-09-13T22:56:09.405 INFO:tasks.workunit.client.1.smithi047.stdout:4/554: truncate dc/de/f18 3419167 0 2024-09-13T22:56:09.408 INFO:tasks.workunit.client.1.smithi047.stdout:4/555: unlink dc/de/d23/f80 0 2024-09-13T22:56:09.409 INFO:tasks.workunit.client.1.smithi047.stdout:0/521: write d1/f40 [1489211,811] 0 2024-09-13T22:56:09.412 INFO:tasks.workunit.client.0.smithi002.stdout:1/425: write d1/f15 [1374537,20666] 0 2024-09-13T22:56:09.414 INFO:tasks.workunit.client.0.smithi002.stdout:4/371: getdents d3/d14/d29/d2a/d30 0 2024-09-13T22:56:09.416 INFO:tasks.workunit.client.1.smithi047.stdout:0/522: getdents d1/d7 0 2024-09-13T22:56:09.418 INFO:tasks.workunit.client.1.smithi047.stdout:0/523: write d1/d5/d16/f94 [749706,76836] 0 2024-09-13T22:56:09.418 INFO:tasks.workunit.client.0.smithi002.stdout:1/426: unlink d1/d13/d30/d31/d3d/f48 0 2024-09-13T22:56:09.422 INFO:tasks.workunit.client.1.smithi047.stdout:0/524: unlink d1/d7/f4b 0 2024-09-13T22:56:09.422 INFO:tasks.workunit.client.1.smithi047.stdout:4/556: dread dc/de/d23/f6f [0,4194304] 0 2024-09-13T22:56:09.423 INFO:tasks.workunit.client.0.smithi002.stdout:1/427: mkdir d1/d13/d30/d31/d3d/d5d/d8e 0 2024-09-13T22:56:09.423 INFO:tasks.workunit.client.1.smithi047.stdout:4/557: write dc/de/d23/f55 [2296369,111955] 0 2024-09-13T22:56:09.425 INFO:tasks.workunit.client.0.smithi002.stdout:4/372: symlink d3/d40/l6e 0 2024-09-13T22:56:09.426 INFO:tasks.workunit.client.1.smithi047.stdout:0/525: creat d1/d5/d11/d2f/fb0 x:0 0 0 2024-09-13T22:56:09.427 INFO:tasks.workunit.client.1.smithi047.stdout:0/526: read d1/d7/f6c [44349,29019] 0 2024-09-13T22:56:09.429 INFO:tasks.workunit.client.1.smithi047.stdout:4/558: symlink dc/de/d23/d40/d7b/lbd 0 2024-09-13T22:56:09.430 INFO:tasks.workunit.client.0.smithi002.stdout:1/428: link d1/d13/d30/d31/d3d/d5d/f37 d1/d13/d30/d31/d86/f8f 0 2024-09-13T22:56:09.432 INFO:tasks.workunit.client.0.smithi002.stdout:1/429: read d1/d13/d30/d31/d3b/f67 [7075528,80620] 0 2024-09-13T22:56:09.436 INFO:tasks.workunit.client.1.smithi047.stdout:4/559: fsync dc/d29/f38 0 2024-09-13T22:56:09.437 INFO:tasks.workunit.client.0.smithi002.stdout:3/469: write d9/d15/f2d [5150022,22438] 0 2024-09-13T22:56:09.438 INFO:tasks.workunit.client.0.smithi002.stdout:3/470: chown d9/d91/f97 584167968 1 2024-09-13T22:56:09.441 INFO:tasks.workunit.client.1.smithi047.stdout:4/560: mknod dc/d29/cbe 0 2024-09-13T22:56:09.444 INFO:tasks.workunit.client.0.smithi002.stdout:2/383: sync 2024-09-13T22:56:09.444 INFO:tasks.workunit.client.0.smithi002.stdout:7/329: sync 2024-09-13T22:56:09.444 INFO:tasks.workunit.client.1.smithi047.stdout:6/520: truncate d3/d11/d2b/d1c/d70/f86 1408334 0 2024-09-13T22:56:09.446 INFO:tasks.workunit.client.0.smithi002.stdout:2/384: truncate d1/d7/d35/f48 2485968 0 2024-09-13T22:56:09.450 INFO:tasks.workunit.client.1.smithi047.stdout:3/515: truncate d0/d3/d4/d16/d2c/de/d1f/f8e 446292 0 2024-09-13T22:56:09.451 INFO:tasks.workunit.client.0.smithi002.stdout:7/330: mkdir d8/d10/d11/d13/d2e/d50/d52/d58 0 2024-09-13T22:56:09.453 INFO:tasks.workunit.client.1.smithi047.stdout:3/516: dread d0/d3/d4/d16/f4e [0,4194304] 0 2024-09-13T22:56:09.454 INFO:tasks.workunit.client.1.smithi047.stdout:4/561: dread dc/de/d17/d25/f36 [0,4194304] 0 2024-09-13T22:56:09.471 INFO:tasks.workunit.client.1.smithi047.stdout:6/521: getdents d3/d11/d2b/d1c/d4d/d69 0 2024-09-13T22:56:09.472 INFO:tasks.workunit.client.0.smithi002.stdout:2/385: link d1/d7/l3d d1/d7/d35/d3e/d59/l7f 0 2024-09-13T22:56:09.472 INFO:tasks.workunit.client.1.smithi047.stdout:6/522: dread - d3/fa5 zero size 2024-09-13T22:56:09.473 INFO:tasks.workunit.client.1.smithi047.stdout:3/517: symlink d0/d25/da3/la7 0 2024-09-13T22:56:09.473 INFO:tasks.workunit.client.0.smithi002.stdout:7/331: link f1 d8/d10/d11/d13/d2e/d3c/f59 0 2024-09-13T22:56:09.474 INFO:tasks.workunit.client.1.smithi047.stdout:0/527: write d1/d7/f81 [752950,20721] 0 2024-09-13T22:56:09.480 INFO:tasks.workunit.client.1.smithi047.stdout:0/528: dwrite d1/d5/f24 [0,4194304] 0 2024-09-13T22:56:09.481 INFO:tasks.workunit.client.0.smithi002.stdout:2/386: mkdir d1/d80 0 2024-09-13T22:56:09.482 INFO:tasks.workunit.client.0.smithi002.stdout:1/430: write d1/d13/d30/f53 [1611290,54305] 0 2024-09-13T22:56:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.487+0000 7f6f7b093700 1 -- 172.21.15.2:0/4147192704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f74100cb0 msgr2=0x7f6f741010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.487+0000 7f6f7b093700 1 --2- 172.21.15.2:0/4147192704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f74100cb0 0x7f6f741010d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009910 tx=0x7f6f68009c20 comp rx=0 tx=0).stop 2024-09-13T22:56:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.488+0000 7f6f7b093700 1 -- 172.21.15.2:0/4147192704 shutdown_connections 2024-09-13T22:56:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.488+0000 7f6f7b093700 1 --2- 172.21.15.2:0/4147192704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f74101eb0 0x7f6f74102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.488+0000 7f6f7b093700 1 --2- 172.21.15.2:0/4147192704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f74100cb0 0x7f6f741010d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.488+0000 7f6f7b093700 1 -- 172.21.15.2:0/4147192704 >> 172.21.15.2:0/4147192704 conn(0x7f6f740fc230 msgr2=0x7f6f740fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.488+0000 7f6f7b093700 1 -- 172.21.15.2:0/4147192704 shutdown_connections 2024-09-13T22:56:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.488+0000 7f6f7b093700 1 -- 172.21.15.2:0/4147192704 wait complete. 2024-09-13T22:56:09.489 INFO:tasks.workunit.client.1.smithi047.stdout:4/562: rmdir dc/da5 0 2024-09-13T22:56:09.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.489+0000 7f6f7b093700 1 Processor -- start 2024-09-13T22:56:09.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.489+0000 7f6f7b093700 1 -- start start 2024-09-13T22:56:09.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.489+0000 7f6f7b093700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f74100cb0 0x7f6f74074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:09.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.489+0000 7f6f7b093700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f74101eb0 0x7f6f74073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:09.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.489+0000 7f6f7b093700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7419a1b0 con 0x7f6f74101eb0 2024-09-13T22:56:09.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.489+0000 7f6f7b093700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7419a2f0 con 0x7f6f74100cb0 2024-09-13T22:56:09.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.490+0000 7f6f73fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f74101eb0 0x7f6f74073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:09.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.490+0000 7f6f73fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f74101eb0 0x7f6f74073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52312/0 (socket says 172.21.15.2:52312) 2024-09-13T22:56:09.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.490+0000 7f6f73fff700 1 -- 172.21.15.2:0/2569707651 learned_addr learned my addr 172.21.15.2:0/2569707651 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:56:09.491 INFO:tasks.workunit.client.0.smithi002.stdout:9/441: dwrite d8/d10/d1c/d3d/f44 [0,4194304] 0 2024-09-13T22:56:09.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.490+0000 7f6f73fff700 1 -- 172.21.15.2:0/2569707651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f74100cb0 msgr2=0x7f6f74074b30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T22:56:09.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.490+0000 7f6f73fff700 1 --2- 172.21.15.2:0/2569707651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f74100cb0 0x7f6f74074b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:09.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.490+0000 7f6f73fff700 1 -- 172.21.15.2:0/2569707651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f680095f0 con 0x7f6f74101eb0 2024-09-13T22:56:09.493 INFO:tasks.workunit.client.0.smithi002.stdout:1/431: rmdir d1/d13/d30 39 2024-09-13T22:56:09.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.491+0000 7f6f73fff700 1 --2- 172.21.15.2:0/2569707651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f74101eb0 0x7f6f74073180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000b4b0 tx=0x7f6f6000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:09.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.491+0000 7f6f71ffb700 1 -- 172.21.15.2:0/2569707651 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f60011800 con 0x7f6f74101eb0 2024-09-13T22:56:09.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.492+0000 7f6f7b093700 1 -- 172.21.15.2:0/2569707651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f740736c0 con 0x7f6f74101eb0 2024-09-13T22:56:09.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.492+0000 7f6f7b093700 1 -- 172.21.15.2:0/2569707651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f74073be0 con 0x7f6f74101eb0 2024-09-13T22:56:09.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.492+0000 7f6f71ffb700 1 -- 172.21.15.2:0/2569707651 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6f60011e10 con 0x7f6f74101eb0 2024-09-13T22:56:09.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.492+0000 7f6f71ffb700 1 -- 172.21.15.2:0/2569707651 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f600193b0 con 0x7f6f74101eb0 2024-09-13T22:56:09.494 INFO:tasks.workunit.client.1.smithi047.stdout:0/529: creat d1/d5/d16/d6a/d92/fb1 x:0 0 0 2024-09-13T22:56:09.494 INFO:tasks.workunit.client.1.smithi047.stdout:6/523: mknod d3/d11/d2b/cb4 0 2024-09-13T22:56:09.494 INFO:tasks.workunit.client.1.smithi047.stdout:0/530: write d1/d7/f81 [29657,29898] 0 2024-09-13T22:56:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.493+0000 7f6f7b093700 1 -- 172.21.15.2:0/2569707651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f74073eb0 con 0x7f6f74101eb0 2024-09-13T22:56:09.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.494+0000 7f6f71ffb700 1 -- 172.21.15.2:0/2569707651 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) v1 ==== 91460+0+0 (secure 0 0 0) 0x7f6f60019510 con 0x7f6f74101eb0 2024-09-13T22:56:09.495 INFO:tasks.workunit.client.1.smithi047.stdout:3/518: link d0/d3/d4/f4c d0/d25/d44/d43/d3a/d81/fa8 0 2024-09-13T22:56:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.495+0000 7f6f71ffb700 1 --2- 172.21.15.2:0/2569707651 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f6f6406d580 0x7f6f6406fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:09.496 INFO:tasks.workunit.client.1.smithi047.stdout:3/519: readlink d0/d3/d4/d16/d2c/l1b 0 2024-09-13T22:56:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.495+0000 7f6f71ffb700 1 -- 172.21.15.2:0/2569707651 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f6f6008c9f0 con 0x7f6f74101eb0 2024-09-13T22:56:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.496+0000 7f6f78e2f700 1 --2- 172.21.15.2:0/2569707651 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f6f6406d580 0x7f6f6406fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:09.497 INFO:tasks.workunit.client.0.smithi002.stdout:1/432: fsync d1/d13/d21/f5b 0 2024-09-13T22:56:09.498 INFO:tasks.workunit.client.0.smithi002.stdout:1/433: read d1/d13/f32 [425245,94877] 0 2024-09-13T22:56:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.498+0000 7f6f78e2f700 1 --2- 172.21.15.2:0/2569707651 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f6f6406d580 0x7f6f6406fa40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6f68000c00 tx=0x7f6f68005fb0 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:09.499 INFO:tasks.workunit.client.0.smithi002.stdout:9/442: rmdir d8/d91/d96/d87 39 2024-09-13T22:56:09.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.504+0000 7f6f71ffb700 1 -- 172.21.15.2:0/2569707651 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f6f60059c10 con 0x7f6f74101eb0 2024-09-13T22:56:09.509 INFO:tasks.workunit.client.1.smithi047.stdout:4/563: rename dc/de/f14 to dc/de/d17/d25/d9b/fbf 0 2024-09-13T22:56:09.510 INFO:tasks.workunit.client.1.smithi047.stdout:4/564: chown ca 30952986 1 2024-09-13T22:56:09.510 INFO:tasks.workunit.client.0.smithi002.stdout:9/443: mknod d8/c9b 0 2024-09-13T22:56:09.514 INFO:tasks.workunit.client.0.smithi002.stdout:9/444: rename d8/d10/c2d to d8/d10/d53/c9c 0 2024-09-13T22:56:09.515 INFO:tasks.workunit.client.0.smithi002.stdout:7/332: write d8/d9/f1a [8442387,6756] 0 2024-09-13T22:56:09.516 INFO:tasks.workunit.client.1.smithi047.stdout:3/520: dread d0/d3/d4/d16/d2c/de/d1f/d3b/f51 [0,4194304] 0 2024-09-13T22:56:09.516 INFO:tasks.workunit.client.0.smithi002.stdout:7/333: read d8/d10/f2a [1524554,125185] 0 2024-09-13T22:56:09.517 INFO:tasks.workunit.client.0.smithi002.stdout:7/334: chown d8/d10/d11/d13/d26/c31 6264 1 2024-09-13T22:56:09.517 INFO:tasks.workunit.client.0.smithi002.stdout:7/335: dread - d8/d10/d39/f4a zero size 2024-09-13T22:56:09.518 INFO:tasks.workunit.client.0.smithi002.stdout:7/336: chown d8/d10 1775 1 2024-09-13T22:56:09.520 INFO:tasks.workunit.client.1.smithi047.stdout:6/524: unlink d3/d2c/l3c 0 2024-09-13T22:56:09.521 INFO:tasks.workunit.client.1.smithi047.stdout:6/525: write d3/d11/d2b/d4c/d30/fa7 [613237,68549] 0 2024-09-13T22:56:09.522 INFO:tasks.workunit.client.0.smithi002.stdout:2/387: dwrite d1/f14 [0,4194304] 0 2024-09-13T22:56:09.527 INFO:tasks.workunit.client.0.smithi002.stdout:2/388: creat d1/d7/d35/d3e/d5e/f81 x:0 0 0 2024-09-13T22:56:09.531 INFO:tasks.workunit.client.0.smithi002.stdout:8/384: sync 2024-09-13T22:56:09.531 INFO:tasks.workunit.client.0.smithi002.stdout:6/377: sync 2024-09-13T22:56:09.532 INFO:tasks.workunit.client.0.smithi002.stdout:2/389: creat d1/d7/d8/d2c/f82 x:0 0 0 2024-09-13T22:56:09.533 INFO:tasks.workunit.client.0.smithi002.stdout:8/385: dread d3/dc/d16/d60/f74 [0,4194304] 0 2024-09-13T22:56:09.533 INFO:tasks.workunit.client.1.smithi047.stdout:0/531: write d1/f36 [1888153,51906] 0 2024-09-13T22:56:09.535 INFO:tasks.workunit.client.0.smithi002.stdout:1/434: write d1/d13/d1d/d34/d51/f82 [1081985,46098] 0 2024-09-13T22:56:09.538 INFO:tasks.workunit.client.1.smithi047.stdout:0/532: dread d1/d7/f6c [0,4194304] 0 2024-09-13T22:56:09.539 INFO:tasks.workunit.client.1.smithi047.stdout:0/533: chown d1/f2 323789 1 2024-09-13T22:56:09.539 INFO:tasks.workunit.client.1.smithi047.stdout:4/565: getdents dc/de/d23/d40/d7b 0 2024-09-13T22:56:09.540 INFO:tasks.workunit.client.1.smithi047.stdout:4/566: chown dc/d29/l9c 1857643804 1 2024-09-13T22:56:09.540 INFO:tasks.workunit.client.0.smithi002.stdout:8/386: dwrite d3/f61 [0,4194304] 0 2024-09-13T22:56:09.543 INFO:tasks.workunit.client.0.smithi002.stdout:6/378: mkdir d12/d17/d28/d7d 0 2024-09-13T22:56:09.546 INFO:tasks.workunit.client.1.smithi047.stdout:6/526: write d3/d11/d2b/d4c/d30/f5d [2021649,88960] 0 2024-09-13T22:56:09.547 INFO:tasks.workunit.client.1.smithi047.stdout:0/534: dread - d1/d5/d16/d23/d77/fa1 zero size 2024-09-13T22:56:09.547 INFO:tasks.workunit.client.1.smithi047.stdout:3/521: write d0/d25/d34/f4b [1520138,70094] 0 2024-09-13T22:56:09.549 INFO:tasks.workunit.client.0.smithi002.stdout:6/379: dwrite f5 [0,4194304] 0 2024-09-13T22:56:09.550 INFO:tasks.workunit.client.1.smithi047.stdout:6/527: write d3/d11/d2b/d4c/d30/fa7 [844759,11611] 0 2024-09-13T22:56:09.554 INFO:tasks.workunit.client.1.smithi047.stdout:0/535: creat d1/d5/d11/d2f/fb2 x:0 0 0 2024-09-13T22:56:09.558 INFO:tasks.workunit.client.0.smithi002.stdout:1/435: write d1/d1c/f26 [3767966,41230] 0 2024-09-13T22:56:09.558 INFO:tasks.workunit.client.0.smithi002.stdout:6/380: dwrite d12/f74 [0,4194304] 0 2024-09-13T22:56:09.559 INFO:tasks.workunit.client.0.smithi002.stdout:2/390: truncate d1/f1d 1305447 0 2024-09-13T22:56:09.562 INFO:tasks.workunit.client.1.smithi047.stdout:6/528: creat d3/d11/d2b/d1c/d4d/d69/fb5 x:0 0 0 2024-09-13T22:56:09.563 INFO:tasks.workunit.client.0.smithi002.stdout:9/445: readlink d8/d10/d1c/d68/d74/l80 0 2024-09-13T22:56:09.568 INFO:tasks.workunit.client.0.smithi002.stdout:8/387: truncate d3/f24 2934999 0 2024-09-13T22:56:09.570 INFO:tasks.workunit.client.1.smithi047.stdout:6/529: dwrite d3/d11/d2b/d4c/d30/d48/f7d [0,4194304] 0 2024-09-13T22:56:09.571 INFO:tasks.workunit.client.1.smithi047.stdout:6/530: chown d3/d11/d2b/d7c 30169 1 2024-09-13T22:56:09.574 INFO:tasks.workunit.client.0.smithi002.stdout:6/381: rename d12/d17/l50 to d12/d17/d4e/l7e 0 2024-09-13T22:56:09.580 INFO:tasks.workunit.client.1.smithi047.stdout:3/522: write d0/d3/d4/d16/d2c/f46 [1981511,63419] 0 2024-09-13T22:56:09.580 INFO:tasks.workunit.client.1.smithi047.stdout:4/567: link dc/d29/d4d/c71 dc/de/d17/cc0 0 2024-09-13T22:56:09.581 INFO:tasks.workunit.client.1.smithi047.stdout:6/531: dwrite d3/d11/d2b/d1c/d4d/d69/fb1 [0,4194304] 0 2024-09-13T22:56:09.584 INFO:tasks.workunit.client.1.smithi047.stdout:6/532: chown d3/d77/fa9 288472893 1 2024-09-13T22:56:09.585 INFO:tasks.workunit.client.1.smithi047.stdout:0/536: dwrite d1/d5/d16/d23/d2d/f31 [4194304,4194304] 0 2024-09-13T22:56:09.586 INFO:tasks.workunit.client.0.smithi002.stdout:9/446: dwrite d8/d10/d42/f7f [0,4194304] 0 2024-09-13T22:56:09.586 INFO:tasks.workunit.client.1.smithi047.stdout:4/568: dread - dc/de/d23/f99 zero size 2024-09-13T22:56:09.591 INFO:tasks.workunit.client.0.smithi002.stdout:1/436: mkdir d1/d13/d30/d31/d86/d90 0 2024-09-13T22:56:09.592 INFO:tasks.workunit.client.1.smithi047.stdout:3/523: mknod d0/d25/d95/ca9 0 2024-09-13T22:56:09.596 INFO:tasks.workunit.client.0.smithi002.stdout:2/391: creat d1/d80/f83 x:0 0 0 2024-09-13T22:56:09.599 INFO:tasks.workunit.client.1.smithi047.stdout:6/533: dwrite d3/d11/d2b/d1c/d4d/d69/fb5 [0,4194304] 0 2024-09-13T22:56:09.600 INFO:tasks.workunit.client.1.smithi047.stdout:4/569: mknod dc/de/d23/d40/d7b/d90/da6/cc1 0 2024-09-13T22:56:09.602 INFO:tasks.workunit.client.0.smithi002.stdout:9/447: symlink d8/d2c/d50/l9d 0 2024-09-13T22:56:09.603 INFO:tasks.workunit.client.1.smithi047.stdout:1/467: sync 2024-09-13T22:56:09.603 INFO:tasks.workunit.client.1.smithi047.stdout:2/592: sync 2024-09-13T22:56:09.603 INFO:tasks.workunit.client.1.smithi047.stdout:8/490: sync 2024-09-13T22:56:09.603 INFO:tasks.workunit.client.0.smithi002.stdout:5/394: sync 2024-09-13T22:56:09.603 INFO:tasks.workunit.client.0.smithi002.stdout:4/373: sync 2024-09-13T22:56:09.604 INFO:tasks.workunit.client.0.smithi002.stdout:3/471: sync 2024-09-13T22:56:09.604 INFO:tasks.workunit.client.0.smithi002.stdout:0/419: sync 2024-09-13T22:56:09.605 INFO:tasks.workunit.client.1.smithi047.stdout:3/524: mknod d0/d3/d4/d16/d2c/de/d1f/caa 0 2024-09-13T22:56:09.607 INFO:tasks.workunit.client.1.smithi047.stdout:0/537: creat d1/d5/d16/d23/d45/d7f/fb3 x:0 0 0 2024-09-13T22:56:09.607 INFO:tasks.workunit.client.0.smithi002.stdout:3/472: chown d9/d15/f42 225 1 2024-09-13T22:56:09.607 INFO:tasks.workunit.client.0.smithi002.stdout:1/437: symlink d1/d13/d1d/d34/l91 0 2024-09-13T22:56:09.608 INFO:tasks.workunit.client.0.smithi002.stdout:8/388: dread d3/dc/d16/f4d [0,4194304] 0 2024-09-13T22:56:09.609 INFO:tasks.workunit.client.1.smithi047.stdout:4/570: write f6 [3138267,77744] 0 2024-09-13T22:56:09.609 INFO:tasks.workunit.client.0.smithi002.stdout:2/392: creat d1/d32/d37/d79/f84 x:0 0 0 2024-09-13T22:56:09.611 INFO:tasks.workunit.client.0.smithi002.stdout:2/393: chown d1/d7/d8/d2c/f2d 1146435932 1 2024-09-13T22:56:09.617 INFO:tasks.workunit.client.0.smithi002.stdout:9/448: creat d8/d10/d1c/d3d/f9e x:0 0 0 2024-09-13T22:56:09.617 INFO:tasks.workunit.client.1.smithi047.stdout:1/468: creat d0/d7/d14/d28/d36/f84 x:0 0 0 2024-09-13T22:56:09.617 INFO:tasks.workunit.client.1.smithi047.stdout:1/469: readlink d0/d7/d14/l52 0 2024-09-13T22:56:09.621 INFO:tasks.workunit.client.0.smithi002.stdout:6/382: write d12/f23 [2458398,103344] 0 2024-09-13T22:56:09.622 INFO:tasks.workunit.client.0.smithi002.stdout:5/395: dread d1/d10/f50 [0,4194304] 0 2024-09-13T22:56:09.622 INFO:tasks.workunit.client.1.smithi047.stdout:4/571: unlink dc/de/d39/l73 0 2024-09-13T22:56:09.622 INFO:tasks.workunit.client.1.smithi047.stdout:1/470: dread d0/d7/db/f3a [0,4194304] 0 2024-09-13T22:56:09.624 INFO:tasks.workunit.client.0.smithi002.stdout:9/449: dwrite d8/d10/d1c/d68/d84/f8a [0,4194304] 0 2024-09-13T22:56:09.625 INFO:tasks.workunit.client.1.smithi047.stdout:8/491: dwrite d8/d64/d4e/d4d/d8f/d91/d40/f8d [0,4194304] 0 2024-09-13T22:56:09.626 INFO:tasks.workunit.client.1.smithi047.stdout:8/492: truncate d8/d77/f86 993969 0 2024-09-13T22:56:09.626 INFO:tasks.workunit.client.0.smithi002.stdout:5/396: chown d1/d2a/d6b/d88/d45/d4f 3774 1 2024-09-13T22:56:09.626 INFO:tasks.workunit.client.1.smithi047.stdout:8/493: readlink d8/d64/l8b 0 2024-09-13T22:56:09.627 INFO:tasks.workunit.client.0.smithi002.stdout:4/374: dread d3/d14/f42 [0,4194304] 0 2024-09-13T22:56:09.635 INFO:tasks.workunit.client.1.smithi047.stdout:3/525: unlink d0/d3/d4/l35 0 2024-09-13T22:56:09.636 INFO:tasks.workunit.client.0.smithi002.stdout:1/438: creat d1/d13/d1d/d34/f92 x:0 0 0 2024-09-13T22:56:09.637 INFO:tasks.workunit.client.0.smithi002.stdout:1/439: write d1/f15 [471228,18871] 0 2024-09-13T22:56:09.640 INFO:tasks.workunit.client.1.smithi047.stdout:6/534: rename d3/d11/d2b/d4c/c96 to d3/d11/d2b/cb6 0 2024-09-13T22:56:09.647 INFO:tasks.workunit.client.1.smithi047.stdout:1/471: creat d0/d7/d75/f85 x:0 0 0 2024-09-13T22:56:09.656 INFO:tasks.workunit.client.1.smithi047.stdout:2/593: rename d1/df/d1d/d3c/l99 to d1/d8a/lc6 0 2024-09-13T22:56:09.657 INFO:tasks.workunit.client.0.smithi002.stdout:8/389: dwrite d3/dc/d16/f4d [0,4194304] 0 2024-09-13T22:56:09.657 INFO:tasks.workunit.client.1.smithi047.stdout:4/572: fsync dc/de/d17/d70/fb8 0 2024-09-13T22:56:09.658 INFO:tasks.workunit.client.1.smithi047.stdout:4/573: write dc/d29/d6c/f93 [1240612,44096] 0 2024-09-13T22:56:09.659 INFO:tasks.workunit.client.1.smithi047.stdout:4/574: fdatasync dc/d29/f61 0 2024-09-13T22:56:09.660 INFO:tasks.workunit.client.0.smithi002.stdout:7/337: sync 2024-09-13T22:56:09.662 INFO:tasks.workunit.client.1.smithi047.stdout:8/494: creat d8/d64/d4e/d70/d98/fad x:0 0 0 2024-09-13T22:56:09.662 INFO:tasks.workunit.client.0.smithi002.stdout:2/394: dwrite d1/d7/d8/d51/f5a [0,4194304] 0 2024-09-13T22:56:09.665 INFO:tasks.workunit.client.0.smithi002.stdout:5/397: mkdir d1/d2a/d6b/d88/d45/d4f/d8f 0 2024-09-13T22:56:09.666 INFO:tasks.workunit.client.1.smithi047.stdout:6/535: symlink d3/d2c/d55/lb7 0 2024-09-13T22:56:09.667 INFO:tasks.workunit.client.1.smithi047.stdout:6/536: readlink d3/d11/d2b/d4c/l65 0 2024-09-13T22:56:09.668 INFO:tasks.workunit.client.0.smithi002.stdout:2/395: write d1/d32/d37/f73 [1024686,56092] 0 2024-09-13T22:56:09.671 INFO:tasks.workunit.client.1.smithi047.stdout:2/594: truncate d1/df/d1d/d20/d2b/f7d 359655 0 2024-09-13T22:56:09.671 INFO:tasks.workunit.client.0.smithi002.stdout:3/473: write d9/d15/f30 [1515879,49092] 0 2024-09-13T22:56:09.672 INFO:tasks.workunit.client.0.smithi002.stdout:7/338: dwrite d8/d9/f57 [0,4194304] 0 2024-09-13T22:56:09.673 INFO:tasks.workunit.client.0.smithi002.stdout:0/420: creat d1/f9e x:0 0 0 2024-09-13T22:56:09.675 INFO:tasks.workunit.client.1.smithi047.stdout:1/472: mknod d0/d1d/d7f/c86 0 2024-09-13T22:56:09.676 INFO:tasks.workunit.client.1.smithi047.stdout:1/473: write d0/d7/d10/f43 [456806,59507] 0 2024-09-13T22:56:09.677 INFO:tasks.workunit.client.1.smithi047.stdout:4/575: chown dc/de/l3a 27771244 1 2024-09-13T22:56:09.678 INFO:tasks.workunit.client.1.smithi047.stdout:4/576: dread - dc/de/d23/f95 zero size 2024-09-13T22:56:09.679 INFO:tasks.workunit.client.1.smithi047.stdout:4/577: fdatasync dc/de/d17/f74 0 2024-09-13T22:56:09.679 INFO:tasks.workunit.client.0.smithi002.stdout:9/450: rename d8/d10/d53 to d8/d2c/d9f 0 2024-09-13T22:56:09.680 INFO:tasks.workunit.client.1.smithi047.stdout:8/495: chown d8/d64/d4e/d4d/d8f/d91/d40/f59 3 1 2024-09-13T22:56:09.680 INFO:tasks.workunit.client.0.smithi002.stdout:6/383: dwrite d12/f6a [0,4194304] 0 2024-09-13T22:56:09.682 INFO:tasks.workunit.client.0.smithi002.stdout:6/384: chown d12/d17/d4e/f52 58 1 2024-09-13T22:56:09.689 INFO:tasks.workunit.client.1.smithi047.stdout:1/474: fdatasync d0/d7/db/f3a 0 2024-09-13T22:56:09.691 INFO:tasks.workunit.client.0.smithi002.stdout:5/398: fdatasync d1/d10/f3d 0 2024-09-13T22:56:09.692 INFO:tasks.workunit.client.0.smithi002.stdout:5/399: readlink d1/lf 0 2024-09-13T22:56:09.694 INFO:tasks.workunit.client.0.smithi002.stdout:9/451: dread d8/d1e/f22 [0,4194304] 0 2024-09-13T22:56:09.696 INFO:tasks.workunit.client.1.smithi047.stdout:1/475: dwrite d0/d7/db/f38 [0,4194304] 0 2024-09-13T22:56:09.697 INFO:tasks.workunit.client.1.smithi047.stdout:1/476: write d0/f5a [2060431,8943] 0 2024-09-13T22:56:09.697 INFO:tasks.workunit.client.0.smithi002.stdout:5/400: dread d1/f18 [0,4194304] 0 2024-09-13T22:56:09.698 INFO:tasks.workunit.client.1.smithi047.stdout:8/496: symlink d8/d64/d4e/d4d/d8f/lae 0 2024-09-13T22:56:09.701 INFO:tasks.workunit.client.0.smithi002.stdout:9/452: dread d8/d1e/f67 [0,4194304] 0 2024-09-13T22:56:09.704 INFO:tasks.workunit.client.0.smithi002.stdout:1/440: rename d1/d13/d1d/f3a to d1/d13/d21/d40/f93 0 2024-09-13T22:56:09.704 INFO:tasks.workunit.client.0.smithi002.stdout:1/441: readlink d1/d1c/l20 0 2024-09-13T22:56:09.705 INFO:tasks.workunit.client.1.smithi047.stdout:2/595: creat d1/d8a/da6/dc3/fc7 x:0 0 0 2024-09-13T22:56:09.707 INFO:tasks.workunit.client.0.smithi002.stdout:6/385: mknod d12/d17/d34/d4b/c7f 0 2024-09-13T22:56:09.707 INFO:tasks.workunit.client.0.smithi002.stdout:6/386: chown d12/f21 7287598 1 2024-09-13T22:56:09.708 INFO:tasks.workunit.client.0.smithi002.stdout:6/387: chown d12/f63 47858929 1 2024-09-13T22:56:09.708 INFO:tasks.workunit.client.0.smithi002.stdout:4/375: creat d3/d14/f6f x:0 0 0 2024-09-13T22:56:09.709 INFO:tasks.workunit.client.0.smithi002.stdout:4/376: chown d3/l59 103335580 1 2024-09-13T22:56:09.711 INFO:tasks.workunit.client.0.smithi002.stdout:2/396: creat d1/d7d/f85 x:0 0 0 2024-09-13T22:56:09.712 INFO:tasks.workunit.client.1.smithi047.stdout:1/477: mkdir d0/d7/d87 0 2024-09-13T22:56:09.717 INFO:tasks.workunit.client.1.smithi047.stdout:6/537: creat d3/d11/fb8 x:0 0 0 2024-09-13T22:56:09.717 INFO:tasks.workunit.client.1.smithi047.stdout:1/478: dread d0/d7/d14/d28/d36/f3d [0,4194304] 0 2024-09-13T22:56:09.719 INFO:tasks.workunit.client.1.smithi047.stdout:4/578: write dc/de/f18 [450310,31630] 0 2024-09-13T22:56:09.722 INFO:tasks.workunit.client.0.smithi002.stdout:4/377: dread d3/f23 [0,4194304] 0 2024-09-13T22:56:09.724 INFO:tasks.workunit.client.1.smithi047.stdout:8/497: unlink d8/l54 0 2024-09-13T22:56:09.733 INFO:tasks.workunit.client.1.smithi047.stdout:2/596: dwrite d1/df/d1d/d20/d37/d7b/f6c [4194304,4194304] 0 2024-09-13T22:56:09.735 INFO:tasks.workunit.client.0.smithi002.stdout:3/474: symlink d9/df/d60/d89/lac 0 2024-09-13T22:56:09.737 INFO:tasks.workunit.client.1.smithi047.stdout:4/579: write dc/de/d39/f47 [245915,10722] 0 2024-09-13T22:56:09.737 INFO:tasks.workunit.client.1.smithi047.stdout:4/580: stat dc/de/d17 0 2024-09-13T22:56:09.738 INFO:tasks.workunit.client.1.smithi047.stdout:8/498: creat d8/d3f/d8c/da6/faf x:0 0 0 2024-09-13T22:56:09.740 INFO:tasks.workunit.client.0.smithi002.stdout:5/401: creat d1/d2a/d6b/d88/d55/d56/d81/f90 x:0 0 0 2024-09-13T22:56:09.742 INFO:tasks.workunit.client.0.smithi002.stdout:5/402: write d1/d2a/d6b/d88/f4d [7603,113441] 0 2024-09-13T22:56:09.745 INFO:tasks.workunit.client.0.smithi002.stdout:9/453: unlink d8/d2c/f78 0 2024-09-13T22:56:09.745 INFO:tasks.workunit.client.1.smithi047.stdout:2/597: dread d1/df/d1d/d20/d37/d7b/f79 [0,4194304] 0 2024-09-13T22:56:09.746 INFO:tasks.workunit.client.0.smithi002.stdout:0/421: sync 2024-09-13T22:56:09.746 INFO:tasks.workunit.client.0.smithi002.stdout:8/390: sync 2024-09-13T22:56:09.747 INFO:tasks.workunit.client.0.smithi002.stdout:1/442: rmdir d1/d13/d1d/d34/d51 39 2024-09-13T22:56:09.747 INFO:tasks.workunit.client.0.smithi002.stdout:1/443: dread - d1/d13/d1d/d34/f6b zero size 2024-09-13T22:56:09.748 INFO:tasks.workunit.client.1.smithi047.stdout:4/581: symlink dc/d29/d8e/lc2 0 2024-09-13T22:56:09.749 INFO:tasks.workunit.client.0.smithi002.stdout:1/444: readlink d1/d13/d30/d31/d3b/d71/d80/l89 0 2024-09-13T22:56:09.750 INFO:tasks.workunit.client.0.smithi002.stdout:6/388: symlink d12/d17/d2a/l80 0 2024-09-13T22:56:09.751 INFO:tasks.workunit.client.1.smithi047.stdout:8/499: dread d8/f1f [0,4194304] 0 2024-09-13T22:56:09.752 INFO:tasks.workunit.client.1.smithi047.stdout:6/538: getdents d3/d2c 0 2024-09-13T22:56:09.755 INFO:tasks.workunit.client.1.smithi047.stdout:8/500: truncate d8/d64/d4e/d70/da7/fa8 766958 0 2024-09-13T22:56:09.757 INFO:tasks.workunit.client.1.smithi047.stdout:4/582: mkdir dc/de/d17/d25/d4a/dc3 0 2024-09-13T22:56:09.758 INFO:tasks.workunit.client.0.smithi002.stdout:3/475: symlink d9/d15/d35/lad 0 2024-09-13T22:56:09.759 INFO:tasks.workunit.client.1.smithi047.stdout:6/539: rmdir d3/d11/d2b/d4c/d30 39 2024-09-13T22:56:09.759 INFO:tasks.workunit.client.0.smithi002.stdout:3/476: write d9/df/f6d [4314008,94595] 0 2024-09-13T22:56:09.759 INFO:tasks.workunit.client.0.smithi002.stdout:7/339: link d8/d10/d11/l25 d8/d10/d11/d13/l5a 0 2024-09-13T22:56:09.760 INFO:tasks.workunit.client.0.smithi002.stdout:7/340: stat d8/d10/d11/d3a 0 2024-09-13T22:56:09.760 INFO:tasks.workunit.client.0.smithi002.stdout:7/341: dread - d8/d9/f54 zero size 2024-09-13T22:56:09.761 INFO:tasks.workunit.client.0.smithi002.stdout:7/342: chown d8/d9/d46 1216 1 2024-09-13T22:56:09.762 INFO:tasks.workunit.client.1.smithi047.stdout:2/598: mkdir d1/df/dc8 0 2024-09-13T22:56:09.762 INFO:tasks.workunit.client.0.smithi002.stdout:7/343: write d8/d9/f57 [1757270,99232] 0 2024-09-13T22:56:09.763 INFO:tasks.workunit.client.0.smithi002.stdout:5/403: rmdir d1/d2a 39 2024-09-13T22:56:09.763 INFO:tasks.workunit.client.0.smithi002.stdout:7/344: readlink d8/d10/d11/l25 0 2024-09-13T22:56:09.763 INFO:tasks.workunit.client.1.smithi047.stdout:2/599: write d1/d8a/da6/fc4 [1215509,22861] 0 2024-09-13T22:56:09.766 INFO:tasks.workunit.client.1.smithi047.stdout:6/540: dwrite d3/d11/d2b/d1c/d4d/f84 [0,4194304] 0 2024-09-13T22:56:09.768 INFO:tasks.workunit.client.0.smithi002.stdout:8/391: rmdir d3/dc 39 2024-09-13T22:56:09.775 INFO:tasks.workunit.client.1.smithi047.stdout:6/541: mkdir d3/d77/d8f/db9 0 2024-09-13T22:56:09.776 INFO:tasks.workunit.client.1.smithi047.stdout:8/501: link d8/d64/d4e/d4d/d8f/lae d8/d64/d4e/d4d/lb0 0 2024-09-13T22:56:09.780 INFO:tasks.workunit.client.1.smithi047.stdout:4/583: rename dc/de/d39 to dc/de/d23/dc4 0 2024-09-13T22:56:09.781 INFO:tasks.workunit.client.0.smithi002.stdout:0/422: write d1/f17 [1428934,96240] 0 2024-09-13T22:56:09.782 INFO:tasks.workunit.client.1.smithi047.stdout:4/584: truncate dc/de/d17/d25/d4a/f9f 587566 0 2024-09-13T22:56:09.784 INFO:tasks.workunit.client.0.smithi002.stdout:1/445: write d1/d13/d30/f2a [978817,122649] 0 2024-09-13T22:56:09.787 INFO:tasks.workunit.client.0.smithi002.stdout:7/345: symlink d8/d9/l5b 0 2024-09-13T22:56:09.789 INFO:tasks.workunit.client.1.smithi047.stdout:2/600: creat d1/df/fc9 x:0 0 0 2024-09-13T22:56:09.791 INFO:tasks.workunit.client.0.smithi002.stdout:1/446: dwrite d1/d13/d30/d31/d3d/d5d/f62 [0,4194304] 0 2024-09-13T22:56:09.792 INFO:tasks.workunit.client.0.smithi002.stdout:1/447: fdatasync d1/d1c/d7d/f7f 0 2024-09-13T22:56:09.792 INFO:tasks.workunit.client.1.smithi047.stdout:6/542: rename d3/d11/d2b/d4c/d30/f44 to d3/d11/d2b/d1c/d23/fba 0 2024-09-13T22:56:09.795 INFO:tasks.workunit.client.1.smithi047.stdout:2/601: mkdir d1/df/d1d/d20/d54/d8e/dca 0 2024-09-13T22:56:09.796 INFO:tasks.workunit.client.1.smithi047.stdout:8/502: dwrite d8/d64/d4e/f49 [0,4194304] 0 2024-09-13T22:56:09.799 INFO:tasks.workunit.client.1.smithi047.stdout:8/503: dread - d8/d64/d4e/d4d/d8f/d91/d78/fa1 zero size 2024-09-13T22:56:09.799 INFO:tasks.workunit.client.0.smithi002.stdout:4/378: creat d3/d40/f70 x:0 0 0 2024-09-13T22:56:09.799 INFO:tasks.workunit.client.0.smithi002.stdout:0/423: rmdir d1/d2/d81/d8f 39 2024-09-13T22:56:09.800 INFO:tasks.workunit.client.0.smithi002.stdout:0/424: readlink d1/d4/d75/d31/l3d 0 2024-09-13T22:56:09.801 INFO:tasks.workunit.client.0.smithi002.stdout:7/346: creat d8/d9/f5c x:0 0 0 2024-09-13T22:56:09.803 INFO:tasks.workunit.client.1.smithi047.stdout:2/602: write d1/df/d1d/d20/d37/d7b/f86 [4939888,44987] 0 2024-09-13T22:56:09.804 INFO:tasks.workunit.client.0.smithi002.stdout:9/454: mknod d8/d10/d1c/d68/d84/ca0 0 2024-09-13T22:56:09.806 INFO:tasks.workunit.client.0.smithi002.stdout:9/455: chown d8/d2c/f47 2090408 1 2024-09-13T22:56:09.807 INFO:tasks.workunit.client.1.smithi047.stdout:4/585: getdents dc/de/d17/d25/d4a 0 2024-09-13T22:56:09.809 INFO:tasks.workunit.client.0.smithi002.stdout:6/389: rename d12/d17/d2a/f59 to d12/d17/f81 0 2024-09-13T22:56:09.811 INFO:tasks.workunit.client.0.smithi002.stdout:2/397: getdents d1/d4a 0 2024-09-13T22:56:09.813 INFO:tasks.workunit.client.0.smithi002.stdout:1/448: dwrite d1/d13/d1d/d34/d51/f82 [0,4194304] 0 2024-09-13T22:56:09.814 INFO:tasks.workunit.client.1.smithi047.stdout:8/504: mknod d8/cb1 0 2024-09-13T22:56:09.820 INFO:tasks.workunit.client.0.smithi002.stdout:6/390: dwrite d12/d17/d34/f73 [0,4194304] 0 2024-09-13T22:56:09.823 INFO:tasks.workunit.client.1.smithi047.stdout:6/543: dwrite d3/d11/d2b/d1c/f2e [0,4194304] 0 2024-09-13T22:56:09.823 INFO:tasks.workunit.client.1.smithi047.stdout:8/505: rename d8/ca to d8/d64/d4e/d70/cb2 0 2024-09-13T22:56:09.827 INFO:tasks.workunit.client.0.smithi002.stdout:3/477: rename d9/df/d60 to d9/d15/d36/d4e/d5e/dae 0 2024-09-13T22:56:09.828 INFO:tasks.workunit.client.0.smithi002.stdout:2/398: chown d1/d7/d35/d3e/d59/d6b/l6e 320 1 2024-09-13T22:56:09.828 INFO:tasks.workunit.client.0.smithi002.stdout:3/478: chown d9/d15/d26/f6e 1 1 2024-09-13T22:56:09.829 INFO:tasks.workunit.client.0.smithi002.stdout:4/379: unlink d3/d14/c22 0 2024-09-13T22:56:09.830 INFO:tasks.workunit.client.1.smithi047.stdout:8/506: creat d8/d77/fb3 x:0 0 0 2024-09-13T22:56:09.830 INFO:tasks.workunit.client.1.smithi047.stdout:8/507: stat d8/d64/d4e/d4d/f7e 0 2024-09-13T22:56:09.831 INFO:tasks.workunit.client.0.smithi002.stdout:1/449: creat d1/d13/d21/d40/f94 x:0 0 0 2024-09-13T22:56:09.835 INFO:tasks.workunit.client.1.smithi047.stdout:8/508: dread d8/d64/d4e/d4d/d8f/d91/d38/f3b [0,4194304] 0 2024-09-13T22:56:09.835 INFO:tasks.workunit.client.1.smithi047.stdout:2/603: write d1/df/d26/f81 [795860,45457] 0 2024-09-13T22:56:09.836 INFO:tasks.workunit.client.0.smithi002.stdout:0/425: mknod d1/d2/d81/d8f/c9f 0 2024-09-13T22:56:09.838 INFO:tasks.workunit.client.0.smithi002.stdout:2/399: dwrite d1/f1f [8388608,4194304] 0 2024-09-13T22:56:09.839 INFO:tasks.workunit.client.1.smithi047.stdout:4/586: truncate dc/d29/d4c/f79 186282 0 2024-09-13T22:56:09.840 INFO:tasks.workunit.client.1.smithi047.stdout:4/587: read - dc/d29/d4d/f7c zero size 2024-09-13T22:56:09.841 INFO:tasks.workunit.client.1.smithi047.stdout:4/588: fsync dc/d29/d4d/f7c 0 2024-09-13T22:56:09.842 INFO:tasks.workunit.client.0.smithi002.stdout:6/391: mknod d12/d17/d34/d4b/c82 0 2024-09-13T22:56:09.842 INFO:tasks.workunit.client.1.smithi047.stdout:4/589: read - dc/de/f88 zero size 2024-09-13T22:56:09.845 INFO:tasks.workunit.client.0.smithi002.stdout:9/456: mknod d8/d10/d1c/d68/d74/ca1 0 2024-09-13T22:56:09.846 INFO:tasks.workunit.client.1.smithi047.stdout:2/604: truncate d1/df/d1d/d20/d29/f9b 1504697 0 2024-09-13T22:56:09.848 INFO:tasks.workunit.client.1.smithi047.stdout:2/605: write d1/df/d1d/d20/d37/fbb [1018386,31903] 0 2024-09-13T22:56:09.850 INFO:tasks.workunit.client.1.smithi047.stdout:4/590: dwrite dc/d29/d4d/f48 [4194304,4194304] 0 2024-09-13T22:56:09.850 INFO:tasks.workunit.client.0.smithi002.stdout:9/457: dwrite d8/d10/d1c/d3d/f7e [0,4194304] 0 2024-09-13T22:56:09.851 INFO:tasks.workunit.client.1.smithi047.stdout:6/544: rmdir d3/d11/d2b/d4c/d30/d48/d64 0 2024-09-13T22:56:09.852 INFO:tasks.workunit.client.1.smithi047.stdout:4/591: read - dc/d29/d6c/fad zero size 2024-09-13T22:56:09.853 INFO:tasks.workunit.client.0.smithi002.stdout:3/479: mkdir d9/d7e/daf 0 2024-09-13T22:56:09.853 INFO:tasks.workunit.client.0.smithi002.stdout:3/480: fdatasync d9/d15/d26/f8f 0 2024-09-13T22:56:09.854 INFO:tasks.workunit.client.1.smithi047.stdout:4/592: read dc/de/d17/f1b [2569455,8890] 0 2024-09-13T22:56:09.854 INFO:tasks.workunit.client.0.smithi002.stdout:3/481: chown d9/d7e 3 1 2024-09-13T22:56:09.854 INFO:tasks.workunit.client.0.smithi002.stdout:5/404: sync 2024-09-13T22:56:09.856 INFO:tasks.workunit.client.0.smithi002.stdout:4/380: creat d3/d14/d29/d2a/f71 x:0 0 0 2024-09-13T22:56:09.862 INFO:tasks.workunit.client.0.smithi002.stdout:0/426: mknod d1/d4/d75/d31/d32/ca0 0 2024-09-13T22:56:09.862 INFO:tasks.workunit.client.1.smithi047.stdout:9/441: sync 2024-09-13T22:56:09.862 INFO:tasks.workunit.client.0.smithi002.stdout:3/482: dwrite d9/d7e/f88 [0,4194304] 0 2024-09-13T22:56:09.866 INFO:tasks.workunit.client.1.smithi047.stdout:6/545: rename d3/d11/d2b/d1c/d4d/d69/fb5 to d3/d77/d8f/db9/fbb 0 2024-09-13T22:56:09.866 INFO:tasks.workunit.client.1.smithi047.stdout:4/593: mknod dc/d29/d6c/cc5 0 2024-09-13T22:56:09.868 INFO:tasks.workunit.client.1.smithi047.stdout:2/606: dread d1/de/f25 [0,4194304] 0 2024-09-13T22:56:09.871 INFO:tasks.workunit.client.1.smithi047.stdout:9/442: creat d1/f8e x:0 0 0 2024-09-13T22:56:09.873 INFO:tasks.workunit.client.1.smithi047.stdout:6/546: creat d3/d11/d2b/d1c/d70/fbc x:0 0 0 2024-09-13T22:56:09.874 INFO:tasks.workunit.client.0.smithi002.stdout:9/458: truncate d8/d1e/f3a 722288 0 2024-09-13T22:56:09.877 INFO:tasks.workunit.client.0.smithi002.stdout:5/405: readlink d1/l24 0 2024-09-13T22:56:09.879 INFO:tasks.workunit.client.1.smithi047.stdout:2/607: mkdir d1/df/d1d/d2e/d5e/dcb 0 2024-09-13T22:56:09.881 INFO:tasks.workunit.client.1.smithi047.stdout:4/594: dread dc/d29/f35 [0,4194304] 0 2024-09-13T22:56:09.882 INFO:tasks.workunit.client.1.smithi047.stdout:4/595: chown dc/d29/l9c 780777 1 2024-09-13T22:56:09.882 INFO:tasks.workunit.client.1.smithi047.stdout:2/608: write d1/df/d35/d8b/fbf [703734,95034] 0 2024-09-13T22:56:09.883 INFO:tasks.workunit.client.1.smithi047.stdout:9/443: unlink d1/dc/d14/dd/f85 0 2024-09-13T22:56:09.885 INFO:tasks.workunit.client.1.smithi047.stdout:6/547: mkdir d3/d11/d2b/d1c/dbd 0 2024-09-13T22:56:09.887 INFO:tasks.workunit.client.0.smithi002.stdout:0/427: dread d1/d4/d75/d31/f46 [0,4194304] 0 2024-09-13T22:56:09.887 INFO:tasks.workunit.client.0.smithi002.stdout:2/400: mknod d1/d7/d52/c86 0 2024-09-13T22:56:09.888 INFO:tasks.workunit.client.0.smithi002.stdout:0/428: stat d1/d2/fd 0 2024-09-13T22:56:09.888 INFO:tasks.workunit.client.0.smithi002.stdout:2/401: read - d1/d32/d37/f7b zero size 2024-09-13T22:56:09.889 INFO:tasks.workunit.client.1.smithi047.stdout:6/548: dread d3/d11/d2b/d4c/d30/d48/f7d [0,4194304] 0 2024-09-13T22:56:09.890 INFO:tasks.workunit.client.1.smithi047.stdout:4/596: creat dc/d29/d4d/fc6 x:0 0 0 2024-09-13T22:56:09.891 INFO:tasks.workunit.client.0.smithi002.stdout:8/392: rename d3/dc/d16/d60/l76 to d3/dc/d16/l78 0 2024-09-13T22:56:09.892 INFO:tasks.workunit.client.0.smithi002.stdout:8/393: read - d3/d27/f62 zero size 2024-09-13T22:56:09.893 INFO:tasks.workunit.client.1.smithi047.stdout:2/609: mknod d1/df/d1d/d20/d37/d85/ccc 0 2024-09-13T22:56:09.893 INFO:tasks.workunit.client.0.smithi002.stdout:8/394: chown d3/dc/d51/d6e 242239 1 2024-09-13T22:56:09.894 INFO:tasks.workunit.client.1.smithi047.stdout:2/610: chown d1/d16/d40/cbd 20 1 2024-09-13T22:56:09.895 INFO:tasks.workunit.client.0.smithi002.stdout:9/459: rmdir d8/d2c/d9f 39 2024-09-13T22:56:09.895 INFO:tasks.workunit.client.0.smithi002.stdout:1/450: dwrite d1/d13/d30/d31/d86/f8f [0,4194304] 0 2024-09-13T22:56:09.902 INFO:tasks.workunit.client.1.smithi047.stdout:6/549: dread d3/d11/d2b/d4c/d30/f37 [0,4194304] 0 2024-09-13T22:56:09.906 INFO:tasks.workunit.client.0.smithi002.stdout:0/429: symlink d1/d7e/la1 0 2024-09-13T22:56:09.908 INFO:tasks.workunit.client.0.smithi002.stdout:6/392: dwrite d12/d17/f48 [0,4194304] 0 2024-09-13T22:56:09.909 INFO:tasks.workunit.client.0.smithi002.stdout:8/395: dread d3/dc/f13 [0,4194304] 0 2024-09-13T22:56:09.909 INFO:tasks.workunit.client.1.smithi047.stdout:2/611: rename d1/df/d1d/d20/d37/d7b/d80 to d1/df/d1d/d20/d29/dcd 0 2024-09-13T22:56:09.909 INFO:tasks.workunit.client.0.smithi002.stdout:6/393: stat fa 0 2024-09-13T22:56:09.910 INFO:tasks.workunit.client.0.smithi002.stdout:6/394: readlink d12/l15 0 2024-09-13T22:56:09.910 INFO:tasks.workunit.client.0.smithi002.stdout:2/402: mkdir d1/d7/d35/d3e/d59/d87 0 2024-09-13T22:56:09.915 INFO:tasks.workunit.client.1.smithi047.stdout:6/550: creat d3/d2c/d55/fbe x:0 0 0 2024-09-13T22:56:09.922 INFO:tasks.workunit.client.0.smithi002.stdout:0/430: write d1/d4/d75/d31/f37 [3056662,77569] 0 2024-09-13T22:56:09.923 INFO:tasks.workunit.client.1.smithi047.stdout:2/612: dread d1/df/d35/f45 [0,4194304] 0 2024-09-13T22:56:09.923 INFO:tasks.workunit.client.0.smithi002.stdout:0/431: dread d1/d2/f67 [0,4194304] 0 2024-09-13T22:56:09.924 INFO:tasks.workunit.client.0.smithi002.stdout:0/432: dread d1/d2/f67 [0,4194304] 0 2024-09-13T22:56:09.926 INFO:tasks.workunit.client.0.smithi002.stdout:2/403: mknod d1/d4a/c88 0 2024-09-13T22:56:09.928 INFO:tasks.workunit.client.1.smithi047.stdout:9/444: dwrite d1/f40 [0,4194304] 0 2024-09-13T22:56:09.931 INFO:tasks.workunit.client.1.smithi047.stdout:9/445: write d1/f40 [8454170,46894] 0 2024-09-13T22:56:09.935 INFO:tasks.workunit.client.1.smithi047.stdout:4/597: dwrite dc/de/d23/f49 [0,4194304] 0 2024-09-13T22:56:09.936 INFO:tasks.workunit.client.1.smithi047.stdout:4/598: chown dc/de/d23/d40/d7b/dab/dae 2 1 2024-09-13T22:56:09.942 INFO:tasks.workunit.client.1.smithi047.stdout:2/613: mknod d1/df/cce 0 2024-09-13T22:56:09.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.941+0000 7f6f7b093700 1 -- 172.21.15.2:0/2569707651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6f741a2db0 con 0x7f6f74101eb0 2024-09-13T22:56:09.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.942+0000 7f6f71ffb700 1 -- 172.21.15.2:0/2569707651 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+770 (secure 0 0 0) 0x7f6f60015320 con 0x7f6f74101eb0 2024-09-13T22:56:09.943 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:56:09.943 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T22:56:09.943 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-13T22:56:09.943 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:56:09.944 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T22:56:09.944 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-09-13T22:56:09.944 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T22:56:09.944 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:56:09.944 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T22:56:09.944 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-13T22:56:09.944 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:56:09.944 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T22:56:09.944 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-13T22:56:09.944 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:56:09.944 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T22:56:09.945 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 13, 2024-09-13T22:56:09.945 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T22:56:09.945 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T22:56:09.945 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:56:09.946 INFO:tasks.workunit.client.1.smithi047.stdout:4/599: creat dc/de/d23/d40/d7b/fc7 x:0 0 0 2024-09-13T22:56:09.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.945+0000 7f6f7b093700 1 -- 172.21.15.2:0/2569707651 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f6f6406d580 msgr2=0x7f6f6406fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:09.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.945+0000 7f6f7b093700 1 --2- 172.21.15.2:0/2569707651 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f6f6406d580 0x7f6f6406fa40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6f68000c00 tx=0x7f6f68005fb0 comp rx=0 tx=0).stop 2024-09-13T22:56:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.945+0000 7f6f7b093700 1 -- 172.21.15.2:0/2569707651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f74101eb0 msgr2=0x7f6f74073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.945+0000 7f6f7b093700 1 --2- 172.21.15.2:0/2569707651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f74101eb0 0x7f6f74073180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000b4b0 tx=0x7f6f6000b870 comp rx=0 tx=0).stop 2024-09-13T22:56:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.945+0000 7f6f7b093700 1 -- 172.21.15.2:0/2569707651 shutdown_connections 2024-09-13T22:56:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.945+0000 7f6f7b093700 1 --2- 172.21.15.2:0/2569707651 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f6f6406d580 0x7f6f6406fa40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.945+0000 7f6f7b093700 1 --2- 172.21.15.2:0/2569707651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f74100cb0 0x7f6f74074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.945+0000 7f6f7b093700 1 --2- 172.21.15.2:0/2569707651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6f74101eb0 0x7f6f74073180 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.945+0000 7f6f7b093700 1 -- 172.21.15.2:0/2569707651 >> 172.21.15.2:0/2569707651 conn(0x7f6f740fc230 msgr2=0x7f6f741050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.945+0000 7f6f7b093700 1 -- 172.21.15.2:0/2569707651 shutdown_connections 2024-09-13T22:56:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:09.945+0000 7f6f7b093700 1 -- 172.21.15.2:0/2569707651 wait complete. 2024-09-13T22:56:09.948 INFO:tasks.workunit.client.0.smithi002.stdout:2/404: fdatasync d1/d7/d8/f27 0 2024-09-13T22:56:09.949 INFO:tasks.workunit.client.0.smithi002.stdout:6/395: dwrite d12/f24 [8388608,4194304] 0 2024-09-13T22:56:09.950 INFO:tasks.workunit.client.1.smithi047.stdout:4/600: mkdir dc/de/d23/dc4/dc8 0 2024-09-13T22:56:09.951 INFO:tasks.workunit.client.0.smithi002.stdout:6/396: stat d12/d17/d34/d4b/c82 0 2024-09-13T22:56:09.953 INFO:tasks.workunit.client.1.smithi047.stdout:6/551: dread d3/f2f [0,4194304] 0 2024-09-13T22:56:09.954 INFO:tasks.workunit.client.1.smithi047.stdout:6/552: chown d3/d11/d2b/d1c/d70/fbc 13539 1 2024-09-13T22:56:09.954 INFO:tasks.workunit.client.0.smithi002.stdout:7/347: rename d8/d10/d11/d13/d2e/d3c/f56 to d8/f5d 0 2024-09-13T22:56:09.956 INFO:tasks.workunit.client.0.smithi002.stdout:7/348: write d8/d10/d11/d13/d26/d4c/f53 [825856,38014] 0 2024-09-13T22:56:09.956 INFO:tasks.workunit.client.0.smithi002.stdout:9/460: link d8/d10/d1c/f2b d8/d91/d96/fa2 0 2024-09-13T22:56:09.957 INFO:tasks.workunit.client.0.smithi002.stdout:9/461: stat d8/d10/d1c/d68/d84/l85 0 2024-09-13T22:56:09.959 INFO:tasks.workunit.client.0.smithi002.stdout:5/406: creat d1/d2a/d6b/d88/d45/f91 x:0 0 0 2024-09-13T22:56:09.959 INFO:tasks.workunit.client.1.smithi047.stdout:9/446: truncate d1/dc/d14/f13 1883891 0 2024-09-13T22:56:09.962 INFO:tasks.workunit.client.1.smithi047.stdout:6/553: rename d3/d2c/d55 to d3/d11/d2b/d1c/dbf 0 2024-09-13T22:56:09.964 INFO:tasks.workunit.client.0.smithi002.stdout:8/396: truncate d3/dc/d18/f67 3812827 0 2024-09-13T22:56:09.964 INFO:tasks.workunit.client.1.smithi047.stdout:4/601: mkdir dc/de/d23/dc4/dc8/dc9 0 2024-09-13T22:56:09.970 INFO:tasks.workunit.client.0.smithi002.stdout:6/397: symlink d12/d17/d28/d67/d6b/l83 0 2024-09-13T22:56:09.977 INFO:tasks.workunit.client.1.smithi047.stdout:9/447: getdents d1/dc 0 2024-09-13T22:56:09.978 INFO:tasks.workunit.client.0.smithi002.stdout:5/407: creat d1/d2a/d69/f92 x:0 0 0 2024-09-13T22:56:09.979 INFO:tasks.workunit.client.1.smithi047.stdout:4/602: dread dc/d29/d4c/f82 [0,4194304] 0 2024-09-13T22:56:09.984 INFO:tasks.workunit.client.0.smithi002.stdout:3/483: rename d9/d3b/d7c/laa to d9/d15/d36/d4e/lb0 0 2024-09-13T22:56:09.985 INFO:tasks.workunit.client.1.smithi047.stdout:9/448: link d1/d5f/d6a/l78 d1/d5f/l8f 0 2024-09-13T22:56:09.985 INFO:tasks.workunit.client.0.smithi002.stdout:8/397: dread d3/dc/f5f [0,4194304] 0 2024-09-13T22:56:09.986 INFO:tasks.workunit.client.0.smithi002.stdout:0/433: getdents d1/d2/d49/d7d 0 2024-09-13T22:56:09.986 INFO:tasks.workunit.client.0.smithi002.stdout:9/462: write d8/d10/d42/f6e [3470898,61961] 0 2024-09-13T22:56:09.988 INFO:tasks.workunit.client.1.smithi047.stdout:9/449: dread d1/f40 [0,4194304] 0 2024-09-13T22:56:09.988 INFO:tasks.workunit.client.0.smithi002.stdout:9/463: fsync d8/f37 0 2024-09-13T22:56:09.989 INFO:tasks.workunit.client.0.smithi002.stdout:5/408: dwrite d1/d2a/d6b/d88/d45/f48 [0,4194304] 0 2024-09-13T22:56:09.990 INFO:tasks.workunit.client.0.smithi002.stdout:0/434: chown d1/d4/d75/d31/f46 1 1 2024-09-13T22:56:09.991 INFO:tasks.workunit.client.0.smithi002.stdout:5/409: fdatasync d1/d2a/d6b/d88/f5d 0 2024-09-13T22:56:09.995 INFO:tasks.workunit.client.0.smithi002.stdout:5/410: chown d1/d2a/d6b/d88/c4e 509887 1 2024-09-13T22:56:09.995 INFO:tasks.workunit.client.0.smithi002.stdout:8/398: dwrite d3/f4f [0,4194304] 0 2024-09-13T22:56:09.996 INFO:tasks.workunit.client.0.smithi002.stdout:4/381: sync 2024-09-13T22:56:09.996 INFO:tasks.workunit.client.0.smithi002.stdout:8/399: readlink d3/dc/d18/d2e/l75 0 2024-09-13T22:56:10.004 INFO:tasks.workunit.client.0.smithi002.stdout:1/451: rename d1/d13/d1d/d34/f92 to d1/d13/d52/f95 0 2024-09-13T22:56:10.008 INFO:tasks.workunit.client.0.smithi002.stdout:3/484: creat d9/d15/d35/fb1 x:0 0 0 2024-09-13T22:56:10.008 INFO:tasks.workunit.client.1.smithi047.stdout:9/450: dread d1/d2d/f83 [0,4194304] 0 2024-09-13T22:56:10.009 INFO:tasks.workunit.client.0.smithi002.stdout:3/485: write d9/d15/d35/fb1 [31733,101310] 0 2024-09-13T22:56:10.009 INFO:tasks.workunit.client.0.smithi002.stdout:2/405: link d1/d7/d8/c22 d1/c89 0 2024-09-13T22:56:10.012 INFO:tasks.workunit.client.0.smithi002.stdout:7/349: write f7 [4504311,97143] 0 2024-09-13T22:56:10.013 INFO:tasks.workunit.client.1.smithi047.stdout:6/554: dwrite d3/d11/d2b/d4c/d30/d48/f7d [0,4194304] 0 2024-09-13T22:56:10.015 INFO:tasks.workunit.client.1.smithi047.stdout:6/555: stat d3/d11/d2b/d4c/l65 0 2024-09-13T22:56:10.015 INFO:tasks.workunit.client.0.smithi002.stdout:9/464: chown d8/d2c/d9f/c95 1554702 1 2024-09-13T22:56:10.024 INFO:tasks.workunit.client.1.smithi047.stdout:4/603: dwrite dc/de/d23/f6f [0,4194304] 0 2024-09-13T22:56:10.024 INFO:tasks.workunit.client.0.smithi002.stdout:5/411: symlink d1/d2a/d69/l93 0 2024-09-13T22:56:10.026 INFO:tasks.workunit.client.0.smithi002.stdout:8/400: mknod d3/dc/d18/d2e/c79 0 2024-09-13T22:56:10.031 INFO:tasks.workunit.client.0.smithi002.stdout:6/398: rename d12/d17/d2a/c30 to d12/d17/d4e/c84 0 2024-09-13T22:56:10.031 INFO:tasks.workunit.client.1.smithi047.stdout:9/451: link d1/l59 d1/dc/d14/dd/l90 0 2024-09-13T22:56:10.032 INFO:tasks.workunit.client.0.smithi002.stdout:3/486: dread - d9/d15/d26/f6e zero size 2024-09-13T22:56:10.033 INFO:tasks.workunit.client.1.smithi047.stdout:6/556: rename d3/d11/d2b/d1c/d70 to d3/d11/d2b/d4c/dc0 0 2024-09-13T22:56:10.034 INFO:tasks.workunit.client.1.smithi047.stdout:6/557: chown d3/d77/d8f/l94 1779 1 2024-09-13T22:56:10.035 INFO:tasks.workunit.client.0.smithi002.stdout:2/406: creat d1/d7/d8/f8a x:0 0 0 2024-09-13T22:56:10.035 INFO:tasks.workunit.client.1.smithi047.stdout:4/604: fsync dc/de/d17/d25/d9b/fbf 0 2024-09-13T22:56:10.037 INFO:tasks.workunit.client.0.smithi002.stdout:2/407: write d1/d32/d37/d79/f84 [682989,110825] 0 2024-09-13T22:56:10.038 INFO:tasks.workunit.client.1.smithi047.stdout:9/452: read d1/dc/d14/f52 [2936641,1358] 0 2024-09-13T22:56:10.039 INFO:tasks.workunit.client.0.smithi002.stdout:9/465: mkdir d8/d91/da3 0 2024-09-13T22:56:10.039 INFO:tasks.workunit.client.0.smithi002.stdout:6/399: dread d12/f1c [0,4194304] 0 2024-09-13T22:56:10.039 INFO:tasks.workunit.client.0.smithi002.stdout:9/466: chown d8/fe 0 1 2024-09-13T22:56:10.040 INFO:tasks.workunit.client.0.smithi002.stdout:0/435: getdents d1/d2/d49/d7d 0 2024-09-13T22:56:10.040 INFO:tasks.workunit.client.0.smithi002.stdout:6/400: fdatasync d12/d17/d34/d4b/f7a 0 2024-09-13T22:56:10.040 INFO:tasks.workunit.client.0.smithi002.stdout:9/467: readlink d8/d91/d96/l64 0 2024-09-13T22:56:10.041 INFO:tasks.workunit.client.0.smithi002.stdout:0/436: chown d1/f5f 0 1 2024-09-13T22:56:10.041 INFO:tasks.workunit.client.0.smithi002.stdout:8/401: symlink d3/dc/d51/d6e/l7a 0 2024-09-13T22:56:10.042 INFO:tasks.workunit.client.0.smithi002.stdout:0/437: chown d1/d2/d81/d8f/l7f 140549 1 2024-09-13T22:56:10.043 INFO:tasks.workunit.client.0.smithi002.stdout:0/438: write d1/d4/f7 [887766,73541] 0 2024-09-13T22:56:10.043 INFO:tasks.workunit.client.1.smithi047.stdout:9/453: fdatasync d1/dc/f15 0 2024-09-13T22:56:10.048 INFO:tasks.workunit.client.0.smithi002.stdout:1/452: rename d1/d13/d21/f36 to d1/d13/d21/d39/d70/f96 0 2024-09-13T22:56:10.050 INFO:tasks.workunit.client.1.smithi047.stdout:4/605: symlink dc/de/d17/d25/d4a/dc3/lca 0 2024-09-13T22:56:10.050 INFO:tasks.workunit.client.1.smithi047.stdout:4/606: write fb [3169439,107771] 0 2024-09-13T22:56:10.051 INFO:tasks.workunit.client.0.smithi002.stdout:3/487: mknod d9/d15/d26/cb2 0 2024-09-13T22:56:10.051 INFO:tasks.workunit.client.1.smithi047.stdout:4/607: readlink dc/d29/l3d 0 2024-09-13T22:56:10.051 INFO:tasks.workunit.client.0.smithi002.stdout:3/488: chown d9/d15/f42 6385 1 2024-09-13T22:56:10.052 INFO:tasks.workunit.client.1.smithi047.stdout:4/608: write dc/de/fb2 [157302,64195] 0 2024-09-13T22:56:10.054 INFO:tasks.workunit.client.1.smithi047.stdout:9/454: mkdir d1/dc/d14/dd/d54/d50/d91 0 2024-09-13T22:56:10.057 INFO:tasks.workunit.client.1.smithi047.stdout:6/558: write d3/d11/f7b [684208,46277] 0 2024-09-13T22:56:10.060 INFO:tasks.workunit.client.1.smithi047.stdout:6/559: chown d3/d11/d2b/d4c/dc0/d89/d8e 1 1 2024-09-13T22:56:10.060 INFO:tasks.workunit.client.1.smithi047.stdout:4/609: symlink dc/de/d17/d70/lcb 0 2024-09-13T22:56:10.061 INFO:tasks.workunit.client.0.smithi002.stdout:2/408: dread d1/d7/f26 [0,4194304] 0 2024-09-13T22:56:10.062 INFO:tasks.workunit.client.1.smithi047.stdout:9/455: creat d1/dc/d14/dd/d54/d50/f92 x:0 0 0 2024-09-13T22:56:10.063 INFO:tasks.workunit.client.1.smithi047.stdout:9/456: chown d1/dc/d14/dd/d54/d4e/l8a 48090994 1 2024-09-13T22:56:10.066 INFO:tasks.workunit.client.0.smithi002.stdout:0/439: symlink d1/d4/d75/d76/la2 0 2024-09-13T22:56:10.068 INFO:tasks.workunit.client.0.smithi002.stdout:7/350: dwrite d8/d10/d11/d13/d2e/d3c/f59 [0,4194304] 0 2024-09-13T22:56:10.070 INFO:tasks.workunit.client.0.smithi002.stdout:4/382: rename d3/d14/d25/c56 to d3/d14/d25/d69/c72 0 2024-09-13T22:56:10.071 INFO:tasks.workunit.client.1.smithi047.stdout:9/457: creat d1/dc/d14/dd/d54/d8d/f93 x:0 0 0 2024-09-13T22:56:10.072 INFO:tasks.workunit.client.0.smithi002.stdout:9/468: symlink d8/d10/d61/la4 0 2024-09-13T22:56:10.073 INFO:tasks.workunit.client.0.smithi002.stdout:6/401: mknod d12/d17/d28/d7d/c85 0 2024-09-13T22:56:10.074 INFO:tasks.workunit.client.0.smithi002.stdout:2/409: mkdir d1/d4d/d8b 0 2024-09-13T22:56:10.076 INFO:tasks.workunit.client.1.smithi047.stdout:9/458: mknod d1/dc/d18/d72/c94 0 2024-09-13T22:56:10.079 INFO:tasks.workunit.client.1.smithi047.stdout:6/560: write d3/f8 [1876437,6789] 0 2024-09-13T22:56:10.081 INFO:tasks.workunit.client.1.smithi047.stdout:6/561: fdatasync d3/d11/d2b/d1c/d4d/f84 0 2024-09-13T22:56:10.083 INFO:tasks.workunit.client.1.smithi047.stdout:4/610: dwrite dc/de/d17/f1b [0,4194304] 0 2024-09-13T22:56:10.090 INFO:tasks.workunit.client.0.smithi002.stdout:2/410: rmdir d1/d7/d8/d4f 39 2024-09-13T22:56:10.092 INFO:tasks.workunit.client.1.smithi047.stdout:9/459: getdents d1/d5f/d6a 0 2024-09-13T22:56:10.093 INFO:tasks.workunit.client.0.smithi002.stdout:2/411: write d1/d7/d8/d51/f5a [4612781,111163] 0 2024-09-13T22:56:10.095 INFO:tasks.workunit.client.0.smithi002.stdout:7/351: mknod d8/d10/d11/d13/d26/c5e 0 2024-09-13T22:56:10.096 INFO:tasks.workunit.client.0.smithi002.stdout:7/352: chown d8/d10/d11/d13/l5a 1 1 2024-09-13T22:56:10.098 INFO:tasks.workunit.client.0.smithi002.stdout:5/412: rename d1/f43 to d1/d2a/d6b/d88/d45/d4f/d8f/f94 0 2024-09-13T22:56:10.099 INFO:tasks.workunit.client.1.smithi047.stdout:4/611: dread dc/de/f18 [0,4194304] 0 2024-09-13T22:56:10.099 INFO:tasks.workunit.client.0.smithi002.stdout:5/413: chown d1/d2a/l34 1 1 2024-09-13T22:56:10.100 INFO:tasks.workunit.client.1.smithi047.stdout:9/460: dwrite d1/dc/d14/dd/d54/d4e/f7b [0,4194304] 0 2024-09-13T22:56:10.102 INFO:tasks.workunit.client.0.smithi002.stdout:1/453: creat d1/d13/f97 x:0 0 0 2024-09-13T22:56:10.104 INFO:tasks.workunit.client.0.smithi002.stdout:6/402: mknod d12/d17/d34/c86 0 2024-09-13T22:56:10.107 INFO:tasks.workunit.client.1.smithi047.stdout:6/562: dwrite d3/f22 [0,4194304] 0 2024-09-13T22:56:10.109 INFO:tasks.workunit.client.0.smithi002.stdout:8/402: getdents d3/dc/d16/d2f 0 2024-09-13T22:56:10.113 INFO:tasks.workunit.client.1.smithi047.stdout:9/461: dwrite d1/dc/d14/dd/d54/d50/f66 [0,4194304] 0 2024-09-13T22:56:10.113 INFO:tasks.workunit.client.0.smithi002.stdout:2/412: mknod d1/d4a/c8c 0 2024-09-13T22:56:10.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.113+0000 7f8aabf68700 1 -- 172.21.15.2:0/110715644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8aa4102e60 msgr2=0x7f8aa4103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:10.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.113+0000 7f8aabf68700 1 --2- 172.21.15.2:0/110715644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8aa4102e60 0x7f8aa4103280 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009910 tx=0x7f8aa0009c20 comp rx=0 tx=0).stop 2024-09-13T22:56:10.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.113+0000 7f8aabf68700 1 -- 172.21.15.2:0/110715644 shutdown_connections 2024-09-13T22:56:10.114 INFO:tasks.workunit.client.0.smithi002.stdout:2/413: stat d1/d7/d8/f1e 0 2024-09-13T22:56:10.115 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:09 smithi002 ceph-mon[27637]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:10.115 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:09 smithi002 ceph-mon[27637]: pgmap v15: 65 pgs: 65 active+clean; 1.6 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 40 MiB/s rd, 188 MiB/s wr, 339 op/s 2024-09-13T22:56:10.115 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:09 smithi002 ceph-mon[27637]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:10.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.113+0000 7f8aabf68700 1 --2- 172.21.15.2:0/110715644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aa4104050 0x7f8aa41044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:10.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.113+0000 7f8aabf68700 1 --2- 172.21.15.2:0/110715644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8aa4102e60 0x7f8aa4103280 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:10.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.113+0000 7f8aabf68700 1 -- 172.21.15.2:0/110715644 >> 172.21.15.2:0/110715644 conn(0x7f8aa40fe470 msgr2=0x7f8aa4100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:10.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.114+0000 7f8aabf68700 1 -- 172.21.15.2:0/110715644 shutdown_connections 2024-09-13T22:56:10.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.114+0000 7f8aabf68700 1 -- 172.21.15.2:0/110715644 wait complete. 2024-09-13T22:56:10.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.115+0000 7f8aabf68700 1 Processor -- start 2024-09-13T22:56:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.115+0000 7f8aabf68700 1 -- start start 2024-09-13T22:56:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.115+0000 7f8aabf68700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aa4102e60 0x7f8aa4071e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.115+0000 7f8aabf68700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8aa4104050 0x7f8aa40723b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.115+0000 7f8aabf68700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa40729d0 con 0x7f8aa4104050 2024-09-13T22:56:10.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.115+0000 7f8aabf68700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa4072b10 con 0x7f8aa4102e60 2024-09-13T22:56:10.118 INFO:tasks.workunit.client.1.smithi047.stdout:6/563: mkdir d3/d11/d2b/d4c/d9d/dc1 0 2024-09-13T22:56:10.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.117+0000 7f8aa9d04700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aa4102e60 0x7f8aa4071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:10.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.117+0000 7f8aa9d04700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aa4102e60 0x7f8aa4071e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.2:56336/0 (socket says 172.21.15.2:56336) 2024-09-13T22:56:10.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.117+0000 7f8aa9d04700 1 -- 172.21.15.2:0/645527961 learned_addr learned my addr 172.21.15.2:0/645527961 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:56:10.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.118+0000 7f8aa9d04700 1 -- 172.21.15.2:0/645527961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8aa4104050 msgr2=0x7f8aa40723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:10.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.118+0000 7f8aa9d04700 1 --2- 172.21.15.2:0/645527961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8aa4104050 0x7f8aa40723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:10.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.118+0000 7f8aa9d04700 1 -- 172.21.15.2:0/645527961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa00095f0 con 0x7f8aa4102e60 2024-09-13T22:56:10.120 INFO:tasks.workunit.client.0.smithi002.stdout:7/353: dread d8/d10/d11/d13/f34 [0,4194304] 0 2024-09-13T22:56:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.118+0000 7f8aa9d04700 1 --2- 172.21.15.2:0/645527961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aa4102e60 0x7f8aa4071e70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000bda0 tx=0x7f8aa000be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.119+0000 7f8a9affd700 1 -- 172.21.15.2:0/645527961 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8aa001d070 con 0x7f8aa4102e60 2024-09-13T22:56:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.119+0000 7f8aabf68700 1 -- 172.21.15.2:0/645527961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa4077760 con 0x7f8aa4102e60 2024-09-13T22:56:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.119+0000 7f8a9affd700 1 -- 172.21.15.2:0/645527961 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8aa0004c50 con 0x7f8aa4102e60 2024-09-13T22:56:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.119+0000 7f8a9affd700 1 -- 172.21.15.2:0/645527961 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8aa000f690 con 0x7f8aa4102e60 2024-09-13T22:56:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.120+0000 7f8aabf68700 1 -- 172.21.15.2:0/645527961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa4077c50 con 0x7f8aa4102e60 2024-09-13T22:56:10.121 INFO:tasks.workunit.client.0.smithi002.stdout:7/354: write d8/d10/f2a [191712,9576] 0 2024-09-13T22:56:10.122 INFO:tasks.workunit.client.1.smithi047.stdout:4/612: rename dc/de/f3f to dc/de/d23/fcc 0 2024-09-13T22:56:10.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.121+0000 7f8aabf68700 1 -- 172.21.15.2:0/645527961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa410ba30 con 0x7f8aa4102e60 2024-09-13T22:56:10.122 INFO:tasks.workunit.client.0.smithi002.stdout:3/489: getdents d9/d3b/d53 0 2024-09-13T22:56:10.123 INFO:tasks.workunit.client.0.smithi002.stdout:3/490: chown d9/d15/d36 323179 1 2024-09-13T22:56:10.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.124+0000 7f8a9affd700 1 -- 172.21.15.2:0/645527961 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 24) v1 ==== 91460+0+0 (secure 0 0 0) 0x7f8aa00229b0 con 0x7f8aa4102e60 2024-09-13T22:56:10.125 INFO:tasks.workunit.client.1.smithi047.stdout:6/564: rmdir d3/d11/d2b/d4c/dc0/d89/d8e 39 2024-09-13T22:56:10.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.124+0000 7f8a9affd700 1 --2- 172.21.15.2:0/645527961 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f8a9006d560 0x7f8a9006fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:10.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.124+0000 7f8a9affd700 1 -- 172.21.15.2:0/645527961 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f8aa008e9c0 con 0x7f8aa4102e60 2024-09-13T22:56:10.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.125+0000 7f8aa9503700 1 --2- 172.21.15.2:0/645527961 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f8a9006d560 0x7f8a9006fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:10.126 INFO:tasks.workunit.client.0.smithi002.stdout:3/491: chown d9/df/f23 1555014109 1 2024-09-13T22:56:10.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.125+0000 7f8aa9503700 1 --2- 172.21.15.2:0/645527961 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f8a9006d560 0x7f8a9006fa20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4102b90 tx=0x7f8a94006d20 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:10.127 INFO:tasks.workunit.client.0.smithi002.stdout:4/383: link d3/d14/d29/d2a/f60 d3/f73 0 2024-09-13T22:56:10.129 INFO:tasks.workunit.client.0.smithi002.stdout:7/355: dwrite f7 [0,4194304] 0 2024-09-13T22:56:10.130 INFO:tasks.workunit.client.0.smithi002.stdout:1/454: rename d1/d1c/d7d/f7f to d1/d1c/d7d/f98 0 2024-09-13T22:56:10.131 INFO:tasks.workunit.client.1.smithi047.stdout:9/462: write d1/dc/d14/dd/d4c/f57 [5618532,7796] 0 2024-09-13T22:56:10.132 INFO:tasks.workunit.client.0.smithi002.stdout:6/403: symlink d12/d17/d28/d7d/l87 0 2024-09-13T22:56:10.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.132+0000 7f8a9affd700 1 -- 172.21.15.2:0/645527961 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f8aa005bcc0 con 0x7f8aa4102e60 2024-09-13T22:56:10.133 INFO:tasks.workunit.client.1.smithi047.stdout:6/565: mkdir d3/d11/d2b/d1c/d4d/d69/dc2 0 2024-09-13T22:56:10.136 INFO:tasks.workunit.client.1.smithi047.stdout:6/566: write d3/d11/d2b/d1c/d4d/fa6 [687946,65674] 0 2024-09-13T22:56:10.136 INFO:tasks.workunit.client.1.smithi047.stdout:9/463: creat d1/dc/d14/dd/d54/d50/d60/f95 x:0 0 0 2024-09-13T22:56:10.138 INFO:tasks.workunit.client.1.smithi047.stdout:6/567: read d3/d11/d2b/d1c/d4d/f84 [801929,121950] 0 2024-09-13T22:56:10.139 INFO:tasks.workunit.client.0.smithi002.stdout:5/414: symlink d1/d2a/l95 0 2024-09-13T22:56:10.141 INFO:tasks.workunit.client.1.smithi047.stdout:4/613: getdents dc/de/d23 0 2024-09-13T22:56:10.141 INFO:tasks.workunit.client.0.smithi002.stdout:3/492: creat d9/d3b/d53/fb3 x:0 0 0 2024-09-13T22:56:10.142 INFO:tasks.workunit.client.1.smithi047.stdout:9/464: mknod d1/d2d/c96 0 2024-09-13T22:56:10.143 INFO:tasks.workunit.client.1.smithi047.stdout:9/465: chown d1/dc/d14/dd/d4c/f57 13913 1 2024-09-13T22:56:10.143 INFO:tasks.workunit.client.1.smithi047.stdout:9/466: stat d1/dc/d18/d72 0 2024-09-13T22:56:10.145 INFO:tasks.workunit.client.0.smithi002.stdout:3/493: dread - d9/d15/d26/f8f zero size 2024-09-13T22:56:10.148 INFO:tasks.workunit.client.0.smithi002.stdout:5/415: dwrite d1/d2a/d69/f92 [0,4194304] 0 2024-09-13T22:56:10.149 INFO:tasks.workunit.client.0.smithi002.stdout:1/455: creat d1/d13/d30/f99 x:0 0 0 2024-09-13T22:56:10.149 INFO:tasks.workunit.client.0.smithi002.stdout:5/416: chown d1/c6f 0 1 2024-09-13T22:56:10.150 INFO:tasks.workunit.client.1.smithi047.stdout:9/467: mkdir d1/dc/d14/dd/d54/d50/d5b/d97 0 2024-09-13T22:56:10.151 INFO:tasks.workunit.client.0.smithi002.stdout:5/417: write d1/d2a/d6b/d88/f74 [1571154,105563] 0 2024-09-13T22:56:10.151 INFO:tasks.workunit.client.0.smithi002.stdout:6/404: mkdir d12/d17/d2a/d88 0 2024-09-13T22:56:10.152 INFO:tasks.workunit.client.0.smithi002.stdout:6/405: fsync d12/d17/d34/f7b 0 2024-09-13T22:56:10.154 INFO:tasks.workunit.client.0.smithi002.stdout:5/418: truncate d1/d2a/d6b/d88/d55/f83 153076 0 2024-09-13T22:56:10.155 INFO:tasks.workunit.client.1.smithi047.stdout:6/568: unlink d3/d2c/c59 0 2024-09-13T22:56:10.158 INFO:tasks.workunit.client.0.smithi002.stdout:0/440: rename d1/d2/d49 to d1/d4/da3 0 2024-09-13T22:56:10.160 INFO:tasks.workunit.client.0.smithi002.stdout:4/384: creat d3/d62/f74 x:0 0 0 2024-09-13T22:56:10.161 INFO:tasks.workunit.client.0.smithi002.stdout:5/419: dwrite d1/d2a/d6b/d88/d45/f54 [0,4194304] 0 2024-09-13T22:56:10.161 INFO:tasks.workunit.client.1.smithi047.stdout:6/569: dread - d3/d11/f63 zero size 2024-09-13T22:56:10.162 INFO:tasks.workunit.client.1.smithi047.stdout:4/614: write dc/de/d17/d25/d9b/fbf [2176823,49924] 0 2024-09-13T22:56:10.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:09 smithi047 ceph-mon[34560]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:10.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:09 smithi047 ceph-mon[34560]: pgmap v15: 65 pgs: 65 active+clean; 1.6 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 40 MiB/s rd, 188 MiB/s wr, 339 op/s 2024-09-13T22:56:10.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:09 smithi047 ceph-mon[34560]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:10.163 INFO:tasks.workunit.client.1.smithi047.stdout:6/570: chown d3/d11/d2b/d1c/c9e 10595 1 2024-09-13T22:56:10.163 INFO:tasks.workunit.client.1.smithi047.stdout:4/615: chown dc/d29/d4d/f7c 5990253 1 2024-09-13T22:56:10.169 INFO:tasks.workunit.client.0.smithi002.stdout:3/494: creat d9/d3b/d53/d83/fb4 x:0 0 0 2024-09-13T22:56:10.171 INFO:tasks.workunit.client.1.smithi047.stdout:6/571: dwrite d3/f22 [0,4194304] 0 2024-09-13T22:56:10.171 INFO:tasks.workunit.client.1.smithi047.stdout:4/616: stat f4 0 2024-09-13T22:56:10.172 INFO:tasks.workunit.client.0.smithi002.stdout:8/403: dwrite d3/dc/d18/f67 [0,4194304] 0 2024-09-13T22:56:10.175 INFO:tasks.workunit.client.0.smithi002.stdout:1/456: readlink d1/d13/d30/d31/d86/l7c 0 2024-09-13T22:56:10.177 INFO:tasks.workunit.client.1.smithi047.stdout:9/468: write d1/f44 [1678677,8284] 0 2024-09-13T22:56:10.179 INFO:tasks.workunit.client.0.smithi002.stdout:6/406: mknod d12/d17/d34/d4b/c89 0 2024-09-13T22:56:10.181 INFO:tasks.workunit.client.0.smithi002.stdout:9/469: rename d8/d2c/d9f to d8/d91/d96/d87/da5 0 2024-09-13T22:56:10.182 INFO:tasks.workunit.client.1.smithi047.stdout:6/572: dwrite d3/d11/d2b/d4c/dc0/fbc [0,4194304] 0 2024-09-13T22:56:10.185 INFO:tasks.workunit.client.0.smithi002.stdout:4/385: fsync d3/d14/f1d 0 2024-09-13T22:56:10.186 INFO:tasks.workunit.client.0.smithi002.stdout:4/386: write d3/d14/f5b [317328,39667] 0 2024-09-13T22:56:10.186 INFO:tasks.workunit.client.0.smithi002.stdout:5/420: creat d1/d2a/d6b/d88/d45/d4f/d78/f96 x:0 0 0 2024-09-13T22:56:10.187 INFO:tasks.workunit.client.1.smithi047.stdout:4/617: link ca dc/d29/d6c/ccd 0 2024-09-13T22:56:10.189 INFO:tasks.workunit.client.1.smithi047.stdout:6/573: creat d3/d77/d8f/db9/fc3 x:0 0 0 2024-09-13T22:56:10.190 INFO:tasks.workunit.client.1.smithi047.stdout:6/574: readlink d3/d11/d2b/d7c/l95 0 2024-09-13T22:56:10.194 INFO:tasks.workunit.client.1.smithi047.stdout:9/469: dread d1/f2b [0,4194304] 0 2024-09-13T22:56:10.196 INFO:tasks.workunit.client.1.smithi047.stdout:2/614: sync 2024-09-13T22:56:10.196 INFO:tasks.workunit.client.1.smithi047.stdout:5/451: sync 2024-09-13T22:56:10.196 INFO:tasks.workunit.client.1.smithi047.stdout:1/479: sync 2024-09-13T22:56:10.197 INFO:tasks.workunit.client.1.smithi047.stdout:0/538: sync 2024-09-13T22:56:10.197 INFO:tasks.workunit.client.1.smithi047.stdout:8/509: sync 2024-09-13T22:56:10.197 INFO:tasks.workunit.client.1.smithi047.stdout:7/549: sync 2024-09-13T22:56:10.197 INFO:tasks.workunit.client.1.smithi047.stdout:3/526: sync 2024-09-13T22:56:10.198 INFO:tasks.workunit.client.0.smithi002.stdout:6/407: unlink d12/f23 0 2024-09-13T22:56:10.198 INFO:tasks.workunit.client.0.smithi002.stdout:1/457: write d1/d13/d21/d39/d70/f96 [3346507,49567] 0 2024-09-13T22:56:10.198 INFO:tasks.workunit.client.0.smithi002.stdout:2/414: rename d1/d32/l65 to d1/d7/d35/d3e/d59/d87/l8d 0 2024-09-13T22:56:10.201 INFO:tasks.workunit.client.0.smithi002.stdout:1/458: fsync d1/d13/d30/f2d 0 2024-09-13T22:56:10.201 INFO:tasks.workunit.client.0.smithi002.stdout:4/387: dread d3/d40/d45/f52 [0,4194304] 0 2024-09-13T22:56:10.201 INFO:tasks.workunit.client.0.smithi002.stdout:6/408: readlink d12/d17/d28/d67/d6b/l41 0 2024-09-13T22:56:10.201 INFO:tasks.workunit.client.0.smithi002.stdout:4/388: readlink d3/d14/d29/l3c 0 2024-09-13T22:56:10.202 INFO:tasks.workunit.client.0.smithi002.stdout:6/409: write d12/f22 [1355582,98308] 0 2024-09-13T22:56:10.202 INFO:tasks.workunit.client.1.smithi047.stdout:0/539: stat d1/d5/d16/d6a/d92/ca0 0 2024-09-13T22:56:10.202 INFO:tasks.workunit.client.1.smithi047.stdout:6/575: symlink d3/d77/d8f/db9/lc4 0 2024-09-13T22:56:10.202 INFO:tasks.workunit.client.1.smithi047.stdout:8/510: read d8/d64/d4e/d4d/d8f/d91/d38/f44 [241769,113357] 0 2024-09-13T22:56:10.204 INFO:tasks.workunit.client.1.smithi047.stdout:9/470: rmdir d1/dc/d14/dd/d54/d8d 39 2024-09-13T22:56:10.205 INFO:tasks.workunit.client.1.smithi047.stdout:6/576: write d3/d77/d8f/db9/fc3 [1030596,15637] 0 2024-09-13T22:56:10.207 INFO:tasks.workunit.client.1.smithi047.stdout:6/577: stat d3/d11/d2b/d1c/dbf 0 2024-09-13T22:56:10.208 INFO:tasks.workunit.client.1.smithi047.stdout:6/578: chown d3/f42 156447 1 2024-09-13T22:56:10.209 INFO:tasks.workunit.client.1.smithi047.stdout:0/540: dwrite d1/d5/f8c [0,4194304] 0 2024-09-13T22:56:10.211 INFO:tasks.workunit.client.1.smithi047.stdout:1/480: unlink d0/d7/d10/c29 0 2024-09-13T22:56:10.213 INFO:tasks.workunit.client.1.smithi047.stdout:2/615: rmdir d1/df/d1d/d20/d54/d8e 39 2024-09-13T22:56:10.217 INFO:tasks.workunit.client.1.smithi047.stdout:4/618: dwrite dc/de/d23/f42 [0,4194304] 0 2024-09-13T22:56:10.218 INFO:tasks.workunit.client.1.smithi047.stdout:0/541: dwrite d1/f36 [0,4194304] 0 2024-09-13T22:56:10.218 INFO:tasks.workunit.client.1.smithi047.stdout:5/452: creat d19/d23/d2e/d41/d58/f97 x:0 0 0 2024-09-13T22:56:10.221 INFO:tasks.workunit.client.1.smithi047.stdout:5/453: fsync d19/f36 0 2024-09-13T22:56:10.223 INFO:tasks.workunit.client.0.smithi002.stdout:2/415: truncate d1/d7/d35/d3e/d5e/f81 393580 0 2024-09-13T22:56:10.223 INFO:tasks.workunit.client.0.smithi002.stdout:6/410: readlink lf 0 2024-09-13T22:56:10.224 INFO:tasks.workunit.client.0.smithi002.stdout:0/441: link d1/d2/f45 d1/d2/d81/d8f/fa4 0 2024-09-13T22:56:10.228 INFO:tasks.workunit.client.0.smithi002.stdout:6/411: stat d12/d17/d34/f7b 0 2024-09-13T22:56:10.228 INFO:tasks.workunit.client.0.smithi002.stdout:7/356: getdents d8/d10 0 2024-09-13T22:56:10.229 INFO:tasks.workunit.client.1.smithi047.stdout:7/550: rename d0/d7/da/d1e/d51/fa7 to d0/d57/d5b/d8b/fbd 0 2024-09-13T22:56:10.229 INFO:tasks.workunit.client.0.smithi002.stdout:0/442: write d1/d2/d81/d8f/f48 [1374708,59400] 0 2024-09-13T22:56:10.229 INFO:tasks.workunit.client.1.smithi047.stdout:4/619: dwrite dc/de/d23/dc4/f47 [0,4194304] 0 2024-09-13T22:56:10.231 INFO:tasks.workunit.client.1.smithi047.stdout:3/527: truncate d0/d25/d44/d43/d3a/f6d 3902732 0 2024-09-13T22:56:10.231 INFO:tasks.workunit.client.1.smithi047.stdout:7/551: write d0/d19/f2d [1672977,83894] 0 2024-09-13T22:56:10.233 INFO:tasks.workunit.client.0.smithi002.stdout:0/443: write d1/d4/da3/f5b [5645331,69400] 0 2024-09-13T22:56:10.234 INFO:tasks.workunit.client.1.smithi047.stdout:8/511: rmdir d8/d64/d4e/d4d/d8f/d91/d78 39 2024-09-13T22:56:10.234 INFO:tasks.workunit.client.0.smithi002.stdout:3/495: rename d9/d3b/d53/d83/l62 to d9/d15/d46/lb5 0 2024-09-13T22:56:10.234 INFO:tasks.workunit.client.0.smithi002.stdout:9/470: mkdir d8/d2c/da6 0 2024-09-13T22:56:10.235 INFO:tasks.workunit.client.1.smithi047.stdout:3/528: write d0/d25/d44/f1e [3254143,112516] 0 2024-09-13T22:56:10.235 INFO:tasks.workunit.client.1.smithi047.stdout:7/552: chown d0/d7/da/d4e/f70 6581741 1 2024-09-13T22:56:10.237 INFO:tasks.workunit.client.1.smithi047.stdout:3/529: stat d0/f5c 0 2024-09-13T22:56:10.240 INFO:tasks.workunit.client.1.smithi047.stdout:5/454: dread d19/d25/d45/f4e [0,4194304] 0 2024-09-13T22:56:10.241 INFO:tasks.workunit.client.0.smithi002.stdout:2/416: dwrite d1/d7/d8/f5d [0,4194304] 0 2024-09-13T22:56:10.243 INFO:tasks.workunit.client.0.smithi002.stdout:6/412: mkdir d12/d17/d34/d39/d8a 0 2024-09-13T22:56:10.244 INFO:tasks.workunit.client.0.smithi002.stdout:7/357: mknod d8/d10/d39/c5f 0 2024-09-13T22:56:10.249 INFO:tasks.workunit.client.1.smithi047.stdout:0/542: chown d1/d5/d16/d23/c2c 193 1 2024-09-13T22:56:10.249 INFO:tasks.workunit.client.0.smithi002.stdout:5/421: fsync d1/d2a/d6b/d88/d45/d4f/d8f/f94 0 2024-09-13T22:56:10.249 INFO:tasks.workunit.client.0.smithi002.stdout:5/422: write d1/d2a/d6b/d88/d55/d56/d81/f90 [387579,23520] 0 2024-09-13T22:56:10.249 INFO:tasks.workunit.client.0.smithi002.stdout:0/444: creat d1/d4/da3/fa5 x:0 0 0 2024-09-13T22:56:10.251 INFO:tasks.workunit.client.0.smithi002.stdout:6/413: dread d12/d17/d34/f38 [0,4194304] 0 2024-09-13T22:56:10.251 INFO:tasks.workunit.client.0.smithi002.stdout:0/445: write d1/d4/da3/f5b [682173,75872] 0 2024-09-13T22:56:10.252 INFO:tasks.workunit.client.1.smithi047.stdout:8/512: dread d8/d64/d4e/d4d/d8f/d91/f3a [4194304,4194304] 0 2024-09-13T22:56:10.261 INFO:tasks.workunit.client.1.smithi047.stdout:6/579: write d3/d11/f63 [186120,48470] 0 2024-09-13T22:56:10.262 INFO:tasks.workunit.client.0.smithi002.stdout:9/471: symlink d8/d91/la7 0 2024-09-13T22:56:10.264 INFO:tasks.workunit.client.0.smithi002.stdout:2/417: mknod d1/d32/d37/d79/c8e 0 2024-09-13T22:56:10.266 INFO:tasks.workunit.client.1.smithi047.stdout:6/580: dread d3/d11/d2b/d1c/d4d/f84 [0,4194304] 0 2024-09-13T22:56:10.266 INFO:tasks.workunit.client.0.smithi002.stdout:7/358: mkdir d8/d10/d39/d60 0 2024-09-13T22:56:10.267 INFO:tasks.workunit.client.0.smithi002.stdout:7/359: read d8/d9/f19 [3738380,117885] 0 2024-09-13T22:56:10.271 INFO:tasks.workunit.client.1.smithi047.stdout:1/481: symlink d0/d7/d87/l88 0 2024-09-13T22:56:10.273 INFO:tasks.workunit.client.0.smithi002.stdout:1/459: truncate d1/d13/d21/d39/f77 189179 0 2024-09-13T22:56:10.273 INFO:tasks.workunit.client.0.smithi002.stdout:1/460: fdatasync d1/d13/d30/d31/f69 0 2024-09-13T22:56:10.275 INFO:tasks.workunit.client.0.smithi002.stdout:6/414: mkdir d12/d17/d34/d39/d8b 0 2024-09-13T22:56:10.275 INFO:tasks.workunit.client.0.smithi002.stdout:6/415: dread - d12/d17/d34/f5a zero size 2024-09-13T22:56:10.276 INFO:tasks.workunit.client.0.smithi002.stdout:6/416: read d12/d17/d34/f38 [28455,102858] 0 2024-09-13T22:56:10.277 INFO:tasks.workunit.client.1.smithi047.stdout:1/482: dwrite d0/d7/db/f67 [0,4194304] 0 2024-09-13T22:56:10.278 INFO:tasks.workunit.client.0.smithi002.stdout:4/389: link d3/d14/f6c d3/d14/f75 0 2024-09-13T22:56:10.282 INFO:tasks.workunit.client.1.smithi047.stdout:8/513: symlink d8/d64/d4e/d4d/d8f/d91/d38/d7a/lb4 0 2024-09-13T22:56:10.282 INFO:tasks.workunit.client.1.smithi047.stdout:8/514: chown d8/d64/d4e 3365102 1 2024-09-13T22:56:10.284 INFO:tasks.workunit.client.0.smithi002.stdout:4/390: dwrite d3/d14/d25/f4f [0,4194304] 0 2024-09-13T22:56:10.284 INFO:tasks.workunit.client.1.smithi047.stdout:3/530: write d0/d3/d4/d16/d2c/de/f10 [6382988,101080] 0 2024-09-13T22:56:10.285 INFO:tasks.workunit.client.1.smithi047.stdout:3/531: write d0/d25/d44/d43/f30 [189971,40080] 0 2024-09-13T22:56:10.289 INFO:tasks.workunit.client.0.smithi002.stdout:7/360: creat d8/d10/d11/d13/d2e/d50/f61 x:0 0 0 2024-09-13T22:56:10.290 INFO:tasks.workunit.client.1.smithi047.stdout:4/620: link dc/de/d23/dc4/f84 dc/de/d23/d40/d7b/dab/dae/fce 0 2024-09-13T22:56:10.292 INFO:tasks.workunit.client.1.smithi047.stdout:2/616: write d1/f2a [698776,125929] 0 2024-09-13T22:56:10.296 INFO:tasks.workunit.client.0.smithi002.stdout:1/461: mknod d1/d13/d1d/d34/d51/c9a 0 2024-09-13T22:56:10.297 INFO:tasks.workunit.client.0.smithi002.stdout:1/462: fsync d1/f4d 0 2024-09-13T22:56:10.298 INFO:tasks.workunit.client.0.smithi002.stdout:7/361: dwrite d8/d10/d11/d13/d2e/d3c/f59 [4194304,4194304] 0 2024-09-13T22:56:10.298 INFO:tasks.workunit.client.1.smithi047.stdout:5/455: mkdir d19/d83/d98 0 2024-09-13T22:56:10.299 INFO:tasks.workunit.client.1.smithi047.stdout:5/456: dread - d19/d25/d45/f6d zero size 2024-09-13T22:56:10.302 INFO:tasks.workunit.client.1.smithi047.stdout:5/457: truncate d19/d23/f6a 879591 0 2024-09-13T22:56:10.304 INFO:tasks.workunit.client.1.smithi047.stdout:7/553: dwrite d0/d57/da6/fb3 [0,4194304] 0 2024-09-13T22:56:10.304 INFO:tasks.workunit.client.1.smithi047.stdout:5/458: write d19/d64/f93 [996423,25638] 0 2024-09-13T22:56:10.305 INFO:tasks.workunit.client.0.smithi002.stdout:1/463: dwrite d1/d13/d30/d31/d86/f8f [4194304,4194304] 0 2024-09-13T22:56:10.305 INFO:tasks.workunit.client.1.smithi047.stdout:0/543: fsync d1/d5/f74 0 2024-09-13T22:56:10.306 INFO:tasks.workunit.client.0.smithi002.stdout:1/464: fsync d1/d13/d21/d40/f5c 0 2024-09-13T22:56:10.306 INFO:tasks.workunit.client.1.smithi047.stdout:5/459: chown d19/d34/d6c 992 1 2024-09-13T22:56:10.308 INFO:tasks.workunit.client.1.smithi047.stdout:5/460: chown d19/d23/d4c/f7c 2384 1 2024-09-13T22:56:10.317 INFO:tasks.workunit.client.0.smithi002.stdout:9/472: write d8/d1e/f25 [400811,3512] 0 2024-09-13T22:56:10.318 INFO:tasks.workunit.client.1.smithi047.stdout:6/581: dwrite d3/d11/d2b/d4c/d30/f71 [0,4194304] 0 2024-09-13T22:56:10.318 INFO:tasks.workunit.client.0.smithi002.stdout:5/423: creat d1/d2a/d6b/d88/d45/f97 x:0 0 0 2024-09-13T22:56:10.319 INFO:tasks.workunit.client.0.smithi002.stdout:9/473: read d8/d10/d1c/d68/d84/f8a [3953487,103194] 0 2024-09-13T22:56:10.319 INFO:tasks.workunit.client.1.smithi047.stdout:9/471: getdents d1/dc/d14/dd/d54/d50 0 2024-09-13T22:56:10.321 INFO:tasks.workunit.client.0.smithi002.stdout:0/446: creat d1/d2/d81/fa6 x:0 0 0 2024-09-13T22:56:10.321 INFO:tasks.workunit.client.1.smithi047.stdout:9/472: chown d1/dc/d14/dd/d54/d50/d5b/d97 1 1 2024-09-13T22:56:10.321 INFO:tasks.workunit.client.1.smithi047.stdout:6/582: truncate d3/d11/d2b/d4c/d30/f91 35730 0 2024-09-13T22:56:10.324 INFO:tasks.workunit.client.1.smithi047.stdout:6/583: chown d3/d11/d2b/d1c/d23/f39 29 1 2024-09-13T22:56:10.326 INFO:tasks.workunit.client.1.smithi047.stdout:3/532: rename d0/d3/d4/d16/d2c/de/f77 to d0/d25/d44/d43/d85/fab 0 2024-09-13T22:56:10.327 INFO:tasks.workunit.client.0.smithi002.stdout:6/417: symlink d12/d17/d34/d39/d8a/l8c 0 2024-09-13T22:56:10.327 INFO:tasks.workunit.client.0.smithi002.stdout:6/418: chown d12/d17/c31 46 1 2024-09-13T22:56:10.328 INFO:tasks.workunit.client.1.smithi047.stdout:4/621: creat dc/d29/d4d/fcf x:0 0 0 2024-09-13T22:56:10.331 INFO:tasks.workunit.client.1.smithi047.stdout:2/617: symlink d1/df/d35/d8b/lcf 0 2024-09-13T22:56:10.333 INFO:tasks.workunit.client.1.smithi047.stdout:7/554: creat d0/d7/da/d2e/fbe x:0 0 0 2024-09-13T22:56:10.335 INFO:tasks.workunit.client.1.smithi047.stdout:0/544: dread d1/f2 [0,4194304] 0 2024-09-13T22:56:10.338 INFO:tasks.workunit.client.1.smithi047.stdout:8/515: symlink d8/d64/lb5 0 2024-09-13T22:56:10.339 INFO:tasks.workunit.client.1.smithi047.stdout:1/483: dwrite d0/d7/f44 [0,4194304] 0 2024-09-13T22:56:10.339 INFO:tasks.workunit.client.1.smithi047.stdout:9/473: dwrite d1/dc/d14/dd/d54/d4e/d51/f5c [0,4194304] 0 2024-09-13T22:56:10.339 INFO:tasks.workunit.client.1.smithi047.stdout:1/484: chown d0 13106923 1 2024-09-13T22:56:10.340 INFO:tasks.workunit.client.1.smithi047.stdout:1/485: readlink d0/d7/db/l7a 0 2024-09-13T22:56:10.341 INFO:tasks.workunit.client.1.smithi047.stdout:0/545: chown d1/d5/d16/d23/d2d/c9f 0 1 2024-09-13T22:56:10.348 INFO:tasks.workunit.client.0.smithi002.stdout:5/424: fdatasync d1/f36 0 2024-09-13T22:56:10.349 INFO:tasks.workunit.client.0.smithi002.stdout:5/425: write d1/f3e [3236850,29223] 0 2024-09-13T22:56:10.350 INFO:tasks.workunit.client.1.smithi047.stdout:1/486: write d0/d7/d14/d28/d36/f84 [997646,29255] 0 2024-09-13T22:56:10.350 INFO:tasks.workunit.client.1.smithi047.stdout:6/584: mknod d3/d11/d2b/d4c/d9d/cc5 0 2024-09-13T22:56:10.350 INFO:tasks.workunit.client.1.smithi047.stdout:0/546: fsync d1/d5/d16/d23/d77/fa1 0 2024-09-13T22:56:10.353 INFO:tasks.workunit.client.1.smithi047.stdout:3/533: symlink d0/d3/d4/d91/lac 0 2024-09-13T22:56:10.354 INFO:tasks.workunit.client.1.smithi047.stdout:0/547: readlink d1/d5/d11/l33 0 2024-09-13T22:56:10.354 INFO:tasks.workunit.client.1.smithi047.stdout:8/516: dread d8/f2b [0,4194304] 0 2024-09-13T22:56:10.355 INFO:tasks.workunit.client.0.smithi002.stdout:6/419: rename d12/d17/d2a/c4c to d12/d17/d2a/d88/c8d 0 2024-09-13T22:56:10.357 INFO:tasks.workunit.client.1.smithi047.stdout:7/555: dwrite d0/d7/da/d1e/d51/f99 [0,4194304] 0 2024-09-13T22:56:10.357 INFO:tasks.workunit.client.0.smithi002.stdout:7/362: symlink d8/d10/d11/d13/d26/l62 0 2024-09-13T22:56:10.358 INFO:tasks.workunit.client.0.smithi002.stdout:8/404: sync 2024-09-13T22:56:10.359 INFO:tasks.workunit.client.0.smithi002.stdout:2/418: getdents d1/d80 0 2024-09-13T22:56:10.360 INFO:tasks.workunit.client.1.smithi047.stdout:5/461: creat d19/d25/d90/f99 x:0 0 0 2024-09-13T22:56:10.362 INFO:tasks.workunit.client.0.smithi002.stdout:4/391: truncate d3/d14/f42 2402041 0 2024-09-13T22:56:10.363 INFO:tasks.workunit.client.0.smithi002.stdout:1/465: link d1/d13/d30/d31/d3d/f8b d1/d13/d1d/d34/d51/f9b 0 2024-09-13T22:56:10.368 INFO:tasks.workunit.client.1.smithi047.stdout:5/462: dwrite d19/d34/d42/f88 [0,4194304] 0 2024-09-13T22:56:10.369 INFO:tasks.workunit.client.0.smithi002.stdout:5/426: symlink d1/d2a/d6b/l98 0 2024-09-13T22:56:10.370 INFO:tasks.workunit.client.0.smithi002.stdout:1/466: dwrite d1/d13/d30/d31/d86/f8f [4194304,4194304] 0 2024-09-13T22:56:10.371 INFO:tasks.workunit.client.1.smithi047.stdout:9/474: unlink d1/dc/d18/l6e 0 2024-09-13T22:56:10.372 INFO:tasks.workunit.client.0.smithi002.stdout:9/474: mkdir d8/d91/d96/da8 0 2024-09-13T22:56:10.374 INFO:tasks.workunit.client.1.smithi047.stdout:4/622: dread dc/d29/d4d/fb4 [0,4194304] 0 2024-09-13T22:56:10.375 INFO:tasks.workunit.client.1.smithi047.stdout:4/623: chown dc/d29/d4d/c56 1 1 2024-09-13T22:56:10.380 INFO:tasks.workunit.client.0.smithi002.stdout:6/420: creat d12/d17/d34/d39/d8a/f8e x:0 0 0 2024-09-13T22:56:10.381 INFO:tasks.workunit.client.0.smithi002.stdout:6/421: fsync d12/d17/d28/f35 0 2024-09-13T22:56:10.382 INFO:tasks.workunit.client.0.smithi002.stdout:7/363: symlink d8/d10/d11/d13/d2e/d50/d52/l63 0 2024-09-13T22:56:10.382 INFO:tasks.workunit.client.0.smithi002.stdout:6/422: write f1 [1885920,71615] 0 2024-09-13T22:56:10.384 INFO:tasks.workunit.client.0.smithi002.stdout:6/423: fsync d12/d17/f48 0 2024-09-13T22:56:10.385 INFO:tasks.workunit.client.0.smithi002.stdout:6/424: dread - d12/d17/d34/f5a zero size 2024-09-13T22:56:10.386 INFO:tasks.workunit.client.0.smithi002.stdout:8/405: creat d3/dc/d51/d6e/f7b x:0 0 0 2024-09-13T22:56:10.392 INFO:tasks.workunit.client.0.smithi002.stdout:5/427: write d1/f18 [1432843,52290] 0 2024-09-13T22:56:10.393 INFO:tasks.workunit.client.0.smithi002.stdout:5/428: dread - d1/d2a/d6b/d88/d55/f7a zero size 2024-09-13T22:56:10.394 INFO:tasks.workunit.client.0.smithi002.stdout:1/467: creat d1/d13/d21/d39/f9c x:0 0 0 2024-09-13T22:56:10.399 INFO:tasks.workunit.client.0.smithi002.stdout:7/364: creat d8/d10/d11/d13/d26/d4c/f64 x:0 0 0 2024-09-13T22:56:10.403 INFO:tasks.workunit.client.1.smithi047.stdout:6/585: mknod d3/d77/d8f/cc6 0 2024-09-13T22:56:10.404 INFO:tasks.workunit.client.0.smithi002.stdout:2/419: dwrite d1/d7/d8/f27 [4194304,4194304] 0 2024-09-13T22:56:10.405 INFO:tasks.workunit.client.1.smithi047.stdout:1/487: dread - d0/d7/d14/d28/f48 zero size 2024-09-13T22:56:10.409 INFO:tasks.workunit.client.0.smithi002.stdout:1/468: mkdir d1/d1c/d9d 0 2024-09-13T22:56:10.410 INFO:tasks.workunit.client.1.smithi047.stdout:0/548: creat d1/d5/d16/d23/d45/d7f/fb4 x:0 0 0 2024-09-13T22:56:10.411 INFO:tasks.workunit.client.0.smithi002.stdout:5/429: mkdir d1/d2a/d6b/d88/d45/d4f/d99 0 2024-09-13T22:56:10.415 INFO:tasks.workunit.client.1.smithi047.stdout:0/549: dread d1/d5/d16/f94 [0,4194304] 0 2024-09-13T22:56:10.417 INFO:tasks.workunit.client.1.smithi047.stdout:3/534: rename d0/d25 to d0/d3/d4/d16/d32/d42/d79/d9c/dad 0 2024-09-13T22:56:10.419 INFO:tasks.workunit.client.1.smithi047.stdout:7/556: unlink d0/d7/f4a 0 2024-09-13T22:56:10.420 INFO:tasks.workunit.client.1.smithi047.stdout:7/557: write d0/d57/d5b/d8b/fbc [801317,9310] 0 2024-09-13T22:56:10.421 INFO:tasks.workunit.client.0.smithi002.stdout:8/406: write d3/dc/d18/f2d [28711,98147] 0 2024-09-13T22:56:10.422 INFO:tasks.workunit.client.0.smithi002.stdout:7/365: creat d8/d10/d11/d13/d2e/f65 x:0 0 0 2024-09-13T22:56:10.429 INFO:tasks.workunit.client.1.smithi047.stdout:5/463: unlink d19/d25/d45/f6d 0 2024-09-13T22:56:10.432 INFO:tasks.workunit.client.1.smithi047.stdout:3/535: dread d0/d3/d4/d16/d2c/f20 [0,4194304] 0 2024-09-13T22:56:10.432 INFO:tasks.workunit.client.1.smithi047.stdout:3/536: read - d0/d3/d4/d16/d32/d42/fa6 zero size 2024-09-13T22:56:10.432 INFO:tasks.workunit.client.1.smithi047.stdout:9/475: mknod d1/d5f/d6a/c98 0 2024-09-13T22:56:10.434 INFO:tasks.workunit.client.1.smithi047.stdout:9/476: write d1/dc/d14/dd/d54/d50/f66 [2814889,15584] 0 2024-09-13T22:56:10.434 INFO:tasks.workunit.client.1.smithi047.stdout:4/624: read dc/de/f97 [2979914,12840] 0 2024-09-13T22:56:10.437 INFO:tasks.workunit.client.0.smithi002.stdout:1/469: fdatasync d1/d13/d52/f95 0 2024-09-13T22:56:10.437 INFO:tasks.workunit.client.0.smithi002.stdout:1/470: stat d1/d1c/d7d 0 2024-09-13T22:56:10.439 INFO:tasks.workunit.client.1.smithi047.stdout:1/488: mkdir d0/d7/d13/d5d/d89 0 2024-09-13T22:56:10.440 INFO:tasks.workunit.client.1.smithi047.stdout:1/489: chown d0/d7/db/c2f 0 1 2024-09-13T22:56:10.441 INFO:tasks.workunit.client.0.smithi002.stdout:5/430: symlink d1/d2a/d6b/d88/d55/d56/d81/l9a 0 2024-09-13T22:56:10.443 INFO:tasks.workunit.client.1.smithi047.stdout:2/618: dwrite d1/df/d1d/d20/d29/f9b [0,4194304] 0 2024-09-13T22:56:10.443 INFO:tasks.workunit.client.1.smithi047.stdout:8/517: symlink d8/d64/lb6 0 2024-09-13T22:56:10.443 INFO:tasks.workunit.client.0.smithi002.stdout:1/471: dwrite d1/d13/d52/f95 [0,4194304] 0 2024-09-13T22:56:10.443 INFO:tasks.workunit.client.1.smithi047.stdout:2/619: fsync d1/df/d1d/d20/d29/dcd/fb8 0 2024-09-13T22:56:10.444 INFO:tasks.workunit.client.0.smithi002.stdout:9/475: creat d8/fa9 x:0 0 0 2024-09-13T22:56:10.444 INFO:tasks.workunit.client.1.smithi047.stdout:6/586: write d3/d11/f81 [89709,92841] 0 2024-09-13T22:56:10.448 INFO:tasks.workunit.client.1.smithi047.stdout:0/550: readlink d1/d5/l60 0 2024-09-13T22:56:10.448 INFO:tasks.workunit.client.1.smithi047.stdout:6/587: write d3/d11/d2b/d4c/d30/fa7 [851753,29850] 0 2024-09-13T22:56:10.449 INFO:tasks.workunit.client.0.smithi002.stdout:6/425: creat d12/d17/d28/d67/f8f x:0 0 0 2024-09-13T22:56:10.450 INFO:tasks.workunit.client.0.smithi002.stdout:2/420: symlink d1/d7/d35/l8f 0 2024-09-13T22:56:10.454 INFO:tasks.workunit.client.0.smithi002.stdout:4/392: getdents d3/d14/d29/d2a 0 2024-09-13T22:56:10.457 INFO:tasks.workunit.client.1.smithi047.stdout:3/537: rename d0/d3/d4/d16/d1c/f2d to d0/d3/d4/d16/d1c/fae 0 2024-09-13T22:56:10.460 INFO:tasks.workunit.client.0.smithi002.stdout:9/476: dread d8/d10/d1c/f19 [0,4194304] 0 2024-09-13T22:56:10.461 INFO:tasks.workunit.client.0.smithi002.stdout:1/472: unlink d1/d13/d30/d31/d3b/f67 0 2024-09-13T22:56:10.462 INFO:tasks.workunit.client.1.smithi047.stdout:4/625: mknod dc/de/d23/d40/d7b/d90/cd0 0 2024-09-13T22:56:10.463 INFO:tasks.workunit.client.0.smithi002.stdout:8/407: creat d3/dc/d18/d56/f7c x:0 0 0 2024-09-13T22:56:10.469 INFO:tasks.workunit.client.1.smithi047.stdout:4/626: dwrite dc/de/d17/d25/d4a/fa4 [0,4194304] 0 2024-09-13T22:56:10.469 INFO:tasks.workunit.client.0.smithi002.stdout:6/426: write d12/d17/f81 [1612038,68005] 0 2024-09-13T22:56:10.472 INFO:tasks.workunit.client.0.smithi002.stdout:2/421: rename d1/d7/d35/d3e/d59/f5b to d1/d7/d35/d3e/d59/f90 0 2024-09-13T22:56:10.472 INFO:tasks.workunit.client.0.smithi002.stdout:6/427: read d12/d17/f1e [2999306,30410] 0 2024-09-13T22:56:10.473 INFO:tasks.workunit.client.0.smithi002.stdout:8/408: dwrite d3/dc/d16/d2f/f47 [0,4194304] 0 2024-09-13T22:56:10.474 INFO:tasks.workunit.client.0.smithi002.stdout:8/409: stat d3/dc/c5e 0 2024-09-13T22:56:10.475 INFO:tasks.workunit.client.0.smithi002.stdout:5/431: dread d1/f8 [0,4194304] 0 2024-09-13T22:56:10.475 INFO:tasks.workunit.client.0.smithi002.stdout:2/422: write d1/d4a/f61 [96964,48723] 0 2024-09-13T22:56:10.478 INFO:tasks.workunit.client.1.smithi047.stdout:1/490: dread d0/f4f [0,4194304] 0 2024-09-13T22:56:10.481 INFO:tasks.workunit.client.0.smithi002.stdout:9/477: fdatasync d8/fe 0 2024-09-13T22:56:10.483 INFO:tasks.workunit.client.1.smithi047.stdout:2/620: rename d1/df/d1d/d20/d2b/c77 to d1/df/d1d/da9/cd0 0 2024-09-13T22:56:10.483 INFO:tasks.workunit.client.1.smithi047.stdout:9/477: write d1/f1a [438689,2310] 0 2024-09-13T22:56:10.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.485+0000 7f8aabf68700 1 -- 172.21.15.2:0/645527961 --> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8aa4108a30 con 0x7f8a9006d560 2024-09-13T22:56:10.486 INFO:tasks.workunit.client.0.smithi002.stdout:8/410: dwrite d3/f4f [0,4194304] 0 2024-09-13T22:56:10.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.487+0000 7f8a9affd700 1 -- 172.21.15.2:0/645527961 <== mgr.14590 v2:172.21.15.47:6828/1914885837 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f8aa4108a30 con 0x7f8a9006d560 2024-09-13T22:56:10.488 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:56:10.488 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:56:10.488 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T22:56:10.488 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T22:56:10.488 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [], 2024-09-13T22:56:10.488 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "1/2 daemons upgraded", 2024-09-13T22:56:10.489 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "", 2024-09-13T22:56:10.489 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T22:56:10.489 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:56:10.491 INFO:tasks.workunit.client.0.smithi002.stdout:9/478: dwrite d8/f70 [0,4194304] 0 2024-09-13T22:56:10.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.492+0000 7f8aabf68700 1 -- 172.21.15.2:0/645527961 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f8a9006d560 msgr2=0x7f8a9006fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:10.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.492+0000 7f8aabf68700 1 --2- 172.21.15.2:0/645527961 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f8a9006d560 0x7f8a9006fa20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4102b90 tx=0x7f8a94006d20 comp rx=0 tx=0).stop 2024-09-13T22:56:10.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.492+0000 7f8aabf68700 1 -- 172.21.15.2:0/645527961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aa4102e60 msgr2=0x7f8aa4071e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:10.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.492+0000 7f8aabf68700 1 --2- 172.21.15.2:0/645527961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aa4102e60 0x7f8aa4071e70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000bda0 tx=0x7f8aa000be80 comp rx=0 tx=0).stop 2024-09-13T22:56:10.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.493+0000 7f8aabf68700 1 -- 172.21.15.2:0/645527961 shutdown_connections 2024-09-13T22:56:10.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.493+0000 7f8aabf68700 1 --2- 172.21.15.2:0/645527961 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f8a9006d560 0x7f8a9006fa20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:10.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.493+0000 7f8aabf68700 1 --2- 172.21.15.2:0/645527961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aa4102e60 0x7f8aa4071e70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:10.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.493+0000 7f8aabf68700 1 --2- 172.21.15.2:0/645527961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8aa4104050 0x7f8aa40723b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:10.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.493+0000 7f8aabf68700 1 -- 172.21.15.2:0/645527961 >> 172.21.15.2:0/645527961 conn(0x7f8aa40fe470 msgr2=0x7f8aa4107310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:10.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.493+0000 7f8aabf68700 1 -- 172.21.15.2:0/645527961 shutdown_connections 2024-09-13T22:56:10.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:10.493+0000 7f8aabf68700 1 -- 172.21.15.2:0/645527961 wait complete. 2024-09-13T22:56:10.497 INFO:tasks.workunit.client.1.smithi047.stdout:5/464: creat d19/d25/d85/f9a x:0 0 0 2024-09-13T22:56:10.498 INFO:tasks.workunit.client.1.smithi047.stdout:5/465: chown d19 33783 1 2024-09-13T22:56:10.500 INFO:tasks.workunit.client.0.smithi002.stdout:8/411: dwrite d3/dc/d16/d4b/f6c [0,4194304] 0 2024-09-13T22:56:10.500 INFO:tasks.workunit.client.1.smithi047.stdout:6/588: dwrite d3/d77/d8f/f92 [0,4194304] 0 2024-09-13T22:56:10.503 INFO:tasks.workunit.client.1.smithi047.stdout:3/538: creat d0/d3/d4/d16/d2c/de/d1f/faf x:0 0 0 2024-09-13T22:56:10.511 INFO:tasks.workunit.client.1.smithi047.stdout:6/589: dwrite d3/d11/d2b/d4c/d30/f71 [0,4194304] 0 2024-09-13T22:56:10.512 INFO:tasks.workunit.client.0.smithi002.stdout:6/428: dread d12/d17/f27 [0,4194304] 0 2024-09-13T22:56:10.514 INFO:tasks.workunit.client.1.smithi047.stdout:8/518: creat d8/d6b/da9/fb7 x:0 0 0 2024-09-13T22:56:10.515 INFO:tasks.workunit.client.1.smithi047.stdout:8/519: stat d8/d3f/d8c/l8e 0 2024-09-13T22:56:10.516 INFO:tasks.workunit.client.0.smithi002.stdout:1/473: unlink d1/d13/d21/c5e 0 2024-09-13T22:56:10.518 INFO:tasks.workunit.client.0.smithi002.stdout:7/366: getdents d8/d10/d11/d13/d2e/d50 0 2024-09-13T22:56:10.519 INFO:tasks.workunit.client.1.smithi047.stdout:1/491: rmdir d0/d7/d87 39 2024-09-13T22:56:10.520 INFO:tasks.workunit.client.0.smithi002.stdout:6/429: dwrite d12/f74 [0,4194304] 0 2024-09-13T22:56:10.520 INFO:tasks.workunit.client.0.smithi002.stdout:6/430: fdatasync d12/d17/f6e 0 2024-09-13T22:56:10.527 INFO:tasks.workunit.client.0.smithi002.stdout:7/367: dwrite d8/d10/d11/d13/d26/d4c/f53 [0,4194304] 0 2024-09-13T22:56:10.530 INFO:tasks.workunit.client.0.smithi002.stdout:8/412: chown d3/f24 40 1 2024-09-13T22:56:10.530 INFO:tasks.workunit.client.0.smithi002.stdout:4/393: creat d3/d40/f76 x:0 0 0 2024-09-13T22:56:10.531 INFO:tasks.workunit.client.1.smithi047.stdout:0/551: dwrite d1/d5/d16/d23/d45/f4f [0,4194304] 0 2024-09-13T22:56:10.533 INFO:tasks.workunit.client.1.smithi047.stdout:0/552: fsync d1/d5/d16/d23/d2d/f31 0 2024-09-13T22:56:10.537 INFO:tasks.workunit.client.0.smithi002.stdout:4/394: dwrite d3/d40/f70 [0,4194304] 0 2024-09-13T22:56:10.543 INFO:tasks.workunit.client.1.smithi047.stdout:0/553: dwrite d1/d7/f6c [0,4194304] 0 2024-09-13T22:56:10.547 INFO:tasks.workunit.client.1.smithi047.stdout:3/539: rename d0/d3/d4/d16/d2c/de/d3d/f50 to d0/d3/d4/d16/d2c/de/fb0 0 2024-09-13T22:56:10.553 INFO:tasks.workunit.client.0.smithi002.stdout:3/496: sync 2024-09-13T22:56:10.553 INFO:tasks.workunit.client.1.smithi047.stdout:6/590: symlink d3/d11/d2b/d1c/lc7 0 2024-09-13T22:56:10.554 INFO:tasks.workunit.client.0.smithi002.stdout:5/432: truncate d1/d2a/f7d 455480 0 2024-09-13T22:56:10.554 INFO:tasks.workunit.client.0.smithi002.stdout:3/497: write d9/d3b/d53/d83/fb4 [849013,12131] 0 2024-09-13T22:56:10.555 INFO:tasks.workunit.client.1.smithi047.stdout:2/621: dwrite d1/de/f25 [0,4194304] 0 2024-09-13T22:56:10.556 INFO:tasks.workunit.client.1.smithi047.stdout:0/554: dwrite d1/d5/d16/d23/d45/d7f/f78 [0,4194304] 0 2024-09-13T22:56:10.565 INFO:tasks.workunit.client.0.smithi002.stdout:3/498: dread f3 [0,4194304] 0 2024-09-13T22:56:10.589 INFO:tasks.workunit.client.1.smithi047.stdout:2/622: write d1/de/f25 [1634552,78531] 0 2024-09-13T22:56:10.590 INFO:tasks.workunit.client.1.smithi047.stdout:1/492: rmdir d0/d7/d10/d55 39 2024-09-13T22:56:10.595 INFO:tasks.workunit.client.1.smithi047.stdout:9/478: creat d1/dc/d14/dd/d54/d50/d5b/d97/f99 x:0 0 0 2024-09-13T22:56:10.597 INFO:tasks.workunit.client.0.smithi002.stdout:0/447: sync 2024-09-13T22:56:10.599 INFO:tasks.workunit.client.1.smithi047.stdout:9/479: dwrite d1/dc/d14/dd/d54/d50/f66 [0,4194304] 0 2024-09-13T22:56:10.617 INFO:tasks.workunit.client.1.smithi047.stdout:9/480: dread d1/f25 [0,4194304] 0 2024-09-13T22:56:10.618 INFO:tasks.workunit.client.1.smithi047.stdout:9/481: read d1/f25 [1538634,27366] 0 2024-09-13T22:56:10.627 INFO:tasks.workunit.client.0.smithi002.stdout:6/431: write f1 [1920194,24293] 0 2024-09-13T22:56:10.629 INFO:tasks.workunit.client.1.smithi047.stdout:8/520: dwrite d8/d64/d4e/d4d/d8f/d91/d40/f48 [0,4194304] 0 2024-09-13T22:56:10.631 INFO:tasks.workunit.client.0.smithi002.stdout:3/499: creat d9/d91/fb6 x:0 0 0 2024-09-13T22:56:10.632 INFO:tasks.workunit.client.1.smithi047.stdout:4/627: creat dc/fd1 x:0 0 0 2024-09-13T22:56:10.636 INFO:tasks.workunit.client.0.smithi002.stdout:7/368: dwrite d8/d10/f45 [0,4194304] 0 2024-09-13T22:56:10.636 INFO:tasks.workunit.client.1.smithi047.stdout:5/466: write d19/d34/d42/f5b [291146,5035] 0 2024-09-13T22:56:10.636 INFO:tasks.workunit.client.1.smithi047.stdout:5/467: readlink lb 0 2024-09-13T22:56:10.637 INFO:tasks.workunit.client.1.smithi047.stdout:8/521: dread d8/d64/f47 [0,4194304] 0 2024-09-13T22:56:10.638 INFO:tasks.workunit.client.0.smithi002.stdout:1/474: write d1/d13/d30/d31/d3d/d5d/f37 [7607148,91011] 0 2024-09-13T22:56:10.642 INFO:tasks.workunit.client.0.smithi002.stdout:0/448: rename d1/d2/f4f to d1/d4/d75/d31/d32/fa7 0 2024-09-13T22:56:10.644 INFO:tasks.workunit.client.0.smithi002.stdout:4/395: symlink d3/d40/l77 0 2024-09-13T22:56:10.645 INFO:tasks.workunit.client.1.smithi047.stdout:2/623: mkdir d1/df/d35/d8b/dd1 0 2024-09-13T22:56:10.647 INFO:tasks.workunit.client.1.smithi047.stdout:8/522: dread d8/d64/d4e/d4d/f6a [0,4194304] 0 2024-09-13T22:56:10.647 INFO:tasks.workunit.client.1.smithi047.stdout:1/493: rmdir d0/d7/db 39 2024-09-13T22:56:10.651 INFO:tasks.workunit.client.0.smithi002.stdout:5/433: link d1/f3e d1/d2a/d6b/d88/d45/d4f/d78/d8b/f9b 0 2024-09-13T22:56:10.652 INFO:tasks.workunit.client.0.smithi002.stdout:8/413: truncate d3/d27/f59 318398 0 2024-09-13T22:56:10.653 INFO:tasks.workunit.client.0.smithi002.stdout:6/432: symlink d12/d17/d2a/l90 0 2024-09-13T22:56:10.653 INFO:tasks.workunit.client.0.smithi002.stdout:8/414: write d3/dc/d51/d6e/f7b [541138,100957] 0 2024-09-13T22:56:10.653 INFO:tasks.workunit.client.1.smithi047.stdout:3/540: write d0/d3/d4/d16/d32/f39 [1496526,111302] 0 2024-09-13T22:56:10.654 INFO:tasks.workunit.client.0.smithi002.stdout:8/415: chown d3/f8 2 1 2024-09-13T22:56:10.655 INFO:tasks.workunit.client.0.smithi002.stdout:9/479: sync 2024-09-13T22:56:10.655 INFO:tasks.workunit.client.0.smithi002.stdout:2/423: sync 2024-09-13T22:56:10.656 INFO:tasks.workunit.client.0.smithi002.stdout:8/416: write d3/dc/d18/f2d [1340327,51525] 0 2024-09-13T22:56:10.657 INFO:tasks.workunit.client.0.smithi002.stdout:9/480: chown d8/d91/d96/d87 333235261 1 2024-09-13T22:56:10.657 INFO:tasks.workunit.client.0.smithi002.stdout:2/424: write d1/d7/d41/f7a [960876,97910] 0 2024-09-13T22:56:10.657 INFO:tasks.workunit.client.0.smithi002.stdout:8/417: write d3/f69 [305953,96478] 0 2024-09-13T22:56:10.658 INFO:tasks.workunit.client.1.smithi047.stdout:9/482: creat d1/dc/d14/dd/d4c/f9a x:0 0 0 2024-09-13T22:56:10.659 INFO:tasks.workunit.client.0.smithi002.stdout:9/481: chown d8/d10/d1c/d68/d84/ca0 0 1 2024-09-13T22:56:10.660 INFO:tasks.workunit.client.1.smithi047.stdout:9/483: chown d1/dc/d14/dd/d54/f8c 140 1 2024-09-13T22:56:10.660 INFO:tasks.workunit.client.0.smithi002.stdout:2/425: write d1/d7/d8/f5d [4161234,119302] 0 2024-09-13T22:56:10.660 INFO:tasks.workunit.client.0.smithi002.stdout:3/500: creat d9/d15/d36/d4e/d5e/fb7 x:0 0 0 2024-09-13T22:56:10.661 INFO:tasks.workunit.client.0.smithi002.stdout:2/426: chown d1/d32/c60 42 1 2024-09-13T22:56:10.669 INFO:tasks.workunit.client.1.smithi047.stdout:4/628: rename dc/d29/f38 to dc/da3/fd2 0 2024-09-13T22:56:10.672 INFO:tasks.workunit.client.1.smithi047.stdout:5/468: chown l14 29872 1 2024-09-13T22:56:10.674 INFO:tasks.workunit.client.0.smithi002.stdout:0/449: creat d1/d4/d75/d76/fa8 x:0 0 0 2024-09-13T22:56:10.674 INFO:tasks.workunit.client.0.smithi002.stdout:4/396: rmdir d3 39 2024-09-13T22:56:10.676 INFO:tasks.workunit.client.0.smithi002.stdout:2/427: dread d1/d7/d8/d2c/f39 [0,4194304] 0 2024-09-13T22:56:10.676 INFO:tasks.workunit.client.1.smithi047.stdout:0/555: mknod d1/d5/d16/d97/cb5 0 2024-09-13T22:56:10.677 INFO:tasks.workunit.client.0.smithi002.stdout:5/434: mknod d1/d2a/d6b/d88/d45/d4f/d78/d8b/c9c 0 2024-09-13T22:56:10.678 INFO:tasks.workunit.client.0.smithi002.stdout:7/369: dwrite d8/d9/f19 [0,4194304] 0 2024-09-13T22:56:10.678 INFO:tasks.workunit.client.1.smithi047.stdout:5/469: dwrite d19/d34/d42/d5d/f8c [0,4194304] 0 2024-09-13T22:56:10.680 INFO:tasks.workunit.client.0.smithi002.stdout:5/435: write d1/d2a/d6b/d88/f70 [669113,32996] 0 2024-09-13T22:56:10.682 INFO:tasks.workunit.client.0.smithi002.stdout:6/433: unlink d12/d17/d34/d4b/f7a 0 2024-09-13T22:56:10.684 INFO:tasks.workunit.client.1.smithi047.stdout:8/523: unlink d8/d6b/f87 0 2024-09-13T22:56:10.687 INFO:tasks.workunit.client.0.smithi002.stdout:5/436: dwrite d1/d2a/d6b/d88/d45/f97 [0,4194304] 0 2024-09-13T22:56:10.688 INFO:tasks.workunit.client.0.smithi002.stdout:1/475: write d1/d13/d30/d31/f44 [3830786,59114] 0 2024-09-13T22:56:10.691 INFO:tasks.workunit.client.0.smithi002.stdout:6/434: dwrite d12/d17/f6e [0,4194304] 0 2024-09-13T22:56:10.698 INFO:tasks.workunit.client.1.smithi047.stdout:1/494: dwrite d0/d7/db/d79/f7b [0,4194304] 0 2024-09-13T22:56:10.699 INFO:tasks.workunit.client.0.smithi002.stdout:9/482: chown d8/d91/d96/d87/da5/c9c 30 1 2024-09-13T22:56:10.699 INFO:tasks.workunit.client.0.smithi002.stdout:9/483: chown d8/d10/d1c/d3d/f7d 9548 1 2024-09-13T22:56:10.700 INFO:tasks.workunit.client.1.smithi047.stdout:4/629: truncate dc/f19 3843763 0 2024-09-13T22:56:10.704 INFO:tasks.workunit.client.1.smithi047.stdout:2/624: dwrite d1/df/d1d/d20/d54/f72 [0,4194304] 0 2024-09-13T22:56:10.706 INFO:tasks.workunit.client.0.smithi002.stdout:9/484: read d8/d91/d96/fa2 [1924914,52670] 0 2024-09-13T22:56:10.706 INFO:tasks.workunit.client.1.smithi047.stdout:0/556: mkdir d1/d5/d16/d97/db6 0 2024-09-13T22:56:10.707 INFO:tasks.workunit.client.1.smithi047.stdout:5/470: creat d19/d34/d42/d5d/f9b x:0 0 0 2024-09-13T22:56:10.710 INFO:tasks.workunit.client.0.smithi002.stdout:2/428: rename d1/f2 to d1/d7/d35/d3e/d59/d6b/d75/f91 0 2024-09-13T22:56:10.711 INFO:tasks.workunit.client.0.smithi002.stdout:2/429: fsync d1/f5 0 2024-09-13T22:56:10.712 INFO:tasks.workunit.client.0.smithi002.stdout:2/430: write d1/d7/d8/f33 [1511420,85183] 0 2024-09-13T22:56:10.719 INFO:tasks.workunit.client.1.smithi047.stdout:3/541: symlink d0/d3/d4/d16/d32/d42/d79/d9c/dad/lb1 0 2024-09-13T22:56:10.719 INFO:tasks.workunit.client.1.smithi047.stdout:9/484: getdents d1/dc/d14/dd/d54/d50/d91 0 2024-09-13T22:56:10.720 INFO:tasks.workunit.client.0.smithi002.stdout:3/501: dread d9/df/f54 [0,4194304] 0 2024-09-13T22:56:10.720 INFO:tasks.workunit.client.0.smithi002.stdout:5/437: dread - d1/f37 zero size 2024-09-13T22:56:10.720 INFO:tasks.workunit.client.0.smithi002.stdout:1/476: mkdir d1/d13/d30/d31/d86/d9e 0 2024-09-13T22:56:10.721 INFO:tasks.workunit.client.1.smithi047.stdout:9/485: write d1/d2d/f81 [331800,41] 0 2024-09-13T22:56:10.721 INFO:tasks.workunit.client.0.smithi002.stdout:5/438: write d1/d2a/d6b/d88/d45/d4f/d78/f79 [934149,76523] 0 2024-09-13T22:56:10.723 INFO:tasks.workunit.client.1.smithi047.stdout:1/495: mkdir d0/d7/d14/d57/d62/d8a 0 2024-09-13T22:56:10.725 INFO:tasks.workunit.client.1.smithi047.stdout:4/630: creat dc/de/d23/d40/d7b/dab/fd3 x:0 0 0 2024-09-13T22:56:10.731 INFO:tasks.workunit.client.1.smithi047.stdout:4/631: dwrite dc/de/d23/f83 [0,4194304] 0 2024-09-13T22:56:10.732 INFO:tasks.workunit.client.1.smithi047.stdout:4/632: fsync dc/f9e 0 2024-09-13T22:56:10.735 INFO:tasks.workunit.client.1.smithi047.stdout:8/524: mknod d8/d64/d4e/d4d/d8f/d9d/cb8 0 2024-09-13T22:56:10.735 INFO:tasks.workunit.client.1.smithi047.stdout:4/633: dread - dc/de/d23/d40/f9a zero size 2024-09-13T22:56:10.735 INFO:tasks.workunit.client.1.smithi047.stdout:4/634: dread - dc/d29/d6c/fb7 zero size 2024-09-13T22:56:10.737 INFO:tasks.workunit.client.1.smithi047.stdout:9/486: creat d1/d5f/f9b x:0 0 0 2024-09-13T22:56:10.738 INFO:tasks.workunit.client.1.smithi047.stdout:9/487: truncate d1/f8e 365286 0 2024-09-13T22:56:10.743 INFO:tasks.workunit.client.1.smithi047.stdout:0/557: write d1/d5/d16/f94 [467005,121625] 0 2024-09-13T22:56:10.744 INFO:tasks.workunit.client.1.smithi047.stdout:2/625: mknod d1/df/d26/cd2 0 2024-09-13T22:56:10.746 INFO:tasks.workunit.client.1.smithi047.stdout:5/471: write d19/d23/d2e/d41/f5a [2703372,39872] 0 2024-09-13T22:56:10.746 INFO:tasks.workunit.client.1.smithi047.stdout:5/472: readlink lb 0 2024-09-13T22:56:10.750 INFO:tasks.workunit.client.1.smithi047.stdout:8/525: write d8/d64/d4e/d70/f93 [5666148,104444] 0 2024-09-13T22:56:10.752 INFO:tasks.workunit.client.1.smithi047.stdout:4/635: creat dc/de/d23/d40/fd4 x:0 0 0 2024-09-13T22:56:10.752 INFO:tasks.workunit.client.1.smithi047.stdout:0/558: dwrite d1/d5/d11/d2f/fb2 [0,4194304] 0 2024-09-13T22:56:10.754 INFO:tasks.workunit.client.1.smithi047.stdout:9/488: mknod d1/d5f/c9c 0 2024-09-13T22:56:10.756 INFO:tasks.workunit.client.0.smithi002.stdout:4/397: truncate d3/d14/d29/d2a/f2d 733942 0 2024-09-13T22:56:10.763 INFO:tasks.workunit.client.1.smithi047.stdout:5/473: fsync d19/d25/d45/f4e 0 2024-09-13T22:56:10.764 INFO:tasks.workunit.client.0.smithi002.stdout:4/398: dread d3/d14/f1d [0,4194304] 0 2024-09-13T22:56:10.764 INFO:tasks.workunit.client.1.smithi047.stdout:5/474: truncate d19/d23/d4c/f67 1047680 0 2024-09-13T22:56:10.770 INFO:tasks.workunit.client.1.smithi047.stdout:0/559: read d1/d5/d16/d23/d2d/f55 [375428,100195] 0 2024-09-13T22:56:10.771 INFO:tasks.workunit.client.0.smithi002.stdout:7/370: truncate d8/d9/f40 239246 0 2024-09-13T22:56:10.771 INFO:tasks.workunit.client.1.smithi047.stdout:0/560: write d1/d5/f8c [2644259,59118] 0 2024-09-13T22:56:10.772 INFO:tasks.workunit.client.0.smithi002.stdout:7/371: write d8/d10/d11/d13/f1c [2828404,73985] 0 2024-09-13T22:56:10.773 INFO:tasks.workunit.client.1.smithi047.stdout:9/489: mknod d1/dc/d14/dd/d54/d50/c9d 0 2024-09-13T22:56:10.773 INFO:tasks.workunit.client.0.smithi002.stdout:7/372: chown d8/d9/f54 86 1 2024-09-13T22:56:10.775 INFO:tasks.workunit.client.0.smithi002.stdout:1/477: creat d1/d13/d52/f9f x:0 0 0 2024-09-13T22:56:10.775 INFO:tasks.workunit.client.1.smithi047.stdout:4/636: write dc/de/f97 [3925487,66621] 0 2024-09-13T22:56:10.776 INFO:tasks.workunit.client.1.smithi047.stdout:2/626: truncate d1/df/d1d/da9/faf 1762030 0 2024-09-13T22:56:10.777 INFO:tasks.workunit.client.0.smithi002.stdout:5/439: rmdir d1/d2a/d6b/d88/d55/d56 39 2024-09-13T22:56:10.780 INFO:tasks.workunit.client.0.smithi002.stdout:7/373: dwrite d8/d10/d11/d13/d26/d4c/f64 [0,4194304] 0 2024-09-13T22:56:10.782 INFO:tasks.workunit.client.0.smithi002.stdout:4/399: mkdir d3/d14/d25/d5e/d78 0 2024-09-13T22:56:10.784 INFO:tasks.workunit.client.1.smithi047.stdout:0/561: fsync d1/d5/d16/d23/d2d/f61 0 2024-09-13T22:56:10.789 INFO:tasks.workunit.client.0.smithi002.stdout:2/431: sync 2024-09-13T22:56:10.790 INFO:tasks.workunit.client.1.smithi047.stdout:9/490: unlink d1/dc/c34 0 2024-09-13T22:56:10.792 INFO:tasks.workunit.client.1.smithi047.stdout:1/496: getdents d0/d7/d13/d5d 0 2024-09-13T22:56:10.793 INFO:tasks.workunit.client.1.smithi047.stdout:0/562: dwrite d1/d5/d16/d23/d2d/f5a [0,4194304] 0 2024-09-13T22:56:10.798 INFO:tasks.workunit.client.1.smithi047.stdout:2/627: dread d1/df/d1d/d20/d2b/f7d [0,4194304] 0 2024-09-13T22:56:10.801 INFO:tasks.workunit.client.1.smithi047.stdout:5/475: link d19/d23/d32/f55 d19/d23/d2e/d41/f9c 0 2024-09-13T22:56:10.801 INFO:tasks.workunit.client.0.smithi002.stdout:5/440: fsync d1/d2a/d6b/f72 0 2024-09-13T22:56:10.802 INFO:tasks.workunit.client.1.smithi047.stdout:8/526: link d8/d3f/l60 d8/d3f/d8c/lb9 0 2024-09-13T22:56:10.803 INFO:tasks.workunit.client.0.smithi002.stdout:8/418: link d3/d27/c2c d3/d27/c7d 0 2024-09-13T22:56:10.803 INFO:tasks.workunit.client.0.smithi002.stdout:5/441: write d1/d2a/d6b/d88/f4d [891118,59138] 0 2024-09-13T22:56:10.805 INFO:tasks.workunit.client.0.smithi002.stdout:6/435: creat d12/d17/f91 x:0 0 0 2024-09-13T22:56:10.807 INFO:tasks.workunit.client.0.smithi002.stdout:0/450: getdents d1 0 2024-09-13T22:56:10.812 INFO:tasks.workunit.client.1.smithi047.stdout:1/497: creat d0/d7/db/f8b x:0 0 0 2024-09-13T22:56:10.814 INFO:tasks.workunit.client.1.smithi047.stdout:1/498: dread - d0/d7/d14/d28/d36/f4c zero size 2024-09-13T22:56:10.814 INFO:tasks.workunit.client.1.smithi047.stdout:4/637: creat dc/de/d23/d40/d7b/dab/dae/fd5 x:0 0 0 2024-09-13T22:56:10.815 INFO:tasks.workunit.client.0.smithi002.stdout:4/400: fdatasync d3/f1e 0 2024-09-13T22:56:10.816 INFO:tasks.workunit.client.1.smithi047.stdout:0/563: chown d1/d5/d16/d23/d2d/l7c 40047052 1 2024-09-13T22:56:10.817 INFO:tasks.workunit.client.1.smithi047.stdout:0/564: write d1/f36 [3970073,98595] 0 2024-09-13T22:56:10.818 INFO:tasks.workunit.client.1.smithi047.stdout:0/565: chown d1/d5/d16/d23/d2d/f5e 13515 1 2024-09-13T22:56:10.818 INFO:tasks.workunit.client.0.smithi002.stdout:3/502: creat d9/fb8 x:0 0 0 2024-09-13T22:56:10.822 INFO:tasks.workunit.client.1.smithi047.stdout:8/527: mknod d8/d64/d4e/d4d/d8f/cba 0 2024-09-13T22:56:10.823 INFO:tasks.workunit.client.1.smithi047.stdout:5/476: write d19/d25/d45/f4e [577981,113852] 0 2024-09-13T22:56:10.825 INFO:tasks.workunit.client.1.smithi047.stdout:5/477: readlink d19/d23/l89 0 2024-09-13T22:56:10.826 INFO:tasks.workunit.client.0.smithi002.stdout:5/442: symlink d1/d2a/d6b/d88/d45/d4f/d78/l9d 0 2024-09-13T22:56:10.827 INFO:tasks.workunit.client.0.smithi002.stdout:2/432: dwrite d1/d7/d8/f1e [0,4194304] 0 2024-09-13T22:56:10.828 INFO:tasks.workunit.client.1.smithi047.stdout:1/499: mkdir d0/d7/d13/d8c 0 2024-09-13T22:56:10.828 INFO:tasks.workunit.client.0.smithi002.stdout:2/433: dread - d1/d7d/f85 zero size 2024-09-13T22:56:10.828 INFO:tasks.workunit.client.1.smithi047.stdout:1/500: stat d0/d1d 0 2024-09-13T22:56:10.829 INFO:tasks.workunit.client.1.smithi047.stdout:4/638: creat dc/de/d23/d40/d7b/d90/da6/fd6 x:0 0 0 2024-09-13T22:56:10.829 INFO:tasks.workunit.client.1.smithi047.stdout:8/528: dwrite d8/d77/fb3 [0,4194304] 0 2024-09-13T22:56:10.830 INFO:tasks.workunit.client.0.smithi002.stdout:2/434: dread - d1/f6a zero size 2024-09-13T22:56:10.831 INFO:tasks.workunit.client.1.smithi047.stdout:2/628: mknod d1/df/d1d/d20/d37/d7b/db6/cd3 0 2024-09-13T22:56:10.832 INFO:tasks.workunit.client.0.smithi002.stdout:9/485: getdents d8/d91/d96 0 2024-09-13T22:56:10.835 INFO:tasks.workunit.client.1.smithi047.stdout:4/639: truncate dc/de/d17/d25/d4a/f9f 979027 0 2024-09-13T22:56:10.840 INFO:tasks.workunit.client.1.smithi047.stdout:1/501: dwrite d0/d1d/f60 [0,4194304] 0 2024-09-13T22:56:10.840 INFO:tasks.workunit.client.0.smithi002.stdout:5/443: dwrite d1/d2a/d6b/d88/d45/d4f/d78/f96 [0,4194304] 0 2024-09-13T22:56:10.841 INFO:tasks.workunit.client.1.smithi047.stdout:4/640: write dc/de/d23/d40/d7b/d90/da6/fd6 [771809,116376] 0 2024-09-13T22:56:10.841 INFO:tasks.workunit.client.0.smithi002.stdout:5/444: fsync d1/d2a/d5a/f62 0 2024-09-13T22:56:10.842 INFO:tasks.workunit.client.0.smithi002.stdout:4/401: creat d3/d14/d25/d5e/f79 x:0 0 0 2024-09-13T22:56:10.842 INFO:tasks.workunit.client.1.smithi047.stdout:5/478: mkdir d19/d34/d42/d5d/d9d 0 2024-09-13T22:56:10.843 INFO:tasks.workunit.client.0.smithi002.stdout:8/419: dread d3/d21/f5b [0,4194304] 0 2024-09-13T22:56:10.846 INFO:tasks.workunit.client.0.smithi002.stdout:3/503: stat d9/d15/d26/l5d 0 2024-09-13T22:56:10.848 INFO:tasks.workunit.client.0.smithi002.stdout:1/478: creat d1/d13/d1d/d34/fa0 x:0 0 0 2024-09-13T22:56:10.849 INFO:tasks.workunit.client.0.smithi002.stdout:7/374: truncate d8/d10/d11/d13/d26/f3f 2722174 0 2024-09-13T22:56:10.851 INFO:tasks.workunit.client.0.smithi002.stdout:6/436: dwrite d12/f5d [0,4194304] 0 2024-09-13T22:56:10.852 INFO:tasks.workunit.client.0.smithi002.stdout:1/479: write d1/d13/d30/d31/f44 [4826163,96227] 0 2024-09-13T22:56:10.853 INFO:tasks.workunit.client.0.smithi002.stdout:7/375: truncate d8/d9/f5c 423298 0 2024-09-13T22:56:10.853 INFO:tasks.workunit.client.0.smithi002.stdout:7/376: chown d8/d10 3897 1 2024-09-13T22:56:10.855 INFO:tasks.workunit.client.1.smithi047.stdout:2/629: dwrite d1/df/d26/d4b/f5a [0,4194304] 0 2024-09-13T22:56:10.856 INFO:tasks.workunit.client.0.smithi002.stdout:6/437: truncate d12/d17/d28/f66 4442345 0 2024-09-13T22:56:10.857 INFO:tasks.workunit.client.1.smithi047.stdout:4/641: symlink dc/da3/ld7 0 2024-09-13T22:56:10.862 INFO:tasks.workunit.client.1.smithi047.stdout:0/566: rmdir d1/d5/d11/d2f/d88 0 2024-09-13T22:56:10.862 INFO:tasks.workunit.client.0.smithi002.stdout:5/445: fdatasync d1/d2a/d6b/d88/f5b 0 2024-09-13T22:56:10.864 INFO:tasks.workunit.client.1.smithi047.stdout:4/642: dread dc/de/d17/d25/d4a/fa4 [0,4194304] 0 2024-09-13T22:56:10.869 INFO:tasks.workunit.client.0.smithi002.stdout:3/504: mkdir d9/d3b/d53/db9 0 2024-09-13T22:56:10.869 INFO:tasks.workunit.client.0.smithi002.stdout:3/505: readlink d9/d7e/l9e 0 2024-09-13T22:56:10.873 INFO:tasks.workunit.client.1.smithi047.stdout:9/491: truncate d1/dc/d18/f33 1901475 0 2024-09-13T22:56:10.875 INFO:tasks.workunit.client.0.smithi002.stdout:2/435: dwrite d1/d4d/f56 [0,4194304] 0 2024-09-13T22:56:10.878 INFO:tasks.workunit.client.1.smithi047.stdout:8/529: truncate d8/d64/d4e/f49 1832318 0 2024-09-13T22:56:10.880 INFO:tasks.workunit.client.1.smithi047.stdout:8/530: dread d8/d64/d4e/d70/da7/fa8 [0,4194304] 0 2024-09-13T22:56:10.882 INFO:tasks.workunit.client.0.smithi002.stdout:0/451: creat d1/d2/fa9 x:0 0 0 2024-09-13T22:56:10.883 INFO:tasks.workunit.client.0.smithi002.stdout:0/452: dread - d1/d2/d81/d8f/f80 zero size 2024-09-13T22:56:10.883 INFO:tasks.workunit.client.0.smithi002.stdout:0/453: rename d1 to d1/d4/d75/d31/daa 22 2024-09-13T22:56:10.884 INFO:tasks.workunit.client.1.smithi047.stdout:2/630: rename d1/df/d1d/d20/d54/d8e/f94 to d1/d8a/fd4 0 2024-09-13T22:56:10.885 INFO:tasks.workunit.client.1.smithi047.stdout:2/631: chown d1/df/d1d/d2e 68 1 2024-09-13T22:56:10.885 INFO:tasks.workunit.client.1.smithi047.stdout:5/479: truncate d19/d23/d32/d69/f70 3558679 0 2024-09-13T22:56:10.885 INFO:tasks.workunit.client.0.smithi002.stdout:6/438: creat d12/d17/d34/d39/f92 x:0 0 0 2024-09-13T22:56:10.888 INFO:tasks.workunit.client.0.smithi002.stdout:9/486: mknod d8/caa 0 2024-09-13T22:56:10.890 INFO:tasks.workunit.client.1.smithi047.stdout:0/567: fdatasync d1/d5/d16/d23/d2d/fa5 0 2024-09-13T22:56:10.895 INFO:tasks.workunit.client.0.smithi002.stdout:3/506: creat d9/d3b/d7c/fba x:0 0 0 2024-09-13T22:56:10.897 INFO:tasks.workunit.client.1.smithi047.stdout:4/643: truncate dc/f2f 4430962 0 2024-09-13T22:56:10.901 INFO:tasks.workunit.client.1.smithi047.stdout:8/531: creat d8/d6b/fbb x:0 0 0 2024-09-13T22:56:10.902 INFO:tasks.workunit.client.0.smithi002.stdout:7/377: creat d8/d9/d51/f66 x:0 0 0 2024-09-13T22:56:10.904 INFO:tasks.workunit.client.1.smithi047.stdout:5/480: mknod d19/d34/d8e/c9e 0 2024-09-13T22:56:10.907 INFO:tasks.workunit.client.1.smithi047.stdout:9/492: fdatasync d1/dc/d18/f33 0 2024-09-13T22:56:10.909 INFO:tasks.workunit.client.0.smithi002.stdout:0/454: creat d1/d4/d75/fab x:0 0 0 2024-09-13T22:56:10.909 INFO:tasks.workunit.client.0.smithi002.stdout:0/455: fdatasync d1/d4/d75/d31/f41 0 2024-09-13T22:56:10.910 INFO:tasks.workunit.client.0.smithi002.stdout:6/439: symlink d12/d17/d2a/l93 0 2024-09-13T22:56:10.911 INFO:tasks.workunit.client.1.smithi047.stdout:0/568: mknod d1/d5/d16/d23/d45/cb7 0 2024-09-13T22:56:10.913 INFO:tasks.workunit.client.0.smithi002.stdout:9/487: creat d8/d91/fab x:0 0 0 2024-09-13T22:56:10.914 INFO:tasks.workunit.client.1.smithi047.stdout:5/481: dread d19/d25/d45/f60 [0,4194304] 0 2024-09-13T22:56:10.914 INFO:tasks.workunit.client.1.smithi047.stdout:5/482: dread - d19/d25/d85/f9a zero size 2024-09-13T22:56:10.915 INFO:tasks.workunit.client.1.smithi047.stdout:4/644: creat dc/d29/d4d/fd8 x:0 0 0 2024-09-13T22:56:10.915 INFO:tasks.workunit.client.0.smithi002.stdout:9/488: fsync d8/d91/d96/d87/f90 0 2024-09-13T22:56:10.916 INFO:tasks.workunit.client.1.smithi047.stdout:4/645: chown dc/de/l3a 1739150 1 2024-09-13T22:56:10.917 INFO:tasks.workunit.client.0.smithi002.stdout:0/456: dwrite d1/f6f [0,4194304] 0 2024-09-13T22:56:10.917 INFO:tasks.workunit.client.0.smithi002.stdout:4/402: sync 2024-09-13T22:56:10.919 INFO:tasks.workunit.client.0.smithi002.stdout:3/507: rename d9/df/c34 to d9/d15/d46/cbb 0 2024-09-13T22:56:10.920 INFO:tasks.workunit.client.0.smithi002.stdout:1/480: dwrite d1/d13/d21/d39/d70/f88 [0,4194304] 0 2024-09-13T22:56:10.921 INFO:tasks.workunit.client.0.smithi002.stdout:1/481: chown d1/d13/d1d/d34/d51 4 1 2024-09-13T22:56:10.922 INFO:tasks.workunit.client.1.smithi047.stdout:8/532: write d8/f1f [2397774,124218] 0 2024-09-13T22:56:10.926 INFO:tasks.workunit.client.1.smithi047.stdout:4/646: dwrite dc/de/d23/f99 [0,4194304] 0 2024-09-13T22:56:10.930 INFO:tasks.workunit.client.1.smithi047.stdout:2/632: dwrite d1/df/d1d/d20/d37/d7b/fab [0,4194304] 0 2024-09-13T22:56:10.936 INFO:tasks.workunit.client.0.smithi002.stdout:8/420: creat d3/dc/d34/f7e x:0 0 0 2024-09-13T22:56:10.941 INFO:tasks.workunit.client.0.smithi002.stdout:0/457: mknod d1/d4/d75/d76/cac 0 2024-09-13T22:56:10.942 INFO:tasks.workunit.client.0.smithi002.stdout:3/508: fsync d9/df/f54 0 2024-09-13T22:56:10.943 INFO:tasks.workunit.client.1.smithi047.stdout:5/483: mknod d19/d25/c9f 0 2024-09-13T22:56:10.943 INFO:tasks.workunit.client.0.smithi002.stdout:3/509: dread - d9/d3b/d7c/fba zero size 2024-09-13T22:56:10.945 INFO:tasks.workunit.client.0.smithi002.stdout:1/482: truncate d1/d13/d1d/f29 3959623 0 2024-09-13T22:56:10.946 INFO:tasks.workunit.client.0.smithi002.stdout:2/436: link d1/d4d/l62 d1/d32/d37/l92 0 2024-09-13T22:56:10.948 INFO:tasks.workunit.client.0.smithi002.stdout:1/483: chown d1/d13/d1d/d34/f6f 1656 1 2024-09-13T22:56:10.949 INFO:tasks.workunit.client.0.smithi002.stdout:0/458: dwrite d1/d4/d75/d31/d32/f50 [4194304,4194304] 0 2024-09-13T22:56:10.950 INFO:tasks.workunit.client.1.smithi047.stdout:4/647: unlink dc/de/d23/dc4/f69 0 2024-09-13T22:56:10.951 INFO:tasks.workunit.client.0.smithi002.stdout:0/459: dread - d1/d4/da3/d7d/f9c zero size 2024-09-13T22:56:10.952 INFO:tasks.workunit.client.0.smithi002.stdout:5/446: getdents d1/d2a/d6b 0 2024-09-13T22:56:10.952 INFO:tasks.workunit.client.1.smithi047.stdout:8/533: rename d8/d64/d4e/d4d/d8f/d91/d38/l4a to d8/d77/d89/lbc 0 2024-09-13T22:56:10.958 INFO:tasks.workunit.client.0.smithi002.stdout:1/484: dwrite d1/d13/d30/d31/f69 [0,4194304] 0 2024-09-13T22:56:10.958 INFO:tasks.workunit.client.0.smithi002.stdout:9/489: write d8/d10/d1c/f2b [4287737,68002] 0 2024-09-13T22:56:10.959 INFO:tasks.workunit.client.0.smithi002.stdout:9/490: chown d8/d1e 2 1 2024-09-13T22:56:10.960 INFO:tasks.workunit.client.1.smithi047.stdout:8/534: dwrite d8/d64/d4e/d70/f9c [0,4194304] 0 2024-09-13T22:56:10.961 INFO:tasks.workunit.client.0.smithi002.stdout:1/485: write d1/d13/f97 [465026,97366] 0 2024-09-13T22:56:10.961 INFO:tasks.workunit.client.0.smithi002.stdout:9/491: stat l6 0 2024-09-13T22:56:10.961 INFO:tasks.workunit.client.0.smithi002.stdout:3/510: unlink d9/d15/d51/f21 0 2024-09-13T22:56:10.962 INFO:tasks.workunit.client.0.smithi002.stdout:3/511: chown d9/d3b/f70 423790 1 2024-09-13T22:56:10.963 INFO:tasks.workunit.client.0.smithi002.stdout:2/437: mknod d1/d7/d8/d2c/c93 0 2024-09-13T22:56:10.964 INFO:tasks.workunit.client.0.smithi002.stdout:2/438: chown d1/d7/l2a 1 1 2024-09-13T22:56:10.967 INFO:tasks.workunit.client.0.smithi002.stdout:7/378: truncate f1 6409679 0 2024-09-13T22:56:10.968 INFO:tasks.workunit.client.0.smithi002.stdout:7/379: stat d8/d10/f2a 0 2024-09-13T22:56:10.972 INFO:tasks.workunit.client.1.smithi047.stdout:2/633: dread d1/df/d1d/d20/d54/f5c [0,4194304] 0 2024-09-13T22:56:10.989 INFO:tasks.workunit.client.1.smithi047.stdout:6/591: sync 2024-09-13T22:56:10.990 INFO:tasks.workunit.client.1.smithi047.stdout:7/558: sync 2024-09-13T22:56:10.993 INFO:tasks.workunit.client.0.smithi002.stdout:0/460: unlink d1/d2/c93 0 2024-09-13T22:56:10.994 INFO:tasks.workunit.client.0.smithi002.stdout:0/461: truncate d1/d4/da3/d7d/f9c 559048 0 2024-09-13T22:56:10.995 INFO:tasks.workunit.client.0.smithi002.stdout:0/462: write d1/d2/f1d [1369390,29958] 0 2024-09-13T22:56:10.995 INFO:tasks.workunit.client.0.smithi002.stdout:8/421: link d3/dc/d51/f4c d3/dc/d51/d6e/f7f 0 2024-09-13T22:56:10.999 INFO:tasks.workunit.client.0.smithi002.stdout:5/447: symlink d1/d2a/d6b/d88/d45/d4f/l9e 0 2024-09-13T22:56:11.000 INFO:tasks.workunit.client.1.smithi047.stdout:9/493: dwrite d1/dc/d14/dd/f1d [0,4194304] 0 2024-09-13T22:56:11.001 INFO:tasks.workunit.client.0.smithi002.stdout:6/440: dwrite d12/f14 [8388608,4194304] 0 2024-09-13T22:56:11.001 INFO:tasks.workunit.client.0.smithi002.stdout:5/448: stat d1/d2a/d6b/d88/d45/f91 0 2024-09-13T22:56:11.002 INFO:tasks.workunit.client.0.smithi002.stdout:8/422: dread d3/dc/f13 [0,4194304] 0 2024-09-13T22:56:11.002 INFO:tasks.workunit.client.0.smithi002.stdout:5/449: chown d1/l39 7258464 1 2024-09-13T22:56:11.003 INFO:tasks.workunit.client.0.smithi002.stdout:6/441: write f1 [249185,43947] 0 2024-09-13T22:56:11.003 INFO:tasks.workunit.client.1.smithi047.stdout:5/484: symlink d19/d83/d98/la0 0 2024-09-13T22:56:11.005 INFO:tasks.workunit.client.1.smithi047.stdout:0/569: truncate d1/d7/f18 4128619 0 2024-09-13T22:56:11.007 INFO:tasks.workunit.client.0.smithi002.stdout:8/423: write d3/dc/d18/f2d [2993868,29520] 0 2024-09-13T22:56:11.008 INFO:tasks.workunit.client.1.smithi047.stdout:2/634: creat d1/df/d1d/d20/d29/fd5 x:0 0 0 2024-09-13T22:56:11.012 INFO:tasks.workunit.client.0.smithi002.stdout:1/486: rename d1/d1c to d1/d13/d30/d73/da1 0 2024-09-13T22:56:11.016 INFO:tasks.workunit.client.0.smithi002.stdout:1/487: read d1/d13/d1d/d34/d51/f82 [3258930,73220] 0 2024-09-13T22:56:11.016 INFO:tasks.workunit.client.0.smithi002.stdout:1/488: chown d1/d13/d1d 69823 1 2024-09-13T22:56:11.017 INFO:tasks.workunit.client.0.smithi002.stdout:3/512: rmdir d9/d15/d26 39 2024-09-13T22:56:11.018 INFO:tasks.workunit.client.1.smithi047.stdout:9/494: fdatasync d1/f2b 0 2024-09-13T22:56:11.019 INFO:tasks.workunit.client.1.smithi047.stdout:7/559: symlink d0/d7/da/d1e/d51/lbf 0 2024-09-13T22:56:11.021 INFO:tasks.workunit.client.0.smithi002.stdout:2/439: symlink d1/d7/d8/d2c/l94 0 2024-09-13T22:56:11.021 INFO:tasks.workunit.client.0.smithi002.stdout:2/440: chown d1/d4a 172 1 2024-09-13T22:56:11.022 INFO:tasks.workunit.client.0.smithi002.stdout:2/441: fsync d1/d4d/f56 0 2024-09-13T22:56:11.022 INFO:tasks.workunit.client.1.smithi047.stdout:6/592: dwrite d3/d11/d2b/d1c/d23/fba [0,4194304] 0 2024-09-13T22:56:11.023 INFO:tasks.workunit.client.0.smithi002.stdout:4/403: sync 2024-09-13T22:56:11.023 INFO:tasks.workunit.client.1.smithi047.stdout:0/570: dread d1/d5/d11/f85 [0,4194304] 0 2024-09-13T22:56:11.023 INFO:tasks.workunit.client.1.smithi047.stdout:4/648: creat dc/de/db9/fd9 x:0 0 0 2024-09-13T22:56:11.026 INFO:tasks.workunit.client.1.smithi047.stdout:0/571: write d1/d5/d16/d47/f93 [969786,114772] 0 2024-09-13T22:56:11.026 INFO:tasks.workunit.client.1.smithi047.stdout:8/535: mkdir d8/d64/d4e/dbd 0 2024-09-13T22:56:11.028 INFO:tasks.workunit.client.1.smithi047.stdout:8/536: chown d8/d64/d4e/d70/da7 53 1 2024-09-13T22:56:11.028 INFO:tasks.workunit.client.0.smithi002.stdout:1/489: dread d1/d13/d30/d31/d3d/f6a [0,4194304] 0 2024-09-13T22:56:11.030 INFO:tasks.workunit.client.0.smithi002.stdout:0/463: mknod d1/d7e/cad 0 2024-09-13T22:56:11.031 INFO:tasks.workunit.client.1.smithi047.stdout:0/572: dread d1/d7/f6c [0,4194304] 0 2024-09-13T22:56:11.031 INFO:tasks.workunit.client.0.smithi002.stdout:0/464: write d1/f63 [941153,75681] 0 2024-09-13T22:56:11.032 INFO:tasks.workunit.client.1.smithi047.stdout:5/485: creat d19/d23/d4c/fa1 x:0 0 0 2024-09-13T22:56:11.034 INFO:tasks.workunit.client.1.smithi047.stdout:0/573: readlink d1/d5/d16/d23/d77/l8b 0 2024-09-13T22:56:11.034 INFO:tasks.workunit.client.0.smithi002.stdout:0/465: fsync d1/d2/d81/d8f/f48 0 2024-09-13T22:56:11.035 INFO:tasks.workunit.client.0.smithi002.stdout:9/492: write d8/d10/d61/f81 [9195,59019] 0 2024-09-13T22:56:11.036 INFO:tasks.workunit.client.0.smithi002.stdout:9/493: fsync f0 0 2024-09-13T22:56:11.036 INFO:tasks.workunit.client.0.smithi002.stdout:0/466: dread d1/d4/d75/d31/f46 [0,4194304] 0 2024-09-13T22:56:11.038 INFO:tasks.workunit.client.0.smithi002.stdout:0/467: write d1/d4/d75/f2c [97399,107134] 0 2024-09-13T22:56:11.043 INFO:tasks.workunit.client.0.smithi002.stdout:2/442: dread d1/d7/d35/d3e/d59/f64 [0,4194304] 0 2024-09-13T22:56:11.045 INFO:tasks.workunit.client.1.smithi047.stdout:9/495: rename d1/d2d to d1/dc/d14/dd/d54/d50/d5b/d9e 0 2024-09-13T22:56:11.045 INFO:tasks.workunit.client.1.smithi047.stdout:7/560: dread d0/d57/f98 [0,4194304] 0 2024-09-13T22:56:11.048 INFO:tasks.workunit.client.1.smithi047.stdout:4/649: mkdir dc/d29/d8e/dda 0 2024-09-13T22:56:11.048 INFO:tasks.workunit.client.1.smithi047.stdout:4/650: readlink dc/de/d17/d70/lcb 0 2024-09-13T22:56:11.048 INFO:tasks.workunit.client.1.smithi047.stdout:3/542: sync 2024-09-13T22:56:11.048 INFO:tasks.workunit.client.1.smithi047.stdout:4/651: dread - dc/de/d23/d40/d7b/f94 zero size 2024-09-13T22:56:11.049 INFO:tasks.workunit.client.0.smithi002.stdout:8/424: mkdir d3/d27/d39/d80 0 2024-09-13T22:56:11.055 INFO:tasks.workunit.client.1.smithi047.stdout:8/537: unlink d8/c11 0 2024-09-13T22:56:11.056 INFO:tasks.workunit.client.0.smithi002.stdout:3/513: creat d9/d91/fbc x:0 0 0 2024-09-13T22:56:11.058 INFO:tasks.workunit.client.1.smithi047.stdout:0/574: creat d1/d5/d16/d97/fb8 x:0 0 0 2024-09-13T22:56:11.063 INFO:tasks.workunit.client.1.smithi047.stdout:2/635: symlink d1/df/d1d/d20/d54/ld6 0 2024-09-13T22:56:11.067 INFO:tasks.workunit.client.0.smithi002.stdout:1/490: creat d1/d13/d30/d31/d3b/d71/fa2 x:0 0 0 2024-09-13T22:56:11.068 INFO:tasks.workunit.client.1.smithi047.stdout:7/561: fsync d0/d57/f98 0 2024-09-13T22:56:11.070 INFO:tasks.workunit.client.1.smithi047.stdout:4/652: mkdir dc/de/d23/dc4/ddb 0 2024-09-13T22:56:11.071 INFO:tasks.workunit.client.1.smithi047.stdout:4/653: write dc/f9e [2254471,56350] 0 2024-09-13T22:56:11.071 INFO:tasks.workunit.client.0.smithi002.stdout:7/380: truncate d8/d10/d11/d13/d26/d4c/f64 2950582 0 2024-09-13T22:56:11.073 INFO:tasks.workunit.client.1.smithi047.stdout:6/593: symlink d3/d11/d2b/d1c/d4d/d69/dc2/lc8 0 2024-09-13T22:56:11.077 INFO:tasks.workunit.client.0.smithi002.stdout:0/468: truncate d1/d4/f24 3718125 0 2024-09-13T22:56:11.079 INFO:tasks.workunit.client.1.smithi047.stdout:8/538: chown d8/d64/d4e/d4d/d8f/d91/d40/l4f 17 1 2024-09-13T22:56:11.079 INFO:tasks.workunit.client.0.smithi002.stdout:6/442: write d12/d17/d34/f6c [2653058,113693] 0 2024-09-13T22:56:11.079 INFO:tasks.workunit.client.1.smithi047.stdout:7/562: dread d0/d19/f7c [0,4194304] 0 2024-09-13T22:56:11.080 INFO:tasks.workunit.client.1.smithi047.stdout:7/563: chown d0/d7/da/d2e/db5/f43 32684 1 2024-09-13T22:56:11.085 INFO:tasks.workunit.client.1.smithi047.stdout:0/575: creat d1/d5/d16/d47/fb9 x:0 0 0 2024-09-13T22:56:11.087 INFO:tasks.workunit.client.0.smithi002.stdout:8/425: fsync d3/dc/d16/d60/f74 0 2024-09-13T22:56:11.091 INFO:tasks.workunit.client.1.smithi047.stdout:5/486: truncate d19/d25/f3f 3516513 0 2024-09-13T22:56:11.093 INFO:tasks.workunit.client.1.smithi047.stdout:6/594: read d3/d11/d2b/d1c/d23/f39 [662139,122990] 0 2024-09-13T22:56:11.098 INFO:tasks.workunit.client.1.smithi047.stdout:5/487: dwrite d19/d23/d4c/f5e [0,4194304] 0 2024-09-13T22:56:11.099 INFO:tasks.workunit.client.0.smithi002.stdout:1/491: unlink d1/d13/d30/f7e 0 2024-09-13T22:56:11.099 INFO:tasks.workunit.client.0.smithi002.stdout:1/492: readlink d1/d13/l56 0 2024-09-13T22:56:11.100 INFO:tasks.workunit.client.1.smithi047.stdout:9/496: write d1/dc/f43 [268636,13742] 0 2024-09-13T22:56:11.100 INFO:tasks.workunit.client.1.smithi047.stdout:8/539: mkdir d8/d64/d4e/d4d/d8f/d91/d38/dbe 0 2024-09-13T22:56:11.101 INFO:tasks.workunit.client.0.smithi002.stdout:7/381: fsync d8/d10/d39/f4a 0 2024-09-13T22:56:11.103 INFO:tasks.workunit.client.1.smithi047.stdout:7/564: readlink d0/d7/da/d4e/l8f 0 2024-09-13T22:56:11.105 INFO:tasks.workunit.client.0.smithi002.stdout:0/469: rename d1/d2/d81/d8f/c95 to d1/d4/da3/cae 0 2024-09-13T22:56:11.106 INFO:tasks.workunit.client.0.smithi002.stdout:0/470: read - d1/d4/d75/d76/f85 zero size 2024-09-13T22:56:11.108 INFO:tasks.workunit.client.0.smithi002.stdout:5/450: creat d1/d2a/d6b/d88/d45/f9f x:0 0 0 2024-09-13T22:56:11.108 INFO:tasks.workunit.client.0.smithi002.stdout:0/471: chown d1/d4/d75/d31/l66 8726297 1 2024-09-13T22:56:11.110 INFO:tasks.workunit.client.0.smithi002.stdout:8/426: creat d3/dc/d18/f81 x:0 0 0 2024-09-13T22:56:11.111 INFO:tasks.workunit.client.1.smithi047.stdout:6/595: dread d3/d11/f97 [0,4194304] 0 2024-09-13T22:56:11.112 INFO:tasks.workunit.client.1.smithi047.stdout:6/596: fdatasync d3/d11/d2b/d1c/dbf/fbe 0 2024-09-13T22:56:11.112 INFO:tasks.workunit.client.1.smithi047.stdout:3/543: link d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/c5f d0/d3/d4/d16/d2c/de/cb2 0 2024-09-13T22:56:11.113 INFO:tasks.workunit.client.1.smithi047.stdout:6/597: chown d3/d11/d2b/d4c/dc0/d98 545 1 2024-09-13T22:56:11.116 INFO:tasks.workunit.client.1.smithi047.stdout:5/488: read d19/d34/d42/f48 [911679,49140] 0 2024-09-13T22:56:11.119 INFO:tasks.workunit.client.1.smithi047.stdout:8/540: creat d8/d3f/fbf x:0 0 0 2024-09-13T22:56:11.119 INFO:tasks.workunit.client.1.smithi047.stdout:5/489: dread d19/d23/d4c/f5e [0,4194304] 0 2024-09-13T22:56:11.120 INFO:tasks.workunit.client.0.smithi002.stdout:1/493: rmdir d1/d13/d30/d31/d3b/d71/d80 39 2024-09-13T22:56:11.120 INFO:tasks.workunit.client.1.smithi047.stdout:5/490: chown d19/d23/d4c/f52 2464 1 2024-09-13T22:56:11.122 INFO:tasks.workunit.client.1.smithi047.stdout:5/491: write d19/d34/d6c/f8d [135066,92577] 0 2024-09-13T22:56:11.123 INFO:tasks.workunit.client.1.smithi047.stdout:0/576: write d1/f2 [1518036,64067] 0 2024-09-13T22:56:11.125 INFO:tasks.workunit.client.0.smithi002.stdout:6/443: write d12/d17/d2a/f4f [828442,51431] 0 2024-09-13T22:56:11.125 INFO:tasks.workunit.client.1.smithi047.stdout:7/565: creat d0/d19/fc0 x:0 0 0 2024-09-13T22:56:11.126 INFO:tasks.workunit.client.1.smithi047.stdout:0/577: write d1/d7/ff [5576632,1523] 0 2024-09-13T22:56:11.129 INFO:tasks.workunit.client.1.smithi047.stdout:9/497: dwrite d1/dc/d14/dd/d54/f8c [0,4194304] 0 2024-09-13T22:56:11.133 INFO:tasks.workunit.client.0.smithi002.stdout:3/514: write d9/fb [1435039,2732] 0 2024-09-13T22:56:11.136 INFO:tasks.workunit.client.0.smithi002.stdout:8/427: fsync d3/f6 0 2024-09-13T22:56:11.137 INFO:tasks.workunit.client.1.smithi047.stdout:5/492: fsync d19/d23/d2e/f59 0 2024-09-13T22:56:11.138 INFO:tasks.workunit.client.0.smithi002.stdout:8/428: truncate d3/dc/d18/f81 785194 0 2024-09-13T22:56:11.138 INFO:tasks.workunit.client.0.smithi002.stdout:1/494: mknod d1/d13/d30/d31/d3d/ca3 0 2024-09-13T22:56:11.140 INFO:tasks.workunit.client.0.smithi002.stdout:1/495: write d1/d13/f32 [114885,75036] 0 2024-09-13T22:56:11.141 INFO:tasks.workunit.client.1.smithi047.stdout:7/566: symlink d0/d7/da/d47/lc1 0 2024-09-13T22:56:11.142 INFO:tasks.workunit.client.1.smithi047.stdout:0/578: mknod d1/d5/d16/d97/cba 0 2024-09-13T22:56:11.143 INFO:tasks.workunit.client.0.smithi002.stdout:7/382: dwrite d8/d10/d11/d13/f21 [0,4194304] 0 2024-09-13T22:56:11.145 INFO:tasks.workunit.client.0.smithi002.stdout:7/383: write d8/d10/f45 [3860091,126091] 0 2024-09-13T22:56:11.145 INFO:tasks.workunit.client.0.smithi002.stdout:5/451: rename d1/lf to d1/d2a/d6b/d88/d55/d56/la0 0 2024-09-13T22:56:11.147 INFO:tasks.workunit.client.1.smithi047.stdout:9/498: readlink d1/l59 0 2024-09-13T22:56:11.148 INFO:tasks.workunit.client.1.smithi047.stdout:5/493: dread d19/d25/f38 [0,4194304] 0 2024-09-13T22:56:11.151 INFO:tasks.workunit.client.0.smithi002.stdout:1/496: dwrite d1/d13/d30/d31/f44 [0,4194304] 0 2024-09-13T22:56:11.151 INFO:tasks.workunit.client.0.smithi002.stdout:5/452: dread d1/d10/f4b [0,4194304] 0 2024-09-13T22:56:11.152 INFO:tasks.workunit.client.0.smithi002.stdout:5/453: fsync d1/d2a/d6b/d88/f5b 0 2024-09-13T22:56:11.153 INFO:tasks.workunit.client.0.smithi002.stdout:8/429: mknod d3/dc/d18/d56/c82 0 2024-09-13T22:56:11.153 INFO:tasks.workunit.client.0.smithi002.stdout:0/472: creat d1/d2/faf x:0 0 0 2024-09-13T22:56:11.157 INFO:tasks.workunit.client.1.smithi047.stdout:3/544: truncate d0/d3/d4/f3e 634941 0 2024-09-13T22:56:11.159 INFO:tasks.workunit.client.1.smithi047.stdout:3/545: write d0/d3/d4/d16/d2c/de/d3d/f6e [626737,30782] 0 2024-09-13T22:56:11.160 INFO:tasks.workunit.client.1.smithi047.stdout:7/567: read d0/d7/da/d1e/f6b [1990913,130125] 0 2024-09-13T22:56:11.161 INFO:tasks.workunit.client.0.smithi002.stdout:9/494: sync 2024-09-13T22:56:11.161 INFO:tasks.workunit.client.0.smithi002.stdout:4/404: sync 2024-09-13T22:56:11.162 INFO:tasks.workunit.client.1.smithi047.stdout:7/568: chown d0/db/cd 67336 1 2024-09-13T22:56:11.162 INFO:tasks.workunit.client.1.smithi047.stdout:3/546: chown d0/d3/d4/d16/d32/d42/d79/d9c/c9d 28098 1 2024-09-13T22:56:11.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:10 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/2569707651' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:56:11.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:10 smithi047 ceph-mon[34560]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:11.163 INFO:tasks.workunit.client.1.smithi047.stdout:7/569: write d0/f94 [67157,6617] 0 2024-09-13T22:56:11.163 INFO:tasks.workunit.client.0.smithi002.stdout:4/405: chown d3/d14/d29/d2a/f36 9829457 1 2024-09-13T22:56:11.163 INFO:tasks.workunit.client.0.smithi002.stdout:4/406: chown d3/f12 27237865 1 2024-09-13T22:56:11.164 INFO:tasks.workunit.client.1.smithi047.stdout:3/547: chown d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/c7a 1010749 1 2024-09-13T22:56:11.165 INFO:tasks.workunit.client.1.smithi047.stdout:9/499: unlink d1/dc/d14/dd/d54/c3c 0 2024-09-13T22:56:11.166 INFO:tasks.workunit.client.1.smithi047.stdout:3/548: write d0/d3/d4/d16/d2c/f46 [813360,96693] 0 2024-09-13T22:56:11.168 INFO:tasks.workunit.client.0.smithi002.stdout:6/444: link d12/d17/f3c d12/d17/d2a/f94 0 2024-09-13T22:56:11.170 INFO:tasks.workunit.client.1.smithi047.stdout:6/598: rename d3/d11/d2b/d1c/f2e to d3/d2c/fc9 0 2024-09-13T22:56:11.171 INFO:tasks.workunit.client.0.smithi002.stdout:1/497: unlink d1/c10 0 2024-09-13T22:56:11.175 INFO:tasks.workunit.client.0.smithi002.stdout:1/498: dread d1/d13/f32 [0,4194304] 0 2024-09-13T22:56:11.177 INFO:tasks.workunit.client.1.smithi047.stdout:0/579: symlink d1/d5/d16/d97/db6/lbb 0 2024-09-13T22:56:11.178 INFO:tasks.workunit.client.0.smithi002.stdout:3/515: creat d9/d15/fbd x:0 0 0 2024-09-13T22:56:11.179 INFO:tasks.workunit.client.1.smithi047.stdout:7/570: stat d0/db/c79 0 2024-09-13T22:56:11.182 INFO:tasks.workunit.client.1.smithi047.stdout:5/494: dwrite d19/f1d [0,4194304] 0 2024-09-13T22:56:11.184 INFO:tasks.workunit.client.1.smithi047.stdout:9/500: mknod d1/dc/d18/d72/c9f 0 2024-09-13T22:56:11.187 INFO:tasks.workunit.client.1.smithi047.stdout:3/549: write d0/d3/d4/d16/d2c/de/fb0 [4956238,14648] 0 2024-09-13T22:56:11.188 INFO:tasks.workunit.client.0.smithi002.stdout:9/495: write d8/d10/d1c/f15 [3687644,59382] 0 2024-09-13T22:56:11.190 INFO:tasks.workunit.client.1.smithi047.stdout:3/550: chown d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/f41 146 1 2024-09-13T22:56:11.191 INFO:tasks.workunit.client.1.smithi047.stdout:3/551: fsync d0/d3/d4/d16/d73/d86/f99 0 2024-09-13T22:56:11.191 INFO:tasks.workunit.client.1.smithi047.stdout:6/599: truncate d3/d11/d2b/d4c/f80 775004 0 2024-09-13T22:56:11.192 INFO:tasks.workunit.client.0.smithi002.stdout:5/454: symlink d1/la1 0 2024-09-13T22:56:11.193 INFO:tasks.workunit.client.1.smithi047.stdout:8/541: getdents d8/d64/d4e/d4d/d8f/d91/d40 0 2024-09-13T22:56:11.195 INFO:tasks.workunit.client.0.smithi002.stdout:3/516: chown d9/d15/d36/l5c 32238682 1 2024-09-13T22:56:11.195 INFO:tasks.workunit.client.1.smithi047.stdout:7/571: write d0/d57/d5b/f8a [1287668,22946] 0 2024-09-13T22:56:11.196 INFO:tasks.workunit.client.1.smithi047.stdout:7/572: stat d0/f33 0 2024-09-13T22:56:11.199 INFO:tasks.workunit.client.0.smithi002.stdout:4/407: symlink d3/d14/d29/l7a 0 2024-09-13T22:56:11.199 INFO:tasks.workunit.client.0.smithi002.stdout:7/384: link d8/d10/d11/d13/d26/c2c d8/d9/c67 0 2024-09-13T22:56:11.201 INFO:tasks.workunit.client.0.smithi002.stdout:6/445: mknod d12/d17/d34/c95 0 2024-09-13T22:56:11.201 INFO:tasks.workunit.client.1.smithi047.stdout:9/501: fdatasync d1/dc/d14/dd/d54/d8d/f93 0 2024-09-13T22:56:11.202 INFO:tasks.workunit.client.1.smithi047.stdout:9/502: truncate d1/d5f/f9b 962070 0 2024-09-13T22:56:11.205 INFO:tasks.workunit.client.1.smithi047.stdout:8/542: creat d8/d6b/da9/fc0 x:0 0 0 2024-09-13T22:56:11.206 INFO:tasks.workunit.client.1.smithi047.stdout:5/495: mknod d19/d23/d2e/d41/d58/d77/ca2 0 2024-09-13T22:56:11.207 INFO:tasks.workunit.client.0.smithi002.stdout:4/408: dwrite d3/d14/d25/f4f [0,4194304] 0 2024-09-13T22:56:11.207 INFO:tasks.workunit.client.0.smithi002.stdout:7/385: dread d8/d9/f19 [0,4194304] 0 2024-09-13T22:56:11.208 INFO:tasks.workunit.client.0.smithi002.stdout:5/455: mknod d1/d2a/d6b/d88/d45/d4f/d8f/ca2 0 2024-09-13T22:56:11.208 INFO:tasks.workunit.client.0.smithi002.stdout:7/386: read - d8/d9/d51/f66 zero size 2024-09-13T22:56:11.208 INFO:tasks.workunit.client.1.smithi047.stdout:3/552: dread d0/d3/f96 [0,4194304] 0 2024-09-13T22:56:11.210 INFO:tasks.workunit.client.1.smithi047.stdout:9/503: dread d1/dc/d18/f33 [0,4194304] 0 2024-09-13T22:56:11.215 INFO:tasks.workunit.client.1.smithi047.stdout:8/543: rename d8/f10 to d8/d3f/d8c/fc1 0 2024-09-13T22:56:11.215 INFO:tasks.workunit.client.0.smithi002.stdout:7/387: dwrite d8/d9/fd [0,4194304] 0 2024-09-13T22:56:11.216 INFO:tasks.workunit.client.1.smithi047.stdout:8/544: chown d8/d64/d4e/d70/f9c 953724812 1 2024-09-13T22:56:11.217 INFO:tasks.workunit.client.1.smithi047.stdout:5/496: mkdir d19/d25/d45/da3 0 2024-09-13T22:56:11.219 INFO:tasks.workunit.client.1.smithi047.stdout:5/497: dread d19/d23/f6a [0,4194304] 0 2024-09-13T22:56:11.221 INFO:tasks.workunit.client.1.smithi047.stdout:3/553: symlink d0/d3/d4/d16/d73/d86/lb3 0 2024-09-13T22:56:11.222 INFO:tasks.workunit.client.1.smithi047.stdout:6/600: write d3/d77/f87 [23710,94683] 0 2024-09-13T22:56:11.223 INFO:tasks.workunit.client.1.smithi047.stdout:6/601: stat d3/d11/f6b 0 2024-09-13T22:56:11.224 INFO:tasks.workunit.client.1.smithi047.stdout:0/580: getdents d1/d5/d16/d97/db6 0 2024-09-13T22:56:11.225 INFO:tasks.workunit.client.1.smithi047.stdout:6/602: write d3/d77/d93/f9a [3097478,17115] 0 2024-09-13T22:56:11.226 INFO:tasks.workunit.client.0.smithi002.stdout:0/473: getdents d1/d2/d81/d8f 0 2024-09-13T22:56:11.227 INFO:tasks.workunit.client.1.smithi047.stdout:9/504: fdatasync d1/dc/d14/dd/d54/d4e/d51/f5d 0 2024-09-13T22:56:11.229 INFO:tasks.workunit.client.0.smithi002.stdout:4/409: read d3/d40/d45/f52 [678575,53006] 0 2024-09-13T22:56:11.229 INFO:tasks.workunit.client.1.smithi047.stdout:6/603: read d3/d11/d2b/d1c/d4d/fa6 [275772,108211] 0 2024-09-13T22:56:11.233 INFO:tasks.workunit.client.0.smithi002.stdout:3/517: link d9/df/f7d d9/d3b/d53/d83/fbe 0 2024-09-13T22:56:11.235 INFO:tasks.workunit.client.0.smithi002.stdout:4/410: dwrite d3/f24 [4194304,4194304] 0 2024-09-13T22:56:11.237 INFO:tasks.workunit.client.1.smithi047.stdout:5/498: creat d19/d23/d4c/fa4 x:0 0 0 2024-09-13T22:56:11.239 INFO:tasks.workunit.client.0.smithi002.stdout:9/496: link d8/d2c/f6a d8/d1e/fac 0 2024-09-13T22:56:11.239 INFO:tasks.workunit.client.1.smithi047.stdout:3/554: fdatasync d0/d3/d4/d16/d2c/de/f97 0 2024-09-13T22:56:11.241 INFO:tasks.workunit.client.1.smithi047.stdout:0/581: mknod d1/d5/d16/d6a/d92/cbc 0 2024-09-13T22:56:11.241 INFO:tasks.workunit.client.0.smithi002.stdout:6/446: dwrite d12/d17/d2a/f94 [0,4194304] 0 2024-09-13T22:56:11.241 INFO:tasks.workunit.client.0.smithi002.stdout:6/447: chown d12/f5c 2 1 2024-09-13T22:56:11.243 INFO:tasks.workunit.client.0.smithi002.stdout:0/474: rmdir d1/d4/da3 39 2024-09-13T22:56:11.246 INFO:tasks.workunit.client.1.smithi047.stdout:1/502: sync 2024-09-13T22:56:11.247 INFO:tasks.workunit.client.1.smithi047.stdout:1/503: readlink d0/l68 0 2024-09-13T22:56:11.247 INFO:tasks.workunit.client.0.smithi002.stdout:9/497: dwrite d8/d2c/f58 [0,4194304] 0 2024-09-13T22:56:11.249 INFO:tasks.workunit.client.0.smithi002.stdout:3/518: creat d9/d3b/da5/fbf x:0 0 0 2024-09-13T22:56:11.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:10 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2569707651' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:56:11.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:10 smithi002 ceph-mon[27637]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:11.250 INFO:tasks.workunit.client.1.smithi047.stdout:6/604: mkdir d3/d11/d2b/d1c/dca 0 2024-09-13T22:56:11.251 INFO:tasks.workunit.client.0.smithi002.stdout:7/388: mkdir d8/d10/d11/d13/d26/d38/d68 0 2024-09-13T22:56:11.266 INFO:tasks.workunit.client.1.smithi047.stdout:1/504: dread d0/d7/d14/d28/d36/f32 [0,4194304] 0 2024-09-13T22:56:11.266 INFO:tasks.workunit.client.0.smithi002.stdout:3/519: mkdir d9/d15/d36/d4e/d5e/dc0 0 2024-09-13T22:56:11.267 INFO:tasks.workunit.client.1.smithi047.stdout:1/505: write d0/d7/d13/f3c [4143036,38335] 0 2024-09-13T22:56:11.267 INFO:tasks.workunit.client.0.smithi002.stdout:3/520: write d9/d3b/d7c/f80 [946084,104514] 0 2024-09-13T22:56:11.268 INFO:tasks.workunit.client.1.smithi047.stdout:9/505: mkdir d1/dc/d14/da0 0 2024-09-13T22:56:11.268 INFO:tasks.workunit.client.1.smithi047.stdout:1/506: write d0/d1d/f60 [154005,11741] 0 2024-09-13T22:56:11.270 INFO:tasks.workunit.client.1.smithi047.stdout:1/507: write d0/f5c [867553,100999] 0 2024-09-13T22:56:11.273 INFO:tasks.workunit.client.1.smithi047.stdout:6/605: symlink d3/d11/d2b/d1c/lcb 0 2024-09-13T22:56:11.274 INFO:tasks.workunit.client.1.smithi047.stdout:6/606: fsync d3/d11/f63 0 2024-09-13T22:56:11.275 INFO:tasks.workunit.client.1.smithi047.stdout:3/555: write d0/d3/d4/d16/d2c/de/d68/f88 [595861,97861] 0 2024-09-13T22:56:11.275 INFO:tasks.workunit.client.1.smithi047.stdout:0/582: write d1/d5/f10 [112644,116887] 0 2024-09-13T22:56:11.277 INFO:tasks.workunit.client.1.smithi047.stdout:0/583: write d1/d5/d16/f94 [824500,97509] 0 2024-09-13T22:56:11.277 INFO:tasks.workunit.client.1.smithi047.stdout:8/545: link d8/d6b/da9/fc0 d8/d64/d4e/d4d/d8f/d91/fc2 0 2024-09-13T22:56:11.278 INFO:tasks.workunit.client.0.smithi002.stdout:6/448: mknod d12/c96 0 2024-09-13T22:56:11.282 INFO:tasks.workunit.client.0.smithi002.stdout:0/475: creat d1/d4/da3/d7d/fb0 x:0 0 0 2024-09-13T22:56:11.284 INFO:tasks.workunit.client.1.smithi047.stdout:0/584: dwrite d1/d5/d11/d2f/fb2 [0,4194304] 0 2024-09-13T22:56:11.284 INFO:tasks.workunit.client.0.smithi002.stdout:9/498: link d8/d91/fab d8/d91/d96/d87/da5/d94/fad 0 2024-09-13T22:56:11.286 INFO:tasks.workunit.client.0.smithi002.stdout:3/521: creat d9/df/fc1 x:0 0 0 2024-09-13T22:56:11.286 INFO:tasks.workunit.client.0.smithi002.stdout:7/389: dwrite d8/f5d [0,4194304] 0 2024-09-13T22:56:11.288 INFO:tasks.workunit.client.0.smithi002.stdout:7/390: dread - d8/d10/d11/d13/d2e/d50/f61 zero size 2024-09-13T22:56:11.290 INFO:tasks.workunit.client.0.smithi002.stdout:7/391: write d8/f5d [918608,111740] 0 2024-09-13T22:56:11.292 INFO:tasks.workunit.client.0.smithi002.stdout:4/411: rmdir d3/d14/d25/d5e/d78 0 2024-09-13T22:56:11.292 INFO:tasks.workunit.client.1.smithi047.stdout:5/499: write d19/d23/d32/d69/f70 [1522730,121159] 0 2024-09-13T22:56:11.293 INFO:tasks.workunit.client.0.smithi002.stdout:4/412: write d3/d14/d29/d2a/d30/f58 [482645,41831] 0 2024-09-13T22:56:11.295 INFO:tasks.workunit.client.0.smithi002.stdout:6/449: creat d12/d17/d2a/f97 x:0 0 0 2024-09-13T22:56:11.295 INFO:tasks.workunit.client.1.smithi047.stdout:1/508: mknod d0/d7/d13/d2d/c8d 0 2024-09-13T22:56:11.296 INFO:tasks.workunit.client.0.smithi002.stdout:6/450: truncate d12/d17/d34/d39/f62 954350 0 2024-09-13T22:56:11.297 INFO:tasks.workunit.client.0.smithi002.stdout:0/476: mknod d1/cb1 0 2024-09-13T22:56:11.297 INFO:tasks.workunit.client.1.smithi047.stdout:9/506: dread d1/dc/f15 [0,4194304] 0 2024-09-13T22:56:11.299 INFO:tasks.workunit.client.0.smithi002.stdout:3/522: fdatasync d9/d3b/f64 0 2024-09-13T22:56:11.300 INFO:tasks.workunit.client.1.smithi047.stdout:3/556: rmdir d0/d3/d4/d16/d32/d42/d79/d9c/dad 39 2024-09-13T22:56:11.300 INFO:tasks.workunit.client.1.smithi047.stdout:3/557: readlink d0/d3/d4/l7 0 2024-09-13T22:56:11.302 INFO:tasks.workunit.client.1.smithi047.stdout:8/546: mkdir d8/d6b/da9/dc3 0 2024-09-13T22:56:11.304 INFO:tasks.workunit.client.0.smithi002.stdout:4/413: mknod d3/d14/d25/d69/c7b 0 2024-09-13T22:56:11.305 INFO:tasks.workunit.client.0.smithi002.stdout:4/414: chown d3/d40/f4e 119 1 2024-09-13T22:56:11.306 INFO:tasks.workunit.client.1.smithi047.stdout:0/585: symlink d1/d5/d16/d97/lbd 0 2024-09-13T22:56:11.309 INFO:tasks.workunit.client.0.smithi002.stdout:9/499: link d8/d10/d1c/d3d/f9e d8/d10/d61/fae 0 2024-09-13T22:56:11.310 INFO:tasks.workunit.client.0.smithi002.stdout:9/500: chown f0 61 1 2024-09-13T22:56:11.310 INFO:tasks.workunit.client.1.smithi047.stdout:5/500: rmdir d19/d25/d45 39 2024-09-13T22:56:11.313 INFO:tasks.workunit.client.1.smithi047.stdout:5/501: dread d19/d25/f38 [0,4194304] 0 2024-09-13T22:56:11.313 INFO:tasks.workunit.client.1.smithi047.stdout:1/509: truncate d0/d1d/f2c 1329035 0 2024-09-13T22:56:11.314 INFO:tasks.workunit.client.1.smithi047.stdout:1/510: read - d0/d7/d14/d57/f6e zero size 2024-09-13T22:56:11.314 INFO:tasks.workunit.client.0.smithi002.stdout:3/523: symlink d9/d15/d36/d4e/lc2 0 2024-09-13T22:56:11.315 INFO:tasks.workunit.client.1.smithi047.stdout:1/511: chown d0/d7/d14/d71 17925294 1 2024-09-13T22:56:11.316 INFO:tasks.workunit.client.0.smithi002.stdout:7/392: getdents d8/d10/d11/d13/d26/d38/d68 0 2024-09-13T22:56:11.316 INFO:tasks.workunit.client.0.smithi002.stdout:7/393: chown d8/d10/f1e 7 1 2024-09-13T22:56:11.317 INFO:tasks.workunit.client.1.smithi047.stdout:9/507: creat d1/dc/d14/dd/d4c/fa1 x:0 0 0 2024-09-13T22:56:11.321 INFO:tasks.workunit.client.0.smithi002.stdout:6/451: mkdir d12/d17/d98 0 2024-09-13T22:56:11.323 INFO:tasks.workunit.client.0.smithi002.stdout:0/477: chown d1/f6f 11198 1 2024-09-13T22:56:11.323 INFO:tasks.workunit.client.1.smithi047.stdout:9/508: dwrite d1/dc/d14/f17 [4194304,4194304] 0 2024-09-13T22:56:11.327 INFO:tasks.workunit.client.1.smithi047.stdout:3/558: mknod d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d3a/cb4 0 2024-09-13T22:56:11.327 INFO:tasks.workunit.client.1.smithi047.stdout:3/559: stat d0/d3/d65 0 2024-09-13T22:56:11.328 INFO:tasks.workunit.client.1.smithi047.stdout:3/560: stat d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/la7 0 2024-09-13T22:56:11.330 INFO:tasks.workunit.client.1.smithi047.stdout:0/586: fsync d1/f37 0 2024-09-13T22:56:11.331 INFO:tasks.workunit.client.1.smithi047.stdout:5/502: mknod d19/d34/d42/d5d/d9d/ca5 0 2024-09-13T22:56:11.332 INFO:tasks.workunit.client.1.smithi047.stdout:5/503: write d19/f4f [142141,55058] 0 2024-09-13T22:56:11.333 INFO:tasks.workunit.client.0.smithi002.stdout:9/501: write d8/d10/d61/f6b [667087,73932] 0 2024-09-13T22:56:11.333 INFO:tasks.workunit.client.1.smithi047.stdout:5/504: chown c18 107947651 1 2024-09-13T22:56:11.335 INFO:tasks.workunit.client.1.smithi047.stdout:1/512: mknod d0/d7/d10/c8e 0 2024-09-13T22:56:11.335 INFO:tasks.workunit.client.1.smithi047.stdout:1/513: chown d0/d7/d14/d28/d36 118 1 2024-09-13T22:56:11.336 INFO:tasks.workunit.client.1.smithi047.stdout:3/561: mknod d0/d3/d4/d16/cb5 0 2024-09-13T22:56:11.337 INFO:tasks.workunit.client.0.smithi002.stdout:7/394: symlink d8/d10/d11/d13/d2e/d50/d52/d58/l69 0 2024-09-13T22:56:11.338 INFO:tasks.workunit.client.0.smithi002.stdout:7/395: chown d8/d10/d39/c5f 0 1 2024-09-13T22:56:11.340 INFO:tasks.workunit.client.0.smithi002.stdout:2/443: sync 2024-09-13T22:56:11.340 INFO:tasks.workunit.client.0.smithi002.stdout:7/396: chown d8/d10/d39/c5f 1 1 2024-09-13T22:56:11.340 INFO:tasks.workunit.client.0.smithi002.stdout:4/415: creat d3/d40/f7c x:0 0 0 2024-09-13T22:56:11.340 INFO:tasks.workunit.client.0.smithi002.stdout:7/397: stat d8/f27 0 2024-09-13T22:56:11.341 INFO:tasks.workunit.client.0.smithi002.stdout:7/398: write d8/d9/d46/f4b [998584,93857] 0 2024-09-13T22:56:11.343 INFO:tasks.workunit.client.0.smithi002.stdout:0/478: unlink d1/d2/f6e 0 2024-09-13T22:56:11.344 INFO:tasks.workunit.client.0.smithi002.stdout:0/479: dread - d1/d2/d81/fa6 zero size 2024-09-13T22:56:11.346 INFO:tasks.workunit.client.1.smithi047.stdout:5/505: creat d19/d23/d2e/d41/d58/d77/fa6 x:0 0 0 2024-09-13T22:56:11.347 INFO:tasks.workunit.client.0.smithi002.stdout:9/502: dread d8/f75 [0,4194304] 0 2024-09-13T22:56:11.348 INFO:tasks.workunit.client.1.smithi047.stdout:1/514: rename d0/d7/c77 to d0/d7/d14/d71/c8f 0 2024-09-13T22:56:11.349 INFO:tasks.workunit.client.0.smithi002.stdout:2/444: stat d1/d32/d37/l92 0 2024-09-13T22:56:11.351 INFO:tasks.workunit.client.0.smithi002.stdout:4/416: dread - d3/d14/f53 zero size 2024-09-13T22:56:11.352 INFO:tasks.workunit.client.1.smithi047.stdout:1/515: readlink d0/d7/db/d79/l83 0 2024-09-13T22:56:11.353 INFO:tasks.workunit.client.0.smithi002.stdout:4/417: truncate d3/f73 222544 0 2024-09-13T22:56:11.354 INFO:tasks.workunit.client.0.smithi002.stdout:6/452: creat d12/d17/d28/d67/f99 x:0 0 0 2024-09-13T22:56:11.355 INFO:tasks.workunit.client.0.smithi002.stdout:2/445: dwrite d1/d7/d35/d78/f6f [0,4194304] 0 2024-09-13T22:56:11.356 INFO:tasks.workunit.client.0.smithi002.stdout:2/446: write d1/d4d/f50 [818323,58528] 0 2024-09-13T22:56:11.359 INFO:tasks.workunit.client.1.smithi047.stdout:1/516: dwrite d0/d7/f44 [0,4194304] 0 2024-09-13T22:56:11.361 INFO:tasks.workunit.client.1.smithi047.stdout:5/506: symlink d19/d23/d32/la7 0 2024-09-13T22:56:11.362 INFO:tasks.workunit.client.0.smithi002.stdout:0/480: fsync d1/d4/d75/f2c 0 2024-09-13T22:56:11.363 INFO:tasks.workunit.client.1.smithi047.stdout:5/507: fsync d19/d23/d4c/f67 0 2024-09-13T22:56:11.366 INFO:tasks.workunit.client.1.smithi047.stdout:5/508: write d19/d34/d42/d5d/f86 [132764,646] 0 2024-09-13T22:56:11.367 INFO:tasks.workunit.client.1.smithi047.stdout:1/517: dread d0/d7/d10/f49 [0,4194304] 0 2024-09-13T22:56:11.368 INFO:tasks.workunit.client.1.smithi047.stdout:5/509: write d19/d34/d42/f5b [2392076,69345] 0 2024-09-13T22:56:11.369 INFO:tasks.workunit.client.1.smithi047.stdout:1/518: chown d0/d1d/f60 1799 1 2024-09-13T22:56:11.369 INFO:tasks.workunit.client.0.smithi002.stdout:3/524: getdents d9/d15/d36/d4e/d5e/dae/d89 0 2024-09-13T22:56:11.371 INFO:tasks.workunit.client.0.smithi002.stdout:9/503: unlink d8/lb 0 2024-09-13T22:56:11.375 INFO:tasks.workunit.client.0.smithi002.stdout:6/453: creat d12/d17/d4e/f9a x:0 0 0 2024-09-13T22:56:11.375 INFO:tasks.workunit.client.1.smithi047.stdout:1/519: dwrite d0/d7/d13/f56 [0,4194304] 0 2024-09-13T22:56:11.376 INFO:tasks.workunit.client.0.smithi002.stdout:2/447: write d1/d32/d37/f45 [3908656,82546] 0 2024-09-13T22:56:11.379 INFO:tasks.workunit.client.0.smithi002.stdout:7/399: mknod d8/d10/d39/d60/c6a 0 2024-09-13T22:56:11.380 INFO:tasks.workunit.client.1.smithi047.stdout:1/520: dread d0/f5c [0,4194304] 0 2024-09-13T22:56:11.381 INFO:tasks.workunit.client.1.smithi047.stdout:1/521: truncate d0/d7/d75/f85 672146 0 2024-09-13T22:56:11.393 INFO:tasks.workunit.client.0.smithi002.stdout:6/454: unlink d12/f2b 0 2024-09-13T22:56:11.393 INFO:tasks.workunit.client.0.smithi002.stdout:6/455: readlink d12/d17/d28/d67/d6b/l77 0 2024-09-13T22:56:11.394 INFO:tasks.workunit.client.0.smithi002.stdout:6/456: readlink d12/d17/d34/d39/l47 0 2024-09-13T22:56:11.394 INFO:tasks.workunit.client.0.smithi002.stdout:6/457: readlink d12/l15 0 2024-09-13T22:56:11.395 INFO:tasks.workunit.client.0.smithi002.stdout:6/458: fdatasync d12/d17/d28/f35 0 2024-09-13T22:56:11.398 INFO:tasks.workunit.client.0.smithi002.stdout:0/481: write d1/d2/fd [2293608,63834] 0 2024-09-13T22:56:11.401 INFO:tasks.workunit.client.0.smithi002.stdout:6/459: dwrite d12/f74 [0,4194304] 0 2024-09-13T22:56:11.401 INFO:tasks.workunit.client.0.smithi002.stdout:3/525: fsync d9/d15/d36/d4e/f9f 0 2024-09-13T22:56:11.402 INFO:tasks.workunit.client.1.smithi047.stdout:3/562: dread - d0/d3/d4/d16/d73/d86/f99 zero size 2024-09-13T22:56:11.407 INFO:tasks.workunit.client.0.smithi002.stdout:8/430: sync 2024-09-13T22:56:11.409 INFO:tasks.workunit.client.1.smithi047.stdout:9/509: link d1/dc/d14/dd/l90 d1/dc/la2 0 2024-09-13T22:56:11.420 INFO:tasks.workunit.client.0.smithi002.stdout:3/526: symlink d9/d15/d51/lc3 0 2024-09-13T22:56:11.421 INFO:tasks.workunit.client.0.smithi002.stdout:3/527: chown d9/d3b/d7c/f80 1 1 2024-09-13T22:56:11.422 INFO:tasks.workunit.client.1.smithi047.stdout:1/522: creat d0/d7/db/f90 x:0 0 0 2024-09-13T22:56:11.424 INFO:tasks.workunit.client.0.smithi002.stdout:4/418: getdents d3/d40 0 2024-09-13T22:56:11.425 INFO:tasks.workunit.client.1.smithi047.stdout:0/587: getdents d1/d7 0 2024-09-13T22:56:11.426 INFO:tasks.workunit.client.0.smithi002.stdout:8/431: mkdir d3/dc/d16/d2f/d83 0 2024-09-13T22:56:11.428 INFO:tasks.workunit.client.0.smithi002.stdout:2/448: link d1/d4d/f74 d1/f95 0 2024-09-13T22:56:11.429 INFO:tasks.workunit.client.0.smithi002.stdout:7/400: dwrite d8/d9/f40 [0,4194304] 0 2024-09-13T22:56:11.430 INFO:tasks.workunit.client.1.smithi047.stdout:5/510: dwrite d19/d23/d4c/f52 [0,4194304] 0 2024-09-13T22:56:11.430 INFO:tasks.workunit.client.0.smithi002.stdout:0/482: dwrite d1/d2/f56 [0,4194304] 0 2024-09-13T22:56:11.431 INFO:tasks.workunit.client.1.smithi047.stdout:5/511: stat d19 0 2024-09-13T22:56:11.434 INFO:tasks.workunit.client.1.smithi047.stdout:1/523: rename d0/d7/db/l7a to d0/d7/d13/d8c/l91 0 2024-09-13T22:56:11.434 INFO:tasks.workunit.client.0.smithi002.stdout:2/449: read d1/d7/d35/d78/f4b [300068,84012] 0 2024-09-13T22:56:11.436 INFO:tasks.workunit.client.1.smithi047.stdout:0/588: dwrite d1/d5/d16/d23/d45/d7f/faf [0,4194304] 0 2024-09-13T22:56:11.436 INFO:tasks.workunit.client.1.smithi047.stdout:1/524: chown d0/d7/d14/d57/d72 10 1 2024-09-13T22:56:11.437 INFO:tasks.workunit.client.0.smithi002.stdout:9/504: getdents d8/d10/d61 0 2024-09-13T22:56:11.437 INFO:tasks.workunit.client.1.smithi047.stdout:0/589: fdatasync d1/d7/f1d 0 2024-09-13T22:56:11.440 INFO:tasks.workunit.client.1.smithi047.stdout:9/510: dread d1/dc/d14/dd/d54/d50/d5b/d9e/f83 [0,4194304] 0 2024-09-13T22:56:11.443 INFO:tasks.workunit.client.0.smithi002.stdout:4/419: mknod d3/d14/d29/d2a/d30/c7d 0 2024-09-13T22:56:11.443 INFO:tasks.workunit.client.1.smithi047.stdout:3/563: getdents d0/d3/d4/d16/d73 0 2024-09-13T22:56:11.445 INFO:tasks.workunit.client.0.smithi002.stdout:4/420: truncate d3/d40/f76 362174 0 2024-09-13T22:56:11.445 INFO:tasks.workunit.client.0.smithi002.stdout:8/432: truncate d3/f6 447741 0 2024-09-13T22:56:11.447 INFO:tasks.workunit.client.0.smithi002.stdout:7/401: creat d8/d10/f6b x:0 0 0 2024-09-13T22:56:11.448 INFO:tasks.workunit.client.1.smithi047.stdout:1/525: symlink d0/d7/d14/d57/d72/l92 0 2024-09-13T22:56:11.450 INFO:tasks.workunit.client.0.smithi002.stdout:6/460: rename d12/f21 to d12/d17/d28/d67/f9b 0 2024-09-13T22:56:11.450 INFO:tasks.workunit.client.1.smithi047.stdout:1/526: write d0/d7/db/f38 [1785244,68978] 0 2024-09-13T22:56:11.450 INFO:tasks.workunit.client.1.smithi047.stdout:0/590: symlink d1/d5/d16/d47/lbe 0 2024-09-13T22:56:11.452 INFO:tasks.workunit.client.0.smithi002.stdout:2/450: mkdir d1/d7/d41/d96 0 2024-09-13T22:56:11.452 INFO:tasks.workunit.client.0.smithi002.stdout:0/483: dread d1/d2/f6d [0,4194304] 0 2024-09-13T22:56:11.453 INFO:tasks.workunit.client.0.smithi002.stdout:3/528: creat d9/d15/d26/fc4 x:0 0 0 2024-09-13T22:56:11.454 INFO:tasks.workunit.client.0.smithi002.stdout:0/484: truncate d1/d4/da3/f68 131749 0 2024-09-13T22:56:11.455 INFO:tasks.workunit.client.0.smithi002.stdout:3/529: read d9/d15/d51/f2e [1746872,106783] 0 2024-09-13T22:56:11.460 INFO:tasks.workunit.client.1.smithi047.stdout:3/564: read - d0/d3/d4/d16/f61 zero size 2024-09-13T22:56:11.461 INFO:tasks.workunit.client.0.smithi002.stdout:9/505: creat d8/d10/d1c/d68/faf x:0 0 0 2024-09-13T22:56:11.461 INFO:tasks.workunit.client.0.smithi002.stdout:4/421: mkdir d3/d14/d25/d69/d7e 0 2024-09-13T22:56:11.462 INFO:tasks.workunit.client.0.smithi002.stdout:0/485: dwrite d1/d2/d6c/d8b/f8c [0,4194304] 0 2024-09-13T22:56:11.464 INFO:tasks.workunit.client.0.smithi002.stdout:8/433: fsync d3/dc/f5f 0 2024-09-13T22:56:11.464 INFO:tasks.workunit.client.1.smithi047.stdout:0/591: dread d1/d5/f10 [0,4194304] 0 2024-09-13T22:56:11.465 INFO:tasks.workunit.client.1.smithi047.stdout:5/512: dread d19/d34/d42/f48 [0,4194304] 0 2024-09-13T22:56:11.467 INFO:tasks.workunit.client.1.smithi047.stdout:9/511: dread d1/dc/f47 [0,4194304] 0 2024-09-13T22:56:11.467 INFO:tasks.workunit.client.1.smithi047.stdout:1/527: dread d0/d7/db/f38 [0,4194304] 0 2024-09-13T22:56:11.468 INFO:tasks.workunit.client.1.smithi047.stdout:1/528: chown d0/d7/d10/l47 102180 1 2024-09-13T22:56:11.469 INFO:tasks.workunit.client.0.smithi002.stdout:8/434: dread d3/dc/d16/d4b/f6c [0,4194304] 0 2024-09-13T22:56:11.471 INFO:tasks.workunit.client.1.smithi047.stdout:3/565: chown d0/d3/d4/d16/d32/d76/l8f 26 1 2024-09-13T22:56:11.476 INFO:tasks.workunit.client.1.smithi047.stdout:0/592: symlink d1/d5/d16/d97/lbf 0 2024-09-13T22:56:11.481 INFO:tasks.workunit.client.1.smithi047.stdout:5/513: symlink d19/d34/d42/la8 0 2024-09-13T22:56:11.482 INFO:tasks.workunit.client.0.smithi002.stdout:1/499: sync 2024-09-13T22:56:11.482 INFO:tasks.workunit.client.0.smithi002.stdout:5/456: sync 2024-09-13T22:56:11.482 INFO:tasks.workunit.client.0.smithi002.stdout:3/530: symlink d9/d15/d35/lc5 0 2024-09-13T22:56:11.484 INFO:tasks.workunit.client.0.smithi002.stdout:3/531: read d9/d15/d35/f96 [570899,105597] 0 2024-09-13T22:56:11.486 INFO:tasks.workunit.client.0.smithi002.stdout:9/506: creat d8/d10/d1c/fb0 x:0 0 0 2024-09-13T22:56:11.486 INFO:tasks.workunit.client.0.smithi002.stdout:5/457: dread d1/d2a/d6b/d88/d45/d4f/d8f/f94 [0,4194304] 0 2024-09-13T22:56:11.490 INFO:tasks.workunit.client.1.smithi047.stdout:3/566: fdatasync d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/f89 0 2024-09-13T22:56:11.492 INFO:tasks.workunit.client.0.smithi002.stdout:0/486: creat d1/d2/d6c/d8b/fb2 x:0 0 0 2024-09-13T22:56:11.492 INFO:tasks.workunit.client.0.smithi002.stdout:9/507: dwrite d8/d10/d1c/f19 [0,4194304] 0 2024-09-13T22:56:11.492 INFO:tasks.workunit.client.0.smithi002.stdout:4/422: rmdir d3/d14/d25 39 2024-09-13T22:56:11.493 INFO:tasks.workunit.client.0.smithi002.stdout:0/487: fdatasync d1/d4/da3/f5b 0 2024-09-13T22:56:11.493 INFO:tasks.workunit.client.0.smithi002.stdout:9/508: fdatasync d8/d10/d42/f7f 0 2024-09-13T22:56:11.493 INFO:tasks.workunit.client.0.smithi002.stdout:4/423: write d3/f2f [2186969,6492] 0 2024-09-13T22:56:11.495 INFO:tasks.workunit.client.0.smithi002.stdout:0/488: truncate d1/d4/f96 4603463 0 2024-09-13T22:56:11.498 INFO:tasks.workunit.client.1.smithi047.stdout:9/512: rename d1/dc/d18/d72 to d1/dc/d14/dd/d54/d50/d91/da3 0 2024-09-13T22:56:11.499 INFO:tasks.workunit.client.1.smithi047.stdout:9/513: chown d1/dc/d14/dd/d54/d50/d5b/d9e 60163 1 2024-09-13T22:56:11.501 INFO:tasks.workunit.client.1.smithi047.stdout:1/529: rmdir d0/d7/d87 39 2024-09-13T22:56:11.501 INFO:tasks.workunit.client.0.smithi002.stdout:0/489: dwrite d1/d4/d75/d31/f37 [0,4194304] 0 2024-09-13T22:56:11.507 INFO:tasks.workunit.client.1.smithi047.stdout:0/593: mkdir d1/d5/d16/dc0 0 2024-09-13T22:56:11.509 INFO:tasks.workunit.client.1.smithi047.stdout:5/514: truncate d19/d34/f40 3602404 0 2024-09-13T22:56:11.511 INFO:tasks.workunit.client.0.smithi002.stdout:1/500: chown d1/d13/d30/d31/d86/l87 446 1 2024-09-13T22:56:11.516 INFO:tasks.workunit.client.0.smithi002.stdout:3/532: chown d9/d15/d36/l76 59 1 2024-09-13T22:56:11.518 INFO:tasks.workunit.client.1.smithi047.stdout:3/567: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/f89 [956504,120041] 0 2024-09-13T22:56:11.519 INFO:tasks.workunit.client.1.smithi047.stdout:5/515: creat d19/d23/d4c/fa9 x:0 0 0 2024-09-13T22:56:11.521 INFO:tasks.workunit.client.1.smithi047.stdout:3/568: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/f87 [938550,114022] 0 2024-09-13T22:56:11.525 INFO:tasks.workunit.client.1.smithi047.stdout:0/594: rename d1/d5/d11/d2f/cad to d1/d5/d16/d23/d2d/cc1 0 2024-09-13T22:56:11.526 INFO:tasks.workunit.client.1.smithi047.stdout:0/595: write d1/d5/d16/d97/fb8 [702325,14012] 0 2024-09-13T22:56:11.527 INFO:tasks.workunit.client.0.smithi002.stdout:6/461: truncate d12/f63 1658103 0 2024-09-13T22:56:11.528 INFO:tasks.workunit.client.1.smithi047.stdout:0/596: chown d1/d5/d16/d23/d2d/l39 877 1 2024-09-13T22:56:11.529 INFO:tasks.workunit.client.1.smithi047.stdout:5/516: creat d19/d23/d2e/d41/d58/faa x:0 0 0 2024-09-13T22:56:11.529 INFO:tasks.workunit.client.1.smithi047.stdout:0/597: chown d1/d5/d11/c46 0 1 2024-09-13T22:56:11.534 INFO:tasks.workunit.client.0.smithi002.stdout:8/435: dwrite d3/dc/d51/f4c [0,4194304] 0 2024-09-13T22:56:11.538 INFO:tasks.workunit.client.0.smithi002.stdout:4/424: symlink d3/d40/l7f 0 2024-09-13T22:56:11.540 INFO:tasks.workunit.client.1.smithi047.stdout:3/569: unlink d0/d3/d4/d16/d2c/de/d3d/f6e 0 2024-09-13T22:56:11.540 INFO:tasks.workunit.client.0.smithi002.stdout:5/458: write d1/d10/f3d [948949,29232] 0 2024-09-13T22:56:11.540 INFO:tasks.workunit.client.1.smithi047.stdout:9/514: dwrite d1/dc/d14/dd/d54/d4e/d51/f5d [0,4194304] 0 2024-09-13T22:56:11.542 INFO:tasks.workunit.client.1.smithi047.stdout:5/517: truncate d19/d25/f2b 1791137 0 2024-09-13T22:56:11.542 INFO:tasks.workunit.client.1.smithi047.stdout:5/518: fdatasync d19/f4f 0 2024-09-13T22:56:11.547 INFO:tasks.workunit.client.0.smithi002.stdout:0/490: mknod d1/d4/d75/d31/d32/cb3 0 2024-09-13T22:56:11.548 INFO:tasks.workunit.client.1.smithi047.stdout:0/598: mknod d1/d5/d16/d23/cc2 0 2024-09-13T22:56:11.549 INFO:tasks.workunit.client.1.smithi047.stdout:0/599: stat d1/d5/d11/d52 0 2024-09-13T22:56:11.550 INFO:tasks.workunit.client.1.smithi047.stdout:0/600: dread - d1/f6e zero size 2024-09-13T22:56:11.551 INFO:tasks.workunit.client.1.smithi047.stdout:0/601: chown d1/d7/f81 222481165 1 2024-09-13T22:56:11.552 INFO:tasks.workunit.client.1.smithi047.stdout:0/602: readlink d1/d5/d16/d47/lab 0 2024-09-13T22:56:11.555 INFO:tasks.workunit.client.1.smithi047.stdout:3/570: creat d0/d3/d4/d91/d8d/fb6 x:0 0 0 2024-09-13T22:56:11.560 INFO:tasks.workunit.client.0.smithi002.stdout:7/402: rename d8 to d8/d10/d11/d13/d26/d6c 22 2024-09-13T22:56:11.562 INFO:tasks.workunit.client.1.smithi047.stdout:5/519: mknod d19/d23/d2e/d41/cab 0 2024-09-13T22:56:11.564 INFO:tasks.workunit.client.0.smithi002.stdout:3/533: creat d9/d15/d36/d4e/d5e/fc6 x:0 0 0 2024-09-13T22:56:11.564 INFO:tasks.workunit.client.1.smithi047.stdout:5/520: write d19/d25/d85/f9a [453711,35705] 0 2024-09-13T22:56:11.570 INFO:tasks.workunit.client.1.smithi047.stdout:0/603: link d1/d5/d11/d52/f72 d1/d5/d16/d23/d2d/fc3 0 2024-09-13T22:56:11.571 INFO:tasks.workunit.client.1.smithi047.stdout:3/571: dread d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/f54 [0,4194304] 0 2024-09-13T22:56:11.572 INFO:tasks.workunit.client.1.smithi047.stdout:5/521: read d19/d34/d42/d5d/f6e [597157,88675] 0 2024-09-13T22:56:11.573 INFO:tasks.workunit.client.0.smithi002.stdout:9/509: write d8/d1e/f41 [3375912,94336] 0 2024-09-13T22:56:11.578 INFO:tasks.workunit.client.0.smithi002.stdout:4/425: creat d3/d14/d29/d2a/d30/f80 x:0 0 0 2024-09-13T22:56:11.580 INFO:tasks.workunit.client.1.smithi047.stdout:3/572: creat d0/d3/d4/d16/d2c/de/d1f/d3b/d69/fb7 x:0 0 0 2024-09-13T22:56:11.581 INFO:tasks.workunit.client.1.smithi047.stdout:5/522: fsync d19/d23/d4c/f5e 0 2024-09-13T22:56:11.582 INFO:tasks.workunit.client.0.smithi002.stdout:2/451: getdents d1/d7/d35/d78 0 2024-09-13T22:56:11.583 INFO:tasks.workunit.client.1.smithi047.stdout:5/523: fdatasync d19/d23/d2e/d41/f5a 0 2024-09-13T22:56:11.583 INFO:tasks.workunit.client.1.smithi047.stdout:9/515: getdents d1/dc/d14/dd/d54 0 2024-09-13T22:56:11.584 INFO:tasks.workunit.client.1.smithi047.stdout:5/524: chown c18 24 1 2024-09-13T22:56:11.585 INFO:tasks.workunit.client.0.smithi002.stdout:0/491: dwrite d1/d2/f7a [0,4194304] 0 2024-09-13T22:56:11.586 INFO:tasks.workunit.client.1.smithi047.stdout:9/516: stat d1/dc/d14/dd/d54/d50/l88 0 2024-09-13T22:56:11.588 INFO:tasks.workunit.client.0.smithi002.stdout:7/403: readlink d8/d10/l35 0 2024-09-13T22:56:11.590 INFO:tasks.workunit.client.1.smithi047.stdout:3/573: dwrite d0/d3/d4/d16/d73/d86/f99 [0,4194304] 0 2024-09-13T22:56:11.591 INFO:tasks.workunit.client.0.smithi002.stdout:6/462: rename d12/d17/d34/l37 to d12/d17/d2a/l9c 0 2024-09-13T22:56:11.592 INFO:tasks.workunit.client.0.smithi002.stdout:3/534: rmdir d9/d15/d36/d4e/d5e/dae 39 2024-09-13T22:56:11.594 INFO:tasks.workunit.client.0.smithi002.stdout:3/535: dread - d9/d91/fbc zero size 2024-09-13T22:56:11.594 INFO:tasks.workunit.client.0.smithi002.stdout:6/463: truncate d12/d17/d28/d67/f9b 4249982 0 2024-09-13T22:56:11.594 INFO:tasks.workunit.client.0.smithi002.stdout:1/501: truncate d1/d13/d30/d73/da1/f65 484404 0 2024-09-13T22:56:11.596 INFO:tasks.workunit.client.1.smithi047.stdout:5/525: dwrite d19/d25/d90/f99 [0,4194304] 0 2024-09-13T22:56:11.597 INFO:tasks.workunit.client.1.smithi047.stdout:9/517: unlink d1/dc/d14/dd/d54/d4e/d51/f5c 0 2024-09-13T22:56:11.599 INFO:tasks.workunit.client.1.smithi047.stdout:0/604: truncate d1/d5/d16/d23/d45/d7f/f78 1804110 0 2024-09-13T22:56:11.603 INFO:tasks.workunit.client.0.smithi002.stdout:1/502: dread d1/d13/f97 [0,4194304] 0 2024-09-13T22:56:11.605 INFO:tasks.workunit.client.1.smithi047.stdout:5/526: dwrite d19/f43 [0,4194304] 0 2024-09-13T22:56:11.612 INFO:tasks.workunit.client.1.smithi047.stdout:5/527: dread d19/d23/d4c/f52 [0,4194304] 0 2024-09-13T22:56:11.613 INFO:tasks.workunit.client.1.smithi047.stdout:9/518: symlink d1/dc/d14/dd/d54/d4e/la4 0 2024-09-13T22:56:11.615 INFO:tasks.workunit.client.1.smithi047.stdout:0/605: creat d1/d5/d16/d97/db6/fc4 x:0 0 0 2024-09-13T22:56:11.617 INFO:tasks.workunit.client.0.smithi002.stdout:7/404: symlink d8/d10/d11/d13/d2e/d50/d52/l6d 0 2024-09-13T22:56:11.618 INFO:tasks.workunit.client.0.smithi002.stdout:0/492: dwrite d1/f5f [0,4194304] 0 2024-09-13T22:56:11.619 INFO:tasks.workunit.client.0.smithi002.stdout:0/493: write d1/d2/f6d [3558415,58650] 0 2024-09-13T22:56:11.624 INFO:tasks.workunit.client.1.smithi047.stdout:3/574: creat d0/d3/d4/d16/d32/d42/d79/d9c/fb8 x:0 0 0 2024-09-13T22:56:11.624 INFO:tasks.workunit.client.0.smithi002.stdout:4/426: dread d3/d14/f42 [0,4194304] 0 2024-09-13T22:56:11.629 INFO:tasks.workunit.client.1.smithi047.stdout:5/528: symlink d19/d23/d32/d69/lac 0 2024-09-13T22:56:11.630 INFO:tasks.workunit.client.1.smithi047.stdout:5/529: chown d19/d34/d42/f88 66 1 2024-09-13T22:56:11.632 INFO:tasks.workunit.client.1.smithi047.stdout:5/530: readlink d19/d23/d2e/d41/l4a 0 2024-09-13T22:56:11.632 INFO:tasks.workunit.client.0.smithi002.stdout:8/436: write d3/dc/f13 [862925,69991] 0 2024-09-13T22:56:11.632 INFO:tasks.workunit.client.1.smithi047.stdout:5/531: chown d19/d25/l8a 164 1 2024-09-13T22:56:11.634 INFO:tasks.workunit.client.1.smithi047.stdout:3/575: dread d0/d3/d4/d91/f66 [0,4194304] 0 2024-09-13T22:56:11.634 INFO:tasks.workunit.client.1.smithi047.stdout:5/532: write d19/d23/d4c/fa4 [826701,29784] 0 2024-09-13T22:56:11.635 INFO:tasks.workunit.client.1.smithi047.stdout:0/606: write d1/d5/d11/d2f/f38 [6391577,56650] 0 2024-09-13T22:56:11.636 INFO:tasks.workunit.client.0.smithi002.stdout:5/459: write d1/d2a/f7d [1453389,94683] 0 2024-09-13T22:56:11.637 INFO:tasks.workunit.client.1.smithi047.stdout:0/607: chown d1/d5/d16/d23/d2d 35574845 1 2024-09-13T22:56:11.638 INFO:tasks.workunit.client.1.smithi047.stdout:0/608: dread - d1/d5/d16/d6a/d92/fa2 zero size 2024-09-13T22:56:11.639 INFO:tasks.workunit.client.1.smithi047.stdout:0/609: dread - d1/d5/d16/d23/d77/fa6 zero size 2024-09-13T22:56:11.641 INFO:tasks.workunit.client.0.smithi002.stdout:2/452: creat d1/d7/d41/d96/f97 x:0 0 0 2024-09-13T22:56:11.646 INFO:tasks.workunit.client.1.smithi047.stdout:9/519: rename d1/dc/d14/dd/d54/d50/d5b/d97 to d1/dc/d14/da5 0 2024-09-13T22:56:11.647 INFO:tasks.workunit.client.1.smithi047.stdout:2/636: sync 2024-09-13T22:56:11.648 INFO:tasks.workunit.client.1.smithi047.stdout:5/533: mknod d19/d23/d2e/cad 0 2024-09-13T22:56:11.650 INFO:tasks.workunit.client.1.smithi047.stdout:5/534: truncate d19/d34/d42/d5d/f9b 589496 0 2024-09-13T22:56:11.652 INFO:tasks.workunit.client.1.smithi047.stdout:3/576: creat d0/d3/d5e/fb9 x:0 0 0 2024-09-13T22:56:11.653 INFO:tasks.workunit.client.0.smithi002.stdout:6/464: dwrite d12/d17/d4e/f52 [0,4194304] 0 2024-09-13T22:56:11.654 INFO:tasks.workunit.client.0.smithi002.stdout:6/465: chown d12/d17/d28/d7d 0 1 2024-09-13T22:56:11.654 INFO:tasks.workunit.client.0.smithi002.stdout:3/536: mknod d9/d7e/daf/cc7 0 2024-09-13T22:56:11.655 INFO:tasks.workunit.client.1.smithi047.stdout:0/610: dwrite d1/d5/d16/d23/f25 [0,4194304] 0 2024-09-13T22:56:11.656 INFO:tasks.workunit.client.1.smithi047.stdout:9/520: creat d1/dc/d14/dd/d54/d50/d5b/fa6 x:0 0 0 2024-09-13T22:56:11.657 INFO:tasks.workunit.client.0.smithi002.stdout:8/437: mknod d3/dc/d16/d60/c84 0 2024-09-13T22:56:11.668 INFO:tasks.workunit.client.1.smithi047.stdout:3/577: mkdir d0/d3/d4/d16/d32/d42/d79/dba 0 2024-09-13T22:56:11.670 INFO:tasks.workunit.client.1.smithi047.stdout:9/521: truncate d1/f25 2263034 0 2024-09-13T22:56:11.670 INFO:tasks.workunit.client.0.smithi002.stdout:7/405: symlink d8/d10/l6e 0 2024-09-13T22:56:11.671 INFO:tasks.workunit.client.1.smithi047.stdout:3/578: read d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/f30 [1799538,72876] 0 2024-09-13T22:56:11.672 INFO:tasks.workunit.client.1.smithi047.stdout:0/611: write d1/d5/d16/d23/fae [830095,89001] 0 2024-09-13T22:56:11.673 INFO:tasks.workunit.client.1.smithi047.stdout:3/579: stat d0/d3/d4/d16/d2c/de 0 2024-09-13T22:56:11.673 INFO:tasks.workunit.client.1.smithi047.stdout:0/612: chown d1/d7 1225 1 2024-09-13T22:56:11.674 INFO:tasks.workunit.client.1.smithi047.stdout:3/580: dread - d0/d3/d4/d91/f8b zero size 2024-09-13T22:56:11.674 INFO:tasks.workunit.client.0.smithi002.stdout:9/510: rename d8/d10/d1c/d68/d84 to d8/d10/db1 0 2024-09-13T22:56:11.675 INFO:tasks.workunit.client.1.smithi047.stdout:0/613: chown d1/d5/d16/d23/d2d/f31 125575052 1 2024-09-13T22:56:11.677 INFO:tasks.workunit.client.1.smithi047.stdout:2/637: write d1/df/d1d/d20/d54/f95 [597642,71973] 0 2024-09-13T22:56:11.678 INFO:tasks.workunit.client.1.smithi047.stdout:5/535: mkdir d19/dae 0 2024-09-13T22:56:11.679 INFO:tasks.workunit.client.1.smithi047.stdout:5/536: read - d19/d23/d2e/d41/d58/d77/fa6 zero size 2024-09-13T22:56:11.681 INFO:tasks.workunit.client.1.smithi047.stdout:5/537: read - d19/d23/d2e/d41/d58/faa zero size 2024-09-13T22:56:11.684 INFO:tasks.workunit.client.0.smithi002.stdout:3/537: dread d9/d3b/da5/fa4 [0,4194304] 0 2024-09-13T22:56:11.685 INFO:tasks.workunit.client.0.smithi002.stdout:6/466: truncate d12/d17/f27 425724 0 2024-09-13T22:56:11.685 INFO:tasks.workunit.client.0.smithi002.stdout:3/538: write f5 [1392987,28548] 0 2024-09-13T22:56:11.691 INFO:tasks.workunit.client.1.smithi047.stdout:2/638: rename d1/df/d1d/d20/d54/d8e to d1/df/d35/dd7 0 2024-09-13T22:56:11.696 INFO:tasks.workunit.client.0.smithi002.stdout:7/406: symlink d8/d9/d46/l6f 0 2024-09-13T22:56:11.697 INFO:tasks.workunit.client.1.smithi047.stdout:5/538: creat d19/d23/d4c/faf x:0 0 0 2024-09-13T22:56:11.699 INFO:tasks.workunit.client.1.smithi047.stdout:2/639: dwrite d1/d8a/da6/dc3/fc7 [0,4194304] 0 2024-09-13T22:56:11.701 INFO:tasks.workunit.client.1.smithi047.stdout:0/614: dwrite d1/d5/d11/f20 [0,4194304] 0 2024-09-13T22:56:11.702 INFO:tasks.workunit.client.0.smithi002.stdout:2/453: rename d1/d7/d8/d2c/l58 to d1/d7/d8/d51/l98 0 2024-09-13T22:56:11.702 INFO:tasks.workunit.client.1.smithi047.stdout:0/615: stat d1/d5/f24 0 2024-09-13T22:56:11.704 INFO:tasks.workunit.client.1.smithi047.stdout:5/539: dread d19/d34/d6c/f8d [0,4194304] 0 2024-09-13T22:56:11.707 INFO:tasks.workunit.client.0.smithi002.stdout:0/494: symlink d1/d7e/d9d/lb4 0 2024-09-13T22:56:11.709 INFO:tasks.workunit.client.0.smithi002.stdout:8/438: mkdir d3/dc/d16/d2f/d83/d85 0 2024-09-13T22:56:11.709 INFO:tasks.workunit.client.1.smithi047.stdout:7/573: sync 2024-09-13T22:56:11.709 INFO:tasks.workunit.client.1.smithi047.stdout:4/654: sync 2024-09-13T22:56:11.710 INFO:tasks.workunit.client.1.smithi047.stdout:7/574: stat d0/d7/da/d1e/d93/l9f 0 2024-09-13T22:56:11.711 INFO:tasks.workunit.client.0.smithi002.stdout:1/503: getdents d1/d13/d30/d31/d3d 0 2024-09-13T22:56:11.711 INFO:tasks.workunit.client.0.smithi002.stdout:8/439: write d3/dc/d18/f2d [1130420,31860] 0 2024-09-13T22:56:11.715 INFO:tasks.workunit.client.1.smithi047.stdout:7/575: truncate d0/d7/da/d2e/fbe 1003138 0 2024-09-13T22:56:11.715 INFO:tasks.workunit.client.1.smithi047.stdout:7/576: chown d0/d7/da/d47 1 1 2024-09-13T22:56:11.715 INFO:tasks.workunit.client.0.smithi002.stdout:2/454: dwrite d1/f5 [4194304,4194304] 0 2024-09-13T22:56:11.715 INFO:tasks.workunit.client.0.smithi002.stdout:5/460: creat d1/d2a/d6b/d88/fa3 x:0 0 0 2024-09-13T22:56:11.716 INFO:tasks.workunit.client.0.smithi002.stdout:4/427: sync 2024-09-13T22:56:11.722 INFO:tasks.workunit.client.0.smithi002.stdout:4/428: dwrite d3/d14/d29/d2a/f71 [0,4194304] 0 2024-09-13T22:56:11.726 INFO:tasks.workunit.client.1.smithi047.stdout:5/540: mknod d19/d34/d42/d5d/d9d/cb0 0 2024-09-13T22:56:11.728 INFO:tasks.workunit.client.0.smithi002.stdout:3/539: write d9/d15/f42 [566818,73153] 0 2024-09-13T22:56:11.731 INFO:tasks.workunit.client.1.smithi047.stdout:7/577: creat d0/d19/fc2 x:0 0 0 2024-09-13T22:56:11.731 INFO:tasks.workunit.client.1.smithi047.stdout:7/578: stat d0/db/f50 0 2024-09-13T22:56:11.735 INFO:tasks.workunit.client.1.smithi047.stdout:9/522: getdents d1/dc/d14/dd/d54/d50/d5b/d9e 0 2024-09-13T22:56:11.738 INFO:tasks.workunit.client.0.smithi002.stdout:9/511: dwrite d8/d1e/f67 [0,4194304] 0 2024-09-13T22:56:11.741 INFO:tasks.workunit.client.1.smithi047.stdout:0/616: mknod d1/d5/d16/cc5 0 2024-09-13T22:56:11.743 INFO:tasks.workunit.client.1.smithi047.stdout:3/581: dwrite d0/d3/d4/d16/d1c/f82 [0,4194304] 0 2024-09-13T22:56:11.744 INFO:tasks.workunit.client.1.smithi047.stdout:4/655: creat dc/de/d23/dc4/ddb/fdc x:0 0 0 2024-09-13T22:56:11.745 INFO:tasks.workunit.client.1.smithi047.stdout:4/656: chown dc/de/d23/f64 17105268 1 2024-09-13T22:56:11.749 INFO:tasks.workunit.client.1.smithi047.stdout:9/523: write d1/dc/d14/dd/d54/f37 [1261470,8062] 0 2024-09-13T22:56:11.752 INFO:tasks.workunit.client.1.smithi047.stdout:9/524: stat d1/dc/d14/dd/d54/d50/d5b/d9e/f81 0 2024-09-13T22:56:11.755 INFO:tasks.workunit.client.1.smithi047.stdout:2/640: dwrite d1/d16/d40/d57/fbe [0,4194304] 0 2024-09-13T22:56:11.756 INFO:tasks.workunit.client.1.smithi047.stdout:9/525: dread - d1/dc/d14/dd/d54/d50/d60/f95 zero size 2024-09-13T22:56:11.758 INFO:tasks.workunit.client.1.smithi047.stdout:7/579: link d0/d7/da/d2e/fa0 d0/d7/da/d2e/d64/fc3 0 2024-09-13T22:56:11.759 INFO:tasks.workunit.client.1.smithi047.stdout:9/526: dread - d1/dc/d14/dd/d54/d4e/d51/d79/f7d zero size 2024-09-13T22:56:11.761 INFO:tasks.workunit.client.1.smithi047.stdout:9/527: dread - d1/dc/d14/dd/d4c/fa1 zero size 2024-09-13T22:56:11.766 INFO:tasks.workunit.client.0.smithi002.stdout:6/467: rename d12/d17/d34/f7b to d12/d17/d28/d67/d6b/f9d 0 2024-09-13T22:56:11.766 INFO:tasks.workunit.client.0.smithi002.stdout:6/468: chown l11 0 1 2024-09-13T22:56:11.767 INFO:tasks.workunit.client.1.smithi047.stdout:3/582: dread d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/f41 [0,4194304] 0 2024-09-13T22:56:11.767 INFO:tasks.workunit.client.1.smithi047.stdout:2/641: fsync d1/d16/d40/d57/f71 0 2024-09-13T22:56:11.769 INFO:tasks.workunit.client.0.smithi002.stdout:0/495: creat d1/d4/da3/fb5 x:0 0 0 2024-09-13T22:56:11.769 INFO:tasks.workunit.client.1.smithi047.stdout:2/642: read d1/df/d1d/d20/d29/f9b [3880245,24542] 0 2024-09-13T22:56:11.771 INFO:tasks.workunit.client.1.smithi047.stdout:2/643: dread d1/df/d1d/d2e/fa7 [0,4194304] 0 2024-09-13T22:56:11.772 INFO:tasks.workunit.client.1.smithi047.stdout:7/580: symlink d0/d57/d5b/d5c/lc4 0 2024-09-13T22:56:11.773 INFO:tasks.workunit.client.1.smithi047.stdout:0/617: write d1/d5/d16/d23/d2d/fa5 [177676,110082] 0 2024-09-13T22:56:11.774 INFO:tasks.workunit.client.1.smithi047.stdout:9/528: mknod d1/dc/d14/da5/ca7 0 2024-09-13T22:56:11.775 INFO:tasks.workunit.client.1.smithi047.stdout:9/529: chown d1/dc/d14/dd/d4c/c87 7163518 1 2024-09-13T22:56:11.776 INFO:tasks.workunit.client.0.smithi002.stdout:8/440: symlink d3/dc/d16/d2f/l86 0 2024-09-13T22:56:11.779 INFO:tasks.workunit.client.0.smithi002.stdout:2/455: creat d1/d7/d35/d3e/d59/d87/f99 x:0 0 0 2024-09-13T22:56:11.780 INFO:tasks.workunit.client.0.smithi002.stdout:8/441: dwrite d3/dc/d18/f23 [0,4194304] 0 2024-09-13T22:56:11.782 INFO:tasks.workunit.client.0.smithi002.stdout:5/461: rmdir d1/d2a 39 2024-09-13T22:56:11.785 INFO:tasks.workunit.client.0.smithi002.stdout:4/429: creat d3/d62/f81 x:0 0 0 2024-09-13T22:56:11.788 INFO:tasks.workunit.client.1.smithi047.stdout:2/644: creat d1/d16/fd8 x:0 0 0 2024-09-13T22:56:11.789 INFO:tasks.workunit.client.0.smithi002.stdout:3/540: creat d9/df/d71/fc8 x:0 0 0 2024-09-13T22:56:11.790 INFO:tasks.workunit.client.1.smithi047.stdout:4/657: dwrite dc/de/d17/d70/fb8 [0,4194304] 0 2024-09-13T22:56:11.791 INFO:tasks.workunit.client.0.smithi002.stdout:3/541: write d9/d3b/d7c/f9c [2648945,76103] 0 2024-09-13T22:56:11.792 INFO:tasks.workunit.client.0.smithi002.stdout:9/512: symlink d8/d10/d1c/d68/d74/lb2 0 2024-09-13T22:56:11.794 INFO:tasks.workunit.client.1.smithi047.stdout:4/658: write dc/de/d23/d40/d7b/dab/dae/fd5 [677042,25513] 0 2024-09-13T22:56:11.796 INFO:tasks.workunit.client.1.smithi047.stdout:0/618: unlink d1/d7/f18 0 2024-09-13T22:56:11.796 INFO:tasks.workunit.client.1.smithi047.stdout:7/581: dread d0/d7/da/d2e/d64/f6a [0,4194304] 0 2024-09-13T22:56:11.800 INFO:tasks.workunit.client.0.smithi002.stdout:7/407: rename d8/d9/d46/l6f to d8/d10/d11/d13/d2e/d50/d52/d58/l70 0 2024-09-13T22:56:11.802 INFO:tasks.workunit.client.0.smithi002.stdout:6/469: creat d12/d17/d34/d39/f9e x:0 0 0 2024-09-13T22:56:11.804 INFO:tasks.workunit.client.0.smithi002.stdout:0/496: creat d1/d4/d75/d31/d32/fb6 x:0 0 0 2024-09-13T22:56:11.806 INFO:tasks.workunit.client.0.smithi002.stdout:7/408: dwrite d8/d9/f1a [4194304,4194304] 0 2024-09-13T22:56:11.809 INFO:tasks.workunit.client.0.smithi002.stdout:7/409: truncate d8/d10/d11/d13/d26/d4c/f53 5031966 0 2024-09-13T22:56:11.809 INFO:tasks.workunit.client.0.smithi002.stdout:8/442: fsync d3/dc/d16/d60/f74 0 2024-09-13T22:56:11.809 INFO:tasks.workunit.client.1.smithi047.stdout:3/583: write d0/d3/d4/d16/d2c/de/f10 [625332,26185] 0 2024-09-13T22:56:11.815 INFO:tasks.workunit.client.1.smithi047.stdout:4/659: write dc/de/d23/f3b [666795,69907] 0 2024-09-13T22:56:11.816 INFO:tasks.workunit.client.0.smithi002.stdout:3/542: creat d9/d91/fc9 x:0 0 0 2024-09-13T22:56:11.817 INFO:tasks.workunit.client.1.smithi047.stdout:0/619: write d1/d5/d11/f35 [5004783,64065] 0 2024-09-13T22:56:11.818 INFO:tasks.workunit.client.1.smithi047.stdout:2/645: creat d1/de/d17/fd9 x:0 0 0 2024-09-13T22:56:11.820 INFO:tasks.workunit.client.0.smithi002.stdout:2/456: rename d1/c2f to d1/d7/d41/d96/c9a 0 2024-09-13T22:56:11.820 INFO:tasks.workunit.client.1.smithi047.stdout:2/646: chown d1/de/f25 118305 1 2024-09-13T22:56:11.821 INFO:tasks.workunit.client.0.smithi002.stdout:2/457: write d1/d7/d35/f48 [2344623,35655] 0 2024-09-13T22:56:11.822 INFO:tasks.workunit.client.1.smithi047.stdout:4/660: dwrite dc/de/d17/f1b [0,4194304] 0 2024-09-13T22:56:11.823 INFO:tasks.workunit.client.1.smithi047.stdout:7/582: mkdir d0/d7/dc5 0 2024-09-13T22:56:11.826 INFO:tasks.workunit.client.1.smithi047.stdout:0/620: mknod d1/d7/cc6 0 2024-09-13T22:56:11.827 INFO:tasks.workunit.client.0.smithi002.stdout:8/443: dread d3/dc/fe [0,4194304] 0 2024-09-13T22:56:11.827 INFO:tasks.workunit.client.0.smithi002.stdout:2/458: dwrite d1/d4d/f71 [0,4194304] 0 2024-09-13T22:56:11.832 INFO:tasks.workunit.client.1.smithi047.stdout:4/661: symlink dc/de/d23/d40/d7b/dab/ldd 0 2024-09-13T22:56:11.833 INFO:tasks.workunit.client.0.smithi002.stdout:2/459: dread d1/d7/d8/f27 [0,4194304] 0 2024-09-13T22:56:11.833 INFO:tasks.workunit.client.0.smithi002.stdout:7/410: symlink d8/d10/d11/d13/d2e/d50/l71 0 2024-09-13T22:56:11.834 INFO:tasks.workunit.client.1.smithi047.stdout:4/662: read dc/de/f18 [1915098,81068] 0 2024-09-13T22:56:11.834 INFO:tasks.workunit.client.1.smithi047.stdout:7/583: fsync d0/d7/fb9 0 2024-09-13T22:56:11.834 INFO:tasks.workunit.client.0.smithi002.stdout:6/470: write d12/f5c [49712,75450] 0 2024-09-13T22:56:11.835 INFO:tasks.workunit.client.0.smithi002.stdout:7/411: write d8/f5d [285596,74072] 0 2024-09-13T22:56:11.835 INFO:tasks.workunit.client.0.smithi002.stdout:2/460: chown d1/d4a/f77 27678681 1 2024-09-13T22:56:11.836 INFO:tasks.workunit.client.1.smithi047.stdout:7/584: chown d0/d7/da/d47/l7d 33775998 1 2024-09-13T22:56:11.837 INFO:tasks.workunit.client.0.smithi002.stdout:4/430: read d3/d40/f70 [2246057,34207] 0 2024-09-13T22:56:11.837 INFO:tasks.workunit.client.0.smithi002.stdout:6/471: dread - d12/d17/d34/d4b/f76 zero size 2024-09-13T22:56:11.838 INFO:tasks.workunit.client.0.smithi002.stdout:6/472: dread - d12/d17/d34/d39/f92 zero size 2024-09-13T22:56:11.840 INFO:tasks.workunit.client.0.smithi002.stdout:6/473: write d12/d17/d28/d67/d6b/f69 [514641,58566] 0 2024-09-13T22:56:11.844 INFO:tasks.workunit.client.1.smithi047.stdout:4/663: dwrite dc/de/d17/d70/fb8 [4194304,4194304] 0 2024-09-13T22:56:11.844 INFO:tasks.workunit.client.1.smithi047.stdout:0/621: creat d1/d5/d16/d23/d45/d84/fc7 x:0 0 0 2024-09-13T22:56:11.846 INFO:tasks.workunit.client.1.smithi047.stdout:7/585: dwrite d0/d7/da/d1e/f22 [0,4194304] 0 2024-09-13T22:56:11.846 INFO:tasks.workunit.client.1.smithi047.stdout:2/647: getdents d1/df/d1d/d2e 0 2024-09-13T22:56:11.846 INFO:tasks.workunit.client.0.smithi002.stdout:1/504: getdents d1/d13/d21/d40 0 2024-09-13T22:56:11.847 INFO:tasks.workunit.client.0.smithi002.stdout:6/474: dwrite d12/d17/d34/f6c [0,4194304] 0 2024-09-13T22:56:11.847 INFO:tasks.workunit.client.1.smithi047.stdout:0/622: fdatasync d1/d5/d11/f35 0 2024-09-13T22:56:11.853 INFO:tasks.workunit.client.1.smithi047.stdout:0/623: mknod d1/d7/cc8 0 2024-09-13T22:56:11.855 INFO:tasks.workunit.client.1.smithi047.stdout:4/664: mkdir dc/d29/d8e/dda/dde 0 2024-09-13T22:56:11.855 INFO:tasks.workunit.client.1.smithi047.stdout:4/665: fsync dc/de/db9/fd9 0 2024-09-13T22:56:11.857 INFO:tasks.workunit.client.0.smithi002.stdout:6/475: dwrite f1 [0,4194304] 0 2024-09-13T22:56:11.858 INFO:tasks.workunit.client.1.smithi047.stdout:0/624: mkdir d1/d7/dc9 0 2024-09-13T22:56:11.859 INFO:tasks.workunit.client.0.smithi002.stdout:6/476: write d12/f14 [8766030,103194] 0 2024-09-13T22:56:11.859 INFO:tasks.workunit.client.0.smithi002.stdout:5/462: getdents d1/d2a/d6b/d88/d45/d4f/d99 0 2024-09-13T22:56:11.859 INFO:tasks.workunit.client.1.smithi047.stdout:7/586: creat d0/d7/fc6 x:0 0 0 2024-09-13T22:56:11.860 INFO:tasks.workunit.client.1.smithi047.stdout:7/587: chown d0/d7/f3e 4032861 1 2024-09-13T22:56:11.861 INFO:tasks.workunit.client.1.smithi047.stdout:4/666: mkdir dc/de/d23/ddf 0 2024-09-13T22:56:11.864 INFO:tasks.workunit.client.0.smithi002.stdout:3/543: symlink d9/d15/d36/d4e/d5e/dae/d89/lca 0 2024-09-13T22:56:11.869 INFO:tasks.workunit.client.0.smithi002.stdout:3/544: stat d9/df/l87 0 2024-09-13T22:56:11.870 INFO:tasks.workunit.client.0.smithi002.stdout:9/513: rename d8/d10/f62 to d8/d10/d1c/d3d/fb3 0 2024-09-13T22:56:11.870 INFO:tasks.workunit.client.0.smithi002.stdout:6/477: dread f5 [0,4194304] 0 2024-09-13T22:56:11.870 INFO:tasks.workunit.client.0.smithi002.stdout:9/514: fsync d8/d1e/f41 0 2024-09-13T22:56:11.871 INFO:tasks.workunit.client.1.smithi047.stdout:4/667: dwrite dc/de/d23/f55 [0,4194304] 0 2024-09-13T22:56:11.871 INFO:tasks.workunit.client.0.smithi002.stdout:1/505: symlink d1/d13/d30/d31/d3b/la4 0 2024-09-13T22:56:11.873 INFO:tasks.workunit.client.0.smithi002.stdout:8/444: symlink d3/dc/d16/l87 0 2024-09-13T22:56:11.875 INFO:tasks.workunit.client.1.smithi047.stdout:4/668: dread dc/de/d23/f55 [0,4194304] 0 2024-09-13T22:56:11.876 INFO:tasks.workunit.client.0.smithi002.stdout:7/412: truncate f1 1529524 0 2024-09-13T22:56:11.876 INFO:tasks.workunit.client.1.smithi047.stdout:4/669: chown f4 7982 1 2024-09-13T22:56:11.877 INFO:tasks.workunit.client.1.smithi047.stdout:4/670: dread - dc/d29/d6c/fb7 zero size 2024-09-13T22:56:11.880 INFO:tasks.workunit.client.0.smithi002.stdout:5/463: creat d1/d2a/d69/fa4 x:0 0 0 2024-09-13T22:56:11.880 INFO:tasks.workunit.client.1.smithi047.stdout:4/671: symlink dc/de/d23/dc4/dc8/le0 0 2024-09-13T22:56:11.881 INFO:tasks.workunit.client.0.smithi002.stdout:5/464: dread - d1/d2a/d6b/d88/d55/d56/d81/f82 zero size 2024-09-13T22:56:11.882 INFO:tasks.workunit.client.0.smithi002.stdout:4/431: mknod d3/d14/d25/d5e/c82 0 2024-09-13T22:56:11.882 INFO:tasks.workunit.client.0.smithi002.stdout:3/545: symlink d9/d15/d26/lcb 0 2024-09-13T22:56:11.885 INFO:tasks.workunit.client.0.smithi002.stdout:2/461: rename d1/d4a/f77 to d1/d7/d35/d3e/d59/d6b/d75/f9b 0 2024-09-13T22:56:11.887 INFO:tasks.workunit.client.0.smithi002.stdout:4/432: dread d3/d14/d29/d2a/d30/f6b [0,4194304] 0 2024-09-13T22:56:11.888 INFO:tasks.workunit.client.0.smithi002.stdout:4/433: write d3/d14/d25/d5e/f65 [323613,61759] 0 2024-09-13T22:56:11.889 INFO:tasks.workunit.client.0.smithi002.stdout:6/478: write d12/d17/d28/f2e [11400628,117637] 0 2024-09-13T22:56:11.889 INFO:tasks.workunit.client.0.smithi002.stdout:4/434: chown d3/d14/d29/l3c 90 1 2024-09-13T22:56:11.891 INFO:tasks.workunit.client.1.smithi047.stdout:4/672: rename dc/de/d23/d40/d7b/dab/cb3 to dc/de/d17/d25/d4a/ce1 0 2024-09-13T22:56:11.894 INFO:tasks.workunit.client.0.smithi002.stdout:0/497: getdents d1/d4/d75/d31 0 2024-09-13T22:56:11.894 INFO:tasks.workunit.client.0.smithi002.stdout:0/498: write d1/d4/da3/fb5 [446472,30731] 0 2024-09-13T22:56:11.899 INFO:tasks.workunit.client.1.smithi047.stdout:7/588: dwrite d0/db/f50 [0,4194304] 0 2024-09-13T22:56:11.901 INFO:tasks.workunit.client.0.smithi002.stdout:5/465: creat d1/d2a/d6b/d88/d55/d56/d81/fa5 x:0 0 0 2024-09-13T22:56:11.909 INFO:tasks.workunit.client.0.smithi002.stdout:3/546: unlink d9/d15/d26/lcb 0 2024-09-13T22:56:11.909 INFO:tasks.workunit.client.0.smithi002.stdout:3/547: chown d9/d15/d35 0 1 2024-09-13T22:56:11.909 INFO:tasks.workunit.client.1.smithi047.stdout:4/673: dread dc/de/f52 [0,4194304] 0 2024-09-13T22:56:11.910 INFO:tasks.workunit.client.0.smithi002.stdout:7/413: dread d8/d10/d11/d13/d26/f3f [0,4194304] 0 2024-09-13T22:56:11.913 INFO:tasks.workunit.client.0.smithi002.stdout:2/462: rename d1/d7/d8/f1a to d1/d32/d37/f9c 0 2024-09-13T22:56:11.917 INFO:tasks.workunit.client.0.smithi002.stdout:2/463: dwrite d1/f14 [0,4194304] 0 2024-09-13T22:56:11.918 INFO:tasks.workunit.client.0.smithi002.stdout:6/479: unlink d12/d17/f81 0 2024-09-13T22:56:11.918 INFO:tasks.workunit.client.0.smithi002.stdout:2/464: fdatasync d1/d7/d8/f1e 0 2024-09-13T22:56:11.919 INFO:tasks.workunit.client.0.smithi002.stdout:6/480: dread - d12/d17/d34/d4b/f68 zero size 2024-09-13T22:56:11.920 INFO:tasks.workunit.client.1.smithi047.stdout:4/674: dwrite dc/de/f18 [0,4194304] 0 2024-09-13T22:56:11.920 INFO:tasks.workunit.client.0.smithi002.stdout:4/435: creat d3/d14/d25/d69/f83 x:0 0 0 2024-09-13T22:56:11.921 INFO:tasks.workunit.client.1.smithi047.stdout:1/530: sync 2024-09-13T22:56:11.921 INFO:tasks.workunit.client.1.smithi047.stdout:6/607: sync 2024-09-13T22:56:11.921 INFO:tasks.workunit.client.1.smithi047.stdout:8/547: sync 2024-09-13T22:56:11.927 INFO:tasks.workunit.client.0.smithi002.stdout:8/445: write d3/dc/fe [3676978,52929] 0 2024-09-13T22:56:11.928 INFO:tasks.workunit.client.1.smithi047.stdout:4/675: symlink dc/de/d23/d40/d7b/dab/le2 0 2024-09-13T22:56:11.931 INFO:tasks.workunit.client.0.smithi002.stdout:5/466: creat d1/d2a/d5a/fa6 x:0 0 0 2024-09-13T22:56:11.931 INFO:tasks.workunit.client.1.smithi047.stdout:4/676: write dc/de/d17/d25/d9b/fbf [2895394,69821] 0 2024-09-13T22:56:11.933 INFO:tasks.workunit.client.1.smithi047.stdout:4/677: chown dc/de/d23/d40/d7b/d90/da6/fd6 1432186901 1 2024-09-13T22:56:11.933 INFO:tasks.workunit.client.0.smithi002.stdout:5/467: truncate d1/d2a/d69/fa4 262740 0 2024-09-13T22:56:11.939 INFO:tasks.workunit.client.1.smithi047.stdout:7/589: write d0/d7/da/d2e/d64/f8e [385318,85375] 0 2024-09-13T22:56:11.950 INFO:tasks.workunit.client.0.smithi002.stdout:1/506: sync 2024-09-13T22:56:11.950 INFO:tasks.workunit.client.1.smithi047.stdout:1/531: getdents d0/d7/d13/d5d/d89 0 2024-09-13T22:56:11.950 INFO:tasks.workunit.client.0.smithi002.stdout:1/507: chown d1/d13/d1d/f6c 119 1 2024-09-13T22:56:11.953 INFO:tasks.workunit.client.1.smithi047.stdout:7/590: unlink d0/d7/da/d4e/l56 0 2024-09-13T22:56:11.954 INFO:tasks.workunit.client.1.smithi047.stdout:8/548: dwrite d8/f2b [0,4194304] 0 2024-09-13T22:56:11.954 INFO:tasks.workunit.client.0.smithi002.stdout:2/465: mkdir d1/d7/d8/d2c/d9d 0 2024-09-13T22:56:11.956 INFO:tasks.workunit.client.0.smithi002.stdout:6/481: rmdir d12/d17/d28/d67/d6b 39 2024-09-13T22:56:11.956 INFO:tasks.workunit.client.0.smithi002.stdout:2/466: write d1/d7/d35/d3e/d59/f64 [2604593,38902] 0 2024-09-13T22:56:11.961 INFO:tasks.workunit.client.0.smithi002.stdout:6/482: dread d12/f74 [0,4194304] 0 2024-09-13T22:56:11.961 INFO:tasks.workunit.client.0.smithi002.stdout:2/467: dread d1/f5 [4194304,4194304] 0 2024-09-13T22:56:11.962 INFO:tasks.workunit.client.0.smithi002.stdout:2/468: fsync d1/d7/d8/d51/f5a 0 2024-09-13T22:56:11.963 INFO:tasks.workunit.client.0.smithi002.stdout:2/469: fsync d1/d7/d41/d96/f97 0 2024-09-13T22:56:11.964 INFO:tasks.workunit.client.0.smithi002.stdout:2/470: fsync d1/f14 0 2024-09-13T22:56:11.965 INFO:tasks.workunit.client.0.smithi002.stdout:8/446: creat d3/dc/d51/d6e/f88 x:0 0 0 2024-09-13T22:56:11.965 INFO:tasks.workunit.client.0.smithi002.stdout:8/447: stat d3/dc/f13 0 2024-09-13T22:56:11.966 INFO:tasks.workunit.client.0.smithi002.stdout:5/468: mkdir d1/d2a/d6b/d88/d45/d4f/da7 0 2024-09-13T22:56:11.969 INFO:tasks.workunit.client.0.smithi002.stdout:0/499: truncate d1/d2/f6d 3852390 0 2024-09-13T22:56:11.975 INFO:tasks.workunit.client.0.smithi002.stdout:4/436: unlink d3/d14/f2b 0 2024-09-13T22:56:11.976 INFO:tasks.workunit.client.0.smithi002.stdout:9/515: getdents d8/d10/d1c/d68/d74 0 2024-09-13T22:56:11.978 INFO:tasks.workunit.client.0.smithi002.stdout:7/414: write d8/fb [1546577,46466] 0 2024-09-13T22:56:11.981 INFO:tasks.workunit.client.0.smithi002.stdout:5/469: dread d1/d2a/d6b/d88/d45/f97 [0,4194304] 0 2024-09-13T22:56:11.982 INFO:tasks.workunit.client.0.smithi002.stdout:8/448: fdatasync d3/d21/f5b 0 2024-09-13T22:56:11.983 INFO:tasks.workunit.client.0.smithi002.stdout:3/548: link d9/d15/d36/d4e/f8b d9/d15/d51/fcc 0 2024-09-13T22:56:11.985 INFO:tasks.workunit.client.0.smithi002.stdout:8/449: stat d3/dc/d51/f4c 0 2024-09-13T22:56:11.986 INFO:tasks.workunit.client.0.smithi002.stdout:8/450: chown d3/d27/l63 238 1 2024-09-13T22:56:11.987 INFO:tasks.workunit.client.0.smithi002.stdout:1/508: dwrite d1/d13/d1d/f6c [4194304,4194304] 0 2024-09-13T22:56:11.987 INFO:tasks.workunit.client.0.smithi002.stdout:2/471: dread d1/d7/d8/f27 [4194304,4194304] 0 2024-09-13T22:56:11.991 INFO:tasks.workunit.client.0.smithi002.stdout:9/516: unlink d8/c7a 0 2024-09-13T22:56:11.992 INFO:tasks.workunit.client.0.smithi002.stdout:6/483: mkdir d12/d17/d28/d67/d9f 0 2024-09-13T22:56:11.993 INFO:tasks.workunit.client.0.smithi002.stdout:7/415: mkdir d8/d10/d11/d13/d2e/d50/d52/d72 0 2024-09-13T22:56:11.994 INFO:tasks.workunit.client.0.smithi002.stdout:6/484: write d12/d17/f4a [10442068,25084] 0 2024-09-13T22:56:11.995 INFO:tasks.workunit.client.0.smithi002.stdout:5/470: mknod d1/d2a/d6b/d88/d45/d4f/d78/d8b/ca8 0 2024-09-13T22:56:11.996 INFO:tasks.workunit.client.0.smithi002.stdout:3/549: creat d9/d15/d36/d4e/fcd x:0 0 0 2024-09-13T22:56:11.996 INFO:tasks.workunit.client.0.smithi002.stdout:2/472: dwrite d1/d7/d35/d3e/d5e/f76 [0,4194304] 0 2024-09-13T22:56:11.997 INFO:tasks.workunit.client.0.smithi002.stdout:3/550: stat d9/d15/d35/f96 0 2024-09-13T22:56:11.998 INFO:tasks.workunit.client.0.smithi002.stdout:8/451: chown d3/d21/d57/l4e 44 1 2024-09-13T22:56:12.001 INFO:tasks.workunit.client.0.smithi002.stdout:9/517: read d8/d1e/f3a [639140,122706] 0 2024-09-13T22:56:12.002 INFO:tasks.workunit.client.0.smithi002.stdout:7/416: mknod d8/d9/c73 0 2024-09-13T22:56:12.003 INFO:tasks.workunit.client.0.smithi002.stdout:9/518: dread - d8/d91/d96/f8b zero size 2024-09-13T22:56:12.006 INFO:tasks.workunit.client.0.smithi002.stdout:2/473: creat d1/d7/d41/d96/f9e x:0 0 0 2024-09-13T22:56:12.007 INFO:tasks.workunit.client.0.smithi002.stdout:5/471: creat d1/d2a/d6b/d88/d45/d4f/d8f/fa9 x:0 0 0 2024-09-13T22:56:12.009 INFO:tasks.workunit.client.0.smithi002.stdout:3/551: unlink d9/d15/d46/f6f 0 2024-09-13T22:56:12.010 INFO:tasks.workunit.client.0.smithi002.stdout:1/509: unlink d1/d13/d1d/c1f 0 2024-09-13T22:56:12.011 INFO:tasks.workunit.client.0.smithi002.stdout:0/500: truncate d1/d4/d75/d31/d32/fa7 22578 0 2024-09-13T22:56:12.014 INFO:tasks.workunit.client.0.smithi002.stdout:7/417: rename d8/d9/c73 to d8/d10/d11/d13/d26/d38/c74 0 2024-09-13T22:56:12.014 INFO:tasks.workunit.client.1.smithi047.stdout:7/591: read d0/d7/da/d1e/f68 [3383033,108828] 0 2024-09-13T22:56:12.014 INFO:tasks.workunit.client.1.smithi047.stdout:6/608: write d3/d11/d2b/d4c/d30/f47 [1334616,115355] 0 2024-09-13T22:56:12.015 INFO:tasks.workunit.client.0.smithi002.stdout:6/485: write d12/d17/d2a/f32 [4035850,57399] 0 2024-09-13T22:56:12.015 INFO:tasks.workunit.client.1.smithi047.stdout:4/678: write f4 [266618,7445] 0 2024-09-13T22:56:12.017 INFO:tasks.workunit.client.1.smithi047.stdout:1/532: chown d0/d1d/c23 3 1 2024-09-13T22:56:12.017 INFO:tasks.workunit.client.1.smithi047.stdout:6/609: fdatasync d3/d11/d2b/d4c/d30/f91 0 2024-09-13T22:56:12.018 INFO:tasks.workunit.client.0.smithi002.stdout:8/452: mkdir d3/dc/d16/d89 0 2024-09-13T22:56:12.018 INFO:tasks.workunit.client.0.smithi002.stdout:3/552: dwrite d9/d15/f42 [0,4194304] 0 2024-09-13T22:56:12.018 INFO:tasks.workunit.client.0.smithi002.stdout:6/486: read fd [612797,45060] 0 2024-09-13T22:56:12.020 INFO:tasks.workunit.client.0.smithi002.stdout:7/418: chown d8/d10/d11/d13/d26/d4c 2000 1 2024-09-13T22:56:12.021 INFO:tasks.workunit.client.0.smithi002.stdout:0/501: mknod d1/d7e/d9d/cb7 0 2024-09-13T22:56:12.021 INFO:tasks.workunit.client.0.smithi002.stdout:4/437: dwrite d3/f24 [0,4194304] 0 2024-09-13T22:56:12.023 INFO:tasks.workunit.client.0.smithi002.stdout:1/510: dread d1/d13/d21/f8c [0,4194304] 0 2024-09-13T22:56:12.023 INFO:tasks.workunit.client.0.smithi002.stdout:2/474: mknod d1/d7/d8/d4f/c9f 0 2024-09-13T22:56:12.023 INFO:tasks.workunit.client.1.smithi047.stdout:8/549: dwrite d8/f2b [0,4194304] 0 2024-09-13T22:56:12.027 INFO:tasks.workunit.client.1.smithi047.stdout:7/592: unlink d0/d7/da/d47/l63 0 2024-09-13T22:56:12.030 INFO:tasks.workunit.client.0.smithi002.stdout:1/511: dwrite d1/d13/d52/f95 [0,4194304] 0 2024-09-13T22:56:12.034 INFO:tasks.workunit.client.0.smithi002.stdout:1/512: write d1/d13/d30/f53 [1159877,47820] 0 2024-09-13T22:56:12.034 INFO:tasks.workunit.client.0.smithi002.stdout:2/475: dwrite d1/d7/d8/d2c/f4e [0,4194304] 0 2024-09-13T22:56:12.038 INFO:tasks.workunit.client.0.smithi002.stdout:2/476: chown d1/d7/d8/f1b 15496236 1 2024-09-13T22:56:12.038 INFO:tasks.workunit.client.0.smithi002.stdout:8/453: creat d3/d27/f8a x:0 0 0 2024-09-13T22:56:12.040 INFO:tasks.workunit.client.0.smithi002.stdout:2/477: chown d1/d7/d35/d3e/d59/f64 20 1 2024-09-13T22:56:12.042 INFO:tasks.workunit.client.0.smithi002.stdout:8/454: read d3/dc/d18/f67 [2161079,82243] 0 2024-09-13T22:56:12.046 INFO:tasks.workunit.client.0.smithi002.stdout:0/502: unlink d1/d2/d6c/f91 0 2024-09-13T22:56:12.046 INFO:tasks.workunit.client.1.smithi047.stdout:8/550: write d8/d64/d4e/d4d/d8f/d91/d38/f45 [8652481,116576] 0 2024-09-13T22:56:12.047 INFO:tasks.workunit.client.0.smithi002.stdout:0/503: chown d1/d4/d75/d76 66 1 2024-09-13T22:56:12.050 INFO:tasks.workunit.client.0.smithi002.stdout:8/455: dwrite d3/f36 [4194304,4194304] 0 2024-09-13T22:56:12.051 INFO:tasks.workunit.client.0.smithi002.stdout:4/438: creat d3/d14/d25/f84 x:0 0 0 2024-09-13T22:56:12.054 INFO:tasks.workunit.client.0.smithi002.stdout:6/487: rename d12/d17/d28/d67/f70 to d12/d17/d34/d4b/fa0 0 2024-09-13T22:56:12.054 INFO:tasks.workunit.client.0.smithi002.stdout:2/478: dread d1/d32/d37/d79/f84 [0,4194304] 0 2024-09-13T22:56:12.061 INFO:tasks.workunit.client.0.smithi002.stdout:1/513: symlink d1/d13/d30/d31/d3d/la5 0 2024-09-13T22:56:12.062 INFO:tasks.workunit.client.1.smithi047.stdout:4/679: link dc/d29/f61 dc/de/d23/d40/d7b/d90/fe3 0 2024-09-13T22:56:12.063 INFO:tasks.workunit.client.1.smithi047.stdout:6/610: link d3/d11/d2b/d1c/d23/f39 d3/d11/d2b/d4c/fcc 0 2024-09-13T22:56:12.065 INFO:tasks.workunit.client.0.smithi002.stdout:3/553: unlink d9/d15/d36/d4e/f50 0 2024-09-13T22:56:12.072 INFO:tasks.workunit.client.0.smithi002.stdout:0/504: fdatasync d1/d2/d81/d8f/f5d 0 2024-09-13T22:56:12.072 INFO:tasks.workunit.client.0.smithi002.stdout:0/505: chown d1/d4/d75/d31/d32/f50 1529804328 1 2024-09-13T22:56:12.073 INFO:tasks.workunit.client.1.smithi047.stdout:7/593: write d0/d57/d5b/d8b/fbd [129,97172] 0 2024-09-13T22:56:12.073 INFO:tasks.workunit.client.1.smithi047.stdout:4/680: creat dc/d29/fe4 x:0 0 0 2024-09-13T22:56:12.074 INFO:tasks.workunit.client.1.smithi047.stdout:1/533: truncate d0/d7/f64 1049112 0 2024-09-13T22:56:12.076 INFO:tasks.workunit.client.0.smithi002.stdout:4/439: unlink d3/d14/d25/f5a 0 2024-09-13T22:56:12.078 INFO:tasks.workunit.client.1.smithi047.stdout:8/551: write d8/d64/d4e/d4d/d8f/d91/f3d [335615,5911] 0 2024-09-13T22:56:12.080 INFO:tasks.workunit.client.1.smithi047.stdout:7/594: dwrite d0/d7/da/d47/fa1 [0,4194304] 0 2024-09-13T22:56:12.082 INFO:tasks.workunit.client.1.smithi047.stdout:6/611: dread d3/d11/d2b/d4c/fcc [0,4194304] 0 2024-09-13T22:56:12.082 INFO:tasks.workunit.client.0.smithi002.stdout:6/488: mknod d12/d17/d34/d39/ca1 0 2024-09-13T22:56:12.085 INFO:tasks.workunit.client.1.smithi047.stdout:6/612: read d3/d11/d2b/d4c/d30/d48/f4e [662948,70960] 0 2024-09-13T22:56:12.086 INFO:tasks.workunit.client.1.smithi047.stdout:4/681: mknod dc/de/d23/d40/d7b/dab/ce5 0 2024-09-13T22:56:12.090 INFO:tasks.workunit.client.0.smithi002.stdout:2/479: dwrite d1/d7/d35/d3e/d59/f90 [0,4194304] 0 2024-09-13T22:56:12.091 INFO:tasks.workunit.client.1.smithi047.stdout:1/534: mknod d0/d7/d14/d57/d62/d76/c93 0 2024-09-13T22:56:12.095 INFO:tasks.workunit.client.0.smithi002.stdout:3/554: mkdir d9/d7e/dce 0 2024-09-13T22:56:12.100 INFO:tasks.workunit.client.1.smithi047.stdout:6/613: mkdir d3/d11/d2b/d1c/d4d/d69/dc2/dcd 0 2024-09-13T22:56:12.103 INFO:tasks.workunit.client.0.smithi002.stdout:2/480: dread d1/d7/d35/f43 [0,4194304] 0 2024-09-13T22:56:12.103 INFO:tasks.workunit.client.1.smithi047.stdout:6/614: read d3/d11/d2b/d1c/d4d/f84 [1963065,33804] 0 2024-09-13T22:56:12.104 INFO:tasks.workunit.client.1.smithi047.stdout:4/682: rename dc/de/d23/f64 to dc/de/d23/dc4/dc8/fe6 0 2024-09-13T22:56:12.104 INFO:tasks.workunit.client.1.smithi047.stdout:6/615: dread - d3/d11/d2b/d1c/dbf/fbe zero size 2024-09-13T22:56:12.107 INFO:tasks.workunit.client.0.smithi002.stdout:8/456: mkdir d3/dc/d8b 0 2024-09-13T22:56:12.107 INFO:tasks.workunit.client.1.smithi047.stdout:6/616: truncate d3/fa5 688606 0 2024-09-13T22:56:12.107 INFO:tasks.workunit.client.1.smithi047.stdout:6/617: fdatasync d3/d11/f3f 0 2024-09-13T22:56:12.110 INFO:tasks.workunit.client.1.smithi047.stdout:6/618: stat d3/d11/d2b/d1c/d4d/d69/fb1 0 2024-09-13T22:56:12.110 INFO:tasks.workunit.client.1.smithi047.stdout:7/595: symlink d0/d7/da/d1e/d93/db7/lc7 0 2024-09-13T22:56:12.113 INFO:tasks.workunit.client.1.smithi047.stdout:4/683: dwrite dc/de/d17/d25/d9b/fbf [0,4194304] 0 2024-09-13T22:56:12.113 INFO:tasks.workunit.client.1.smithi047.stdout:1/535: write d0/d7/db/f38 [5377527,1669] 0 2024-09-13T22:56:12.114 INFO:tasks.workunit.client.0.smithi002.stdout:3/555: dread d9/df/f23 [0,4194304] 0 2024-09-13T22:56:12.116 INFO:tasks.workunit.client.0.smithi002.stdout:3/556: read d9/d15/d36/f38 [1920381,71897] 0 2024-09-13T22:56:12.117 INFO:tasks.workunit.client.0.smithi002.stdout:5/472: sync 2024-09-13T22:56:12.117 INFO:tasks.workunit.client.0.smithi002.stdout:9/519: sync 2024-09-13T22:56:12.118 INFO:tasks.workunit.client.0.smithi002.stdout:5/473: fdatasync d1/d10/f51 0 2024-09-13T22:56:12.119 INFO:tasks.workunit.client.0.smithi002.stdout:6/489: rename d12/d17/d34/f6c to d12/d17/d28/d7d/fa2 0 2024-09-13T22:56:12.119 INFO:tasks.workunit.client.0.smithi002.stdout:8/457: dread d3/dc/d16/f50 [0,4194304] 0 2024-09-13T22:56:12.120 INFO:tasks.workunit.client.0.smithi002.stdout:8/458: chown d3/f61 570518 1 2024-09-13T22:56:12.125 INFO:tasks.workunit.client.0.smithi002.stdout:2/481: dread d1/f18 [0,4194304] 0 2024-09-13T22:56:12.125 INFO:tasks.workunit.client.0.smithi002.stdout:1/514: mknod d1/d13/d30/d31/d3d/d5d/d8e/ca6 0 2024-09-13T22:56:12.126 INFO:tasks.workunit.client.1.smithi047.stdout:8/552: dwrite d8/f1e [0,4194304] 0 2024-09-13T22:56:12.129 INFO:tasks.workunit.client.0.smithi002.stdout:2/482: fsync d1/d7/d8/f33 0 2024-09-13T22:56:12.131 INFO:tasks.workunit.client.0.smithi002.stdout:1/515: dread - d1/d13/d30/d31/d3d/f8b zero size 2024-09-13T22:56:12.132 INFO:tasks.workunit.client.0.smithi002.stdout:5/474: dwrite d1/d2a/d5a/fa6 [0,4194304] 0 2024-09-13T22:56:12.133 INFO:tasks.workunit.client.0.smithi002.stdout:3/557: dread d9/d15/d51/f18 [0,4194304] 0 2024-09-13T22:56:12.134 INFO:tasks.workunit.client.0.smithi002.stdout:0/506: unlink d1/d2/c72 0 2024-09-13T22:56:12.135 INFO:tasks.workunit.client.0.smithi002.stdout:4/440: mkdir d3/d14/d85 0 2024-09-13T22:56:12.135 INFO:tasks.workunit.client.0.smithi002.stdout:8/459: dwrite d3/fa [0,4194304] 0 2024-09-13T22:56:12.137 INFO:tasks.workunit.client.0.smithi002.stdout:5/475: write d1/d2a/d6b/d88/f70 [200721,29357] 0 2024-09-13T22:56:12.138 INFO:tasks.workunit.client.0.smithi002.stdout:7/419: link d8/d9/l2f d8/d10/d11/d13/d26/l75 0 2024-09-13T22:56:12.138 INFO:tasks.workunit.client.0.smithi002.stdout:3/558: read - d9/d3b/da5/fbf zero size 2024-09-13T22:56:12.138 INFO:tasks.workunit.client.0.smithi002.stdout:0/507: readlink d1/d4/d75/d31/l66 0 2024-09-13T22:56:12.140 INFO:tasks.workunit.client.0.smithi002.stdout:9/520: unlink d8/fa9 0 2024-09-13T22:56:12.140 INFO:tasks.workunit.client.0.smithi002.stdout:7/420: stat d8/d10/d11 0 2024-09-13T22:56:12.142 INFO:tasks.workunit.client.1.smithi047.stdout:6/619: dwrite d3/d11/d2b/d4c/d30/d48/f4e [0,4194304] 0 2024-09-13T22:56:12.142 INFO:tasks.workunit.client.0.smithi002.stdout:3/559: dread - d9/d91/f97 zero size 2024-09-13T22:56:12.144 INFO:tasks.workunit.client.0.smithi002.stdout:1/516: dread d1/f24 [0,4194304] 0 2024-09-13T22:56:12.145 INFO:tasks.workunit.client.1.smithi047.stdout:1/536: dread d0/d7/d10/f6c [0,4194304] 0 2024-09-13T22:56:12.149 INFO:tasks.workunit.client.1.smithi047.stdout:1/537: fdatasync d0/d7/db/f58 0 2024-09-13T22:56:12.149 INFO:tasks.workunit.client.0.smithi002.stdout:0/508: dwrite d1/d4/d75/d31/d32/f50 [4194304,4194304] 0 2024-09-13T22:56:12.153 INFO:tasks.workunit.client.1.smithi047.stdout:8/553: unlink d8/d64/d4e/d4d/d8f/lae 0 2024-09-13T22:56:12.154 INFO:tasks.workunit.client.1.smithi047.stdout:6/620: dwrite d3/d11/d2b/d4c/dc0/fbc [0,4194304] 0 2024-09-13T22:56:12.156 INFO:tasks.workunit.client.1.smithi047.stdout:6/621: chown d3/d11/f6b 19 1 2024-09-13T22:56:12.156 INFO:tasks.workunit.client.1.smithi047.stdout:7/596: creat d0/d7/fc8 x:0 0 0 2024-09-13T22:56:12.159 INFO:tasks.workunit.client.0.smithi002.stdout:9/521: dwrite d8/d2c/f58 [0,4194304] 0 2024-09-13T22:56:12.163 INFO:tasks.workunit.client.0.smithi002.stdout:8/460: symlink d3/d21/d57/l8c 0 2024-09-13T22:56:12.163 INFO:tasks.workunit.client.1.smithi047.stdout:6/622: creat d3/d11/d2b/d1c/fce x:0 0 0 2024-09-13T22:56:12.164 INFO:tasks.workunit.client.1.smithi047.stdout:6/623: chown d3/d77/d93/f9a 186307 1 2024-09-13T22:56:12.164 INFO:tasks.workunit.client.0.smithi002.stdout:8/461: write d3/f61 [1708989,5738] 0 2024-09-13T22:56:12.165 INFO:tasks.workunit.client.1.smithi047.stdout:7/597: symlink d0/d57/lc9 0 2024-09-13T22:56:12.165 INFO:tasks.workunit.client.1.smithi047.stdout:6/624: chown d3/d11/d2b/d7c/l95 1412186302 1 2024-09-13T22:56:12.167 INFO:tasks.workunit.client.1.smithi047.stdout:6/625: fdatasync d3/d11/d2b/d1c/fce 0 2024-09-13T22:56:12.168 INFO:tasks.workunit.client.1.smithi047.stdout:6/626: fdatasync d3/d11/d2b/d1c/f1e 0 2024-09-13T22:56:12.172 INFO:tasks.workunit.client.0.smithi002.stdout:5/476: dwrite d1/d2a/d6b/d88/d45/f61 [0,4194304] 0 2024-09-13T22:56:12.175 INFO:tasks.workunit.client.0.smithi002.stdout:6/490: rmdir d12/d17/d28/d67/d6b 39 2024-09-13T22:56:12.176 INFO:tasks.workunit.client.1.smithi047.stdout:6/627: mknod d3/d77/d8f/ccf 0 2024-09-13T22:56:12.178 INFO:tasks.workunit.client.1.smithi047.stdout:6/628: write d3/d11/d2b/d1c/f20 [3835405,47460] 0 2024-09-13T22:56:12.180 INFO:tasks.workunit.client.1.smithi047.stdout:1/538: fdatasync d0/d7/f64 0 2024-09-13T22:56:12.188 INFO:tasks.workunit.client.1.smithi047.stdout:4/684: dwrite dc/da3/fd2 [0,4194304] 0 2024-09-13T22:56:12.190 INFO:tasks.workunit.client.0.smithi002.stdout:2/483: write d1/f95 [268667,85802] 0 2024-09-13T22:56:12.192 INFO:tasks.workunit.client.1.smithi047.stdout:1/539: fdatasync d0/d7/f64 0 2024-09-13T22:56:12.195 INFO:tasks.workunit.client.0.smithi002.stdout:7/421: dread d8/d10/d11/d13/d2e/d3c/f48 [0,4194304] 0 2024-09-13T22:56:12.195 INFO:tasks.workunit.client.1.smithi047.stdout:6/629: dwrite d3/d11/d2b/d76/fa2 [0,4194304] 0 2024-09-13T22:56:12.196 INFO:tasks.workunit.client.0.smithi002.stdout:7/422: fsync d8/d9/f57 0 2024-09-13T22:56:12.197 INFO:tasks.workunit.client.0.smithi002.stdout:0/509: dread d1/d4/f21 [0,4194304] 0 2024-09-13T22:56:12.199 INFO:tasks.workunit.client.0.smithi002.stdout:9/522: unlink d8/l4a 0 2024-09-13T22:56:12.200 INFO:tasks.workunit.client.0.smithi002.stdout:9/523: dread - d8/d10/d1c/fb0 zero size 2024-09-13T22:56:12.201 INFO:tasks.workunit.client.0.smithi002.stdout:4/441: mkdir d3/d14/d86 0 2024-09-13T22:56:12.201 INFO:tasks.workunit.client.0.smithi002.stdout:9/524: write d8/d10/d42/f7f [3881764,28782] 0 2024-09-13T22:56:12.203 INFO:tasks.workunit.client.1.smithi047.stdout:8/554: truncate d8/d64/d4e/d70/f93 4603178 0 2024-09-13T22:56:12.207 INFO:tasks.workunit.client.1.smithi047.stdout:1/540: mkdir d0/d7/d14/d57/d62/d76/d94 0 2024-09-13T22:56:12.208 INFO:tasks.workunit.client.1.smithi047.stdout:1/541: truncate d0/d7/db/f8b 239960 0 2024-09-13T22:56:12.215 INFO:tasks.workunit.client.1.smithi047.stdout:4/685: unlink dc/d29/d6c/ccd 0 2024-09-13T22:56:12.216 INFO:tasks.workunit.client.0.smithi002.stdout:1/517: mkdir d1/d13/d1d/d34/da7 0 2024-09-13T22:56:12.216 INFO:tasks.workunit.client.0.smithi002.stdout:3/560: dwrite d9/d3b/f70 [0,4194304] 0 2024-09-13T22:56:12.218 INFO:tasks.workunit.client.0.smithi002.stdout:1/518: dread - d1/d13/d1d/d34/d51/f9b zero size 2024-09-13T22:56:12.218 INFO:tasks.workunit.client.0.smithi002.stdout:3/561: read d9/f68 [336649,55592] 0 2024-09-13T22:56:12.218 INFO:tasks.workunit.client.0.smithi002.stdout:2/484: symlink d1/d7/d8/d51/la0 0 2024-09-13T22:56:12.219 INFO:tasks.workunit.client.1.smithi047.stdout:1/542: symlink d0/d7/d13/l95 0 2024-09-13T22:56:12.220 INFO:tasks.workunit.client.0.smithi002.stdout:2/485: chown d1/d32/d37/f7b 741 1 2024-09-13T22:56:12.227 INFO:tasks.workunit.client.1.smithi047.stdout:4/686: creat dc/de/d23/dc4/ddb/fe7 x:0 0 0 2024-09-13T22:56:12.227 INFO:tasks.workunit.client.1.smithi047.stdout:1/543: dwrite d0/d7/f44 [4194304,4194304] 0 2024-09-13T22:56:12.230 INFO:tasks.workunit.client.1.smithi047.stdout:4/687: write dc/de/d17/d25/d9b/fbf [1275373,83703] 0 2024-09-13T22:56:12.232 INFO:tasks.workunit.client.0.smithi002.stdout:0/510: symlink d1/d2/d6c/d8b/lb8 0 2024-09-13T22:56:12.233 INFO:tasks.workunit.client.0.smithi002.stdout:0/511: chown d1/d4/d75/d31/c60 0 1 2024-09-13T22:56:12.235 INFO:tasks.workunit.client.1.smithi047.stdout:6/630: dwrite d3/d11/d2b/d4c/d30/f37 [0,4194304] 0 2024-09-13T22:56:12.237 INFO:tasks.workunit.client.1.smithi047.stdout:6/631: write d3/d77/fa9 [685443,108354] 0 2024-09-13T22:56:12.240 INFO:tasks.workunit.client.0.smithi002.stdout:9/525: creat d8/d91/d96/fb4 x:0 0 0 2024-09-13T22:56:12.246 INFO:tasks.workunit.client.1.smithi047.stdout:1/544: fsync d0/d7/f44 0 2024-09-13T22:56:12.247 INFO:tasks.workunit.client.1.smithi047.stdout:1/545: write d0/d7/d14/d28/d36/f4c [188232,30474] 0 2024-09-13T22:56:12.248 INFO:tasks.workunit.client.0.smithi002.stdout:6/491: creat d12/d17/d34/d39/d8b/fa3 x:0 0 0 2024-09-13T22:56:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:11 smithi002 ceph-mon[27637]: pgmap v16: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 58 MiB/s rd, 232 MiB/s wr, 470 op/s 2024-09-13T22:56:12.252 INFO:tasks.workunit.client.0.smithi002.stdout:8/462: truncate d3/dc/f42 3414417 0 2024-09-13T22:56:12.258 INFO:tasks.workunit.client.1.smithi047.stdout:8/555: rename d8/d64/d4e/d4d/d8f/cba to d8/d64/d4e/d4d/d8f/cc4 0 2024-09-13T22:56:12.261 INFO:tasks.workunit.client.1.smithi047.stdout:6/632: symlink d3/ld0 0 2024-09-13T22:56:12.262 INFO:tasks.workunit.client.0.smithi002.stdout:0/512: symlink d1/d2/d6c/lb9 0 2024-09-13T22:56:12.262 INFO:tasks.workunit.client.1.smithi047.stdout:1/546: write d0/d7/d14/f2a [993825,125365] 0 2024-09-13T22:56:12.263 INFO:tasks.workunit.client.0.smithi002.stdout:0/513: read - d1/d4/d75/d31/f8d zero size 2024-09-13T22:56:12.266 INFO:tasks.workunit.client.0.smithi002.stdout:9/526: write d8/d10/f3c [46142,18842] 0 2024-09-13T22:56:12.268 INFO:tasks.workunit.client.1.smithi047.stdout:4/688: rename dc/f19 to dc/de/fe8 0 2024-09-13T22:56:12.270 INFO:tasks.workunit.client.1.smithi047.stdout:4/689: write dc/de/d23/fcc [3794594,15259] 0 2024-09-13T22:56:12.271 INFO:tasks.workunit.client.0.smithi002.stdout:8/463: creat d3/dc/d18/d2e/f8d x:0 0 0 2024-09-13T22:56:12.271 INFO:tasks.workunit.client.0.smithi002.stdout:7/423: dwrite d8/d10/f1e [0,4194304] 0 2024-09-13T22:56:12.273 INFO:tasks.workunit.client.1.smithi047.stdout:6/633: rename d3/d11/d2b/d1c/dbf/fbe to d3/d11/d2b/d1c/d4d/d69/dc2/dcd/fd1 0 2024-09-13T22:56:12.273 INFO:tasks.workunit.client.1.smithi047.stdout:4/690: read dc/de/d23/dc4/f47 [478595,87613] 0 2024-09-13T22:56:12.274 INFO:tasks.workunit.client.0.smithi002.stdout:6/492: dwrite fd [0,4194304] 0 2024-09-13T22:56:12.276 INFO:tasks.workunit.client.1.smithi047.stdout:1/547: dread d0/d7/d14/d71/f7e [0,4194304] 0 2024-09-13T22:56:12.278 INFO:tasks.workunit.client.1.smithi047.stdout:1/548: dread - d0/d7/d14/d28/f48 zero size 2024-09-13T22:56:12.281 INFO:tasks.workunit.client.0.smithi002.stdout:4/442: creat d3/f87 x:0 0 0 2024-09-13T22:56:12.281 INFO:tasks.workunit.client.1.smithi047.stdout:8/556: dread d8/d3f/d8c/f90 [0,4194304] 0 2024-09-13T22:56:12.282 INFO:tasks.workunit.client.1.smithi047.stdout:6/634: symlink d3/d11/d2b/d1c/d4d/d69/dc2/ld2 0 2024-09-13T22:56:12.283 INFO:tasks.workunit.client.1.smithi047.stdout:8/557: chown d8/d64/d4e/d70/da7 20654 1 2024-09-13T22:56:12.284 INFO:tasks.workunit.client.1.smithi047.stdout:4/691: creat dc/de/d17/d25/d9b/fe9 x:0 0 0 2024-09-13T22:56:12.285 INFO:tasks.workunit.client.1.smithi047.stdout:6/635: chown d3/d11/d2b/d4c/dc0/d89 17676 1 2024-09-13T22:56:12.287 INFO:tasks.workunit.client.1.smithi047.stdout:1/549: dwrite d0/d7/d14/d28/d36/f84 [0,4194304] 0 2024-09-13T22:56:12.287 INFO:tasks.workunit.client.1.smithi047.stdout:6/636: write d3/d11/d2b/d1c/d23/fba [3649829,68507] 0 2024-09-13T22:56:12.288 INFO:tasks.workunit.client.0.smithi002.stdout:9/527: mknod d8/d10/d1c/d68/cb5 0 2024-09-13T22:56:12.288 INFO:tasks.workunit.client.0.smithi002.stdout:9/528: stat d8/d1e/f41 0 2024-09-13T22:56:12.292 INFO:tasks.workunit.client.1.smithi047.stdout:6/637: truncate d3/d11/d2b/d4c/d30/f91 71751 0 2024-09-13T22:56:12.292 INFO:tasks.workunit.client.0.smithi002.stdout:9/529: read d8/f37 [7068,60390] 0 2024-09-13T22:56:12.294 INFO:tasks.workunit.client.0.smithi002.stdout:9/530: chown d8/d10/d61/f6b 1298191506 1 2024-09-13T22:56:12.294 INFO:tasks.workunit.client.0.smithi002.stdout:9/531: write d8/d10/d42/f51 [2403600,59574] 0 2024-09-13T22:56:12.295 INFO:tasks.workunit.client.0.smithi002.stdout:9/532: chown d8/f37 414664 1 2024-09-13T22:56:12.297 INFO:tasks.workunit.client.1.smithi047.stdout:8/558: unlink d8/d3f/d8c/lb9 0 2024-09-13T22:56:12.298 INFO:tasks.workunit.client.1.smithi047.stdout:8/559: write d8/d64/d4e/d70/f9c [2391504,115258] 0 2024-09-13T22:56:12.305 INFO:tasks.workunit.client.0.smithi002.stdout:2/486: link d1/l1c d1/d7/d35/d3e/d59/d6b/la1 0 2024-09-13T22:56:12.305 INFO:tasks.workunit.client.1.smithi047.stdout:1/550: creat d0/d7/d14/d28/d36/f96 x:0 0 0 2024-09-13T22:56:12.307 INFO:tasks.workunit.client.0.smithi002.stdout:3/562: getdents d9/d91 0 2024-09-13T22:56:12.308 INFO:tasks.workunit.client.0.smithi002.stdout:3/563: chown d9/d91/fab 78537455 1 2024-09-13T22:56:12.308 INFO:tasks.workunit.client.1.smithi047.stdout:1/551: rmdir d0/d7/d14/d57/d72 39 2024-09-13T22:56:12.308 INFO:tasks.workunit.client.0.smithi002.stdout:3/564: readlink d9/d15/d36/l5c 0 2024-09-13T22:56:12.309 INFO:tasks.workunit.client.0.smithi002.stdout:3/565: stat d9/d15/d36/d4e/d5e/dae/d89/lca 0 2024-09-13T22:56:12.313 INFO:tasks.workunit.client.0.smithi002.stdout:1/519: rename d1/d13/d30/d73/da1/f65 to d1/d13/d30/d31/fa8 0 2024-09-13T22:56:12.314 INFO:tasks.workunit.client.1.smithi047.stdout:4/692: creat dc/fea x:0 0 0 2024-09-13T22:56:12.315 INFO:tasks.workunit.client.1.smithi047.stdout:4/693: chown dc/de/d17/d25/d4a/dc3 2459 1 2024-09-13T22:56:12.316 INFO:tasks.workunit.client.0.smithi002.stdout:9/533: symlink d8/d10/d1c/d3d/lb6 0 2024-09-13T22:56:12.317 INFO:tasks.workunit.client.0.smithi002.stdout:8/464: mknod d3/dc/d16/d4b/d72/d73/c8e 0 2024-09-13T22:56:12.318 INFO:tasks.workunit.client.0.smithi002.stdout:3/566: dwrite d9/d15/d36/d4e/d5e/fb7 [0,4194304] 0 2024-09-13T22:56:12.319 INFO:tasks.workunit.client.1.smithi047.stdout:4/694: creat dc/de/d23/d40/d7b/dab/feb x:0 0 0 2024-09-13T22:56:12.321 INFO:tasks.workunit.client.0.smithi002.stdout:2/487: mknod d1/d80/ca2 0 2024-09-13T22:56:12.322 INFO:tasks.workunit.client.0.smithi002.stdout:6/493: dwrite f1 [0,4194304] 0 2024-09-13T22:56:12.322 INFO:tasks.workunit.client.1.smithi047.stdout:6/638: getdents d3/d11/d2b/d4c/d9d 0 2024-09-13T22:56:12.323 INFO:tasks.workunit.client.1.smithi047.stdout:6/639: write d3/d11/d2b/d1c/f56 [2348317,14347] 0 2024-09-13T22:56:12.326 INFO:tasks.workunit.client.1.smithi047.stdout:1/552: creat d0/d1d/f97 x:0 0 0 2024-09-13T22:56:12.329 INFO:tasks.workunit.client.1.smithi047.stdout:4/695: creat dc/de/d23/dc4/ddb/fec x:0 0 0 2024-09-13T22:56:12.329 INFO:tasks.workunit.client.0.smithi002.stdout:3/567: dwrite d9/d3b/d7c/fba [0,4194304] 0 2024-09-13T22:56:12.332 INFO:tasks.workunit.client.0.smithi002.stdout:9/534: rmdir d8/d10/d1c/d68 39 2024-09-13T22:56:12.333 INFO:tasks.workunit.client.1.smithi047.stdout:1/553: creat d0/d7/db/f98 x:0 0 0 2024-09-13T22:56:12.334 INFO:tasks.workunit.client.1.smithi047.stdout:1/554: chown d0/f4f 251855082 1 2024-09-13T22:56:12.336 INFO:tasks.workunit.client.0.smithi002.stdout:7/424: dwrite d8/d10/d11/d13/d26/d4c/f64 [0,4194304] 0 2024-09-13T22:56:12.336 INFO:tasks.workunit.client.1.smithi047.stdout:4/696: rmdir dc/d29/d6c 39 2024-09-13T22:56:12.340 INFO:tasks.workunit.client.0.smithi002.stdout:4/443: link d3/d14/f6f d3/d40/f88 0 2024-09-13T22:56:12.340 INFO:tasks.workunit.client.1.smithi047.stdout:1/555: dread d0/d1d/f2e [0,4194304] 0 2024-09-13T22:56:12.342 INFO:tasks.workunit.client.0.smithi002.stdout:5/477: sync 2024-09-13T22:56:12.343 INFO:tasks.workunit.client.0.smithi002.stdout:6/494: truncate d12/f74 3876727 0 2024-09-13T22:56:12.343 INFO:tasks.workunit.client.0.smithi002.stdout:5/478: write d1/d2a/d6b/d88/f4d [547464,125378] 0 2024-09-13T22:56:12.347 INFO:tasks.workunit.client.0.smithi002.stdout:3/568: chown d9/df/c25 6021 1 2024-09-13T22:56:12.348 INFO:tasks.workunit.client.0.smithi002.stdout:8/465: write d3/dc/f5f [786772,95733] 0 2024-09-13T22:56:12.349 INFO:tasks.workunit.client.1.smithi047.stdout:4/697: symlink dc/de/d23/ddf/led 0 2024-09-13T22:56:12.349 INFO:tasks.workunit.client.0.smithi002.stdout:8/466: read - d3/dc/d18/d2e/f8d zero size 2024-09-13T22:56:12.350 INFO:tasks.workunit.client.1.smithi047.stdout:1/556: getdents d0/d7/d14/d57/d62/d8a 0 2024-09-13T22:56:12.356 INFO:tasks.workunit.client.1.smithi047.stdout:4/698: unlink dc/d29/d4d/f7c 0 2024-09-13T22:56:12.356 INFO:tasks.workunit.client.1.smithi047.stdout:1/557: write d0/d7/f12 [3995498,56134] 0 2024-09-13T22:56:12.357 INFO:tasks.workunit.client.0.smithi002.stdout:9/535: mknod d8/d10/db1/cb7 0 2024-09-13T22:56:12.357 INFO:tasks.workunit.client.0.smithi002.stdout:9/536: fsync d8/d10/d1c/f2b 0 2024-09-13T22:56:12.358 INFO:tasks.workunit.client.1.smithi047.stdout:4/699: write dc/de/d23/f96 [160256,65409] 0 2024-09-13T22:56:12.359 INFO:tasks.workunit.client.1.smithi047.stdout:4/700: write dc/de/f97 [4939267,124146] 0 2024-09-13T22:56:12.365 INFO:tasks.workunit.client.1.smithi047.stdout:1/558: dwrite d0/d7/d14/d28/d36/f4c [0,4194304] 0 2024-09-13T22:56:12.366 INFO:tasks.workunit.client.1.smithi047.stdout:1/559: chown d0/d7/d13/f56 774 1 2024-09-13T22:56:12.366 INFO:tasks.workunit.client.1.smithi047.stdout:1/560: chown d0/d7/d13/d2d 458077758 1 2024-09-13T22:56:12.376 INFO:tasks.workunit.client.0.smithi002.stdout:4/444: dwrite d3/d14/d25/d5e/f5f [0,4194304] 0 2024-09-13T22:56:12.377 INFO:tasks.workunit.client.0.smithi002.stdout:4/445: chown d3/d14/f42 104239 1 2024-09-13T22:56:12.377 INFO:tasks.workunit.client.0.smithi002.stdout:0/514: sync 2024-09-13T22:56:12.378 INFO:tasks.workunit.client.0.smithi002.stdout:7/425: symlink d8/d10/d11/d13/d2e/d50/d52/d72/l76 0 2024-09-13T22:56:12.379 INFO:tasks.workunit.client.0.smithi002.stdout:7/426: write d8/d10/f1e [4479164,34019] 0 2024-09-13T22:56:12.382 INFO:tasks.workunit.client.0.smithi002.stdout:5/479: mkdir d1/d2a/d6b/d88/d45/d4f/da7/daa 0 2024-09-13T22:56:12.384 INFO:tasks.workunit.client.0.smithi002.stdout:3/569: link d9/d15/d36/f38 d9/d15/d46/fcf 0 2024-09-13T22:56:12.385 INFO:tasks.workunit.client.0.smithi002.stdout:1/520: link d1/d13/d1d/d34/c7b d1/d13/d30/d73/da1/d7d/ca9 0 2024-09-13T22:56:12.387 INFO:tasks.workunit.client.1.smithi047.stdout:4/701: mkdir dc/de/d23/d40/d7b/dab/dae/dee 0 2024-09-13T22:56:12.390 INFO:tasks.workunit.client.0.smithi002.stdout:8/467: link d3/dc/d51/d6e/f88 d3/dc/d18/d2e/f8f 0 2024-09-13T22:56:12.393 INFO:tasks.workunit.client.0.smithi002.stdout:1/521: dread d1/ff [0,4194304] 0 2024-09-13T22:56:12.394 INFO:tasks.workunit.client.1.smithi047.stdout:1/561: symlink d0/d7/d14/d57/l99 0 2024-09-13T22:56:12.397 INFO:tasks.workunit.client.0.smithi002.stdout:2/488: getdents d1 0 2024-09-13T22:56:12.397 INFO:tasks.workunit.client.0.smithi002.stdout:2/489: fsync d1/f14 0 2024-09-13T22:56:12.401 INFO:tasks.workunit.client.0.smithi002.stdout:6/495: write d12/f63 [1810000,9022] 0 2024-09-13T22:56:12.404 INFO:tasks.workunit.client.0.smithi002.stdout:2/490: dwrite d1/d7/d8/d2c/f4e [0,4194304] 0 2024-09-13T22:56:12.405 INFO:tasks.workunit.client.1.smithi047.stdout:4/702: link dc/de/d17/d25/d9b/cb5 dc/de/d17/d25/cef 0 2024-09-13T22:56:12.406 INFO:tasks.workunit.client.0.smithi002.stdout:5/480: creat d1/d2a/d6b/d88/d45/d4f/d78/d8b/fab x:0 0 0 2024-09-13T22:56:12.407 INFO:tasks.workunit.client.0.smithi002.stdout:3/570: symlink d9/d3b/d53/d95/ld0 0 2024-09-13T22:56:12.408 INFO:tasks.workunit.client.0.smithi002.stdout:1/522: dread d1/d13/d30/f2d [0,4194304] 0 2024-09-13T22:56:12.411 INFO:tasks.workunit.client.1.smithi047.stdout:4/703: creat dc/d29/d8e/dda/ff0 x:0 0 0 2024-09-13T22:56:12.412 INFO:tasks.workunit.client.1.smithi047.stdout:4/704: chown dc/d29/d4d/fd8 88736011 1 2024-09-13T22:56:12.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:11 smithi047 ceph-mon[34560]: pgmap v16: 65 pgs: 65 active+clean; 1.9 GiB data, 5.6 GiB used, 531 GiB / 536 GiB avail; 58 MiB/s rd, 232 MiB/s wr, 470 op/s 2024-09-13T22:56:12.413 INFO:tasks.workunit.client.1.smithi047.stdout:4/705: stat dc/d29/d4d 0 2024-09-13T22:56:12.413 INFO:tasks.workunit.client.1.smithi047.stdout:4/706: chown f4 8385810 1 2024-09-13T22:56:12.415 INFO:tasks.workunit.client.0.smithi002.stdout:9/537: truncate d8/d2c/f58 63326 0 2024-09-13T22:56:12.417 INFO:tasks.workunit.client.0.smithi002.stdout:5/481: dread d1/d2a/d6b/d88/d45/f48 [0,4194304] 0 2024-09-13T22:56:12.418 INFO:tasks.workunit.client.1.smithi047.stdout:4/707: creat dc/de/d23/d40/d7b/dab/ff1 x:0 0 0 2024-09-13T22:56:12.419 INFO:tasks.workunit.client.1.smithi047.stdout:4/708: fsync dc/de/d23/dc4/ddb/fec 0 2024-09-13T22:56:12.423 INFO:tasks.workunit.client.1.smithi047.stdout:1/562: dwrite d0/d7/d10/f49 [0,4194304] 0 2024-09-13T22:56:12.423 INFO:tasks.workunit.client.0.smithi002.stdout:5/482: dwrite d1/d2a/d6b/d88/f4d [0,4194304] 0 2024-09-13T22:56:12.424 INFO:tasks.workunit.client.0.smithi002.stdout:1/523: chown d1/d13/d30/d31/d3b/d71/d80/l89 670733 1 2024-09-13T22:56:12.427 INFO:tasks.workunit.client.0.smithi002.stdout:4/446: rename d3/cc to d3/c89 0 2024-09-13T22:56:12.430 INFO:tasks.workunit.client.1.smithi047.stdout:1/563: dwrite d0/d7/db/d79/f7b [0,4194304] 0 2024-09-13T22:56:12.431 INFO:tasks.workunit.client.0.smithi002.stdout:1/524: dread d1/d13/d21/f8c [0,4194304] 0 2024-09-13T22:56:12.431 INFO:tasks.workunit.client.0.smithi002.stdout:1/525: chown d1/d13/d21/d39/d70/f72 26 1 2024-09-13T22:56:12.433 INFO:tasks.workunit.client.0.smithi002.stdout:0/515: creat d1/d4/fba x:0 0 0 2024-09-13T22:56:12.440 INFO:tasks.workunit.client.1.smithi047.stdout:4/709: symlink dc/de/d17/lf2 0 2024-09-13T22:56:12.441 INFO:tasks.workunit.client.1.smithi047.stdout:1/564: dwrite d0/d7/db/f90 [0,4194304] 0 2024-09-13T22:56:12.441 INFO:tasks.workunit.client.0.smithi002.stdout:9/538: fsync d8/d10/d1c/d68/faf 0 2024-09-13T22:56:12.447 INFO:tasks.workunit.client.1.smithi047.stdout:4/710: dread dc/d29/d4c/f79 [0,4194304] 0 2024-09-13T22:56:12.449 INFO:tasks.workunit.client.0.smithi002.stdout:3/571: mkdir d9/dd1 0 2024-09-13T22:56:12.450 INFO:tasks.workunit.client.0.smithi002.stdout:3/572: chown d9/d91/fb6 257982529 1 2024-09-13T22:56:12.451 INFO:tasks.workunit.client.0.smithi002.stdout:4/447: unlink d3/c11 0 2024-09-13T22:56:12.452 INFO:tasks.workunit.client.0.smithi002.stdout:4/448: read - d3/d14/f6f zero size 2024-09-13T22:56:12.454 INFO:tasks.workunit.client.0.smithi002.stdout:4/449: dread - d3/d40/f88 zero size 2024-09-13T22:56:12.455 INFO:tasks.workunit.client.0.smithi002.stdout:4/450: dread - d3/d14/d29/d2a/d30/f57 zero size 2024-09-13T22:56:12.455 INFO:tasks.workunit.client.1.smithi047.stdout:1/565: write d0/d7/db/f3a [5009625,44843] 0 2024-09-13T22:56:12.455 INFO:tasks.workunit.client.0.smithi002.stdout:6/496: creat d12/fa4 x:0 0 0 2024-09-13T22:56:12.458 INFO:tasks.workunit.client.1.smithi047.stdout:1/566: creat d0/d7/d14/d28/f9a x:0 0 0 2024-09-13T22:56:12.460 INFO:tasks.workunit.client.1.smithi047.stdout:4/711: link dc/da3/fd2 dc/d29/ff3 0 2024-09-13T22:56:12.461 INFO:tasks.workunit.client.0.smithi002.stdout:4/451: dwrite d3/d14/d29/d2a/d30/f80 [0,4194304] 0 2024-09-13T22:56:12.462 INFO:tasks.workunit.client.0.smithi002.stdout:3/573: creat d9/d15/d26/fd2 x:0 0 0 2024-09-13T22:56:12.463 INFO:tasks.workunit.client.1.smithi047.stdout:4/712: read dc/de/d23/d40/d7b/dab/dae/fd5 [178398,13603] 0 2024-09-13T22:56:12.464 INFO:tasks.workunit.client.0.smithi002.stdout:3/574: chown d9/d3b/d7c/f80 147882 1 2024-09-13T22:56:12.464 INFO:tasks.workunit.client.1.smithi047.stdout:1/567: rename d0/d7/db/f90 to d0/d7/d14/d28/d36/f9b 0 2024-09-13T22:56:12.465 INFO:tasks.workunit.client.1.smithi047.stdout:4/713: write dc/d29/d8e/dda/ff0 [77221,103665] 0 2024-09-13T22:56:12.467 INFO:tasks.workunit.client.0.smithi002.stdout:5/483: dread d1/d2a/d5a/f8c [0,4194304] 0 2024-09-13T22:56:12.471 INFO:tasks.workunit.client.0.smithi002.stdout:5/484: read d1/d2a/d6b/d88/f74 [1870808,52520] 0 2024-09-13T22:56:12.472 INFO:tasks.workunit.client.0.smithi002.stdout:5/485: chown d1/d2a/d6b/d88/l44 454972932 1 2024-09-13T22:56:12.473 INFO:tasks.workunit.client.1.smithi047.stdout:1/568: dread d0/f4f [0,4194304] 0 2024-09-13T22:56:12.474 INFO:tasks.workunit.client.1.smithi047.stdout:1/569: chown d0/f4f 8609682 1 2024-09-13T22:56:12.475 INFO:tasks.workunit.client.1.smithi047.stdout:4/714: rename dc/d29/d6c/fb1 to dc/d29/d4d/ff4 0 2024-09-13T22:56:12.476 INFO:tasks.workunit.client.0.smithi002.stdout:2/491: getdents d1/d80 0 2024-09-13T22:56:12.484 INFO:tasks.workunit.client.1.smithi047.stdout:1/570: dwrite d0/d7/db/f8b [0,4194304] 0 2024-09-13T22:56:12.484 INFO:tasks.workunit.client.1.smithi047.stdout:4/715: creat dc/de/d17/d70/ff5 x:0 0 0 2024-09-13T22:56:12.485 INFO:tasks.workunit.client.1.smithi047.stdout:4/716: stat dc/de/d17/d70/ff5 0 2024-09-13T22:56:12.487 INFO:tasks.workunit.client.1.smithi047.stdout:1/571: mknod d0/d7/d13/d5d/c9c 0 2024-09-13T22:56:12.488 INFO:tasks.workunit.client.0.smithi002.stdout:9/539: creat d8/d1e/fb8 x:0 0 0 2024-09-13T22:56:12.489 INFO:tasks.workunit.client.0.smithi002.stdout:5/486: fsync d1/d2a/d6b/d88/d45/f76 0 2024-09-13T22:56:12.490 INFO:tasks.workunit.client.0.smithi002.stdout:5/487: write d1/d10/f51 [4729195,63587] 0 2024-09-13T22:56:12.491 INFO:tasks.workunit.client.1.smithi047.stdout:1/572: mknod d0/d7/db/c9d 0 2024-09-13T22:56:12.491 INFO:tasks.workunit.client.0.smithi002.stdout:2/492: symlink d1/d7/d41/la3 0 2024-09-13T22:56:12.494 INFO:tasks.workunit.client.0.smithi002.stdout:4/452: link f1 d3/d14/d25/f8a 0 2024-09-13T22:56:12.495 INFO:tasks.workunit.client.1.smithi047.stdout:1/573: chown d0/d7/d10/d55/l65 3 1 2024-09-13T22:56:12.495 INFO:tasks.workunit.client.0.smithi002.stdout:1/526: truncate d1/d13/f3f 1792967 0 2024-09-13T22:56:12.496 INFO:tasks.workunit.client.0.smithi002.stdout:1/527: truncate d1/d13/d1d/d34/d51/f82 5213387 0 2024-09-13T22:56:12.497 INFO:tasks.workunit.client.0.smithi002.stdout:1/528: truncate d1/d13/d1d/f75 173910 0 2024-09-13T22:56:12.498 INFO:tasks.workunit.client.0.smithi002.stdout:1/529: readlink d1/d13/d30/d73/da1/l20 0 2024-09-13T22:56:12.498 INFO:tasks.workunit.client.0.smithi002.stdout:6/497: creat d12/fa5 x:0 0 0 2024-09-13T22:56:12.499 INFO:tasks.workunit.client.1.smithi047.stdout:4/717: getdents dc/de/d17/d25/d4a/dc3 0 2024-09-13T22:56:12.499 INFO:tasks.workunit.client.1.smithi047.stdout:4/718: stat dc/de/d23/ddf 0 2024-09-13T22:56:12.501 INFO:tasks.workunit.client.0.smithi002.stdout:5/488: creat d1/d2a/d6b/d88/d45/d4f/d78/fac x:0 0 0 2024-09-13T22:56:12.502 INFO:tasks.workunit.client.0.smithi002.stdout:5/489: chown d1/d2a/d6b/f72 215 1 2024-09-13T22:56:12.503 INFO:tasks.workunit.client.1.smithi047.stdout:4/719: creat dc/de/d23/dc4/dc8/ff6 x:0 0 0 2024-09-13T22:56:12.504 INFO:tasks.workunit.client.0.smithi002.stdout:2/493: rename d1/d7d to d1/d7/d8/d2c/da4 0 2024-09-13T22:56:12.505 INFO:tasks.workunit.client.1.smithi047.stdout:1/574: creat d0/d7/d14/d57/f9e x:0 0 0 2024-09-13T22:56:12.506 INFO:tasks.workunit.client.0.smithi002.stdout:3/575: creat d9/d15/d36/d4e/d5e/fd3 x:0 0 0 2024-09-13T22:56:12.510 INFO:tasks.workunit.client.0.smithi002.stdout:9/540: mkdir d8/d91/da3/db9 0 2024-09-13T22:56:12.510 INFO:tasks.workunit.client.0.smithi002.stdout:9/541: readlink d8/d10/d1c/l23 0 2024-09-13T22:56:12.510 INFO:tasks.workunit.client.0.smithi002.stdout:9/542: stat d8/d2c/d50 0 2024-09-13T22:56:12.512 INFO:tasks.workunit.client.0.smithi002.stdout:5/490: mknod d1/d2a/d6b/d88/d55/d56/cad 0 2024-09-13T22:56:12.519 INFO:tasks.workunit.client.0.smithi002.stdout:3/576: dread d9/d15/d26/f32 [0,4194304] 0 2024-09-13T22:56:12.525 INFO:tasks.workunit.client.1.smithi047.stdout:5/541: sync 2024-09-13T22:56:12.526 INFO:tasks.workunit.client.1.smithi047.stdout:4/720: creat dc/de/d23/ff7 x:0 0 0 2024-09-13T22:56:12.526 INFO:tasks.workunit.client.1.smithi047.stdout:1/575: write d0/d7/d13/f56 [215611,35628] 0 2024-09-13T22:56:12.527 INFO:tasks.workunit.client.1.smithi047.stdout:4/721: dread - dc/de/d23/dc4/ddb/fdc zero size 2024-09-13T22:56:12.529 INFO:tasks.workunit.client.1.smithi047.stdout:1/576: truncate d0/d7/d14/d28/d36/f4c 4995524 0 2024-09-13T22:56:12.530 INFO:tasks.workunit.client.1.smithi047.stdout:1/577: chown d0/d7/d14/d57/d62 4 1 2024-09-13T22:56:12.530 INFO:tasks.workunit.client.1.smithi047.stdout:4/722: truncate dc/de/d23/d40/d7b/d90/da6/fb6 915788 0 2024-09-13T22:56:12.533 INFO:tasks.workunit.client.1.smithi047.stdout:5/542: rename d19/d34/d42/c6f to d19/d34/d6c/cb1 0 2024-09-13T22:56:12.534 INFO:tasks.workunit.client.0.smithi002.stdout:9/543: dread d8/d10/d1c/f12 [0,4194304] 0 2024-09-13T22:56:12.538 INFO:tasks.workunit.client.1.smithi047.stdout:4/723: dwrite dc/de/d17/d25/d4a/f9f [0,4194304] 0 2024-09-13T22:56:12.541 INFO:tasks.workunit.client.1.smithi047.stdout:5/543: dwrite d19/d23/d2e/d41/f51 [0,4194304] 0 2024-09-13T22:56:12.542 INFO:tasks.workunit.client.0.smithi002.stdout:6/498: rmdir d12/d17/d98 0 2024-09-13T22:56:12.543 INFO:tasks.workunit.client.0.smithi002.stdout:6/499: truncate d12/d17/d28/d7d/fa2 4385509 0 2024-09-13T22:56:12.544 INFO:tasks.workunit.client.1.smithi047.stdout:5/544: fdatasync d19/d34/d42/d5d/f9b 0 2024-09-13T22:56:12.546 INFO:tasks.workunit.client.0.smithi002.stdout:4/453: rename d3/d14/d25/d69/f83 to d3/d40/f8b 0 2024-09-13T22:56:12.551 INFO:tasks.workunit.client.0.smithi002.stdout:5/491: link d1/d10/f3d d1/d10/fae 0 2024-09-13T22:56:12.552 INFO:tasks.workunit.client.0.smithi002.stdout:7/427: sync 2024-09-13T22:56:12.552 INFO:tasks.workunit.client.0.smithi002.stdout:8/468: sync 2024-09-13T22:56:12.555 INFO:tasks.workunit.client.1.smithi047.stdout:4/724: dwrite dc/d29/d4c/f82 [4194304,4194304] 0 2024-09-13T22:56:12.556 INFO:tasks.workunit.client.0.smithi002.stdout:7/428: dread d8/d10/f1e [0,4194304] 0 2024-09-13T22:56:12.556 INFO:tasks.workunit.client.1.smithi047.stdout:1/578: getdents d0/d7/d10/d55 0 2024-09-13T22:56:12.559 INFO:tasks.workunit.client.0.smithi002.stdout:6/500: creat d12/d17/d4e/fa6 x:0 0 0 2024-09-13T22:56:12.564 INFO:tasks.workunit.client.1.smithi047.stdout:4/725: fdatasync dc/f2f 0 2024-09-13T22:56:12.566 INFO:tasks.workunit.client.0.smithi002.stdout:6/501: dwrite d12/d17/d28/f2f [4194304,4194304] 0 2024-09-13T22:56:12.566 INFO:tasks.workunit.client.0.smithi002.stdout:4/454: chown d3/d14/f1a 6100348 1 2024-09-13T22:56:12.568 INFO:tasks.workunit.client.0.smithi002.stdout:6/502: write d12/f6a [4945368,127387] 0 2024-09-13T22:56:12.569 INFO:tasks.workunit.client.0.smithi002.stdout:4/455: write d3/d14/d25/d5e/f65 [403772,19323] 0 2024-09-13T22:56:12.571 INFO:tasks.workunit.client.0.smithi002.stdout:5/492: mknod d1/d2a/d6b/d88/d45/d4f/caf 0 2024-09-13T22:56:12.572 INFO:tasks.workunit.client.0.smithi002.stdout:5/493: truncate d1/d2a/d5a/f62 743264 0 2024-09-13T22:56:12.573 INFO:tasks.workunit.client.0.smithi002.stdout:2/494: link d1/d7/d8/lc d1/d32/d37/la5 0 2024-09-13T22:56:12.578 INFO:tasks.workunit.client.1.smithi047.stdout:1/579: dwrite d0/f4f [0,4194304] 0 2024-09-13T22:56:12.578 INFO:tasks.workunit.client.0.smithi002.stdout:5/494: dwrite d1/d2a/d6b/d88/d45/f76 [0,4194304] 0 2024-09-13T22:56:12.579 INFO:tasks.workunit.client.0.smithi002.stdout:9/544: creat d8/d2c/fba x:0 0 0 2024-09-13T22:56:12.581 INFO:tasks.workunit.client.0.smithi002.stdout:4/456: fsync d3/d14/d25/f8a 0 2024-09-13T22:56:12.586 INFO:tasks.workunit.client.0.smithi002.stdout:8/469: link d3/dc/d16/d2f/f47 d3/dc/d18/d6f/f90 0 2024-09-13T22:56:12.588 INFO:tasks.workunit.client.0.smithi002.stdout:2/495: creat d1/fa6 x:0 0 0 2024-09-13T22:56:12.590 INFO:tasks.workunit.client.0.smithi002.stdout:1/530: rename d1/d13/d30/d31/d86/f8f to d1/d13/d21/faa 0 2024-09-13T22:56:12.591 INFO:tasks.workunit.client.0.smithi002.stdout:4/457: dwrite d3/d14/d29/d2a/f37 [0,4194304] 0 2024-09-13T22:56:12.591 INFO:tasks.workunit.client.0.smithi002.stdout:1/531: stat d1/d13/d1d/d34/f6b 0 2024-09-13T22:56:12.593 INFO:tasks.workunit.client.0.smithi002.stdout:6/503: getdents d12/d17/d28/d67/d9f 0 2024-09-13T22:56:12.593 INFO:tasks.workunit.client.0.smithi002.stdout:8/470: dread d3/dc/d18/f23 [0,4194304] 0 2024-09-13T22:56:12.594 INFO:tasks.workunit.client.1.smithi047.stdout:1/580: getdents d0/d1d/d7f 0 2024-09-13T22:56:12.596 INFO:tasks.workunit.client.0.smithi002.stdout:9/545: unlink d8/f75 0 2024-09-13T22:56:12.598 INFO:tasks.workunit.client.0.smithi002.stdout:5/495: creat d1/d2a/d6b/d88/d55/d56/d86/fb0 x:0 0 0 2024-09-13T22:56:12.600 INFO:tasks.workunit.client.1.smithi047.stdout:1/581: mknod d0/d7/d14/d57/d62/d76/c9f 0 2024-09-13T22:56:12.603 INFO:tasks.workunit.client.0.smithi002.stdout:9/546: dwrite d8/d10/d42/f7f [0,4194304] 0 2024-09-13T22:56:12.606 INFO:tasks.workunit.client.1.smithi047.stdout:1/582: rename d0/d1d/d7f/c86 to d0/d7/d14/d57/d62/ca0 0 2024-09-13T22:56:12.608 INFO:tasks.workunit.client.0.smithi002.stdout:9/547: dread d8/d1e/f67 [0,4194304] 0 2024-09-13T22:56:12.610 INFO:tasks.workunit.client.1.smithi047.stdout:1/583: creat d0/d7/d14/fa1 x:0 0 0 2024-09-13T22:56:12.611 INFO:tasks.workunit.client.0.smithi002.stdout:4/458: dread d3/f10 [0,4194304] 0 2024-09-13T22:56:12.612 INFO:tasks.workunit.client.1.smithi047.stdout:1/584: chown d0/d7/d14/d28/d36/l1c 7806 1 2024-09-13T22:56:12.613 INFO:tasks.workunit.client.1.smithi047.stdout:1/585: chown d0/d7/d10/d55 9594 1 2024-09-13T22:56:12.613 INFO:tasks.workunit.client.1.smithi047.stdout:1/586: chown d0/d7/db/f3a 258194836 1 2024-09-13T22:56:12.615 INFO:tasks.workunit.client.0.smithi002.stdout:6/504: creat d12/d17/d34/d39/d8a/fa7 x:0 0 0 2024-09-13T22:56:12.615 INFO:tasks.workunit.client.0.smithi002.stdout:6/505: dread - d12/d17/d34/d39/f9e zero size 2024-09-13T22:56:12.617 INFO:tasks.workunit.client.0.smithi002.stdout:6/506: write d12/d17/d28/f66 [3056001,36410] 0 2024-09-13T22:56:12.618 INFO:tasks.workunit.client.0.smithi002.stdout:0/516: sync 2024-09-13T22:56:12.619 INFO:tasks.workunit.client.0.smithi002.stdout:0/517: dread - d1/d4/da3/d7d/f9a zero size 2024-09-13T22:56:12.619 INFO:tasks.workunit.client.1.smithi047.stdout:1/587: symlink d0/la2 0 2024-09-13T22:56:12.620 INFO:tasks.workunit.client.0.smithi002.stdout:0/518: chown d1/d4/da3/f64 2 1 2024-09-13T22:56:12.620 INFO:tasks.workunit.client.0.smithi002.stdout:2/496: write d1/d7/d8/f10 [40574,14179] 0 2024-09-13T22:56:12.620 INFO:tasks.workunit.client.1.smithi047.stdout:1/588: write d0/f5 [3459675,29886] 0 2024-09-13T22:56:12.620 INFO:tasks.workunit.client.0.smithi002.stdout:0/519: dread - d1/d4/fba zero size 2024-09-13T22:56:12.621 INFO:tasks.workunit.client.0.smithi002.stdout:7/429: getdents d8/d10/d11/d13/d26 0 2024-09-13T22:56:12.622 INFO:tasks.workunit.client.0.smithi002.stdout:0/520: dread - d1/d4/d75/d31/f8d zero size 2024-09-13T22:56:12.623 INFO:tasks.workunit.client.1.smithi047.stdout:1/589: creat d0/d7/d14/d57/d62/fa3 x:0 0 0 2024-09-13T22:56:12.626 INFO:tasks.workunit.client.0.smithi002.stdout:1/532: symlink d1/lab 0 2024-09-13T22:56:12.630 INFO:tasks.workunit.client.0.smithi002.stdout:6/507: unlink d12/d17/c31 0 2024-09-13T22:56:12.632 INFO:tasks.workunit.client.0.smithi002.stdout:5/496: creat d1/d2a/d6b/d88/d45/d4f/d99/fb1 x:0 0 0 2024-09-13T22:56:12.633 INFO:tasks.workunit.client.0.smithi002.stdout:2/497: creat d1/d7/d35/d3e/d59/d6b/d75/fa7 x:0 0 0 2024-09-13T22:56:12.634 INFO:tasks.workunit.client.0.smithi002.stdout:2/498: read d1/f14 [3696976,12056] 0 2024-09-13T22:56:12.635 INFO:tasks.workunit.client.0.smithi002.stdout:9/548: write d8/d2c/f56 [892752,3765] 0 2024-09-13T22:56:12.635 INFO:tasks.workunit.client.0.smithi002.stdout:7/430: rmdir d8/d10/d11/d13/d2e/d50 39 2024-09-13T22:56:12.637 INFO:tasks.workunit.client.0.smithi002.stdout:8/471: write d3/dc/f42 [1342564,92266] 0 2024-09-13T22:56:12.638 INFO:tasks.workunit.client.1.smithi047.stdout:1/590: truncate d0/d7/d14/f2b 3236520 0 2024-09-13T22:56:12.639 INFO:tasks.workunit.client.1.smithi047.stdout:1/591: write d0/d1d/f97 [281397,44311] 0 2024-09-13T22:56:12.639 INFO:tasks.workunit.client.0.smithi002.stdout:5/497: dwrite d1/d2a/d6b/d88/d55/f84 [0,4194304] 0 2024-09-13T22:56:12.641 INFO:tasks.workunit.client.0.smithi002.stdout:1/533: rename d1/d13/d21/d39/d70/f88 to d1/d13/d30/d73/da1/fac 0 2024-09-13T22:56:12.641 INFO:tasks.workunit.client.0.smithi002.stdout:5/498: write d1/d2a/d5a/f6d [4580592,17435] 0 2024-09-13T22:56:12.646 INFO:tasks.workunit.client.0.smithi002.stdout:9/549: creat d8/d10/d42/fbb x:0 0 0 2024-09-13T22:56:12.647 INFO:tasks.workunit.client.1.smithi047.stdout:1/592: dwrite d0/d7/f12 [0,4194304] 0 2024-09-13T22:56:12.650 INFO:tasks.workunit.client.1.smithi047.stdout:1/593: truncate d0/d7/d13/d5d/f6a 258600 0 2024-09-13T22:56:12.654 INFO:tasks.workunit.client.0.smithi002.stdout:5/499: dread d1/d10/f3d [0,4194304] 0 2024-09-13T22:56:12.654 INFO:tasks.workunit.client.0.smithi002.stdout:1/534: rename d1/lab to d1/d13/d21/d39/d70/lad 0 2024-09-13T22:56:12.656 INFO:tasks.workunit.client.0.smithi002.stdout:1/535: write d1/d13/d30/f99 [124490,36841] 0 2024-09-13T22:56:12.658 INFO:tasks.workunit.client.0.smithi002.stdout:7/431: symlink d8/l77 0 2024-09-13T22:56:12.659 INFO:tasks.workunit.client.0.smithi002.stdout:5/500: dread d1/d2a/d6b/d88/d45/d4f/d8f/f94 [0,4194304] 0 2024-09-13T22:56:12.659 INFO:tasks.workunit.client.1.smithi047.stdout:1/594: symlink d0/d7/d14/d28/d36/la4 0 2024-09-13T22:56:12.661 INFO:tasks.workunit.client.0.smithi002.stdout:7/432: fsync d8/d9/d46/f4b 0 2024-09-13T22:56:12.661 INFO:tasks.workunit.client.0.smithi002.stdout:4/459: link d3/d40/f7c d3/d14/f8c 0 2024-09-13T22:56:12.662 INFO:tasks.workunit.client.0.smithi002.stdout:9/550: truncate d8/d10/d1c/f12 1897461 0 2024-09-13T22:56:12.662 INFO:tasks.workunit.client.1.smithi047.stdout:1/595: mknod d0/d7/d14/d28/ca5 0 2024-09-13T22:56:12.663 INFO:tasks.workunit.client.1.smithi047.stdout:1/596: dread - d0/d7/d14/d28/f9a zero size 2024-09-13T22:56:12.664 INFO:tasks.workunit.client.0.smithi002.stdout:8/472: mknod d3/c91 0 2024-09-13T22:56:12.666 INFO:tasks.workunit.client.0.smithi002.stdout:0/521: getdents d1/d2/d81 0 2024-09-13T22:56:12.667 INFO:tasks.workunit.client.0.smithi002.stdout:9/551: write d8/d10/d1c/f2b [5835526,20433] 0 2024-09-13T22:56:12.667 INFO:tasks.workunit.client.1.smithi047.stdout:1/597: readlink d0/d7/d75/l7d 0 2024-09-13T22:56:12.668 INFO:tasks.workunit.client.0.smithi002.stdout:1/536: dwrite d1/d13/d52/f9f [0,4194304] 0 2024-09-13T22:56:12.668 INFO:tasks.workunit.client.0.smithi002.stdout:6/508: dwrite d12/d17/d34/f36 [0,4194304] 0 2024-09-13T22:56:12.669 INFO:tasks.workunit.client.1.smithi047.stdout:1/598: write d0/d7/d10/f6c [975401,115337] 0 2024-09-13T22:56:12.670 INFO:tasks.workunit.client.0.smithi002.stdout:0/522: fsync d1/d2/d81/fa6 0 2024-09-13T22:56:12.671 INFO:tasks.workunit.client.0.smithi002.stdout:6/509: stat d12/d17/d4e/f52 0 2024-09-13T22:56:12.674 INFO:tasks.workunit.client.0.smithi002.stdout:6/510: write fa [2267608,99996] 0 2024-09-13T22:56:12.674 INFO:tasks.workunit.client.0.smithi002.stdout:5/501: symlink d1/d2a/d6b/d88/d45/d4f/d78/d8b/lb2 0 2024-09-13T22:56:12.674 INFO:tasks.workunit.client.0.smithi002.stdout:8/473: fsync d3/f24 0 2024-09-13T22:56:12.675 INFO:tasks.workunit.client.0.smithi002.stdout:6/511: fsync f5 0 2024-09-13T22:56:12.675 INFO:tasks.workunit.client.0.smithi002.stdout:0/523: write d1/d4/d75/d76/fa8 [169113,42054] 0 2024-09-13T22:56:12.676 INFO:tasks.workunit.client.1.smithi047.stdout:1/599: mkdir d0/d7/d13/d5d/d89/da6 0 2024-09-13T22:56:12.677 INFO:tasks.workunit.client.0.smithi002.stdout:4/460: truncate d3/f21 4432051 0 2024-09-13T22:56:12.680 INFO:tasks.workunit.client.0.smithi002.stdout:6/512: read d12/f51 [2890442,31102] 0 2024-09-13T22:56:12.681 INFO:tasks.workunit.client.0.smithi002.stdout:7/433: dwrite d8/d10/f2b [0,4194304] 0 2024-09-13T22:56:12.686 INFO:tasks.workunit.client.0.smithi002.stdout:9/552: mkdir d8/d2c/dbc 0 2024-09-13T22:56:12.688 INFO:tasks.workunit.client.1.smithi047.stdout:1/600: creat d0/d7/d10/fa7 x:0 0 0 2024-09-13T22:56:12.701 INFO:tasks.workunit.client.0.smithi002.stdout:3/577: sync 2024-09-13T22:56:12.716 INFO:tasks.workunit.client.1.smithi047.stdout:1/601: dread d0/d1d/f2e [0,4194304] 0 2024-09-13T22:56:12.716 INFO:tasks.workunit.client.1.smithi047.stdout:9/530: sync 2024-09-13T22:56:12.716 INFO:tasks.workunit.client.1.smithi047.stdout:1/602: fdatasync d0/d7/f74 0 2024-09-13T22:56:12.717 INFO:tasks.workunit.client.1.smithi047.stdout:9/531: write d1/dc/d14/dd/d4c/f57 [591041,26186] 0 2024-09-13T22:56:12.717 INFO:tasks.workunit.client.1.smithi047.stdout:1/603: write d0/d7/d14/fa1 [633843,112083] 0 2024-09-13T22:56:12.720 INFO:tasks.workunit.client.1.smithi047.stdout:9/532: write d1/dc/d14/dd/d54/d50/d5b/d9e/f81 [818153,89106] 0 2024-09-13T22:56:12.720 INFO:tasks.workunit.client.0.smithi002.stdout:5/502: symlink d1/d2a/d6b/d88/d45/d4f/d8f/lb3 0 2024-09-13T22:56:12.720 INFO:tasks.workunit.client.0.smithi002.stdout:6/513: symlink d12/d17/d34/d4b/la8 0 2024-09-13T22:56:12.721 INFO:tasks.workunit.client.1.smithi047.stdout:1/604: creat d0/d7/d14/d28/d36/fa8 x:0 0 0 2024-09-13T22:56:12.721 INFO:tasks.workunit.client.0.smithi002.stdout:9/553: write d8/d1e/f41 [2724011,34410] 0 2024-09-13T22:56:12.721 INFO:tasks.workunit.client.0.smithi002.stdout:8/474: mknod d3/d21/c92 0 2024-09-13T22:56:12.723 INFO:tasks.workunit.client.0.smithi002.stdout:5/503: dread d1/d2a/d69/fa4 [0,4194304] 0 2024-09-13T22:56:12.723 INFO:tasks.workunit.client.0.smithi002.stdout:8/475: fsync d3/d27/d39/f5c 0 2024-09-13T22:56:12.724 INFO:tasks.workunit.client.0.smithi002.stdout:6/514: write d12/d17/d34/d4b/f76 [23544,107898] 0 2024-09-13T22:56:12.724 INFO:tasks.workunit.client.1.smithi047.stdout:9/533: mknod d1/dc/d18/ca8 0 2024-09-13T22:56:12.725 INFO:tasks.workunit.client.0.smithi002.stdout:6/515: write d12/fa5 [1017763,94545] 0 2024-09-13T22:56:12.728 INFO:tasks.workunit.client.0.smithi002.stdout:6/516: dread d12/d17/f4a [4194304,4194304] 0 2024-09-13T22:56:12.729 INFO:tasks.workunit.client.0.smithi002.stdout:6/517: write d12/d17/d34/d39/d8a/f8e [710435,83244] 0 2024-09-13T22:56:12.730 INFO:tasks.workunit.client.0.smithi002.stdout:6/518: truncate d12/d17/d2a/f97 991455 0 2024-09-13T22:56:12.731 INFO:tasks.workunit.client.0.smithi002.stdout:4/461: creat d3/d14/d85/f8d x:0 0 0 2024-09-13T22:56:12.732 INFO:tasks.workunit.client.0.smithi002.stdout:3/578: chown d9/d15/d46/lb5 439 1 2024-09-13T22:56:12.733 INFO:tasks.workunit.client.0.smithi002.stdout:7/434: creat d8/d10/d11/d13/d2e/d50/f78 x:0 0 0 2024-09-13T22:56:12.735 INFO:tasks.workunit.client.0.smithi002.stdout:9/554: rename d8/c5b to d8/d91/cbd 0 2024-09-13T22:56:12.737 INFO:tasks.workunit.client.0.smithi002.stdout:8/476: creat d3/dc/d51/d6e/f93 x:0 0 0 2024-09-13T22:56:12.739 INFO:tasks.workunit.client.1.smithi047.stdout:1/605: symlink d0/d7/d14/d57/d62/d8a/la9 0 2024-09-13T22:56:12.740 INFO:tasks.workunit.client.1.smithi047.stdout:1/606: fdatasync d0/d7/db/d79/f7b 0 2024-09-13T22:56:12.741 INFO:tasks.workunit.client.1.smithi047.stdout:9/534: creat d1/dc/d14/dd/d54/d50/d91/da3/fa9 x:0 0 0 2024-09-13T22:56:12.745 INFO:tasks.workunit.client.0.smithi002.stdout:7/435: creat d8/d10/d11/d13/f79 x:0 0 0 2024-09-13T22:56:12.750 INFO:tasks.workunit.client.0.smithi002.stdout:5/504: symlink d1/d2a/lb4 0 2024-09-13T22:56:12.754 INFO:tasks.workunit.client.1.smithi047.stdout:1/607: dread d0/d7/db/f6b [0,4194304] 0 2024-09-13T22:56:12.754 INFO:tasks.workunit.client.0.smithi002.stdout:6/519: write d12/d17/d28/d67/d6b/f9d [185162,103361] 0 2024-09-13T22:56:12.755 INFO:tasks.workunit.client.1.smithi047.stdout:9/535: dread d1/dc/d14/dd/d54/d50/f66 [0,4194304] 0 2024-09-13T22:56:12.755 INFO:tasks.workunit.client.1.smithi047.stdout:1/608: read - d0/d7/d14/d28/f9a zero size 2024-09-13T22:56:12.756 INFO:tasks.workunit.client.0.smithi002.stdout:1/537: link d1/d13/d30/d31/d3d/c50 d1/d13/d30/d31/d3b/d71/cae 0 2024-09-13T22:56:12.757 INFO:tasks.workunit.client.0.smithi002.stdout:1/538: chown d1/d13/d30/d31/d3d/d5d/l42 68398777 1 2024-09-13T22:56:12.758 INFO:tasks.workunit.client.0.smithi002.stdout:3/579: creat d9/dd1/fd4 x:0 0 0 2024-09-13T22:56:12.760 INFO:tasks.workunit.client.1.smithi047.stdout:1/609: dread d0/d7/d10/f49 [0,4194304] 0 2024-09-13T22:56:12.761 INFO:tasks.workunit.client.1.smithi047.stdout:1/610: readlink d0/d7/d75/l7d 0 2024-09-13T22:56:12.764 INFO:tasks.workunit.client.0.smithi002.stdout:2/499: sync 2024-09-13T22:56:12.765 INFO:tasks.workunit.client.0.smithi002.stdout:6/520: dread d12/d17/f48 [0,4194304] 0 2024-09-13T22:56:12.766 INFO:tasks.workunit.client.1.smithi047.stdout:1/611: dread d0/d7/d10/f49 [0,4194304] 0 2024-09-13T22:56:12.766 INFO:tasks.workunit.client.0.smithi002.stdout:3/580: mknod d9/d3b/d7c/cd5 0 2024-09-13T22:56:12.767 INFO:tasks.workunit.client.1.smithi047.stdout:1/612: readlink d0/d7/d10/d55/l65 0 2024-09-13T22:56:12.774 INFO:tasks.workunit.client.1.smithi047.stdout:1/613: rmdir d0/d7/d13/d5d/d89/da6 0 2024-09-13T22:56:12.774 INFO:tasks.workunit.client.0.smithi002.stdout:4/462: dread d3/d14/d25/f8a [0,4194304] 0 2024-09-13T22:56:12.774 INFO:tasks.workunit.client.0.smithi002.stdout:4/463: chown d3/d14/d29/d2a/d30/l41 1050683498 1 2024-09-13T22:56:12.775 INFO:tasks.workunit.client.0.smithi002.stdout:6/521: getdents d12 0 2024-09-13T22:56:12.777 INFO:tasks.workunit.client.0.smithi002.stdout:8/477: rename d3/dc/d51/d6e to d3/dc/d18/d2e/d94 0 2024-09-13T22:56:12.779 INFO:tasks.workunit.client.1.smithi047.stdout:1/614: rename d0/d7/d14/d71 to d0/d1d/daa 0 2024-09-13T22:56:12.784 INFO:tasks.workunit.client.1.smithi047.stdout:1/615: creat d0/d7/d14/d57/d62/d76/d94/fab x:0 0 0 2024-09-13T22:56:12.784 INFO:tasks.workunit.client.1.smithi047.stdout:1/616: mknod d0/d7/d13/d5d/d89/cac 0 2024-09-13T22:56:12.786 INFO:tasks.workunit.client.1.smithi047.stdout:1/617: rename d0/d7/d14/l52 to d0/d7/db/d79/lad 0 2024-09-13T22:56:12.788 INFO:tasks.workunit.client.1.smithi047.stdout:1/618: chown d0/d7/d14/d57/d62/d76 194 1 2024-09-13T22:56:12.788 INFO:tasks.workunit.client.1.smithi047.stdout:9/536: dwrite d1/dc/d14/dd/d54/f4f [4194304,4194304] 0 2024-09-13T22:56:12.793 INFO:tasks.workunit.client.1.smithi047.stdout:9/537: rename d1/dc/f43 to d1/dc/d14/da0/faa 0 2024-09-13T22:56:12.796 INFO:tasks.workunit.client.1.smithi047.stdout:9/538: creat d1/dc/d18/fab x:0 0 0 2024-09-13T22:56:12.799 INFO:tasks.workunit.client.1.smithi047.stdout:1/619: write d0/d7/d14/d28/f48 [158306,11970] 0 2024-09-13T22:56:12.803 INFO:tasks.workunit.client.1.smithi047.stdout:1/620: truncate d0/d7/f44 6834914 0 2024-09-13T22:56:12.813 INFO:tasks.workunit.client.1.smithi047.stdout:1/621: dwrite d0/d7/d14/d28/d36/f3d [0,4194304] 0 2024-09-13T22:56:12.816 INFO:tasks.workunit.client.0.smithi002.stdout:4/464: rmdir d3/d40 39 2024-09-13T22:56:12.817 INFO:tasks.workunit.client.0.smithi002.stdout:9/555: write d8/d1e/f36 [2602746,7875] 0 2024-09-13T22:56:12.818 INFO:tasks.workunit.client.0.smithi002.stdout:1/539: write d1/ff [2526592,42767] 0 2024-09-13T22:56:12.820 INFO:tasks.workunit.client.0.smithi002.stdout:5/505: rename d1/d2a/d6b/l98 to d1/d57/lb5 0 2024-09-13T22:56:12.821 INFO:tasks.workunit.client.1.smithi047.stdout:1/622: dwrite d0/d7/d14/d28/f48 [0,4194304] 0 2024-09-13T22:56:12.822 INFO:tasks.workunit.client.0.smithi002.stdout:8/478: unlink d3/dc/d16/d2f/f71 0 2024-09-13T22:56:12.825 INFO:tasks.workunit.client.0.smithi002.stdout:2/500: rename d1/d7/d35/d3e/d59/d6b/d75/f9b to d1/d4a/fa8 0 2024-09-13T22:56:12.827 INFO:tasks.workunit.client.1.smithi047.stdout:1/623: read d0/d7/d13/f39 [381254,81874] 0 2024-09-13T22:56:12.827 INFO:tasks.workunit.client.0.smithi002.stdout:4/465: symlink d3/d40/l8e 0 2024-09-13T22:56:12.829 INFO:tasks.workunit.client.0.smithi002.stdout:1/540: creat d1/d13/d30/d73/da1/d7d/faf x:0 0 0 2024-09-13T22:56:12.830 INFO:tasks.workunit.client.0.smithi002.stdout:6/522: dwrite d12/fa4 [0,4194304] 0 2024-09-13T22:56:12.832 INFO:tasks.workunit.client.0.smithi002.stdout:2/501: dread - d1/d7/d8/f8a zero size 2024-09-13T22:56:12.833 INFO:tasks.workunit.client.0.smithi002.stdout:5/506: unlink d1/d2a/d6b/d88/d55/d56/f85 0 2024-09-13T22:56:12.834 INFO:tasks.workunit.client.0.smithi002.stdout:7/436: dwrite d8/d9/f54 [0,4194304] 0 2024-09-13T22:56:12.834 INFO:tasks.workunit.client.1.smithi047.stdout:1/624: creat d0/d7/d14/d57/d62/d76/d94/fae x:0 0 0 2024-09-13T22:56:12.835 INFO:tasks.workunit.client.0.smithi002.stdout:7/437: fsync d8/d9/f5c 0 2024-09-13T22:56:12.836 INFO:tasks.workunit.client.1.smithi047.stdout:1/625: read d0/d1d/f97 [39258,8848] 0 2024-09-13T22:56:12.836 INFO:tasks.workunit.client.0.smithi002.stdout:8/479: mkdir d3/dc/d16/d2f/d83/d95 0 2024-09-13T22:56:12.836 INFO:tasks.workunit.client.0.smithi002.stdout:7/438: fsync d8/d9/f5c 0 2024-09-13T22:56:12.837 INFO:tasks.workunit.client.1.smithi047.stdout:1/626: dread - d0/d7/d14/d28/f9a zero size 2024-09-13T22:56:12.837 INFO:tasks.workunit.client.0.smithi002.stdout:4/466: fsync d3/f5d 0 2024-09-13T22:56:12.838 INFO:tasks.workunit.client.0.smithi002.stdout:6/523: dread d12/d17/d2a/f4f [0,4194304] 0 2024-09-13T22:56:12.839 INFO:tasks.workunit.client.0.smithi002.stdout:6/524: chown d12/d17/d34/c86 867402 1 2024-09-13T22:56:12.844 INFO:tasks.workunit.client.0.smithi002.stdout:0/524: sync 2024-09-13T22:56:12.844 INFO:tasks.workunit.client.1.smithi047.stdout:1/627: creat d0/d7/d14/faf x:0 0 0 2024-09-13T22:56:12.846 INFO:tasks.workunit.client.0.smithi002.stdout:2/502: mkdir d1/da9 0 2024-09-13T22:56:12.847 INFO:tasks.workunit.client.0.smithi002.stdout:2/503: readlink d1/d7/l2a 0 2024-09-13T22:56:12.851 INFO:tasks.workunit.client.0.smithi002.stdout:1/541: symlink d1/d13/d30/d73/da1/d7d/lb0 0 2024-09-13T22:56:12.851 INFO:tasks.workunit.client.0.smithi002.stdout:5/507: dread - d1/d10/f75 zero size 2024-09-13T22:56:12.852 INFO:tasks.workunit.client.1.smithi047.stdout:1/628: rename d0/d1d/f2e to d0/d7/d14/d57/d72/fb0 0 2024-09-13T22:56:12.854 INFO:tasks.workunit.client.0.smithi002.stdout:6/525: dread d12/d17/f3c [0,4194304] 0 2024-09-13T22:56:12.856 INFO:tasks.workunit.client.1.smithi047.stdout:1/629: symlink d0/d7/lb1 0 2024-09-13T22:56:12.856 INFO:tasks.workunit.client.0.smithi002.stdout:7/439: dread d8/d10/d11/d13/f34 [0,4194304] 0 2024-09-13T22:56:12.856 INFO:tasks.workunit.client.1.smithi047.stdout:1/630: readlink d0/d7/d14/l3e 0 2024-09-13T22:56:12.857 INFO:tasks.workunit.client.0.smithi002.stdout:0/525: mkdir d1/d4/d75/d31/d32/dbb 0 2024-09-13T22:56:12.863 INFO:tasks.workunit.client.0.smithi002.stdout:5/508: mknod d1/d57/cb6 0 2024-09-13T22:56:12.866 INFO:tasks.workunit.client.1.smithi047.stdout:1/631: creat d0/fb2 x:0 0 0 2024-09-13T22:56:12.868 INFO:tasks.workunit.client.0.smithi002.stdout:4/467: symlink d3/d14/d29/l8f 0 2024-09-13T22:56:12.871 INFO:tasks.workunit.client.0.smithi002.stdout:6/526: truncate d12/d17/d2a/f56 4208534 0 2024-09-13T22:56:12.871 INFO:tasks.workunit.client.0.smithi002.stdout:8/480: dwrite d3/dc/d18/f23 [0,4194304] 0 2024-09-13T22:56:12.873 INFO:tasks.workunit.client.0.smithi002.stdout:8/481: chown d3/dc/d18/d6f/f90 2881665 1 2024-09-13T22:56:12.874 INFO:tasks.workunit.client.0.smithi002.stdout:7/440: truncate d8/f27 297294 0 2024-09-13T22:56:12.875 INFO:tasks.workunit.client.0.smithi002.stdout:2/504: dwrite d1/d4d/f71 [4194304,4194304] 0 2024-09-13T22:56:12.877 INFO:tasks.workunit.client.1.smithi047.stdout:1/632: rename d0/d7/d13/d2d/c8d to d0/d1d/cb3 0 2024-09-13T22:56:12.879 INFO:tasks.workunit.client.0.smithi002.stdout:1/542: symlink d1/d13/d30/d31/lb1 0 2024-09-13T22:56:12.880 INFO:tasks.workunit.client.0.smithi002.stdout:5/509: mkdir d1/d2a/d6b/d88/d45/d4f/db7 0 2024-09-13T22:56:12.880 INFO:tasks.workunit.client.0.smithi002.stdout:4/468: creat d3/d14/d25/f90 x:0 0 0 2024-09-13T22:56:12.886 INFO:tasks.workunit.client.1.smithi047.stdout:1/633: rename d0/d7/f44 to d0/d7/d13/d8c/fb4 0 2024-09-13T22:56:12.886 INFO:tasks.workunit.client.0.smithi002.stdout:8/482: rmdir d3/dc/d18/d6f 39 2024-09-13T22:56:12.887 INFO:tasks.workunit.client.1.smithi047.stdout:1/634: dread - d0/d7/db/f98 zero size 2024-09-13T22:56:12.888 INFO:tasks.workunit.client.1.smithi047.stdout:1/635: chown d0/d7/d14/d57/d72/c81 4 1 2024-09-13T22:56:12.888 INFO:tasks.workunit.client.0.smithi002.stdout:4/469: write d3/f12 [5238181,12907] 0 2024-09-13T22:56:12.889 INFO:tasks.workunit.client.0.smithi002.stdout:1/543: truncate d1/d13/d1d/d34/f7a 814041 0 2024-09-13T22:56:12.890 INFO:tasks.workunit.client.1.smithi047.stdout:1/636: write d0/d7/d14/d28/f9a [112845,3707] 0 2024-09-13T22:56:12.890 INFO:tasks.workunit.client.0.smithi002.stdout:0/526: link d1/d4/d75/f58 d1/d4/d75/d31/fbc 0 2024-09-13T22:56:12.892 INFO:tasks.workunit.client.0.smithi002.stdout:1/544: stat d1/d13/d30/d31/d3b/d71 0 2024-09-13T22:56:12.892 INFO:tasks.workunit.client.0.smithi002.stdout:8/483: symlink d3/d27/l96 0 2024-09-13T22:56:12.894 INFO:tasks.workunit.client.0.smithi002.stdout:8/484: chown d3/dc/d18/d2e/d94/f7b 468975197 1 2024-09-13T22:56:12.896 INFO:tasks.workunit.client.1.smithi047.stdout:1/637: rename d0/d7/d14/f2a to d0/d7/d14/d57/d62/d76/d94/fb5 0 2024-09-13T22:56:12.896 INFO:tasks.workunit.client.1.smithi047.stdout:1/638: stat d0/d1d/d7f 0 2024-09-13T22:56:12.897 INFO:tasks.workunit.client.0.smithi002.stdout:6/527: creat d12/d17/d34/fa9 x:0 0 0 2024-09-13T22:56:12.897 INFO:tasks.workunit.client.0.smithi002.stdout:5/510: dread d1/d2a/d6b/d88/f46 [0,4194304] 0 2024-09-13T22:56:12.901 INFO:tasks.workunit.client.1.smithi047.stdout:1/639: mkdir d0/d7/d14/d57/db6 0 2024-09-13T22:56:12.903 INFO:tasks.workunit.client.0.smithi002.stdout:6/528: mkdir d12/d17/d28/d67/d6b/daa 0 2024-09-13T22:56:12.903 INFO:tasks.workunit.client.0.smithi002.stdout:6/529: read - d12/d17/d34/d4b/f68 zero size 2024-09-13T22:56:12.904 INFO:tasks.workunit.client.0.smithi002.stdout:3/581: sync 2024-09-13T22:56:12.907 INFO:tasks.workunit.client.0.smithi002.stdout:1/545: creat d1/d13/d1d/d34/da7/fb2 x:0 0 0 2024-09-13T22:56:12.908 INFO:tasks.workunit.client.0.smithi002.stdout:8/485: mkdir d3/dc/d16/d97 0 2024-09-13T22:56:12.910 INFO:tasks.workunit.client.0.smithi002.stdout:6/530: write d12/d17/d4e/f61 [843136,59474] 0 2024-09-13T22:56:12.912 INFO:tasks.workunit.client.0.smithi002.stdout:1/546: truncate d1/d13/f32 360969 0 2024-09-13T22:56:12.913 INFO:tasks.workunit.client.1.smithi047.stdout:1/640: dread d0/f5 [0,4194304] 0 2024-09-13T22:56:12.914 INFO:tasks.workunit.client.0.smithi002.stdout:7/441: dwrite d8/d10/f32 [0,4194304] 0 2024-09-13T22:56:12.915 INFO:tasks.workunit.client.0.smithi002.stdout:6/531: dread - d12/d17/d28/d67/f6d zero size 2024-09-13T22:56:12.916 INFO:tasks.workunit.client.0.smithi002.stdout:3/582: creat d9/d15/fd6 x:0 0 0 2024-09-13T22:56:12.919 INFO:tasks.workunit.client.1.smithi047.stdout:1/641: dwrite d0/d7/db/f3a [0,4194304] 0 2024-09-13T22:56:12.921 INFO:tasks.workunit.client.0.smithi002.stdout:3/583: creat d9/d15/d35/fd7 x:0 0 0 2024-09-13T22:56:12.921 INFO:tasks.workunit.client.0.smithi002.stdout:6/532: write d12/f51 [3055971,61123] 0 2024-09-13T22:56:12.925 INFO:tasks.workunit.client.0.smithi002.stdout:7/442: unlink d8/d10/d11/d13/d26/d4c/f53 0 2024-09-13T22:56:12.926 INFO:tasks.workunit.client.0.smithi002.stdout:4/470: dwrite d3/f5d [0,4194304] 0 2024-09-13T22:56:12.929 INFO:tasks.workunit.client.0.smithi002.stdout:4/471: chown d3/c2e 32 1 2024-09-13T22:56:12.929 INFO:tasks.workunit.client.0.smithi002.stdout:8/486: dread d3/dc/d16/d4b/f6c [0,4194304] 0 2024-09-13T22:56:12.930 INFO:tasks.workunit.client.0.smithi002.stdout:7/443: write d8/d9/d46/f4b [1695344,30508] 0 2024-09-13T22:56:12.930 INFO:tasks.workunit.client.1.smithi047.stdout:1/642: dwrite d0/d7/db/f38 [4194304,4194304] 0 2024-09-13T22:56:12.930 INFO:tasks.workunit.client.0.smithi002.stdout:5/511: dwrite d1/f8 [4194304,4194304] 0 2024-09-13T22:56:12.931 INFO:tasks.workunit.client.0.smithi002.stdout:1/547: rename d1/d13/d30/fa to d1/d13/d30/d31/d3b/d71/fb3 0 2024-09-13T22:56:12.933 INFO:tasks.workunit.client.0.smithi002.stdout:4/472: write d3/d14/d85/f8d [868981,20820] 0 2024-09-13T22:56:12.933 INFO:tasks.workunit.client.0.smithi002.stdout:7/444: chown d8/d10/d11/d13/d2e/d50 39499114 1 2024-09-13T22:56:12.933 INFO:tasks.workunit.client.0.smithi002.stdout:8/487: write d3/dc/d16/f4d [4494162,21501] 0 2024-09-13T22:56:12.935 INFO:tasks.workunit.client.0.smithi002.stdout:6/533: unlink d12/d17/d4e/c84 0 2024-09-13T22:56:12.936 INFO:tasks.workunit.client.0.smithi002.stdout:1/548: write d1/d13/d21/d39/d70/f96 [4709198,10873] 0 2024-09-13T22:56:12.938 INFO:tasks.workunit.client.0.smithi002.stdout:6/534: stat d12/d17/d34/d39/ca1 0 2024-09-13T22:56:12.939 INFO:tasks.workunit.client.0.smithi002.stdout:5/512: mkdir d1/d2a/d69/db8 0 2024-09-13T22:56:12.943 INFO:tasks.workunit.client.0.smithi002.stdout:9/556: sync 2024-09-13T22:56:12.958 INFO:tasks.workunit.client.0.smithi002.stdout:8/488: dread d3/f36 [0,4194304] 0 2024-09-13T22:56:12.986 INFO:tasks.workunit.client.0.smithi002.stdout:2/505: sync 2024-09-13T22:56:12.987 INFO:tasks.workunit.client.0.smithi002.stdout:0/527: sync 2024-09-13T22:56:12.987 INFO:tasks.workunit.client.0.smithi002.stdout:2/506: fsync d1/d7/d41/d96/f97 0 2024-09-13T22:56:12.988 INFO:tasks.workunit.client.0.smithi002.stdout:2/507: dread - d1/d7/d41/d96/f97 zero size 2024-09-13T22:56:12.998 INFO:tasks.workunit.client.1.smithi047.stdout:3/584: sync 2024-09-13T22:56:12.999 INFO:tasks.workunit.client.1.smithi047.stdout:3/585: readlink d0/d3/d4/d16/d32/d42/d79/d9c/dad/lb1 0 2024-09-13T22:56:13.001 INFO:tasks.workunit.client.1.smithi047.stdout:3/586: chown d0/d3/d4/d16/d2c/de/d1f/d3b/d69/f7d 0 1 2024-09-13T22:56:13.001 INFO:tasks.workunit.client.1.smithi047.stdout:1/643: mknod d0/d7/d87/cb7 0 2024-09-13T22:56:13.005 INFO:tasks.workunit.client.1.smithi047.stdout:1/644: creat d0/d7/db/fb8 x:0 0 0 2024-09-13T22:56:13.008 INFO:tasks.workunit.client.1.smithi047.stdout:3/587: creat d0/d3/d4/d16/d32/d42/fbb x:0 0 0 2024-09-13T22:56:13.012 INFO:tasks.workunit.client.1.smithi047.stdout:3/588: chown d0/d3/d4/d16/d1c/fae 169615960 1 2024-09-13T22:56:13.016 INFO:tasks.workunit.client.1.smithi047.stdout:1/645: symlink d0/d7/d10/lb9 0 2024-09-13T22:56:13.019 INFO:tasks.workunit.client.0.smithi002.stdout:5/513: sync 2024-09-13T22:56:13.019 INFO:tasks.workunit.client.0.smithi002.stdout:3/584: dwrite d9/d15/d51/f18 [4194304,4194304] 0 2024-09-13T22:56:13.021 INFO:tasks.workunit.client.0.smithi002.stdout:2/508: mkdir d1/d7/d52/daa 0 2024-09-13T22:56:13.023 INFO:tasks.workunit.client.0.smithi002.stdout:4/473: write d3/d14/d29/d2a/f43 [332386,1745] 0 2024-09-13T22:56:13.026 INFO:tasks.workunit.client.0.smithi002.stdout:7/445: rename d8/d10/d11/d13/d2e/d50/f78 to d8/d10/d39/d60/f7a 0 2024-09-13T22:56:13.028 INFO:tasks.workunit.client.0.smithi002.stdout:6/535: symlink d12/d17/d28/d67/lab 0 2024-09-13T22:56:13.029 INFO:tasks.workunit.client.1.smithi047.stdout:3/589: dread d0/f12 [0,4194304] 0 2024-09-13T22:56:13.029 INFO:tasks.workunit.client.0.smithi002.stdout:8/489: dread d3/f35 [0,4194304] 0 2024-09-13T22:56:13.033 INFO:tasks.workunit.client.0.smithi002.stdout:0/528: creat d1/d4/d75/d31/d32/dbb/fbd x:0 0 0 2024-09-13T22:56:13.034 INFO:tasks.workunit.client.1.smithi047.stdout:1/646: write d0/d1d/f97 [1145014,15593] 0 2024-09-13T22:56:13.035 INFO:tasks.workunit.client.1.smithi047.stdout:1/647: read d0/d7/f12 [2000159,78516] 0 2024-09-13T22:56:13.036 INFO:tasks.workunit.client.0.smithi002.stdout:5/514: mknod d1/d2a/d6b/d88/d55/d56/d86/cb9 0 2024-09-13T22:56:13.037 INFO:tasks.workunit.client.0.smithi002.stdout:3/585: truncate d9/d15/d51/f2e 1298171 0 2024-09-13T22:56:13.037 INFO:tasks.workunit.client.0.smithi002.stdout:1/549: dwrite d1/d13/d30/d31/d3d/f8b [0,4194304] 0 2024-09-13T22:56:13.037 INFO:tasks.workunit.client.0.smithi002.stdout:5/515: fdatasync d1/d2a/d6b/d88/d45/f54 0 2024-09-13T22:56:13.039 INFO:tasks.workunit.client.0.smithi002.stdout:5/516: fdatasync d1/d2a/d6b/d88/d45/f54 0 2024-09-13T22:56:13.042 INFO:tasks.workunit.client.0.smithi002.stdout:4/474: creat d3/d14/d25/d69/f91 x:0 0 0 2024-09-13T22:56:13.048 INFO:tasks.workunit.client.0.smithi002.stdout:9/557: creat d8/fbe x:0 0 0 2024-09-13T22:56:13.049 INFO:tasks.workunit.client.0.smithi002.stdout:4/475: dread d3/d14/d29/d2a/d30/f58 [0,4194304] 0 2024-09-13T22:56:13.049 INFO:tasks.workunit.client.1.smithi047.stdout:1/648: creat d0/d7/fba x:0 0 0 2024-09-13T22:56:13.050 INFO:tasks.workunit.client.0.smithi002.stdout:4/476: write d3/f12 [172484,78597] 0 2024-09-13T22:56:13.050 INFO:tasks.workunit.client.0.smithi002.stdout:4/477: dread - d3/d40/f88 zero size 2024-09-13T22:56:13.051 INFO:tasks.workunit.client.1.smithi047.stdout:3/590: dread d0/d3/f15 [0,4194304] 0 2024-09-13T22:56:13.051 INFO:tasks.workunit.client.1.smithi047.stdout:1/649: read d0/d7/d10/f6c [857695,125892] 0 2024-09-13T22:56:13.051 INFO:tasks.workunit.client.0.smithi002.stdout:8/490: unlink d3/d21/d57/l4e 0 2024-09-13T22:56:13.052 INFO:tasks.workunit.client.1.smithi047.stdout:1/650: dread - d0/d7/db/f98 zero size 2024-09-13T22:56:13.054 INFO:tasks.workunit.client.1.smithi047.stdout:1/651: chown d0/d7/d14/d57/d72/l92 22 1 2024-09-13T22:56:13.060 INFO:tasks.workunit.client.0.smithi002.stdout:3/586: unlink d9/d15/d36/d4e/d5e/fc6 0 2024-09-13T22:56:13.061 INFO:tasks.workunit.client.0.smithi002.stdout:7/446: write d8/d10/d11/d13/d2e/d3c/f59 [2341906,116911] 0 2024-09-13T22:56:13.061 INFO:tasks.workunit.client.0.smithi002.stdout:7/447: read d8/d9/f5c [157156,61010] 0 2024-09-13T22:56:13.062 INFO:tasks.workunit.client.0.smithi002.stdout:7/448: chown d8/d9/f57 8677301 1 2024-09-13T22:56:13.062 INFO:tasks.workunit.client.1.smithi047.stdout:1/652: rename d0/d7/f12 to d0/d7/d14/d57/d62/d76/fbb 0 2024-09-13T22:56:13.063 INFO:tasks.workunit.client.0.smithi002.stdout:7/449: dread - d8/d10/d11/d13/d2e/d50/f61 zero size 2024-09-13T22:56:13.065 INFO:tasks.workunit.client.1.smithi047.stdout:3/591: creat d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d3a/d81/fbc x:0 0 0 2024-09-13T22:56:13.066 INFO:tasks.workunit.client.1.smithi047.stdout:3/592: readlink d0/d3/d4/d16/d1c/l67 0 2024-09-13T22:56:13.067 INFO:tasks.workunit.client.0.smithi002.stdout:2/509: mkdir d1/d7/d8/d2c/d9d/dab 0 2024-09-13T22:56:13.069 INFO:tasks.workunit.client.1.smithi047.stdout:1/653: symlink d0/d7/d14/d57/d62/d76/lbc 0 2024-09-13T22:56:13.070 INFO:tasks.workunit.client.1.smithi047.stdout:1/654: dread - d0/d7/d14/d28/d36/fa8 zero size 2024-09-13T22:56:13.070 INFO:tasks.workunit.client.0.smithi002.stdout:5/517: rmdir d1/d2a 39 2024-09-13T22:56:13.070 INFO:tasks.workunit.client.1.smithi047.stdout:1/655: dread - d0/d7/d14/d28/d36/f96 zero size 2024-09-13T22:56:13.075 INFO:tasks.workunit.client.0.smithi002.stdout:4/478: rmdir d3/d14/d25/d5e 39 2024-09-13T22:56:13.075 INFO:tasks.workunit.client.0.smithi002.stdout:4/479: stat d3/d40/f88 0 2024-09-13T22:56:13.079 INFO:tasks.workunit.client.1.smithi047.stdout:1/656: link d0/d7/d14/l5e d0/d7/d14/d57/d62/d8a/lbd 0 2024-09-13T22:56:13.080 INFO:tasks.workunit.client.1.smithi047.stdout:1/657: chown d0/d7/d14/d57/d62/d76/d94 2 1 2024-09-13T22:56:13.081 INFO:tasks.workunit.client.1.smithi047.stdout:3/593: dread d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/f49 [0,4194304] 0 2024-09-13T22:56:13.085 INFO:tasks.workunit.client.1.smithi047.stdout:1/658: symlink d0/d7/db/lbe 0 2024-09-13T22:56:13.086 INFO:tasks.workunit.client.0.smithi002.stdout:2/510: creat d1/d4d/fac x:0 0 0 2024-09-13T22:56:13.088 INFO:tasks.workunit.client.0.smithi002.stdout:5/518: symlink d1/d57/lba 0 2024-09-13T22:56:13.092 INFO:tasks.workunit.client.1.smithi047.stdout:1/659: dwrite d0/d7/d14/d28/d36/f96 [0,4194304] 0 2024-09-13T22:56:13.092 INFO:tasks.workunit.client.0.smithi002.stdout:9/558: mkdir d8/d10/d1c/dbf 0 2024-09-13T22:56:13.092 INFO:tasks.workunit.client.0.smithi002.stdout:9/559: chown d8/c4b 1 1 2024-09-13T22:56:13.093 INFO:tasks.workunit.client.1.smithi047.stdout:3/594: dread d0/f5c [0,4194304] 0 2024-09-13T22:56:13.095 INFO:tasks.workunit.client.0.smithi002.stdout:8/491: write d3/d21/d57/f68 [944753,61586] 0 2024-09-13T22:56:13.097 INFO:tasks.workunit.client.0.smithi002.stdout:6/536: link d12/d17/d4e/f52 d12/d17/d28/fac 0 2024-09-13T22:56:13.098 INFO:tasks.workunit.client.0.smithi002.stdout:3/587: write d9/d15/d51/fcc [167181,22639] 0 2024-09-13T22:56:13.099 INFO:tasks.workunit.client.0.smithi002.stdout:4/480: truncate d3/d40/f88 427714 0 2024-09-13T22:56:13.100 INFO:tasks.workunit.client.0.smithi002.stdout:9/560: dwrite d8/d10/d1c/d3d/f7d [0,4194304] 0 2024-09-13T22:56:13.100 INFO:tasks.workunit.client.1.smithi047.stdout:3/595: mkdir d0/d3/d4/d16/d32/d42/dbd 0 2024-09-13T22:56:13.101 INFO:tasks.workunit.client.0.smithi002.stdout:3/588: chown d9/d15/d46/f9b 45382661 1 2024-09-13T22:56:13.104 INFO:tasks.workunit.client.0.smithi002.stdout:3/589: dread - d9/d15/d26/fd2 zero size 2024-09-13T22:56:13.111 INFO:tasks.workunit.client.0.smithi002.stdout:2/511: creat d1/d7/d35/d3e/d59/d6b/fad x:0 0 0 2024-09-13T22:56:13.113 INFO:tasks.workunit.client.1.smithi047.stdout:1/660: rename d0/d7/d14/l5e to d0/d7/d14/d57/lbf 0 2024-09-13T22:56:13.114 INFO:tasks.workunit.client.1.smithi047.stdout:1/661: stat d0/d7/d13/c82 0 2024-09-13T22:56:13.116 INFO:tasks.workunit.client.1.smithi047.stdout:1/662: mknod d0/d7/db/cc0 0 2024-09-13T22:56:13.117 INFO:tasks.workunit.client.0.smithi002.stdout:2/512: dwrite d1/d7/d41/d96/f97 [0,4194304] 0 2024-09-13T22:56:13.118 INFO:tasks.workunit.client.0.smithi002.stdout:8/492: rename d3/dc/d16/d2f/f47 to d3/dc/d16/d2f/d83/d85/f98 0 2024-09-13T22:56:13.121 INFO:tasks.workunit.client.1.smithi047.stdout:3/596: rename d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/f27 to d0/d3/d4/d16/d2c/d7e/fbe 0 2024-09-13T22:56:13.121 INFO:tasks.workunit.client.0.smithi002.stdout:0/529: getdents d1/d4/d75/d31/d32/dbb 0 2024-09-13T22:56:13.123 INFO:tasks.workunit.client.0.smithi002.stdout:2/513: dwrite d1/d7/d8/d2c/da4/f85 [0,4194304] 0 2024-09-13T22:56:13.124 INFO:tasks.workunit.client.0.smithi002.stdout:3/590: creat d9/d3b/d53/d95/fd8 x:0 0 0 2024-09-13T22:56:13.125 INFO:tasks.workunit.client.1.smithi047.stdout:1/663: truncate d0/d7/db/d79/f7b 2162984 0 2024-09-13T22:56:13.125 INFO:tasks.workunit.client.0.smithi002.stdout:3/591: fdatasync d9/d15/d36/d4e/f8b 0 2024-09-13T22:56:13.126 INFO:tasks.workunit.client.0.smithi002.stdout:1/550: getdents d1/d13/d30/d73 0 2024-09-13T22:56:13.126 INFO:tasks.workunit.client.1.smithi047.stdout:1/664: write d0/d7/d75/f85 [93090,36801] 0 2024-09-13T22:56:13.129 INFO:tasks.workunit.client.1.smithi047.stdout:3/597: truncate d0/f12 1715126 0 2024-09-13T22:56:13.129 INFO:tasks.workunit.client.0.smithi002.stdout:7/450: sync 2024-09-13T22:56:13.137 INFO:tasks.workunit.client.0.smithi002.stdout:5/519: rmdir d1/d2a/d5a 39 2024-09-13T22:56:13.138 INFO:tasks.workunit.client.0.smithi002.stdout:5/520: chown d1/d2a/d6b/d88/f46 12 1 2024-09-13T22:56:13.144 INFO:tasks.workunit.client.1.smithi047.stdout:1/665: link d0/d7/db/f98 d0/d7/d14/d57/d62/fc1 0 2024-09-13T22:56:13.145 INFO:tasks.workunit.client.0.smithi002.stdout:6/537: truncate d12/d17/d2a/f56 5149314 0 2024-09-13T22:56:13.147 INFO:tasks.workunit.client.1.smithi047.stdout:3/598: chown d0/d3/d4/d16/d2c/d7e/la4 675617 1 2024-09-13T22:56:13.148 INFO:tasks.workunit.client.1.smithi047.stdout:1/666: dread d0/f4f [0,4194304] 0 2024-09-13T22:56:13.148 INFO:tasks.workunit.client.0.smithi002.stdout:8/493: chown d3/d21/l45 2236 1 2024-09-13T22:56:13.150 INFO:tasks.workunit.client.0.smithi002.stdout:4/481: mknod d3/d14/d25/c92 0 2024-09-13T22:56:13.151 INFO:tasks.workunit.client.0.smithi002.stdout:9/561: creat d8/d2c/da6/fc0 x:0 0 0 2024-09-13T22:56:13.151 INFO:tasks.workunit.client.0.smithi002.stdout:4/482: read d3/d14/d29/d2a/f71 [652741,105297] 0 2024-09-13T22:56:13.152 INFO:tasks.workunit.client.0.smithi002.stdout:4/483: chown d3/d14/d25/d69/c7b 14 1 2024-09-13T22:56:13.153 INFO:tasks.workunit.client.0.smithi002.stdout:4/484: chown d3/d62/f81 409 1 2024-09-13T22:56:13.153 INFO:tasks.workunit.client.0.smithi002.stdout:4/485: dread - d3/d62/f81 zero size 2024-09-13T22:56:13.160 INFO:tasks.workunit.client.0.smithi002.stdout:3/592: unlink d9/d15/d46/la8 0 2024-09-13T22:56:13.160 INFO:tasks.workunit.client.0.smithi002.stdout:1/551: unlink d1/d13/d1d/d34/d51/c9a 0 2024-09-13T22:56:13.162 INFO:tasks.workunit.client.1.smithi047.stdout:1/667: symlink d0/d7/d14/d57/lc2 0 2024-09-13T22:56:13.163 INFO:tasks.workunit.client.0.smithi002.stdout:7/451: symlink d8/d10/d11/d13/d2e/d3c/l7b 0 2024-09-13T22:56:13.163 INFO:tasks.workunit.client.1.smithi047.stdout:1/668: readlink d0/d7/d13/d2d/l45 0 2024-09-13T22:56:13.166 INFO:tasks.workunit.client.0.smithi002.stdout:6/538: dread d12/d17/f20 [0,4194304] 0 2024-09-13T22:56:13.166 INFO:tasks.workunit.client.1.smithi047.stdout:3/599: dwrite d0/d3/d4/d16/d32/d42/f64 [0,4194304] 0 2024-09-13T22:56:13.167 INFO:tasks.workunit.client.0.smithi002.stdout:6/539: chown d12/f63 52060002 1 2024-09-13T22:56:13.167 INFO:tasks.workunit.client.0.smithi002.stdout:9/562: mknod d8/d10/d1c/d68/cc1 0 2024-09-13T22:56:13.178 INFO:tasks.workunit.client.1.smithi047.stdout:3/600: mknod d0/d3/d4/d16/d32/d76/cbf 0 2024-09-13T22:56:13.180 INFO:tasks.workunit.client.0.smithi002.stdout:3/593: symlink d9/d3b/d53/d95/ld9 0 2024-09-13T22:56:13.182 INFO:tasks.workunit.client.1.smithi047.stdout:1/669: dread d0/f5a [0,4194304] 0 2024-09-13T22:56:13.185 INFO:tasks.workunit.client.0.smithi002.stdout:5/521: mknod d1/d2a/d6b/d88/cbb 0 2024-09-13T22:56:13.186 INFO:tasks.workunit.client.0.smithi002.stdout:5/522: fsync d1/d2a/d69/f73 0 2024-09-13T22:56:13.186 INFO:tasks.workunit.client.1.smithi047.stdout:2/648: sync 2024-09-13T22:56:13.187 INFO:tasks.workunit.client.0.smithi002.stdout:6/540: dread d12/d17/d2a/f32 [0,4194304] 0 2024-09-13T22:56:13.187 INFO:tasks.workunit.client.0.smithi002.stdout:6/541: chown d12/d17/d34/d4b/f76 994 1 2024-09-13T22:56:13.188 INFO:tasks.workunit.client.0.smithi002.stdout:8/494: rename d3/dc/d34 to d3/dc/d51/d99 0 2024-09-13T22:56:13.189 INFO:tasks.workunit.client.1.smithi047.stdout:3/601: fdatasync d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/f90 0 2024-09-13T22:56:13.190 INFO:tasks.workunit.client.0.smithi002.stdout:2/514: write d1/d7/d8/f31 [1224745,55933] 0 2024-09-13T22:56:13.190 INFO:tasks.workunit.client.1.smithi047.stdout:2/649: dread d1/d16/d40/d57/fbe [0,4194304] 0 2024-09-13T22:56:13.191 INFO:tasks.workunit.client.0.smithi002.stdout:2/515: dread - d1/d7/d35/d3e/d59/d87/f99 zero size 2024-09-13T22:56:13.192 INFO:tasks.workunit.client.1.smithi047.stdout:1/670: creat d0/d7/d14/d57/d62/d76/fc3 x:0 0 0 2024-09-13T22:56:13.194 INFO:tasks.workunit.client.0.smithi002.stdout:2/516: dread d1/d4d/f71 [4194304,4194304] 0 2024-09-13T22:56:13.195 INFO:tasks.workunit.client.0.smithi002.stdout:2/517: read d1/d7/d8/f10 [1116979,51388] 0 2024-09-13T22:56:13.197 INFO:tasks.workunit.client.1.smithi047.stdout:3/602: unlink d0/d3/d4/f7b 0 2024-09-13T22:56:13.198 INFO:tasks.workunit.client.0.smithi002.stdout:0/530: link d1/d7e/d9d/cb7 d1/d4/d75/cbe 0 2024-09-13T22:56:13.199 INFO:tasks.workunit.client.1.smithi047.stdout:1/671: symlink d0/d7/d13/d8c/lc4 0 2024-09-13T22:56:13.201 INFO:tasks.workunit.client.0.smithi002.stdout:9/563: dwrite d8/d1e/f25 [0,4194304] 0 2024-09-13T22:56:13.203 INFO:tasks.workunit.client.1.smithi047.stdout:3/603: mknod d0/d3/d4/d16/d2c/de/d1f/d3b/d69/cc0 0 2024-09-13T22:56:13.207 INFO:tasks.workunit.client.0.smithi002.stdout:9/564: dwrite d8/d10/d1c/f15 [0,4194304] 0 2024-09-13T22:56:13.209 INFO:tasks.workunit.client.0.smithi002.stdout:5/523: unlink d1/l64 0 2024-09-13T22:56:13.210 INFO:tasks.workunit.client.0.smithi002.stdout:5/524: stat d1/d2a/d6b/d88/d55/d56/d81/fa5 0 2024-09-13T22:56:13.211 INFO:tasks.workunit.client.1.smithi047.stdout:3/604: rename d0/d3/d4/d16/d2c/de/d3d/f62 to d0/d3/d4/d91/fc1 0 2024-09-13T22:56:13.214 INFO:tasks.workunit.client.0.smithi002.stdout:8/495: chown d3/c14 6 1 2024-09-13T22:56:13.214 INFO:tasks.workunit.client.1.smithi047.stdout:1/672: truncate d0/d7/d14/d57/d62/d76/fbb 3361669 0 2024-09-13T22:56:13.215 INFO:tasks.workunit.client.1.smithi047.stdout:2/650: dread d1/df/d1d/d20/d37/d7a/f84 [0,4194304] 0 2024-09-13T22:56:13.217 INFO:tasks.workunit.client.1.smithi047.stdout:1/673: write d0/d7/d14/d57/f9e [915368,79831] 0 2024-09-13T22:56:13.217 INFO:tasks.workunit.client.0.smithi002.stdout:5/525: dwrite d1/d2a/d6b/d88/f70 [0,4194304] 0 2024-09-13T22:56:13.217 INFO:tasks.workunit.client.1.smithi047.stdout:2/651: fdatasync d1/df/d1d/d20/d37/d7a/fbc 0 2024-09-13T22:56:13.219 INFO:tasks.workunit.client.0.smithi002.stdout:7/452: rename d8/d9 to d8/d10/d11/d13/d7c 0 2024-09-13T22:56:13.220 INFO:tasks.workunit.client.1.smithi047.stdout:3/605: symlink d0/d3/d4/d16/d2c/de/d3d/lc2 0 2024-09-13T22:56:13.220 INFO:tasks.workunit.client.0.smithi002.stdout:5/526: chown d1/d2a/d6b/d88/d45/d4f/d78/d8b/ca8 5610 1 2024-09-13T22:56:13.221 INFO:tasks.workunit.client.1.smithi047.stdout:3/606: stat d0/d3 0 2024-09-13T22:56:13.221 INFO:tasks.workunit.client.0.smithi002.stdout:1/552: write d1/d13/d30/d31/d3b/d71/fb3 [2084377,38177] 0 2024-09-13T22:56:13.221 INFO:tasks.workunit.client.1.smithi047.stdout:0/625: sync 2024-09-13T22:56:13.227 INFO:tasks.workunit.client.0.smithi002.stdout:1/553: dread d1/d13/d1d/d34/d51/f9b [0,4194304] 0 2024-09-13T22:56:13.229 INFO:tasks.workunit.client.1.smithi047.stdout:3/607: dwrite d0/d3/d4/d16/d2c/de/d1f/faf [0,4194304] 0 2024-09-13T22:56:13.232 INFO:tasks.workunit.client.1.smithi047.stdout:2/652: creat d1/df/d35/d8b/fda x:0 0 0 2024-09-13T22:56:13.234 INFO:tasks.workunit.client.1.smithi047.stdout:2/653: readlink d1/df/d1d/d20/d37/d7b/l88 0 2024-09-13T22:56:13.235 INFO:tasks.workunit.client.1.smithi047.stdout:0/626: dread d1/d5/d16/d47/f4a [0,4194304] 0 2024-09-13T22:56:13.236 INFO:tasks.workunit.client.0.smithi002.stdout:2/518: unlink d1/d7/d8/f33 0 2024-09-13T22:56:13.241 INFO:tasks.workunit.client.0.smithi002.stdout:4/486: creat d3/d40/f93 x:0 0 0 2024-09-13T22:56:13.243 INFO:tasks.workunit.client.1.smithi047.stdout:1/674: write d0/d7/d14/d57/d62/fc1 [150522,119719] 0 2024-09-13T22:56:13.243 INFO:tasks.workunit.client.0.smithi002.stdout:1/554: dread d1/f27 [0,4194304] 0 2024-09-13T22:56:13.244 INFO:tasks.workunit.client.1.smithi047.stdout:1/675: fdatasync d0/d7/d10/f43 0 2024-09-13T22:56:13.244 INFO:tasks.workunit.client.0.smithi002.stdout:4/487: dread d3/f10 [0,4194304] 0 2024-09-13T22:56:13.245 INFO:tasks.workunit.client.1.smithi047.stdout:2/654: mknod d1/df/d26/d9f/cdb 0 2024-09-13T22:56:13.245 INFO:tasks.workunit.client.1.smithi047.stdout:1/676: chown d0/d7/d14/d28 0 1 2024-09-13T22:56:13.247 INFO:tasks.workunit.client.0.smithi002.stdout:9/565: rename d8/d10/d1c/d3d/f7d to d8/d10/d1c/d3d/fc2 0 2024-09-13T22:56:13.248 INFO:tasks.workunit.client.1.smithi047.stdout:3/608: fsync d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d3a/f6d 0 2024-09-13T22:56:13.254 INFO:tasks.workunit.client.0.smithi002.stdout:0/531: rename d1/d2/f19 to d1/d2/d6c/d8b/fbf 0 2024-09-13T22:56:13.255 INFO:tasks.workunit.client.0.smithi002.stdout:0/532: write d1/d2/f18 [3231540,8607] 0 2024-09-13T22:56:13.256 INFO:tasks.workunit.client.0.smithi002.stdout:6/542: creat d12/d17/d28/d67/d6b/daa/fad x:0 0 0 2024-09-13T22:56:13.257 INFO:tasks.workunit.client.0.smithi002.stdout:6/543: chown d12/d17/d28/d67/d6b/f9d 2567669 1 2024-09-13T22:56:13.257 INFO:tasks.workunit.client.1.smithi047.stdout:0/627: mkdir d1/d7/dc9/dca 0 2024-09-13T22:56:13.258 INFO:tasks.workunit.client.1.smithi047.stdout:0/628: fsync d1/d5/d16/d97/db6/fc4 0 2024-09-13T22:56:13.258 INFO:tasks.workunit.client.0.smithi002.stdout:7/453: symlink d8/d10/d11/d13/d2e/d50/d52/l7d 0 2024-09-13T22:56:13.259 INFO:tasks.workunit.client.0.smithi002.stdout:7/454: fdatasync d8/d10/d11/d13/d26/d4c/f64 0 2024-09-13T22:56:13.260 INFO:tasks.workunit.client.0.smithi002.stdout:5/527: creat d1/d2a/d6b/fbc x:0 0 0 2024-09-13T22:56:13.262 INFO:tasks.workunit.client.1.smithi047.stdout:3/609: mkdir d0/d3/d4/d16/d32/d42/d79/d9c/dad/d95/dc3 0 2024-09-13T22:56:13.264 INFO:tasks.workunit.client.0.smithi002.stdout:8/496: dwrite d3/f36 [0,4194304] 0 2024-09-13T22:56:13.265 INFO:tasks.workunit.client.0.smithi002.stdout:8/497: write d3/dc/fd [1709723,117973] 0 2024-09-13T22:56:13.267 INFO:tasks.workunit.client.0.smithi002.stdout:8/498: write d3/dc/d51/d99/f7e [94401,13541] 0 2024-09-13T22:56:13.267 INFO:tasks.workunit.client.1.smithi047.stdout:3/610: dread d0/d3/d4/d16/d2c/de/d1f/faf [0,4194304] 0 2024-09-13T22:56:13.268 INFO:tasks.workunit.client.0.smithi002.stdout:8/499: chown d3/f69 573763 1 2024-09-13T22:56:13.269 INFO:tasks.workunit.client.1.smithi047.stdout:0/629: mknod d1/d5/d16/d97/ccb 0 2024-09-13T22:56:13.271 INFO:tasks.workunit.client.1.smithi047.stdout:0/630: truncate d1/d5/d16/fac 717376 0 2024-09-13T22:56:13.271 INFO:tasks.workunit.client.0.smithi002.stdout:3/594: sync 2024-09-13T22:56:13.276 INFO:tasks.workunit.client.0.smithi002.stdout:1/555: unlink d1/d13/d30/d31/d3b/d71/fb3 0 2024-09-13T22:56:13.281 INFO:tasks.workunit.client.1.smithi047.stdout:2/655: dwrite d1/df/d26/d4b/f50 [0,4194304] 0 2024-09-13T22:56:13.282 INFO:tasks.workunit.client.1.smithi047.stdout:2/656: fdatasync d1/d16/fd8 0 2024-09-13T22:56:13.286 INFO:tasks.workunit.client.1.smithi047.stdout:0/631: mknod d1/d5/d16/d97/ccc 0 2024-09-13T22:56:13.287 INFO:tasks.workunit.client.1.smithi047.stdout:6/640: sync 2024-09-13T22:56:13.287 INFO:tasks.workunit.client.1.smithi047.stdout:4/726: sync 2024-09-13T22:56:13.287 INFO:tasks.workunit.client.1.smithi047.stdout:8/560: sync 2024-09-13T22:56:13.287 INFO:tasks.workunit.client.1.smithi047.stdout:5/545: sync 2024-09-13T22:56:13.287 INFO:tasks.workunit.client.1.smithi047.stdout:7/598: sync 2024-09-13T22:56:13.287 INFO:tasks.workunit.client.1.smithi047.stdout:9/539: sync 2024-09-13T22:56:13.290 INFO:tasks.workunit.client.1.smithi047.stdout:9/540: read d1/f40 [6062456,13128] 0 2024-09-13T22:56:13.290 INFO:tasks.workunit.client.1.smithi047.stdout:3/611: mkdir d0/d3/d4/d16/d2c/d7e/dc4 0 2024-09-13T22:56:13.292 INFO:tasks.workunit.client.1.smithi047.stdout:1/677: getdents d0/d1d/d7f 0 2024-09-13T22:56:13.294 INFO:tasks.workunit.client.1.smithi047.stdout:2/657: creat d1/df/d1d/da9/fdc x:0 0 0 2024-09-13T22:56:13.296 INFO:tasks.workunit.client.1.smithi047.stdout:5/546: write d19/d23/d2e/d41/d58/d77/fa6 [749967,41135] 0 2024-09-13T22:56:13.301 INFO:tasks.workunit.client.0.smithi002.stdout:8/500: rmdir d3/d27 39 2024-09-13T22:56:13.302 INFO:tasks.workunit.client.1.smithi047.stdout:6/641: dwrite d3/f22 [0,4194304] 0 2024-09-13T22:56:13.304 INFO:tasks.workunit.client.1.smithi047.stdout:7/599: truncate d0/f33 3617100 0 2024-09-13T22:56:13.308 INFO:tasks.workunit.client.1.smithi047.stdout:8/561: mkdir d8/d64/dc5 0 2024-09-13T22:56:13.310 INFO:tasks.workunit.client.0.smithi002.stdout:7/455: dwrite d8/d10/d11/d13/f1c [0,4194304] 0 2024-09-13T22:56:13.310 INFO:tasks.workunit.client.1.smithi047.stdout:5/547: dwrite d19/d23/d4c/fa1 [0,4194304] 0 2024-09-13T22:56:13.314 INFO:tasks.workunit.client.0.smithi002.stdout:1/556: write d1/d13/d30/d31/d3d/f8b [918202,23549] 0 2024-09-13T22:56:13.316 INFO:tasks.workunit.client.0.smithi002.stdout:4/488: creat d3/d14/d25/d5e/f94 x:0 0 0 2024-09-13T22:56:13.320 INFO:tasks.workunit.client.1.smithi047.stdout:2/658: creat d1/d16/d40/d57/db0/fdd x:0 0 0 2024-09-13T22:56:13.320 INFO:tasks.workunit.client.1.smithi047.stdout:5/548: write d19/d23/d2e/d41/f5a [5016411,42985] 0 2024-09-13T22:56:13.320 INFO:tasks.workunit.client.0.smithi002.stdout:0/533: getdents d1/d2/d81/d8f 0 2024-09-13T22:56:13.322 INFO:tasks.workunit.client.1.smithi047.stdout:0/632: dwrite d1/d5/d16/d23/d2d/f55 [0,4194304] 0 2024-09-13T22:56:13.324 INFO:tasks.workunit.client.1.smithi047.stdout:9/541: dread d1/dc/d14/dd/d54/d50/d5b/d9e/f7f [0,4194304] 0 2024-09-13T22:56:13.325 INFO:tasks.workunit.client.1.smithi047.stdout:9/542: dread - d1/dc/d18/fab zero size 2024-09-13T22:56:13.326 INFO:tasks.workunit.client.1.smithi047.stdout:0/633: fsync d1/d5/d16/d23/d2d/f5a 0 2024-09-13T22:56:13.327 INFO:tasks.workunit.client.1.smithi047.stdout:3/612: creat d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/fc5 x:0 0 0 2024-09-13T22:56:13.327 INFO:tasks.workunit.client.1.smithi047.stdout:1/678: dread d0/d7/d14/d57/d62/d76/fbb [0,4194304] 0 2024-09-13T22:56:13.331 INFO:tasks.workunit.client.0.smithi002.stdout:3/595: truncate d9/d3b/f67 1202938 0 2024-09-13T22:56:13.333 INFO:tasks.workunit.client.1.smithi047.stdout:8/562: symlink d8/d6b/lc6 0 2024-09-13T22:56:13.339 INFO:tasks.workunit.client.1.smithi047.stdout:4/727: rmdir dc/d29/d8e/dda/dde 0 2024-09-13T22:56:13.340 INFO:tasks.workunit.client.1.smithi047.stdout:6/642: dwrite d3/f42 [0,4194304] 0 2024-09-13T22:56:13.340 INFO:tasks.workunit.client.0.smithi002.stdout:1/557: symlink d1/d13/d30/d73/lb4 0 2024-09-13T22:56:13.341 INFO:tasks.workunit.client.1.smithi047.stdout:1/679: dread d0/d7/d14/d28/d36/f84 [0,4194304] 0 2024-09-13T22:56:13.342 INFO:tasks.workunit.client.1.smithi047.stdout:5/549: rmdir d19/d23 39 2024-09-13T22:56:13.344 INFO:tasks.workunit.client.1.smithi047.stdout:6/643: truncate d3/d11/d2b/d1c/fa8 798441 0 2024-09-13T22:56:13.345 INFO:tasks.workunit.client.0.smithi002.stdout:0/534: symlink d1/d2/d81/lc0 0 2024-09-13T22:56:13.348 INFO:tasks.workunit.client.0.smithi002.stdout:6/544: creat d12/d17/d34/fae x:0 0 0 2024-09-13T22:56:13.350 INFO:tasks.workunit.client.0.smithi002.stdout:5/528: creat d1/fbd x:0 0 0 2024-09-13T22:56:13.352 INFO:tasks.workunit.client.0.smithi002.stdout:5/529: dread - d1/d2a/d6b/d88/d55/d56/d81/fa5 zero size 2024-09-13T22:56:13.354 INFO:tasks.workunit.client.1.smithi047.stdout:7/600: dread d0/d7/da/d1e/d51/fa3 [0,4194304] 0 2024-09-13T22:56:13.355 INFO:tasks.workunit.client.1.smithi047.stdout:3/613: creat d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/fc6 x:0 0 0 2024-09-13T22:56:13.356 INFO:tasks.workunit.client.0.smithi002.stdout:6/545: dwrite d12/d17/d28/d67/d6b/f78 [0,4194304] 0 2024-09-13T22:56:13.356 INFO:tasks.workunit.client.0.smithi002.stdout:2/519: link d1/d7/d8/d51/l98 d1/d7/d52/lae 0 2024-09-13T22:56:13.360 INFO:tasks.workunit.client.1.smithi047.stdout:8/563: rename d8/d3f/c74 to d8/d64/d4e/d4d/d8f/d91/d38/d7a/cc7 0 2024-09-13T22:56:13.364 INFO:tasks.workunit.client.1.smithi047.stdout:2/659: unlink d1/d16/d40/cc0 0 2024-09-13T22:56:13.367 INFO:tasks.workunit.client.1.smithi047.stdout:1/680: creat d0/d7/d13/d5d/fc5 x:0 0 0 2024-09-13T22:56:13.368 INFO:tasks.workunit.client.1.smithi047.stdout:3/614: dwrite d0/d3/d4/d16/d2c/de/fb0 [0,4194304] 0 2024-09-13T22:56:13.369 INFO:tasks.workunit.client.1.smithi047.stdout:1/681: write d0/fb2 [609582,100050] 0 2024-09-13T22:56:13.370 INFO:tasks.workunit.client.1.smithi047.stdout:3/615: dread - d0/d3/d4/d16/d2c/de/f97 zero size 2024-09-13T22:56:13.370 INFO:tasks.workunit.client.0.smithi002.stdout:8/501: truncate d3/dc/d18/d2e/d94/f7f 2020044 0 2024-09-13T22:56:13.375 INFO:tasks.workunit.client.0.smithi002.stdout:9/566: mkdir d8/d91/d96/da8/dc3 0 2024-09-13T22:56:13.378 INFO:tasks.workunit.client.0.smithi002.stdout:7/456: truncate d8/d10/d11/d13/f21 3270089 0 2024-09-13T22:56:13.379 INFO:tasks.workunit.client.1.smithi047.stdout:5/550: dwrite d19/d25/d45/f4e [0,4194304] 0 2024-09-13T22:56:13.380 INFO:tasks.workunit.client.0.smithi002.stdout:3/596: dwrite d9/f68 [0,4194304] 0 2024-09-13T22:56:13.389 INFO:tasks.workunit.client.0.smithi002.stdout:5/530: symlink d1/d10/lbe 0 2024-09-13T22:56:13.390 INFO:tasks.workunit.client.1.smithi047.stdout:5/551: dwrite d19/d25/f38 [0,4194304] 0 2024-09-13T22:56:13.393 INFO:tasks.workunit.client.0.smithi002.stdout:2/520: creat d1/d7/d35/d3e/d59/d87/faf x:0 0 0 2024-09-13T22:56:13.395 INFO:tasks.workunit.client.1.smithi047.stdout:9/543: dwrite d1/dc/d14/dd/d54/d4e/d51/f53 [0,4194304] 0 2024-09-13T22:56:13.397 INFO:tasks.workunit.client.0.smithi002.stdout:6/546: mknod d12/d17/d34/d39/d8a/caf 0 2024-09-13T22:56:13.398 INFO:tasks.workunit.client.1.smithi047.stdout:0/634: truncate d1/d5/d16/d23/d2d/fa5 661650 0 2024-09-13T22:56:13.401 INFO:tasks.workunit.client.0.smithi002.stdout:1/558: symlink d1/d13/lb5 0 2024-09-13T22:56:13.406 INFO:tasks.workunit.client.1.smithi047.stdout:9/544: dwrite d1/dc/d14/dd/d54/d50/d5b/d9e/f81 [0,4194304] 0 2024-09-13T22:56:13.419 INFO:tasks.workunit.client.0.smithi002.stdout:0/535: truncate d1/d4/f24 1385547 0 2024-09-13T22:56:13.422 INFO:tasks.workunit.client.0.smithi002.stdout:5/531: unlink d1/l24 0 2024-09-13T22:56:13.425 INFO:tasks.workunit.client.0.smithi002.stdout:2/521: symlink d1/d7/d8/d2c/lb0 0 2024-09-13T22:56:13.425 INFO:tasks.workunit.client.0.smithi002.stdout:2/522: fsync d1/d4d/f56 0 2024-09-13T22:56:13.426 INFO:tasks.workunit.client.0.smithi002.stdout:9/567: write d8/d10/d61/fae [358703,100481] 0 2024-09-13T22:56:13.427 INFO:tasks.workunit.client.0.smithi002.stdout:9/568: fdatasync d8/f37 0 2024-09-13T22:56:13.430 INFO:tasks.workunit.client.0.smithi002.stdout:1/559: mkdir d1/d13/d30/d31/d3d/db6 0 2024-09-13T22:56:13.432 INFO:tasks.workunit.client.0.smithi002.stdout:4/489: getdents d3/d62 0 2024-09-13T22:56:13.438 INFO:tasks.workunit.client.0.smithi002.stdout:3/597: dwrite d9/d15/d35/f9d [0,4194304] 0 2024-09-13T22:56:13.438 INFO:tasks.workunit.client.0.smithi002.stdout:1/560: dwrite d1/d13/d30/d31/f69 [4194304,4194304] 0 2024-09-13T22:56:13.440 INFO:tasks.workunit.client.0.smithi002.stdout:1/561: fdatasync d1/d13/d30/d31/d3b/d71/fa2 0 2024-09-13T22:56:13.441 INFO:tasks.workunit.client.0.smithi002.stdout:1/562: fdatasync d1/d13/d30/d73/da1/d7d/faf 0 2024-09-13T22:56:13.443 INFO:tasks.workunit.client.0.smithi002.stdout:1/563: chown d1/d13/d30/d31/d3b 11836486 1 2024-09-13T22:56:13.447 INFO:tasks.workunit.client.0.smithi002.stdout:2/523: rmdir d1/d32/d37 39 2024-09-13T22:56:13.450 INFO:tasks.workunit.client.0.smithi002.stdout:8/502: truncate d3/f5 4218651 0 2024-09-13T22:56:13.450 INFO:tasks.workunit.client.0.smithi002.stdout:6/547: symlink d12/d17/d28/d67/d9f/lb0 0 2024-09-13T22:56:13.454 INFO:tasks.workunit.client.1.smithi047.stdout:6/644: rename d3/d77/d8f/l94 to d3/d11/d2b/d1c/d4d/d69/dc2/dcd/ld3 0 2024-09-13T22:56:13.456 INFO:tasks.workunit.client.1.smithi047.stdout:2/660: mknod d1/df/d1d/d20/cde 0 2024-09-13T22:56:13.462 INFO:tasks.workunit.client.0.smithi002.stdout:3/598: mkdir d9/d3b/d53/d83/dda 0 2024-09-13T22:56:13.465 INFO:tasks.workunit.client.0.smithi002.stdout:0/536: truncate d1/d2/f6d 4665903 0 2024-09-13T22:56:13.466 INFO:tasks.workunit.client.1.smithi047.stdout:3/616: dread d0/d3/d4/d16/d2c/de/d1f/d3b/d69/f7d [0,4194304] 0 2024-09-13T22:56:13.466 INFO:tasks.workunit.client.0.smithi002.stdout:7/457: dwrite d8/f27 [0,4194304] 0 2024-09-13T22:56:13.467 INFO:tasks.workunit.client.1.smithi047.stdout:3/617: stat d0/d3/d4/d16/d32/f39 0 2024-09-13T22:56:13.468 INFO:tasks.workunit.client.1.smithi047.stdout:3/618: dread - d0/d3/d4/d91/fc1 zero size 2024-09-13T22:56:13.469 INFO:tasks.workunit.client.0.smithi002.stdout:1/564: mknod d1/d13/d21/d39/cb7 0 2024-09-13T22:56:13.470 INFO:tasks.workunit.client.0.smithi002.stdout:5/532: dwrite d1/d2a/d6b/d88/f74 [4194304,4194304] 0 2024-09-13T22:56:13.470 INFO:tasks.workunit.client.1.smithi047.stdout:3/619: readlink d0/d3/d4/d16/d2c/de/d1f/d2e/l5d 0 2024-09-13T22:56:13.471 INFO:tasks.workunit.client.1.smithi047.stdout:3/620: readlink d0/d3/d65/l72 0 2024-09-13T22:56:13.471 INFO:tasks.workunit.client.0.smithi002.stdout:5/533: dread - d1/d2a/d6b/d88/d45/d4f/d99/fb1 zero size 2024-09-13T22:56:13.475 INFO:tasks.workunit.client.1.smithi047.stdout:5/552: write d19/d23/d4c/fa9 [534814,100352] 0 2024-09-13T22:56:13.483 INFO:tasks.workunit.client.0.smithi002.stdout:6/548: mknod d12/d17/d28/d67/d6b/cb1 0 2024-09-13T22:56:13.483 INFO:tasks.workunit.client.1.smithi047.stdout:1/682: write d0/d7/d13/f42 [38335,49686] 0 2024-09-13T22:56:13.484 INFO:tasks.workunit.client.0.smithi002.stdout:6/549: read d12/d17/d4e/f61 [772293,56312] 0 2024-09-13T22:56:13.487 INFO:tasks.workunit.client.0.smithi002.stdout:9/569: unlink d8/d10/d1c/c1b 0 2024-09-13T22:56:13.488 INFO:tasks.workunit.client.1.smithi047.stdout:0/635: dread d1/f69 [0,4194304] 0 2024-09-13T22:56:13.488 INFO:tasks.workunit.client.1.smithi047.stdout:0/636: readlink d1/d5/d16/l6b 0 2024-09-13T22:56:13.490 INFO:tasks.workunit.client.1.smithi047.stdout:9/545: creat d1/dc/d14/dd/d4c/fac x:0 0 0 2024-09-13T22:56:13.491 INFO:tasks.workunit.client.0.smithi002.stdout:4/490: rename d3/d40/f88 to d3/d14/d86/f95 0 2024-09-13T22:56:13.494 INFO:tasks.workunit.client.1.smithi047.stdout:8/564: rename d8/da3 to d8/d64/d4e/d4d/d8f/d91/d38/dc8 0 2024-09-13T22:56:13.496 INFO:tasks.workunit.client.1.smithi047.stdout:6/645: mknod d3/d11/d2b/d76/cd4 0 2024-09-13T22:56:13.496 INFO:tasks.workunit.client.0.smithi002.stdout:6/550: dread d12/d17/d28/fac [0,4194304] 0 2024-09-13T22:56:13.497 INFO:tasks.workunit.client.1.smithi047.stdout:6/646: stat d3/d11/d74/fb3 0 2024-09-13T22:56:13.499 INFO:tasks.workunit.client.1.smithi047.stdout:2/661: mknod d1/df/d35/d8b/cdf 0 2024-09-13T22:56:13.500 INFO:tasks.workunit.client.1.smithi047.stdout:7/601: truncate d0/d57/d5b/f8a 535164 0 2024-09-13T22:56:13.500 INFO:tasks.workunit.client.1.smithi047.stdout:2/662: truncate d1/df/d26/d4b/f50 4317258 0 2024-09-13T22:56:13.502 INFO:tasks.workunit.client.0.smithi002.stdout:1/565: symlink d1/d13/d30/d31/d3d/lb8 0 2024-09-13T22:56:13.504 INFO:tasks.workunit.client.0.smithi002.stdout:4/491: dread d3/d14/d25/f4f [0,4194304] 0 2024-09-13T22:56:13.504 INFO:tasks.workunit.client.1.smithi047.stdout:3/621: chown d0/d3/d4/d16/d32/d42/d79/d9c/dad/c47 33541 1 2024-09-13T22:56:13.505 INFO:tasks.workunit.client.0.smithi002.stdout:4/492: truncate d3/d14/d85/f8d 1825515 0 2024-09-13T22:56:13.506 INFO:tasks.workunit.client.0.smithi002.stdout:2/524: mkdir d1/d7/d8/d2c/d9d/dab/db1 0 2024-09-13T22:56:13.508 INFO:tasks.workunit.client.1.smithi047.stdout:7/602: dwrite d0/d7/fc8 [0,4194304] 0 2024-09-13T22:56:13.508 INFO:tasks.workunit.client.1.smithi047.stdout:1/683: mknod d0/d7/d14/d28/cc6 0 2024-09-13T22:56:13.510 INFO:tasks.workunit.client.1.smithi047.stdout:8/565: dread d8/d64/d4e/d4d/d8f/d91/f3c [0,4194304] 0 2024-09-13T22:56:13.511 INFO:tasks.workunit.client.0.smithi002.stdout:4/493: dread d3/d14/d29/d2a/f36 [0,4194304] 0 2024-09-13T22:56:13.512 INFO:tasks.workunit.client.1.smithi047.stdout:8/566: stat d8/d64/d4e/d70/d98 0 2024-09-13T22:56:13.515 INFO:tasks.workunit.client.0.smithi002.stdout:9/570: chown d8/d91/d96/d87/da5/c9c 106588 1 2024-09-13T22:56:13.521 INFO:tasks.workunit.client.1.smithi047.stdout:2/663: fsync d1/df/d26/f30 0 2024-09-13T22:56:13.527 INFO:tasks.workunit.client.1.smithi047.stdout:8/567: dread d8/d64/d4e/d4d/d8f/d91/d38/f45 [0,4194304] 0 2024-09-13T22:56:13.531 INFO:tasks.workunit.client.1.smithi047.stdout:7/603: dread d0/d7/f36 [0,4194304] 0 2024-09-13T22:56:13.534 INFO:tasks.workunit.client.1.smithi047.stdout:0/637: link d1/d5/d11/d52/f8e d1/d7/dc9/fcd 0 2024-09-13T22:56:13.537 INFO:tasks.workunit.client.1.smithi047.stdout:3/622: truncate d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/f30 6289585 0 2024-09-13T22:56:13.537 INFO:tasks.workunit.client.0.smithi002.stdout:1/566: rmdir d1/d13/d30/d73 39 2024-09-13T22:56:13.542 INFO:tasks.workunit.client.0.smithi002.stdout:0/537: write d1/d4/d75/d31/d32/fa7 [941365,97193] 0 2024-09-13T22:56:13.542 INFO:tasks.workunit.client.0.smithi002.stdout:0/538: readlink d1/d2/l2f 0 2024-09-13T22:56:13.543 INFO:tasks.workunit.client.1.smithi047.stdout:6/647: creat d3/d11/d2b/d1c/dca/fd5 x:0 0 0 2024-09-13T22:56:13.544 INFO:tasks.workunit.client.0.smithi002.stdout:6/551: dwrite d12/d17/d28/f2f [8388608,4194304] 0 2024-09-13T22:56:13.545 INFO:tasks.workunit.client.0.smithi002.stdout:0/539: write d1/d7e/f8a [3567735,29268] 0 2024-09-13T22:56:13.545 INFO:tasks.workunit.client.1.smithi047.stdout:1/684: dwrite d0/f4f [0,4194304] 0 2024-09-13T22:56:13.546 INFO:tasks.workunit.client.0.smithi002.stdout:6/552: write d12/f6a [1952704,40383] 0 2024-09-13T22:56:13.547 INFO:tasks.workunit.client.1.smithi047.stdout:2/664: mknod d1/df/d35/ce0 0 2024-09-13T22:56:13.551 INFO:tasks.workunit.client.0.smithi002.stdout:7/458: dwrite d8/d10/d11/d13/f21 [0,4194304] 0 2024-09-13T22:56:13.553 INFO:tasks.workunit.client.1.smithi047.stdout:0/638: readlink d1/d5/laa 0 2024-09-13T22:56:13.555 INFO:tasks.workunit.client.1.smithi047.stdout:6/648: read d3/d77/d8f/db9/fc3 [1027688,62462] 0 2024-09-13T22:56:13.555 INFO:tasks.workunit.client.1.smithi047.stdout:6/649: chown d3/f7 91 1 2024-09-13T22:56:13.556 INFO:tasks.workunit.client.0.smithi002.stdout:1/567: truncate d1/d13/d1d/d34/f6f 389334 0 2024-09-13T22:56:13.558 INFO:tasks.workunit.client.1.smithi047.stdout:9/546: creat d1/dc/d14/fad x:0 0 0 2024-09-13T22:56:13.561 INFO:tasks.workunit.client.0.smithi002.stdout:7/459: dwrite d8/d10/d11/d13/d2e/f65 [0,4194304] 0 2024-09-13T22:56:13.565 INFO:tasks.workunit.client.1.smithi047.stdout:9/547: dread d1/f1a [0,4194304] 0 2024-09-13T22:56:13.566 INFO:tasks.workunit.client.1.smithi047.stdout:9/548: readlink d1/dc/d14/dd/d54/d50/d5b/d9e/l6f 0 2024-09-13T22:56:13.569 INFO:tasks.workunit.client.0.smithi002.stdout:0/540: symlink d1/d2/d81/lc1 0 2024-09-13T22:56:13.569 INFO:tasks.workunit.client.1.smithi047.stdout:5/553: getdents d19/d34/d42/d5d/d9d 0 2024-09-13T22:56:13.572 INFO:tasks.workunit.client.1.smithi047.stdout:2/665: mkdir d1/df/d1d/d20/d29/de1 0 2024-09-13T22:56:13.573 INFO:tasks.workunit.client.0.smithi002.stdout:4/494: truncate d3/f1e 3770734 0 2024-09-13T22:56:13.575 INFO:tasks.workunit.client.0.smithi002.stdout:9/571: mkdir d8/d10/dc4 0 2024-09-13T22:56:13.575 INFO:tasks.workunit.client.0.smithi002.stdout:9/572: read d8/d10/d1c/d3d/fc2 [3139175,28445] 0 2024-09-13T22:56:13.576 INFO:tasks.workunit.client.0.smithi002.stdout:3/599: getdents d9/d3b/d53/d83 0 2024-09-13T22:56:13.578 INFO:tasks.workunit.client.1.smithi047.stdout:0/639: creat d1/d5/d16/d23/d45/d7f/fce x:0 0 0 2024-09-13T22:56:13.582 INFO:tasks.workunit.client.0.smithi002.stdout:5/534: link d1/d10/f35 d1/d2a/d6b/d88/fbf 0 2024-09-13T22:56:13.583 INFO:tasks.workunit.client.0.smithi002.stdout:5/535: write d1/d2a/d6b/d88/d45/d4f/d78/f96 [2519608,75185] 0 2024-09-13T22:56:13.585 INFO:tasks.workunit.client.0.smithi002.stdout:7/460: mkdir d8/d10/d11/d13/d7c/d46/d7e 0 2024-09-13T22:56:13.589 INFO:tasks.workunit.client.1.smithi047.stdout:9/549: mknod d1/dc/d18/cae 0 2024-09-13T22:56:13.591 INFO:tasks.workunit.client.0.smithi002.stdout:3/600: dread d9/d15/d51/f1d [0,4194304] 0 2024-09-13T22:56:13.593 INFO:tasks.workunit.client.1.smithi047.stdout:4/728: sync 2024-09-13T22:56:13.593 INFO:tasks.workunit.client.0.smithi002.stdout:7/461: dwrite d8/d10/d11/d13/d7c/f5c [0,4194304] 0 2024-09-13T22:56:13.594 INFO:tasks.workunit.client.1.smithi047.stdout:2/666: truncate d1/df/d1d/f8d 871216 0 2024-09-13T22:56:13.596 INFO:tasks.workunit.client.1.smithi047.stdout:3/623: truncate d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d85/fa0 2163580 0 2024-09-13T22:56:13.599 INFO:tasks.workunit.client.1.smithi047.stdout:3/624: fdatasync d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d3a/d81/fbc 0 2024-09-13T22:56:13.599 INFO:tasks.workunit.client.1.smithi047.stdout:7/604: creat d0/fca x:0 0 0 2024-09-13T22:56:13.600 INFO:tasks.workunit.client.1.smithi047.stdout:3/625: chown d0/c48 55039 1 2024-09-13T22:56:13.602 INFO:tasks.workunit.client.1.smithi047.stdout:0/640: unlink d1/d5/d11/c66 0 2024-09-13T22:56:13.603 INFO:tasks.workunit.client.1.smithi047.stdout:7/605: dread d0/f94 [0,4194304] 0 2024-09-13T22:56:13.603 INFO:tasks.workunit.client.0.smithi002.stdout:5/536: creat d1/d2a/d6b/d88/d45/d4f/d78/d8b/fc0 x:0 0 0 2024-09-13T22:56:13.604 INFO:tasks.workunit.client.1.smithi047.stdout:7/606: write d0/d57/f98 [3187707,87671] 0 2024-09-13T22:56:13.604 INFO:tasks.workunit.client.0.smithi002.stdout:5/537: dread d1/d2a/d6b/d88/d55/f83 [0,4194304] 0 2024-09-13T22:56:13.605 INFO:tasks.workunit.client.1.smithi047.stdout:6/650: symlink d3/d11/d2b/d4c/d9d/dac/ld6 0 2024-09-13T22:56:13.606 INFO:tasks.workunit.client.0.smithi002.stdout:2/525: getdents d1/d7/d8/d2c/d9d/dab 0 2024-09-13T22:56:13.607 INFO:tasks.workunit.client.0.smithi002.stdout:2/526: write d1/d7/d35/f43 [1270135,129964] 0 2024-09-13T22:56:13.609 INFO:tasks.workunit.client.0.smithi002.stdout:0/541: symlink d1/d2/lc2 0 2024-09-13T22:56:13.612 INFO:tasks.workunit.client.1.smithi047.stdout:5/554: dwrite d19/d34/d42/d5d/f6e [0,4194304] 0 2024-09-13T22:56:13.614 INFO:tasks.workunit.client.0.smithi002.stdout:2/527: dwrite d1/f6a [0,4194304] 0 2024-09-13T22:56:13.614 INFO:tasks.workunit.client.0.smithi002.stdout:8/503: sync 2024-09-13T22:56:13.622 INFO:tasks.workunit.client.0.smithi002.stdout:9/573: creat d8/d10/d1c/dbf/fc5 x:0 0 0 2024-09-13T22:56:13.624 INFO:tasks.workunit.client.0.smithi002.stdout:9/574: write d8/d10/d42/fbb [179651,128641] 0 2024-09-13T22:56:13.625 INFO:tasks.workunit.client.0.smithi002.stdout:7/462: symlink d8/d10/d11/d13/d26/l7f 0 2024-09-13T22:56:13.628 INFO:tasks.workunit.client.0.smithi002.stdout:0/542: dread d1/d7e/f8a [0,4194304] 0 2024-09-13T22:56:13.628 INFO:tasks.workunit.client.0.smithi002.stdout:1/568: creat d1/d13/d1d/d34/fb9 x:0 0 0 2024-09-13T22:56:13.636 INFO:tasks.workunit.client.0.smithi002.stdout:3/601: dwrite d9/d3b/f61 [0,4194304] 0 2024-09-13T22:56:13.642 INFO:tasks.workunit.client.0.smithi002.stdout:4/495: creat d3/d14/d29/f96 x:0 0 0 2024-09-13T22:56:13.644 INFO:tasks.workunit.client.0.smithi002.stdout:8/504: dwrite d3/d27/f62 [0,4194304] 0 2024-09-13T22:56:13.645 INFO:tasks.workunit.client.0.smithi002.stdout:7/463: symlink d8/d10/d39/d60/l80 0 2024-09-13T22:56:13.646 INFO:tasks.workunit.client.0.smithi002.stdout:0/543: symlink d1/d4/da3/lc3 0 2024-09-13T22:56:13.647 INFO:tasks.workunit.client.0.smithi002.stdout:5/538: getdents d1/d2a/d6b/d88/d45/d4f/db7 0 2024-09-13T22:56:13.650 INFO:tasks.workunit.client.0.smithi002.stdout:0/544: dread - d1/d4/da3/d7d/f9a zero size 2024-09-13T22:56:13.651 INFO:tasks.workunit.client.0.smithi002.stdout:9/575: symlink d8/lc6 0 2024-09-13T22:56:13.652 INFO:tasks.workunit.client.0.smithi002.stdout:4/496: rename d3/d14/d29/d2a/d30/c7d to d3/d14/d25/d69/c97 0 2024-09-13T22:56:13.653 INFO:tasks.workunit.client.0.smithi002.stdout:1/569: creat d1/d13/d30/d31/d86/d9e/fba x:0 0 0 2024-09-13T22:56:13.653 INFO:tasks.workunit.client.0.smithi002.stdout:2/528: dwrite d1/d7/d8/f10 [0,4194304] 0 2024-09-13T22:56:13.655 INFO:tasks.workunit.client.0.smithi002.stdout:3/602: link d9/d15/f30 d9/d3b/da5/fdb 0 2024-09-13T22:56:13.657 INFO:tasks.workunit.client.0.smithi002.stdout:3/603: chown d9/d15/d35/lc5 986076561 1 2024-09-13T22:56:13.662 INFO:tasks.workunit.client.0.smithi002.stdout:8/505: mknod d3/dc/d18/c9a 0 2024-09-13T22:56:13.663 INFO:tasks.workunit.client.0.smithi002.stdout:2/529: unlink d1/d7/d41/c4c 0 2024-09-13T22:56:13.664 INFO:tasks.workunit.client.0.smithi002.stdout:5/539: getdents d1/d2a/d6b/d88/d45/d4f/da7/daa 0 2024-09-13T22:56:13.664 INFO:tasks.workunit.client.0.smithi002.stdout:3/604: rename d9/d7e/f88 to d9/d7e/dce/fdc 0 2024-09-13T22:56:13.666 INFO:tasks.workunit.client.0.smithi002.stdout:3/605: readlink d9/df/l87 0 2024-09-13T22:56:13.667 INFO:tasks.workunit.client.0.smithi002.stdout:8/506: unlink d3/dc/d18/d56/c82 0 2024-09-13T22:56:13.668 INFO:tasks.workunit.client.0.smithi002.stdout:4/497: creat d3/d14/d25/f98 x:0 0 0 2024-09-13T22:56:13.669 INFO:tasks.workunit.client.0.smithi002.stdout:7/464: rename d8/d10/d11/d13/d7c to d8/d10/d11/d13/d26/d4c/d81 0 2024-09-13T22:56:13.670 INFO:tasks.workunit.client.0.smithi002.stdout:5/540: mknod d1/d2a/d6b/d88/d45/d4f/cc1 0 2024-09-13T22:56:13.670 INFO:tasks.workunit.client.0.smithi002.stdout:3/606: symlink d9/d15/d36/d4e/ldd 0 2024-09-13T22:56:13.671 INFO:tasks.workunit.client.0.smithi002.stdout:8/507: creat d3/dc/d16/d2f/d83/f9b x:0 0 0 2024-09-13T22:56:13.672 INFO:tasks.workunit.client.0.smithi002.stdout:3/607: stat d9/d3b/da5/fbf 0 2024-09-13T22:56:13.673 INFO:tasks.workunit.client.0.smithi002.stdout:2/530: rename d1/d7/d8/f27 to d1/d7/d8/d2c/d9d/fb2 0 2024-09-13T22:56:13.674 INFO:tasks.workunit.client.0.smithi002.stdout:8/508: fdatasync d3/d21/f5b 0 2024-09-13T22:56:13.674 INFO:tasks.workunit.client.0.smithi002.stdout:0/545: dread d1/d2/f7a [0,4194304] 0 2024-09-13T22:56:13.676 INFO:tasks.workunit.client.0.smithi002.stdout:1/570: dread d1/f63 [4194304,4194304] 0 2024-09-13T22:56:13.677 INFO:tasks.workunit.client.0.smithi002.stdout:0/546: write d1/d4/da3/f68 [1096190,127959] 0 2024-09-13T22:56:13.680 INFO:tasks.workunit.client.1.smithi047.stdout:5/555: write d19/d23/d4c/f5e [2118588,99800] 0 2024-09-13T22:56:13.680 INFO:tasks.workunit.client.1.smithi047.stdout:4/729: creat dc/d29/d4c/ff8 x:0 0 0 2024-09-13T22:56:13.681 INFO:tasks.workunit.client.1.smithi047.stdout:8/568: getdents d8/d3f/d8c/da6 0 2024-09-13T22:56:13.683 INFO:tasks.workunit.client.1.smithi047.stdout:6/651: mkdir d3/d11/d2b/d4c/d30/d48/dd7 0 2024-09-13T22:56:13.684 INFO:tasks.workunit.client.0.smithi002.stdout:1/571: dwrite d1/f4d [0,4194304] 0 2024-09-13T22:56:13.684 INFO:tasks.workunit.client.1.smithi047.stdout:6/652: readlink d3/d11/l29 0 2024-09-13T22:56:13.685 INFO:tasks.workunit.client.1.smithi047.stdout:3/626: write d0/d3/d4/d16/f61 [508082,112315] 0 2024-09-13T22:56:13.685 INFO:tasks.workunit.client.0.smithi002.stdout:1/572: chown d1/d13/d1d/d34 1 1 2024-09-13T22:56:13.686 INFO:tasks.workunit.client.0.smithi002.stdout:1/573: chown d1/d13/d30/d31/f41 1127 1 2024-09-13T22:56:13.688 INFO:tasks.workunit.client.1.smithi047.stdout:3/627: write d0/d3/d4/d91/d8d/fb6 [565540,27654] 0 2024-09-13T22:56:13.689 INFO:tasks.workunit.client.0.smithi002.stdout:8/509: dread d3/dc/fe [0,4194304] 0 2024-09-13T22:56:13.691 INFO:tasks.workunit.client.0.smithi002.stdout:8/510: chown d3/dc/d16/d2f/l86 57917759 1 2024-09-13T22:56:13.696 INFO:tasks.workunit.client.0.smithi002.stdout:8/511: dwrite d3/dc/d18/d2e/d94/f93 [0,4194304] 0 2024-09-13T22:56:13.705 INFO:tasks.workunit.client.0.smithi002.stdout:6/553: sync 2024-09-13T22:56:13.705 INFO:tasks.workunit.client.1.smithi047.stdout:7/607: dread d0/d7/da/d4e/f66 [0,4194304] 0 2024-09-13T22:56:13.707 INFO:tasks.workunit.client.0.smithi002.stdout:6/554: read d12/d17/d28/f2e [4509485,53697] 0 2024-09-13T22:56:13.765 INFO:tasks.workunit.client.0.smithi002.stdout:5/541: creat d1/d2a/d6b/d88/d45/d4f/da7/fc2 x:0 0 0 2024-09-13T22:56:13.766 INFO:tasks.workunit.client.1.smithi047.stdout:1/685: getdents d0/d7/d10 0 2024-09-13T22:56:13.768 INFO:tasks.workunit.client.1.smithi047.stdout:1/686: truncate d0/d7/d14/fa1 1315926 0 2024-09-13T22:56:13.768 INFO:tasks.workunit.client.1.smithi047.stdout:1/687: chown d0/d7/db/c9d 38658634 1 2024-09-13T22:56:13.769 INFO:tasks.workunit.client.1.smithi047.stdout:1/688: fdatasync d0/d7/d14/d28/d36/f3d 0 2024-09-13T22:56:13.770 INFO:tasks.workunit.client.1.smithi047.stdout:1/689: truncate d0/d7/db/f98 1055427 0 2024-09-13T22:56:13.779 INFO:tasks.workunit.client.1.smithi047.stdout:5/556: symlink d19/d83/d98/lb2 0 2024-09-13T22:56:13.779 INFO:tasks.workunit.client.1.smithi047.stdout:5/557: fdatasync d19/d34/d42/f5b 0 2024-09-13T22:56:13.787 INFO:tasks.workunit.client.0.smithi002.stdout:9/576: sync 2024-09-13T22:56:13.788 INFO:tasks.workunit.client.0.smithi002.stdout:9/577: write d8/d10/d1c/fb0 [365129,14243] 0 2024-09-13T22:56:13.789 INFO:tasks.workunit.client.0.smithi002.stdout:9/578: chown d8/d10/d1c/f15 0 1 2024-09-13T22:56:13.791 INFO:tasks.workunit.client.0.smithi002.stdout:8/512: creat d3/d27/f9c x:0 0 0 2024-09-13T22:56:13.798 INFO:tasks.workunit.client.1.smithi047.stdout:6/653: dread d3/d11/d2b/d4c/fcc [0,4194304] 0 2024-09-13T22:56:13.799 INFO:tasks.workunit.client.1.smithi047.stdout:6/654: write d3/d11/d2b/d1c/f1e [2347594,71400] 0 2024-09-13T22:56:13.800 INFO:tasks.workunit.client.1.smithi047.stdout:6/655: read d3/f42 [2068227,98350] 0 2024-09-13T22:56:13.800 INFO:tasks.workunit.client.1.smithi047.stdout:7/608: rmdir d0/d57/d5b/d5c 39 2024-09-13T22:56:13.803 INFO:tasks.workunit.client.1.smithi047.stdout:6/656: dread d3/d11/d2b/d4c/d30/f91 [0,4194304] 0 2024-09-13T22:56:13.807 INFO:tasks.workunit.client.1.smithi047.stdout:1/690: unlink d0/d7/d14/d28/d36/c7c 0 2024-09-13T22:56:13.810 INFO:tasks.workunit.client.1.smithi047.stdout:6/657: dwrite d3/d11/d2b/d4c/d30/f5d [0,4194304] 0 2024-09-13T22:56:13.814 INFO:tasks.workunit.client.0.smithi002.stdout:1/574: sync 2024-09-13T22:56:13.820 INFO:tasks.workunit.client.1.smithi047.stdout:9/550: getdents d1/dc/d14 0 2024-09-13T22:56:13.839 INFO:tasks.workunit.client.1.smithi047.stdout:6/658: truncate d3/d11/d2b/d4c/fcc 4462060 0 2024-09-13T22:56:13.840 INFO:tasks.workunit.client.1.smithi047.stdout:5/558: getdents d19/d25/d45/da3 0 2024-09-13T22:56:13.843 INFO:tasks.workunit.client.1.smithi047.stdout:9/551: creat d1/dc/d14/dd/d54/d50/d91/faf x:0 0 0 2024-09-13T22:56:13.848 INFO:tasks.workunit.client.1.smithi047.stdout:7/609: creat d0/d57/d5b/d8b/d95/fcb x:0 0 0 2024-09-13T22:56:13.853 INFO:tasks.workunit.client.1.smithi047.stdout:6/659: rename d3/d11/d2b/d4c/d30/d48/fad to d3/d11/d2b/d4c/dc0/fd8 0 2024-09-13T22:56:13.853 INFO:tasks.workunit.client.1.smithi047.stdout:7/610: dread d0/d7/f87 [0,4194304] 0 2024-09-13T22:56:13.854 INFO:tasks.workunit.client.1.smithi047.stdout:7/611: chown d0/d57/d5b/fb4 10 1 2024-09-13T22:56:13.855 INFO:tasks.workunit.client.0.smithi002.stdout:7/465: rename d8/d10/d11/d13/d26/d4c/d81/l2f to d8/d10/d11/d13/l82 0 2024-09-13T22:56:13.855 INFO:tasks.workunit.client.1.smithi047.stdout:7/612: write d0/d7/da/d47/fa1 [1040615,58864] 0 2024-09-13T22:56:13.859 INFO:tasks.workunit.client.1.smithi047.stdout:5/559: creat d19/d23/d4c/fb3 x:0 0 0 2024-09-13T22:56:13.860 INFO:tasks.workunit.client.1.smithi047.stdout:9/552: mkdir d1/dc/d14/dd/d54/d50/d60/db0 0 2024-09-13T22:56:13.861 INFO:tasks.workunit.client.1.smithi047.stdout:9/553: chown d1/dc/d14/dd/l7c 2209407 1 2024-09-13T22:56:13.863 INFO:tasks.workunit.client.1.smithi047.stdout:9/554: dread d1/d5f/f9b [0,4194304] 0 2024-09-13T22:56:13.864 INFO:tasks.workunit.client.1.smithi047.stdout:9/555: chown d1/dc/d14/dd/l7c 221991286 1 2024-09-13T22:56:13.865 INFO:tasks.workunit.client.1.smithi047.stdout:9/556: write d1/dc/d14/dd/d4c/fac [95001,3865] 0 2024-09-13T22:56:13.867 INFO:tasks.workunit.client.1.smithi047.stdout:7/613: truncate d0/d7/da/d1e/fac 1029134 0 2024-09-13T22:56:13.870 INFO:tasks.workunit.client.1.smithi047.stdout:5/560: creat d19/d34/d42/d5d/fb4 x:0 0 0 2024-09-13T22:56:13.873 INFO:tasks.workunit.client.1.smithi047.stdout:6/660: mknod d3/d2c/cd9 0 2024-09-13T22:56:13.880 INFO:tasks.workunit.client.1.smithi047.stdout:9/557: dread d1/dc/d14/dd/d4c/f57 [4194304,4194304] 0 2024-09-13T22:56:13.884 INFO:tasks.workunit.client.1.smithi047.stdout:7/614: dread - d0/d7/da/d2e/d64/f6c zero size 2024-09-13T22:56:13.892 INFO:tasks.workunit.client.0.smithi002.stdout:2/531: creat d1/d32/d37/d79/fb3 x:0 0 0 2024-09-13T22:56:13.905 INFO:tasks.workunit.client.0.smithi002.stdout:4/498: mknod d3/d40/c99 0 2024-09-13T22:56:13.906 INFO:tasks.workunit.client.0.smithi002.stdout:4/499: write d3/d14/d25/d5e/f5f [1137840,123680] 0 2024-09-13T22:56:13.906 INFO:tasks.workunit.client.0.smithi002.stdout:1/575: dread - d1/d13/d30/d73/da1/d7d/f98 zero size 2024-09-13T22:56:13.908 INFO:tasks.workunit.client.0.smithi002.stdout:4/500: chown d3/d14/d29/d2a/f71 0 1 2024-09-13T22:56:13.911 INFO:tasks.workunit.client.0.smithi002.stdout:7/466: rmdir d8/d10/d11/d13/d2e/d3c/d3e 39 2024-09-13T22:56:13.913 INFO:tasks.workunit.client.0.smithi002.stdout:1/576: dwrite d1/d13/d30/f99 [0,4194304] 0 2024-09-13T22:56:13.916 INFO:tasks.workunit.client.0.smithi002.stdout:7/467: dread d8/d10/f32 [0,4194304] 0 2024-09-13T22:56:13.917 INFO:tasks.workunit.client.0.smithi002.stdout:4/501: truncate d3/d14/d25/f8a 541069 0 2024-09-13T22:56:13.918 INFO:tasks.workunit.client.0.smithi002.stdout:4/502: stat d3/d14/d25/f84 0 2024-09-13T22:56:13.924 INFO:tasks.workunit.client.0.smithi002.stdout:8/513: creat d3/d21/f9d x:0 0 0 2024-09-13T22:56:13.925 INFO:tasks.workunit.client.0.smithi002.stdout:4/503: dwrite d3/d14/d25/d5e/f5f [0,4194304] 0 2024-09-13T22:56:14.006 INFO:tasks.workunit.client.0.smithi002.stdout:7/468: sync 2024-09-13T22:56:14.049 INFO:tasks.workunit.client.0.smithi002.stdout:7/469: creat d8/d10/d11/d13/f83 x:0 0 0 2024-09-13T22:56:14.052 INFO:tasks.workunit.client.0.smithi002.stdout:8/514: creat d3/dc/d8b/f9e x:0 0 0 2024-09-13T22:56:14.056 INFO:tasks.workunit.client.0.smithi002.stdout:4/504: getdents d3/d14/d29/d2a 0 2024-09-13T22:56:14.057 INFO:tasks.workunit.client.0.smithi002.stdout:4/505: write d3/f5d [3661904,86176] 0 2024-09-13T22:56:14.059 INFO:tasks.workunit.client.0.smithi002.stdout:8/515: creat d3/dc/d16/d4b/d72/d73/f9f x:0 0 0 2024-09-13T22:56:14.061 INFO:tasks.workunit.client.0.smithi002.stdout:8/516: write d3/dc/f42 [4458420,65271] 0 2024-09-13T22:56:14.061 INFO:tasks.workunit.client.0.smithi002.stdout:7/470: dread d8/d10/d11/d13/d26/f3f [0,4194304] 0 2024-09-13T22:56:14.065 INFO:tasks.workunit.client.0.smithi002.stdout:4/506: chown d3/f2f 2984 1 2024-09-13T22:56:14.065 INFO:tasks.workunit.client.0.smithi002.stdout:4/507: stat d3/d14/d29/d2a/f44 0 2024-09-13T22:56:14.066 INFO:tasks.workunit.client.0.smithi002.stdout:4/508: stat d3/d14/d25/f84 0 2024-09-13T22:56:14.066 INFO:tasks.workunit.client.0.smithi002.stdout:8/517: creat d3/dc/d16/d60/fa0 x:0 0 0 2024-09-13T22:56:14.073 INFO:tasks.workunit.client.0.smithi002.stdout:7/471: mkdir d8/d10/d11/d13/d26/d38/d84 0 2024-09-13T22:56:14.080 INFO:tasks.workunit.client.0.smithi002.stdout:6/555: dwrite d12/d17/d28/d67/f6d [0,4194304] 0 2024-09-13T22:56:14.085 INFO:tasks.workunit.client.0.smithi002.stdout:6/556: write d12/d17/d28/f2f [13398784,11112] 0 2024-09-13T22:56:14.086 INFO:tasks.workunit.client.1.smithi047.stdout:8/569: truncate d8/d64/d4e/d4d/d8f/d91/f96 1265274 0 2024-09-13T22:56:14.086 INFO:tasks.workunit.client.0.smithi002.stdout:7/472: dread d8/d10/d11/d13/d26/d4c/d81/f40 [0,4194304] 0 2024-09-13T22:56:14.087 INFO:tasks.workunit.client.1.smithi047.stdout:3/628: creat d0/d3/d4/d16/d2c/de/fc7 x:0 0 0 2024-09-13T22:56:14.090 INFO:tasks.workunit.client.0.smithi002.stdout:7/473: mkdir d8/d10/d11/d13/d2e/d50/d85 0 2024-09-13T22:56:14.094 INFO:tasks.workunit.client.0.smithi002.stdout:7/474: fsync d8/d10/d11/d13/d2e/d3c/f48 0 2024-09-13T22:56:14.094 INFO:tasks.workunit.client.1.smithi047.stdout:3/629: read d0/d3/d4/d16/d2c/de/f28 [1128460,6878] 0 2024-09-13T22:56:14.094 INFO:tasks.workunit.client.1.smithi047.stdout:8/570: truncate d8/d64/d4e/d4d/d8f/d91/d38/f3b 150750 0 2024-09-13T22:56:14.096 INFO:tasks.workunit.client.0.smithi002.stdout:7/475: creat d8/d10/d11/d13/d26/d4c/d81/d51/f86 x:0 0 0 2024-09-13T22:56:14.101 INFO:tasks.workunit.client.1.smithi047.stdout:3/630: dread d0/d3/d4/d91/f66 [0,4194304] 0 2024-09-13T22:56:14.105 INFO:tasks.workunit.client.0.smithi002.stdout:7/476: getdents d8/d10 0 2024-09-13T22:56:14.107 INFO:tasks.workunit.client.1.smithi047.stdout:2/667: symlink d1/df/le2 0 2024-09-13T22:56:14.108 INFO:tasks.workunit.client.1.smithi047.stdout:2/668: chown d1/df/d35/d8b/lcf 247 1 2024-09-13T22:56:14.115 INFO:tasks.workunit.client.1.smithi047.stdout:3/631: dread d0/d3/d4/d16/d2c/f24 [0,4194304] 0 2024-09-13T22:56:14.128 INFO:tasks.workunit.client.1.smithi047.stdout:3/632: symlink d0/d3/lc8 0 2024-09-13T22:56:14.128 INFO:tasks.workunit.client.1.smithi047.stdout:3/633: chown d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/la7 764391 1 2024-09-13T22:56:14.129 INFO:tasks.workunit.client.1.smithi047.stdout:3/634: chown d0/d3 514 1 2024-09-13T22:56:14.129 INFO:tasks.workunit.client.1.smithi047.stdout:3/635: stat d0/d3/d5e 0 2024-09-13T22:56:14.135 INFO:tasks.workunit.client.0.smithi002.stdout:5/542: write d1/d2a/f53 [448075,55730] 0 2024-09-13T22:56:14.136 INFO:tasks.workunit.client.0.smithi002.stdout:2/532: getdents d1/d32/d37/d79 0 2024-09-13T22:56:14.137 INFO:tasks.workunit.client.0.smithi002.stdout:5/543: mknod d1/d2a/d6b/d88/d45/d4f/d99/cc3 0 2024-09-13T22:56:14.138 INFO:tasks.workunit.client.0.smithi002.stdout:2/533: fdatasync d1/d7/d35/d78/f4b 0 2024-09-13T22:56:14.139 INFO:tasks.workunit.client.0.smithi002.stdout:5/544: creat d1/d57/fc4 x:0 0 0 2024-09-13T22:56:14.140 INFO:tasks.workunit.client.1.smithi047.stdout:9/558: write d1/dc/d14/f52 [4324813,71007] 0 2024-09-13T22:56:14.141 INFO:tasks.workunit.client.1.smithi047.stdout:6/661: truncate d3/d77/fa9 445412 0 2024-09-13T22:56:14.143 INFO:tasks.workunit.client.0.smithi002.stdout:5/545: mknod d1/d2a/d5a/cc5 0 2024-09-13T22:56:14.143 INFO:tasks.workunit.client.0.smithi002.stdout:2/534: dwrite d1/d4d/f74 [0,4194304] 0 2024-09-13T22:56:14.144 INFO:tasks.workunit.client.1.smithi047.stdout:4/730: symlink dc/de/d23/d40/lf9 0 2024-09-13T22:56:14.145 INFO:tasks.workunit.client.1.smithi047.stdout:9/559: dread d1/dc/d14/dd/d54/d50/d5b/d9e/f7f [0,4194304] 0 2024-09-13T22:56:14.145 INFO:tasks.workunit.client.1.smithi047.stdout:4/731: write dc/de/d23/fcc [4223873,89710] 0 2024-09-13T22:56:14.146 INFO:tasks.workunit.client.1.smithi047.stdout:6/662: rename d3/d11/d2b/d4c/dc0/d98 to d3/d11/d2b/d1c/d23/dda 0 2024-09-13T22:56:14.148 INFO:tasks.workunit.client.1.smithi047.stdout:6/663: write d3/d11/d2b/d4c/d30/f71 [4774592,94640] 0 2024-09-13T22:56:14.149 INFO:tasks.workunit.client.0.smithi002.stdout:2/535: mknod d1/d7/d35/d3e/d59/d6b/d75/cb4 0 2024-09-13T22:56:14.150 INFO:tasks.workunit.client.0.smithi002.stdout:2/536: write d1/fa6 [670520,122111] 0 2024-09-13T22:56:14.150 INFO:tasks.workunit.client.1.smithi047.stdout:7/615: write d0/db/f16 [515270,77091] 0 2024-09-13T22:56:14.152 INFO:tasks.workunit.client.1.smithi047.stdout:4/732: creat dc/de/d23/dc4/dc8/ffa x:0 0 0 2024-09-13T22:56:14.153 INFO:tasks.workunit.client.1.smithi047.stdout:4/733: write dc/fd1 [889378,101639] 0 2024-09-13T22:56:14.154 INFO:tasks.workunit.client.0.smithi002.stdout:7/477: link d8/d10/d11/d13/d26/d4c/d81/f19 d8/d10/d11/d13/d2e/f87 0 2024-09-13T22:56:14.155 INFO:tasks.workunit.client.1.smithi047.stdout:4/734: write dc/de/d23/f49 [3653459,101841] 0 2024-09-13T22:56:14.159 INFO:tasks.workunit.client.1.smithi047.stdout:9/560: rename d1/dc/d14/dd/d54/d50/d5b/d9e/f7f to d1/dc/d14/dd/d54/d50/d60/fb1 0 2024-09-13T22:56:14.161 INFO:tasks.workunit.client.0.smithi002.stdout:0/547: unlink d1/d4/l5e 0 2024-09-13T22:56:14.162 INFO:tasks.workunit.client.0.smithi002.stdout:7/478: write d8/d10/d11/d13/d26/d4c/d81/f40 [3102819,72819] 0 2024-09-13T22:56:14.165 INFO:tasks.workunit.client.0.smithi002.stdout:2/537: mkdir d1/d7/d52/daa/db5 0 2024-09-13T22:56:14.165 INFO:tasks.workunit.client.0.smithi002.stdout:2/538: stat d1/c2e 0 2024-09-13T22:56:14.167 INFO:tasks.workunit.client.0.smithi002.stdout:0/548: mknod d1/d4/d75/d76/cc4 0 2024-09-13T22:56:14.168 INFO:tasks.workunit.client.0.smithi002.stdout:0/549: readlink d1/d2/l3 0 2024-09-13T22:56:14.169 INFO:tasks.workunit.client.1.smithi047.stdout:0/641: sync 2024-09-13T22:56:14.170 INFO:tasks.workunit.client.0.smithi002.stdout:1/577: dwrite d1/f24 [0,4194304] 0 2024-09-13T22:56:14.174 INFO:tasks.workunit.client.0.smithi002.stdout:9/579: rename d8/f70 to d8/d1e/fc7 0 2024-09-13T22:56:14.176 INFO:tasks.workunit.client.0.smithi002.stdout:0/550: creat d1/d4/d75/d31/fc5 x:0 0 0 2024-09-13T22:56:14.177 INFO:tasks.workunit.client.1.smithi047.stdout:4/735: mkdir dc/de/dfb 0 2024-09-13T22:56:14.178 INFO:tasks.workunit.client.0.smithi002.stdout:7/479: dwrite d8/d10/d39/d60/f7a [0,4194304] 0 2024-09-13T22:56:14.178 INFO:tasks.workunit.client.0.smithi002.stdout:2/539: truncate d1/d4d/f71 9017036 0 2024-09-13T22:56:14.178 INFO:tasks.workunit.client.1.smithi047.stdout:4/736: write dc/de/d23/d40/d7b/f94 [250311,10742] 0 2024-09-13T22:56:14.181 INFO:tasks.workunit.client.0.smithi002.stdout:9/580: truncate d8/d2c/da6/fc0 535219 0 2024-09-13T22:56:14.183 INFO:tasks.workunit.client.0.smithi002.stdout:1/578: dwrite d1/d13/d1d/d34/fb9 [0,4194304] 0 2024-09-13T22:56:14.184 INFO:tasks.workunit.client.1.smithi047.stdout:9/561: mkdir d1/dc/d14/dd/d54/d50/d60/db0/db2 0 2024-09-13T22:56:14.186 INFO:tasks.workunit.client.0.smithi002.stdout:5/546: rename d1/d2a/d6b/d88/d55/d56/cad to d1/d2a/d6b/d88/d45/d4f/d8f/cc6 0 2024-09-13T22:56:14.188 INFO:tasks.workunit.client.0.smithi002.stdout:5/547: chown d1/d10/l3b 361656 1 2024-09-13T22:56:14.190 INFO:tasks.workunit.client.0.smithi002.stdout:3/608: unlink d9/f68 0 2024-09-13T22:56:14.192 INFO:tasks.workunit.client.0.smithi002.stdout:0/551: creat d1/d7e/d9d/fc6 x:0 0 0 2024-09-13T22:56:14.194 INFO:tasks.workunit.client.1.smithi047.stdout:6/664: getdents d3/d11/d2b/d4c/d30/d48 0 2024-09-13T22:56:14.196 INFO:tasks.workunit.client.1.smithi047.stdout:4/737: mkdir dc/de/d23/dc4/dfc 0 2024-09-13T22:56:14.200 INFO:tasks.workunit.client.1.smithi047.stdout:7/616: link d0/d7/da/d1e/d93/f96 d0/d7/da/fcc 0 2024-09-13T22:56:14.200 INFO:tasks.workunit.client.0.smithi002.stdout:9/581: read d8/d1e/f22 [6922754,58402] 0 2024-09-13T22:56:14.208 INFO:tasks.workunit.client.1.smithi047.stdout:9/562: mknod d1/dc/cb3 0 2024-09-13T22:56:14.208 INFO:tasks.workunit.client.0.smithi002.stdout:4/509: dwrite d3/d14/f75 [0,4194304] 0 2024-09-13T22:56:14.209 INFO:tasks.workunit.client.0.smithi002.stdout:8/518: dwrite d3/dc/d16/d60/f74 [0,4194304] 0 2024-09-13T22:56:14.211 INFO:tasks.workunit.client.0.smithi002.stdout:0/552: creat d1/d2/d81/fc7 x:0 0 0 2024-09-13T22:56:14.216 INFO:tasks.workunit.client.0.smithi002.stdout:1/579: unlink d1/c54 0 2024-09-13T22:56:14.224 INFO:tasks.workunit.client.1.smithi047.stdout:9/563: rename d1/d5f/c9c to d1/dc/d14/dd/d54/d50/d5b/d9e/cb4 0 2024-09-13T22:56:14.229 INFO:tasks.workunit.client.1.smithi047.stdout:9/564: mknod d1/dc/d14/dd/d4c/d6b/cb5 0 2024-09-13T22:56:14.234 INFO:tasks.workunit.client.1.smithi047.stdout:9/565: mknod d1/dc/d14/dd/d54/d50/d60/cb6 0 2024-09-13T22:56:14.235 INFO:tasks.workunit.client.0.smithi002.stdout:6/557: rmdir d12 39 2024-09-13T22:56:14.236 INFO:tasks.workunit.client.0.smithi002.stdout:0/553: symlink d1/d4/d75/d31/lc8 0 2024-09-13T22:56:14.237 INFO:tasks.workunit.client.0.smithi002.stdout:0/554: write d1/d4/d75/d31/d32/dbb/fbd [592243,39110] 0 2024-09-13T22:56:14.238 INFO:tasks.workunit.client.1.smithi047.stdout:8/571: dwrite d8/d64/d4e/d70/da7/fa8 [0,4194304] 0 2024-09-13T22:56:14.240 INFO:tasks.workunit.client.0.smithi002.stdout:1/580: rmdir d1/d13/d52 39 2024-09-13T22:56:14.242 INFO:tasks.workunit.client.0.smithi002.stdout:1/581: chown d1/d13/d30/d31/d3d/d5d/d8e/ca6 113243223 1 2024-09-13T22:56:14.242 INFO:tasks.workunit.client.1.smithi047.stdout:2/669: write d1/df/d1d/d20/d37/fb1 [761559,33541] 0 2024-09-13T22:56:14.243 INFO:tasks.workunit.client.1.smithi047.stdout:9/566: dwrite d1/dc/d14/dd/d54/d8d/f93 [0,4194304] 0 2024-09-13T22:56:14.245 INFO:tasks.workunit.client.0.smithi002.stdout:7/480: rename d8/d10/d11/d13/d26/d4c/d81/d46/d7e to d8/d10/d11/d13/d26/d88 0 2024-09-13T22:56:14.246 INFO:tasks.workunit.client.1.smithi047.stdout:9/567: write d1/dc/d14/dd/d54/d50/d91/da3/fa9 [176723,84419] 0 2024-09-13T22:56:14.246 INFO:tasks.workunit.client.0.smithi002.stdout:3/609: link d9/d15/d36/d4e/d5e/f90 d9/d3b/d53/d83/dda/fde 0 2024-09-13T22:56:14.252 INFO:tasks.workunit.client.1.smithi047.stdout:3/636: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d85/fab [57153,82461] 0 2024-09-13T22:56:14.254 INFO:tasks.workunit.client.1.smithi047.stdout:3/637: stat d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/fc6 0 2024-09-13T22:56:14.257 INFO:tasks.workunit.client.1.smithi047.stdout:3/638: chown d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/f89 11 1 2024-09-13T22:56:14.259 INFO:tasks.workunit.client.1.smithi047.stdout:3/639: dread - d0/d3/d4/d16/d2c/de/fc7 zero size 2024-09-13T22:56:14.259 INFO:tasks.workunit.client.0.smithi002.stdout:6/558: write d12/d17/d34/d39/d8a/fa7 [93297,20715] 0 2024-09-13T22:56:14.262 INFO:tasks.workunit.client.0.smithi002.stdout:7/481: dread d8/f5d [0,4194304] 0 2024-09-13T22:56:14.263 INFO:tasks.workunit.client.0.smithi002.stdout:7/482: dread - d8/d10/d11/d13/d26/d4c/d81/d51/f86 zero size 2024-09-13T22:56:14.265 INFO:tasks.workunit.client.1.smithi047.stdout:9/568: dread d1/dc/d14/dd/d54/f4f [0,4194304] 0 2024-09-13T22:56:14.267 INFO:tasks.workunit.client.1.smithi047.stdout:9/569: chown d1/dc/d14/dd/d54/d4e/la4 173769530 1 2024-09-13T22:56:14.268 INFO:tasks.workunit.client.0.smithi002.stdout:5/548: rename d1/d2a/d6b/d88/d45/d4f/d99 to d1/d2a/d6b/d88/d55/d56/dc7 0 2024-09-13T22:56:14.269 INFO:tasks.workunit.client.0.smithi002.stdout:5/549: write d1/d2a/d69/f92 [1236743,113060] 0 2024-09-13T22:56:14.270 INFO:tasks.workunit.client.0.smithi002.stdout:5/550: chown d1/d2a/d69/f92 211156 1 2024-09-13T22:56:14.272 INFO:tasks.workunit.client.1.smithi047.stdout:3/640: creat d0/d3/d4/d16/d2c/de/d3d/fc9 x:0 0 0 2024-09-13T22:56:14.274 INFO:tasks.workunit.client.0.smithi002.stdout:3/610: rmdir d9/d3b/da5 39 2024-09-13T22:56:14.276 INFO:tasks.workunit.client.0.smithi002.stdout:0/555: dread d1/f2d [4194304,4194304] 0 2024-09-13T22:56:14.276 INFO:tasks.workunit.client.1.smithi047.stdout:9/570: mknod d1/d5f/d6a/cb7 0 2024-09-13T22:56:14.277 INFO:tasks.workunit.client.0.smithi002.stdout:0/556: write d1/d2/d81/fc7 [281368,49469] 0 2024-09-13T22:56:14.279 INFO:tasks.workunit.client.1.smithi047.stdout:3/641: creat d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/fca x:0 0 0 2024-09-13T22:56:14.281 INFO:tasks.workunit.client.1.smithi047.stdout:9/571: unlink d1/dc/d14/dd/d54/d4e/d51/d79/f7d 0 2024-09-13T22:56:14.282 INFO:tasks.workunit.client.1.smithi047.stdout:9/572: write d1/dc/d14/dd/d54/d50/f92 [445113,105045] 0 2024-09-13T22:56:14.283 INFO:tasks.workunit.client.0.smithi002.stdout:7/483: creat d8/d10/f89 x:0 0 0 2024-09-13T22:56:14.286 INFO:tasks.workunit.client.0.smithi002.stdout:1/582: rename d1/d13/d1d/d34/d51/f8d to d1/d13/d30/d73/fbb 0 2024-09-13T22:56:14.286 INFO:tasks.workunit.client.1.smithi047.stdout:3/642: dread d0/d3/d4/d16/f4e [0,4194304] 0 2024-09-13T22:56:14.290 INFO:tasks.workunit.client.0.smithi002.stdout:2/540: rmdir d1/d7/d8 39 2024-09-13T22:56:14.291 INFO:tasks.workunit.client.1.smithi047.stdout:9/573: read d1/dc/d14/f4d [879943,126657] 0 2024-09-13T22:56:14.291 INFO:tasks.workunit.client.0.smithi002.stdout:2/541: write d1/d7/d35/d3e/d59/d87/f99 [833847,83945] 0 2024-09-13T22:56:14.294 INFO:tasks.workunit.client.0.smithi002.stdout:5/551: fdatasync d1/d10/f3d 0 2024-09-13T22:56:14.297 INFO:tasks.workunit.client.0.smithi002.stdout:3/611: read d9/d15/d26/d93/f6b [340417,105543] 0 2024-09-13T22:56:14.298 INFO:tasks.workunit.client.1.smithi047.stdout:9/574: dwrite d1/dc/d14/dd/d54/d50/f92 [0,4194304] 0 2024-09-13T22:56:14.299 INFO:tasks.workunit.client.0.smithi002.stdout:0/557: dread d1/d2/f67 [0,4194304] 0 2024-09-13T22:56:14.300 INFO:tasks.workunit.client.1.smithi047.stdout:9/575: chown d1/dc/d14/dd/d54/d4e/la4 516393 1 2024-09-13T22:56:14.301 INFO:tasks.workunit.client.1.smithi047.stdout:9/576: readlink d1/l5e 0 2024-09-13T22:56:14.305 INFO:tasks.workunit.client.1.smithi047.stdout:3/643: dread d0/d3/d4/f9 [0,4194304] 0 2024-09-13T22:56:14.307 INFO:tasks.workunit.client.1.smithi047.stdout:9/577: mknod d1/dc/d14/dd/d54/cb8 0 2024-09-13T22:56:14.308 INFO:tasks.workunit.client.0.smithi002.stdout:1/583: creat d1/d13/d30/d31/d3d/d5d/fbc x:0 0 0 2024-09-13T22:56:14.309 INFO:tasks.workunit.client.0.smithi002.stdout:1/584: write d1/d13/d30/f2a [1721447,45006] 0 2024-09-13T22:56:14.312 INFO:tasks.workunit.client.0.smithi002.stdout:9/582: write d8/d10/d42/f4c [1535318,72170] 0 2024-09-13T22:56:14.313 INFO:tasks.workunit.client.0.smithi002.stdout:5/552: creat d1/d2a/d6b/d88/d45/d4f/d78/d8b/fc8 x:0 0 0 2024-09-13T22:56:14.314 INFO:tasks.workunit.client.1.smithi047.stdout:6/665: truncate d3/d11/d2b/d4c/d30/f37 3325590 0 2024-09-13T22:56:14.314 INFO:tasks.workunit.client.1.smithi047.stdout:4/738: dwrite dc/d29/f61 [0,4194304] 0 2024-09-13T22:56:14.316 INFO:tasks.workunit.client.0.smithi002.stdout:3/612: mknod d9/d3b/d7c/cdf 0 2024-09-13T22:56:14.317 INFO:tasks.workunit.client.0.smithi002.stdout:3/613: truncate d9/d15/d26/fc4 295885 0 2024-09-13T22:56:14.318 INFO:tasks.workunit.client.1.smithi047.stdout:7/617: dwrite d0/d7/da/d2e/d64/fc3 [0,4194304] 0 2024-09-13T22:56:14.319 INFO:tasks.workunit.client.0.smithi002.stdout:0/558: creat d1/d4/d75/d31/d32/dbb/fc9 x:0 0 0 2024-09-13T22:56:14.323 INFO:tasks.workunit.client.1.smithi047.stdout:1/691: sync 2024-09-13T22:56:14.323 INFO:tasks.workunit.client.1.smithi047.stdout:5/561: sync 2024-09-13T22:56:14.332 INFO:tasks.workunit.client.1.smithi047.stdout:5/562: dread d19/d34/d42/d5d/f6e [0,4194304] 0 2024-09-13T22:56:14.332 INFO:tasks.workunit.client.1.smithi047.stdout:6/666: truncate d3/f26 2727240 0 2024-09-13T22:56:14.333 INFO:tasks.workunit.client.1.smithi047.stdout:7/618: creat d0/d57/d5b/d8b/d95/fcd x:0 0 0 2024-09-13T22:56:14.333 INFO:tasks.workunit.client.0.smithi002.stdout:2/542: rmdir d1/d7/d8/d51 39 2024-09-13T22:56:14.334 INFO:tasks.workunit.client.1.smithi047.stdout:7/619: fsync d0/d7/da/d2e/d64/fc3 0 2024-09-13T22:56:14.335 INFO:tasks.workunit.client.0.smithi002.stdout:8/519: dwrite d3/dc/d18/d2e/f8f [0,4194304] 0 2024-09-13T22:56:14.338 INFO:tasks.workunit.client.0.smithi002.stdout:9/583: rename d8/d2c/da6 to d8/d2c/dbc/dc8 0 2024-09-13T22:56:14.341 INFO:tasks.workunit.client.1.smithi047.stdout:4/739: mknod dc/d29/cfd 0 2024-09-13T22:56:14.346 INFO:tasks.workunit.client.1.smithi047.stdout:1/692: rename d0/d7/d14/d57/d62/d76/fbb to d0/d7/d75/fc7 0 2024-09-13T22:56:14.347 INFO:tasks.workunit.client.0.smithi002.stdout:4/510: dwrite d3/f1e [4194304,4194304] 0 2024-09-13T22:56:14.347 INFO:tasks.workunit.client.0.smithi002.stdout:0/559: mkdir d1/d4/d75/dca 0 2024-09-13T22:56:14.348 INFO:tasks.workunit.client.0.smithi002.stdout:5/553: dwrite d1/d2a/d6b/d88/d45/d4f/d78/d8b/f8e [0,4194304] 0 2024-09-13T22:56:14.349 INFO:tasks.workunit.client.0.smithi002.stdout:5/554: chown d1/d2a/c38 446004618 1 2024-09-13T22:56:14.350 INFO:tasks.workunit.client.1.smithi047.stdout:8/572: dwrite d8/d64/d4e/f92 [4194304,4194304] 0 2024-09-13T22:56:14.350 INFO:tasks.workunit.client.1.smithi047.stdout:6/667: symlink d3/d11/d2b/d4c/d9d/ldb 0 2024-09-13T22:56:14.351 INFO:tasks.workunit.client.1.smithi047.stdout:2/670: dwrite d1/de/f33 [0,4194304] 0 2024-09-13T22:56:14.352 INFO:tasks.workunit.client.0.smithi002.stdout:6/559: getdents d12/d17 0 2024-09-13T22:56:14.354 INFO:tasks.workunit.client.0.smithi002.stdout:6/560: write d12/d17/d34/d39/f62 [449151,43355] 0 2024-09-13T22:56:14.359 INFO:tasks.workunit.client.0.smithi002.stdout:1/585: mkdir d1/d13/d30/d73/da1/d9d/dbd 0 2024-09-13T22:56:14.362 INFO:tasks.workunit.client.0.smithi002.stdout:9/584: dread d8/d10/d1c/d3d/f7e [0,4194304] 0 2024-09-13T22:56:14.364 INFO:tasks.workunit.client.0.smithi002.stdout:9/585: write d8/d2c/dbc/dc8/fc0 [1434066,98745] 0 2024-09-13T22:56:14.365 INFO:tasks.workunit.client.0.smithi002.stdout:9/586: stat d8/c4b 0 2024-09-13T22:56:14.375 INFO:tasks.workunit.client.1.smithi047.stdout:5/563: rename d19/d25/d45/f60 to d19/d83/fb5 0 2024-09-13T22:56:14.379 INFO:tasks.workunit.client.1.smithi047.stdout:6/668: symlink d3/d11/d2b/d4c/d30/d48/ldc 0 2024-09-13T22:56:14.379 INFO:tasks.workunit.client.1.smithi047.stdout:6/669: stat d3/d77/d93/fa3 0 2024-09-13T22:56:14.387 INFO:tasks.workunit.client.0.smithi002.stdout:0/560: symlink d1/d4/d75/d31/lcb 0 2024-09-13T22:56:14.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:14 smithi047 ceph-mon[34560]: pgmap v17: 65 pgs: 65 active+clean; 2.2 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 74 MiB/s rd, 252 MiB/s wr, 477 op/s 2024-09-13T22:56:14.476 INFO:tasks.workunit.client.0.smithi002.stdout:9/587: read d8/d91/d96/fa2 [63211,112042] 0 2024-09-13T22:56:14.492 INFO:tasks.workunit.client.0.smithi002.stdout:4/511: creat d3/d40/d45/f9a x:0 0 0 2024-09-13T22:56:14.494 INFO:tasks.workunit.client.0.smithi002.stdout:4/512: dread d3/d14/d29/d2a/f36 [0,4194304] 0 2024-09-13T22:56:14.495 INFO:tasks.workunit.client.0.smithi002.stdout:5/555: link d1/d2a/d6b/d88/d45/f54 d1/d2a/d6b/d88/d55/d56/d81/fc9 0 2024-09-13T22:56:14.495 INFO:tasks.workunit.client.0.smithi002.stdout:5/556: readlink d1/la1 0 2024-09-13T22:56:14.496 INFO:tasks.workunit.client.1.smithi047.stdout:7/620: dwrite d0/d7/da/fcc [0,4194304] 0 2024-09-13T22:56:14.497 INFO:tasks.workunit.client.0.smithi002.stdout:5/557: read d1/d2a/d5a/f62 [351308,49040] 0 2024-09-13T22:56:14.497 INFO:tasks.workunit.client.0.smithi002.stdout:5/558: chown d1/d2a/lb4 40598 1 2024-09-13T22:56:14.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:14 smithi002 ceph-mon[27637]: pgmap v17: 65 pgs: 65 active+clean; 2.2 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 74 MiB/s rd, 252 MiB/s wr, 477 op/s 2024-09-13T22:56:14.500 INFO:tasks.workunit.client.0.smithi002.stdout:1/586: symlink d1/d13/d30/d31/d3b/d71/lbe 0 2024-09-13T22:56:14.504 INFO:tasks.workunit.client.0.smithi002.stdout:5/559: dwrite d1/d2a/d5a/f6d [0,4194304] 0 2024-09-13T22:56:14.504 INFO:tasks.workunit.client.1.smithi047.stdout:7/621: dwrite d0/d7/fc8 [0,4194304] 0 2024-09-13T22:56:14.505 INFO:tasks.workunit.client.1.smithi047.stdout:7/622: read d0/d7/f36 [501359,13411] 0 2024-09-13T22:56:14.507 INFO:tasks.workunit.client.0.smithi002.stdout:0/561: sync 2024-09-13T22:56:14.507 INFO:tasks.workunit.client.0.smithi002.stdout:0/562: stat d1/d2 0 2024-09-13T22:56:14.510 INFO:tasks.workunit.client.0.smithi002.stdout:7/484: creat d8/d10/d11/d13/d26/d4c/f8a x:0 0 0 2024-09-13T22:56:14.512 INFO:tasks.workunit.client.0.smithi002.stdout:3/614: link d9/d15/d36/c7f d9/d3b/d53/d95/ce0 0 2024-09-13T22:56:14.513 INFO:tasks.workunit.client.1.smithi047.stdout:5/564: rmdir d19/d23 39 2024-09-13T22:56:14.513 INFO:tasks.workunit.client.1.smithi047.stdout:0/642: sync 2024-09-13T22:56:14.518 INFO:tasks.workunit.client.0.smithi002.stdout:4/513: rmdir d3/d14/d25 39 2024-09-13T22:56:14.520 INFO:tasks.workunit.client.1.smithi047.stdout:9/578: write d1/dc/d14/dd/d54/d4e/f7b [2585326,8618] 0 2024-09-13T22:56:14.521 INFO:tasks.workunit.client.0.smithi002.stdout:8/520: truncate d3/f4f 1913284 0 2024-09-13T22:56:14.523 INFO:tasks.workunit.client.0.smithi002.stdout:6/561: creat d12/d17/d34/fb2 x:0 0 0 2024-09-13T22:56:14.530 INFO:tasks.workunit.client.0.smithi002.stdout:2/543: getdents d1/d7/d52/daa 0 2024-09-13T22:56:14.536 INFO:tasks.workunit.client.1.smithi047.stdout:4/740: rmdir dc/de/d23/dc4/dfc 0 2024-09-13T22:56:14.536 INFO:tasks.workunit.client.1.smithi047.stdout:4/741: readlink dc/d29/l51 0 2024-09-13T22:56:14.539 INFO:tasks.workunit.client.0.smithi002.stdout:3/615: truncate d9/d15/d26/f85 1440613 0 2024-09-13T22:56:14.543 INFO:tasks.workunit.client.1.smithi047.stdout:1/693: truncate d0/d7/d14/d28/d36/f9b 953558 0 2024-09-13T22:56:14.543 INFO:tasks.workunit.client.1.smithi047.stdout:6/670: write d3/d77/d8f/db9/fc3 [2091775,11994] 0 2024-09-13T22:56:14.546 INFO:tasks.workunit.client.0.smithi002.stdout:4/514: dwrite d3/d14/d25/d5e/f65 [0,4194304] 0 2024-09-13T22:56:14.546 INFO:tasks.workunit.client.0.smithi002.stdout:8/521: rmdir d3/dc/d16/d2f/d83 39 2024-09-13T22:56:14.549 INFO:tasks.workunit.client.1.smithi047.stdout:9/579: fsync d1/dc/d14/f4d 0 2024-09-13T22:56:14.550 INFO:tasks.workunit.client.1.smithi047.stdout:1/694: dwrite d0/d7/d14/d57/d62/fa3 [0,4194304] 0 2024-09-13T22:56:14.551 INFO:tasks.workunit.client.1.smithi047.stdout:2/671: truncate d1/df/d26/d4b/f5a 7491017 0 2024-09-13T22:56:14.554 INFO:tasks.workunit.client.1.smithi047.stdout:2/672: read d1/df/d1d/d20/d37/d7a/fbc [292923,63255] 0 2024-09-13T22:56:14.556 INFO:tasks.workunit.client.0.smithi002.stdout:6/562: creat d12/d17/d28/d67/d6b/fb3 x:0 0 0 2024-09-13T22:56:14.558 INFO:tasks.workunit.client.1.smithi047.stdout:5/565: dread d19/d23/d2e/d41/f9c [0,4194304] 0 2024-09-13T22:56:14.559 INFO:tasks.workunit.client.1.smithi047.stdout:4/742: symlink dc/d29/d4d/lfe 0 2024-09-13T22:56:14.563 INFO:tasks.workunit.client.0.smithi002.stdout:2/544: rename d1/fa6 to d1/d80/fb6 0 2024-09-13T22:56:14.564 INFO:tasks.workunit.client.0.smithi002.stdout:9/588: truncate d8/d10/d42/f4c 4505145 0 2024-09-13T22:56:14.565 INFO:tasks.workunit.client.1.smithi047.stdout:0/643: symlink d1/d5/d16/d23/lcf 0 2024-09-13T22:56:14.566 INFO:tasks.workunit.client.0.smithi002.stdout:5/560: dwrite d1/d10/f4b [0,4194304] 0 2024-09-13T22:56:14.566 INFO:tasks.workunit.client.1.smithi047.stdout:0/644: readlink d1/d5/d16/d23/d2d/l95 0 2024-09-13T22:56:14.570 INFO:tasks.workunit.client.1.smithi047.stdout:3/644: sync 2024-09-13T22:56:14.571 INFO:tasks.workunit.client.0.smithi002.stdout:5/561: dread d1/d10/f4b [0,4194304] 0 2024-09-13T22:56:14.572 INFO:tasks.workunit.client.0.smithi002.stdout:5/562: write d1/d57/fc4 [838617,100951] 0 2024-09-13T22:56:14.574 INFO:tasks.workunit.client.0.smithi002.stdout:5/563: chown d1/d2a/d6b/d88/f4d 261672 1 2024-09-13T22:56:14.580 INFO:tasks.workunit.client.1.smithi047.stdout:1/695: unlink d0/d7/d13/l95 0 2024-09-13T22:56:14.581 INFO:tasks.workunit.client.1.smithi047.stdout:1/696: fdatasync d0/d7/d13/f3c 0 2024-09-13T22:56:14.581 INFO:tasks.workunit.client.0.smithi002.stdout:6/563: creat d12/d17/d4e/fb4 x:0 0 0 2024-09-13T22:56:14.584 INFO:tasks.workunit.client.0.smithi002.stdout:1/587: link d1/d13/d30/d31/d3b/d71/lbe d1/d13/d30/d73/lbf 0 2024-09-13T22:56:14.585 INFO:tasks.workunit.client.1.smithi047.stdout:7/623: link d0/d57/d5b/lad d0/d7/da/d1e/d51/lce 0 2024-09-13T22:56:14.586 INFO:tasks.workunit.client.1.smithi047.stdout:7/624: dread - d0/d57/d5b/d8b/d95/fcb zero size 2024-09-13T22:56:14.587 INFO:tasks.workunit.client.1.smithi047.stdout:7/625: write d0/d7/da/fcc [3601122,29341] 0 2024-09-13T22:56:14.592 INFO:tasks.workunit.client.0.smithi002.stdout:2/545: creat d1/d7/d35/d3e/d59/d6b/fb7 x:0 0 0 2024-09-13T22:56:14.592 INFO:tasks.workunit.client.0.smithi002.stdout:0/563: truncate d1/d2/d81/d8f/f48 7125748 0 2024-09-13T22:56:14.594 INFO:tasks.workunit.client.0.smithi002.stdout:9/589: fdatasync d8/d10/d1c/d3d/f3e 0 2024-09-13T22:56:14.595 INFO:tasks.workunit.client.1.smithi047.stdout:0/645: rmdir d1/d5/d16/d23/d45 39 2024-09-13T22:56:14.598 INFO:tasks.workunit.client.1.smithi047.stdout:6/671: dwrite d3/d11/d74/fb3 [0,4194304] 0 2024-09-13T22:56:14.600 INFO:tasks.workunit.client.1.smithi047.stdout:9/580: readlink d1/dc/d14/dd/d54/d50/l6d 0 2024-09-13T22:56:14.604 INFO:tasks.workunit.client.0.smithi002.stdout:4/515: dwrite d3/d14/d25/f5c [0,4194304] 0 2024-09-13T22:56:14.607 INFO:tasks.workunit.client.1.smithi047.stdout:1/697: creat d0/d7/db/d79/fc8 x:0 0 0 2024-09-13T22:56:14.607 INFO:tasks.workunit.client.1.smithi047.stdout:2/673: write d1/df/d26/f9c [951082,122820] 0 2024-09-13T22:56:14.609 INFO:tasks.workunit.client.1.smithi047.stdout:1/698: dread - d0/d7/d14/d57/d62/d76/d94/fab zero size 2024-09-13T22:56:14.611 INFO:tasks.workunit.client.0.smithi002.stdout:5/564: unlink d1/d2a/d6b/d88/d55/f5f 0 2024-09-13T22:56:14.615 INFO:tasks.workunit.client.1.smithi047.stdout:7/626: fdatasync d0/d7/f7a 0 2024-09-13T22:56:14.617 INFO:tasks.workunit.client.1.smithi047.stdout:2/674: dread d1/df/d1d/d20/d54/f95 [0,4194304] 0 2024-09-13T22:56:14.618 INFO:tasks.workunit.client.0.smithi002.stdout:6/564: write d12/d17/d2a/f94 [2523888,117032] 0 2024-09-13T22:56:14.618 INFO:tasks.workunit.client.0.smithi002.stdout:6/565: stat d12/d17/d2a/l90 0 2024-09-13T22:56:14.619 INFO:tasks.workunit.client.0.smithi002.stdout:1/588: mkdir d1/d13/d30/d73/dc0 0 2024-09-13T22:56:14.619 INFO:tasks.workunit.client.0.smithi002.stdout:6/566: chown d12/d17/d28/f2e 298234 1 2024-09-13T22:56:14.620 INFO:tasks.workunit.client.0.smithi002.stdout:1/589: read - d1/d13/d21/d40/f94 zero size 2024-09-13T22:56:14.620 INFO:tasks.workunit.client.0.smithi002.stdout:6/567: chown d12/d17/d34/d39/d8b/fa3 2107248875 1 2024-09-13T22:56:14.621 INFO:tasks.workunit.client.0.smithi002.stdout:3/616: truncate d9/d15/d51/f18 6079838 0 2024-09-13T22:56:14.624 INFO:tasks.workunit.client.1.smithi047.stdout:2/675: dwrite d1/df/d1d/d20/d37/d7b/f86 [4194304,4194304] 0 2024-09-13T22:56:14.625 INFO:tasks.workunit.client.0.smithi002.stdout:6/568: dread d12/d17/d28/fac [0,4194304] 0 2024-09-13T22:56:14.626 INFO:tasks.workunit.client.0.smithi002.stdout:1/590: dread d1/d13/d30/f2a [0,4194304] 0 2024-09-13T22:56:14.626 INFO:tasks.workunit.client.0.smithi002.stdout:6/569: stat d12/d17/d28/d67/d6b/l53 0 2024-09-13T22:56:14.627 INFO:tasks.workunit.client.1.smithi047.stdout:0/646: mkdir d1/d5/d16/d47/dd0 0 2024-09-13T22:56:14.628 INFO:tasks.workunit.client.0.smithi002.stdout:1/591: fdatasync d1/d13/d30/d31/d3d/d5d/f62 0 2024-09-13T22:56:14.629 INFO:tasks.workunit.client.1.smithi047.stdout:0/647: readlink d1/d5/d16/d47/lab 0 2024-09-13T22:56:14.629 INFO:tasks.workunit.client.1.smithi047.stdout:2/676: dread d1/de/f33 [0,4194304] 0 2024-09-13T22:56:14.629 INFO:tasks.workunit.client.1.smithi047.stdout:3/645: truncate d0/f12 2069409 0 2024-09-13T22:56:14.632 INFO:tasks.workunit.client.0.smithi002.stdout:6/570: dwrite d12/f6a [0,4194304] 0 2024-09-13T22:56:14.633 INFO:tasks.workunit.client.1.smithi047.stdout:9/581: symlink d1/d5f/d6a/lb9 0 2024-09-13T22:56:14.635 INFO:tasks.workunit.client.1.smithi047.stdout:3/646: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/fc6 [15689,11389] 0 2024-09-13T22:56:14.637 INFO:tasks.workunit.client.0.smithi002.stdout:7/485: getdents d8/d10/d11/d13/d26/d4c/d81/d46 0 2024-09-13T22:56:14.638 INFO:tasks.workunit.client.0.smithi002.stdout:0/564: write d1/d2/d81/d8f/f47 [4591094,122752] 0 2024-09-13T22:56:14.638 INFO:tasks.workunit.client.0.smithi002.stdout:0/565: stat d1/d7e/d9d/fc6 0 2024-09-13T22:56:14.640 INFO:tasks.workunit.client.1.smithi047.stdout:0/648: dwrite d1/d5/d16/d23/d2d/f5a [0,4194304] 0 2024-09-13T22:56:14.645 INFO:tasks.workunit.client.1.smithi047.stdout:3/647: write d0/d3/d4/d16/d2c/de/d1f/d3b/d69/fb7 [836054,94308] 0 2024-09-13T22:56:14.645 INFO:tasks.workunit.client.1.smithi047.stdout:2/677: dwrite d1/df/d1d/d20/d37/d7b/f86 [4194304,4194304] 0 2024-09-13T22:56:14.652 INFO:tasks.workunit.client.0.smithi002.stdout:5/565: rename d1/d10/l25 to d1/d2a/d69/lca 0 2024-09-13T22:56:14.653 INFO:tasks.workunit.client.1.smithi047.stdout:0/649: dwrite d1/d5/d11/f35 [4194304,4194304] 0 2024-09-13T22:56:14.654 INFO:tasks.workunit.client.0.smithi002.stdout:5/566: stat d1/d2a/d6b/d88/d55/d56/dc7/fb1 0 2024-09-13T22:56:14.657 INFO:tasks.workunit.client.0.smithi002.stdout:3/617: creat d9/df/d71/fe1 x:0 0 0 2024-09-13T22:56:14.657 INFO:tasks.workunit.client.1.smithi047.stdout:4/743: link dc/d29/cfd dc/de/d23/dc4/ddb/cff 0 2024-09-13T22:56:14.661 INFO:tasks.workunit.client.0.smithi002.stdout:2/546: link d1/d32/d37/f9c d1/d4a/fb8 0 2024-09-13T22:56:14.665 INFO:tasks.workunit.client.1.smithi047.stdout:3/648: dread - d0/f98 zero size 2024-09-13T22:56:14.667 INFO:tasks.workunit.client.1.smithi047.stdout:1/699: creat d0/d7/d14/d57/db6/fc9 x:0 0 0 2024-09-13T22:56:14.669 INFO:tasks.workunit.client.0.smithi002.stdout:9/590: mknod d8/d91/d96/d87/da5/d94/cc9 0 2024-09-13T22:56:14.673 INFO:tasks.workunit.client.1.smithi047.stdout:5/566: getdents d19/d83 0 2024-09-13T22:56:14.674 INFO:tasks.workunit.client.1.smithi047.stdout:1/700: dwrite d0/d7/d14/d57/d62/fc1 [0,4194304] 0 2024-09-13T22:56:14.675 INFO:tasks.workunit.client.0.smithi002.stdout:7/486: chown d8/d10/d39/d60/f7a 2086790 1 2024-09-13T22:56:14.677 INFO:tasks.workunit.client.1.smithi047.stdout:4/744: creat dc/de/d23/d40/d7b/f100 x:0 0 0 2024-09-13T22:56:14.680 INFO:tasks.workunit.client.1.smithi047.stdout:9/582: dread d1/dc/d14/dd/d54/d50/f66 [0,4194304] 0 2024-09-13T22:56:14.682 INFO:tasks.workunit.client.1.smithi047.stdout:9/583: write d1/dc/d14/dd/d54/d50/d91/da3/fa9 [247828,64009] 0 2024-09-13T22:56:14.688 INFO:tasks.workunit.client.0.smithi002.stdout:3/618: creat d9/d15/d36/d4e/fe2 x:0 0 0 2024-09-13T22:56:14.690 INFO:tasks.workunit.client.1.smithi047.stdout:0/650: creat d1/d5/d16/d23/d45/d84/fd1 x:0 0 0 2024-09-13T22:56:14.690 INFO:tasks.workunit.client.0.smithi002.stdout:2/547: readlink d1/d7/d35/d3e/d59/d87/l8d 0 2024-09-13T22:56:14.692 INFO:tasks.workunit.client.1.smithi047.stdout:3/649: dwrite d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/f6b [0,4194304] 0 2024-09-13T22:56:14.692 INFO:tasks.workunit.client.1.smithi047.stdout:9/584: dwrite d1/dc/d14/fad [0,4194304] 0 2024-09-13T22:56:14.694 INFO:tasks.workunit.client.1.smithi047.stdout:1/701: rmdir d0/d7/d14/d28 39 2024-09-13T22:56:14.694 INFO:tasks.workunit.client.0.smithi002.stdout:9/591: truncate d8/d2c/f47 1907491 0 2024-09-13T22:56:14.695 INFO:tasks.workunit.client.0.smithi002.stdout:9/592: fdatasync d8/d91/d96/fb4 0 2024-09-13T22:56:14.697 INFO:tasks.workunit.client.1.smithi047.stdout:5/567: mknod d19/d23/d32/cb6 0 2024-09-13T22:56:14.700 INFO:tasks.workunit.client.0.smithi002.stdout:1/592: mkdir d1/d13/d30/dc1 0 2024-09-13T22:56:14.700 INFO:tasks.workunit.client.0.smithi002.stdout:1/593: fsync d1/d13/d21/d40/f94 0 2024-09-13T22:56:14.701 INFO:tasks.workunit.client.1.smithi047.stdout:4/745: mknod dc/de/d23/d40/d7b/c101 0 2024-09-13T22:56:14.708 INFO:tasks.workunit.client.1.smithi047.stdout:7/627: truncate d0/d19/f7c 4151040 0 2024-09-13T22:56:14.709 INFO:tasks.workunit.client.0.smithi002.stdout:4/516: creat d3/d14/d25/f9b x:0 0 0 2024-09-13T22:56:14.710 INFO:tasks.workunit.client.1.smithi047.stdout:8/573: sync 2024-09-13T22:56:14.713 INFO:tasks.workunit.client.1.smithi047.stdout:0/651: unlink d1/d5/d16/d47/fb9 0 2024-09-13T22:56:14.714 INFO:tasks.workunit.client.1.smithi047.stdout:0/652: chown d1/d5/d11/d2f/fb0 932686 1 2024-09-13T22:56:14.714 INFO:tasks.workunit.client.0.smithi002.stdout:4/517: dwrite d3/d14/f5b [0,4194304] 0 2024-09-13T22:56:14.715 INFO:tasks.workunit.client.0.smithi002.stdout:4/518: readlink d3/d14/d29/l8f 0 2024-09-13T22:56:14.717 INFO:tasks.workunit.client.0.smithi002.stdout:9/593: fsync d8/d91/d96/f86 0 2024-09-13T22:56:14.717 INFO:tasks.workunit.client.1.smithi047.stdout:4/746: dread f4 [0,4194304] 0 2024-09-13T22:56:14.719 INFO:tasks.workunit.client.0.smithi002.stdout:1/594: mknod d1/d13/d30/d73/da1/d7d/cc2 0 2024-09-13T22:56:14.722 INFO:tasks.workunit.client.0.smithi002.stdout:8/522: sync 2024-09-13T22:56:14.727 INFO:tasks.workunit.client.1.smithi047.stdout:7/628: rename d0/d7/da/d2e/fa0 to d0/da2/fcf 0 2024-09-13T22:56:14.728 INFO:tasks.workunit.client.1.smithi047.stdout:7/629: readlink d0/d7/da/d47/lc1 0 2024-09-13T22:56:14.728 INFO:tasks.workunit.client.0.smithi002.stdout:8/523: write d3/dc/d18/d2e/f8d [79,108790] 0 2024-09-13T22:56:14.729 INFO:tasks.workunit.client.0.smithi002.stdout:0/566: truncate d1/d2/d81/d8f/f48 7421399 0 2024-09-13T22:56:14.731 INFO:tasks.workunit.client.0.smithi002.stdout:7/487: mknod d8/d10/d11/d13/d26/c8b 0 2024-09-13T22:56:14.735 INFO:tasks.workunit.client.1.smithi047.stdout:8/574: mknod d8/d64/d4e/d4d/d8f/d91/d38/d7a/cc9 0 2024-09-13T22:56:14.736 INFO:tasks.workunit.client.1.smithi047.stdout:3/650: write d0/d3/d4/f4c [5513225,86267] 0 2024-09-13T22:56:14.738 INFO:tasks.workunit.client.0.smithi002.stdout:2/548: truncate d1/d4a/fb8 2172026 0 2024-09-13T22:56:14.739 INFO:tasks.workunit.client.0.smithi002.stdout:2/549: write d1/f6a [103152,26371] 0 2024-09-13T22:56:14.740 INFO:tasks.workunit.client.1.smithi047.stdout:0/653: rename d1/d5/d16/d6a/d92/l9d to d1/d5/d16/d6a/d92/ld2 0 2024-09-13T22:56:14.744 INFO:tasks.workunit.client.1.smithi047.stdout:0/654: truncate d1/d5/f24 4756117 0 2024-09-13T22:56:14.744 INFO:tasks.workunit.client.1.smithi047.stdout:5/568: symlink d19/d34/lb7 0 2024-09-13T22:56:14.745 INFO:tasks.workunit.client.1.smithi047.stdout:9/585: write d1/dc/f15 [1402696,129372] 0 2024-09-13T22:56:14.747 INFO:tasks.workunit.client.0.smithi002.stdout:1/595: creat d1/d13/d30/d31/d3d/d5d/fc3 x:0 0 0 2024-09-13T22:56:14.748 INFO:tasks.workunit.client.0.smithi002.stdout:6/571: link d12/d17/d2a/f56 d12/fb5 0 2024-09-13T22:56:14.750 INFO:tasks.workunit.client.1.smithi047.stdout:9/586: dread d1/dc/d14/dd/d54/d50/d5b/d9e/f81 [0,4194304] 0 2024-09-13T22:56:14.751 INFO:tasks.workunit.client.1.smithi047.stdout:8/575: creat d8/d3f/d8c/da6/fca x:0 0 0 2024-09-13T22:56:14.751 INFO:tasks.workunit.client.1.smithi047.stdout:9/587: fsync d1/dc/f15 0 2024-09-13T22:56:14.752 INFO:tasks.workunit.client.1.smithi047.stdout:8/576: chown d8/l61 46560771 1 2024-09-13T22:56:14.752 INFO:tasks.workunit.client.1.smithi047.stdout:8/577: chown d8/d6b/da9/dc3 0 1 2024-09-13T22:56:14.754 INFO:tasks.workunit.client.1.smithi047.stdout:0/655: symlink d1/d5/d11/d52/ld3 0 2024-09-13T22:56:14.760 INFO:tasks.workunit.client.1.smithi047.stdout:3/651: mkdir d0/d3/d4/d16/d2c/dcb 0 2024-09-13T22:56:14.765 INFO:tasks.workunit.client.1.smithi047.stdout:3/652: read d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/f1e [7297469,78124] 0 2024-09-13T22:56:14.765 INFO:tasks.workunit.client.1.smithi047.stdout:3/653: fdatasync d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/f6b 0 2024-09-13T22:56:14.765 INFO:tasks.workunit.client.0.smithi002.stdout:5/567: sync 2024-09-13T22:56:14.766 INFO:tasks.workunit.client.1.smithi047.stdout:3/654: stat d0/d3/d4/d16/d32/d42/fbb 0 2024-09-13T22:56:14.768 INFO:tasks.workunit.client.1.smithi047.stdout:5/569: link d19/d23/d2e/d41/f51 d19/d25/d45/da3/fb8 0 2024-09-13T22:56:14.769 INFO:tasks.workunit.client.1.smithi047.stdout:0/656: creat d1/d5/d16/d23/d77/fd4 x:0 0 0 2024-09-13T22:56:14.770 INFO:tasks.workunit.client.0.smithi002.stdout:5/568: dwrite d1/d2a/d6b/d88/d55/d56/d81/fa5 [0,4194304] 0 2024-09-13T22:56:14.771 INFO:tasks.workunit.client.0.smithi002.stdout:5/569: stat d1/d2a/d6b/d88/d45 0 2024-09-13T22:56:14.772 INFO:tasks.workunit.client.0.smithi002.stdout:5/570: write d1/d2a/d6b/d88/d45/f91 [132359,95932] 0 2024-09-13T22:56:14.775 INFO:tasks.workunit.client.1.smithi047.stdout:0/657: dwrite d1/d5/d16/d23/fae [0,4194304] 0 2024-09-13T22:56:14.778 INFO:tasks.workunit.client.1.smithi047.stdout:9/588: mkdir d1/dc/d14/dd/dba 0 2024-09-13T22:56:14.785 INFO:tasks.workunit.client.1.smithi047.stdout:3/655: mkdir d0/d3/d4/d16/d2c/de/dcc 0 2024-09-13T22:56:14.787 INFO:tasks.workunit.client.1.smithi047.stdout:3/656: read d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/f89 [787982,25176] 0 2024-09-13T22:56:14.787 INFO:tasks.workunit.client.1.smithi047.stdout:5/570: rename d19/d64/l65 to d19/d34/d42/d5d/d9d/lb9 0 2024-09-13T22:56:14.788 INFO:tasks.workunit.client.0.smithi002.stdout:5/571: dread d1/d2a/d5a/f8c [0,4194304] 0 2024-09-13T22:56:14.789 INFO:tasks.workunit.client.0.smithi002.stdout:5/572: fsync d1/d2a/d6b/d88/d45/f9f 0 2024-09-13T22:56:14.790 INFO:tasks.workunit.client.1.smithi047.stdout:7/630: getdents d0/d7/da/d47/d92 0 2024-09-13T22:56:14.791 INFO:tasks.workunit.client.1.smithi047.stdout:7/631: chown d0/d57/d5b/d8b/fb8 5 1 2024-09-13T22:56:14.795 INFO:tasks.workunit.client.0.smithi002.stdout:3/619: creat d9/d15/fe3 x:0 0 0 2024-09-13T22:56:14.795 INFO:tasks.workunit.client.1.smithi047.stdout:9/589: creat d1/dc/d14/dd/d54/d4e/fbb x:0 0 0 2024-09-13T22:56:14.797 INFO:tasks.workunit.client.1.smithi047.stdout:8/578: creat d8/d64/fcb x:0 0 0 2024-09-13T22:56:14.802 INFO:tasks.workunit.client.0.smithi002.stdout:4/519: creat d3/d14/d25/d69/d7e/f9c x:0 0 0 2024-09-13T22:56:14.802 INFO:tasks.workunit.client.1.smithi047.stdout:5/571: read d19/d23/d4c/f52 [4325163,28186] 0 2024-09-13T22:56:14.804 INFO:tasks.workunit.client.1.smithi047.stdout:7/632: rename d0/d7/da/d2e/d64/f8e to d0/d57/d5b/d8b/fd0 0 2024-09-13T22:56:14.807 INFO:tasks.workunit.client.0.smithi002.stdout:1/596: write d1/d13/d30/d73/da1/f4c [3202181,123373] 0 2024-09-13T22:56:14.809 INFO:tasks.workunit.client.1.smithi047.stdout:9/590: dread d1/d5f/f9b [0,4194304] 0 2024-09-13T22:56:14.809 INFO:tasks.workunit.client.0.smithi002.stdout:6/572: symlink d12/d17/d34/d4b/lb6 0 2024-09-13T22:56:14.814 INFO:tasks.workunit.client.1.smithi047.stdout:3/657: symlink d0/d3/d4/d16/d2c/lcd 0 2024-09-13T22:56:14.814 INFO:tasks.workunit.client.0.smithi002.stdout:6/573: dwrite f1 [0,4194304] 0 2024-09-13T22:56:14.819 INFO:tasks.workunit.client.0.smithi002.stdout:0/567: write d1/d4/f3e [3920564,60749] 0 2024-09-13T22:56:14.823 INFO:tasks.workunit.client.0.smithi002.stdout:2/550: creat d1/d4d/d8b/fb9 x:0 0 0 2024-09-13T22:56:14.825 INFO:tasks.workunit.client.1.smithi047.stdout:8/579: creat d8/d64/d4e/d4d/d8f/d91/d78/fcc x:0 0 0 2024-09-13T22:56:14.828 INFO:tasks.workunit.client.0.smithi002.stdout:9/594: rename d8/d10/d61/fae to d8/d1e/fca 0 2024-09-13T22:56:14.828 INFO:tasks.workunit.client.0.smithi002.stdout:8/524: dwrite d3/dc/d18/d2e/f6b [0,4194304] 0 2024-09-13T22:56:14.829 INFO:tasks.workunit.client.0.smithi002.stdout:1/597: mkdir d1/d13/d21/d40/dc4 0 2024-09-13T22:56:14.829 INFO:tasks.workunit.client.1.smithi047.stdout:5/572: fdatasync d19/d25/f2b 0 2024-09-13T22:56:14.831 INFO:tasks.workunit.client.0.smithi002.stdout:7/488: dwrite d8/d10/d11/d13/d2e/f87 [0,4194304] 0 2024-09-13T22:56:14.832 INFO:tasks.workunit.client.1.smithi047.stdout:0/658: write d1/d5/d16/d23/d45/d7f/f78 [553988,30029] 0 2024-09-13T22:56:14.833 INFO:tasks.workunit.client.0.smithi002.stdout:8/525: chown d3/dc/d18/d6f/f90 412955 1 2024-09-13T22:56:14.834 INFO:tasks.workunit.client.0.smithi002.stdout:6/574: dread d12/d17/d2a/f94 [0,4194304] 0 2024-09-13T22:56:14.834 INFO:tasks.workunit.client.0.smithi002.stdout:5/573: creat d1/d2a/d6b/d88/d45/d4f/db7/fcb x:0 0 0 2024-09-13T22:56:14.835 INFO:tasks.workunit.client.1.smithi047.stdout:5/573: dread d19/d25/f38 [0,4194304] 0 2024-09-13T22:56:14.836 INFO:tasks.workunit.client.1.smithi047.stdout:9/591: mkdir d1/dc/d14/dd/d54/d8d/dbc 0 2024-09-13T22:56:14.837 INFO:tasks.workunit.client.0.smithi002.stdout:0/568: chown d1/f17 38075766 1 2024-09-13T22:56:14.838 INFO:tasks.workunit.client.1.smithi047.stdout:8/580: fdatasync d8/f9 0 2024-09-13T22:56:14.840 INFO:tasks.workunit.client.0.smithi002.stdout:9/595: dwrite d8/d91/d96/d87/f90 [0,4194304] 0 2024-09-13T22:56:14.843 INFO:tasks.workunit.client.0.smithi002.stdout:2/551: mkdir d1/d7/d41/d96/dba 0 2024-09-13T22:56:14.843 INFO:tasks.workunit.client.1.smithi047.stdout:7/633: write d0/d7/f3e [6701979,49690] 0 2024-09-13T22:56:14.844 INFO:tasks.workunit.client.1.smithi047.stdout:7/634: stat d0/d7/da/d2e/d64/f6c 0 2024-09-13T22:56:14.852 INFO:tasks.workunit.client.1.smithi047.stdout:0/659: rmdir d1 39 2024-09-13T22:56:14.854 INFO:tasks.workunit.client.0.smithi002.stdout:3/620: rename d9/d3b/d53/d95/fd8 to d9/d3b/d53/d83/fe4 0 2024-09-13T22:56:14.855 INFO:tasks.workunit.client.1.smithi047.stdout:5/574: fsync d19/d34/d42/d5d/f6e 0 2024-09-13T22:56:14.856 INFO:tasks.workunit.client.0.smithi002.stdout:1/598: creat d1/d13/d30/d31/d3b/d71/d80/fc5 x:0 0 0 2024-09-13T22:56:14.860 INFO:tasks.workunit.client.1.smithi047.stdout:8/581: dread - d8/d64/f9f zero size 2024-09-13T22:56:14.862 INFO:tasks.workunit.client.1.smithi047.stdout:3/658: creat d0/d3/d4/d16/d32/d42/d79/d9c/fce x:0 0 0 2024-09-13T22:56:14.863 INFO:tasks.workunit.client.0.smithi002.stdout:6/575: truncate d12/d17/d4e/f52 2354810 0 2024-09-13T22:56:14.864 INFO:tasks.workunit.client.1.smithi047.stdout:7/635: mkdir d0/d7/da/d4e/dd1 0 2024-09-13T22:56:14.865 INFO:tasks.workunit.client.1.smithi047.stdout:7/636: chown d0/d7/f2c 93783 1 2024-09-13T22:56:14.866 INFO:tasks.workunit.client.0.smithi002.stdout:0/569: creat d1/d4/d75/d31/d32/fcc x:0 0 0 2024-09-13T22:56:14.867 INFO:tasks.workunit.client.0.smithi002.stdout:9/596: creat d8/d10/d61/fcb x:0 0 0 2024-09-13T22:56:14.868 INFO:tasks.workunit.client.0.smithi002.stdout:8/526: write d3/dc/d18/f5a [4960634,6835] 0 2024-09-13T22:56:14.870 INFO:tasks.workunit.client.1.smithi047.stdout:5/575: fsync d19/d23/d4c/f7c 0 2024-09-13T22:56:14.874 INFO:tasks.workunit.client.1.smithi047.stdout:8/582: fsync d8/d3f/f66 0 2024-09-13T22:56:14.876 INFO:tasks.workunit.client.0.smithi002.stdout:1/599: mkdir d1/d13/d1d/d34/d51/dc6 0 2024-09-13T22:56:14.879 INFO:tasks.workunit.client.1.smithi047.stdout:7/637: symlink d0/d7/da/d1e/d51/ld2 0 2024-09-13T22:56:14.880 INFO:tasks.workunit.client.0.smithi002.stdout:6/576: creat d12/d17/fb7 x:0 0 0 2024-09-13T22:56:14.882 INFO:tasks.workunit.client.1.smithi047.stdout:0/660: rename d1/d5/d16/d23/d45/d7f/fb4 to d1/d7/dc9/fd5 0 2024-09-13T22:56:14.883 INFO:tasks.workunit.client.0.smithi002.stdout:0/570: creat d1/d4/d75/d31/fcd x:0 0 0 2024-09-13T22:56:14.884 INFO:tasks.workunit.client.0.smithi002.stdout:3/621: write d9/df/f23 [3873752,101967] 0 2024-09-13T22:56:14.884 INFO:tasks.workunit.client.0.smithi002.stdout:3/622: stat d9/df/c9a 0 2024-09-13T22:56:14.886 INFO:tasks.workunit.client.0.smithi002.stdout:9/597: rmdir d8/d10/d1c 39 2024-09-13T22:56:14.888 INFO:tasks.workunit.client.0.smithi002.stdout:0/571: dread d1/d7e/f8a [4194304,4194304] 0 2024-09-13T22:56:14.889 INFO:tasks.workunit.client.0.smithi002.stdout:0/572: write d1/d2/fd [1346558,107591] 0 2024-09-13T22:56:14.889 INFO:tasks.workunit.client.0.smithi002.stdout:8/527: mkdir d3/d21/d57/da1 0 2024-09-13T22:56:14.890 INFO:tasks.workunit.client.0.smithi002.stdout:0/573: chown d1/d7e/d9d 16755630 1 2024-09-13T22:56:14.891 INFO:tasks.workunit.client.0.smithi002.stdout:1/600: dread d1/d13/d21/d39/d70/f96 [0,4194304] 0 2024-09-13T22:56:14.892 INFO:tasks.workunit.client.1.smithi047.stdout:5/576: unlink d19/d34/c3d 0 2024-09-13T22:56:14.892 INFO:tasks.workunit.client.0.smithi002.stdout:4/520: link d3/d40/l6e d3/d14/d29/d2a/l9d 0 2024-09-13T22:56:14.895 INFO:tasks.workunit.client.1.smithi047.stdout:9/592: link d1/dc/d14/dd/d54/d50/d5b/fa6 d1/dc/fbd 0 2024-09-13T22:56:14.897 INFO:tasks.workunit.client.0.smithi002.stdout:7/489: rename d8/d10/f2b to d8/d10/d11/d13/d2e/d50/d52/d72/f8c 0 2024-09-13T22:56:14.898 INFO:tasks.workunit.client.1.smithi047.stdout:8/583: creat d8/d3f/d8c/da6/fcd x:0 0 0 2024-09-13T22:56:14.904 INFO:tasks.workunit.client.1.smithi047.stdout:7/638: mkdir d0/d7/da/d4e/dd3 0 2024-09-13T22:56:14.905 INFO:tasks.workunit.client.0.smithi002.stdout:3/623: mkdir d9/d15/d36/d4e/d5e/dae/d89/de5 0 2024-09-13T22:56:14.911 INFO:tasks.workunit.client.1.smithi047.stdout:9/593: symlink d1/dc/d14/dd/d54/d50/d91/lbe 0 2024-09-13T22:56:14.913 INFO:tasks.workunit.client.0.smithi002.stdout:0/574: unlink d1/d7e/f8a 0 2024-09-13T22:56:14.914 INFO:tasks.workunit.client.1.smithi047.stdout:8/584: mkdir d8/d6b/dce 0 2024-09-13T22:56:14.915 INFO:tasks.workunit.client.1.smithi047.stdout:8/585: truncate d8/f2c 9026714 0 2024-09-13T22:56:14.915 INFO:tasks.workunit.client.0.smithi002.stdout:4/521: rmdir d3/d14/d29/d2a/d30 39 2024-09-13T22:56:14.916 INFO:tasks.workunit.client.0.smithi002.stdout:4/522: chown d3/d14/d25/d69/c7b 9 1 2024-09-13T22:56:14.916 INFO:tasks.workunit.client.1.smithi047.stdout:8/586: chown d8/d64/d4e/d4d/d8f/d91/d40/f8d 1441 1 2024-09-13T22:56:14.917 INFO:tasks.workunit.client.0.smithi002.stdout:4/523: write d3/d14/f75 [3295344,6962] 0 2024-09-13T22:56:14.917 INFO:tasks.workunit.client.1.smithi047.stdout:3/659: creat d0/d3/d4/d16/d32/d42/d79/d9c/dad/fcf x:0 0 0 2024-09-13T22:56:14.918 INFO:tasks.workunit.client.0.smithi002.stdout:4/524: readlink d3/d14/d29/d2a/l9d 0 2024-09-13T22:56:14.922 INFO:tasks.workunit.client.0.smithi002.stdout:2/552: rename d1/d7/d35/d78/f6f to d1/d80/fbb 0 2024-09-13T22:56:14.923 INFO:tasks.workunit.client.1.smithi047.stdout:9/594: dread d1/f5 [0,4194304] 0 2024-09-13T22:56:14.923 INFO:tasks.workunit.client.1.smithi047.stdout:9/595: dread - d1/dc/d18/fab zero size 2024-09-13T22:56:14.923 INFO:tasks.workunit.client.0.smithi002.stdout:5/574: sync 2024-09-13T22:56:14.925 INFO:tasks.workunit.client.1.smithi047.stdout:9/596: write d1/dc/d14/dd/d54/d4e/d51/f53 [2553168,15476] 0 2024-09-13T22:56:14.927 INFO:tasks.workunit.client.1.smithi047.stdout:0/661: fsync d1/f17 0 2024-09-13T22:56:14.930 INFO:tasks.workunit.client.1.smithi047.stdout:5/577: mkdir d19/d23/d2e/dba 0 2024-09-13T22:56:14.932 INFO:tasks.workunit.client.0.smithi002.stdout:3/624: mkdir d9/d15/d36/d4e/d5e/dae/de6 0 2024-09-13T22:56:14.935 INFO:tasks.workunit.client.0.smithi002.stdout:9/598: fdatasync d8/d10/d1c/d3d/f7b 0 2024-09-13T22:56:14.938 INFO:tasks.workunit.client.1.smithi047.stdout:3/660: rename d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/f41 to d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/fd0 0 2024-09-13T22:56:14.942 INFO:tasks.workunit.client.0.smithi002.stdout:1/601: creat d1/d13/d30/dc1/fc7 x:0 0 0 2024-09-13T22:56:14.945 INFO:tasks.workunit.client.0.smithi002.stdout:0/575: write d1/d4/f21 [1791971,40975] 0 2024-09-13T22:56:14.948 INFO:tasks.workunit.client.1.smithi047.stdout:9/597: write d1/dc/fbd [216769,62370] 0 2024-09-13T22:56:14.950 INFO:tasks.workunit.client.1.smithi047.stdout:0/662: write d1/d5/f3f [146811,25668] 0 2024-09-13T22:56:14.953 INFO:tasks.workunit.client.1.smithi047.stdout:8/587: rename d8/c19 to d8/d64/dc5/ccf 0 2024-09-13T22:56:14.953 INFO:tasks.workunit.client.0.smithi002.stdout:2/553: rmdir d1/d80 39 2024-09-13T22:56:14.954 INFO:tasks.workunit.client.1.smithi047.stdout:7/639: link d0/d7/da/d2e/c90 d0/d57/d5b/d8b/d95/cd4 0 2024-09-13T22:56:14.954 INFO:tasks.workunit.client.0.smithi002.stdout:2/554: chown d1/d7/d41/d96/f9e 91466 1 2024-09-13T22:56:14.955 INFO:tasks.workunit.client.0.smithi002.stdout:5/575: symlink d1/d2a/d6b/d88/d45/d4f/db7/lcc 0 2024-09-13T22:56:14.958 INFO:tasks.workunit.client.0.smithi002.stdout:3/625: truncate d9/d3b/f64 1065699 0 2024-09-13T22:56:14.962 INFO:tasks.workunit.client.1.smithi047.stdout:9/598: dread d1/dc/d14/dd/d54/d4e/f7b [0,4194304] 0 2024-09-13T22:56:14.963 INFO:tasks.workunit.client.0.smithi002.stdout:8/528: creat d3/dc/fa2 x:0 0 0 2024-09-13T22:56:14.964 INFO:tasks.workunit.client.1.smithi047.stdout:5/578: truncate d19/f4f 407536 0 2024-09-13T22:56:14.965 INFO:tasks.workunit.client.1.smithi047.stdout:3/661: dwrite d0/f98 [0,4194304] 0 2024-09-13T22:56:14.965 INFO:tasks.workunit.client.0.smithi002.stdout:5/576: dread d1/d10/fae [0,4194304] 0 2024-09-13T22:56:14.969 INFO:tasks.workunit.client.1.smithi047.stdout:0/663: unlink d1/d5/d16/d97/ccc 0 2024-09-13T22:56:14.970 INFO:tasks.workunit.client.0.smithi002.stdout:0/576: mkdir d1/d4/d75/d31/d32/dce 0 2024-09-13T22:56:14.971 INFO:tasks.workunit.client.0.smithi002.stdout:0/577: chown d1/d4/d75/d76/la2 678 1 2024-09-13T22:56:14.972 INFO:tasks.workunit.client.0.smithi002.stdout:0/578: write d1/d4/da3/d7d/fb0 [42106,16652] 0 2024-09-13T22:56:14.974 INFO:tasks.workunit.client.0.smithi002.stdout:7/490: rename d8/d10/f6b to d8/d10/d11/d13/d26/d4c/d81/f8d 0 2024-09-13T22:56:14.974 INFO:tasks.workunit.client.0.smithi002.stdout:7/491: stat d8 0 2024-09-13T22:56:14.975 INFO:tasks.workunit.client.1.smithi047.stdout:7/640: creat d0/d57/d5b/d8b/fd5 x:0 0 0 2024-09-13T22:56:14.980 INFO:tasks.workunit.client.0.smithi002.stdout:4/525: dwrite d3/f21 [0,4194304] 0 2024-09-13T22:56:14.982 INFO:tasks.workunit.client.0.smithi002.stdout:8/529: mkdir d3/d27/da3 0 2024-09-13T22:56:14.988 INFO:tasks.workunit.client.0.smithi002.stdout:1/602: mkdir d1/d13/d21/d40/dc4/dc8 0 2024-09-13T22:56:14.989 INFO:tasks.workunit.client.0.smithi002.stdout:2/555: write d1/f29 [308460,37966] 0 2024-09-13T22:56:14.990 INFO:tasks.workunit.client.1.smithi047.stdout:8/588: dwrite d8/d3f/d8c/fab [0,4194304] 0 2024-09-13T22:56:14.990 INFO:tasks.workunit.client.0.smithi002.stdout:2/556: readlink d1/d7/d8/l12 0 2024-09-13T22:56:14.991 INFO:tasks.workunit.client.0.smithi002.stdout:2/557: chown d1/d7/d35/d78/l67 475164 1 2024-09-13T22:56:14.992 INFO:tasks.workunit.client.0.smithi002.stdout:2/558: readlink d1/d7/d41/la3 0 2024-09-13T22:56:14.992 INFO:tasks.workunit.client.1.smithi047.stdout:2/678: sync 2024-09-13T22:56:14.992 INFO:tasks.workunit.client.1.smithi047.stdout:6/672: sync 2024-09-13T22:56:14.998 INFO:tasks.workunit.client.1.smithi047.stdout:0/664: dwrite d1/d7/dc9/fd5 [0,4194304] 0 2024-09-13T22:56:15.002 INFO:tasks.workunit.client.0.smithi002.stdout:6/577: creat d12/d17/d34/fb8 x:0 0 0 2024-09-13T22:56:15.003 INFO:tasks.workunit.client.0.smithi002.stdout:3/626: mkdir d9/d15/d36/d4e/d5e/dae/d89/de5/de7 0 2024-09-13T22:56:15.009 INFO:tasks.workunit.client.1.smithi047.stdout:8/589: creat d8/d64/d4e/d4d/d8f/d9d/fd0 x:0 0 0 2024-09-13T22:56:15.009 INFO:tasks.workunit.client.1.smithi047.stdout:3/662: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d85/fa0 [3059722,62144] 0 2024-09-13T22:56:15.011 INFO:tasks.workunit.client.0.smithi002.stdout:7/492: dwrite d8/d10/d11/d13/d26/d4c/f4e [0,4194304] 0 2024-09-13T22:56:15.012 INFO:tasks.workunit.client.1.smithi047.stdout:3/663: read - d0/d3/d5e/fb9 zero size 2024-09-13T22:56:15.012 INFO:tasks.workunit.client.1.smithi047.stdout:7/641: dwrite d0/d7/da/d4e/f70 [0,4194304] 0 2024-09-13T22:56:15.014 INFO:tasks.workunit.client.1.smithi047.stdout:9/599: creat d1/dc/d14/dd/d54/fbf x:0 0 0 2024-09-13T22:56:15.016 INFO:tasks.workunit.client.1.smithi047.stdout:9/600: stat d1/f44 0 2024-09-13T22:56:15.020 INFO:tasks.workunit.client.1.smithi047.stdout:2/679: unlink d1/d8a/da6/fc4 0 2024-09-13T22:56:15.022 INFO:tasks.workunit.client.1.smithi047.stdout:0/665: dread d1/d5/d16/d23/d45/f4f [0,4194304] 0 2024-09-13T22:56:15.023 INFO:tasks.workunit.client.1.smithi047.stdout:0/666: fdatasync d1/d5/d16/d23/fae 0 2024-09-13T22:56:15.023 INFO:tasks.workunit.client.0.smithi002.stdout:5/577: mknod d1/d2a/d6b/d88/ccd 0 2024-09-13T22:56:15.025 INFO:tasks.workunit.client.1.smithi047.stdout:6/673: write d3/d11/d2b/d1c/d4d/d69/dc2/dcd/fd1 [900953,53581] 0 2024-09-13T22:56:15.028 INFO:tasks.workunit.client.0.smithi002.stdout:6/578: mknod d12/d17/d34/d39/d8a/cb9 0 2024-09-13T22:56:15.030 INFO:tasks.workunit.client.0.smithi002.stdout:3/627: mknod d9/df/ce8 0 2024-09-13T22:56:15.032 INFO:tasks.workunit.client.0.smithi002.stdout:9/599: getdents d8/d91/d96/d87/da5/d94 0 2024-09-13T22:56:15.035 INFO:tasks.workunit.client.0.smithi002.stdout:2/559: write d1/f1d [1388663,17654] 0 2024-09-13T22:56:15.040 INFO:tasks.workunit.client.0.smithi002.stdout:8/530: mkdir d3/dc/da4 0 2024-09-13T22:56:15.040 INFO:tasks.workunit.client.0.smithi002.stdout:1/603: dread d1/d13/d52/f95 [0,4194304] 0 2024-09-13T22:56:15.042 INFO:tasks.workunit.client.0.smithi002.stdout:8/531: chown d3/d27/f9c 36700 1 2024-09-13T22:56:15.042 INFO:tasks.workunit.client.0.smithi002.stdout:5/578: dread d1/d2a/d69/f73 [0,4194304] 0 2024-09-13T22:56:15.043 INFO:tasks.workunit.client.0.smithi002.stdout:0/579: dwrite d1/d4/f24 [0,4194304] 0 2024-09-13T22:56:15.045 INFO:tasks.workunit.client.0.smithi002.stdout:6/579: rename d12/c96 to d12/d17/d34/d39/d8b/cba 0 2024-09-13T22:56:15.045 INFO:tasks.workunit.client.0.smithi002.stdout:9/600: creat d8/d2c/dbc/fcc x:0 0 0 2024-09-13T22:56:15.046 INFO:tasks.workunit.client.0.smithi002.stdout:3/628: write d9/d7e/dce/fdc [973822,127442] 0 2024-09-13T22:56:15.047 INFO:tasks.workunit.client.0.smithi002.stdout:6/580: write d12/f5d [3381593,10895] 0 2024-09-13T22:56:15.048 INFO:tasks.workunit.client.0.smithi002.stdout:7/493: rmdir d8/d10/d39/d60 39 2024-09-13T22:56:15.050 INFO:tasks.workunit.client.0.smithi002.stdout:2/560: creat d1/d7/d8/d2c/da4/fbc x:0 0 0 2024-09-13T22:56:15.052 INFO:tasks.workunit.client.0.smithi002.stdout:7/494: chown d8/d10/d11/d13/d26/d4c/f64 19848616 1 2024-09-13T22:56:15.053 INFO:tasks.workunit.client.0.smithi002.stdout:8/532: dwrite d3/dc/d8b/f9e [0,4194304] 0 2024-09-13T22:56:15.054 INFO:tasks.workunit.client.0.smithi002.stdout:7/495: fdatasync d8/d10/d11/d13/d26/d4c/f64 0 2024-09-13T22:56:15.054 INFO:tasks.workunit.client.0.smithi002.stdout:5/579: fsync d1/d2a/d6b/f71 0 2024-09-13T22:56:15.056 INFO:tasks.workunit.client.0.smithi002.stdout:4/526: getdents d3/d40/d45 0 2024-09-13T22:56:15.057 INFO:tasks.workunit.client.0.smithi002.stdout:9/601: mknod d8/d10/d1c/d68/d74/ccd 0 2024-09-13T22:56:15.065 INFO:tasks.workunit.client.0.smithi002.stdout:9/602: dread d8/d2c/dbc/dc8/fc0 [0,4194304] 0 2024-09-13T22:56:15.065 INFO:tasks.workunit.client.0.smithi002.stdout:5/580: dwrite d1/d2a/d6b/d88/d45/d4f/db7/fcb [0,4194304] 0 2024-09-13T22:56:15.065 INFO:tasks.workunit.client.0.smithi002.stdout:8/533: rename d3/dc/l1a to d3/dc/d16/d89/la5 0 2024-09-13T22:56:15.071 INFO:tasks.workunit.client.0.smithi002.stdout:3/629: creat d9/d3b/fe9 x:0 0 0 2024-09-13T22:56:15.073 INFO:tasks.workunit.client.0.smithi002.stdout:1/604: truncate d1/d13/d30/f53 1203321 0 2024-09-13T22:56:15.074 INFO:tasks.workunit.client.0.smithi002.stdout:2/561: write d1/d80/f83 [720417,128421] 0 2024-09-13T22:56:15.075 INFO:tasks.workunit.client.0.smithi002.stdout:9/603: fdatasync d8/d91/fab 0 2024-09-13T22:56:15.077 INFO:tasks.workunit.client.0.smithi002.stdout:5/581: creat d1/d2a/d6b/d88/d45/d4f/d78/fce x:0 0 0 2024-09-13T22:56:15.078 INFO:tasks.workunit.client.0.smithi002.stdout:7/496: write d8/d10/f23 [718524,22744] 0 2024-09-13T22:56:15.079 INFO:tasks.workunit.client.0.smithi002.stdout:5/582: stat d1/d57 0 2024-09-13T22:56:15.079 INFO:tasks.workunit.client.0.smithi002.stdout:4/527: creat d3/f9e x:0 0 0 2024-09-13T22:56:15.080 INFO:tasks.workunit.client.0.smithi002.stdout:6/581: getdents d12 0 2024-09-13T22:56:15.082 INFO:tasks.workunit.client.0.smithi002.stdout:3/630: dwrite d9/d15/fe3 [0,4194304] 0 2024-09-13T22:56:15.083 INFO:tasks.workunit.client.1.smithi047.stdout:2/680: unlink d1/d16/ca1 0 2024-09-13T22:56:15.084 INFO:tasks.workunit.client.0.smithi002.stdout:1/605: creat d1/d13/d30/d31/d3d/fc9 x:0 0 0 2024-09-13T22:56:15.084 INFO:tasks.workunit.client.1.smithi047.stdout:5/579: getdents d19/d25/d45 0 2024-09-13T22:56:15.085 INFO:tasks.workunit.client.1.smithi047.stdout:5/580: chown d19/d25/d45 435 1 2024-09-13T22:56:15.086 INFO:tasks.workunit.client.0.smithi002.stdout:3/631: truncate d9/dd1/fd4 149123 0 2024-09-13T22:56:15.092 INFO:tasks.workunit.client.1.smithi047.stdout:9/601: dread d1/dc/d14/f52 [0,4194304] 0 2024-09-13T22:56:15.101 INFO:tasks.workunit.client.0.smithi002.stdout:6/582: creat d12/d17/d34/d39/fbb x:0 0 0 2024-09-13T22:56:15.101 INFO:tasks.workunit.client.0.smithi002.stdout:8/534: write d3/d21/f58 [239219,112612] 0 2024-09-13T22:56:15.101 INFO:tasks.workunit.client.1.smithi047.stdout:8/590: dread d8/f1c [0,4194304] 0 2024-09-13T22:56:15.101 INFO:tasks.workunit.client.1.smithi047.stdout:2/681: creat d1/df/d1d/d20/d37/d7b/fe3 x:0 0 0 2024-09-13T22:56:15.101 INFO:tasks.workunit.client.1.smithi047.stdout:5/581: symlink d19/d34/d8e/lbb 0 2024-09-13T22:56:15.102 INFO:tasks.workunit.client.1.smithi047.stdout:6/674: write d3/d11/d2b/d4c/dc0/f75 [1045079,62738] 0 2024-09-13T22:56:15.104 INFO:tasks.workunit.client.0.smithi002.stdout:1/606: creat d1/d13/d30/d31/d3d/d5d/fca x:0 0 0 2024-09-13T22:56:15.105 INFO:tasks.workunit.client.0.smithi002.stdout:7/497: dread d8/d10/d11/d13/d26/d4c/d81/f54 [0,4194304] 0 2024-09-13T22:56:15.106 INFO:tasks.workunit.client.0.smithi002.stdout:9/604: dwrite d8/d10/d1c/d3d/f48 [0,4194304] 0 2024-09-13T22:56:15.107 INFO:tasks.workunit.client.0.smithi002.stdout:1/607: write d1/d13/d21/d40/f94 [698148,57246] 0 2024-09-13T22:56:15.107 INFO:tasks.workunit.client.1.smithi047.stdout:0/667: link d1/d7/dc9/fcd d1/d5/d16/d47/fd6 0 2024-09-13T22:56:15.108 INFO:tasks.workunit.client.0.smithi002.stdout:9/605: read - d8/fbe zero size 2024-09-13T22:56:15.108 INFO:tasks.workunit.client.0.smithi002.stdout:3/632: dread d9/d15/d36/d4e/d5e/fb7 [0,4194304] 0 2024-09-13T22:56:15.110 INFO:tasks.workunit.client.0.smithi002.stdout:3/633: dread d9/d15/d26/fc4 [0,4194304] 0 2024-09-13T22:56:15.112 INFO:tasks.workunit.client.1.smithi047.stdout:9/602: dwrite d1/dc/d14/dd/d54/d50/d91/da3/f7e [0,4194304] 0 2024-09-13T22:56:15.113 INFO:tasks.workunit.client.0.smithi002.stdout:4/528: mkdir d3/d14/d25/d9f 0 2024-09-13T22:56:15.113 INFO:tasks.workunit.client.1.smithi047.stdout:2/682: dread d1/d16/f7c [0,4194304] 0 2024-09-13T22:56:15.114 INFO:tasks.workunit.client.1.smithi047.stdout:5/582: creat d19/d64/fbc x:0 0 0 2024-09-13T22:56:15.115 INFO:tasks.workunit.client.1.smithi047.stdout:7/642: getdents d0/d57 0 2024-09-13T22:56:15.116 INFO:tasks.workunit.client.0.smithi002.stdout:0/580: sync 2024-09-13T22:56:15.119 INFO:tasks.workunit.client.0.smithi002.stdout:4/529: dwrite d3/f9e [0,4194304] 0 2024-09-13T22:56:15.120 INFO:tasks.workunit.client.1.smithi047.stdout:0/668: unlink d1/d5/d16/d47/l53 0 2024-09-13T22:56:15.125 INFO:tasks.workunit.client.0.smithi002.stdout:8/535: rename d3/dc/d16/d4b/d72/d73/c8e to d3/d21/d57/da1/ca6 0 2024-09-13T22:56:15.125 INFO:tasks.workunit.client.0.smithi002.stdout:6/583: rename d12/d17/d28/d7d to d12/d17/d28/d7d/dbc 22 2024-09-13T22:56:15.127 INFO:tasks.workunit.client.0.smithi002.stdout:2/562: truncate d1/d7/d35/f43 3828261 0 2024-09-13T22:56:15.129 INFO:tasks.workunit.client.1.smithi047.stdout:9/603: dread d1/dc/d14/f17 [4194304,4194304] 0 2024-09-13T22:56:15.130 INFO:tasks.workunit.client.0.smithi002.stdout:7/498: creat d8/d10/d11/d13/d26/d4c/d81/f8e x:0 0 0 2024-09-13T22:56:15.130 INFO:tasks.workunit.client.1.smithi047.stdout:6/675: write d3/d11/d2b/d4c/d30/f91 [147723,121796] 0 2024-09-13T22:56:15.131 INFO:tasks.workunit.client.1.smithi047.stdout:7/643: dread d0/d57/d5b/d8b/fd0 [0,4194304] 0 2024-09-13T22:56:15.132 INFO:tasks.workunit.client.0.smithi002.stdout:7/499: write d8/d10/d11/d13/d26/d4c/d81/f1a [3695718,94296] 0 2024-09-13T22:56:15.133 INFO:tasks.workunit.client.0.smithi002.stdout:2/563: dwrite d1/d7/d8/f1e [0,4194304] 0 2024-09-13T22:56:15.136 INFO:tasks.workunit.client.0.smithi002.stdout:3/634: creat d9/d15/d35/fea x:0 0 0 2024-09-13T22:56:15.137 INFO:tasks.workunit.client.0.smithi002.stdout:3/635: chown d9/df/c82 986796 1 2024-09-13T22:56:15.138 INFO:tasks.workunit.client.1.smithi047.stdout:9/604: write d1/dc/d14/da0/faa [392065,29635] 0 2024-09-13T22:56:15.139 INFO:tasks.workunit.client.0.smithi002.stdout:0/581: rmdir d1/d4/d75/d31/d32/dbb 39 2024-09-13T22:56:15.141 INFO:tasks.workunit.client.1.smithi047.stdout:6/676: creat d3/d77/d93/fdd x:0 0 0 2024-09-13T22:56:15.142 INFO:tasks.workunit.client.0.smithi002.stdout:5/583: creat d1/d2a/d6b/d88/d55/fcf x:0 0 0 2024-09-13T22:56:15.142 INFO:tasks.workunit.client.1.smithi047.stdout:7/644: symlink d0/d57/ld6 0 2024-09-13T22:56:15.143 INFO:tasks.workunit.client.0.smithi002.stdout:4/530: chown d3/d14/d29/d2a/d30/c3e 201199797 1 2024-09-13T22:56:15.144 INFO:tasks.workunit.client.0.smithi002.stdout:4/531: write d3/d14/d25/f8a [3658407,121336] 0 2024-09-13T22:56:15.145 INFO:tasks.workunit.client.1.smithi047.stdout:8/591: getdents d8/d64/d4e/d70/d98 0 2024-09-13T22:56:15.146 INFO:tasks.workunit.client.1.smithi047.stdout:7/645: chown d0/db/c35 6625 1 2024-09-13T22:56:15.147 INFO:tasks.workunit.client.1.smithi047.stdout:9/605: dwrite d1/dc/fbd [0,4194304] 0 2024-09-13T22:56:15.150 INFO:tasks.workunit.client.0.smithi002.stdout:6/584: truncate d12/d17/d4e/fb4 750069 0 2024-09-13T22:56:15.152 INFO:tasks.workunit.client.1.smithi047.stdout:2/683: rename d1/df/d1d/d20/d2b/f7d to d1/de/fe4 0 2024-09-13T22:56:15.154 INFO:tasks.workunit.client.0.smithi002.stdout:8/536: mkdir d3/dc/d16/d60/da7 0 2024-09-13T22:56:15.155 INFO:tasks.workunit.client.0.smithi002.stdout:8/537: write d3/d27/f62 [178646,129634] 0 2024-09-13T22:56:15.157 INFO:tasks.workunit.client.0.smithi002.stdout:1/608: mknod d1/d13/d21/ccb 0 2024-09-13T22:56:15.158 INFO:tasks.workunit.client.0.smithi002.stdout:1/609: chown d1/d13/d30/d31/d3d 2665 1 2024-09-13T22:56:15.159 INFO:tasks.workunit.client.1.smithi047.stdout:6/677: creat d3/d11/d2b/d1c/d4d/d69/dc2/fde x:0 0 0 2024-09-13T22:56:15.161 INFO:tasks.workunit.client.1.smithi047.stdout:6/678: write d3/d77/d93/f9a [4042853,193] 0 2024-09-13T22:56:15.162 INFO:tasks.workunit.client.1.smithi047.stdout:8/592: mknod d8/d64/d4e/d4d/d8f/cd1 0 2024-09-13T22:56:15.164 INFO:tasks.workunit.client.1.smithi047.stdout:9/606: rmdir d1/dc/d14/dd/d4c 39 2024-09-13T22:56:15.166 INFO:tasks.workunit.client.0.smithi002.stdout:7/500: mkdir d8/d10/d11/d13/d2e/d50/d52/d72/d8f 0 2024-09-13T22:56:15.167 INFO:tasks.workunit.client.1.smithi047.stdout:0/669: link d1/d5/d16/c3a d1/d5/d11/cd7 0 2024-09-13T22:56:15.168 INFO:tasks.workunit.client.0.smithi002.stdout:8/538: dread d3/d21/f44 [0,4194304] 0 2024-09-13T22:56:15.168 INFO:tasks.workunit.client.1.smithi047.stdout:0/670: chown d1/d5/d16/cc5 2 1 2024-09-13T22:56:15.169 INFO:tasks.workunit.client.1.smithi047.stdout:0/671: dread - d1/d5/d16/d23/d77/fa1 zero size 2024-09-13T22:56:15.172 INFO:tasks.workunit.client.0.smithi002.stdout:9/606: write d8/d1e/f27 [4065091,79138] 0 2024-09-13T22:56:15.173 INFO:tasks.workunit.client.1.smithi047.stdout:6/679: creat d3/d11/d2b/d4c/dc0/fdf x:0 0 0 2024-09-13T22:56:15.174 INFO:tasks.workunit.client.0.smithi002.stdout:9/607: write d8/d10/d42/fbb [281207,45654] 0 2024-09-13T22:56:15.174 INFO:tasks.workunit.client.0.smithi002.stdout:8/539: dwrite d3/d21/f44 [4194304,4194304] 0 2024-09-13T22:56:15.175 INFO:tasks.workunit.client.0.smithi002.stdout:5/584: mkdir d1/d57/dd0 0 2024-09-13T22:56:15.176 INFO:tasks.workunit.client.0.smithi002.stdout:5/585: read d1/d10/fae [3318324,3174] 0 2024-09-13T22:56:15.179 INFO:tasks.workunit.client.0.smithi002.stdout:9/608: read d8/d10/d42/f6e [4130596,127210] 0 2024-09-13T22:56:15.180 INFO:tasks.workunit.client.1.smithi047.stdout:4/747: sync 2024-09-13T22:56:15.180 INFO:tasks.workunit.client.1.smithi047.stdout:1/702: sync 2024-09-13T22:56:15.182 INFO:tasks.workunit.client.0.smithi002.stdout:4/532: dread d3/d14/d86/f95 [0,4194304] 0 2024-09-13T22:56:15.182 INFO:tasks.workunit.client.0.smithi002.stdout:9/609: chown d8/d10/db1/f8a 27719090 1 2024-09-13T22:56:15.182 INFO:tasks.workunit.client.1.smithi047.stdout:4/748: chown dc/de/dfb 9589954 1 2024-09-13T22:56:15.182 INFO:tasks.workunit.client.1.smithi047.stdout:4/749: chown dc/d29/d6c/f93 56790 1 2024-09-13T22:56:15.182 INFO:tasks.workunit.client.1.smithi047.stdout:8/593: write d8/f32 [513305,29079] 0 2024-09-13T22:56:15.183 INFO:tasks.workunit.client.1.smithi047.stdout:4/750: chown dc/de/d17/d25/d9b/fbf 95 1 2024-09-13T22:56:15.184 INFO:tasks.workunit.client.1.smithi047.stdout:4/751: write dc/de/d17/f74 [5805965,65247] 0 2024-09-13T22:56:15.184 INFO:tasks.workunit.client.0.smithi002.stdout:6/585: dread d12/d17/f18 [0,4194304] 0 2024-09-13T22:56:15.186 INFO:tasks.workunit.client.1.smithi047.stdout:4/752: write dc/d29/d6c/fad [431022,16142] 0 2024-09-13T22:56:15.186 INFO:tasks.workunit.client.0.smithi002.stdout:3/636: dwrite d9/d15/f2d [0,4194304] 0 2024-09-13T22:56:15.187 INFO:tasks.workunit.client.1.smithi047.stdout:7/646: rename d0/d7/fb9 to d0/fd7 0 2024-09-13T22:56:15.188 INFO:tasks.workunit.client.0.smithi002.stdout:3/637: write d9/d3b/d7c/f9c [1571165,81520] 0 2024-09-13T22:56:15.188 INFO:tasks.workunit.client.1.smithi047.stdout:0/672: mkdir d1/d5/d16/d23/dd8 0 2024-09-13T22:56:15.190 INFO:tasks.workunit.client.1.smithi047.stdout:8/594: truncate d8/d64/f94 306052 0 2024-09-13T22:56:15.191 INFO:tasks.workunit.client.0.smithi002.stdout:2/564: truncate d1/d4d/f71 3735143 0 2024-09-13T22:56:15.192 INFO:tasks.workunit.client.0.smithi002.stdout:2/565: chown d1/d7/d8/d2c/f2d 135442843 1 2024-09-13T22:56:15.194 INFO:tasks.workunit.client.0.smithi002.stdout:7/501: fsync d8/d10/d39/d60/f7a 0 2024-09-13T22:56:15.194 INFO:tasks.workunit.client.1.smithi047.stdout:1/703: mknod d0/d7/d14/d57/cca 0 2024-09-13T22:56:15.196 INFO:tasks.workunit.client.1.smithi047.stdout:1/704: chown d0/d7/d14/d57/f6e 11634 1 2024-09-13T22:56:15.197 INFO:tasks.workunit.client.1.smithi047.stdout:2/684: rename d1/df/d1d/d20/d29/l7e to d1/d16/d40/d57/le5 0 2024-09-13T22:56:15.200 INFO:tasks.workunit.client.0.smithi002.stdout:2/566: dwrite d1/d4a/f6c [0,4194304] 0 2024-09-13T22:56:15.200 INFO:tasks.workunit.client.1.smithi047.stdout:0/673: creat d1/d5/d11/d2f/fd9 x:0 0 0 2024-09-13T22:56:15.202 INFO:tasks.workunit.client.1.smithi047.stdout:1/705: dwrite d0/d7/d13/f42 [0,4194304] 0 2024-09-13T22:56:15.202 INFO:tasks.workunit.client.1.smithi047.stdout:8/595: mknod d8/d64/d4e/d4d/d8f/d91/d38/d7a/cd2 0 2024-09-13T22:56:15.204 INFO:tasks.workunit.client.0.smithi002.stdout:7/502: dwrite d8/d10/d11/d13/d26/d4c/d81/f57 [4194304,4194304] 0 2024-09-13T22:56:15.205 INFO:tasks.workunit.client.1.smithi047.stdout:9/607: link d1/dc/d14/dd/d4c/fac d1/dc/d14/dd/d54/d8d/fc0 0 2024-09-13T22:56:15.206 INFO:tasks.workunit.client.1.smithi047.stdout:9/608: chown d1/dc/d14/dd/l7c 14205 1 2024-09-13T22:56:15.209 INFO:tasks.workunit.client.0.smithi002.stdout:7/503: dread d8/d10/d11/d13/d26/f3f [0,4194304] 0 2024-09-13T22:56:15.209 INFO:tasks.workunit.client.1.smithi047.stdout:7/647: unlink d0/d7/da/d2e/db5/fa5 0 2024-09-13T22:56:15.213 INFO:tasks.workunit.client.0.smithi002.stdout:1/610: mknod d1/ccc 0 2024-09-13T22:56:15.215 INFO:tasks.workunit.client.1.smithi047.stdout:0/674: symlink d1/d5/d16/d47/lda 0 2024-09-13T22:56:15.217 INFO:tasks.workunit.client.0.smithi002.stdout:3/638: mkdir d9/d15/d51/deb 0 2024-09-13T22:56:15.228 INFO:tasks.workunit.client.1.smithi047.stdout:9/609: mkdir d1/dc/d14/dc1 0 2024-09-13T22:56:15.228 INFO:tasks.workunit.client.1.smithi047.stdout:1/706: rmdir d0 39 2024-09-13T22:56:15.230 INFO:tasks.workunit.client.0.smithi002.stdout:0/582: link d1/d4/d75/d31/f8d d1/d4/d75/d31/d32/dbb/fcf 0 2024-09-13T22:56:15.232 INFO:tasks.workunit.client.1.smithi047.stdout:7/648: unlink d0/d57/d5b/f69 0 2024-09-13T22:56:15.232 INFO:tasks.workunit.client.1.smithi047.stdout:7/649: chown d0/d57/d5b/l72 67 1 2024-09-13T22:56:15.235 INFO:tasks.workunit.client.0.smithi002.stdout:5/586: symlink d1/d2a/ld1 0 2024-09-13T22:56:15.240 INFO:tasks.workunit.client.1.smithi047.stdout:4/753: truncate dc/d29/d6c/fad 85639 0 2024-09-13T22:56:15.246 INFO:tasks.workunit.client.0.smithi002.stdout:9/610: rename d8/d91/d96/d87/da5/l8f to d8/d10/d61/lce 0 2024-09-13T22:56:15.248 INFO:tasks.workunit.client.1.smithi047.stdout:1/707: dwrite d0/d7/d14/d57/d62/d76/d94/fab [0,4194304] 0 2024-09-13T22:56:15.253 INFO:tasks.workunit.client.0.smithi002.stdout:1/611: unlink d1/d13/d30/d31/d3d/la5 0 2024-09-13T22:56:15.254 INFO:tasks.workunit.client.0.smithi002.stdout:1/612: chown d1/d13/d30/d31/d3d/d5d/fc3 7004666 1 2024-09-13T22:56:15.257 INFO:tasks.workunit.client.1.smithi047.stdout:4/754: mkdir dc/de/d23/d40/d7b/dab/dae/d102 0 2024-09-13T22:56:15.262 INFO:tasks.workunit.client.0.smithi002.stdout:5/587: creat d1/d2a/d5a/fd2 x:0 0 0 2024-09-13T22:56:15.263 INFO:tasks.workunit.client.0.smithi002.stdout:5/588: chown d1/d2a/d6b/d88/d55/f83 324134 1 2024-09-13T22:56:15.264 INFO:tasks.workunit.client.1.smithi047.stdout:0/675: truncate d1/d7/dc9/fd5 2855236 0 2024-09-13T22:56:15.264 INFO:tasks.workunit.client.0.smithi002.stdout:5/589: write d1/d2a/d6b/d88/d55/d56/d81/fa5 [201655,117417] 0 2024-09-13T22:56:15.265 INFO:tasks.workunit.client.1.smithi047.stdout:1/708: fsync d0/d7/d10/f49 0 2024-09-13T22:56:15.266 INFO:tasks.workunit.client.0.smithi002.stdout:2/567: mkdir d1/da9/dbd 0 2024-09-13T22:56:15.266 INFO:tasks.workunit.client.1.smithi047.stdout:7/650: write d0/d7/da/d1e/d51/fa3 [163988,60812] 0 2024-09-13T22:56:15.267 INFO:tasks.workunit.client.1.smithi047.stdout:8/596: getdents d8/d6b/da9 0 2024-09-13T22:56:15.267 INFO:tasks.workunit.client.0.smithi002.stdout:2/568: write d1/d7/d41/d96/f9e [222264,127562] 0 2024-09-13T22:56:15.271 INFO:tasks.workunit.client.0.smithi002.stdout:9/611: chown d8/d10/l33 348836984 1 2024-09-13T22:56:15.275 INFO:tasks.workunit.client.0.smithi002.stdout:0/583: dwrite d1/d2/f29 [0,4194304] 0 2024-09-13T22:56:15.277 INFO:tasks.workunit.client.1.smithi047.stdout:1/709: creat d0/d7/d14/d57/d62/d76/fcb x:0 0 0 2024-09-13T22:56:15.281 INFO:tasks.workunit.client.0.smithi002.stdout:7/504: write d8/d10/d11/d13/d2e/d50/d52/d72/f8c [65894,111042] 0 2024-09-13T22:56:15.283 INFO:tasks.workunit.client.0.smithi002.stdout:3/639: getdents d9/d15/d36/d4e/d5e/dc0 0 2024-09-13T22:56:15.285 INFO:tasks.workunit.client.1.smithi047.stdout:9/610: getdents d1/dc 0 2024-09-13T22:56:15.286 INFO:tasks.workunit.client.1.smithi047.stdout:9/611: readlink d1/dc/d14/dd/d54/d50/d5b/d9e/l6f 0 2024-09-13T22:56:15.288 INFO:tasks.workunit.client.1.smithi047.stdout:9/612: chown d1/dc/d14/da0/faa 265942891 1 2024-09-13T22:56:15.288 INFO:tasks.workunit.client.1.smithi047.stdout:4/755: creat dc/de/dfb/f103 x:0 0 0 2024-09-13T22:56:15.288 INFO:tasks.workunit.client.1.smithi047.stdout:4/756: stat dc/d29/c8d 0 2024-09-13T22:56:15.288 INFO:tasks.workunit.client.0.smithi002.stdout:8/540: getdents d3/dc/d16/d4b/d72/d73 0 2024-09-13T22:56:15.292 INFO:tasks.workunit.client.1.smithi047.stdout:0/676: mkdir d1/ddb 0 2024-09-13T22:56:15.292 INFO:tasks.workunit.client.0.smithi002.stdout:5/590: symlink d1/d2a/d6b/ld3 0 2024-09-13T22:56:15.293 INFO:tasks.workunit.client.1.smithi047.stdout:0/677: dread - d1/d5/d16/d23/d77/fa6 zero size 2024-09-13T22:56:15.293 INFO:tasks.workunit.client.0.smithi002.stdout:8/541: dwrite d3/d21/f58 [0,4194304] 0 2024-09-13T22:56:15.293 INFO:tasks.workunit.client.1.smithi047.stdout:4/757: dwrite dc/de/f97 [0,4194304] 0 2024-09-13T22:56:15.296 INFO:tasks.workunit.client.1.smithi047.stdout:4/758: read dc/de/d23/f3b [357137,114046] 0 2024-09-13T22:56:15.297 INFO:tasks.workunit.client.0.smithi002.stdout:4/533: getdents d3 0 2024-09-13T22:56:15.299 INFO:tasks.workunit.client.1.smithi047.stdout:7/651: truncate d0/d7/da/d1e/f24 186305 0 2024-09-13T22:56:15.304 INFO:tasks.workunit.client.1.smithi047.stdout:9/613: read d1/dc/d14/dd/d54/d4e/d51/f53 [693630,27683] 0 2024-09-13T22:56:15.305 INFO:tasks.workunit.client.0.smithi002.stdout:6/586: getdents d12/d17/d28/d67/d6b 0 2024-09-13T22:56:15.308 INFO:tasks.workunit.client.1.smithi047.stdout:1/710: dread d0/d7/d13/d8c/fb4 [0,4194304] 0 2024-09-13T22:56:15.310 INFO:tasks.workunit.client.1.smithi047.stdout:1/711: chown d0/d7/db/f38 1799368633 1 2024-09-13T22:56:15.314 INFO:tasks.workunit.client.1.smithi047.stdout:8/597: creat d8/fd3 x:0 0 0 2024-09-13T22:56:15.315 INFO:tasks.workunit.client.1.smithi047.stdout:8/598: dread - d8/d6b/da9/fc0 zero size 2024-09-13T22:56:15.317 INFO:tasks.workunit.client.0.smithi002.stdout:1/613: write d1/d13/d1d/d34/f7a [644848,26028] 0 2024-09-13T22:56:15.318 INFO:tasks.workunit.client.1.smithi047.stdout:7/652: mknod d0/d57/cd8 0 2024-09-13T22:56:15.322 INFO:tasks.workunit.client.1.smithi047.stdout:4/759: write dc/d29/f41 [4065787,87708] 0 2024-09-13T22:56:15.323 INFO:tasks.workunit.client.0.smithi002.stdout:2/569: fsync d1/d4d/f56 0 2024-09-13T22:56:15.325 INFO:tasks.workunit.client.0.smithi002.stdout:5/591: write d1/d10/f3d [1024396,108254] 0 2024-09-13T22:56:15.326 INFO:tasks.workunit.client.1.smithi047.stdout:1/712: read d0/d7/d14/d28/f48 [371297,18692] 0 2024-09-13T22:56:15.327 INFO:tasks.workunit.client.0.smithi002.stdout:6/587: mknod d12/d17/d28/d7d/cbd 0 2024-09-13T22:56:15.328 INFO:tasks.workunit.client.0.smithi002.stdout:6/588: dread - d12/d17/d4e/f9a zero size 2024-09-13T22:56:15.329 INFO:tasks.workunit.client.0.smithi002.stdout:3/640: truncate d9/d3b/d53/d83/fbe 386919 0 2024-09-13T22:56:15.330 INFO:tasks.workunit.client.0.smithi002.stdout:3/641: fdatasync d9/d3b/f61 0 2024-09-13T22:56:15.332 INFO:tasks.workunit.client.0.smithi002.stdout:1/614: creat d1/d13/d30/d31/d3d/d5d/d8e/fcd x:0 0 0 2024-09-13T22:56:15.334 INFO:tasks.workunit.client.1.smithi047.stdout:8/599: write d8/fc [2905563,22033] 0 2024-09-13T22:56:15.337 INFO:tasks.workunit.client.1.smithi047.stdout:7/653: rename d0/d7/l9d to d0/d7/da/d1e/d93/ld9 0 2024-09-13T22:56:15.340 INFO:tasks.workunit.client.0.smithi002.stdout:2/570: unlink d1/l25 0 2024-09-13T22:56:15.341 INFO:tasks.workunit.client.0.smithi002.stdout:2/571: chown d1/d7/d35/d3e/d59/d6b/d75 1013772 1 2024-09-13T22:56:15.341 INFO:tasks.workunit.client.1.smithi047.stdout:0/678: creat d1/d5/d16/fdc x:0 0 0 2024-09-13T22:56:15.342 INFO:tasks.workunit.client.0.smithi002.stdout:5/592: mknod d1/d2a/d6b/d88/d45/d4f/d78/d8b/cd4 0 2024-09-13T22:56:15.344 INFO:tasks.workunit.client.0.smithi002.stdout:6/589: fsync d12/d17/d34/f38 0 2024-09-13T22:56:15.344 INFO:tasks.workunit.client.1.smithi047.stdout:1/713: rmdir d0/d7 39 2024-09-13T22:56:15.344 INFO:tasks.workunit.client.0.smithi002.stdout:8/542: dwrite d3/f5 [4194304,4194304] 0 2024-09-13T22:56:15.346 INFO:tasks.workunit.client.0.smithi002.stdout:7/505: rename d8/l77 to d8/d10/l90 0 2024-09-13T22:56:15.348 INFO:tasks.workunit.client.1.smithi047.stdout:8/600: mknod d8/d3f/d8c/cd4 0 2024-09-13T22:56:15.350 INFO:tasks.workunit.client.0.smithi002.stdout:3/642: mknod d9/df/cec 0 2024-09-13T22:56:15.353 INFO:tasks.workunit.client.1.smithi047.stdout:4/760: rename dc/da3/ld7 to dc/de/d23/d40/d7b/dab/l104 0 2024-09-13T22:56:15.354 INFO:tasks.workunit.client.1.smithi047.stdout:4/761: write dc/de/d17/d25/d9b/fe9 [18982,99417] 0 2024-09-13T22:56:15.359 INFO:tasks.workunit.client.1.smithi047.stdout:7/654: rmdir d0/d57/d5b/d8b 39 2024-09-13T22:56:15.360 INFO:tasks.workunit.client.1.smithi047.stdout:9/614: creat d1/dc/d14/dd/fc2 x:0 0 0 2024-09-13T22:56:15.361 INFO:tasks.workunit.client.1.smithi047.stdout:9/615: dread d1/dc/d14/dd/d54/d8d/fc0 [0,4194304] 0 2024-09-13T22:56:15.362 INFO:tasks.workunit.client.0.smithi002.stdout:9/612: getdents d8/d10/d1c/d3d 0 2024-09-13T22:56:15.363 INFO:tasks.workunit.client.0.smithi002.stdout:2/572: read - d1/d7/d35/d3e/d59/f70 zero size 2024-09-13T22:56:15.367 INFO:tasks.workunit.client.0.smithi002.stdout:9/613: dwrite d8/d1e/f41 [0,4194304] 0 2024-09-13T22:56:15.369 INFO:tasks.workunit.client.0.smithi002.stdout:9/614: write d8/d10/d1c/f19 [423129,100020] 0 2024-09-13T22:56:15.369 INFO:tasks.workunit.client.0.smithi002.stdout:9/615: dread - d8/fbe zero size 2024-09-13T22:56:15.370 INFO:tasks.workunit.client.0.smithi002.stdout:4/534: rename d3/d14/d29/d2a/f71 to d3/d14/d25/d69/d7e/fa0 0 2024-09-13T22:56:15.374 INFO:tasks.workunit.client.0.smithi002.stdout:4/535: dread d3/d14/d85/f8d [0,4194304] 0 2024-09-13T22:56:15.379 INFO:tasks.workunit.client.0.smithi002.stdout:8/543: mknod d3/dc/d18/ca8 0 2024-09-13T22:56:15.380 INFO:tasks.workunit.client.0.smithi002.stdout:3/643: mkdir d9/d15/d36/d4e/d5e/ded 0 2024-09-13T22:56:15.382 INFO:tasks.workunit.client.0.smithi002.stdout:4/536: symlink d3/d14/d29/d2a/d30/la1 0 2024-09-13T22:56:15.383 INFO:tasks.workunit.client.0.smithi002.stdout:4/537: chown d3/f1e 69 1 2024-09-13T22:56:15.387 INFO:tasks.workunit.client.0.smithi002.stdout:3/644: creat d9/dd1/fee x:0 0 0 2024-09-13T22:56:15.388 INFO:tasks.workunit.client.0.smithi002.stdout:4/538: chown d3/d14/d29/d2a/f2d 41818556 1 2024-09-13T22:56:15.389 INFO:tasks.workunit.client.0.smithi002.stdout:8/544: creat d3/dc/da4/fa9 x:0 0 0 2024-09-13T22:56:15.391 INFO:tasks.workunit.client.0.smithi002.stdout:7/506: rename d8/d10/d11/d13/d2e/f65 to d8/d10/d11/d13/d2e/d3c/f91 0 2024-09-13T22:56:15.393 INFO:tasks.workunit.client.0.smithi002.stdout:3/645: creat d9/d15/d26/fef x:0 0 0 2024-09-13T22:56:15.393 INFO:tasks.workunit.client.0.smithi002.stdout:4/539: dread d3/d14/f1d [0,4194304] 0 2024-09-13T22:56:15.395 INFO:tasks.workunit.client.0.smithi002.stdout:8/545: mknod d3/dc/d18/d2e/caa 0 2024-09-13T22:56:15.395 INFO:tasks.workunit.client.0.smithi002.stdout:3/646: truncate d9/d3b/d7c/f80 2048055 0 2024-09-13T22:56:15.397 INFO:tasks.workunit.client.0.smithi002.stdout:8/546: read - d3/dc/d18/d56/f7c zero size 2024-09-13T22:56:15.398 INFO:tasks.workunit.client.0.smithi002.stdout:4/540: mknod d3/d14/d29/ca2 0 2024-09-13T22:56:15.398 INFO:tasks.workunit.client.0.smithi002.stdout:7/507: dwrite d8/d10/d11/d13/f79 [0,4194304] 0 2024-09-13T22:56:15.399 INFO:tasks.workunit.client.0.smithi002.stdout:4/541: write d3/f87 [993139,95126] 0 2024-09-13T22:56:15.400 INFO:tasks.workunit.client.0.smithi002.stdout:8/547: dread d3/dc/d18/d2e/f8d [0,4194304] 0 2024-09-13T22:56:15.400 INFO:tasks.workunit.client.0.smithi002.stdout:4/542: write d3/f5d [3716190,13256] 0 2024-09-13T22:56:15.401 INFO:tasks.workunit.client.0.smithi002.stdout:8/548: fsync d3/f6 0 2024-09-13T22:56:15.403 INFO:tasks.workunit.client.0.smithi002.stdout:8/549: readlink d3/d27/l3a 0 2024-09-13T22:56:15.405 INFO:tasks.workunit.client.0.smithi002.stdout:8/550: truncate d3/dc/d16/d60/f64 141838 0 2024-09-13T22:56:15.407 INFO:tasks.workunit.client.0.smithi002.stdout:7/508: dwrite d8/d10/f2a [0,4194304] 0 2024-09-13T22:56:15.410 INFO:tasks.workunit.client.0.smithi002.stdout:8/551: mknod d3/dc/cab 0 2024-09-13T22:56:15.410 INFO:tasks.workunit.client.0.smithi002.stdout:8/552: stat d3/dc/d16/d4b 0 2024-09-13T22:56:15.416 INFO:tasks.workunit.client.0.smithi002.stdout:8/553: dread - d3/dc/d16/d2f/d83/f9b zero size 2024-09-13T22:56:15.417 INFO:tasks.workunit.client.0.smithi002.stdout:0/584: sync 2024-09-13T22:56:15.418 INFO:tasks.workunit.client.0.smithi002.stdout:0/585: fdatasync d1/d4/da3/d7d/f9a 0 2024-09-13T22:56:15.423 INFO:tasks.workunit.client.0.smithi002.stdout:7/509: creat d8/d10/d11/d13/d26/f92 x:0 0 0 2024-09-13T22:56:15.426 INFO:tasks.workunit.client.0.smithi002.stdout:5/593: dread d1/fe [0,4194304] 0 2024-09-13T22:56:15.428 INFO:tasks.workunit.client.0.smithi002.stdout:7/510: dread d8/f5d [0,4194304] 0 2024-09-13T22:56:15.432 INFO:tasks.workunit.client.0.smithi002.stdout:8/554: getdents d3/d21/d57 0 2024-09-13T22:56:15.433 INFO:tasks.workunit.client.0.smithi002.stdout:3/647: dread d9/d15/d51/f1d [0,4194304] 0 2024-09-13T22:56:15.433 INFO:tasks.workunit.client.0.smithi002.stdout:2/573: truncate d1/d7/d35/d3e/d59/d87/f99 385843 0 2024-09-13T22:56:15.435 INFO:tasks.workunit.client.0.smithi002.stdout:7/511: mknod d8/d10/d11/d13/d2e/c93 0 2024-09-13T22:56:15.437 INFO:tasks.workunit.client.0.smithi002.stdout:2/574: unlink d1/f29 0 2024-09-13T22:56:15.438 INFO:tasks.workunit.client.0.smithi002.stdout:7/512: dread - d8/d10/d11/d13/d26/d4c/d81/d51/f86 zero size 2024-09-13T22:56:15.440 INFO:tasks.workunit.client.0.smithi002.stdout:8/555: dwrite d3/dc/d18/f2d [0,4194304] 0 2024-09-13T22:56:15.441 INFO:tasks.workunit.client.0.smithi002.stdout:0/586: dread d1/d2/d6c/d8b/fbf [0,4194304] 0 2024-09-13T22:56:15.447 INFO:tasks.workunit.client.0.smithi002.stdout:0/587: symlink d1/d2/d6c/d8b/ld0 0 2024-09-13T22:56:15.448 INFO:tasks.workunit.client.0.smithi002.stdout:8/556: dwrite d3/dc/d18/f81 [0,4194304] 0 2024-09-13T22:56:15.448 INFO:tasks.workunit.client.0.smithi002.stdout:0/588: chown d1/d4/d75/d31/d32/dbb 26304865 1 2024-09-13T22:56:15.449 INFO:tasks.workunit.client.0.smithi002.stdout:8/557: stat d3/f69 0 2024-09-13T22:56:15.450 INFO:tasks.workunit.client.0.smithi002.stdout:2/575: mknod d1/d7/d8/d4f/cbe 0 2024-09-13T22:56:15.452 INFO:tasks.workunit.client.1.smithi047.stdout:8/601: creat d8/d64/d4e/d70/da7/fd5 x:0 0 0 2024-09-13T22:56:15.452 INFO:tasks.workunit.client.1.smithi047.stdout:0/679: write d1/d5/d16/d47/f4d [404556,19176] 0 2024-09-13T22:56:15.453 INFO:tasks.workunit.client.0.smithi002.stdout:3/648: link d9/d15/d51/f18 d9/d15/d36/ff0 0 2024-09-13T22:56:15.456 INFO:tasks.workunit.client.0.smithi002.stdout:0/589: mknod d1/d2/d81/cd1 0 2024-09-13T22:56:15.458 INFO:tasks.workunit.client.1.smithi047.stdout:4/762: symlink dc/de/d23/dc4/dc8/dc9/l105 0 2024-09-13T22:56:15.459 INFO:tasks.workunit.client.0.smithi002.stdout:3/649: dwrite d9/d3b/d7c/f9c [8388608,4194304] 0 2024-09-13T22:56:15.460 INFO:tasks.workunit.client.0.smithi002.stdout:8/558: creat d3/d21/d57/da1/fac x:0 0 0 2024-09-13T22:56:15.464 INFO:tasks.workunit.client.0.smithi002.stdout:2/576: dread d1/d7/d41/f7a [0,4194304] 0 2024-09-13T22:56:15.465 INFO:tasks.workunit.client.0.smithi002.stdout:2/577: chown d1/d7/f47 66 1 2024-09-13T22:56:15.465 INFO:tasks.workunit.client.1.smithi047.stdout:8/602: rmdir d8/d6b/da9 39 2024-09-13T22:56:15.467 INFO:tasks.workunit.client.1.smithi047.stdout:9/616: dwrite d1/f5 [4194304,4194304] 0 2024-09-13T22:56:15.470 INFO:tasks.workunit.client.1.smithi047.stdout:8/603: fsync d8/d3f/d8c/da6/fcd 0 2024-09-13T22:56:15.470 INFO:tasks.workunit.client.0.smithi002.stdout:2/578: dwrite d1/d32/d37/f45 [0,4194304] 0 2024-09-13T22:56:15.471 INFO:tasks.workunit.client.1.smithi047.stdout:0/680: dwrite d1/d5/d16/d23/f25 [4194304,4194304] 0 2024-09-13T22:56:15.473 INFO:tasks.workunit.client.0.smithi002.stdout:1/615: sync 2024-09-13T22:56:15.476 INFO:tasks.workunit.client.1.smithi047.stdout:4/763: dwrite dc/de/d17/f1b [0,4194304] 0 2024-09-13T22:56:15.482 INFO:tasks.workunit.client.1.smithi047.stdout:1/714: truncate d0/d7/d13/f3c 4144923 0 2024-09-13T22:56:15.483 INFO:tasks.workunit.client.1.smithi047.stdout:1/715: chown d0/d7/d10/c8e 232586174 1 2024-09-13T22:56:15.483 INFO:tasks.workunit.client.1.smithi047.stdout:0/681: dread d1/d5/d16/d47/fd6 [0,4194304] 0 2024-09-13T22:56:15.485 INFO:tasks.workunit.client.1.smithi047.stdout:1/716: chown d0/d7/d13/c15 26 1 2024-09-13T22:56:15.487 INFO:tasks.workunit.client.0.smithi002.stdout:8/559: write d3/dc/d16/d60/f64 [36338,121654] 0 2024-09-13T22:56:15.488 INFO:tasks.workunit.client.0.smithi002.stdout:8/560: dread - d3/dc/fa2 zero size 2024-09-13T22:56:15.493 INFO:tasks.workunit.client.1.smithi047.stdout:7/655: getdents d0/d57/d5b/d5c/db6 0 2024-09-13T22:56:15.493 INFO:tasks.workunit.client.0.smithi002.stdout:4/543: write d3/fb [464813,129281] 0 2024-09-13T22:56:15.494 INFO:tasks.workunit.client.0.smithi002.stdout:7/513: link d8/d10/d11/d13/d26/l75 d8/d10/d11/d13/d26/d4c/d81/d51/l94 0 2024-09-13T22:56:15.495 INFO:tasks.workunit.client.1.smithi047.stdout:9/617: symlink d1/dc/d14/da5/lc3 0 2024-09-13T22:56:15.496 INFO:tasks.workunit.client.0.smithi002.stdout:8/561: dwrite d3/dc/d18/d56/f7c [0,4194304] 0 2024-09-13T22:56:15.496 INFO:tasks.workunit.client.0.smithi002.stdout:7/514: write d8/d10/f89 [284906,46331] 0 2024-09-13T22:56:15.498 INFO:tasks.workunit.client.0.smithi002.stdout:0/590: mknod d1/d2/cd2 0 2024-09-13T22:56:15.499 INFO:tasks.workunit.client.0.smithi002.stdout:2/579: creat d1/d7/d41/fbf x:0 0 0 2024-09-13T22:56:15.501 INFO:tasks.workunit.client.1.smithi047.stdout:8/604: rename d8/d64/d4e/d4d/d8f/d9d/fd0 to d8/d64/d4e/d4d/d8f/d9d/fd6 0 2024-09-13T22:56:15.505 INFO:tasks.workunit.client.0.smithi002.stdout:1/616: chown d1/d13/d30/d31/f44 2356480 1 2024-09-13T22:56:15.505 INFO:tasks.workunit.client.0.smithi002.stdout:8/562: dwrite d3/dc/d18/d56/f7c [0,4194304] 0 2024-09-13T22:56:15.508 INFO:tasks.workunit.client.0.smithi002.stdout:3/650: mkdir d9/d15/d36/df1 0 2024-09-13T22:56:15.509 INFO:tasks.workunit.client.1.smithi047.stdout:4/764: rename dc/d29/l72 to dc/de/d23/ddf/l106 0 2024-09-13T22:56:15.510 INFO:tasks.workunit.client.1.smithi047.stdout:4/765: chown dc/de/d23/dc4/dc8/ff6 1710796 1 2024-09-13T22:56:15.513 INFO:tasks.workunit.client.1.smithi047.stdout:0/682: mknod d1/d7/cdd 0 2024-09-13T22:56:15.515 INFO:tasks.workunit.client.0.smithi002.stdout:6/590: sync 2024-09-13T22:56:15.515 INFO:tasks.workunit.client.0.smithi002.stdout:9/616: sync 2024-09-13T22:56:15.516 INFO:tasks.workunit.client.1.smithi047.stdout:1/717: mkdir d0/d7/d14/d28/d36/dcc 0 2024-09-13T22:56:15.518 INFO:tasks.workunit.client.1.smithi047.stdout:7/656: creat d0/db/fda x:0 0 0 2024-09-13T22:56:15.520 INFO:tasks.workunit.client.1.smithi047.stdout:7/657: read d0/d57/f98 [2582162,114162] 0 2024-09-13T22:56:15.520 INFO:tasks.workunit.client.1.smithi047.stdout:9/618: readlink d1/l75 0 2024-09-13T22:56:15.524 INFO:tasks.workunit.client.0.smithi002.stdout:5/594: dwrite d1/fe [4194304,4194304] 0 2024-09-13T22:56:15.526 INFO:tasks.workunit.client.0.smithi002.stdout:5/595: truncate d1/d2a/f53 548622 0 2024-09-13T22:56:15.526 INFO:tasks.workunit.client.1.smithi047.stdout:8/605: unlink d8/d3f/d8c/da6/fcd 0 2024-09-13T22:56:15.528 INFO:tasks.workunit.client.1.smithi047.stdout:7/658: dwrite d0/db/fda [0,4194304] 0 2024-09-13T22:56:15.530 INFO:tasks.workunit.client.1.smithi047.stdout:8/606: chown d8/d64/d4e/d4d/d8f/d91/d38/d7a/cd2 792 1 2024-09-13T22:56:15.530 INFO:tasks.workunit.client.1.smithi047.stdout:4/766: fdatasync dc/d29/ff3 0 2024-09-13T22:56:15.532 INFO:tasks.workunit.client.1.smithi047.stdout:8/607: chown d8/d64/d4e/d4d/d8f/d91/d38/dc8/laa 9499 1 2024-09-13T22:56:15.532 INFO:tasks.workunit.client.0.smithi002.stdout:3/651: rmdir d9/d7e/dce 39 2024-09-13T22:56:15.534 INFO:tasks.workunit.client.1.smithi047.stdout:5/583: sync 2024-09-13T22:56:15.534 INFO:tasks.workunit.client.1.smithi047.stdout:3/664: sync 2024-09-13T22:56:15.539 INFO:tasks.workunit.client.0.smithi002.stdout:7/515: mkdir d8/d10/d11/d13/d26/d95 0 2024-09-13T22:56:15.540 INFO:tasks.workunit.client.1.smithi047.stdout:4/767: dwrite dc/de/d23/d40/fd4 [0,4194304] 0 2024-09-13T22:56:15.541 INFO:tasks.workunit.client.0.smithi002.stdout:3/652: dwrite d9/d91/fc9 [0,4194304] 0 2024-09-13T22:56:15.543 INFO:tasks.workunit.client.0.smithi002.stdout:9/617: fsync d8/d10/d1c/d3d/f44 0 2024-09-13T22:56:15.544 INFO:tasks.workunit.client.0.smithi002.stdout:9/618: chown d8/d10/db1/l8c 1 1 2024-09-13T22:56:15.545 INFO:tasks.workunit.client.0.smithi002.stdout:9/619: chown d8/d2c/dbc 2 1 2024-09-13T22:56:15.545 INFO:tasks.workunit.client.0.smithi002.stdout:9/620: stat d8/d2c/f79 0 2024-09-13T22:56:15.547 INFO:tasks.workunit.client.0.smithi002.stdout:2/580: creat d1/d7/d8/d2c/da4/fc0 x:0 0 0 2024-09-13T22:56:15.548 INFO:tasks.workunit.client.0.smithi002.stdout:2/581: read d1/d32/d37/f45 [1053106,105768] 0 2024-09-13T22:56:15.550 INFO:tasks.workunit.client.1.smithi047.stdout:9/619: truncate d1/dc/d14/dd/d54/d50/d5b/d9e/f81 371914 0 2024-09-13T22:56:15.550 INFO:tasks.workunit.client.0.smithi002.stdout:2/582: dread - d1/d7/d35/d3e/d59/d87/faf zero size 2024-09-13T22:56:15.557 INFO:tasks.workunit.client.0.smithi002.stdout:5/596: mkdir d1/d2a/d6b/d88/d45/d4f/d8f/dd5 0 2024-09-13T22:56:15.561 INFO:tasks.workunit.client.1.smithi047.stdout:8/608: mknod d8/d64/d4e/d4d/d8f/d91/d78/cd7 0 2024-09-13T22:56:15.566 INFO:tasks.workunit.client.1.smithi047.stdout:3/665: rmdir d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d3a 39 2024-09-13T22:56:15.569 INFO:tasks.workunit.client.1.smithi047.stdout:3/666: dread d0/d3/d4/d16/d2c/f24 [4194304,4194304] 0 2024-09-13T22:56:15.574 INFO:tasks.workunit.client.1.smithi047.stdout:3/667: dread d0/d3/d4/d16/d2c/de/d68/f88 [0,4194304] 0 2024-09-13T22:56:15.574 INFO:tasks.workunit.client.0.smithi002.stdout:5/597: symlink d1/d2a/d6b/d88/d45/d4f/d8f/ld6 0 2024-09-13T22:56:15.575 INFO:tasks.workunit.client.1.smithi047.stdout:3/668: fsync d0/d3/d4/d16/d32/d42/fa6 0 2024-09-13T22:56:15.578 INFO:tasks.workunit.client.1.smithi047.stdout:8/609: unlink d8/d64/d4e/d4d/d8f/d91/d40/c58 0 2024-09-13T22:56:15.579 INFO:tasks.workunit.client.0.smithi002.stdout:4/544: link d3/f3d d3/d14/d29/d2a/fa3 0 2024-09-13T22:56:15.579 INFO:tasks.workunit.client.1.smithi047.stdout:3/669: dread d0/f98 [0,4194304] 0 2024-09-13T22:56:15.582 INFO:tasks.workunit.client.1.smithi047.stdout:6/680: sync 2024-09-13T22:56:15.582 INFO:tasks.workunit.client.1.smithi047.stdout:2/685: sync 2024-09-13T22:56:15.583 INFO:tasks.workunit.client.1.smithi047.stdout:2/686: fsync d1/d8a/da6/dc3/fc7 0 2024-09-13T22:56:15.584 INFO:tasks.workunit.client.1.smithi047.stdout:1/718: write d0/d7/f64 [1193507,114225] 0 2024-09-13T22:56:15.584 INFO:tasks.workunit.client.0.smithi002.stdout:1/617: dwrite d1/d13/d21/f5b [4194304,4194304] 0 2024-09-13T22:56:15.587 INFO:tasks.workunit.client.1.smithi047.stdout:9/620: fsync d1/dc/d18/f48 0 2024-09-13T22:56:15.587 INFO:tasks.workunit.client.0.smithi002.stdout:5/598: dread d1/d2a/d6b/d88/f70 [0,4194304] 0 2024-09-13T22:56:15.590 INFO:tasks.workunit.client.1.smithi047.stdout:2/687: dread d1/df/d1d/d20/d37/fb1 [0,4194304] 0 2024-09-13T22:56:15.590 INFO:tasks.workunit.client.0.smithi002.stdout:0/591: getdents d1/d2/d6c 0 2024-09-13T22:56:15.594 INFO:tasks.workunit.client.1.smithi047.stdout:8/610: mknod d8/d64/d4e/d70/d98/cd8 0 2024-09-13T22:56:15.597 INFO:tasks.workunit.client.0.smithi002.stdout:0/592: write d1/d4/d75/d31/d32/fb6 [693,65220] 0 2024-09-13T22:56:15.598 INFO:tasks.workunit.client.0.smithi002.stdout:8/563: getdents d3/dc/d18/d56 0 2024-09-13T22:56:15.598 INFO:tasks.workunit.client.0.smithi002.stdout:0/593: fsync d1/d2/f56 0 2024-09-13T22:56:15.599 INFO:tasks.workunit.client.0.smithi002.stdout:6/591: sync 2024-09-13T22:56:15.600 INFO:tasks.workunit.client.1.smithi047.stdout:0/683: truncate d1/d5/f3f 456886 0 2024-09-13T22:56:15.601 INFO:tasks.workunit.client.1.smithi047.stdout:7/659: dwrite d0/d19/f2d [0,4194304] 0 2024-09-13T22:56:15.602 INFO:tasks.workunit.client.0.smithi002.stdout:8/564: dread d3/dc/d18/f81 [0,4194304] 0 2024-09-13T22:56:15.602 INFO:tasks.workunit.client.1.smithi047.stdout:0/684: write d1/d5/d16/d23/d77/fd4 [563781,75809] 0 2024-09-13T22:56:15.604 INFO:tasks.workunit.client.1.smithi047.stdout:4/768: link dc/de/d23/d40/d7b/dab/ce5 dc/de/d23/dc4/dc8/dc9/c107 0 2024-09-13T22:56:15.611 INFO:tasks.workunit.client.1.smithi047.stdout:4/769: dwrite dc/de/d23/f96 [0,4194304] 0 2024-09-13T22:56:15.612 INFO:tasks.workunit.client.0.smithi002.stdout:7/516: rename d8/d10/d11/d13/d26/d4c/d81/f8d to d8/d10/d11/d13/d26/f96 0 2024-09-13T22:56:15.613 INFO:tasks.workunit.client.0.smithi002.stdout:7/517: write d8/d10/d11/d13/d26/f92 [345505,77052] 0 2024-09-13T22:56:15.619 INFO:tasks.workunit.client.1.smithi047.stdout:4/770: dwrite dc/de/d17/d70/ff5 [0,4194304] 0 2024-09-13T22:56:15.620 INFO:tasks.workunit.client.0.smithi002.stdout:9/621: creat d8/d10/d1c/fcf x:0 0 0 2024-09-13T22:56:15.620 INFO:tasks.workunit.client.0.smithi002.stdout:9/622: stat d8/d10 0 2024-09-13T22:56:15.623 INFO:tasks.workunit.client.0.smithi002.stdout:1/618: mkdir d1/d13/d30/d73/da1/d7d/dce 0 2024-09-13T22:56:15.624 INFO:tasks.workunit.client.0.smithi002.stdout:1/619: chown d1/d13/d30/d31/f44 587282 1 2024-09-13T22:56:15.625 INFO:tasks.workunit.client.0.smithi002.stdout:1/620: chown d1/d13/d30/d31/d3b/d71/d80/l89 1131722198 1 2024-09-13T22:56:15.625 INFO:tasks.workunit.client.1.smithi047.stdout:9/621: symlink d1/dc/d14/dd/d54/d50/d91/lc4 0 2024-09-13T22:56:15.626 INFO:tasks.workunit.client.0.smithi002.stdout:2/583: getdents d1/d7/d52/daa 0 2024-09-13T22:56:15.628 INFO:tasks.workunit.client.1.smithi047.stdout:2/688: unlink d1/de/c48 0 2024-09-13T22:56:15.637 INFO:tasks.workunit.client.1.smithi047.stdout:5/584: rename d19/d23/c26 to d19/d23/d32/cbd 0 2024-09-13T22:56:15.639 INFO:tasks.workunit.client.0.smithi002.stdout:0/594: creat d1/d7e/fd3 x:0 0 0 2024-09-13T22:56:15.640 INFO:tasks.workunit.client.1.smithi047.stdout:3/670: getdents d0/d3/d4/d16/d32/d42/dbd 0 2024-09-13T22:56:15.643 INFO:tasks.workunit.client.1.smithi047.stdout:7/660: symlink d0/da2/ldb 0 2024-09-13T22:56:15.644 INFO:tasks.workunit.client.0.smithi002.stdout:8/565: mknod d3/dc/da4/cad 0 2024-09-13T22:56:15.645 INFO:tasks.workunit.client.0.smithi002.stdout:8/566: write d3/dc/f13 [3407892,16615] 0 2024-09-13T22:56:15.649 INFO:tasks.workunit.client.1.smithi047.stdout:6/681: mkdir d3/d11/d2b/d4c/d9d/dc1/de0 0 2024-09-13T22:56:15.650 INFO:tasks.workunit.client.0.smithi002.stdout:3/653: getdents d9/dd1 0 2024-09-13T22:56:15.650 INFO:tasks.workunit.client.1.smithi047.stdout:5/585: dread d19/d25/d90/f99 [0,4194304] 0 2024-09-13T22:56:15.654 INFO:tasks.workunit.client.0.smithi002.stdout:9/623: truncate d8/d10/d1c/d3d/f92 142273 0 2024-09-13T22:56:15.654 INFO:tasks.workunit.client.0.smithi002.stdout:9/624: stat d8/d10/d1c/f15 0 2024-09-13T22:56:15.655 INFO:tasks.workunit.client.0.smithi002.stdout:9/625: stat d8/d91/d96/f86 0 2024-09-13T22:56:15.655 INFO:tasks.workunit.client.1.smithi047.stdout:4/771: creat dc/d29/d4c/f108 x:0 0 0 2024-09-13T22:56:15.657 INFO:tasks.workunit.client.1.smithi047.stdout:1/719: mkdir d0/d7/d14/d57/dcd 0 2024-09-13T22:56:15.658 INFO:tasks.workunit.client.0.smithi002.stdout:1/621: mkdir d1/d13/d52/dcf 0 2024-09-13T22:56:15.661 INFO:tasks.workunit.client.0.smithi002.stdout:2/584: rename d1/d7/d41/fbf to d1/d7/d35/d3e/d59/d6b/d75/fc1 0 2024-09-13T22:56:15.663 INFO:tasks.workunit.client.1.smithi047.stdout:9/622: creat d1/dc/d14/dd/d54/d50/d60/db0/fc5 x:0 0 0 2024-09-13T22:56:15.663 INFO:tasks.workunit.client.0.smithi002.stdout:4/545: write d3/d14/d29/d2a/fa3 [2294979,84841] 0 2024-09-13T22:56:15.670 INFO:tasks.workunit.client.1.smithi047.stdout:1/720: dread d0/d7/d14/d28/f48 [0,4194304] 0 2024-09-13T22:56:15.673 INFO:tasks.workunit.client.1.smithi047.stdout:0/685: rename d1/d7/dc9/dca to d1/d5/d16/d47/dde 0 2024-09-13T22:56:15.675 INFO:tasks.workunit.client.1.smithi047.stdout:1/721: dread d0/d1d/f97 [0,4194304] 0 2024-09-13T22:56:15.678 INFO:tasks.workunit.client.1.smithi047.stdout:7/661: mkdir d0/d7/da/d1e/d93/db7/ddc 0 2024-09-13T22:56:15.679 INFO:tasks.workunit.client.0.smithi002.stdout:3/654: dread d9/d3b/f67 [0,4194304] 0 2024-09-13T22:56:15.679 INFO:tasks.workunit.client.1.smithi047.stdout:7/662: chown d0/d7/da/d1e/d51/lce 0 1 2024-09-13T22:56:15.679 INFO:tasks.workunit.client.0.smithi002.stdout:3/655: readlink d9/d15/d35/lad 0 2024-09-13T22:56:15.680 INFO:tasks.workunit.client.1.smithi047.stdout:6/682: unlink d3/d11/l43 0 2024-09-13T22:56:15.680 INFO:tasks.workunit.client.1.smithi047.stdout:6/683: chown d3/d77/d8f 1 1 2024-09-13T22:56:15.682 INFO:tasks.workunit.client.0.smithi002.stdout:9/626: mkdir d8/d2c/dbc/dc8/dd0 0 2024-09-13T22:56:15.683 INFO:tasks.workunit.client.1.smithi047.stdout:8/611: truncate d8/f1f 3754777 0 2024-09-13T22:56:15.684 INFO:tasks.workunit.client.0.smithi002.stdout:5/599: link d1/f3 d1/d2a/d6b/d88/d45/d4f/d8f/dd5/fd7 0 2024-09-13T22:56:15.687 INFO:tasks.workunit.client.1.smithi047.stdout:9/623: creat d1/dc/d14/dd/d54/d4e/d51/d79/fc6 x:0 0 0 2024-09-13T22:56:15.688 INFO:tasks.workunit.client.0.smithi002.stdout:2/585: rmdir d1/d7/d35 39 2024-09-13T22:56:15.688 INFO:tasks.workunit.client.0.smithi002.stdout:6/592: dwrite d12/d17/d2a/f6f [0,4194304] 0 2024-09-13T22:56:15.689 INFO:tasks.workunit.client.1.smithi047.stdout:9/624: chown d1/dc/d14/dd/d54/d50/f92 6 1 2024-09-13T22:56:15.689 INFO:tasks.workunit.client.0.smithi002.stdout:0/595: truncate d1/d4/d75/f58 1617685 0 2024-09-13T22:56:15.691 INFO:tasks.workunit.client.1.smithi047.stdout:3/671: rename d0/d3/d4/d16/d2c/d7e to d0/d3/d4/d16/d2c/de/dcc/dd1 0 2024-09-13T22:56:15.692 INFO:tasks.workunit.client.1.smithi047.stdout:0/686: symlink d1/d7/ldf 0 2024-09-13T22:56:15.694 INFO:tasks.workunit.client.0.smithi002.stdout:7/518: creat d8/d10/d11/d13/d2e/d3c/f97 x:0 0 0 2024-09-13T22:56:15.695 INFO:tasks.workunit.client.1.smithi047.stdout:1/722: stat d0/d1d/daa/c8f 0 2024-09-13T22:56:15.696 INFO:tasks.workunit.client.0.smithi002.stdout:0/596: dwrite d1/d4/d75/d31/f37 [0,4194304] 0 2024-09-13T22:56:15.699 INFO:tasks.workunit.client.0.smithi002.stdout:5/600: unlink d1/d10/l16 0 2024-09-13T22:56:15.701 INFO:tasks.workunit.client.1.smithi047.stdout:6/684: unlink d3/d77/d8f/db9/lc4 0 2024-09-13T22:56:15.704 INFO:tasks.workunit.client.0.smithi002.stdout:1/622: creat d1/d13/d30/d31/d3d/db6/fd0 x:0 0 0 2024-09-13T22:56:15.705 INFO:tasks.workunit.client.0.smithi002.stdout:1/623: dread - d1/d13/d1d/d34/fa0 zero size 2024-09-13T22:56:15.707 INFO:tasks.workunit.client.0.smithi002.stdout:9/627: dread d8/d1e/f67 [0,4194304] 0 2024-09-13T22:56:15.708 INFO:tasks.workunit.client.0.smithi002.stdout:9/628: readlink d8/d10/l33 0 2024-09-13T22:56:15.708 INFO:tasks.workunit.client.0.smithi002.stdout:9/629: chown d8/d2c/dbc/dc8 19204770 1 2024-09-13T22:56:15.711 INFO:tasks.workunit.client.1.smithi047.stdout:8/612: fdatasync d8/d64/d4e/d4d/d8f/d91/f3d 0 2024-09-13T22:56:15.712 INFO:tasks.workunit.client.0.smithi002.stdout:4/546: mknod d3/d14/d25/d9f/ca4 0 2024-09-13T22:56:15.713 INFO:tasks.workunit.client.1.smithi047.stdout:4/772: symlink dc/de/d17/d25/l109 0 2024-09-13T22:56:15.714 INFO:tasks.workunit.client.1.smithi047.stdout:4/773: chown dc/d29/fe4 29806 1 2024-09-13T22:56:15.715 INFO:tasks.workunit.client.1.smithi047.stdout:2/689: creat d1/d16/d40/fe6 x:0 0 0 2024-09-13T22:56:15.717 INFO:tasks.workunit.client.0.smithi002.stdout:4/547: dwrite d3/d14/d25/f8a [4194304,4194304] 0 2024-09-13T22:56:15.722 INFO:tasks.workunit.client.0.smithi002.stdout:3/656: mkdir d9/d3b/d53/db9/df2 0 2024-09-13T22:56:15.725 INFO:tasks.workunit.client.1.smithi047.stdout:7/663: dwrite d0/d7/f2c [0,4194304] 0 2024-09-13T22:56:15.728 INFO:tasks.workunit.client.1.smithi047.stdout:3/672: truncate d0/d3/d4/d91/f66 1449410 0 2024-09-13T22:56:15.733 INFO:tasks.workunit.client.1.smithi047.stdout:0/687: creat d1/d5/d16/d47/dde/fe0 x:0 0 0 2024-09-13T22:56:15.735 INFO:tasks.workunit.client.0.smithi002.stdout:5/601: symlink d1/d2a/d6b/d88/d45/d4f/d78/ld8 0 2024-09-13T22:56:15.735 INFO:tasks.workunit.client.1.smithi047.stdout:5/586: dwrite d19/f4f [0,4194304] 0 2024-09-13T22:56:15.736 INFO:tasks.workunit.client.1.smithi047.stdout:1/723: symlink d0/d7/d13/d2d/lce 0 2024-09-13T22:56:15.740 INFO:tasks.workunit.client.0.smithi002.stdout:2/586: write d1/d7/d8/d2c/f82 [385502,103917] 0 2024-09-13T22:56:15.742 INFO:tasks.workunit.client.1.smithi047.stdout:6/685: creat d3/d77/fe1 x:0 0 0 2024-09-13T22:56:15.743 INFO:tasks.workunit.client.1.smithi047.stdout:5/587: dwrite d19/f4f [0,4194304] 0 2024-09-13T22:56:15.745 INFO:tasks.workunit.client.1.smithi047.stdout:6/686: chown d3/d11/d2b/d1c/d4d/d69/l78 176873833 1 2024-09-13T22:56:15.748 INFO:tasks.workunit.client.0.smithi002.stdout:1/624: dread d1/d13/d1d/f29 [0,4194304] 0 2024-09-13T22:56:15.749 INFO:tasks.workunit.client.0.smithi002.stdout:4/548: unlink d3/d40/d45/f9a 0 2024-09-13T22:56:15.749 INFO:tasks.workunit.client.1.smithi047.stdout:4/774: creat dc/de/d23/d40/d7b/d90/da6/f10a x:0 0 0 2024-09-13T22:56:15.750 INFO:tasks.workunit.client.1.smithi047.stdout:2/690: read d1/df/d1d/d3c/f56 [98420,8914] 0 2024-09-13T22:56:15.750 INFO:tasks.workunit.client.0.smithi002.stdout:3/657: mknod d9/d15/d36/d4e/d5e/dae/d89/de5/cf3 0 2024-09-13T22:56:15.753 INFO:tasks.workunit.client.0.smithi002.stdout:7/519: link d8/d10/d11/d13/d2e/d50/f61 d8/d10/d11/d13/d2e/d50/d85/f98 0 2024-09-13T22:56:15.753 INFO:tasks.workunit.client.1.smithi047.stdout:9/625: dwrite d1/f1a [0,4194304] 0 2024-09-13T22:56:15.753 INFO:tasks.workunit.client.1.smithi047.stdout:4/775: read dc/da3/fd2 [3196625,125050] 0 2024-09-13T22:56:15.756 INFO:tasks.workunit.client.1.smithi047.stdout:2/691: read d1/df/d26/d4b/f50 [3415760,7444] 0 2024-09-13T22:56:15.757 INFO:tasks.workunit.client.1.smithi047.stdout:7/664: fdatasync d0/d7/da/d2e/db5/f43 0 2024-09-13T22:56:15.760 INFO:tasks.workunit.client.0.smithi002.stdout:7/520: dwrite d8/d10/d11/d13/d26/d4c/d81/f1a [8388608,4194304] 0 2024-09-13T22:56:15.764 INFO:tasks.workunit.client.1.smithi047.stdout:6/687: dwrite d3/d11/d2b/d1c/d4d/d69/dc2/fde [0,4194304] 0 2024-09-13T22:56:15.768 INFO:tasks.workunit.client.0.smithi002.stdout:8/567: sync 2024-09-13T22:56:15.768 INFO:tasks.workunit.client.0.smithi002.stdout:8/568: readlink d3/dc/d18/d2e/d94/l70 0 2024-09-13T22:56:15.768 INFO:tasks.workunit.client.1.smithi047.stdout:5/588: dread d19/d23/d2e/d41/f51 [0,4194304] 0 2024-09-13T22:56:15.768 INFO:tasks.workunit.client.1.smithi047.stdout:0/688: symlink d1/d5/d16/d47/dde/le1 0 2024-09-13T22:56:15.779 INFO:tasks.workunit.client.0.smithi002.stdout:7/521: fdatasync d8/d10/d11/d13/d26/d4c/d81/f1a 0 2024-09-13T22:56:15.782 INFO:tasks.workunit.client.0.smithi002.stdout:7/522: dread d8/d10/d11/d13/d26/f3f [0,4194304] 0 2024-09-13T22:56:15.783 INFO:tasks.workunit.client.1.smithi047.stdout:6/688: dread d3/d11/d2b/d4c/d30/f47 [0,4194304] 0 2024-09-13T22:56:15.785 INFO:tasks.workunit.client.1.smithi047.stdout:9/626: mkdir d1/d5f/dc7 0 2024-09-13T22:56:15.789 INFO:tasks.workunit.client.1.smithi047.stdout:7/665: dread d0/d7/da/d1e/d51/fa3 [0,4194304] 0 2024-09-13T22:56:15.790 INFO:tasks.workunit.client.1.smithi047.stdout:7/666: fsync d0/d19/fc2 0 2024-09-13T22:56:15.792 INFO:tasks.workunit.client.1.smithi047.stdout:2/692: fdatasync d1/df/fc9 0 2024-09-13T22:56:15.793 INFO:tasks.workunit.client.1.smithi047.stdout:8/613: write d8/d64/d4e/d4d/d8f/d91/d38/f3b [70354,47437] 0 2024-09-13T22:56:15.800 INFO:tasks.workunit.client.1.smithi047.stdout:5/589: unlink d19/d25/l8a 0 2024-09-13T22:56:15.800 INFO:tasks.workunit.client.1.smithi047.stdout:5/590: stat c12 0 2024-09-13T22:56:15.801 INFO:tasks.workunit.client.1.smithi047.stdout:0/689: rmdir d1/d5/d16/d23/d2d 39 2024-09-13T22:56:15.886 INFO:tasks.workunit.client.1.smithi047.stdout:9/627: stat d1/dc/d14/dd/d54/l2c 0 2024-09-13T22:56:15.886 INFO:tasks.workunit.client.1.smithi047.stdout:9/628: chown d1/dc/d14/f52 6429379 1 2024-09-13T22:56:15.887 INFO:tasks.workunit.client.1.smithi047.stdout:9/629: chown d1/dc/l46 3 1 2024-09-13T22:56:15.904 INFO:tasks.workunit.client.0.smithi002.stdout:5/602: rename d1/c6f to d1/d2a/d6b/d88/d55/d56/d86/cd9 0 2024-09-13T22:56:15.905 INFO:tasks.workunit.client.1.smithi047.stdout:1/724: dwrite d0/d7/d13/f3c [0,4194304] 0 2024-09-13T22:56:15.906 INFO:tasks.workunit.client.1.smithi047.stdout:7/667: mknod d0/d7/da/d1e/d93/cdd 0 2024-09-13T22:56:15.907 INFO:tasks.workunit.client.1.smithi047.stdout:1/725: write d0/d7/db/f58 [108111,102305] 0 2024-09-13T22:56:15.908 INFO:tasks.workunit.client.0.smithi002.stdout:9/630: creat d8/d91/d96/da8/dc3/fd1 x:0 0 0 2024-09-13T22:56:15.912 INFO:tasks.workunit.client.1.smithi047.stdout:2/693: creat d1/df/d1d/d2e/fe7 x:0 0 0 2024-09-13T22:56:15.913 INFO:tasks.workunit.client.0.smithi002.stdout:6/593: creat d12/d17/fbe x:0 0 0 2024-09-13T22:56:15.914 INFO:tasks.workunit.client.1.smithi047.stdout:8/614: rmdir d8/d3f 39 2024-09-13T22:56:15.917 INFO:tasks.workunit.client.1.smithi047.stdout:1/726: dwrite d0/d7/fba [0,4194304] 0 2024-09-13T22:56:15.919 INFO:tasks.workunit.client.1.smithi047.stdout:4/776: truncate dc/de/d23/f49 4094419 0 2024-09-13T22:56:15.920 INFO:tasks.workunit.client.1.smithi047.stdout:1/727: truncate d0/d7/d14/d57/d62/d76/fcb 280206 0 2024-09-13T22:56:15.920 INFO:tasks.workunit.client.0.smithi002.stdout:4/549: creat d3/d14/d85/fa5 x:0 0 0 2024-09-13T22:56:15.922 INFO:tasks.workunit.client.0.smithi002.stdout:3/658: chown d9/d15/d51/f2e 13860 1 2024-09-13T22:56:15.922 INFO:tasks.workunit.client.1.smithi047.stdout:1/728: write d0/d7/d14/d57/d62/d76/fcb [640529,94366] 0 2024-09-13T22:56:15.925 INFO:tasks.workunit.client.1.smithi047.stdout:1/729: write d0/d7/db/f38 [2366316,38442] 0 2024-09-13T22:56:15.926 INFO:tasks.workunit.client.1.smithi047.stdout:5/591: creat d19/d34/d6c/fbe x:0 0 0 2024-09-13T22:56:15.930 INFO:tasks.workunit.client.1.smithi047.stdout:4/777: dwrite dc/de/d23/dc4/dc8/ffa [0,4194304] 0 2024-09-13T22:56:15.930 INFO:tasks.workunit.client.0.smithi002.stdout:8/569: symlink d3/dc/d18/d6f/lae 0 2024-09-13T22:56:15.931 INFO:tasks.workunit.client.0.smithi002.stdout:8/570: chown d3/dc/fe 502955987 1 2024-09-13T22:56:15.932 INFO:tasks.workunit.client.0.smithi002.stdout:8/571: chown d3/dc/d16/d4b/d72/d73 7130096 1 2024-09-13T22:56:15.933 INFO:tasks.workunit.client.0.smithi002.stdout:7/523: unlink d8/d10/d11/d13/d2e/f87 0 2024-09-13T22:56:15.934 INFO:tasks.workunit.client.0.smithi002.stdout:7/524: dread - d8/d10/d11/d13/d26/d4c/d81/d51/f86 zero size 2024-09-13T22:56:15.937 INFO:tasks.workunit.client.1.smithi047.stdout:3/673: getdents d0/d3/d4/d16/d2c/de 0 2024-09-13T22:56:15.941 INFO:tasks.workunit.client.0.smithi002.stdout:7/525: dwrite d8/d10/f89 [0,4194304] 0 2024-09-13T22:56:15.941 INFO:tasks.workunit.client.0.smithi002.stdout:4/550: dread d3/f5d [0,4194304] 0 2024-09-13T22:56:15.943 INFO:tasks.workunit.client.0.smithi002.stdout:1/625: rename d1/d13/lb5 to d1/d13/d30/d73/ld1 0 2024-09-13T22:56:15.943 INFO:tasks.workunit.client.0.smithi002.stdout:7/526: dread - d8/d10/d11/d13/d26/d4c/d81/d51/f66 zero size 2024-09-13T22:56:15.944 INFO:tasks.workunit.client.0.smithi002.stdout:1/626: readlink d1/d13/d30/d73/lbf 0 2024-09-13T22:56:15.945 INFO:tasks.workunit.client.1.smithi047.stdout:5/592: dread d19/d23/d2e/d41/f9c [0,4194304] 0 2024-09-13T22:56:15.945 INFO:tasks.workunit.client.1.smithi047.stdout:5/593: readlink d19/d25/l56 0 2024-09-13T22:56:15.946 INFO:tasks.workunit.client.0.smithi002.stdout:9/631: rmdir d8/d2c/d50 39 2024-09-13T22:56:15.946 INFO:tasks.workunit.client.1.smithi047.stdout:5/594: chown d19/d25/d85 42173827 1 2024-09-13T22:56:15.950 INFO:tasks.workunit.client.0.smithi002.stdout:2/587: unlink d1/d7/d35/d3e/d59/d87/faf 0 2024-09-13T22:56:15.951 INFO:tasks.workunit.client.1.smithi047.stdout:2/694: truncate d1/df/d1d/d20/d29/f9b 3374364 0 2024-09-13T22:56:15.953 INFO:tasks.workunit.client.1.smithi047.stdout:8/615: symlink d8/d64/dc5/ld9 0 2024-09-13T22:56:15.956 INFO:tasks.workunit.client.0.smithi002.stdout:3/659: creat d9/d15/d35/ff4 x:0 0 0 2024-09-13T22:56:15.959 INFO:tasks.workunit.client.0.smithi002.stdout:0/597: getdents d1/d4/d75/d31/d32 0 2024-09-13T22:56:15.959 INFO:tasks.workunit.client.1.smithi047.stdout:0/690: symlink d1/ddb/le2 0 2024-09-13T22:56:15.962 INFO:tasks.workunit.client.0.smithi002.stdout:0/598: dread d1/d2/d81/d8f/f48 [0,4194304] 0 2024-09-13T22:56:15.964 INFO:tasks.workunit.client.1.smithi047.stdout:4/778: symlink dc/de/d17/d25/d4a/dc3/l10b 0 2024-09-13T22:56:15.967 INFO:tasks.workunit.client.1.smithi047.stdout:3/674: chown d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d3a/la2 2 1 2024-09-13T22:56:15.967 INFO:tasks.workunit.client.1.smithi047.stdout:0/691: dwrite d1/d5/d16/d47/f4d [4194304,4194304] 0 2024-09-13T22:56:15.968 INFO:tasks.workunit.client.0.smithi002.stdout:7/527: mkdir d8/d10/d11/d13/d2e/d50/d52/d99 0 2024-09-13T22:56:15.969 INFO:tasks.workunit.client.1.smithi047.stdout:3/675: write d0/d3/d4/d16/d32/d42/fbb [443614,125215] 0 2024-09-13T22:56:15.972 INFO:tasks.workunit.client.1.smithi047.stdout:3/676: write d0/d3/d4/f4c [196173,67183] 0 2024-09-13T22:56:15.972 INFO:tasks.workunit.client.1.smithi047.stdout:7/668: mknod d0/d7/da/d4e/dd3/cde 0 2024-09-13T22:56:15.976 INFO:tasks.workunit.client.1.smithi047.stdout:5/595: chown d19/d34/d42/d5d/d9d/lb9 215 1 2024-09-13T22:56:15.977 INFO:tasks.workunit.client.0.smithi002.stdout:6/594: mknod d12/d17/d4e/cbf 0 2024-09-13T22:56:15.978 INFO:tasks.workunit.client.0.smithi002.stdout:6/595: stat d12/l1f 0 2024-09-13T22:56:15.983 INFO:tasks.workunit.client.1.smithi047.stdout:5/596: dwrite d19/d23/d2e/d41/d58/faa [0,4194304] 0 2024-09-13T22:56:15.985 INFO:tasks.workunit.client.0.smithi002.stdout:0/599: dread - d1/d2/f6b zero size 2024-09-13T22:56:15.987 INFO:tasks.workunit.client.0.smithi002.stdout:0/600: fsync d1/d4/d75/d31/d32/fb6 0 2024-09-13T22:56:15.988 INFO:tasks.workunit.client.0.smithi002.stdout:5/603: rmdir d1/d2a/d6b/d88/d45/d4f/d78/d8b 39 2024-09-13T22:56:15.989 INFO:tasks.workunit.client.0.smithi002.stdout:9/632: dwrite d8/d10/d42/f6e [0,4194304] 0 2024-09-13T22:56:15.991 INFO:tasks.workunit.client.1.smithi047.stdout:0/692: creat d1/d5/d16/d47/dde/fe3 x:0 0 0 2024-09-13T22:56:15.998 INFO:tasks.workunit.client.0.smithi002.stdout:7/528: dwrite d8/d10/d11/d13/d26/f96 [0,4194304] 0 2024-09-13T22:56:15.999 INFO:tasks.workunit.client.0.smithi002.stdout:7/529: dread - d8/d10/d11/d13/d26/d4c/d81/d51/f66 zero size 2024-09-13T22:56:16.000 INFO:tasks.workunit.client.1.smithi047.stdout:0/693: dread d1/d5/d16/d23/d45/d7f/f78 [0,4194304] 0 2024-09-13T22:56:16.002 INFO:tasks.workunit.client.0.smithi002.stdout:4/551: rename d3/d14/d25 to d3/d14/d29/d2a/da6 0 2024-09-13T22:56:16.002 INFO:tasks.workunit.client.1.smithi047.stdout:0/694: chown d1/d5/d16/d6a/c90 2087917190 1 2024-09-13T22:56:16.005 INFO:tasks.workunit.client.1.smithi047.stdout:8/616: rmdir d8/d64/d4e/d4d/d8f/d91/d40 39 2024-09-13T22:56:16.007 INFO:tasks.workunit.client.1.smithi047.stdout:7/669: dread d0/f33 [0,4194304] 0 2024-09-13T22:56:16.008 INFO:tasks.workunit.client.1.smithi047.stdout:7/670: chown d0/fd7 428800175 1 2024-09-13T22:56:16.012 INFO:tasks.workunit.client.1.smithi047.stdout:2/695: dwrite d1/d16/d40/f4d [0,4194304] 0 2024-09-13T22:56:16.014 INFO:tasks.workunit.client.1.smithi047.stdout:4/779: mknod dc/de/d17/c10c 0 2024-09-13T22:56:16.015 INFO:tasks.workunit.client.0.smithi002.stdout:1/627: creat d1/d13/d30/d31/d3b/d71/fd2 x:0 0 0 2024-09-13T22:56:16.015 INFO:tasks.workunit.client.1.smithi047.stdout:9/630: link d1/d5f/d6a/l78 d1/dc/d14/dd/d54/d50/d60/db0/lc8 0 2024-09-13T22:56:16.016 INFO:tasks.workunit.client.0.smithi002.stdout:1/628: stat d1/d13/d1d/d34/d51/f9b 0 2024-09-13T22:56:16.018 INFO:tasks.workunit.client.1.smithi047.stdout:4/780: truncate dc/de/d23/dc4/ddb/fec 464147 0 2024-09-13T22:56:16.018 INFO:tasks.workunit.client.1.smithi047.stdout:9/631: write d1/f5 [7908437,97760] 0 2024-09-13T22:56:16.019 INFO:tasks.workunit.client.1.smithi047.stdout:9/632: dread - d1/dc/d14/dd/d54/fbf zero size 2024-09-13T22:56:16.020 INFO:tasks.workunit.client.0.smithi002.stdout:9/633: write d8/d1e/f3a [900375,111150] 0 2024-09-13T22:56:16.024 INFO:tasks.workunit.client.1.smithi047.stdout:4/781: dwrite dc/de/d17/f1b [0,4194304] 0 2024-09-13T22:56:16.025 INFO:tasks.workunit.client.0.smithi002.stdout:8/572: sync 2024-09-13T22:56:16.026 INFO:tasks.workunit.client.1.smithi047.stdout:3/677: creat d0/d3/d4/d16/d32/d42/d79/d9c/dad/d95/dc3/fd2 x:0 0 0 2024-09-13T22:56:16.028 INFO:tasks.workunit.client.1.smithi047.stdout:4/782: truncate dc/de/d23/d40/d7b/dab/fd3 872802 0 2024-09-13T22:56:16.028 INFO:tasks.workunit.client.0.smithi002.stdout:7/530: creat d8/d10/d11/d3a/f9a x:0 0 0 2024-09-13T22:56:16.030 INFO:tasks.workunit.client.0.smithi002.stdout:4/552: mknod d3/d14/d29/d2a/da6/d9f/ca7 0 2024-09-13T22:56:16.030 INFO:tasks.workunit.client.0.smithi002.stdout:8/573: dwrite d3/dc/d16/d60/f74 [0,4194304] 0 2024-09-13T22:56:16.031 INFO:tasks.workunit.client.0.smithi002.stdout:8/574: write d3/d27/f8a [499037,30662] 0 2024-09-13T22:56:16.032 INFO:tasks.workunit.client.1.smithi047.stdout:0/695: mkdir d1/d5/d16/d97/de4 0 2024-09-13T22:56:16.032 INFO:tasks.workunit.client.0.smithi002.stdout:8/575: write d3/d27/f9c [344650,123404] 0 2024-09-13T22:56:16.033 INFO:tasks.workunit.client.0.smithi002.stdout:0/601: mknod d1/d4/cd4 0 2024-09-13T22:56:16.038 INFO:tasks.workunit.client.1.smithi047.stdout:1/730: getdents d0/d7/db 0 2024-09-13T22:56:16.039 INFO:tasks.workunit.client.1.smithi047.stdout:7/671: mkdir d0/d7/da/d1e/d93/ddf 0 2024-09-13T22:56:16.041 INFO:tasks.workunit.client.0.smithi002.stdout:9/634: rename d8/d10/d1c/d3d/f6f to d8/d91/fd2 0 2024-09-13T22:56:16.043 INFO:tasks.workunit.client.0.smithi002.stdout:6/596: mknod d12/d17/d34/cc0 0 2024-09-13T22:56:16.044 INFO:tasks.workunit.client.0.smithi002.stdout:6/597: dread - d12/d17/d34/d39/d8b/fa3 zero size 2024-09-13T22:56:16.045 INFO:tasks.workunit.client.0.smithi002.stdout:3/660: getdents d9/d15/d36/d4e/d5e 0 2024-09-13T22:56:16.047 INFO:tasks.workunit.client.0.smithi002.stdout:0/602: dread d1/d2/f45 [0,4194304] 0 2024-09-13T22:56:16.048 INFO:tasks.workunit.client.1.smithi047.stdout:9/633: mknod d1/dc/d14/dd/d54/d4e/cc9 0 2024-09-13T22:56:16.048 INFO:tasks.workunit.client.1.smithi047.stdout:8/617: write d8/d64/f9f [147610,24713] 0 2024-09-13T22:56:16.049 INFO:tasks.workunit.client.1.smithi047.stdout:9/634: chown d1/f1a 49062 1 2024-09-13T22:56:16.051 INFO:tasks.workunit.client.0.smithi002.stdout:4/553: mknod d3/d62/ca8 0 2024-09-13T22:56:16.053 INFO:tasks.workunit.client.0.smithi002.stdout:5/604: dwrite d1/d2a/d6b/d88/d45/d4f/d78/d8b/f9b [0,4194304] 0 2024-09-13T22:56:16.053 INFO:tasks.workunit.client.1.smithi047.stdout:3/678: write d0/f98 [73735,11471] 0 2024-09-13T22:56:16.056 INFO:tasks.workunit.client.0.smithi002.stdout:5/605: truncate d1/d2a/d6b/d88/d45/d4f/d78/d8b/fc0 376362 0 2024-09-13T22:56:16.056 INFO:tasks.workunit.client.1.smithi047.stdout:4/783: creat dc/de/d17/d25/d4a/dc3/f10d x:0 0 0 2024-09-13T22:56:16.058 INFO:tasks.workunit.client.0.smithi002.stdout:8/576: rename d3/dc/d18/d2e/d94/l70 to d3/dc/d18/d2e/d94/laf 0 2024-09-13T22:56:16.061 INFO:tasks.workunit.client.1.smithi047.stdout:0/696: unlink d1/d5/d16/d23/fae 0 2024-09-13T22:56:16.064 INFO:tasks.workunit.client.0.smithi002.stdout:1/629: mknod d1/d13/d30/d31/d86/d90/cd3 0 2024-09-13T22:56:16.066 INFO:tasks.workunit.client.1.smithi047.stdout:1/731: creat d0/d7/d87/fcf x:0 0 0 2024-09-13T22:56:16.067 INFO:tasks.workunit.client.1.smithi047.stdout:0/697: dwrite d1/d5/d11/d2f/fb2 [0,4194304] 0 2024-09-13T22:56:16.068 INFO:tasks.workunit.client.0.smithi002.stdout:6/598: stat d12/d17/f33 0 2024-09-13T22:56:16.070 INFO:tasks.workunit.client.1.smithi047.stdout:2/696: symlink d1/df/d26/d4b/le8 0 2024-09-13T22:56:16.073 INFO:tasks.workunit.client.1.smithi047.stdout:8/618: chown d8/d64/f94 22 1 2024-09-13T22:56:16.074 INFO:tasks.workunit.client.0.smithi002.stdout:6/599: dwrite d12/d17/d34/fb2 [0,4194304] 0 2024-09-13T22:56:16.074 INFO:tasks.workunit.client.0.smithi002.stdout:2/588: sync 2024-09-13T22:56:16.075 INFO:tasks.workunit.client.1.smithi047.stdout:9/635: creat d1/dc/d14/dd/d54/d50/d60/db0/fca x:0 0 0 2024-09-13T22:56:16.076 INFO:tasks.workunit.client.0.smithi002.stdout:2/589: write d1/d7/d41/d96/f97 [829090,130065] 0 2024-09-13T22:56:16.078 INFO:tasks.workunit.client.0.smithi002.stdout:0/603: creat d1/d4/d75/d31/d32/dbb/fd5 x:0 0 0 2024-09-13T22:56:16.079 INFO:tasks.workunit.client.0.smithi002.stdout:0/604: chown d1/d4/d75/d31/f46 49618454 1 2024-09-13T22:56:16.081 INFO:tasks.workunit.client.0.smithi002.stdout:0/605: chown d1/d4/d75/d31/d32/dbb/fbd 13667 1 2024-09-13T22:56:16.081 INFO:tasks.workunit.client.0.smithi002.stdout:0/606: dread - d1/d7e/fd3 zero size 2024-09-13T22:56:16.083 INFO:tasks.workunit.client.0.smithi002.stdout:8/577: fsync d3/dc/d18/f81 0 2024-09-13T22:56:16.084 INFO:tasks.workunit.client.1.smithi047.stdout:1/732: mknod d0/d1d/d7f/cd0 0 2024-09-13T22:56:16.086 INFO:tasks.workunit.client.0.smithi002.stdout:1/630: rmdir d1/d13/d1d/d34/d51 39 2024-09-13T22:56:16.086 INFO:tasks.workunit.client.1.smithi047.stdout:7/672: dwrite d0/d7/f36 [0,4194304] 0 2024-09-13T22:56:16.086 INFO:tasks.workunit.client.1.smithi047.stdout:7/673: fdatasync d0/d19/fc2 0 2024-09-13T22:56:16.087 INFO:tasks.workunit.client.0.smithi002.stdout:5/606: dwrite d1/d10/f4b [0,4194304] 0 2024-09-13T22:56:16.088 INFO:tasks.workunit.client.0.smithi002.stdout:9/635: mknod d8/cd3 0 2024-09-13T22:56:16.088 INFO:tasks.workunit.client.1.smithi047.stdout:0/698: readlink d1/d5/d16/d23/la3 0 2024-09-13T22:56:16.089 INFO:tasks.workunit.client.1.smithi047.stdout:2/697: mkdir d1/df/d1d/d20/d37/d7b/db6/de9 0 2024-09-13T22:56:16.090 INFO:tasks.workunit.client.0.smithi002.stdout:3/661: write d9/d15/d46/f9b [492006,123900] 0 2024-09-13T22:56:16.091 INFO:tasks.workunit.client.1.smithi047.stdout:8/619: stat d8/d64/d4e/d4d/l5d 0 2024-09-13T22:56:16.094 INFO:tasks.workunit.client.0.smithi002.stdout:3/662: chown d9/d15/d36/d4e/d5e/dae 2026 1 2024-09-13T22:56:16.095 INFO:tasks.workunit.client.1.smithi047.stdout:9/636: rename d1/dc/d14/f4a to d1/dc/d14/dd/d54/d8d/fcb 0 2024-09-13T22:56:16.096 INFO:tasks.workunit.client.0.smithi002.stdout:6/600: readlink d12/d17/d28/d67/d6b/l41 0 2024-09-13T22:56:16.097 INFO:tasks.workunit.client.0.smithi002.stdout:3/663: write d9/d91/fc9 [1333204,68377] 0 2024-09-13T22:56:16.098 INFO:tasks.workunit.client.0.smithi002.stdout:5/607: dwrite d1/d2a/d6b/d88/d45/d4f/db7/fcb [0,4194304] 0 2024-09-13T22:56:16.099 INFO:tasks.workunit.client.1.smithi047.stdout:4/784: creat dc/de/d23/d40/d7b/dab/dae/dee/f10e x:0 0 0 2024-09-13T22:56:16.101 INFO:tasks.workunit.client.1.smithi047.stdout:3/679: dwrite d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/f4b [0,4194304] 0 2024-09-13T22:56:16.105 INFO:tasks.workunit.client.1.smithi047.stdout:7/674: symlink d0/d7/da/d4e/dd3/le0 0 2024-09-13T22:56:16.107 INFO:tasks.workunit.client.0.smithi002.stdout:5/608: dwrite d1/d2a/d5a/fd2 [0,4194304] 0 2024-09-13T22:56:16.109 INFO:tasks.workunit.client.0.smithi002.stdout:8/578: rename d3/dc/d18/d2e/f8f to d3/dc/d16/d2f/d83/d95/fb0 0 2024-09-13T22:56:16.109 INFO:tasks.workunit.client.0.smithi002.stdout:5/609: dread d1/d2a/d6b/d88/d45/d4f/d78/d8b/fc0 [0,4194304] 0 2024-09-13T22:56:16.110 INFO:tasks.workunit.client.0.smithi002.stdout:8/579: chown d3/d21/c92 15 1 2024-09-13T22:56:16.110 INFO:tasks.workunit.client.1.smithi047.stdout:9/637: dwrite d1/dc/d14/dd/d54/d8d/f93 [0,4194304] 0 2024-09-13T22:56:16.111 INFO:tasks.workunit.client.0.smithi002.stdout:5/610: write d1/d2a/d6b/d88/d55/d56/dc7/fb1 [543375,85724] 0 2024-09-13T22:56:16.112 INFO:tasks.workunit.client.1.smithi047.stdout:0/699: fsync d1/d5/d16/d23/d77/fa6 0 2024-09-13T22:56:16.113 INFO:tasks.workunit.client.0.smithi002.stdout:1/631: creat d1/d13/d21/d40/dc4/fd4 x:0 0 0 2024-09-13T22:56:16.114 INFO:tasks.workunit.client.1.smithi047.stdout:9/638: chown d1/dc/d14/dd/d54/d50/d91/da3/fa9 1539 1 2024-09-13T22:56:16.118 INFO:tasks.workunit.client.0.smithi002.stdout:6/601: dread d12/d17/d28/d67/f6d [0,4194304] 0 2024-09-13T22:56:16.123 INFO:tasks.workunit.client.1.smithi047.stdout:2/698: rename d1/d16/f7c to d1/de/d17/fea 0 2024-09-13T22:56:16.125 INFO:tasks.workunit.client.0.smithi002.stdout:4/554: write d3/d40/f4e [3688826,101683] 0 2024-09-13T22:56:16.128 INFO:tasks.workunit.client.0.smithi002.stdout:4/555: truncate d3/d14/d29/d2a/da6/d5e/f65 4477229 0 2024-09-13T22:56:16.128 INFO:tasks.workunit.client.1.smithi047.stdout:4/785: creat dc/de/d23/d40/d7b/dab/f10f x:0 0 0 2024-09-13T22:56:16.129 INFO:tasks.workunit.client.0.smithi002.stdout:3/664: fsync d9/d15/d26/f48 0 2024-09-13T22:56:16.131 INFO:tasks.workunit.client.1.smithi047.stdout:7/675: dread - d0/d57/d5b/d8b/fd5 zero size 2024-09-13T22:56:16.138 INFO:tasks.workunit.client.1.smithi047.stdout:9/639: creat d1/dc/d14/dd/d54/d50/d5b/fcc x:0 0 0 2024-09-13T22:56:16.139 INFO:tasks.workunit.client.1.smithi047.stdout:9/640: write d1/dc/d14/dd/d4c/fa1 [173857,115054] 0 2024-09-13T22:56:16.140 INFO:tasks.workunit.client.1.smithi047.stdout:8/620: rmdir d8/d3f/d8c 39 2024-09-13T22:56:16.145 INFO:tasks.workunit.client.1.smithi047.stdout:1/733: creat d0/d7/d14/fd1 x:0 0 0 2024-09-13T22:56:16.145 INFO:tasks.workunit.client.1.smithi047.stdout:2/699: dread d1/d16/f64 [0,4194304] 0 2024-09-13T22:56:16.147 INFO:tasks.workunit.client.0.smithi002.stdout:0/607: write d1/d4/d75/d31/f41 [638614,106039] 0 2024-09-13T22:56:16.149 INFO:tasks.workunit.client.1.smithi047.stdout:4/786: rename dc/de/d17/d25/d4a/dc3/f10d to dc/de/d17/d70/f110 0 2024-09-13T22:56:16.150 INFO:tasks.workunit.client.1.smithi047.stdout:4/787: chown dc/de/d17/d25 18085 1 2024-09-13T22:56:16.150 INFO:tasks.workunit.client.1.smithi047.stdout:4/788: stat dc/de/d17/d70 0 2024-09-13T22:56:16.153 INFO:tasks.workunit.client.1.smithi047.stdout:3/680: link d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d85/fa0 d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d3a/fd3 0 2024-09-13T22:56:16.154 INFO:tasks.workunit.client.0.smithi002.stdout:9/636: mkdir d8/d10/dc4/dd4 0 2024-09-13T22:56:16.154 INFO:tasks.workunit.client.1.smithi047.stdout:3/681: write d0/d3/d4/d16/d1c/f82 [5100378,77310] 0 2024-09-13T22:56:16.156 INFO:tasks.workunit.client.0.smithi002.stdout:6/602: readlink d12/d17/d2a/l93 0 2024-09-13T22:56:16.157 INFO:tasks.workunit.client.0.smithi002.stdout:4/556: fdatasync d3/d40/f8b 0 2024-09-13T22:56:16.157 INFO:tasks.workunit.client.0.smithi002.stdout:4/557: chown d3/d14/f1d 798421785 1 2024-09-13T22:56:16.158 INFO:tasks.workunit.client.1.smithi047.stdout:3/682: dread - d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d3a/d81/fbc zero size 2024-09-13T22:56:16.161 INFO:tasks.workunit.client.1.smithi047.stdout:2/700: dread d1/df/d1d/d20/d37/d7a/f84 [0,4194304] 0 2024-09-13T22:56:16.161 INFO:tasks.workunit.client.0.smithi002.stdout:7/531: link d8/d10/d11/d13/f1c d8/d10/d39/f9b 0 2024-09-13T22:56:16.161 INFO:tasks.workunit.client.1.smithi047.stdout:4/789: truncate f4 1250765 0 2024-09-13T22:56:16.166 INFO:tasks.workunit.client.1.smithi047.stdout:1/734: dwrite d0/f5a [0,4194304] 0 2024-09-13T22:56:16.168 INFO:tasks.workunit.client.1.smithi047.stdout:9/641: dread d1/dc/d14/dd/d54/f4f [0,4194304] 0 2024-09-13T22:56:16.168 INFO:tasks.workunit.client.1.smithi047.stdout:1/735: write d0/d7/d10/f49 [5213871,92568] 0 2024-09-13T22:56:16.169 INFO:tasks.workunit.client.1.smithi047.stdout:8/621: mkdir d8/d64/d4e/d4d/dda 0 2024-09-13T22:56:16.172 INFO:tasks.workunit.client.0.smithi002.stdout:8/580: creat d3/dc/d16/d60/da7/fb1 x:0 0 0 2024-09-13T22:56:16.176 INFO:tasks.workunit.client.1.smithi047.stdout:7/676: rename d0/l78 to d0/le1 0 2024-09-13T22:56:16.177 INFO:tasks.workunit.client.0.smithi002.stdout:3/665: dwrite d9/d15/d51/f2e [0,4194304] 0 2024-09-13T22:56:16.178 INFO:tasks.workunit.client.1.smithi047.stdout:7/677: chown d0/d7/da/d47/fa1 13283 1 2024-09-13T22:56:16.181 INFO:tasks.workunit.client.1.smithi047.stdout:3/683: unlink d0/d3/d4/d91/d8d/fa5 0 2024-09-13T22:56:16.184 INFO:tasks.workunit.client.0.smithi002.stdout:1/632: mknod d1/d13/d30/d73/dc0/cd5 0 2024-09-13T22:56:16.185 INFO:tasks.workunit.client.0.smithi002.stdout:9/637: creat d8/d10/d42/fd5 x:0 0 0 2024-09-13T22:56:16.186 INFO:tasks.workunit.client.1.smithi047.stdout:4/790: fdatasync dc/de/d23/f83 0 2024-09-13T22:56:16.187 INFO:tasks.workunit.client.1.smithi047.stdout:0/700: link d1/d5/d16/d23/d2d/f61 d1/d5/d16/d23/d45/fe5 0 2024-09-13T22:56:16.189 INFO:tasks.workunit.client.1.smithi047.stdout:1/736: mknod d0/d7/d13/cd2 0 2024-09-13T22:56:16.189 INFO:tasks.workunit.client.1.smithi047.stdout:1/737: chown d0/f5c 96119 1 2024-09-13T22:56:16.190 INFO:tasks.workunit.client.1.smithi047.stdout:1/738: readlink d0/d7/db/lbe 0 2024-09-13T22:56:16.191 INFO:tasks.workunit.client.0.smithi002.stdout:2/590: getdents d1/d7/d8/d2c/d9d 0 2024-09-13T22:56:16.195 INFO:tasks.workunit.client.1.smithi047.stdout:3/684: chown d0/d3/d4/d16/d2c/de/dcc/dd1/fbe 173020734 1 2024-09-13T22:56:16.196 INFO:tasks.workunit.client.1.smithi047.stdout:3/685: chown d0/d3/d4/d91/c74 27980 1 2024-09-13T22:56:16.198 INFO:tasks.workunit.client.1.smithi047.stdout:2/701: symlink d1/d16/d40/leb 0 2024-09-13T22:56:16.200 INFO:tasks.workunit.client.1.smithi047.stdout:2/702: write d1/df/d1d/d20/d29/dcd/fb8 [1588432,114922] 0 2024-09-13T22:56:16.200 INFO:tasks.workunit.client.0.smithi002.stdout:8/581: write d3/dc/d18/d2e/f8d [397364,18777] 0 2024-09-13T22:56:16.200 INFO:tasks.workunit.client.0.smithi002.stdout:8/582: fsync d3/d21/f5b 0 2024-09-13T22:56:16.203 INFO:tasks.workunit.client.1.smithi047.stdout:7/678: write d0/d7/da/d1e/d51/f99 [4687229,86873] 0 2024-09-13T22:56:16.205 INFO:tasks.workunit.client.0.smithi002.stdout:5/611: rename d1/d2a/d6b/d88/d45/d4f/d78/d8b/f8e to d1/d2a/d6b/d88/d55/fda 0 2024-09-13T22:56:16.206 INFO:tasks.workunit.client.0.smithi002.stdout:7/532: write d8/d10/f2a [3369839,9296] 0 2024-09-13T22:56:16.207 INFO:tasks.workunit.client.1.smithi047.stdout:0/701: symlink d1/d5/d16/d6a/le6 0 2024-09-13T22:56:16.207 INFO:tasks.workunit.client.0.smithi002.stdout:5/612: write d1/d2a/d6b/d88/d55/d56/d81/fa5 [1168361,130446] 0 2024-09-13T22:56:16.208 INFO:tasks.workunit.client.1.smithi047.stdout:0/702: fdatasync d1/d5/f24 0 2024-09-13T22:56:16.210 INFO:tasks.workunit.client.1.smithi047.stdout:9/642: mknod d1/dc/d14/dd/ccd 0 2024-09-13T22:56:16.211 INFO:tasks.workunit.client.1.smithi047.stdout:7/679: dwrite d0/d7/fc6 [0,4194304] 0 2024-09-13T22:56:16.211 INFO:tasks.workunit.client.0.smithi002.stdout:1/633: fdatasync d1/d13/d30/d73/da1/d7d/f98 0 2024-09-13T22:56:16.212 INFO:tasks.workunit.client.0.smithi002.stdout:1/634: chown d1/d13/d21/d39 7759 1 2024-09-13T22:56:16.212 INFO:tasks.workunit.client.1.smithi047.stdout:7/680: readlink d0/d7/da/d47/l7d 0 2024-09-13T22:56:16.212 INFO:tasks.workunit.client.0.smithi002.stdout:1/635: chown d1/d13/d30/d31/d3d/d5d/f62 30 1 2024-09-13T22:56:16.214 INFO:tasks.workunit.client.1.smithi047.stdout:4/791: write dc/de/d23/f81 [118856,18933] 0 2024-09-13T22:56:16.217 INFO:tasks.workunit.client.0.smithi002.stdout:6/603: fdatasync d12/d17/f27 0 2024-09-13T22:56:16.220 INFO:tasks.workunit.client.1.smithi047.stdout:3/686: symlink d0/d3/d4/d16/d32/d42/ld4 0 2024-09-13T22:56:16.221 INFO:tasks.workunit.client.1.smithi047.stdout:9/643: dwrite d1/dc/d14/dd/f1d [4194304,4194304] 0 2024-09-13T22:56:16.221 INFO:tasks.workunit.client.1.smithi047.stdout:2/703: rmdir d1/df/d35/dd7 39 2024-09-13T22:56:16.222 INFO:tasks.workunit.client.1.smithi047.stdout:2/704: chown d1/df/cce 32 1 2024-09-13T22:56:16.223 INFO:tasks.workunit.client.0.smithi002.stdout:3/666: dwrite d9/d15/d51/f92 [4194304,4194304] 0 2024-09-13T22:56:16.238 INFO:tasks.workunit.client.0.smithi002.stdout:2/591: creat d1/d7/d41/fc2 x:0 0 0 2024-09-13T22:56:16.239 INFO:tasks.workunit.client.0.smithi002.stdout:4/558: truncate d3/d14/f5b 2621452 0 2024-09-13T22:56:16.240 INFO:tasks.workunit.client.0.smithi002.stdout:4/559: dread - d3/d14/f8c zero size 2024-09-13T22:56:16.241 INFO:tasks.workunit.client.0.smithi002.stdout:8/583: rmdir d3/dc/d16/d4b 39 2024-09-13T22:56:16.245 INFO:tasks.workunit.client.1.smithi047.stdout:0/703: unlink d1/d7/c1b 0 2024-09-13T22:56:16.252 INFO:tasks.workunit.client.0.smithi002.stdout:2/592: dread d1/d7/d8/d2c/f4e [0,4194304] 0 2024-09-13T22:56:16.252 INFO:tasks.workunit.client.1.smithi047.stdout:4/792: symlink dc/d29/d4c/l111 0 2024-09-13T22:56:16.253 INFO:tasks.workunit.client.0.smithi002.stdout:5/613: mkdir d1/d2a/d6b/d88/d45/d4f/d78/d8b/ddb 0 2024-09-13T22:56:16.254 INFO:tasks.workunit.client.0.smithi002.stdout:9/638: truncate d8/d1e/fc7 327689 0 2024-09-13T22:56:16.257 INFO:tasks.workunit.client.0.smithi002.stdout:6/604: creat d12/fc1 x:0 0 0 2024-09-13T22:56:16.259 INFO:tasks.workunit.client.1.smithi047.stdout:9/644: rmdir d1/dc/d14/dd/d54/d4e/d51/d79 39 2024-09-13T22:56:16.265 INFO:tasks.workunit.client.1.smithi047.stdout:7/681: dread d0/d7/da/d2e/db5/f43 [0,4194304] 0 2024-09-13T22:56:16.269 INFO:tasks.workunit.client.1.smithi047.stdout:8/622: link d8/c31 d8/d6b/da9/dc3/cdb 0 2024-09-13T22:56:16.269 INFO:tasks.workunit.client.1.smithi047.stdout:9/645: dwrite d1/dc/d14/dd/fc2 [0,4194304] 0 2024-09-13T22:56:16.271 INFO:tasks.workunit.client.1.smithi047.stdout:4/793: mknod dc/d29/d8e/c112 0 2024-09-13T22:56:16.276 INFO:tasks.workunit.client.1.smithi047.stdout:1/739: rmdir d0/d7/d14/d57/dcd 0 2024-09-13T22:56:16.277 INFO:tasks.workunit.client.0.smithi002.stdout:8/584: creat d3/dc/d51/fb2 x:0 0 0 2024-09-13T22:56:16.279 INFO:tasks.workunit.client.1.smithi047.stdout:2/705: dread d1/df/d1d/d20/d37/d7b/f6c [0,4194304] 0 2024-09-13T22:56:16.281 INFO:tasks.workunit.client.1.smithi047.stdout:3/687: dwrite d0/d3/d4/d16/d32/d42/f9e [0,4194304] 0 2024-09-13T22:56:16.282 INFO:tasks.workunit.client.0.smithi002.stdout:7/533: symlink d8/d10/d11/d13/d26/l9c 0 2024-09-13T22:56:16.284 INFO:tasks.workunit.client.1.smithi047.stdout:9/646: dread d1/dc/d14/dd/d54/d50/d5b/d9e/f83 [0,4194304] 0 2024-09-13T22:56:16.287 INFO:tasks.workunit.client.1.smithi047.stdout:0/704: dwrite d1/f4 [0,4194304] 0 2024-09-13T22:56:16.289 INFO:tasks.workunit.client.1.smithi047.stdout:4/794: creat dc/d29/d6c/f113 x:0 0 0 2024-09-13T22:56:16.290 INFO:tasks.workunit.client.1.smithi047.stdout:8/623: dread d8/f2b [0,4194304] 0 2024-09-13T22:56:16.295 INFO:tasks.workunit.client.1.smithi047.stdout:2/706: fsync d1/df/d1d/d2e/fa7 0 2024-09-13T22:56:16.295 INFO:tasks.workunit.client.0.smithi002.stdout:9/639: truncate d8/d10/d1c/d3d/f7e 3476362 0 2024-09-13T22:56:16.299 INFO:tasks.workunit.client.0.smithi002.stdout:0/608: rename d1/d2/d81/lc1 to d1/d4/ld6 0 2024-09-13T22:56:16.304 INFO:tasks.workunit.client.0.smithi002.stdout:7/534: write d8/d10/d11/d13/d2e/d3c/f91 [47721,44644] 0 2024-09-13T22:56:16.307 INFO:tasks.workunit.client.1.smithi047.stdout:1/740: mkdir d0/d7/dd3 0 2024-09-13T22:56:16.309 INFO:tasks.workunit.client.0.smithi002.stdout:5/614: creat d1/d2a/d69/db8/fdc x:0 0 0 2024-09-13T22:56:16.309 INFO:tasks.workunit.client.0.smithi002.stdout:5/615: stat d1 0 2024-09-13T22:56:16.309 INFO:tasks.workunit.client.1.smithi047.stdout:1/741: read d0/f5 [2992123,72265] 0 2024-09-13T22:56:16.310 INFO:tasks.workunit.client.1.smithi047.stdout:1/742: readlink d0/d7/d10/lb9 0 2024-09-13T22:56:16.312 INFO:tasks.workunit.client.1.smithi047.stdout:8/624: dwrite d8/d3f/d8c/fab [4194304,4194304] 0 2024-09-13T22:56:16.312 INFO:tasks.workunit.client.1.smithi047.stdout:1/743: fsync d0/d7/d14/d57/db6/fc9 0 2024-09-13T22:56:16.314 INFO:tasks.workunit.client.1.smithi047.stdout:8/625: dread - d8/d64/d4e/d4d/d8f/d91/d78/fcc zero size 2024-09-13T22:56:16.315 INFO:tasks.workunit.client.0.smithi002.stdout:3/667: creat d9/d7e/ff5 x:0 0 0 2024-09-13T22:56:16.317 INFO:tasks.workunit.client.0.smithi002.stdout:3/668: dread d9/d3b/f67 [0,4194304] 0 2024-09-13T22:56:16.317 INFO:tasks.workunit.client.1.smithi047.stdout:8/626: chown d8/d64/d4e/d4d/d8f/d91/d38/d7a/ca4 11693 1 2024-09-13T22:56:16.317 INFO:tasks.workunit.client.1.smithi047.stdout:9/647: creat d1/dc/d14/dd/dba/fce x:0 0 0 2024-09-13T22:56:16.319 INFO:tasks.workunit.client.0.smithi002.stdout:1/636: rename d1/d13/d30/d31/d3d/lb8 to d1/d13/d1d/d34/da7/ld6 0 2024-09-13T22:56:16.322 INFO:tasks.workunit.client.0.smithi002.stdout:0/609: unlink d1/d4/d75/d31/d32/dbb/fbd 0 2024-09-13T22:56:16.324 INFO:tasks.workunit.client.1.smithi047.stdout:3/688: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/f30 [2323427,45230] 0 2024-09-13T22:56:16.325 INFO:tasks.workunit.client.0.smithi002.stdout:8/585: truncate d3/dc/d18/d6f/f90 2312035 0 2024-09-13T22:56:16.329 INFO:tasks.workunit.client.0.smithi002.stdout:2/593: link d1/d7/d8/d4f/cbe d1/d7/d35/d3e/d59/d6b/cc3 0 2024-09-13T22:56:16.331 INFO:tasks.workunit.client.1.smithi047.stdout:1/744: symlink d0/d7/d13/d5d/ld4 0 2024-09-13T22:56:16.336 INFO:tasks.workunit.client.1.smithi047.stdout:8/627: read d8/d64/d4e/d4d/d8f/d91/f3d [3461071,27852] 0 2024-09-13T22:56:16.337 INFO:tasks.workunit.client.0.smithi002.stdout:9/640: mkdir d8/d10/d1c/dd6 0 2024-09-13T22:56:16.339 INFO:tasks.workunit.client.1.smithi047.stdout:2/707: dwrite d1/df/d1d/d20/f42 [0,4194304] 0 2024-09-13T22:56:16.340 INFO:tasks.workunit.client.0.smithi002.stdout:3/669: unlink d9/d15/d26/f32 0 2024-09-13T22:56:16.342 INFO:tasks.workunit.client.1.smithi047.stdout:4/795: creat dc/d29/f114 x:0 0 0 2024-09-13T22:56:16.343 INFO:tasks.workunit.client.1.smithi047.stdout:4/796: chown dc/de/f18 7684790 1 2024-09-13T22:56:16.345 INFO:tasks.workunit.client.1.smithi047.stdout:4/797: write dc/de/d23/d40/d7b/dab/fd3 [136766,37419] 0 2024-09-13T22:56:16.347 INFO:tasks.workunit.client.1.smithi047.stdout:1/745: unlink d0/d7/d13/d2d/c63 0 2024-09-13T22:56:16.349 INFO:tasks.workunit.client.0.smithi002.stdout:8/586: readlink d3/dc/d16/d89/la5 0 2024-09-13T22:56:16.351 INFO:tasks.workunit.client.1.smithi047.stdout:2/708: rename d1/de/d17/f90 to d1/df/d1d/da9/fec 0 2024-09-13T22:56:16.352 INFO:tasks.workunit.client.1.smithi047.stdout:8/628: dread d8/d64/d4e/d4d/d8f/d91/f3d [0,4194304] 0 2024-09-13T22:56:16.352 INFO:tasks.workunit.client.0.smithi002.stdout:2/594: creat d1/d7/d41/fc4 x:0 0 0 2024-09-13T22:56:16.355 INFO:tasks.workunit.client.0.smithi002.stdout:6/605: getdents d12/d17/d34 0 2024-09-13T22:56:16.356 INFO:tasks.workunit.client.1.smithi047.stdout:1/746: dwrite d0/d7/d13/d5d/f6a [0,4194304] 0 2024-09-13T22:56:16.359 INFO:tasks.workunit.client.0.smithi002.stdout:4/560: sync 2024-09-13T22:56:16.361 INFO:tasks.workunit.client.1.smithi047.stdout:2/709: readlink d1/df/l6b 0 2024-09-13T22:56:16.362 INFO:tasks.workunit.client.1.smithi047.stdout:1/747: dread d0/d7/d14/d57/f9e [0,4194304] 0 2024-09-13T22:56:16.363 INFO:tasks.workunit.client.0.smithi002.stdout:1/637: symlink d1/d13/d52/dcf/ld7 0 2024-09-13T22:56:16.364 INFO:tasks.workunit.client.0.smithi002.stdout:0/610: mknod d1/d4/d75/dca/cd7 0 2024-09-13T22:56:16.365 INFO:tasks.workunit.client.0.smithi002.stdout:0/611: chown d1/d7e/la1 337977 1 2024-09-13T22:56:16.370 INFO:tasks.workunit.client.0.smithi002.stdout:2/595: symlink d1/d32/d37/lc5 0 2024-09-13T22:56:16.372 INFO:tasks.workunit.client.0.smithi002.stdout:5/616: link d1/l1b d1/d2a/d5a/ldd 0 2024-09-13T22:56:16.375 INFO:tasks.workunit.client.0.smithi002.stdout:6/606: creat d12/d17/d34/d39/d8a/fc2 x:0 0 0 2024-09-13T22:56:16.376 INFO:tasks.workunit.client.1.smithi047.stdout:9/648: getdents d1/dc/d14/dd/d54/d50/d5b 0 2024-09-13T22:56:16.377 INFO:tasks.workunit.client.0.smithi002.stdout:3/670: creat d9/d7e/dce/ff6 x:0 0 0 2024-09-13T22:56:16.378 INFO:tasks.workunit.client.0.smithi002.stdout:6/607: dread d12/d17/d28/d67/d6b/f9d [0,4194304] 0 2024-09-13T22:56:16.379 INFO:tasks.workunit.client.1.smithi047.stdout:3/689: getdents d0/d3/d4/d16/d32/d42/d79 0 2024-09-13T22:56:16.379 INFO:tasks.workunit.client.1.smithi047.stdout:3/690: chown d0/d3/d4/d16/d2c/de/d1f/l21 10 1 2024-09-13T22:56:16.380 INFO:tasks.workunit.client.0.smithi002.stdout:4/561: creat d3/d40/d45/fa9 x:0 0 0 2024-09-13T22:56:16.383 INFO:tasks.workunit.client.0.smithi002.stdout:7/535: rename d8/d10/d11/d13/d2e/d50/d85/f98 to d8/d10/d11/d13/d2e/f9d 0 2024-09-13T22:56:16.384 INFO:tasks.workunit.client.0.smithi002.stdout:7/536: readlink d8/l17 0 2024-09-13T22:56:16.384 INFO:tasks.workunit.client.0.smithi002.stdout:6/608: dwrite d12/f63 [0,4194304] 0 2024-09-13T22:56:16.385 INFO:tasks.workunit.client.0.smithi002.stdout:8/587: creat d3/dc/d16/d4b/fb3 x:0 0 0 2024-09-13T22:56:16.386 INFO:tasks.workunit.client.1.smithi047.stdout:8/629: dwrite d8/d3f/d8c/da6/faf [0,4194304] 0 2024-09-13T22:56:16.386 INFO:tasks.workunit.client.0.smithi002.stdout:5/617: mknod d1/d57/cde 0 2024-09-13T22:56:16.387 INFO:tasks.workunit.client.0.smithi002.stdout:6/609: chown d12/d17/d34/d39/d8a/fa7 352156185 1 2024-09-13T22:56:16.389 INFO:tasks.workunit.client.0.smithi002.stdout:4/562: dwrite d3/d14/d85/fa5 [0,4194304] 0 2024-09-13T22:56:16.392 INFO:tasks.workunit.client.0.smithi002.stdout:6/610: chown d12/d17/d34/c54 0 1 2024-09-13T22:56:16.392 INFO:tasks.workunit.client.0.smithi002.stdout:3/671: mkdir d9/d15/d36/d4e/d5e/dae/d89/df7 0 2024-09-13T22:56:16.392 INFO:tasks.workunit.client.0.smithi002.stdout:6/611: readlink d12/d17/d28/d67/d6b/l53 0 2024-09-13T22:56:16.392 INFO:tasks.workunit.client.0.smithi002.stdout:1/638: mkdir d1/d13/d30/d73/da1/d9d/dbd/dd8 0 2024-09-13T22:56:16.395 INFO:tasks.workunit.client.0.smithi002.stdout:6/612: truncate d12/f5c 951734 0 2024-09-13T22:56:16.397 INFO:tasks.workunit.client.0.smithi002.stdout:7/537: creat d8/d10/d11/d13/d26/d38/f9e x:0 0 0 2024-09-13T22:56:16.400 INFO:tasks.workunit.client.0.smithi002.stdout:8/588: mkdir d3/dc/d16/d60/db4 0 2024-09-13T22:56:16.403 INFO:tasks.workunit.client.0.smithi002.stdout:3/672: mknod d9/d15/d36/d4e/d5e/cf8 0 2024-09-13T22:56:16.404 INFO:tasks.workunit.client.0.smithi002.stdout:3/673: chown d9/d15/d35/fb1 473609 1 2024-09-13T22:56:16.404 INFO:tasks.workunit.client.0.smithi002.stdout:4/563: symlink d3/d14/d29/d2a/da6/d69/d7e/laa 0 2024-09-13T22:56:16.406 INFO:tasks.workunit.client.0.smithi002.stdout:1/639: fsync d1/d13/d30/d73/fbb 0 2024-09-13T22:56:16.408 INFO:tasks.workunit.client.0.smithi002.stdout:6/613: mkdir d12/d17/d28/d67/d9f/dc3 0 2024-09-13T22:56:16.409 INFO:tasks.workunit.client.0.smithi002.stdout:7/538: creat d8/d10/d11/f9f x:0 0 0 2024-09-13T22:56:16.410 INFO:tasks.workunit.client.0.smithi002.stdout:3/674: dwrite d9/d15/fd6 [0,4194304] 0 2024-09-13T22:56:16.411 INFO:tasks.workunit.client.0.smithi002.stdout:7/539: dread - d8/d10/d11/d13/d2e/f9d zero size 2024-09-13T22:56:16.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:16 smithi047 ceph-mon[34560]: pgmap v18: 65 pgs: 65 active+clean; 2.2 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 68 MiB/s rd, 193 MiB/s wr, 387 op/s 2024-09-13T22:56:16.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:16 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:56:16.417 INFO:tasks.workunit.client.0.smithi002.stdout:9/641: rename d8/d1e/f27 to d8/fd7 0 2024-09-13T22:56:16.417 INFO:tasks.workunit.client.0.smithi002.stdout:9/642: fsync d8/d10/d1c/d68/faf 0 2024-09-13T22:56:16.418 INFO:tasks.workunit.client.0.smithi002.stdout:9/643: stat d8/d91/d96/d87/da5 0 2024-09-13T22:56:16.419 INFO:tasks.workunit.client.0.smithi002.stdout:1/640: read d1/f15 [848999,31956] 0 2024-09-13T22:56:16.423 INFO:tasks.workunit.client.0.smithi002.stdout:6/614: creat d12/d17/d34/d4b/fc4 x:0 0 0 2024-09-13T22:56:16.424 INFO:tasks.workunit.client.0.smithi002.stdout:8/589: creat d3/dc/d16/d97/fb5 x:0 0 0 2024-09-13T22:56:16.424 INFO:tasks.workunit.client.0.smithi002.stdout:8/590: stat d3/fa 0 2024-09-13T22:56:16.429 INFO:tasks.workunit.client.0.smithi002.stdout:3/675: creat d9/d15/d46/ff9 x:0 0 0 2024-09-13T22:56:16.430 INFO:tasks.workunit.client.0.smithi002.stdout:4/564: mknod d3/d14/d29/d2a/cab 0 2024-09-13T22:56:16.435 INFO:tasks.workunit.client.0.smithi002.stdout:0/612: rename d1/d2/f6d to d1/d2/d6c/fd8 0 2024-09-13T22:56:16.435 INFO:tasks.workunit.client.0.smithi002.stdout:5/618: write d1/d2a/d6b/f71 [985950,70581] 0 2024-09-13T22:56:16.436 INFO:tasks.workunit.client.0.smithi002.stdout:9/644: creat d8/d91/fd8 x:0 0 0 2024-09-13T22:56:16.437 INFO:tasks.workunit.client.0.smithi002.stdout:5/619: chown d1/d2a/d6b/d88/f5d 9838410 1 2024-09-13T22:56:16.438 INFO:tasks.workunit.client.0.smithi002.stdout:9/645: truncate d8/d2c/dbc/dc8/fc0 1798354 0 2024-09-13T22:56:16.439 INFO:tasks.workunit.client.0.smithi002.stdout:1/641: unlink d1/f24 0 2024-09-13T22:56:16.440 INFO:tasks.workunit.client.0.smithi002.stdout:1/642: stat d1/d13/d1d/d34/l61 0 2024-09-13T22:56:16.443 INFO:tasks.workunit.client.0.smithi002.stdout:4/565: dread d3/d14/f75 [0,4194304] 0 2024-09-13T22:56:16.448 INFO:tasks.workunit.client.0.smithi002.stdout:2/596: rename d1/d7/d35/d3e/d59/d6b/fb7 to d1/d7/d52/daa/fc6 0 2024-09-13T22:56:16.450 INFO:tasks.workunit.client.0.smithi002.stdout:0/613: mknod d1/d2/d81/d8f/cd9 0 2024-09-13T22:56:16.457 INFO:tasks.workunit.client.1.smithi047.stdout:2/710: mkdir d1/df/d1d/d20/d37/d7b/db6/de9/ded 0 2024-09-13T22:56:16.458 INFO:tasks.workunit.client.0.smithi002.stdout:4/566: creat d3/fac x:0 0 0 2024-09-13T22:56:16.464 INFO:tasks.workunit.client.0.smithi002.stdout:7/540: rename d8/d10/d11/d13/d26/d4c/d81/l5b to d8/d10/d39/d60/la0 0 2024-09-13T22:56:16.467 INFO:tasks.workunit.client.1.smithi047.stdout:4/798: getdents dc/de/d17/d70 0 2024-09-13T22:56:16.469 INFO:tasks.workunit.client.0.smithi002.stdout:0/614: unlink d1/d4/d75/d31/d32/f50 0 2024-09-13T22:56:16.471 INFO:tasks.workunit.client.0.smithi002.stdout:8/591: write d3/d21/d57/f55 [24675,121730] 0 2024-09-13T22:56:16.478 INFO:tasks.workunit.client.0.smithi002.stdout:6/615: rename d12/d17/d34/f5a to d12/d17/d34/d4b/fc5 0 2024-09-13T22:56:16.481 INFO:tasks.workunit.client.0.smithi002.stdout:5/620: write d1/d10/f35 [515191,25498] 0 2024-09-13T22:56:16.482 INFO:tasks.workunit.client.1.smithi047.stdout:2/711: mknod d1/cee 0 2024-09-13T22:56:16.484 INFO:tasks.workunit.client.1.smithi047.stdout:1/748: getdents d0/d7/d13/d5d/d89 0 2024-09-13T22:56:16.485 INFO:tasks.workunit.client.0.smithi002.stdout:0/615: mkdir d1/d2/d81/d8f/dda 0 2024-09-13T22:56:16.486 INFO:tasks.workunit.client.1.smithi047.stdout:3/691: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/f90 [1412330,52334] 0 2024-09-13T22:56:16.487 INFO:tasks.workunit.client.0.smithi002.stdout:9/646: dwrite d8/d10/d42/f76 [0,4194304] 0 2024-09-13T22:56:16.487 INFO:tasks.workunit.client.0.smithi002.stdout:8/592: readlink d3/dc/d18/d2e/d94/laf 0 2024-09-13T22:56:16.489 INFO:tasks.workunit.client.0.smithi002.stdout:9/647: readlink d8/d10/db1/l8c 0 2024-09-13T22:56:16.489 INFO:tasks.workunit.client.0.smithi002.stdout:8/593: chown d3/dc/da4 1 1 2024-09-13T22:56:16.493 INFO:tasks.workunit.client.1.smithi047.stdout:2/712: unlink d1/df/d1d/d20/d37/d85/fb2 0 2024-09-13T22:56:16.496 INFO:tasks.workunit.client.1.smithi047.stdout:1/749: symlink d0/d7/d13/d5d/d89/ld5 0 2024-09-13T22:56:16.499 INFO:tasks.workunit.client.1.smithi047.stdout:1/750: write d0/d7/db/f3a [1367850,13658] 0 2024-09-13T22:56:16.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:16 smithi002 ceph-mon[27637]: pgmap v18: 65 pgs: 65 active+clean; 2.2 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 68 MiB/s rd, 193 MiB/s wr, 387 op/s 2024-09-13T22:56:16.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:16 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:56:16.500 INFO:tasks.workunit.client.1.smithi047.stdout:9/649: truncate d1/dc/fbd 1268271 0 2024-09-13T22:56:16.501 INFO:tasks.workunit.client.1.smithi047.stdout:1/751: readlink d0/d7/d13/d5d/ld4 0 2024-09-13T22:56:16.508 INFO:tasks.workunit.client.0.smithi002.stdout:6/616: unlink d12/d17/d2a/f6f 0 2024-09-13T22:56:16.508 INFO:tasks.workunit.client.0.smithi002.stdout:7/541: mkdir d8/d10/d11/d13/d2e/d3c/d3e/da1 0 2024-09-13T22:56:16.508 INFO:tasks.workunit.client.1.smithi047.stdout:8/630: dwrite d8/d64/d4e/d4d/d8f/d91/fc2 [0,4194304] 0 2024-09-13T22:56:16.508 INFO:tasks.workunit.client.1.smithi047.stdout:9/650: write d1/dc/d14/dd/d54/fbf [278259,81302] 0 2024-09-13T22:56:16.509 INFO:tasks.workunit.client.1.smithi047.stdout:3/692: mkdir d0/d3/d4/d91/dd5 0 2024-09-13T22:56:16.512 INFO:tasks.workunit.client.1.smithi047.stdout:4/799: getdents dc/d29/d6c 0 2024-09-13T22:56:16.515 INFO:tasks.workunit.client.1.smithi047.stdout:1/752: dwrite d0/d7/db/fb8 [0,4194304] 0 2024-09-13T22:56:16.516 INFO:tasks.workunit.client.0.smithi002.stdout:4/567: dread - d3/d40/f8b zero size 2024-09-13T22:56:16.517 INFO:tasks.workunit.client.1.smithi047.stdout:4/800: dread dc/de/d23/f81 [0,4194304] 0 2024-09-13T22:56:16.518 INFO:tasks.workunit.client.1.smithi047.stdout:4/801: chown dc/de/d23/d40/d7b/d90/fe3 47 1 2024-09-13T22:56:16.519 INFO:tasks.workunit.client.1.smithi047.stdout:3/693: rmdir d0/d3/d4 39 2024-09-13T22:56:16.520 INFO:tasks.workunit.client.1.smithi047.stdout:4/802: chown dc/de/d23/d40/d7b/lbd 33114 1 2024-09-13T22:56:16.520 INFO:tasks.workunit.client.1.smithi047.stdout:4/803: readlink dc/de/d23/l34 0 2024-09-13T22:56:16.521 INFO:tasks.workunit.client.0.smithi002.stdout:8/594: creat d3/d27/fb6 x:0 0 0 2024-09-13T22:56:16.524 INFO:tasks.workunit.client.1.smithi047.stdout:2/713: mkdir d1/df/d35/d8b/dd1/def 0 2024-09-13T22:56:16.524 INFO:tasks.workunit.client.1.smithi047.stdout:8/631: dread d8/d64/f47 [0,4194304] 0 2024-09-13T22:56:16.525 INFO:tasks.workunit.client.1.smithi047.stdout:9/651: chown d1/dc/d14/dd/d54/d4e/d51/d79 208 1 2024-09-13T22:56:16.525 INFO:tasks.workunit.client.1.smithi047.stdout:8/632: chown d8/d64/d4e/d4d/d8f/d91/d78 622 1 2024-09-13T22:56:16.532 INFO:tasks.workunit.client.1.smithi047.stdout:2/714: dwrite d1/df/d1d/da9/fdc [0,4194304] 0 2024-09-13T22:56:16.536 INFO:tasks.workunit.client.0.smithi002.stdout:6/617: mkdir d12/d17/d28/d67/d6b/daa/dc6 0 2024-09-13T22:56:16.539 INFO:tasks.workunit.client.0.smithi002.stdout:7/542: mkdir d8/d10/d11/da2 0 2024-09-13T22:56:16.539 INFO:tasks.workunit.client.1.smithi047.stdout:6/689: sync 2024-09-13T22:56:16.540 INFO:tasks.workunit.client.1.smithi047.stdout:3/694: chown d0/d3/d4/l7 0 1 2024-09-13T22:56:16.540 INFO:tasks.workunit.client.0.smithi002.stdout:7/543: write d8/d10/d39/f9b [1136487,55319] 0 2024-09-13T22:56:16.541 INFO:tasks.workunit.client.1.smithi047.stdout:3/695: chown d0/d3/d4/d16/d1c/c3c 784406 1 2024-09-13T22:56:16.542 INFO:tasks.workunit.client.0.smithi002.stdout:2/597: getdents d1 0 2024-09-13T22:56:16.542 INFO:tasks.workunit.client.1.smithi047.stdout:3/696: read - d0/d3/d4/d16/d32/d42/d79/d9c/dad/fcf zero size 2024-09-13T22:56:16.543 INFO:tasks.workunit.client.0.smithi002.stdout:2/598: chown d1/d4d/d8b 23069 1 2024-09-13T22:56:16.543 INFO:tasks.workunit.client.1.smithi047.stdout:4/804: dread - dc/d29/d4d/fcf zero size 2024-09-13T22:56:16.548 INFO:tasks.workunit.client.0.smithi002.stdout:9/648: fdatasync d8/d1e/f34 0 2024-09-13T22:56:16.550 INFO:tasks.workunit.client.0.smithi002.stdout:3/676: getdents d9/d15/d36/d4e/d5e/dae 0 2024-09-13T22:56:16.552 INFO:tasks.workunit.client.0.smithi002.stdout:1/643: rename d1/d13/d1d/l64 to d1/d13/d21/ld9 0 2024-09-13T22:56:16.555 INFO:tasks.workunit.client.1.smithi047.stdout:1/753: mknod d0/d7/d14/cd6 0 2024-09-13T22:56:16.556 INFO:tasks.workunit.client.1.smithi047.stdout:1/754: readlink d0/d7/d14/d57/d62/d8a/la9 0 2024-09-13T22:56:16.560 INFO:tasks.workunit.client.0.smithi002.stdout:2/599: mknod d1/d32/d37/d79/cc7 0 2024-09-13T22:56:16.561 INFO:tasks.workunit.client.1.smithi047.stdout:3/697: creat d0/d3/d4/d16/d32/d42/fd6 x:0 0 0 2024-09-13T22:56:16.561 INFO:tasks.workunit.client.1.smithi047.stdout:9/652: symlink d1/dc/d18/d82/lcf 0 2024-09-13T22:56:16.563 INFO:tasks.workunit.client.1.smithi047.stdout:1/755: dread d0/d7/db/fb8 [0,4194304] 0 2024-09-13T22:56:16.564 INFO:tasks.workunit.client.1.smithi047.stdout:3/698: truncate d0/d3/d5e/fb9 991960 0 2024-09-13T22:56:16.564 INFO:tasks.workunit.client.1.smithi047.stdout:2/715: dwrite d1/df/d1d/d20/d37/fb1 [0,4194304] 0 2024-09-13T22:56:16.565 INFO:tasks.workunit.client.1.smithi047.stdout:8/633: mkdir d8/d6b/da9/dc3/ddc 0 2024-09-13T22:56:16.565 INFO:tasks.workunit.client.1.smithi047.stdout:8/634: chown d8 0 1 2024-09-13T22:56:16.566 INFO:tasks.workunit.client.0.smithi002.stdout:8/595: mkdir d3/dc/d16/d2f/db7 0 2024-09-13T22:56:16.567 INFO:tasks.workunit.client.0.smithi002.stdout:3/677: symlink d9/df/lfa 0 2024-09-13T22:56:16.569 INFO:tasks.workunit.client.1.smithi047.stdout:6/690: mkdir d3/d11/d2b/d4c/de2 0 2024-09-13T22:56:16.571 INFO:tasks.workunit.client.1.smithi047.stdout:8/635: readlink d8/d64/d4e/d4d/d8f/d91/d38/d7a/lb4 0 2024-09-13T22:56:16.571 INFO:tasks.workunit.client.0.smithi002.stdout:5/621: rename d1/d2a/d6b/d88/d45/d4f/d78/d8b/fc0 to d1/d57/fdf 0 2024-09-13T22:56:16.577 INFO:tasks.workunit.client.1.smithi047.stdout:4/805: symlink dc/de/d23/d40/d7b/dab/dae/d102/l115 0 2024-09-13T22:56:16.577 INFO:tasks.workunit.client.1.smithi047.stdout:2/716: dwrite d1/df/d1d/d20/f42 [4194304,4194304] 0 2024-09-13T22:56:16.578 INFO:tasks.workunit.client.0.smithi002.stdout:7/544: mknod d8/d10/d11/d13/d2e/ca3 0 2024-09-13T22:56:16.579 INFO:tasks.workunit.client.1.smithi047.stdout:9/653: fsync d1/dc/d14/dd/d54/d8d/fc0 0 2024-09-13T22:56:16.581 INFO:tasks.workunit.client.1.smithi047.stdout:9/654: read d1/f5 [4217463,104527] 0 2024-09-13T22:56:16.582 INFO:tasks.workunit.client.1.smithi047.stdout:1/756: mknod d0/d7/d13/d8c/cd7 0 2024-09-13T22:56:16.582 INFO:tasks.workunit.client.1.smithi047.stdout:3/699: dread d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d85/fa0 [0,4194304] 0 2024-09-13T22:56:16.588 INFO:tasks.workunit.client.0.smithi002.stdout:8/596: mknod d3/dc/d16/d2f/d83/d85/cb8 0 2024-09-13T22:56:16.590 INFO:tasks.workunit.client.1.smithi047.stdout:1/757: dwrite d0/d7/d14/d57/d62/fa3 [0,4194304] 0 2024-09-13T22:56:16.595 INFO:tasks.workunit.client.1.smithi047.stdout:6/691: dwrite d3/d11/f97 [0,4194304] 0 2024-09-13T22:56:16.596 INFO:tasks.workunit.client.0.smithi002.stdout:0/616: rename d1/d4/d75/d31/d32/dbb/fd5 to d1/d4/d75/d76/fdb 0 2024-09-13T22:56:16.598 INFO:tasks.workunit.client.0.smithi002.stdout:5/622: mknod d1/d2a/d6b/d88/d55/d56/d81/ce0 0 2024-09-13T22:56:16.599 INFO:tasks.workunit.client.1.smithi047.stdout:4/806: read - dc/de/d23/d40/f8c zero size 2024-09-13T22:56:16.600 INFO:tasks.workunit.client.0.smithi002.stdout:1/644: truncate d1/d13/d30/d31/d3b/f4b 1665497 0 2024-09-13T22:56:16.602 INFO:tasks.workunit.client.0.smithi002.stdout:1/645: stat d1/d13/d30/d31/d3d/db6/fd0 0 2024-09-13T22:56:16.603 INFO:tasks.workunit.client.0.smithi002.stdout:6/618: mknod d12/d17/d34/cc7 0 2024-09-13T22:56:16.606 INFO:tasks.workunit.client.0.smithi002.stdout:3/678: write d9/df/f6d [55525,75215] 0 2024-09-13T22:56:16.606 INFO:tasks.workunit.client.0.smithi002.stdout:2/600: fdatasync d1/d4a/fb8 0 2024-09-13T22:56:16.608 INFO:tasks.workunit.client.1.smithi047.stdout:9/655: creat d1/dc/d14/dd/d54/d50/fd0 x:0 0 0 2024-09-13T22:56:16.610 INFO:tasks.workunit.client.1.smithi047.stdout:3/700: rmdir d0/d3/d4/d16/d2c/de/d3d 39 2024-09-13T22:56:16.614 INFO:tasks.workunit.client.1.smithi047.stdout:2/717: write d1/df/d26/f30 [1907441,128423] 0 2024-09-13T22:56:16.619 INFO:tasks.workunit.client.0.smithi002.stdout:9/649: rename d8/d2c/d50/c8e to d8/d10/d1c/d68/d74/cd9 0 2024-09-13T22:56:16.621 INFO:tasks.workunit.client.1.smithi047.stdout:6/692: rename d3/d11/d2b/d1c/f1e to d3/d77/fe3 0 2024-09-13T22:56:16.621 INFO:tasks.workunit.client.0.smithi002.stdout:8/597: write d3/f24 [882977,105561] 0 2024-09-13T22:56:16.622 INFO:tasks.workunit.client.1.smithi047.stdout:4/807: rmdir dc 39 2024-09-13T22:56:16.625 INFO:tasks.workunit.client.0.smithi002.stdout:6/619: rmdir d12/d17/d28/d67 39 2024-09-13T22:56:16.625 INFO:tasks.workunit.client.0.smithi002.stdout:7/545: symlink d8/la4 0 2024-09-13T22:56:16.626 INFO:tasks.workunit.client.1.smithi047.stdout:1/758: dwrite d0/d7/d13/d8c/fb4 [0,4194304] 0 2024-09-13T22:56:16.627 INFO:tasks.workunit.client.0.smithi002.stdout:7/546: write d8/d10/d11/d3a/f9a [833122,47622] 0 2024-09-13T22:56:16.627 INFO:tasks.workunit.client.1.smithi047.stdout:9/656: creat d1/d5f/d6a/fd1 x:0 0 0 2024-09-13T22:56:16.628 INFO:tasks.workunit.client.1.smithi047.stdout:2/718: mkdir d1/df/d1d/d20/d37/df0 0 2024-09-13T22:56:16.629 INFO:tasks.workunit.client.0.smithi002.stdout:2/601: fsync d1/f15 0 2024-09-13T22:56:16.632 INFO:tasks.workunit.client.1.smithi047.stdout:8/636: creat d8/d6b/fdd x:0 0 0 2024-09-13T22:56:16.635 INFO:tasks.workunit.client.0.smithi002.stdout:4/568: link d3/f9e d3/d14/fad 0 2024-09-13T22:56:16.639 INFO:tasks.workunit.client.1.smithi047.stdout:3/701: rename d0/d3/d4/d16/d2c/de/f10 to d0/d3/d4/d16/d2c/de/dcc/dd1/dc4/fd7 0 2024-09-13T22:56:16.639 INFO:tasks.workunit.client.1.smithi047.stdout:1/759: fsync d0/d7/d13/d8c/fb4 0 2024-09-13T22:56:16.642 INFO:tasks.workunit.client.1.smithi047.stdout:4/808: stat dc/de/d23/dc4/ddb/cff 0 2024-09-13T22:56:16.643 INFO:tasks.workunit.client.1.smithi047.stdout:9/657: fsync d1/dc/d18/f48 0 2024-09-13T22:56:16.643 INFO:tasks.workunit.client.1.smithi047.stdout:1/760: dread d0/d7/d75/f85 [0,4194304] 0 2024-09-13T22:56:16.645 INFO:tasks.workunit.client.0.smithi002.stdout:6/620: read d12/d17/f20 [7933,1384] 0 2024-09-13T22:56:16.646 INFO:tasks.workunit.client.0.smithi002.stdout:6/621: read - d12/d17/fbe zero size 2024-09-13T22:56:16.646 INFO:tasks.workunit.client.0.smithi002.stdout:6/622: fsync d12/f1c 0 2024-09-13T22:56:16.647 INFO:tasks.workunit.client.0.smithi002.stdout:7/547: mknod d8/d10/d11/d13/d26/d4c/ca5 0 2024-09-13T22:56:16.685 INFO:tasks.workunit.client.1.smithi047.stdout:5/597: sync 2024-09-13T22:56:16.688 INFO:tasks.workunit.client.0.smithi002.stdout:3/679: symlink d9/d15/d36/d4e/d5e/dae/d89/df7/lfb 0 2024-09-13T22:56:16.688 INFO:tasks.workunit.client.0.smithi002.stdout:3/680: dread - d9/d15/d36/d4e/fe2 zero size 2024-09-13T22:56:16.690 INFO:tasks.workunit.client.0.smithi002.stdout:3/681: write d9/d3b/f70 [21078,86538] 0 2024-09-13T22:56:16.691 INFO:tasks.workunit.client.0.smithi002.stdout:9/650: mkdir d8/d10/d1c/dd6/dda 0 2024-09-13T22:56:16.694 INFO:tasks.workunit.client.0.smithi002.stdout:1/646: sync 2024-09-13T22:56:16.696 INFO:tasks.workunit.client.0.smithi002.stdout:8/598: creat d3/d27/d39/d80/fb9 x:0 0 0 2024-09-13T22:56:16.702 INFO:tasks.workunit.client.0.smithi002.stdout:2/602: dread d1/d7/d8/f10 [0,4194304] 0 2024-09-13T22:56:16.702 INFO:tasks.workunit.client.0.smithi002.stdout:2/603: stat d1/d7/d8/d4f 0 2024-09-13T22:56:16.703 INFO:tasks.workunit.client.0.smithi002.stdout:2/604: stat d1/d7/d35/d3e/d59/d6b/d75/fa7 0 2024-09-13T22:56:16.703 INFO:tasks.workunit.client.0.smithi002.stdout:7/548: creat d8/d10/d39/d60/fa6 x:0 0 0 2024-09-13T22:56:16.704 INFO:tasks.workunit.client.0.smithi002.stdout:5/623: truncate d1/d2a/d6b/d88/d45/f97 492091 0 2024-09-13T22:56:16.705 INFO:tasks.workunit.client.0.smithi002.stdout:5/624: chown d1/d2a/d6b/d88 3 1 2024-09-13T22:56:16.709 INFO:tasks.workunit.client.0.smithi002.stdout:7/549: dwrite d8/d10/d11/d13/f79 [0,4194304] 0 2024-09-13T22:56:16.710 INFO:tasks.workunit.client.0.smithi002.stdout:0/617: getdents d1/d2/d81 0 2024-09-13T22:56:16.711 INFO:tasks.workunit.client.0.smithi002.stdout:0/618: chown d1/d4/f3e 18 1 2024-09-13T22:56:16.711 INFO:tasks.workunit.client.0.smithi002.stdout:1/647: creat d1/d13/d30/d31/d3b/fda x:0 0 0 2024-09-13T22:56:16.713 INFO:tasks.workunit.client.0.smithi002.stdout:8/599: mkdir d3/dc/d16/d2f/d83/d85/dba 0 2024-09-13T22:56:16.718 INFO:tasks.workunit.client.0.smithi002.stdout:3/682: write d9/d15/d26/f29 [3870307,80959] 0 2024-09-13T22:56:16.718 INFO:tasks.workunit.client.0.smithi002.stdout:7/550: dread d8/fb [0,4194304] 0 2024-09-13T22:56:16.719 INFO:tasks.workunit.client.0.smithi002.stdout:3/683: fdatasync d9/d15/d35/f9d 0 2024-09-13T22:56:16.725 INFO:tasks.workunit.client.0.smithi002.stdout:9/651: dwrite d8/d2c/f79 [0,4194304] 0 2024-09-13T22:56:16.726 INFO:tasks.workunit.client.0.smithi002.stdout:6/623: getdents d12/d17/d28/d67/d6b/daa/dc6 0 2024-09-13T22:56:16.727 INFO:tasks.workunit.client.0.smithi002.stdout:8/600: rmdir d3/dc/d16/d4b 39 2024-09-13T22:56:16.729 INFO:tasks.workunit.client.0.smithi002.stdout:2/605: mknod d1/d32/cc8 0 2024-09-13T22:56:16.731 INFO:tasks.workunit.client.0.smithi002.stdout:4/569: getdents d3/d14 0 2024-09-13T22:56:16.732 INFO:tasks.workunit.client.0.smithi002.stdout:2/606: chown d1/d32/d37/l57 3623169 1 2024-09-13T22:56:16.739 INFO:tasks.workunit.client.0.smithi002.stdout:5/625: truncate d1/d2a/d6b/d88/d55/f84 120769 0 2024-09-13T22:56:16.741 INFO:tasks.workunit.client.0.smithi002.stdout:9/652: symlink d8/d10/d42/ldb 0 2024-09-13T22:56:16.746 INFO:tasks.workunit.client.0.smithi002.stdout:8/601: dwrite d3/dc/d16/d60/fa0 [0,4194304] 0 2024-09-13T22:56:16.748 INFO:tasks.workunit.client.0.smithi002.stdout:1/648: dwrite d1/d13/d30/d31/d3b/f58 [0,4194304] 0 2024-09-13T22:56:16.750 INFO:tasks.workunit.client.0.smithi002.stdout:3/684: truncate d9/fb 495164 0 2024-09-13T22:56:16.754 INFO:tasks.workunit.client.0.smithi002.stdout:4/570: dwrite d3/d14/d29/d2a/f43 [0,4194304] 0 2024-09-13T22:56:16.754 INFO:tasks.workunit.client.0.smithi002.stdout:0/619: dwrite d1/d4/d75/f58 [0,4194304] 0 2024-09-13T22:56:16.773 INFO:tasks.workunit.client.0.smithi002.stdout:2/607: readlink d1/d7/d8/lc 0 2024-09-13T22:56:16.776 INFO:tasks.workunit.client.0.smithi002.stdout:9/653: write d8/d91/d96/f8b [739387,39311] 0 2024-09-13T22:56:16.776 INFO:tasks.workunit.client.0.smithi002.stdout:8/602: mkdir d3/dc/d16/d2f/d83/d95/dbb 0 2024-09-13T22:56:16.777 INFO:tasks.workunit.client.0.smithi002.stdout:8/603: stat d3/dc/d16/d60/f64 0 2024-09-13T22:56:16.777 INFO:tasks.workunit.client.0.smithi002.stdout:9/654: chown d8/d10/db1/l8c 0 1 2024-09-13T22:56:16.777 INFO:tasks.workunit.client.0.smithi002.stdout:1/649: creat d1/d13/d30/d31/d3d/db6/fdb x:0 0 0 2024-09-13T22:56:16.778 INFO:tasks.workunit.client.0.smithi002.stdout:3/685: rmdir d9/d15/d51 39 2024-09-13T22:56:16.779 INFO:tasks.workunit.client.0.smithi002.stdout:3/686: chown d9/d3b/d53 27522 1 2024-09-13T22:56:16.779 INFO:tasks.workunit.client.0.smithi002.stdout:0/620: dread - d1/d2/fa9 zero size 2024-09-13T22:56:16.779 INFO:tasks.workunit.client.0.smithi002.stdout:1/650: write d1/d13/d30/d31/d3d/db6/fd0 [887281,94300] 0 2024-09-13T22:56:16.780 INFO:tasks.workunit.client.0.smithi002.stdout:4/571: mknod d3/d14/d29/d2a/d30/cae 0 2024-09-13T22:56:16.783 INFO:tasks.workunit.client.0.smithi002.stdout:2/608: creat d1/d7/d41/d96/fc9 x:0 0 0 2024-09-13T22:56:16.784 INFO:tasks.workunit.client.0.smithi002.stdout:6/624: mknod d12/d17/d34/d4b/cc8 0 2024-09-13T22:56:16.786 INFO:tasks.workunit.client.0.smithi002.stdout:9/655: unlink d8/d10/db1/ca0 0 2024-09-13T22:56:16.788 INFO:tasks.workunit.client.0.smithi002.stdout:4/572: dread f1 [4194304,4194304] 0 2024-09-13T22:56:16.789 INFO:tasks.workunit.client.0.smithi002.stdout:8/604: dread d3/d27/f59 [0,4194304] 0 2024-09-13T22:56:16.789 INFO:tasks.workunit.client.0.smithi002.stdout:0/621: dwrite d1/d4/d75/d31/fcd [0,4194304] 0 2024-09-13T22:56:16.790 INFO:tasks.workunit.client.0.smithi002.stdout:4/573: stat d3/d14/d29/d2a/fa3 0 2024-09-13T22:56:16.791 INFO:tasks.workunit.client.0.smithi002.stdout:2/609: symlink d1/d7/d35/d78/lca 0 2024-09-13T22:56:16.792 INFO:tasks.workunit.client.0.smithi002.stdout:6/625: rmdir d12/d17/d28/d7d 39 2024-09-13T22:56:16.792 INFO:tasks.workunit.client.0.smithi002.stdout:4/574: chown d3/d14/d29/d2a/da6/d69/d7e 221864685 1 2024-09-13T22:56:16.795 INFO:tasks.workunit.client.0.smithi002.stdout:9/656: fdatasync d8/d10/d1c/d3d/f44 0 2024-09-13T22:56:16.796 INFO:tasks.workunit.client.0.smithi002.stdout:9/657: truncate d8/d10/d1c/fcf 262461 0 2024-09-13T22:56:16.797 INFO:tasks.workunit.client.0.smithi002.stdout:3/687: rename d9/d15/d51/c4c to d9/d15/d26/cfc 0 2024-09-13T22:56:16.803 INFO:tasks.workunit.client.1.smithi047.stdout:3/702: creat d0/d3/d4/d16/d73/fd8 x:0 0 0 2024-09-13T22:56:16.803 INFO:tasks.workunit.client.1.smithi047.stdout:4/809: creat dc/de/d17/d25/d4a/dc3/f116 x:0 0 0 2024-09-13T22:56:16.804 INFO:tasks.workunit.client.0.smithi002.stdout:6/626: dread f1 [0,4194304] 0 2024-09-13T22:56:16.804 INFO:tasks.workunit.client.0.smithi002.stdout:2/610: creat d1/d7/d35/d3e/d59/fcb x:0 0 0 2024-09-13T22:56:16.804 INFO:tasks.workunit.client.1.smithi047.stdout:8/637: creat d8/d64/d4e/d4d/d8f/d91/d38/dbe/fde x:0 0 0 2024-09-13T22:56:16.805 INFO:tasks.workunit.client.1.smithi047.stdout:2/719: dread d1/de/f33 [0,4194304] 0 2024-09-13T22:56:16.806 INFO:tasks.workunit.client.1.smithi047.stdout:6/693: creat d3/d11/d2b/fe4 x:0 0 0 2024-09-13T22:56:16.807 INFO:tasks.workunit.client.1.smithi047.stdout:3/703: write d0/d3/d4/d16/d2c/de/fb0 [5385780,102070] 0 2024-09-13T22:56:16.810 INFO:tasks.workunit.client.0.smithi002.stdout:9/658: read d8/d91/d96/fa2 [1846467,57463] 0 2024-09-13T22:56:16.813 INFO:tasks.workunit.client.1.smithi047.stdout:5/598: dread d19/d23/d4c/f67 [0,4194304] 0 2024-09-13T22:56:16.813 INFO:tasks.workunit.client.1.smithi047.stdout:4/810: dwrite dc/d29/d4c/ff8 [0,4194304] 0 2024-09-13T22:56:16.815 INFO:tasks.workunit.client.1.smithi047.stdout:5/599: stat d19/d34/d42/d5d/l72 0 2024-09-13T22:56:16.815 INFO:tasks.workunit.client.1.smithi047.stdout:2/720: dread d1/df/d1d/d20/d37/fb1 [0,4194304] 0 2024-09-13T22:56:16.815 INFO:tasks.workunit.client.1.smithi047.stdout:5/600: readlink l8 0 2024-09-13T22:56:16.816 INFO:tasks.workunit.client.0.smithi002.stdout:7/551: truncate d8/d10/d11/d13/d2e/d3c/f91 972746 0 2024-09-13T22:56:16.817 INFO:tasks.workunit.client.1.smithi047.stdout:5/601: truncate d19/d23/d2e/d41/d58/d77/fa6 1516773 0 2024-09-13T22:56:16.818 INFO:tasks.workunit.client.1.smithi047.stdout:8/638: mknod d8/d64/d4e/d4d/d8f/cdf 0 2024-09-13T22:56:16.820 INFO:tasks.workunit.client.0.smithi002.stdout:1/651: getdents d1/d13/d1d/d34 0 2024-09-13T22:56:16.823 INFO:tasks.workunit.client.0.smithi002.stdout:6/627: creat d12/d17/d4e/fc9 x:0 0 0 2024-09-13T22:56:16.823 INFO:tasks.workunit.client.1.smithi047.stdout:6/694: read d3/d11/d2b/d4c/fcc [885265,41851] 0 2024-09-13T22:56:16.825 INFO:tasks.workunit.client.1.smithi047.stdout:6/695: chown d3/d11/d2b/d1c/d4d/l51 1573786 1 2024-09-13T22:56:16.828 INFO:tasks.workunit.client.0.smithi002.stdout:9/659: dread d8/d10/d1c/d3d/fc2 [0,4194304] 0 2024-09-13T22:56:16.828 INFO:tasks.workunit.client.0.smithi002.stdout:2/611: rmdir d1/d7/d35/d3e/d5e 39 2024-09-13T22:56:16.829 INFO:tasks.workunit.client.0.smithi002.stdout:2/612: chown d1/d7/d8/d2c/f82 6802 1 2024-09-13T22:56:16.830 INFO:tasks.workunit.client.0.smithi002.stdout:3/688: creat d9/d15/d36/d4e/d5e/dae/d89/de5/de7/ffd x:0 0 0 2024-09-13T22:56:16.831 INFO:tasks.workunit.client.1.smithi047.stdout:1/761: link d0/d7/d14/d28/cc6 d0/d1d/daa/cd8 0 2024-09-13T22:56:16.833 INFO:tasks.workunit.client.0.smithi002.stdout:0/622: creat d1/d4/d75/d31/d32/fdc x:0 0 0 2024-09-13T22:56:16.836 INFO:tasks.workunit.client.0.smithi002.stdout:7/552: rmdir d8/d10/d11/d3a 39 2024-09-13T22:56:16.838 INFO:tasks.workunit.client.1.smithi047.stdout:5/602: truncate d19/d23/d2e/d41/d58/f97 871078 0 2024-09-13T22:56:16.838 INFO:tasks.workunit.client.0.smithi002.stdout:7/553: write d8/d10/d11/d13/d2e/d3c/f59 [1851154,10402] 0 2024-09-13T22:56:16.839 INFO:tasks.workunit.client.0.smithi002.stdout:1/652: mkdir d1/d13/d21/d40/ddc 0 2024-09-13T22:56:16.839 INFO:tasks.workunit.client.0.smithi002.stdout:0/623: dwrite d1/d4/da3/d7d/fb0 [0,4194304] 0 2024-09-13T22:56:16.841 INFO:tasks.workunit.client.0.smithi002.stdout:7/554: dread - d8/d10/d11/d13/d26/d38/f9e zero size 2024-09-13T22:56:16.842 INFO:tasks.workunit.client.1.smithi047.stdout:6/696: truncate d3/d11/d74/f85 611227 0 2024-09-13T22:56:16.847 INFO:tasks.workunit.client.1.smithi047.stdout:1/762: stat d0/d1d/daa/f7e 0 2024-09-13T22:56:16.848 INFO:tasks.workunit.client.0.smithi002.stdout:8/605: dwrite d3/d27/d39/f3b [0,4194304] 0 2024-09-13T22:56:16.850 INFO:tasks.workunit.client.1.smithi047.stdout:8/639: unlink d8/d64/d4e/d4d/l5e 0 2024-09-13T22:56:16.852 INFO:tasks.workunit.client.0.smithi002.stdout:5/626: sync 2024-09-13T22:56:16.856 INFO:tasks.workunit.client.1.smithi047.stdout:5/603: unlink d19/d34/d42/d5d/f9b 0 2024-09-13T22:56:16.856 INFO:tasks.workunit.client.1.smithi047.stdout:6/697: dread d3/d11/d2b/d4c/dc0/f75 [0,4194304] 0 2024-09-13T22:56:16.862 INFO:tasks.workunit.client.1.smithi047.stdout:3/704: rename d0/d3/d4/d91/c74 to d0/d3/cd9 0 2024-09-13T22:56:16.863 INFO:tasks.workunit.client.1.smithi047.stdout:3/705: stat d0/d3/d4/f3e 0 2024-09-13T22:56:16.865 INFO:tasks.workunit.client.1.smithi047.stdout:1/763: rmdir d0/d7/d87 39 2024-09-13T22:56:16.866 INFO:tasks.workunit.client.1.smithi047.stdout:8/640: dread d8/d64/d4e/f92 [0,4194304] 0 2024-09-13T22:56:16.868 INFO:tasks.workunit.client.0.smithi002.stdout:9/660: unlink d8/d10/l16 0 2024-09-13T22:56:16.872 INFO:tasks.workunit.client.0.smithi002.stdout:7/555: creat d8/d10/d11/d13/d26/d4c/fa7 x:0 0 0 2024-09-13T22:56:16.872 INFO:tasks.workunit.client.1.smithi047.stdout:1/764: dwrite d0/d7/d13/d5d/fc5 [0,4194304] 0 2024-09-13T22:56:16.873 INFO:tasks.workunit.client.0.smithi002.stdout:4/575: dwrite d3/d40/f76 [0,4194304] 0 2024-09-13T22:56:16.876 INFO:tasks.workunit.client.0.smithi002.stdout:6/628: write d12/d17/f3c [407884,99643] 0 2024-09-13T22:56:16.876 INFO:tasks.workunit.client.0.smithi002.stdout:0/624: dread d1/d2/d6c/d8b/f8c [0,4194304] 0 2024-09-13T22:56:16.876 INFO:tasks.workunit.client.1.smithi047.stdout:6/698: symlink d3/d11/d2b/d1c/dca/le5 0 2024-09-13T22:56:16.882 INFO:tasks.workunit.client.0.smithi002.stdout:0/625: dread d1/d4/da3/d7d/fb0 [0,4194304] 0 2024-09-13T22:56:16.884 INFO:tasks.workunit.client.1.smithi047.stdout:4/811: rename dc/de/d17/d25/d4a/dc3/f116 to dc/da3/f117 0 2024-09-13T22:56:16.887 INFO:tasks.workunit.client.0.smithi002.stdout:2/613: dwrite d1/d4a/f61 [0,4194304] 0 2024-09-13T22:56:16.888 INFO:tasks.workunit.client.1.smithi047.stdout:3/706: creat d0/d3/d4/d16/d2c/de/dcc/fda x:0 0 0 2024-09-13T22:56:16.890 INFO:tasks.workunit.client.0.smithi002.stdout:2/614: chown d1/d7/d35/d3e/d59/fcb 903284 1 2024-09-13T22:56:16.894 INFO:tasks.workunit.client.0.smithi002.stdout:9/661: chown d8/d2c/f58 1180 1 2024-09-13T22:56:16.894 INFO:tasks.workunit.client.0.smithi002.stdout:3/689: dwrite d9/f1a [0,4194304] 0 2024-09-13T22:56:16.896 INFO:tasks.workunit.client.0.smithi002.stdout:1/653: creat d1/d13/d30/d73/da1/d7d/dce/fdd x:0 0 0 2024-09-13T22:56:16.897 INFO:tasks.workunit.client.0.smithi002.stdout:7/556: symlink d8/d10/d11/d13/d26/d38/la8 0 2024-09-13T22:56:16.903 INFO:tasks.workunit.client.0.smithi002.stdout:6/629: write d12/d17/d28/d7d/fa2 [1887878,112725] 0 2024-09-13T22:56:16.904 INFO:tasks.workunit.client.1.smithi047.stdout:4/812: rename dc/de/d23/d40/d7b/f100 to dc/de/d23/dc4/dc8/dc9/f118 0 2024-09-13T22:56:16.905 INFO:tasks.workunit.client.0.smithi002.stdout:0/626: fsync d1/d4/d75/d31/f8d 0 2024-09-13T22:56:16.907 INFO:tasks.workunit.client.1.smithi047.stdout:4/813: truncate dc/de/d23/d40/d7b/dab/dae/dee/f10e 60788 0 2024-09-13T22:56:16.907 INFO:tasks.workunit.client.1.smithi047.stdout:8/641: write d8/d3f/d8c/fc1 [4395160,57383] 0 2024-09-13T22:56:16.907 INFO:tasks.workunit.client.0.smithi002.stdout:9/662: dwrite d8/d10/d61/fcb [0,4194304] 0 2024-09-13T22:56:16.910 INFO:tasks.workunit.client.1.smithi047.stdout:5/604: rmdir d19/dae 0 2024-09-13T22:56:16.910 INFO:tasks.workunit.client.0.smithi002.stdout:5/627: dwrite d1/d2a/d6b/d88/d55/f83 [0,4194304] 0 2024-09-13T22:56:16.916 INFO:tasks.workunit.client.0.smithi002.stdout:8/606: write d3/dc/d16/d2f/d83/d85/f98 [1315950,25485] 0 2024-09-13T22:56:16.917 INFO:tasks.workunit.client.0.smithi002.stdout:8/607: fsync d3/dc/d18/f2d 0 2024-09-13T22:56:16.918 INFO:tasks.workunit.client.0.smithi002.stdout:7/557: stat d8/d10/l90 0 2024-09-13T22:56:16.919 INFO:tasks.workunit.client.1.smithi047.stdout:3/707: truncate d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/f6b 1869438 0 2024-09-13T22:56:16.921 INFO:tasks.workunit.client.0.smithi002.stdout:4/576: dwrite d3/d14/f16 [0,4194304] 0 2024-09-13T22:56:16.922 INFO:tasks.workunit.client.0.smithi002.stdout:7/558: chown d8/d10/d11/d13/d26/d4c/d81/fd 1747812 1 2024-09-13T22:56:16.922 INFO:tasks.workunit.client.1.smithi047.stdout:8/642: mkdir d8/d64/d4e/d70/da7/de0 0 2024-09-13T22:56:16.926 INFO:tasks.workunit.client.1.smithi047.stdout:5/605: mkdir d19/d23/d2e/d41/d58/dbf 0 2024-09-13T22:56:16.926 INFO:tasks.workunit.client.1.smithi047.stdout:5/606: chown d19/d23/c7e 3974 1 2024-09-13T22:56:16.926 INFO:tasks.workunit.client.1.smithi047.stdout:5/607: chown d19/d34/d42/d5d/f86 113936 1 2024-09-13T22:56:16.928 INFO:tasks.workunit.client.1.smithi047.stdout:5/608: fdatasync d19/d23/d4c/fb3 0 2024-09-13T22:56:16.931 INFO:tasks.workunit.client.0.smithi002.stdout:7/559: dwrite d8/f27 [0,4194304] 0 2024-09-13T22:56:16.933 INFO:tasks.workunit.client.0.smithi002.stdout:2/615: dwrite d1/d7/d35/d3e/d59/f70 [0,4194304] 0 2024-09-13T22:56:16.934 INFO:tasks.workunit.client.1.smithi047.stdout:1/765: getdents d0/d7/d14/d57/d62/d8a 0 2024-09-13T22:56:16.935 INFO:tasks.workunit.client.1.smithi047.stdout:1/766: chown d0/d7/d13/c82 4 1 2024-09-13T22:56:16.935 INFO:tasks.workunit.client.0.smithi002.stdout:0/627: symlink d1/d2/d6c/d8b/ldd 0 2024-09-13T22:56:16.937 INFO:tasks.workunit.client.1.smithi047.stdout:4/814: creat dc/d29/f119 x:0 0 0 2024-09-13T22:56:16.938 INFO:tasks.workunit.client.1.smithi047.stdout:4/815: chown dc/d29/f119 0 1 2024-09-13T22:56:16.939 INFO:tasks.workunit.client.0.smithi002.stdout:2/616: dwrite d1/d4a/f6c [0,4194304] 0 2024-09-13T22:56:16.940 INFO:tasks.workunit.client.1.smithi047.stdout:5/609: symlink d19/d34/d42/d5d/d9d/lc0 0 2024-09-13T22:56:16.940 INFO:tasks.workunit.client.0.smithi002.stdout:2/617: fdatasync d1/f14 0 2024-09-13T22:56:16.944 INFO:tasks.workunit.client.1.smithi047.stdout:3/708: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/f4f [1414539,66317] 0 2024-09-13T22:56:16.946 INFO:tasks.workunit.client.1.smithi047.stdout:8/643: dread d8/f32 [0,4194304] 0 2024-09-13T22:56:16.947 INFO:tasks.workunit.client.0.smithi002.stdout:9/663: write d8/d10/d42/f4d [4427560,50397] 0 2024-09-13T22:56:16.948 INFO:tasks.workunit.client.0.smithi002.stdout:4/577: rmdir d3/d14/d85 39 2024-09-13T22:56:16.950 INFO:tasks.workunit.client.1.smithi047.stdout:1/767: creat d0/d7/d13/d5d/fd9 x:0 0 0 2024-09-13T22:56:16.951 INFO:tasks.workunit.client.1.smithi047.stdout:8/644: dread d8/f13 [0,4194304] 0 2024-09-13T22:56:16.955 INFO:tasks.workunit.client.1.smithi047.stdout:5/610: mkdir d19/d23/d2e/d41/dc1 0 2024-09-13T22:56:16.959 INFO:tasks.workunit.client.0.smithi002.stdout:6/630: mkdir d12/d17/d28/d67/dca 0 2024-09-13T22:56:16.959 INFO:tasks.workunit.client.0.smithi002.stdout:6/631: chown d12 68 1 2024-09-13T22:56:16.961 INFO:tasks.workunit.client.1.smithi047.stdout:1/768: creat d0/d7/d13/d2d/fda x:0 0 0 2024-09-13T22:56:16.962 INFO:tasks.workunit.client.0.smithi002.stdout:6/632: dread d12/d17/d34/d4b/f76 [0,4194304] 0 2024-09-13T22:56:16.963 INFO:tasks.workunit.client.0.smithi002.stdout:7/560: mkdir d8/d10/d11/d13/d26/d4c/d81/d51/da9 0 2024-09-13T22:56:16.965 INFO:tasks.workunit.client.0.smithi002.stdout:0/628: creat d1/d4/d75/dca/fde x:0 0 0 2024-09-13T22:56:16.966 INFO:tasks.workunit.client.1.smithi047.stdout:4/816: dwrite dc/de/d17/d25/f36 [0,4194304] 0 2024-09-13T22:56:16.966 INFO:tasks.workunit.client.0.smithi002.stdout:0/629: chown d1/d4/cd4 153119 1 2024-09-13T22:56:16.968 INFO:tasks.workunit.client.1.smithi047.stdout:5/611: mknod d19/d25/d90/cc2 0 2024-09-13T22:56:16.968 INFO:tasks.workunit.client.1.smithi047.stdout:4/817: chown dc/de/d23/d40/d7b/dab/dae/fce 14127064 1 2024-09-13T22:56:16.968 INFO:tasks.workunit.client.0.smithi002.stdout:7/561: dwrite d8/d10/d11/d13/d26/d4c/f4e [0,4194304] 0 2024-09-13T22:56:16.969 INFO:tasks.workunit.client.0.smithi002.stdout:2/618: write d1/d7/d8/f31 [983517,124606] 0 2024-09-13T22:56:16.974 INFO:tasks.workunit.client.0.smithi002.stdout:1/654: rename d1/d13/d30/f2d to d1/fde 0 2024-09-13T22:56:16.980 INFO:tasks.workunit.client.0.smithi002.stdout:7/562: dread d8/f5d [0,4194304] 0 2024-09-13T22:56:16.981 INFO:tasks.workunit.client.0.smithi002.stdout:9/664: chown d8/d1e/c6c 50768 1 2024-09-13T22:56:16.982 INFO:tasks.workunit.client.0.smithi002.stdout:9/665: write d8/d10/d42/fd5 [536825,68139] 0 2024-09-13T22:56:16.985 INFO:tasks.workunit.client.0.smithi002.stdout:8/608: truncate d3/dc/d18/f23 3045398 0 2024-09-13T22:56:16.986 INFO:tasks.workunit.client.0.smithi002.stdout:8/609: chown d3/dc/d51 5539 1 2024-09-13T22:56:16.988 INFO:tasks.workunit.client.1.smithi047.stdout:1/769: symlink d0/d7/d14/ldb 0 2024-09-13T22:56:16.989 INFO:tasks.workunit.client.1.smithi047.stdout:8/645: mknod d8/d64/d4e/d4d/d8f/d91/d40/ce1 0 2024-09-13T22:56:16.990 INFO:tasks.workunit.client.1.smithi047.stdout:8/646: chown d8/d3f/d8c 0 1 2024-09-13T22:56:16.991 INFO:tasks.workunit.client.0.smithi002.stdout:3/690: getdents d9/df/d71 0 2024-09-13T22:56:16.992 INFO:tasks.workunit.client.1.smithi047.stdout:5/612: dwrite d19/f1d [0,4194304] 0 2024-09-13T22:56:16.992 INFO:tasks.workunit.client.0.smithi002.stdout:3/691: stat d9/ca6 0 2024-09-13T22:56:16.992 INFO:tasks.workunit.client.0.smithi002.stdout:3/692: stat d9/d15/d26/f29 0 2024-09-13T22:56:16.993 INFO:tasks.workunit.client.0.smithi002.stdout:0/630: creat d1/d2/d81/fdf x:0 0 0 2024-09-13T22:56:16.996 INFO:tasks.workunit.client.1.smithi047.stdout:3/709: link d0/d3/d4/d16/d2c/de/d3d/lc2 d0/d3/d4/d16/d2c/dcb/ldb 0 2024-09-13T22:56:16.998 INFO:tasks.workunit.client.0.smithi002.stdout:8/610: dread d3/dc/f22 [0,4194304] 0 2024-09-13T22:56:17.001 INFO:tasks.workunit.client.0.smithi002.stdout:2/619: rmdir d1/d7/d35/d3e/d59/d87 39 2024-09-13T22:56:17.005 INFO:tasks.workunit.client.1.smithi047.stdout:3/710: unlink d0/f5c 0 2024-09-13T22:56:17.008 INFO:tasks.workunit.client.1.smithi047.stdout:1/770: dread d0/d7/d14/d28/d36/f9b [0,4194304] 0 2024-09-13T22:56:17.008 INFO:tasks.workunit.client.1.smithi047.stdout:4/818: getdents dc/de/d23/d40/d7b/d90/da6 0 2024-09-13T22:56:17.010 INFO:tasks.workunit.client.0.smithi002.stdout:9/666: symlink d8/d10/db1/ldc 0 2024-09-13T22:56:17.012 INFO:tasks.workunit.client.1.smithi047.stdout:4/819: creat dc/de/d23/ddf/f11a x:0 0 0 2024-09-13T22:56:17.013 INFO:tasks.workunit.client.0.smithi002.stdout:7/563: dwrite d8/d10/d11/d13/d2e/d50/d52/d72/f8c [0,4194304] 0 2024-09-13T22:56:17.013 INFO:tasks.workunit.client.1.smithi047.stdout:3/711: dwrite d0/d3/d4/d16/d32/d42/fd6 [0,4194304] 0 2024-09-13T22:56:17.014 INFO:tasks.workunit.client.1.smithi047.stdout:1/771: creat d0/fdc x:0 0 0 2024-09-13T22:56:17.017 INFO:tasks.workunit.client.1.smithi047.stdout:4/820: unlink dc/d29/d4d/c78 0 2024-09-13T22:56:17.021 INFO:tasks.workunit.client.0.smithi002.stdout:0/631: mkdir d1/d4/d75/d31/de0 0 2024-09-13T22:56:17.023 INFO:tasks.workunit.client.1.smithi047.stdout:1/772: mknod d0/d7/d14/d57/d62/cdd 0 2024-09-13T22:56:17.028 INFO:tasks.workunit.client.0.smithi002.stdout:6/633: truncate d12/f51 4172928 0 2024-09-13T22:56:17.030 INFO:tasks.workunit.client.0.smithi002.stdout:6/634: read d12/d17/d28/fac [1080497,72703] 0 2024-09-13T22:56:17.030 INFO:tasks.workunit.client.0.smithi002.stdout:1/655: mkdir d1/d13/d21/d40/dc4/dc8/ddf 0 2024-09-13T22:56:17.031 INFO:tasks.workunit.client.0.smithi002.stdout:6/635: stat d12/d17/d34/d4b/c82 0 2024-09-13T22:56:17.031 INFO:tasks.workunit.client.0.smithi002.stdout:6/636: stat d12/d17/d28/d67/d6b/l77 0 2024-09-13T22:56:17.032 INFO:tasks.workunit.client.0.smithi002.stdout:4/578: creat d3/d14/d29/d2a/da6/d69/d7e/faf x:0 0 0 2024-09-13T22:56:17.034 INFO:tasks.workunit.client.1.smithi047.stdout:1/773: link d0/d7/d14/d28/f48 d0/d7/d13/d2d/fde 0 2024-09-13T22:56:17.035 INFO:tasks.workunit.client.0.smithi002.stdout:9/667: mkdir d8/d10/d42/ddd 0 2024-09-13T22:56:17.035 INFO:tasks.workunit.client.1.smithi047.stdout:4/821: write dc/de/d23/d40/f92 [526271,13372] 0 2024-09-13T22:56:17.036 INFO:tasks.workunit.client.0.smithi002.stdout:7/564: readlink d8/d10/d39/d60/la0 0 2024-09-13T22:56:17.036 INFO:tasks.workunit.client.1.smithi047.stdout:3/712: dwrite d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/f89 [0,4194304] 0 2024-09-13T22:56:17.037 INFO:tasks.workunit.client.0.smithi002.stdout:9/668: read d8/d1e/f41 [376018,118047] 0 2024-09-13T22:56:17.038 INFO:tasks.workunit.client.0.smithi002.stdout:9/669: chown d8/d10/d1c/d68/d74/l80 1707867 1 2024-09-13T22:56:17.038 INFO:tasks.workunit.client.1.smithi047.stdout:4/822: fsync dc/de/d23/d40/d7b/d90/da6/fb6 0 2024-09-13T22:56:17.039 INFO:tasks.workunit.client.0.smithi002.stdout:3/693: symlink d9/d15/d36/lfe 0 2024-09-13T22:56:17.045 INFO:tasks.workunit.client.0.smithi002.stdout:5/628: rename d1/fbd to d1/d2a/d6b/d88/fe1 0 2024-09-13T22:56:17.048 INFO:tasks.workunit.client.1.smithi047.stdout:4/823: dwrite dc/de/d23/d40/d7b/dab/ff1 [0,4194304] 0 2024-09-13T22:56:17.050 INFO:tasks.workunit.client.0.smithi002.stdout:5/629: dwrite d1/d2a/d6b/f71 [0,4194304] 0 2024-09-13T22:56:17.050 INFO:tasks.workunit.client.1.smithi047.stdout:1/774: creat d0/d7/d14/d28/d36/dcc/fdf x:0 0 0 2024-09-13T22:56:17.054 INFO:tasks.workunit.client.1.smithi047.stdout:3/713: creat d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d3a/fdc x:0 0 0 2024-09-13T22:56:17.063 INFO:tasks.workunit.client.0.smithi002.stdout:9/670: readlink d8/d1e/l3b 0 2024-09-13T22:56:17.066 INFO:tasks.workunit.client.1.smithi047.stdout:1/775: rename d0/f4f to d0/d1d/daa/fe0 0 2024-09-13T22:56:17.067 INFO:tasks.workunit.client.0.smithi002.stdout:0/632: mkdir d1/d4/d75/d31/d32/dbb/de1 0 2024-09-13T22:56:17.069 INFO:tasks.workunit.client.0.smithi002.stdout:3/694: write d9/d3b/d53/d83/fe4 [631662,57450] 0 2024-09-13T22:56:17.072 INFO:tasks.workunit.client.1.smithi047.stdout:3/714: dread d0/d3/d4/d16/d2c/de/d1f/faf [0,4194304] 0 2024-09-13T22:56:17.074 INFO:tasks.workunit.client.0.smithi002.stdout:4/579: dwrite d3/d14/d29/d2a/f60 [0,4194304] 0 2024-09-13T22:56:17.074 INFO:tasks.workunit.client.1.smithi047.stdout:4/824: write dc/fd [2598768,80534] 0 2024-09-13T22:56:17.075 INFO:tasks.workunit.client.0.smithi002.stdout:4/580: chown d3/d14/d29/d2a/da6/d69/d7e 1 1 2024-09-13T22:56:17.075 INFO:tasks.workunit.client.0.smithi002.stdout:2/620: rename d1/d7/d35/d3e/d5e/f81 to d1/d7/d35/d3e/d59/d6b/d75/fcc 0 2024-09-13T22:56:17.075 INFO:tasks.workunit.client.0.smithi002.stdout:2/621: chown d1/d7/d35 0 1 2024-09-13T22:56:17.079 INFO:tasks.workunit.client.0.smithi002.stdout:6/637: mkdir d12/d17/d34/d39/d8b/dcb 0 2024-09-13T22:56:17.083 INFO:tasks.workunit.client.1.smithi047.stdout:3/715: symlink d0/d3/d4/d16/d32/d42/d79/dba/ldd 0 2024-09-13T22:56:17.084 INFO:tasks.workunit.client.0.smithi002.stdout:8/611: sync 2024-09-13T22:56:17.086 INFO:tasks.workunit.client.1.smithi047.stdout:1/776: dwrite d0/d7/db/f98 [4194304,4194304] 0 2024-09-13T22:56:17.087 INFO:tasks.workunit.client.0.smithi002.stdout:9/671: fdatasync d8/d2c/f46 0 2024-09-13T22:56:17.089 INFO:tasks.workunit.client.0.smithi002.stdout:9/672: write d8/d91/d96/f86 [823833,39523] 0 2024-09-13T22:56:17.091 INFO:tasks.workunit.client.0.smithi002.stdout:0/633: write d1/d4/d75/d31/d32/fb6 [153508,27091] 0 2024-09-13T22:56:17.091 INFO:tasks.workunit.client.1.smithi047.stdout:1/777: dread - d0/d7/f80 zero size 2024-09-13T22:56:17.093 INFO:tasks.workunit.client.0.smithi002.stdout:0/634: truncate d1/d4/d75/dca/fde 788511 0 2024-09-13T22:56:17.094 INFO:tasks.workunit.client.0.smithi002.stdout:5/630: write d1/f3 [2306810,50861] 0 2024-09-13T22:56:17.097 INFO:tasks.workunit.client.1.smithi047.stdout:1/778: creat d0/d7/d10/fe1 x:0 0 0 2024-09-13T22:56:17.098 INFO:tasks.workunit.client.0.smithi002.stdout:7/565: write d8/d10/d11/d13/d2e/d3c/f91 [287725,16431] 0 2024-09-13T22:56:17.100 INFO:tasks.workunit.client.1.smithi047.stdout:4/825: dwrite dc/de/d23/dc4/f84 [0,4194304] 0 2024-09-13T22:56:17.102 INFO:tasks.workunit.client.1.smithi047.stdout:4/826: write dc/de/d23/dc4/ddb/fe7 [1013734,22728] 0 2024-09-13T22:56:17.103 INFO:tasks.workunit.client.0.smithi002.stdout:1/656: rename d1/d13/d30/d31/f69 to d1/d13/d30/d31/d3d/fe0 0 2024-09-13T22:56:17.105 INFO:tasks.workunit.client.1.smithi047.stdout:1/779: dread d0/f5a [0,4194304] 0 2024-09-13T22:56:17.107 INFO:tasks.workunit.client.1.smithi047.stdout:3/716: dread d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/fd0 [0,4194304] 0 2024-09-13T22:56:17.109 INFO:tasks.workunit.client.1.smithi047.stdout:4/827: creat dc/de/d23/d40/d7b/d90/da6/f11b x:0 0 0 2024-09-13T22:56:17.111 INFO:tasks.workunit.client.0.smithi002.stdout:8/612: mkdir d3/d21/d57/da1/dbc 0 2024-09-13T22:56:17.114 INFO:tasks.workunit.client.1.smithi047.stdout:3/717: rename d0/d3/d4/d16/d2c/de/f28 to d0/d3/d65/fde 0 2024-09-13T22:56:17.119 INFO:tasks.workunit.client.0.smithi002.stdout:5/631: stat d1/l1b 0 2024-09-13T22:56:17.122 INFO:tasks.workunit.client.0.smithi002.stdout:0/635: creat d1/d4/d75/d31/d32/dbb/fe2 x:0 0 0 2024-09-13T22:56:17.122 INFO:tasks.workunit.client.1.smithi047.stdout:1/780: dwrite d0/d7/d13/d2d/fde [0,4194304] 0 2024-09-13T22:56:17.126 INFO:tasks.workunit.client.1.smithi047.stdout:1/781: creat d0/d7/d13/d5d/fe2 x:0 0 0 2024-09-13T22:56:17.127 INFO:tasks.workunit.client.0.smithi002.stdout:3/695: dwrite d9/df/f7d [0,4194304] 0 2024-09-13T22:56:17.128 INFO:tasks.workunit.client.0.smithi002.stdout:6/638: rename d12/d17/d34/d4b/cc8 to d12/d17/d34/d39/d8a/ccc 0 2024-09-13T22:56:17.130 INFO:tasks.workunit.client.1.smithi047.stdout:3/718: dwrite d0/d3/d4/d16/d2c/f20 [4194304,4194304] 0 2024-09-13T22:56:17.130 INFO:tasks.workunit.client.0.smithi002.stdout:6/639: chown d12/d17/d2a/d88 867 1 2024-09-13T22:56:17.131 INFO:tasks.workunit.client.0.smithi002.stdout:6/640: chown d12/fc1 18 1 2024-09-13T22:56:17.132 INFO:tasks.workunit.client.1.smithi047.stdout:1/782: mknod d0/d7/db/d79/ce3 0 2024-09-13T22:56:17.136 INFO:tasks.workunit.client.1.smithi047.stdout:4/828: getdents dc/d29/d4c 0 2024-09-13T22:56:17.141 INFO:tasks.workunit.client.1.smithi047.stdout:4/829: mkdir dc/de/d17/d25/d4a/d11c 0 2024-09-13T22:56:17.145 INFO:tasks.workunit.client.0.smithi002.stdout:7/566: mknod d8/d10/caa 0 2024-09-13T22:56:17.146 INFO:tasks.workunit.client.1.smithi047.stdout:4/830: symlink dc/de/d23/ddf/l11d 0 2024-09-13T22:56:17.147 INFO:tasks.workunit.client.1.smithi047.stdout:1/783: creat d0/d7/d14/fe4 x:0 0 0 2024-09-13T22:56:17.149 INFO:tasks.workunit.client.0.smithi002.stdout:2/622: write d1/d7/d8/d2c/d9d/fb2 [4008521,100196] 0 2024-09-13T22:56:17.150 INFO:tasks.workunit.client.1.smithi047.stdout:4/831: unlink dc/de/d23/c2a 0 2024-09-13T22:56:17.151 INFO:tasks.workunit.client.0.smithi002.stdout:1/657: mkdir d1/d13/d30/de1 0 2024-09-13T22:56:17.152 INFO:tasks.workunit.client.0.smithi002.stdout:3/696: dread d9/d3b/f64 [0,4194304] 0 2024-09-13T22:56:17.154 INFO:tasks.workunit.client.0.smithi002.stdout:6/641: rename d12/fa4 to d12/d17/d34/d4b/fcd 0 2024-09-13T22:56:17.155 INFO:tasks.workunit.client.1.smithi047.stdout:3/719: truncate d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d3a/d81/fa8 7354611 0 2024-09-13T22:56:17.157 INFO:tasks.workunit.client.0.smithi002.stdout:8/613: symlink d3/dc/d16/d60/db4/lbd 0 2024-09-13T22:56:17.158 INFO:tasks.workunit.client.1.smithi047.stdout:1/784: read d0/d7/d10/f6c [411746,113842] 0 2024-09-13T22:56:17.165 INFO:tasks.workunit.client.0.smithi002.stdout:5/632: link d1/d2a/d6b/d88/fbf d1/d2a/d6b/d88/d45/d4f/fe2 0 2024-09-13T22:56:17.173 INFO:tasks.workunit.client.1.smithi047.stdout:1/785: dwrite d0/d7/d10/f43 [0,4194304] 0 2024-09-13T22:56:17.175 INFO:tasks.workunit.client.1.smithi047.stdout:4/832: dwrite dc/de/fe8 [0,4194304] 0 2024-09-13T22:56:17.175 INFO:tasks.workunit.client.0.smithi002.stdout:7/567: unlink d8/d10/d11/d13/d26/d4c/d81/f8e 0 2024-09-13T22:56:17.177 INFO:tasks.workunit.client.0.smithi002.stdout:0/636: write d1/fa [7396721,13257] 0 2024-09-13T22:56:17.179 INFO:tasks.workunit.client.1.smithi047.stdout:3/720: read d0/d3/d4/f4c [1580403,54368] 0 2024-09-13T22:56:17.181 INFO:tasks.workunit.client.1.smithi047.stdout:3/721: fsync d0/d3/d4/d16/d2c/de/fc7 0 2024-09-13T22:56:17.181 INFO:tasks.workunit.client.0.smithi002.stdout:1/658: mkdir d1/d13/d21/d39/d70/de2 0 2024-09-13T22:56:17.183 INFO:tasks.workunit.client.0.smithi002.stdout:1/659: write d1/d13/d30/d31/d3d/db6/fdb [971800,63146] 0 2024-09-13T22:56:17.185 INFO:tasks.workunit.client.1.smithi047.stdout:4/833: dwrite dc/d29/d4c/f108 [0,4194304] 0 2024-09-13T22:56:17.190 INFO:tasks.workunit.client.0.smithi002.stdout:3/697: rmdir d9 39 2024-09-13T22:56:17.199 INFO:tasks.workunit.client.0.smithi002.stdout:9/673: getdents d8/d91 0 2024-09-13T22:56:17.199 INFO:tasks.workunit.client.0.smithi002.stdout:9/674: chown d8/d2c/dbc/fcc 75102290 1 2024-09-13T22:56:17.200 INFO:tasks.workunit.client.0.smithi002.stdout:9/675: fsync d8/d10/d1c/fcf 0 2024-09-13T22:56:17.200 INFO:tasks.workunit.client.1.smithi047.stdout:1/786: getdents d0/d7/d14/d57/d62/d76 0 2024-09-13T22:56:17.201 INFO:tasks.workunit.client.0.smithi002.stdout:9/676: chown d8/d10/d1c/d68/cb5 74144194 1 2024-09-13T22:56:17.201 INFO:tasks.workunit.client.0.smithi002.stdout:5/633: mknod d1/d2a/d69/ce3 0 2024-09-13T22:56:17.202 INFO:tasks.workunit.client.1.smithi047.stdout:3/722: write d0/d3/d4/d16/d2c/de/d1f/d3b/d69/f7d [1592799,15461] 0 2024-09-13T22:56:17.203 INFO:tasks.workunit.client.0.smithi002.stdout:4/581: link d3/d40/l77 d3/d14/d86/lb0 0 2024-09-13T22:56:17.205 INFO:tasks.workunit.client.1.smithi047.stdout:1/787: rmdir d0/d7/d14/d28/d36/dcc 39 2024-09-13T22:56:17.208 INFO:tasks.workunit.client.1.smithi047.stdout:1/788: write d0/d7/d13/d5d/fd9 [310168,117048] 0 2024-09-13T22:56:17.208 INFO:tasks.workunit.client.1.smithi047.stdout:3/723: dread d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d85/fab [0,4194304] 0 2024-09-13T22:56:17.209 INFO:tasks.workunit.client.0.smithi002.stdout:2/623: mknod d1/d7/d8/ccd 0 2024-09-13T22:56:17.209 INFO:tasks.workunit.client.0.smithi002.stdout:7/568: write d8/d10/d11/d13/d26/d4c/d81/fd [5015902,76136] 0 2024-09-13T22:56:17.211 INFO:tasks.workunit.client.1.smithi047.stdout:4/834: getdents dc/d29 0 2024-09-13T22:56:17.211 INFO:tasks.workunit.client.0.smithi002.stdout:0/637: truncate d1/d4/d75/fab 751331 0 2024-09-13T22:56:17.211 INFO:tasks.workunit.client.0.smithi002.stdout:7/569: write d8/d10/d11/d13/d26/d4c/d81/f19 [1498649,619] 0 2024-09-13T22:56:17.214 INFO:tasks.workunit.client.1.smithi047.stdout:1/789: rename d0/d7/d13/d8c/lc4 to d0/d1d/daa/le5 0 2024-09-13T22:56:17.215 INFO:tasks.workunit.client.1.smithi047.stdout:1/790: stat d0/d1d/c73 0 2024-09-13T22:56:17.215 INFO:tasks.workunit.client.1.smithi047.stdout:1/791: stat d0/d7/d14/d57/d62/fa3 0 2024-09-13T22:56:17.215 INFO:tasks.workunit.client.0.smithi002.stdout:6/642: fsync d12/d17/f91 0 2024-09-13T22:56:17.216 INFO:tasks.workunit.client.1.smithi047.stdout:4/835: symlink dc/de/d23/d40/d7b/d90/l11e 0 2024-09-13T22:56:17.217 INFO:tasks.workunit.client.0.smithi002.stdout:8/614: getdents d3/d27/da3 0 2024-09-13T22:56:17.218 INFO:tasks.workunit.client.0.smithi002.stdout:7/570: dwrite d8/d10/d11/d13/d26/d4c/f8a [0,4194304] 0 2024-09-13T22:56:17.219 INFO:tasks.workunit.client.0.smithi002.stdout:9/677: chown d8/d10/l32 89179 1 2024-09-13T22:56:17.219 INFO:tasks.workunit.client.0.smithi002.stdout:7/571: chown d8/d10/d11/d13/d26 64 1 2024-09-13T22:56:17.221 INFO:tasks.workunit.client.1.smithi047.stdout:3/724: dwrite d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d3a/d81/fa8 [0,4194304] 0 2024-09-13T22:56:17.224 INFO:tasks.workunit.client.1.smithi047.stdout:4/836: rename dc/de/d17/c10c to dc/de/d17/d25/d4a/c11f 0 2024-09-13T22:56:17.228 INFO:tasks.workunit.client.1.smithi047.stdout:3/725: symlink d0/d3/d4/d16/d73/ldf 0 2024-09-13T22:56:17.229 INFO:tasks.workunit.client.0.smithi002.stdout:1/660: mknod d1/d13/d21/d39/d70/de2/ce3 0 2024-09-13T22:56:17.230 INFO:tasks.workunit.client.1.smithi047.stdout:3/726: dread - d0/d3/d4/d16/d2c/de/f97 zero size 2024-09-13T22:56:17.230 INFO:tasks.workunit.client.1.smithi047.stdout:1/792: link d0/d7/d13/f39 d0/d1d/daa/fe6 0 2024-09-13T22:56:17.231 INFO:tasks.workunit.client.1.smithi047.stdout:4/837: symlink dc/de/d17/d25/d4a/d11c/l120 0 2024-09-13T22:56:17.235 INFO:tasks.workunit.client.0.smithi002.stdout:1/661: dread d1/d13/d30/d31/d3d/db6/fdb [0,4194304] 0 2024-09-13T22:56:17.236 INFO:tasks.workunit.client.1.smithi047.stdout:1/793: dwrite d0/d7/db/f8b [0,4194304] 0 2024-09-13T22:56:17.237 INFO:tasks.workunit.client.0.smithi002.stdout:0/638: dwrite d1/d4/d75/d76/fdb [0,4194304] 0 2024-09-13T22:56:17.237 INFO:tasks.workunit.client.0.smithi002.stdout:0/639: stat d1/d7e 0 2024-09-13T22:56:17.294 INFO:tasks.workunit.client.0.smithi002.stdout:2/624: sync 2024-09-13T22:56:17.371 INFO:tasks.workunit.client.1.smithi047.stdout:7/682: sync 2024-09-13T22:56:17.379 INFO:tasks.workunit.client.1.smithi047.stdout:4/838: creat dc/de/dfb/f121 x:0 0 0 2024-09-13T22:56:17.384 INFO:tasks.workunit.client.1.smithi047.stdout:3/727: write d0/d3/d4/d16/d2c/de/d1f/d3b/f51 [1059606,55746] 0 2024-09-13T22:56:17.385 INFO:tasks.workunit.client.0.smithi002.stdout:7/572: mkdir d8/d10/d11/d13/d2e/d50/d52/dab 0 2024-09-13T22:56:17.387 INFO:tasks.workunit.client.0.smithi002.stdout:9/678: write d8/d10/d1c/d3d/f7b [3416801,80085] 0 2024-09-13T22:56:17.388 INFO:tasks.workunit.client.0.smithi002.stdout:9/679: write d8/d10/d42/f51 [2690824,88493] 0 2024-09-13T22:56:17.390 INFO:tasks.workunit.client.0.smithi002.stdout:9/680: chown c3 404 1 2024-09-13T22:56:17.391 INFO:tasks.workunit.client.0.smithi002.stdout:3/698: creat d9/d15/d51/deb/fff x:0 0 0 2024-09-13T22:56:17.395 INFO:tasks.workunit.client.0.smithi002.stdout:0/640: mkdir d1/d7e/d9d/de3 0 2024-09-13T22:56:17.397 INFO:tasks.workunit.client.0.smithi002.stdout:2/625: fsync d1/d7/d8/f8a 0 2024-09-13T22:56:17.405 INFO:tasks.workunit.client.0.smithi002.stdout:7/573: fsync d8/d10/d11/d13/d2e/d50/f61 0 2024-09-13T22:56:17.406 INFO:tasks.workunit.client.0.smithi002.stdout:7/574: readlink d8/d10/d11/d13/d26/l7f 0 2024-09-13T22:56:17.407 INFO:tasks.workunit.client.0.smithi002.stdout:7/575: truncate d8/d10/d11/d13/d26/d4c/f64 4821810 0 2024-09-13T22:56:17.407 INFO:tasks.workunit.client.0.smithi002.stdout:7/576: chown d8 1525188 1 2024-09-13T22:56:17.408 INFO:tasks.workunit.client.0.smithi002.stdout:7/577: fsync d8/d10/d11/d13/f21 0 2024-09-13T22:56:17.413 INFO:tasks.workunit.client.0.smithi002.stdout:3/699: rename d9/d15/d36/df1 to d9/d3b/d53/d83/d100 0 2024-09-13T22:56:17.414 INFO:tasks.workunit.client.0.smithi002.stdout:7/578: dwrite d8/d10/d11/d13/d26/f96 [0,4194304] 0 2024-09-13T22:56:17.414 INFO:tasks.workunit.client.0.smithi002.stdout:9/681: dread d8/d2c/f46 [0,4194304] 0 2024-09-13T22:56:17.416 INFO:tasks.workunit.client.0.smithi002.stdout:1/662: symlink d1/d13/d30/d31/d3b/d71/le4 0 2024-09-13T22:56:17.416 INFO:tasks.workunit.client.0.smithi002.stdout:9/682: dread - d8/d2c/dbc/fcc zero size 2024-09-13T22:56:17.417 INFO:tasks.workunit.client.0.smithi002.stdout:9/683: write d8/d2c/fba [346130,74088] 0 2024-09-13T22:56:17.423 INFO:tasks.workunit.client.0.smithi002.stdout:8/615: creat d3/d21/fbe x:0 0 0 2024-09-13T22:56:17.424 INFO:tasks.workunit.client.0.smithi002.stdout:5/634: getdents d1/d2a/d6b/d88/d55/d56/dc7 0 2024-09-13T22:56:17.426 INFO:tasks.workunit.client.0.smithi002.stdout:4/582: getdents d3/d14/d29/d2a/da6/d5e 0 2024-09-13T22:56:17.427 INFO:tasks.workunit.client.0.smithi002.stdout:8/616: dread d3/d21/d57/f55 [0,4194304] 0 2024-09-13T22:56:17.430 INFO:tasks.workunit.client.0.smithi002.stdout:1/663: dread d1/d13/d30/d31/d3d/d5d/f37 [0,4194304] 0 2024-09-13T22:56:17.430 INFO:tasks.workunit.client.1.smithi047.stdout:0/705: sync 2024-09-13T22:56:17.431 INFO:tasks.workunit.client.0.smithi002.stdout:1/664: chown d1/f27 61855726 1 2024-09-13T22:56:17.431 INFO:tasks.workunit.client.0.smithi002.stdout:7/579: creat d8/d10/d11/d13/d26/d38/fac x:0 0 0 2024-09-13T22:56:17.431 INFO:tasks.workunit.client.1.smithi047.stdout:0/706: chown d1/d5/d16/d23/d45/d7f 0 1 2024-09-13T22:56:17.434 INFO:tasks.workunit.client.0.smithi002.stdout:8/617: dwrite d3/dc/d16/d60/da7/fb1 [0,4194304] 0 2024-09-13T22:56:17.437 INFO:tasks.workunit.client.0.smithi002.stdout:9/684: mkdir d8/d10/dc4/dde 0 2024-09-13T22:56:17.437 INFO:tasks.workunit.client.0.smithi002.stdout:9/685: readlink l2 0 2024-09-13T22:56:17.440 INFO:tasks.workunit.client.0.smithi002.stdout:6/643: getdents d12 0 2024-09-13T22:56:17.443 INFO:tasks.workunit.client.0.smithi002.stdout:2/626: write d1/d7/f47 [236719,55012] 0 2024-09-13T22:56:17.443 INFO:tasks.workunit.client.0.smithi002.stdout:6/644: write d12/d17/d34/d39/d8a/f8e [177774,49846] 0 2024-09-13T22:56:17.445 INFO:tasks.workunit.client.0.smithi002.stdout:5/635: mkdir d1/d2a/d6b/d88/d55/d56/de4 0 2024-09-13T22:56:17.445 INFO:tasks.workunit.client.0.smithi002.stdout:9/686: dwrite d8/d10/d1c/f15 [0,4194304] 0 2024-09-13T22:56:17.454 INFO:tasks.workunit.client.0.smithi002.stdout:4/583: dwrite d3/d14/f16 [4194304,4194304] 0 2024-09-13T22:56:17.454 INFO:tasks.workunit.client.0.smithi002.stdout:7/580: symlink d8/d10/d11/d13/d2e/d3c/d3e/lad 0 2024-09-13T22:56:17.456 INFO:tasks.workunit.client.0.smithi002.stdout:7/581: read d8/d10/d11/d13/f21 [1789372,20967] 0 2024-09-13T22:56:17.458 INFO:tasks.workunit.client.0.smithi002.stdout:8/618: write d3/f35 [2413823,106424] 0 2024-09-13T22:56:17.458 INFO:tasks.workunit.client.0.smithi002.stdout:7/582: dread - d8/d10/d11/d13/d26/d4c/fa7 zero size 2024-09-13T22:56:17.461 INFO:tasks.workunit.client.0.smithi002.stdout:0/641: truncate d1/d2/f29 1749358 0 2024-09-13T22:56:17.461 INFO:tasks.workunit.client.0.smithi002.stdout:7/583: write d8/d10/d11/d13/d26/d4c/f64 [910196,76073] 0 2024-09-13T22:56:17.464 INFO:tasks.workunit.client.1.smithi047.stdout:4/839: unlink dc/f9e 0 2024-09-13T22:56:17.465 INFO:tasks.workunit.client.0.smithi002.stdout:6/645: read - d12/d17/d28/d67/f8f zero size 2024-09-13T22:56:17.466 INFO:tasks.workunit.client.1.smithi047.stdout:4/840: read dc/de/d23/d40/d7b/dab/dae/fce [1875696,26408] 0 2024-09-13T22:56:17.467 INFO:tasks.workunit.client.0.smithi002.stdout:6/646: chown d12/d17/d28/d67/d6b/l41 26352 1 2024-09-13T22:56:17.467 INFO:tasks.workunit.client.0.smithi002.stdout:7/584: dwrite f1 [0,4194304] 0 2024-09-13T22:56:17.469 INFO:tasks.workunit.client.1.smithi047.stdout:7/683: symlink d0/d7/da/le2 0 2024-09-13T22:56:17.470 INFO:tasks.workunit.client.0.smithi002.stdout:2/627: rename d1/d7/d41/l6d to d1/d32/d37/lce 0 2024-09-13T22:56:17.476 INFO:tasks.workunit.client.1.smithi047.stdout:0/707: readlink d1/ld 0 2024-09-13T22:56:17.480 INFO:tasks.workunit.client.1.smithi047.stdout:1/794: link d0/d7/f80 d0/d7/d14/d57/d62/d76/fe7 0 2024-09-13T22:56:17.481 INFO:tasks.workunit.client.0.smithi002.stdout:4/584: mkdir d3/d14/d86/db1 0 2024-09-13T22:56:17.489 INFO:tasks.workunit.client.0.smithi002.stdout:7/585: dread d8/d10/d11/d13/d26/d4c/d81/f57 [4194304,4194304] 0 2024-09-13T22:56:17.493 INFO:tasks.workunit.client.1.smithi047.stdout:0/708: unlink d1/d5/d16/d47/dde/fe3 0 2024-09-13T22:56:17.497 INFO:tasks.workunit.client.0.smithi002.stdout:7/586: dwrite d8/d10/d11/d13/d26/d4c/d81/f57 [8388608,4194304] 0 2024-09-13T22:56:17.498 INFO:tasks.workunit.client.0.smithi002.stdout:2/628: write d1/d80/fb6 [1638625,19272] 0 2024-09-13T22:56:17.502 INFO:tasks.workunit.client.1.smithi047.stdout:3/728: creat d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/fe0 x:0 0 0 2024-09-13T22:56:17.503 INFO:tasks.workunit.client.0.smithi002.stdout:7/587: dwrite f1 [0,4194304] 0 2024-09-13T22:56:17.505 INFO:tasks.workunit.client.1.smithi047.stdout:3/729: chown d0/d3/d4/d16/d32/d42/d79/d9c/c9d 0 1 2024-09-13T22:56:17.506 INFO:tasks.workunit.client.0.smithi002.stdout:9/687: link d8/d10/d1c/d3d/f3e d8/d91/d96/d87/fdf 0 2024-09-13T22:56:17.507 INFO:tasks.workunit.client.1.smithi047.stdout:7/684: rmdir d0 39 2024-09-13T22:56:17.512 INFO:tasks.workunit.client.1.smithi047.stdout:0/709: unlink d1/d5/d16/d23/d45/d84/fd1 0 2024-09-13T22:56:17.515 INFO:tasks.workunit.client.1.smithi047.stdout:1/795: symlink d0/d7/d14/d28/d36/le8 0 2024-09-13T22:56:17.516 INFO:tasks.workunit.client.1.smithi047.stdout:4/841: creat dc/de/d17/d25/f122 x:0 0 0 2024-09-13T22:56:17.517 INFO:tasks.workunit.client.0.smithi002.stdout:4/585: dread d3/d14/d85/fa5 [0,4194304] 0 2024-09-13T22:56:17.518 INFO:tasks.workunit.client.1.smithi047.stdout:3/730: symlink d0/d3/d5e/le1 0 2024-09-13T22:56:17.523 INFO:tasks.workunit.client.1.smithi047.stdout:3/731: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d3a/d81/fa8 [1966370,65209] 0 2024-09-13T22:56:17.524 INFO:tasks.workunit.client.0.smithi002.stdout:3/700: sync 2024-09-13T22:56:17.525 INFO:tasks.workunit.client.1.smithi047.stdout:4/842: dwrite dc/de/d23/d40/f92 [0,4194304] 0 2024-09-13T22:56:17.526 INFO:tasks.workunit.client.0.smithi002.stdout:7/588: dread d8/d10/d11/d13/f1c [0,4194304] 0 2024-09-13T22:56:17.528 INFO:tasks.workunit.client.0.smithi002.stdout:9/688: mknod d8/d91/ce0 0 2024-09-13T22:56:17.531 INFO:tasks.workunit.client.0.smithi002.stdout:1/665: getdents d1/d13/d52 0 2024-09-13T22:56:17.532 INFO:tasks.workunit.client.0.smithi002.stdout:6/647: write d12/d17/d28/d67/d6b/f9d [885941,30944] 0 2024-09-13T22:56:17.534 INFO:tasks.workunit.client.1.smithi047.stdout:7/685: rename d0/da2/fcf to d0/d57/fe3 0 2024-09-13T22:56:17.536 INFO:tasks.workunit.client.0.smithi002.stdout:0/642: dwrite d1/d2/f1d [0,4194304] 0 2024-09-13T22:56:17.536 INFO:tasks.workunit.client.0.smithi002.stdout:7/589: dread d8/f27 [0,4194304] 0 2024-09-13T22:56:17.536 INFO:tasks.workunit.client.0.smithi002.stdout:5/636: write d1/d2a/d6b/d88/d45/f8a [886932,44524] 0 2024-09-13T22:56:17.540 INFO:tasks.workunit.client.0.smithi002.stdout:3/701: creat d9/d15/d36/d4e/d5e/dae/d89/df7/f101 x:0 0 0 2024-09-13T22:56:17.542 INFO:tasks.workunit.client.0.smithi002.stdout:3/702: chown d9/d15/d36/l5c 296554 1 2024-09-13T22:56:17.544 INFO:tasks.workunit.client.1.smithi047.stdout:7/686: fsync d0/d7/da/d4e/f4f 0 2024-09-13T22:56:17.545 INFO:tasks.workunit.client.0.smithi002.stdout:3/703: write d9/d15/fe3 [4609813,120928] 0 2024-09-13T22:56:17.545 INFO:tasks.workunit.client.0.smithi002.stdout:7/590: dwrite d8/d10/d11/d13/d26/f96 [4194304,4194304] 0 2024-09-13T22:56:17.547 INFO:tasks.workunit.client.0.smithi002.stdout:9/689: truncate d8/d1e/f22 3054948 0 2024-09-13T22:56:17.548 INFO:tasks.workunit.client.1.smithi047.stdout:3/732: mkdir d0/d3/d4/d16/de2 0 2024-09-13T22:56:17.550 INFO:tasks.workunit.client.0.smithi002.stdout:5/637: dread d1/d10/f3d [0,4194304] 0 2024-09-13T22:56:17.550 INFO:tasks.workunit.client.0.smithi002.stdout:5/638: stat d1/d2a/d5a/f6d 0 2024-09-13T22:56:17.553 INFO:tasks.workunit.client.1.smithi047.stdout:7/687: fsync d0/d57/d5b/fb4 0 2024-09-13T22:56:17.554 INFO:tasks.workunit.client.1.smithi047.stdout:0/710: write d1/d7/fe [1075262,59474] 0 2024-09-13T22:56:17.558 INFO:tasks.workunit.client.0.smithi002.stdout:6/648: creat d12/d17/d2a/fce x:0 0 0 2024-09-13T22:56:17.559 INFO:tasks.workunit.client.1.smithi047.stdout:7/688: mknod d0/d7/da/d4e/ce4 0 2024-09-13T22:56:17.559 INFO:tasks.workunit.client.1.smithi047.stdout:7/689: readlink d0/d57/lc9 0 2024-09-13T22:56:17.562 INFO:tasks.workunit.client.1.smithi047.stdout:0/711: mknod d1/d5/d16/d47/dde/ce7 0 2024-09-13T22:56:17.562 INFO:tasks.workunit.client.1.smithi047.stdout:7/690: chown d0/d7/da/d4e/caa 4679 1 2024-09-13T22:56:17.562 INFO:tasks.workunit.client.1.smithi047.stdout:1/796: dwrite d0/f5a [0,4194304] 0 2024-09-13T22:56:17.563 INFO:tasks.workunit.client.0.smithi002.stdout:4/586: mknod d3/d40/cb2 0 2024-09-13T22:56:17.564 INFO:tasks.workunit.client.1.smithi047.stdout:1/797: write d0/d7/d14/d28/d36/f4c [1005525,129383] 0 2024-09-13T22:56:17.566 INFO:tasks.workunit.client.1.smithi047.stdout:1/798: read d0/d7/d13/d8c/fb4 [887375,124386] 0 2024-09-13T22:56:17.567 INFO:tasks.workunit.client.1.smithi047.stdout:1/799: dread - d0/d7/d10/fe1 zero size 2024-09-13T22:56:17.569 INFO:tasks.workunit.client.0.smithi002.stdout:0/643: mknod d1/d2/d81/ce4 0 2024-09-13T22:56:17.576 INFO:tasks.workunit.client.0.smithi002.stdout:1/666: write d1/d13/f19 [2390954,84258] 0 2024-09-13T22:56:17.581 INFO:tasks.workunit.client.1.smithi047.stdout:9/658: sync 2024-09-13T22:56:17.581 INFO:tasks.workunit.client.1.smithi047.stdout:6/699: sync 2024-09-13T22:56:17.581 INFO:tasks.workunit.client.1.smithi047.stdout:2/721: sync 2024-09-13T22:56:17.581 INFO:tasks.workunit.client.1.smithi047.stdout:8/647: sync 2024-09-13T22:56:17.581 INFO:tasks.workunit.client.1.smithi047.stdout:5/613: sync 2024-09-13T22:56:17.582 INFO:tasks.workunit.client.0.smithi002.stdout:3/704: rename d9/d15/d26/f8c to d9/d15/d51/f102 0 2024-09-13T22:56:17.583 INFO:tasks.workunit.client.1.smithi047.stdout:1/800: dread d0/d7/db/f98 [0,4194304] 0 2024-09-13T22:56:17.583 INFO:tasks.workunit.client.1.smithi047.stdout:6/700: read - d3/d11/d2b/fe4 zero size 2024-09-13T22:56:17.584 INFO:tasks.workunit.client.0.smithi002.stdout:9/690: mknod d8/d10/d1c/d68/d74/ce1 0 2024-09-13T22:56:17.585 INFO:tasks.workunit.client.1.smithi047.stdout:8/648: dread d8/f13 [0,4194304] 0 2024-09-13T22:56:17.585 INFO:tasks.workunit.client.1.smithi047.stdout:6/701: readlink d3/d11/d2b/d4c/d30/d48/la0 0 2024-09-13T22:56:17.587 INFO:tasks.workunit.client.1.smithi047.stdout:7/691: write d0/d57/da6/fb3 [5051913,45723] 0 2024-09-13T22:56:17.591 INFO:tasks.workunit.client.1.smithi047.stdout:7/692: dread d0/d7/da/d2e/db5/f43 [0,4194304] 0 2024-09-13T22:56:17.592 INFO:tasks.workunit.client.1.smithi047.stdout:7/693: write d0/d57/d5b/fb4 [503260,76222] 0 2024-09-13T22:56:17.596 INFO:tasks.workunit.client.0.smithi002.stdout:3/705: creat d9/d7e/daf/f103 x:0 0 0 2024-09-13T22:56:17.600 INFO:tasks.workunit.client.1.smithi047.stdout:3/733: getdents d0/d3/d4/d16/d32/d42/d79 0 2024-09-13T22:56:17.601 INFO:tasks.workunit.client.0.smithi002.stdout:5/639: creat d1/d2a/d6b/d88/d45/d4f/da7/daa/fe5 x:0 0 0 2024-09-13T22:56:17.602 INFO:tasks.workunit.client.0.smithi002.stdout:3/706: dwrite d9/d15/d26/f29 [4194304,4194304] 0 2024-09-13T22:56:17.603 INFO:tasks.workunit.client.1.smithi047.stdout:2/722: write d1/df/d35/f45 [1006939,119163] 0 2024-09-13T22:56:17.606 INFO:tasks.workunit.client.0.smithi002.stdout:9/691: write d8/d10/d1c/f2b [2782503,100269] 0 2024-09-13T22:56:17.608 INFO:tasks.workunit.client.1.smithi047.stdout:0/712: creat d1/d5/d11/d52/fe8 x:0 0 0 2024-09-13T22:56:17.609 INFO:tasks.workunit.client.0.smithi002.stdout:4/587: mkdir d3/db3 0 2024-09-13T22:56:17.612 INFO:tasks.workunit.client.0.smithi002.stdout:0/644: mknod d1/d4/ce5 0 2024-09-13T22:56:17.613 INFO:tasks.workunit.client.0.smithi002.stdout:7/591: creat d8/fae x:0 0 0 2024-09-13T22:56:17.614 INFO:tasks.workunit.client.1.smithi047.stdout:0/713: stat d1/d5/d16/d23/d45/fe5 0 2024-09-13T22:56:17.616 INFO:tasks.workunit.client.1.smithi047.stdout:9/659: dwrite d1/dc/d14/dd/d54/d50/d5b/d9e/f83 [0,4194304] 0 2024-09-13T22:56:17.618 INFO:tasks.workunit.client.1.smithi047.stdout:3/734: rmdir d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34 39 2024-09-13T22:56:17.619 INFO:tasks.workunit.client.0.smithi002.stdout:3/707: symlink d9/d15/d36/d4e/d5e/dae/d89/de5/l104 0 2024-09-13T22:56:17.620 INFO:tasks.workunit.client.1.smithi047.stdout:6/702: dwrite d3/d2c/fc9 [0,4194304] 0 2024-09-13T22:56:17.621 INFO:tasks.workunit.client.0.smithi002.stdout:8/619: sync 2024-09-13T22:56:17.621 INFO:tasks.workunit.client.0.smithi002.stdout:6/649: creat d12/d17/d28/fcf x:0 0 0 2024-09-13T22:56:17.622 INFO:tasks.workunit.client.1.smithi047.stdout:8/649: dwrite d8/d64/d4e/d70/d98/fad [0,4194304] 0 2024-09-13T22:56:17.623 INFO:tasks.workunit.client.0.smithi002.stdout:6/650: write d12/d17/d4e/fb4 [353333,107022] 0 2024-09-13T22:56:17.624 INFO:tasks.workunit.client.0.smithi002.stdout:9/692: symlink d8/d91/le2 0 2024-09-13T22:56:17.628 INFO:tasks.workunit.client.1.smithi047.stdout:5/614: creat d19/d25/fc3 x:0 0 0 2024-09-13T22:56:17.631 INFO:tasks.workunit.client.0.smithi002.stdout:0/645: fsync d1/d2/d6c/d8b/fbf 0 2024-09-13T22:56:17.632 INFO:tasks.workunit.client.0.smithi002.stdout:8/620: dwrite d3/d21/f9d [0,4194304] 0 2024-09-13T22:56:17.633 INFO:tasks.workunit.client.1.smithi047.stdout:3/735: dread d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/f60 [4194304,4194304] 0 2024-09-13T22:56:17.634 INFO:tasks.workunit.client.0.smithi002.stdout:7/592: creat d8/d10/d11/d13/d2e/d50/d52/d72/faf x:0 0 0 2024-09-13T22:56:17.637 INFO:tasks.workunit.client.1.smithi047.stdout:7/694: link d0/d57/d5b/d8b/fd5 d0/d7/da/d2e/db5/fe5 0 2024-09-13T22:56:17.638 INFO:tasks.workunit.client.0.smithi002.stdout:5/640: write d1/d2a/d6b/d88/f70 [2484929,10117] 0 2024-09-13T22:56:17.641 INFO:tasks.workunit.client.1.smithi047.stdout:1/801: dwrite d0/d7/f80 [0,4194304] 0 2024-09-13T22:56:17.644 INFO:tasks.workunit.client.1.smithi047.stdout:0/714: creat d1/d5/d16/d6a/fe9 x:0 0 0 2024-09-13T22:56:17.650 INFO:tasks.workunit.client.1.smithi047.stdout:9/660: mkdir d1/dd2 0 2024-09-13T22:56:17.651 INFO:tasks.workunit.client.1.smithi047.stdout:9/661: chown d1/dc/d14/dd/d54/d50/d5b/d9e/c96 7477465 1 2024-09-13T22:56:17.654 INFO:tasks.workunit.client.0.smithi002.stdout:3/708: write d9/df/f54 [4806572,26730] 0 2024-09-13T22:56:17.657 INFO:tasks.workunit.client.1.smithi047.stdout:2/723: rename d1/df/d1d/d3c/ca4 to d1/d8a/da6/dc3/cf1 0 2024-09-13T22:56:17.660 INFO:tasks.workunit.client.1.smithi047.stdout:8/650: unlink d8/d64/f94 0 2024-09-13T22:56:17.661 INFO:tasks.workunit.client.0.smithi002.stdout:3/709: dwrite d9/d15/d46/f9b [0,4194304] 0 2024-09-13T22:56:17.661 INFO:tasks.workunit.client.0.smithi002.stdout:8/621: mknod d3/d21/d57/cbf 0 2024-09-13T22:56:17.661 INFO:tasks.workunit.client.1.smithi047.stdout:5/615: creat d19/d23/d2e/d41/d58/d77/fc4 x:0 0 0 2024-09-13T22:56:17.662 INFO:tasks.workunit.client.0.smithi002.stdout:8/622: readlink d3/d27/l96 0 2024-09-13T22:56:17.664 INFO:tasks.workunit.client.0.smithi002.stdout:6/651: dwrite d12/d17/d28/d67/d6b/f49 [0,4194304] 0 2024-09-13T22:56:17.668 INFO:tasks.workunit.client.1.smithi047.stdout:0/715: unlink d1/d5/d16/d23/d45/d7f/faf 0 2024-09-13T22:56:17.670 INFO:tasks.workunit.client.0.smithi002.stdout:9/693: symlink d8/d2c/dbc/dc8/dd0/le3 0 2024-09-13T22:56:17.676 INFO:tasks.workunit.client.1.smithi047.stdout:9/662: rename d1/dc/d14/c63 to d1/dc/d14/dd/d54/d50/d60/db0/cd3 0 2024-09-13T22:56:17.677 INFO:tasks.workunit.client.0.smithi002.stdout:1/667: sync 2024-09-13T22:56:17.677 INFO:tasks.workunit.client.0.smithi002.stdout:2/629: sync 2024-09-13T22:56:17.680 INFO:tasks.workunit.client.1.smithi047.stdout:2/724: unlink d1/df/f9e 0 2024-09-13T22:56:17.684 INFO:tasks.workunit.client.1.smithi047.stdout:8/651: write d8/f2b [4614047,1262] 0 2024-09-13T22:56:17.687 INFO:tasks.workunit.client.0.smithi002.stdout:5/641: mkdir d1/d2a/d6b/d88/d45/d4f/d78/d8b/ddb/de6 0 2024-09-13T22:56:17.688 INFO:tasks.workunit.client.1.smithi047.stdout:8/652: dread - d8/d64/d4e/d70/da7/fd5 zero size 2024-09-13T22:56:17.688 INFO:tasks.workunit.client.1.smithi047.stdout:7/695: dwrite d0/d7/da/d1e/d51/fa3 [4194304,4194304] 0 2024-09-13T22:56:17.692 INFO:tasks.workunit.client.0.smithi002.stdout:6/652: unlink d12/d17/d2a/fce 0 2024-09-13T22:56:17.693 INFO:tasks.workunit.client.1.smithi047.stdout:0/716: mknod d1/d5/d16/d6a/d92/cea 0 2024-09-13T22:56:17.694 INFO:tasks.workunit.client.0.smithi002.stdout:6/653: chown d12/d17/d28/fcf 79 1 2024-09-13T22:56:17.694 INFO:tasks.workunit.client.0.smithi002.stdout:6/654: readlink d12/l72 0 2024-09-13T22:56:17.695 INFO:tasks.workunit.client.1.smithi047.stdout:0/717: chown d1/d5/d16/d23/d2d/f5a 46995 1 2024-09-13T22:56:17.695 INFO:tasks.workunit.client.0.smithi002.stdout:0/646: write d1/f63 [926418,32686] 0 2024-09-13T22:56:17.696 INFO:tasks.workunit.client.1.smithi047.stdout:6/703: creat d3/fe6 x:0 0 0 2024-09-13T22:56:17.698 INFO:tasks.workunit.client.0.smithi002.stdout:2/630: mknod d1/d7/d35/d3e/d5e/ccf 0 2024-09-13T22:56:17.698 INFO:tasks.workunit.client.0.smithi002.stdout:7/593: write d8/d10/f45 [255620,65945] 0 2024-09-13T22:56:17.699 INFO:tasks.workunit.client.1.smithi047.stdout:9/663: mkdir d1/d5f/dd4 0 2024-09-13T22:56:17.704 INFO:tasks.workunit.client.1.smithi047.stdout:3/736: symlink d0/d3/d4/d16/d2c/de/le3 0 2024-09-13T22:56:17.705 INFO:tasks.workunit.client.0.smithi002.stdout:7/594: dwrite d8/d10/d11/d13/d26/f96 [8388608,4194304] 0 2024-09-13T22:56:17.705 INFO:tasks.workunit.client.0.smithi002.stdout:7/595: chown d8/d10/d11 1735 1 2024-09-13T22:56:17.705 INFO:tasks.workunit.client.0.smithi002.stdout:8/623: mknod d3/dc/d16/d4b/d72/d73/cc0 0 2024-09-13T22:56:17.706 INFO:tasks.workunit.client.1.smithi047.stdout:5/616: dwrite d19/d34/d6c/f8d [0,4194304] 0 2024-09-13T22:56:17.707 INFO:tasks.workunit.client.1.smithi047.stdout:5/617: chown d19/d34/d42/d5d/d9d/lb9 64042 1 2024-09-13T22:56:17.710 INFO:tasks.workunit.client.0.smithi002.stdout:8/624: dread d3/d27/d39/f3b [0,4194304] 0 2024-09-13T22:56:17.716 INFO:tasks.workunit.client.0.smithi002.stdout:0/647: mkdir d1/d7e/d9d/de6 0 2024-09-13T22:56:17.719 INFO:tasks.workunit.client.0.smithi002.stdout:2/631: mknod d1/d7/d35/d78/cd0 0 2024-09-13T22:56:17.720 INFO:tasks.workunit.client.0.smithi002.stdout:2/632: write d1/d7/d8/f31 [1011652,58883] 0 2024-09-13T22:56:17.721 INFO:tasks.workunit.client.1.smithi047.stdout:2/725: write d1/df/d1d/d3c/f56 [419362,121469] 0 2024-09-13T22:56:17.721 INFO:tasks.workunit.client.0.smithi002.stdout:2/633: fsync d1/d7/d41/fc2 0 2024-09-13T22:56:17.723 INFO:tasks.workunit.client.0.smithi002.stdout:3/710: getdents d9/d15/d36/d4e/d5e/dc0 0 2024-09-13T22:56:17.724 INFO:tasks.workunit.client.1.smithi047.stdout:6/704: dread d3/d77/d93/fa4 [0,4194304] 0 2024-09-13T22:56:17.725 INFO:tasks.workunit.client.0.smithi002.stdout:5/642: mkdir d1/de7 0 2024-09-13T22:56:17.727 INFO:tasks.workunit.client.1.smithi047.stdout:8/653: mkdir d8/d64/d4e/d4d/d8f/d91/de2 0 2024-09-13T22:56:17.728 INFO:tasks.workunit.client.0.smithi002.stdout:7/596: dread d8/fb [0,4194304] 0 2024-09-13T22:56:17.729 INFO:tasks.workunit.client.0.smithi002.stdout:9/694: write d8/d10/d1c/d3d/f92 [674969,39742] 0 2024-09-13T22:56:17.729 INFO:tasks.workunit.client.1.smithi047.stdout:5/618: mkdir d19/d25/d85/dc5 0 2024-09-13T22:56:17.730 INFO:tasks.workunit.client.1.smithi047.stdout:6/705: dread d3/d11/d2b/d1c/d4d/d69/dc2/dcd/fd1 [0,4194304] 0 2024-09-13T22:56:17.731 INFO:tasks.workunit.client.0.smithi002.stdout:9/695: chown d8/d10/d42/f76 0 1 2024-09-13T22:56:17.731 INFO:tasks.workunit.client.0.smithi002.stdout:7/597: write d8/d10/d11/d13/d26/d38/fac [837007,88988] 0 2024-09-13T22:56:17.732 INFO:tasks.workunit.client.1.smithi047.stdout:9/664: write d1/f24 [3970810,31688] 0 2024-09-13T22:56:17.732 INFO:tasks.workunit.client.1.smithi047.stdout:8/654: dread - d8/d64/d4e/d4d/d8f/d91/d78/fcc zero size 2024-09-13T22:56:17.733 INFO:tasks.workunit.client.0.smithi002.stdout:9/696: write d8/d10/d61/f81 [1713728,46802] 0 2024-09-13T22:56:17.733 INFO:tasks.workunit.client.0.smithi002.stdout:6/655: creat d12/d17/d34/d39/d8b/dcb/fd0 x:0 0 0 2024-09-13T22:56:17.736 INFO:tasks.workunit.client.0.smithi002.stdout:8/625: creat d3/dc/d16/d4b/fc1 x:0 0 0 2024-09-13T22:56:17.736 INFO:tasks.workunit.client.1.smithi047.stdout:7/696: dwrite d0/d7/da/d1e/f86 [0,4194304] 0 2024-09-13T22:56:17.737 INFO:tasks.workunit.client.1.smithi047.stdout:0/718: dwrite d1/d5/d11/d2f/f38 [0,4194304] 0 2024-09-13T22:56:17.737 INFO:tasks.workunit.client.1.smithi047.stdout:7/697: fdatasync d0/d7/fc6 0 2024-09-13T22:56:17.741 INFO:tasks.workunit.client.1.smithi047.stdout:2/726: mkdir d1/df/d26/d9f/df2 0 2024-09-13T22:56:17.747 INFO:tasks.workunit.client.0.smithi002.stdout:2/634: mknod d1/d80/cd1 0 2024-09-13T22:56:17.747 INFO:tasks.workunit.client.0.smithi002.stdout:0/648: readlink d1/lf 0 2024-09-13T22:56:17.750 INFO:tasks.workunit.client.0.smithi002.stdout:7/598: dwrite d8/d10/d11/d13/d26/d4c/fa7 [0,4194304] 0 2024-09-13T22:56:17.751 INFO:tasks.workunit.client.0.smithi002.stdout:2/635: read - d1/d7/d8/d2c/da4/fc0 zero size 2024-09-13T22:56:17.754 INFO:tasks.workunit.client.1.smithi047.stdout:3/737: dread d0/d3/d4/d16/d1c/f92 [0,4194304] 0 2024-09-13T22:56:17.755 INFO:tasks.workunit.client.0.smithi002.stdout:6/656: unlink d12/d17/d28/fac 0 2024-09-13T22:56:17.755 INFO:tasks.workunit.client.0.smithi002.stdout:8/626: dwrite d3/dc/d18/f81 [0,4194304] 0 2024-09-13T22:56:17.755 INFO:tasks.workunit.client.1.smithi047.stdout:3/738: stat d0/d3/d5e 0 2024-09-13T22:56:17.756 INFO:tasks.workunit.client.0.smithi002.stdout:9/697: mkdir d8/d10/d61/de4 0 2024-09-13T22:56:17.758 INFO:tasks.workunit.client.1.smithi047.stdout:2/727: creat d1/df/d26/d9f/ff3 x:0 0 0 2024-09-13T22:56:17.758 INFO:tasks.workunit.client.1.smithi047.stdout:0/719: dread d1/d5/f3f [0,4194304] 0 2024-09-13T22:56:17.760 INFO:tasks.workunit.client.1.smithi047.stdout:2/728: read d1/df/d1d/d20/d37/d7a/fbc [215201,61642] 0 2024-09-13T22:56:17.764 INFO:tasks.workunit.client.0.smithi002.stdout:4/588: sync 2024-09-13T22:56:17.767 INFO:tasks.workunit.client.1.smithi047.stdout:7/698: symlink d0/d7/le6 0 2024-09-13T22:56:17.770 INFO:tasks.workunit.client.1.smithi047.stdout:3/739: fdatasync d0/d3/d4/d16/d32/f39 0 2024-09-13T22:56:17.772 INFO:tasks.workunit.client.1.smithi047.stdout:3/740: write d0/d3/d4/f4c [3048775,60041] 0 2024-09-13T22:56:17.773 INFO:tasks.workunit.client.1.smithi047.stdout:9/665: dread d1/dc/d14/dd/d54/f37 [0,4194304] 0 2024-09-13T22:56:17.778 INFO:tasks.workunit.client.1.smithi047.stdout:2/729: fsync d1/df/d1d/d20/f2c 0 2024-09-13T22:56:17.780 INFO:tasks.workunit.client.1.smithi047.stdout:8/655: write d8/f9e [823681,84034] 0 2024-09-13T22:56:17.780 INFO:tasks.workunit.client.1.smithi047.stdout:0/720: dread d1/d5/f10 [0,4194304] 0 2024-09-13T22:56:17.780 INFO:tasks.workunit.client.1.smithi047.stdout:2/730: chown d1/df/l68 8 1 2024-09-13T22:56:17.784 INFO:tasks.workunit.client.1.smithi047.stdout:5/619: dwrite d19/d23/d32/f55 [0,4194304] 0 2024-09-13T22:56:17.789 INFO:tasks.workunit.client.1.smithi047.stdout:7/699: dwrite d0/d57/fe3 [0,4194304] 0 2024-09-13T22:56:17.790 INFO:tasks.workunit.client.1.smithi047.stdout:3/741: mknod d0/d3/d4/d16/d2c/de/d3d/ce4 0 2024-09-13T22:56:17.791 INFO:tasks.workunit.client.1.smithi047.stdout:8/656: dwrite d8/d6b/da9/fc0 [0,4194304] 0 2024-09-13T22:56:17.801 INFO:tasks.workunit.client.1.smithi047.stdout:6/706: dwrite d3/f26 [0,4194304] 0 2024-09-13T22:56:17.803 INFO:tasks.workunit.client.1.smithi047.stdout:0/721: rename d1/d5/d16/d23/d2d/l9e to d1/d5/d16/d97/leb 0 2024-09-13T22:56:17.805 INFO:tasks.workunit.client.1.smithi047.stdout:5/620: creat d19/d83/fc6 x:0 0 0 2024-09-13T22:56:17.808 INFO:tasks.workunit.client.1.smithi047.stdout:8/657: mkdir d8/d77/de3 0 2024-09-13T22:56:17.810 INFO:tasks.workunit.client.1.smithi047.stdout:3/742: unlink d0/d3/d4/d16/d2c/de/dcc/dd1/fbe 0 2024-09-13T22:56:17.812 INFO:tasks.workunit.client.1.smithi047.stdout:2/731: fdatasync d1/df/d1d/da9/fec 0 2024-09-13T22:56:17.820 INFO:tasks.workunit.client.1.smithi047.stdout:7/700: mkdir d0/d7/da/d1e/de7 0 2024-09-13T22:56:17.821 INFO:tasks.workunit.client.1.smithi047.stdout:9/666: link d1/dc/d14/da5/f99 d1/fd5 0 2024-09-13T22:56:17.825 INFO:tasks.workunit.client.1.smithi047.stdout:9/667: dread d1/dc/d14/dd/d54/fbf [0,4194304] 0 2024-09-13T22:56:17.832 INFO:tasks.workunit.client.1.smithi047.stdout:2/732: dread d1/df/d1d/da9/faf [0,4194304] 0 2024-09-13T22:56:17.833 INFO:tasks.workunit.client.1.smithi047.stdout:2/733: chown d1/df/d1d/d2e/fe7 1 1 2024-09-13T22:56:17.834 INFO:tasks.workunit.client.1.smithi047.stdout:5/621: getdents d19/d34/d42/d5d/d80 0 2024-09-13T22:56:17.837 INFO:tasks.workunit.client.1.smithi047.stdout:8/658: creat d8/d64/d4e/d4d/dda/fe4 x:0 0 0 2024-09-13T22:56:17.841 INFO:tasks.workunit.client.1.smithi047.stdout:5/622: dread d19/f1d [0,4194304] 0 2024-09-13T22:56:17.841 INFO:tasks.workunit.client.1.smithi047.stdout:6/707: dwrite d3/d11/f6b [0,4194304] 0 2024-09-13T22:56:17.843 INFO:tasks.workunit.client.1.smithi047.stdout:9/668: symlink d1/d5f/ld6 0 2024-09-13T22:56:17.844 INFO:tasks.workunit.client.1.smithi047.stdout:3/743: write d0/d3/d4/f9 [772906,51197] 0 2024-09-13T22:56:17.845 INFO:tasks.workunit.client.1.smithi047.stdout:3/744: rename d0/d3 to d0/d3/d4/d91/dd5/de5 22 2024-09-13T22:56:17.846 INFO:tasks.workunit.client.1.smithi047.stdout:5/623: dread d19/d23/d32/f55 [0,4194304] 0 2024-09-13T22:56:17.850 INFO:tasks.workunit.client.1.smithi047.stdout:2/734: creat d1/df/d1d/d20/d29/ff4 x:0 0 0 2024-09-13T22:56:17.853 INFO:tasks.workunit.client.1.smithi047.stdout:7/701: dwrite d0/d7/f6 [0,4194304] 0 2024-09-13T22:56:17.855 INFO:tasks.workunit.client.1.smithi047.stdout:7/702: write d0/db/f16 [1946553,121538] 0 2024-09-13T22:56:17.857 INFO:tasks.workunit.client.1.smithi047.stdout:7/703: chown d0/d57/d5b/d5c/l6d 639 1 2024-09-13T22:56:17.864 INFO:tasks.workunit.client.0.smithi002.stdout:7/599: creat d8/d10/d11/d13/d2e/d50/d85/fb0 x:0 0 0 2024-09-13T22:56:17.865 INFO:tasks.workunit.client.1.smithi047.stdout:0/722: getdents d1/d5/d16/d47/dde 0 2024-09-13T22:56:17.867 INFO:tasks.workunit.client.0.smithi002.stdout:6/657: write d12/d17/f48 [2995248,15419] 0 2024-09-13T22:56:17.877 INFO:tasks.workunit.client.0.smithi002.stdout:5/643: link d1/d2a/d6b/d88/fbf d1/d2a/d6b/d88/d55/d56/dc7/fe8 0 2024-09-13T22:56:17.884 INFO:tasks.workunit.client.0.smithi002.stdout:8/627: dwrite d3/dc/d18/d2e/d94/f7b [0,4194304] 0 2024-09-13T22:56:17.884 INFO:tasks.workunit.client.0.smithi002.stdout:0/649: dwrite d1/d2/f18 [0,4194304] 0 2024-09-13T22:56:17.885 INFO:tasks.workunit.client.0.smithi002.stdout:9/698: link d8/d10/d61/fcb d8/d10/db1/fe5 0 2024-09-13T22:56:17.886 INFO:tasks.workunit.client.0.smithi002.stdout:4/589: symlink d3/d14/d85/lb4 0 2024-09-13T22:56:17.891 INFO:tasks.workunit.client.0.smithi002.stdout:0/650: creat d1/d4/d75/d31/d32/dbb/fe7 x:0 0 0 2024-09-13T22:56:17.891 INFO:tasks.workunit.client.0.smithi002.stdout:1/668: sync 2024-09-13T22:56:17.891 INFO:tasks.workunit.client.0.smithi002.stdout:3/711: sync 2024-09-13T22:56:17.891 INFO:tasks.workunit.client.0.smithi002.stdout:2/636: sync 2024-09-13T22:56:17.892 INFO:tasks.workunit.client.0.smithi002.stdout:1/669: chown d1/d13/d30/f99 0 1 2024-09-13T22:56:17.892 INFO:tasks.workunit.client.0.smithi002.stdout:3/712: chown d9/dd1/fee 132326677 1 2024-09-13T22:56:17.893 INFO:tasks.workunit.client.0.smithi002.stdout:3/713: write d9/d15/fd6 [972779,36346] 0 2024-09-13T22:56:17.893 INFO:tasks.workunit.client.0.smithi002.stdout:1/670: read - d1/d13/d30/dc1/fc7 zero size 2024-09-13T22:56:17.894 INFO:tasks.workunit.client.0.smithi002.stdout:3/714: chown d9/d15/fd6 92925468 1 2024-09-13T22:56:17.895 INFO:tasks.workunit.client.0.smithi002.stdout:6/658: rename f5 to d12/d17/fd1 0 2024-09-13T22:56:17.900 INFO:tasks.workunit.client.0.smithi002.stdout:2/637: mkdir d1/d4d/d8b/dd2 0 2024-09-13T22:56:17.900 INFO:tasks.workunit.client.0.smithi002.stdout:5/644: link d1/d10/l3c d1/d2a/d6b/d88/d55/d56/de4/le9 0 2024-09-13T22:56:17.900 INFO:tasks.workunit.client.0.smithi002.stdout:0/651: symlink d1/d2/d6c/d8b/le8 0 2024-09-13T22:56:17.901 INFO:tasks.workunit.client.0.smithi002.stdout:0/652: fdatasync d1/d4/f3e 0 2024-09-13T22:56:17.902 INFO:tasks.workunit.client.0.smithi002.stdout:5/645: chown d1/d2a/d6b/d88/d45/d4f/d78/f79 18712 1 2024-09-13T22:56:17.903 INFO:tasks.workunit.client.0.smithi002.stdout:7/600: truncate d8/f5d 2502647 0 2024-09-13T22:56:17.904 INFO:tasks.workunit.client.0.smithi002.stdout:5/646: readlink d1/d2a/d69/l93 0 2024-09-13T22:56:17.904 INFO:tasks.workunit.client.0.smithi002.stdout:3/715: read - d9/d91/fbc zero size 2024-09-13T22:56:17.906 INFO:tasks.workunit.client.0.smithi002.stdout:3/716: chown d9/c99 848796717 1 2024-09-13T22:56:17.907 INFO:tasks.workunit.client.0.smithi002.stdout:0/653: dread d1/d2/f18 [0,4194304] 0 2024-09-13T22:56:17.908 INFO:tasks.workunit.client.0.smithi002.stdout:1/671: truncate d1/d13/d30/d31/fa8 1432486 0 2024-09-13T22:56:17.910 INFO:tasks.workunit.client.0.smithi002.stdout:1/672: truncate d1/d13/d30/d73/fbb 882880 0 2024-09-13T22:56:17.911 INFO:tasks.workunit.client.0.smithi002.stdout:9/699: rename d8/d2c/f47 to d8/d91/d96/da8/dc3/fe6 0 2024-09-13T22:56:17.912 INFO:tasks.workunit.client.0.smithi002.stdout:4/590: rename d3/d14 to d3/d14/d29/d2a/da6/d69/db5 22 2024-09-13T22:56:17.915 INFO:tasks.workunit.client.0.smithi002.stdout:6/659: creat d12/d17/fd2 x:0 0 0 2024-09-13T22:56:17.933 INFO:tasks.workunit.client.1.smithi047.stdout:4/843: sync 2024-09-13T22:56:17.935 INFO:tasks.workunit.client.1.smithi047.stdout:1/802: sync 2024-09-13T22:56:17.935 INFO:tasks.workunit.client.0.smithi002.stdout:1/673: mknod d1/d13/d30/d31/d3b/d71/d80/ce5 0 2024-09-13T22:56:17.936 INFO:tasks.workunit.client.0.smithi002.stdout:9/700: creat d8/d10/d1c/d68/fe7 x:0 0 0 2024-09-13T22:56:17.937 INFO:tasks.workunit.client.0.smithi002.stdout:2/638: rmdir d1/d7/d52/daa/db5 0 2024-09-13T22:56:17.937 INFO:tasks.workunit.client.0.smithi002.stdout:5/647: write d1/d2a/d6b/d88/d45/d4f/d8f/f94 [488818,117499] 0 2024-09-13T22:56:17.937 INFO:tasks.workunit.client.0.smithi002.stdout:0/654: creat d1/d4/d75/d31/d32/dbb/de1/fe9 x:0 0 0 2024-09-13T22:56:17.939 INFO:tasks.workunit.client.0.smithi002.stdout:4/591: creat d3/d62/fb6 x:0 0 0 2024-09-13T22:56:17.940 INFO:tasks.workunit.client.0.smithi002.stdout:7/601: getdents d8/d10/d11/d13/d2e/d50/d85 0 2024-09-13T22:56:17.943 INFO:tasks.workunit.client.0.smithi002.stdout:0/655: creat d1/d4/d75/fea x:0 0 0 2024-09-13T22:56:17.945 INFO:tasks.workunit.client.0.smithi002.stdout:4/592: symlink d3/d14/d85/lb7 0 2024-09-13T22:56:17.946 INFO:tasks.workunit.client.0.smithi002.stdout:9/701: write d8/d91/d96/d87/da5/f9a [339925,35736] 0 2024-09-13T22:56:17.947 INFO:tasks.workunit.client.0.smithi002.stdout:6/660: dwrite d12/d17/d34/d39/d8a/fc2 [0,4194304] 0 2024-09-13T22:56:17.949 INFO:tasks.workunit.client.0.smithi002.stdout:2/639: symlink d1/d7/d41/d96/dba/ld3 0 2024-09-13T22:56:17.950 INFO:tasks.workunit.client.0.smithi002.stdout:0/656: write d1/d2/f7a [2284022,54274] 0 2024-09-13T22:56:17.956 INFO:tasks.workunit.client.0.smithi002.stdout:9/702: truncate d8/d91/d96/f8b 1595952 0 2024-09-13T22:56:17.956 INFO:tasks.workunit.client.0.smithi002.stdout:1/674: truncate d1/d13/d30/d73/fbb 69285 0 2024-09-13T22:56:17.957 INFO:tasks.workunit.client.0.smithi002.stdout:5/648: dwrite d1/d2a/d6b/d88/d45/f91 [0,4194304] 0 2024-09-13T22:56:17.958 INFO:tasks.workunit.client.0.smithi002.stdout:2/640: fsync d1/d80/fbb 0 2024-09-13T22:56:17.960 INFO:tasks.workunit.client.0.smithi002.stdout:7/602: dwrite d8/d10/d11/d13/d26/d38/f9e [0,4194304] 0 2024-09-13T22:56:17.960 INFO:tasks.workunit.client.0.smithi002.stdout:4/593: write d3/d14/d29/d2a/f63 [4201922,36634] 0 2024-09-13T22:56:17.963 INFO:tasks.workunit.client.0.smithi002.stdout:9/703: creat d8/d10/db1/fe8 x:0 0 0 2024-09-13T22:56:17.966 INFO:tasks.workunit.client.0.smithi002.stdout:1/675: truncate d1/d13/d30/dc1/fc7 306623 0 2024-09-13T22:56:17.967 INFO:tasks.workunit.client.0.smithi002.stdout:7/603: mkdir d8/d10/d11/d13/d2e/d50/d52/db1 0 2024-09-13T22:56:17.969 INFO:tasks.workunit.client.0.smithi002.stdout:2/641: mkdir d1/d7/d8/d2c/d9d/dab/dd4 0 2024-09-13T22:56:17.969 INFO:tasks.workunit.client.0.smithi002.stdout:6/661: write d12/d17/d34/d39/f9e [195890,19278] 0 2024-09-13T22:56:17.971 INFO:tasks.workunit.client.0.smithi002.stdout:0/657: truncate d1/d2/d81/d8f/f5d 789840 0 2024-09-13T22:56:17.973 INFO:tasks.workunit.client.0.smithi002.stdout:4/594: rename d3/c54 to d3/d62/cb8 0 2024-09-13T22:56:17.975 INFO:tasks.workunit.client.0.smithi002.stdout:5/649: creat d1/d2a/d6b/d88/d55/d56/dc7/fea x:0 0 0 2024-09-13T22:56:17.976 INFO:tasks.workunit.client.0.smithi002.stdout:4/595: read d3/d14/d29/d2a/f60 [3715043,73819] 0 2024-09-13T22:56:17.978 INFO:tasks.workunit.client.0.smithi002.stdout:4/596: chown d3/d14/d29/d2a/da6/c92 192 1 2024-09-13T22:56:17.979 INFO:tasks.workunit.client.0.smithi002.stdout:6/662: rename d12/d17/f20 to d12/d17/d28/d67/d6b/daa/fd3 0 2024-09-13T22:56:17.980 INFO:tasks.workunit.client.0.smithi002.stdout:1/676: dread d1/d13/f32 [0,4194304] 0 2024-09-13T22:56:17.980 INFO:tasks.workunit.client.0.smithi002.stdout:7/604: mkdir d8/d10/d11/d13/d2e/d3c/db2 0 2024-09-13T22:56:17.981 INFO:tasks.workunit.client.0.smithi002.stdout:8/628: sync 2024-09-13T22:56:17.981 INFO:tasks.workunit.client.0.smithi002.stdout:2/642: symlink d1/d7/d8/d51/ld5 0 2024-09-13T22:56:17.985 INFO:tasks.workunit.client.0.smithi002.stdout:9/704: dwrite d8/fe [8388608,4194304] 0 2024-09-13T22:56:17.987 INFO:tasks.workunit.client.0.smithi002.stdout:8/629: stat d3/dc/d18/c9a 0 2024-09-13T22:56:17.989 INFO:tasks.workunit.client.0.smithi002.stdout:7/605: fsync d8/d10/d11/d13/d26/d4c/d81/d51/f66 0 2024-09-13T22:56:17.989 INFO:tasks.workunit.client.0.smithi002.stdout:4/597: mkdir d3/db3/db9 0 2024-09-13T22:56:17.990 INFO:tasks.workunit.client.0.smithi002.stdout:9/705: chown d8/d10/d1c/c24 257596992 1 2024-09-13T22:56:17.991 INFO:tasks.workunit.client.0.smithi002.stdout:5/650: dwrite d1/d2a/d69/f73 [0,4194304] 0 2024-09-13T22:56:17.991 INFO:tasks.workunit.client.0.smithi002.stdout:0/658: link d1/d2/c9b d1/d4/d75/d31/d32/dce/ceb 0 2024-09-13T22:56:17.996 INFO:tasks.workunit.client.0.smithi002.stdout:9/706: creat d8/d2c/dbc/fe9 x:0 0 0 2024-09-13T22:56:17.996 INFO:tasks.workunit.client.0.smithi002.stdout:1/677: creat d1/d13/d30/fe6 x:0 0 0 2024-09-13T22:56:17.998 INFO:tasks.workunit.client.0.smithi002.stdout:5/651: write d1/d2a/d6b/d88/d45/f91 [4418216,62956] 0 2024-09-13T22:56:17.999 INFO:tasks.workunit.client.0.smithi002.stdout:2/643: dwrite d1/f1d [0,4194304] 0 2024-09-13T22:56:18.005 INFO:tasks.workunit.client.0.smithi002.stdout:6/663: truncate d12/f5c 738130 0 2024-09-13T22:56:18.006 INFO:tasks.workunit.client.0.smithi002.stdout:4/598: truncate d3/d14/d85/f8d 1748929 0 2024-09-13T22:56:18.007 INFO:tasks.workunit.client.0.smithi002.stdout:0/659: creat d1/d4/d75/d31/de0/fec x:0 0 0 2024-09-13T22:56:18.008 INFO:tasks.workunit.client.0.smithi002.stdout:7/606: dwrite d8/d10/d11/d13/f79 [4194304,4194304] 0 2024-09-13T22:56:18.011 INFO:tasks.workunit.client.0.smithi002.stdout:2/644: mkdir d1/d7/d8/d51/dd6 0 2024-09-13T22:56:18.013 INFO:tasks.workunit.client.0.smithi002.stdout:5/652: rename d1 to d1/d2a/d6b/d88/d45/deb 22 2024-09-13T22:56:18.017 INFO:tasks.workunit.client.0.smithi002.stdout:2/645: readlink d1/d32/d37/lc5 0 2024-09-13T22:56:18.017 INFO:tasks.workunit.client.0.smithi002.stdout:1/678: dwrite d1/d13/d30/d31/d3d/db6/fd0 [0,4194304] 0 2024-09-13T22:56:18.019 INFO:tasks.workunit.client.1.smithi047.stdout:5/624: rmdir d19 39 2024-09-13T22:56:18.020 INFO:tasks.workunit.client.0.smithi002.stdout:2/646: creat d1/d7/d35/d3e/d5e/fd7 x:0 0 0 2024-09-13T22:56:18.021 INFO:tasks.workunit.client.0.smithi002.stdout:9/707: link d8/d10/d1c/dbf/fc5 d8/d91/d96/d87/fea 0 2024-09-13T22:56:18.021 INFO:tasks.workunit.client.1.smithi047.stdout:9/669: write d1/dc/d14/f4d [2245707,98083] 0 2024-09-13T22:56:18.021 INFO:tasks.workunit.client.1.smithi047.stdout:3/745: write d0/d3/f15 [1692414,123624] 0 2024-09-13T22:56:18.022 INFO:tasks.workunit.client.1.smithi047.stdout:7/704: chown d0/d57/d5b/f8a 363649687 1 2024-09-13T22:56:18.022 INFO:tasks.workunit.client.0.smithi002.stdout:6/664: symlink d12/d17/ld4 0 2024-09-13T22:56:18.026 INFO:tasks.workunit.client.0.smithi002.stdout:0/660: write d1/d2/d6c/d8b/f8c [3003793,75044] 0 2024-09-13T22:56:18.030 INFO:tasks.workunit.client.0.smithi002.stdout:4/599: rename d3/d14/d29/d2a/da6/f4f to d3/d14/d29/d2a/da6/d5e/fba 0 2024-09-13T22:56:18.033 INFO:tasks.workunit.client.0.smithi002.stdout:5/653: dwrite d1/d2a/d6b/d88/fe1 [0,4194304] 0 2024-09-13T22:56:18.038 INFO:tasks.workunit.client.1.smithi047.stdout:0/723: rename d1/d5/d11/f35 to d1/d5/d16/d97/de4/fec 0 2024-09-13T22:56:18.040 INFO:tasks.workunit.client.0.smithi002.stdout:1/679: truncate d1/d13/d21/d39/f9c 1002502 0 2024-09-13T22:56:18.040 INFO:tasks.workunit.client.0.smithi002.stdout:1/680: chown d1/d13/d30/d31/d3d/f6a 3 1 2024-09-13T22:56:18.042 INFO:tasks.workunit.client.1.smithi047.stdout:8/659: mkdir d8/d64/d4e/d4d/d8f/d91/d40/de5 0 2024-09-13T22:56:18.042 INFO:tasks.workunit.client.1.smithi047.stdout:7/705: dread d0/d7/f36 [0,4194304] 0 2024-09-13T22:56:18.047 INFO:tasks.workunit.client.1.smithi047.stdout:4/844: write dc/de/d23/f81 [638269,27809] 0 2024-09-13T22:56:18.047 INFO:tasks.workunit.client.0.smithi002.stdout:9/708: dread d8/d10/d42/f76 [0,4194304] 0 2024-09-13T22:56:18.051 INFO:tasks.workunit.client.0.smithi002.stdout:9/709: dread - d8/d91/d96/da8/dc3/fd1 zero size 2024-09-13T22:56:18.051 INFO:tasks.workunit.client.1.smithi047.stdout:1/803: write d0/d7/f4e [1056575,958] 0 2024-09-13T22:56:18.052 INFO:tasks.workunit.client.1.smithi047.stdout:3/746: mknod d0/d3/d4/d16/d32/d76/ce6 0 2024-09-13T22:56:18.053 INFO:tasks.workunit.client.0.smithi002.stdout:9/710: fsync d8/d91/d96/da8/dc3/fd1 0 2024-09-13T22:56:18.053 INFO:tasks.workunit.client.0.smithi002.stdout:6/665: dwrite d12/d17/d34/fa9 [0,4194304] 0 2024-09-13T22:56:18.053 INFO:tasks.workunit.client.1.smithi047.stdout:5/625: dread d19/d34/d42/f48 [0,4194304] 0 2024-09-13T22:56:18.055 INFO:tasks.workunit.client.0.smithi002.stdout:2/647: write d1/d32/d37/d79/f84 [630806,65468] 0 2024-09-13T22:56:18.058 INFO:tasks.workunit.client.0.smithi002.stdout:7/607: dwrite d8/d10/d11/d13/d2e/d50/d52/d72/f8c [0,4194304] 0 2024-09-13T22:56:18.059 INFO:tasks.workunit.client.0.smithi002.stdout:7/608: stat d8/d10/f89 0 2024-09-13T22:56:18.062 INFO:tasks.workunit.client.1.smithi047.stdout:2/735: mkdir d1/df/d35/dd7/dca/df5 0 2024-09-13T22:56:18.065 INFO:tasks.workunit.client.0.smithi002.stdout:5/654: creat d1/d2a/d69/fec x:0 0 0 2024-09-13T22:56:18.069 INFO:tasks.workunit.client.0.smithi002.stdout:0/661: dwrite d1/d4/d75/d76/f85 [0,4194304] 0 2024-09-13T22:56:18.071 INFO:tasks.workunit.client.0.smithi002.stdout:1/681: chown d1/d13/d21/c83 13 1 2024-09-13T22:56:18.071 INFO:tasks.workunit.client.1.smithi047.stdout:7/706: mkdir d0/db/de8 0 2024-09-13T22:56:18.074 INFO:tasks.workunit.client.1.smithi047.stdout:4/845: rmdir dc/de/d17/d70 39 2024-09-13T22:56:18.080 INFO:tasks.workunit.client.1.smithi047.stdout:3/747: unlink d0/d3/d4/d16/d32/d42/ld4 0 2024-09-13T22:56:18.082 INFO:tasks.workunit.client.0.smithi002.stdout:2/648: creat d1/d7/d8/d2c/d9d/fd8 x:0 0 0 2024-09-13T22:56:18.083 INFO:tasks.workunit.client.1.smithi047.stdout:2/736: creat d1/df/d1d/da9/ff6 x:0 0 0 2024-09-13T22:56:18.084 INFO:tasks.workunit.client.0.smithi002.stdout:7/609: symlink d8/d10/d11/d13/lb3 0 2024-09-13T22:56:18.085 INFO:tasks.workunit.client.0.smithi002.stdout:4/600: getdents d3/db3/db9 0 2024-09-13T22:56:18.086 INFO:tasks.workunit.client.1.smithi047.stdout:2/737: dread d1/df/d1d/da9/faf [0,4194304] 0 2024-09-13T22:56:18.087 INFO:tasks.workunit.client.0.smithi002.stdout:5/655: chown d1/d2a/d6b/d88/l6a 120 1 2024-09-13T22:56:18.087 INFO:tasks.workunit.client.1.smithi047.stdout:7/707: mknod d0/d7/da/d1e/d93/db7/ce9 0 2024-09-13T22:56:18.088 INFO:tasks.workunit.client.0.smithi002.stdout:2/649: dwrite d1/d4d/fac [0,4194304] 0 2024-09-13T22:56:18.089 INFO:tasks.workunit.client.0.smithi002.stdout:5/656: read d1/d2a/d6b/d88/fbf [2387172,85212] 0 2024-09-13T22:56:18.089 INFO:tasks.workunit.client.0.smithi002.stdout:2/650: write d1/f6a [2324509,77258] 0 2024-09-13T22:56:18.095 INFO:tasks.workunit.client.0.smithi002.stdout:0/662: dread d1/d4/d75/d31/d32/f39 [0,4194304] 0 2024-09-13T22:56:18.098 INFO:tasks.workunit.client.0.smithi002.stdout:9/711: truncate d8/d1e/fac 597283 0 2024-09-13T22:56:18.098 INFO:tasks.workunit.client.1.smithi047.stdout:7/708: dwrite d0/d7/da/d47/fa1 [0,4194304] 0 2024-09-13T22:56:18.098 INFO:tasks.workunit.client.1.smithi047.stdout:1/804: symlink d0/d7/d10/d55/le9 0 2024-09-13T22:56:18.101 INFO:tasks.workunit.client.1.smithi047.stdout:7/709: read d0/d7/f87 [1731529,80680] 0 2024-09-13T22:56:18.103 INFO:tasks.workunit.client.1.smithi047.stdout:8/660: dwrite d8/d64/d4e/d4d/f6a [0,4194304] 0 2024-09-13T22:56:18.105 INFO:tasks.workunit.client.0.smithi002.stdout:3/717: sync 2024-09-13T22:56:18.105 INFO:tasks.workunit.client.0.smithi002.stdout:8/630: sync 2024-09-13T22:56:18.108 INFO:tasks.workunit.client.1.smithi047.stdout:0/724: mknod d1/d5/d11/d52/ced 0 2024-09-13T22:56:18.109 INFO:tasks.workunit.client.0.smithi002.stdout:7/610: rename d8/c3b to d8/d10/d11/d13/d26/d88/cb4 0 2024-09-13T22:56:18.110 INFO:tasks.workunit.client.1.smithi047.stdout:4/846: dwrite dc/de/d17/d25/d4a/fa4 [0,4194304] 0 2024-09-13T22:56:18.112 INFO:tasks.workunit.client.0.smithi002.stdout:2/651: dread - d1/d32/d37/d79/f7c zero size 2024-09-13T22:56:18.113 INFO:tasks.workunit.client.0.smithi002.stdout:2/652: write d1/d4d/f71 [511366,16364] 0 2024-09-13T22:56:18.114 INFO:tasks.workunit.client.1.smithi047.stdout:2/738: creat d1/df/d1d/d20/d2b/ff7 x:0 0 0 2024-09-13T22:56:18.117 INFO:tasks.workunit.client.1.smithi047.stdout:9/670: getdents d1/dc/d14/dd/d54/d8d 0 2024-09-13T22:56:18.120 INFO:tasks.workunit.client.0.smithi002.stdout:8/631: dread d3/dc/d18/d56/f7c [0,4194304] 0 2024-09-13T22:56:18.120 INFO:tasks.workunit.client.1.smithi047.stdout:5/626: creat d19/d23/fc7 x:0 0 0 2024-09-13T22:56:18.123 INFO:tasks.workunit.client.1.smithi047.stdout:8/661: rmdir d8/d64/d4e/d4d/d8f/d91 39 2024-09-13T22:56:18.124 INFO:tasks.workunit.client.0.smithi002.stdout:9/712: dwrite d8/d10/d1c/d3d/f9e [0,4194304] 0 2024-09-13T22:56:18.125 INFO:tasks.workunit.client.0.smithi002.stdout:7/611: truncate d8/d10/d11/d13/d2e/f9d 929937 0 2024-09-13T22:56:18.125 INFO:tasks.workunit.client.0.smithi002.stdout:7/612: chown d8/f5d 878873 1 2024-09-13T22:56:18.126 INFO:tasks.workunit.client.0.smithi002.stdout:7/613: fsync d8/d10/d11/d13/d26/d4c/f4e 0 2024-09-13T22:56:18.132 INFO:tasks.workunit.client.1.smithi047.stdout:3/748: rename d0/d3/d5e/fb9 to d0/d3/d4/d16/d2c/de/dcc/dd1/fe7 0 2024-09-13T22:56:18.135 INFO:tasks.workunit.client.0.smithi002.stdout:1/682: creat d1/d13/d30/fe7 x:0 0 0 2024-09-13T22:56:18.137 INFO:tasks.workunit.client.0.smithi002.stdout:0/663: creat d1/d7e/d9d/de6/fed x:0 0 0 2024-09-13T22:56:18.137 INFO:tasks.workunit.client.0.smithi002.stdout:2/653: dread d1/d7/d35/f48 [0,4194304] 0 2024-09-13T22:56:18.139 INFO:tasks.workunit.client.0.smithi002.stdout:6/666: getdents d12/d17/d2a/d88 0 2024-09-13T22:56:18.139 INFO:tasks.workunit.client.0.smithi002.stdout:2/654: write d1/d4d/d8b/fb9 [89706,130160] 0 2024-09-13T22:56:18.140 INFO:tasks.workunit.client.1.smithi047.stdout:6/708: sync 2024-09-13T22:56:18.144 INFO:tasks.workunit.client.0.smithi002.stdout:8/632: creat d3/dc/d16/d2f/d83/d95/fc2 x:0 0 0 2024-09-13T22:56:18.144 INFO:tasks.workunit.client.0.smithi002.stdout:8/633: chown d3/dc/d18/l52 49 1 2024-09-13T22:56:18.147 INFO:tasks.workunit.client.0.smithi002.stdout:1/683: dread d1/d13/f3f [0,4194304] 0 2024-09-13T22:56:18.147 INFO:tasks.workunit.client.1.smithi047.stdout:2/739: dwrite d1/df/d1d/d2e/fa7 [0,4194304] 0 2024-09-13T22:56:18.148 INFO:tasks.workunit.client.0.smithi002.stdout:1/684: chown d1/d13/d21/ccb 23 1 2024-09-13T22:56:18.148 INFO:tasks.workunit.client.1.smithi047.stdout:4/847: mknod dc/de/d17/d25/c123 0 2024-09-13T22:56:18.149 INFO:tasks.workunit.client.1.smithi047.stdout:7/710: truncate d0/d7/da/d1e/f86 506823 0 2024-09-13T22:56:18.152 INFO:tasks.workunit.client.1.smithi047.stdout:1/805: truncate d0/d7/d13/d2d/fde 308104 0 2024-09-13T22:56:18.153 INFO:tasks.workunit.client.1.smithi047.stdout:1/806: write d0/d7/d14/fa1 [830219,66206] 0 2024-09-13T22:56:18.155 INFO:tasks.workunit.client.1.smithi047.stdout:0/725: truncate d1/d5/d16/d23/d2d/fc3 6080059 0 2024-09-13T22:56:18.156 INFO:tasks.workunit.client.0.smithi002.stdout:9/713: mkdir d8/d91/d96/d87/da5/d94/deb 0 2024-09-13T22:56:18.157 INFO:tasks.workunit.client.0.smithi002.stdout:9/714: readlink d8/d2c/dbc/dc8/dd0/le3 0 2024-09-13T22:56:18.158 INFO:tasks.workunit.client.1.smithi047.stdout:9/671: symlink d1/dc/d14/dd/ld7 0 2024-09-13T22:56:18.160 INFO:tasks.workunit.client.0.smithi002.stdout:7/614: rmdir d8/d10/d11/d13/d2e/d50 39 2024-09-13T22:56:18.162 INFO:tasks.workunit.client.0.smithi002.stdout:7/615: write d8/d10/d11/d13/d26/d38/fac [682453,2446] 0 2024-09-13T22:56:18.164 INFO:tasks.workunit.client.1.smithi047.stdout:3/749: chown d0/d3/d4/d16/d73/fd8 1 1 2024-09-13T22:56:18.171 INFO:tasks.workunit.client.1.smithi047.stdout:6/709: rmdir d3/d11/d2b/d1c/dca 39 2024-09-13T22:56:18.174 INFO:tasks.workunit.client.0.smithi002.stdout:0/664: dwrite d1/d2/f45 [0,4194304] 0 2024-09-13T22:56:18.175 INFO:tasks.workunit.client.0.smithi002.stdout:0/665: readlink d1/d2/d6c/lb9 0 2024-09-13T22:56:18.176 INFO:tasks.workunit.client.1.smithi047.stdout:4/848: mknod dc/de/d23/d40/d7b/dab/c124 0 2024-09-13T22:56:18.178 INFO:tasks.workunit.client.0.smithi002.stdout:2/655: creat d1/da9/fd9 x:0 0 0 2024-09-13T22:56:18.178 INFO:tasks.workunit.client.1.smithi047.stdout:2/740: truncate d1/df/d1d/d20/d54/f72 105619 0 2024-09-13T22:56:18.179 INFO:tasks.workunit.client.0.smithi002.stdout:6/667: dread d12/d17/d4e/f61 [0,4194304] 0 2024-09-13T22:56:18.180 INFO:tasks.workunit.client.0.smithi002.stdout:8/634: mknod d3/dc/d16/d60/db4/cc3 0 2024-09-13T22:56:18.182 INFO:tasks.workunit.client.0.smithi002.stdout:1/685: write d1/d13/d30/d31/d3d/fe0 [5164689,53649] 0 2024-09-13T22:56:18.186 INFO:tasks.workunit.client.0.smithi002.stdout:4/601: link d3/d14/fad d3/d14/d85/fbb 0 2024-09-13T22:56:18.188 INFO:tasks.workunit.client.1.smithi047.stdout:5/627: dwrite d19/d23/d32/d69/f70 [0,4194304] 0 2024-09-13T22:56:18.189 INFO:tasks.workunit.client.1.smithi047.stdout:1/807: mkdir d0/d7/d14/d57/d62/d76/d94/dea 0 2024-09-13T22:56:18.190 INFO:tasks.workunit.client.0.smithi002.stdout:9/715: symlink d8/d91/d96/da8/lec 0 2024-09-13T22:56:18.191 INFO:tasks.workunit.client.0.smithi002.stdout:9/716: write d8/d10/d1c/f15 [3245792,56361] 0 2024-09-13T22:56:18.192 INFO:tasks.workunit.client.0.smithi002.stdout:9/717: dread - d8/d91/fab zero size 2024-09-13T22:56:18.192 INFO:tasks.workunit.client.1.smithi047.stdout:9/672: symlink d1/dc/d14/da5/ld8 0 2024-09-13T22:56:18.194 INFO:tasks.workunit.client.0.smithi002.stdout:9/718: write d8/d10/db1/fe8 [603326,100339] 0 2024-09-13T22:56:18.194 INFO:tasks.workunit.client.0.smithi002.stdout:5/657: getdents d1/d2a/d6b/d88/d55/d56/dc7 0 2024-09-13T22:56:18.195 INFO:tasks.workunit.client.0.smithi002.stdout:7/616: mkdir d8/d10/d11/d13/d26/d4c/d81/db5 0 2024-09-13T22:56:18.196 INFO:tasks.workunit.client.1.smithi047.stdout:6/710: read - d3/d77/d93/fa3 zero size 2024-09-13T22:56:18.197 INFO:tasks.workunit.client.0.smithi002.stdout:7/617: write d8/d10/d11/d13/d26/d4c/f8a [4314380,109077] 0 2024-09-13T22:56:18.198 INFO:tasks.workunit.client.0.smithi002.stdout:0/666: read d1/d4/da3/d7d/f9c [182238,91477] 0 2024-09-13T22:56:18.199 INFO:tasks.workunit.client.0.smithi002.stdout:2/656: rmdir d1/d7/d35/d78 39 2024-09-13T22:56:18.201 INFO:tasks.workunit.client.1.smithi047.stdout:2/741: unlink d1/df/d1d/d20/d54/f95 0 2024-09-13T22:56:18.203 INFO:tasks.workunit.client.1.smithi047.stdout:2/742: stat d1/df/d1d/d20/d37/d7b/db6/de9/ded 0 2024-09-13T22:56:18.204 INFO:tasks.workunit.client.0.smithi002.stdout:6/668: symlink d12/d17/d34/d39/d8b/ld5 0 2024-09-13T22:56:18.205 INFO:tasks.workunit.client.1.smithi047.stdout:0/726: dread d1/d5/d16/d23/d45/f4f [0,4194304] 0 2024-09-13T22:56:18.205 INFO:tasks.workunit.client.0.smithi002.stdout:8/635: creat d3/d21/d57/fc4 x:0 0 0 2024-09-13T22:56:18.205 INFO:tasks.workunit.client.1.smithi047.stdout:0/727: chown d1/d5/f59 80 1 2024-09-13T22:56:18.208 INFO:tasks.workunit.client.0.smithi002.stdout:1/686: unlink d1/d13/f19 0 2024-09-13T22:56:18.209 INFO:tasks.workunit.client.0.smithi002.stdout:3/718: rename d9/d15/d36/d4e/d5e/fd3 to d9/d15/d36/d4e/d5e/f105 0 2024-09-13T22:56:18.209 INFO:tasks.workunit.client.0.smithi002.stdout:1/687: readlink d1/d13/d30/d31/d3b/d71/le4 0 2024-09-13T22:56:18.211 INFO:tasks.workunit.client.1.smithi047.stdout:9/673: creat d1/dc/d14/dd/d54/d8d/fd9 x:0 0 0 2024-09-13T22:56:18.213 INFO:tasks.workunit.client.1.smithi047.stdout:3/750: link d0/d3/d4/d16/d2c/de/d1f/d3b/f51 d0/d3/d5e/fe8 0 2024-09-13T22:56:18.214 INFO:tasks.workunit.client.0.smithi002.stdout:5/658: symlink d1/d2a/d6b/d88/d45/d4f/da7/daa/led 0 2024-09-13T22:56:18.215 INFO:tasks.workunit.client.1.smithi047.stdout:4/849: link dc/d29/d6c/f113 dc/de/d17/d25/d4a/d11c/f125 0 2024-09-13T22:56:18.217 INFO:tasks.workunit.client.0.smithi002.stdout:6/669: dread d12/d17/d28/f2e [8388608,4194304] 0 2024-09-13T22:56:18.217 INFO:tasks.workunit.client.1.smithi047.stdout:6/711: mknod d3/d11/d2b/d76/ce7 0 2024-09-13T22:56:18.218 INFO:tasks.workunit.client.1.smithi047.stdout:6/712: chown d3/d11/d2b/fe4 293 1 2024-09-13T22:56:18.218 INFO:tasks.workunit.client.0.smithi002.stdout:8/636: dread d3/d21/f58 [0,4194304] 0 2024-09-13T22:56:18.218 INFO:tasks.workunit.client.0.smithi002.stdout:7/618: write d8/d10/d39/f9b [1656224,83704] 0 2024-09-13T22:56:18.219 INFO:tasks.workunit.client.0.smithi002.stdout:6/670: write d12/d17/f33 [2132692,103606] 0 2024-09-13T22:56:18.220 INFO:tasks.workunit.client.0.smithi002.stdout:0/667: symlink d1/d2/d6c/lee 0 2024-09-13T22:56:18.222 INFO:tasks.workunit.client.0.smithi002.stdout:2/657: creat d1/d32/d37/fda x:0 0 0 2024-09-13T22:56:18.224 INFO:tasks.workunit.client.0.smithi002.stdout:1/688: dread d1/d13/d30/d31/d3d/f6a [0,4194304] 0 2024-09-13T22:56:18.226 INFO:tasks.workunit.client.1.smithi047.stdout:0/728: truncate d1/d7/dc9/fcd 988609 0 2024-09-13T22:56:18.227 INFO:tasks.workunit.client.0.smithi002.stdout:1/689: dread d1/d13/f3f [0,4194304] 0 2024-09-13T22:56:18.229 INFO:tasks.workunit.client.1.smithi047.stdout:5/628: symlink d19/lc8 0 2024-09-13T22:56:18.231 INFO:tasks.workunit.client.1.smithi047.stdout:9/674: creat d1/dc/d14/dd/d54/d50/fda x:0 0 0 2024-09-13T22:56:18.232 INFO:tasks.workunit.client.1.smithi047.stdout:9/675: write d1/dc/d14/dd/d54/d8d/fc0 [459015,127006] 0 2024-09-13T22:56:18.232 INFO:tasks.workunit.client.0.smithi002.stdout:3/719: symlink d9/d3b/d7c/l106 0 2024-09-13T22:56:18.233 INFO:tasks.workunit.client.1.smithi047.stdout:3/751: symlink d0/d3/d4/d16/d32/d42/d79/d9c/dad/d95/le9 0 2024-09-13T22:56:18.236 INFO:tasks.workunit.client.0.smithi002.stdout:4/602: fdatasync d3/f21 0 2024-09-13T22:56:18.236 INFO:tasks.workunit.client.1.smithi047.stdout:4/850: rename dc/de/l3a to dc/de/d23/d40/l126 0 2024-09-13T22:56:18.238 INFO:tasks.workunit.client.0.smithi002.stdout:9/719: symlink d8/d2c/led 0 2024-09-13T22:56:18.238 INFO:tasks.workunit.client.1.smithi047.stdout:7/711: getdents d0/d7/da/d1e/d93/db7 0 2024-09-13T22:56:18.246 INFO:tasks.workunit.client.1.smithi047.stdout:2/743: mkdir d1/df/d35/d8b/dd1/def/df8 0 2024-09-13T22:56:18.247 INFO:tasks.workunit.client.0.smithi002.stdout:7/619: rename d8/d10/d11/da2 to d8/d10/d11/d13/d26/d4c/d81/db6 0 2024-09-13T22:56:18.253 INFO:tasks.workunit.client.1.smithi047.stdout:9/676: creat d1/dc/d14/dd/d54/d8d/fdb x:0 0 0 2024-09-13T22:56:18.255 INFO:tasks.workunit.client.1.smithi047.stdout:3/752: mknod d0/d3/d4/d91/cea 0 2024-09-13T22:56:18.257 INFO:tasks.workunit.client.1.smithi047.stdout:7/712: fsync d0/d7/fa9 0 2024-09-13T22:56:18.258 INFO:tasks.workunit.client.1.smithi047.stdout:7/713: chown d0/d7/da/d4e 1543 1 2024-09-13T22:56:18.260 INFO:tasks.workunit.client.1.smithi047.stdout:6/713: mkdir d3/d11/d2b/d1c/dbd/de8 0 2024-09-13T22:56:18.263 INFO:tasks.workunit.client.1.smithi047.stdout:8/662: getdents d8/d64/d4e/d4d/d8f/d91/d40 0 2024-09-13T22:56:18.264 INFO:tasks.workunit.client.1.smithi047.stdout:2/744: read - d1/d8a/fd4 zero size 2024-09-13T22:56:18.265 INFO:tasks.workunit.client.1.smithi047.stdout:2/745: chown d1/df/d35/dd7/dca/df5 0 1 2024-09-13T22:56:18.271 INFO:tasks.workunit.client.1.smithi047.stdout:9/677: fdatasync d1/dc/d14/dd/f3e 0 2024-09-13T22:56:18.273 INFO:tasks.workunit.client.0.smithi002.stdout:5/659: write d1/d2a/d6b/d88/f4d [917651,58518] 0 2024-09-13T22:56:18.273 INFO:tasks.workunit.client.1.smithi047.stdout:9/678: read d1/dc/d14/dd/d4c/fa1 [276753,107528] 0 2024-09-13T22:56:18.273 INFO:tasks.workunit.client.0.smithi002.stdout:8/637: mknod d3/cc5 0 2024-09-13T22:56:18.274 INFO:tasks.workunit.client.0.smithi002.stdout:8/638: fsync d3/dc/d18/d6f/f90 0 2024-09-13T22:56:18.275 INFO:tasks.workunit.client.1.smithi047.stdout:3/753: symlink d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d3a/leb 0 2024-09-13T22:56:18.275 INFO:tasks.workunit.client.0.smithi002.stdout:8/639: chown d3/d27/f9c 2021872552 1 2024-09-13T22:56:18.275 INFO:tasks.workunit.client.0.smithi002.stdout:8/640: chown d3/dc/d18 43949 1 2024-09-13T22:56:18.277 INFO:tasks.workunit.client.1.smithi047.stdout:5/629: write d19/d23/d4c/f52 [2026686,105499] 0 2024-09-13T22:56:18.279 INFO:tasks.workunit.client.0.smithi002.stdout:0/668: rename d1/d2/d6c/d8b/fb2 to d1/d4/da3/fef 0 2024-09-13T22:56:18.279 INFO:tasks.workunit.client.0.smithi002.stdout:2/658: rename d1/d32/d37 to d1/d32/d37/d79/ddb 22 2024-09-13T22:56:18.280 INFO:tasks.workunit.client.1.smithi047.stdout:9/679: dwrite d1/dc/d14/dd/d54/d50/d91/faf [0,4194304] 0 2024-09-13T22:56:18.280 INFO:tasks.workunit.client.1.smithi047.stdout:7/714: rmdir d0/d57/d5b/d8b/d95 39 2024-09-13T22:56:18.284 INFO:tasks.workunit.client.0.smithi002.stdout:6/671: getdents d12/d17/d28/d67/dca 0 2024-09-13T22:56:18.284 INFO:tasks.workunit.client.0.smithi002.stdout:6/672: readlink d12/d17/d28/d67/d6b/l53 0 2024-09-13T22:56:18.286 INFO:tasks.workunit.client.1.smithi047.stdout:6/714: rename d3/d11/d2b/d4c/d30/f47 to d3/d77/fe9 0 2024-09-13T22:56:18.288 INFO:tasks.workunit.client.0.smithi002.stdout:1/690: creat d1/d13/d30/d73/da1/d9d/dbd/dd8/fe8 x:0 0 0 2024-09-13T22:56:18.288 INFO:tasks.workunit.client.0.smithi002.stdout:3/720: write d9/d3b/d7c/fba [4953558,34672] 0 2024-09-13T22:56:18.289 INFO:tasks.workunit.client.1.smithi047.stdout:8/663: chown d8/l24 2 1 2024-09-13T22:56:18.293 INFO:tasks.workunit.client.0.smithi002.stdout:4/603: mkdir d3/d14/d29/d2a/dbc 0 2024-09-13T22:56:18.293 INFO:tasks.workunit.client.0.smithi002.stdout:4/604: chown d3/d14/d29/d2a/d30 184121 1 2024-09-13T22:56:18.294 INFO:tasks.workunit.client.1.smithi047.stdout:0/729: read d1/d5/d16/d47/fd6 [431270,79877] 0 2024-09-13T22:56:18.295 INFO:tasks.workunit.client.1.smithi047.stdout:2/746: creat d1/df/d35/d8b/dd1/def/ff9 x:0 0 0 2024-09-13T22:56:18.296 INFO:tasks.workunit.client.1.smithi047.stdout:2/747: chown d1/d16/f6a 100926367 1 2024-09-13T22:56:18.297 INFO:tasks.workunit.client.0.smithi002.stdout:6/673: dread d12/f63 [0,4194304] 0 2024-09-13T22:56:18.298 INFO:tasks.workunit.client.1.smithi047.stdout:2/748: dread d1/df/d1d/da9/faf [0,4194304] 0 2024-09-13T22:56:18.300 INFO:tasks.workunit.client.0.smithi002.stdout:8/641: creat d3/d27/fc6 x:0 0 0 2024-09-13T22:56:18.301 INFO:tasks.workunit.client.0.smithi002.stdout:8/642: stat d3/f6 0 2024-09-13T22:56:18.302 INFO:tasks.workunit.client.0.smithi002.stdout:3/721: dread d9/d7e/dce/fdc [0,4194304] 0 2024-09-13T22:56:18.302 INFO:tasks.workunit.client.0.smithi002.stdout:0/669: creat d1/d2/d81/ff0 x:0 0 0 2024-09-13T22:56:18.308 INFO:tasks.workunit.client.0.smithi002.stdout:7/620: rename d8/d10/d11/d13/d2e/d50/d52/d72/faf to d8/d10/d11/d13/d26/d38/fb7 0 2024-09-13T22:56:18.309 INFO:tasks.workunit.client.0.smithi002.stdout:9/720: dwrite d8/d1e/fc7 [0,4194304] 0 2024-09-13T22:56:18.311 INFO:tasks.workunit.client.1.smithi047.stdout:9/680: unlink d1/dc/d14/dd/d54/d50/d5b/d9e/c96 0 2024-09-13T22:56:18.313 INFO:tasks.workunit.client.1.smithi047.stdout:6/715: truncate d3/ff 88898 0 2024-09-13T22:56:18.316 INFO:tasks.workunit.client.0.smithi002.stdout:1/691: creat d1/d13/d21/d39/d70/de2/fe9 x:0 0 0 2024-09-13T22:56:18.322 INFO:tasks.workunit.client.0.smithi002.stdout:2/659: dwrite d1/d7/d8/d2c/f39 [0,4194304] 0 2024-09-13T22:56:18.323 INFO:tasks.workunit.client.0.smithi002.stdout:1/692: dwrite d1/d13/d30/d31/d3d/fe0 [4194304,4194304] 0 2024-09-13T22:56:18.323 INFO:tasks.workunit.client.1.smithi047.stdout:5/630: dwrite d19/d25/f2b [0,4194304] 0 2024-09-13T22:56:18.325 INFO:tasks.workunit.client.0.smithi002.stdout:8/643: symlink d3/dc/d16/d4b/d72/lc7 0 2024-09-13T22:56:18.329 INFO:tasks.workunit.client.0.smithi002.stdout:0/670: rmdir d1/d4/da3/d7d 39 2024-09-13T22:56:18.330 INFO:tasks.workunit.client.0.smithi002.stdout:0/671: readlink d1/d4/l38 0 2024-09-13T22:56:18.331 INFO:tasks.workunit.client.1.smithi047.stdout:2/749: chown d1/df/d1d/d20/d29/f9b 49442385 1 2024-09-13T22:56:18.332 INFO:tasks.workunit.client.1.smithi047.stdout:3/754: mknod d0/d3/d4/d16/d2c/de/cec 0 2024-09-13T22:56:18.334 INFO:tasks.workunit.client.1.smithi047.stdout:7/715: creat d0/d7/da/d1e/de7/fea x:0 0 0 2024-09-13T22:56:18.336 INFO:tasks.workunit.client.1.smithi047.stdout:7/716: fsync d0/db/f16 0 2024-09-13T22:56:18.338 INFO:tasks.workunit.client.1.smithi047.stdout:6/716: rename d3/d11/d2b/f6f to d3/d11/d2b/d4c/d30/d48/fea 0 2024-09-13T22:56:18.340 INFO:tasks.workunit.client.0.smithi002.stdout:9/721: creat d8/d91/fee x:0 0 0 2024-09-13T22:56:18.344 INFO:tasks.workunit.client.1.smithi047.stdout:5/631: fdatasync d19/d23/d4c/f7b 0 2024-09-13T22:56:18.346 INFO:tasks.workunit.client.1.smithi047.stdout:0/730: dread d1/d7/f3e [0,4194304] 0 2024-09-13T22:56:18.346 INFO:tasks.workunit.client.0.smithi002.stdout:4/605: getdents d3/db3/db9 0 2024-09-13T22:56:18.347 INFO:tasks.workunit.client.1.smithi047.stdout:5/632: truncate d19/d34/d42/d5d/fb4 832629 0 2024-09-13T22:56:18.348 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:18 smithi002 ceph-mon[27637]: pgmap v19: 65 pgs: 65 active+clean; 2.8 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 110 MiB/s rd, 284 MiB/s wr, 597 op/s 2024-09-13T22:56:18.349 INFO:tasks.workunit.client.0.smithi002.stdout:5/660: creat d1/d2a/d6b/d88/d55/fee x:0 0 0 2024-09-13T22:56:18.355 INFO:tasks.workunit.client.0.smithi002.stdout:3/722: dwrite f5 [0,4194304] 0 2024-09-13T22:56:18.357 INFO:tasks.workunit.client.0.smithi002.stdout:8/644: unlink d3/dc/d18/l2a 0 2024-09-13T22:56:18.358 INFO:tasks.workunit.client.0.smithi002.stdout:2/660: dwrite d1/d7/d8/f1e [0,4194304] 0 2024-09-13T22:56:18.358 INFO:tasks.workunit.client.1.smithi047.stdout:8/664: link d8/fc d8/d64/d4e/d4d/fe6 0 2024-09-13T22:56:18.362 INFO:tasks.workunit.client.0.smithi002.stdout:0/672: mkdir d1/d4/d75/d31/df1 0 2024-09-13T22:56:18.364 INFO:tasks.workunit.client.0.smithi002.stdout:1/693: dwrite d1/d13/d1d/f6c [8388608,4194304] 0 2024-09-13T22:56:18.364 INFO:tasks.workunit.client.1.smithi047.stdout:0/731: read d1/d7/f1d [1170219,53190] 0 2024-09-13T22:56:18.364 INFO:tasks.workunit.client.1.smithi047.stdout:3/755: write d0/d3/d4/d91/f66 [1706969,89283] 0 2024-09-13T22:56:18.365 INFO:tasks.workunit.client.1.smithi047.stdout:0/732: chown d1/d5/d11 38400 1 2024-09-13T22:56:18.366 INFO:tasks.workunit.client.1.smithi047.stdout:5/633: readlink d19/d23/d32/la7 0 2024-09-13T22:56:18.367 INFO:tasks.workunit.client.0.smithi002.stdout:8/645: dread d3/d27/d39/f3b [0,4194304] 0 2024-09-13T22:56:18.368 INFO:tasks.workunit.client.1.smithi047.stdout:3/756: readlink d0/d3/d4/d16/d2c/de/d3d/lc2 0 2024-09-13T22:56:18.368 INFO:tasks.workunit.client.0.smithi002.stdout:1/694: readlink d1/d13/d30/d31/d3b/la4 0 2024-09-13T22:56:18.368 INFO:tasks.workunit.client.0.smithi002.stdout:2/661: dread d1/d4a/f6c [0,4194304] 0 2024-09-13T22:56:18.369 INFO:tasks.workunit.client.0.smithi002.stdout:9/722: rename d8/d10/db1/f8a to d8/d10/db1/fef 0 2024-09-13T22:56:18.369 INFO:tasks.workunit.client.1.smithi047.stdout:3/757: chown d0/d3/d4/d16/d2c/dcb/ldb 0 1 2024-09-13T22:56:18.370 INFO:tasks.workunit.client.1.smithi047.stdout:3/758: fsync d0/d3/f15 0 2024-09-13T22:56:18.372 INFO:tasks.workunit.client.0.smithi002.stdout:4/606: creat d3/d14/d86/fbd x:0 0 0 2024-09-13T22:56:18.373 INFO:tasks.workunit.client.1.smithi047.stdout:7/717: getdents d0/db/de8 0 2024-09-13T22:56:18.375 INFO:tasks.workunit.client.0.smithi002.stdout:4/607: write d3/d14/d29/f96 [920958,46131] 0 2024-09-13T22:56:18.378 INFO:tasks.workunit.client.0.smithi002.stdout:4/608: dread - d3/d14/d86/fbd zero size 2024-09-13T22:56:18.378 INFO:tasks.workunit.client.0.smithi002.stdout:6/674: creat d12/d17/fd6 x:0 0 0 2024-09-13T22:56:18.379 INFO:tasks.workunit.client.0.smithi002.stdout:2/662: dwrite d1/d7/d8/d2c/f82 [0,4194304] 0 2024-09-13T22:56:18.379 INFO:tasks.workunit.client.0.smithi002.stdout:9/723: dwrite d8/d1e/f25 [0,4194304] 0 2024-09-13T22:56:18.382 INFO:tasks.workunit.client.0.smithi002.stdout:3/723: mkdir d9/d15/d51/d107 0 2024-09-13T22:56:18.385 INFO:tasks.workunit.client.1.smithi047.stdout:9/681: dwrite d1/fd5 [0,4194304] 0 2024-09-13T22:56:18.385 INFO:tasks.workunit.client.1.smithi047.stdout:0/733: mknod d1/d5/d91/cee 0 2024-09-13T22:56:18.387 INFO:tasks.workunit.client.1.smithi047.stdout:3/759: dread d0/d3/d4/d91/d8d/fb6 [0,4194304] 0 2024-09-13T22:56:18.387 INFO:tasks.workunit.client.1.smithi047.stdout:5/634: truncate d19/d34/f46 1375896 0 2024-09-13T22:56:18.389 INFO:tasks.workunit.client.1.smithi047.stdout:0/734: chown d1/d5/d11/f20 30800744 1 2024-09-13T22:56:18.403 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:18 smithi047 ceph-mon[34560]: pgmap v19: 65 pgs: 65 active+clean; 2.8 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 110 MiB/s rd, 284 MiB/s wr, 597 op/s 2024-09-13T22:56:18.406 INFO:tasks.workunit.client.0.smithi002.stdout:6/675: creat d12/d17/d28/d67/d6b/fd7 x:0 0 0 2024-09-13T22:56:18.407 INFO:tasks.workunit.client.0.smithi002.stdout:8/646: dread d3/f5 [4194304,4194304] 0 2024-09-13T22:56:18.408 INFO:tasks.workunit.client.0.smithi002.stdout:2/663: creat d1/d7/d8/d4f/fdc x:0 0 0 2024-09-13T22:56:18.409 INFO:tasks.workunit.client.0.smithi002.stdout:2/664: chown d1/d7/d35/d3e/d59/d6b/d75/fa7 9057050 1 2024-09-13T22:56:18.416 INFO:tasks.workunit.client.0.smithi002.stdout:7/621: getdents d8/d10/d11 0 2024-09-13T22:56:18.417 INFO:tasks.workunit.client.0.smithi002.stdout:7/622: readlink d8/d10/d39/d60/l80 0 2024-09-13T22:56:18.417 INFO:tasks.workunit.client.0.smithi002.stdout:7/623: chown d8/l20 69 1 2024-09-13T22:56:18.417 INFO:tasks.workunit.client.0.smithi002.stdout:0/673: mkdir d1/d4/d75/d31/df1/df2 0 2024-09-13T22:56:18.418 INFO:tasks.workunit.client.0.smithi002.stdout:0/674: stat d1/d2/d81/d8f/f47 0 2024-09-13T22:56:18.418 INFO:tasks.workunit.client.0.smithi002.stdout:7/624: truncate d8/d10/d11/f9f 374492 0 2024-09-13T22:56:18.418 INFO:tasks.workunit.client.0.smithi002.stdout:4/609: write d3/d14/d85/fa5 [5151868,36574] 0 2024-09-13T22:56:18.420 INFO:tasks.workunit.client.0.smithi002.stdout:4/610: dread - d3/d14/d29/d2a/da6/f9b zero size 2024-09-13T22:56:18.421 INFO:tasks.workunit.client.0.smithi002.stdout:5/661: rmdir d1/d2a/d6b/d88/d45/d4f/d78/d8b/ddb/de6 0 2024-09-13T22:56:18.424 INFO:tasks.workunit.client.0.smithi002.stdout:4/611: dwrite d3/d14/f16 [4194304,4194304] 0 2024-09-13T22:56:18.454 INFO:tasks.workunit.client.1.smithi047.stdout:9/682: symlink d1/ldc 0 2024-09-13T22:56:18.455 INFO:tasks.workunit.client.1.smithi047.stdout:5/635: dread - d19/d34/d8e/f8f zero size 2024-09-13T22:56:18.455 INFO:tasks.workunit.client.1.smithi047.stdout:9/683: readlink d1/dc/d14/l3d 0 2024-09-13T22:56:18.456 INFO:tasks.workunit.client.1.smithi047.stdout:5/636: chown d19/d23/d4c/f67 123815 1 2024-09-13T22:56:18.457 INFO:tasks.workunit.client.1.smithi047.stdout:3/760: mkdir d0/d3/d5e/ded 0 2024-09-13T22:56:18.459 INFO:tasks.workunit.client.1.smithi047.stdout:6/717: getdents d3/d11/d2b/d4c/d9d/dc1 0 2024-09-13T22:56:18.460 INFO:tasks.workunit.client.0.smithi002.stdout:8/647: mkdir d3/dc/d16/d2f/d83/d85/dc8 0 2024-09-13T22:56:18.461 INFO:tasks.workunit.client.0.smithi002.stdout:9/724: symlink d8/d10/d61/de4/lf0 0 2024-09-13T22:56:18.461 INFO:tasks.workunit.client.1.smithi047.stdout:7/718: creat d0/d7/da/d4e/dd1/feb x:0 0 0 2024-09-13T22:56:18.461 INFO:tasks.workunit.client.0.smithi002.stdout:7/625: rename d8/d10/d11/d13 to d8/d10/d39/d60/db8 0 2024-09-13T22:56:18.462 INFO:tasks.workunit.client.0.smithi002.stdout:1/695: symlink d1/d13/d30/d31/d3d/d5d/lea 0 2024-09-13T22:56:18.462 INFO:tasks.workunit.client.0.smithi002.stdout:5/662: creat d1/d2a/d6b/d88/d45/d4f/da7/fef x:0 0 0 2024-09-13T22:56:18.463 INFO:tasks.workunit.client.0.smithi002.stdout:6/676: mkdir d12/d17/d28/d67/dca/dd8 0 2024-09-13T22:56:18.464 INFO:tasks.workunit.client.1.smithi047.stdout:9/684: symlink d1/dc/d14/dd/d54/d4e/ldd 0 2024-09-13T22:56:18.465 INFO:tasks.workunit.client.0.smithi002.stdout:8/648: chown d3/dc/d16/d2f/d83/d85/f98 6 1 2024-09-13T22:56:18.466 INFO:tasks.workunit.client.0.smithi002.stdout:4/612: mknod d3/d14/d29/d2a/dbc/cbe 0 2024-09-13T22:56:18.467 INFO:tasks.workunit.client.0.smithi002.stdout:6/677: write d12/d17/d34/d39/d8a/fa7 [1045265,117965] 0 2024-09-13T22:56:18.468 INFO:tasks.workunit.client.0.smithi002.stdout:3/724: dwrite d9/d91/f97 [0,4194304] 0 2024-09-13T22:56:18.468 INFO:tasks.workunit.client.1.smithi047.stdout:3/761: rename d0/d3/f15 to d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d3a/d81/fee 0 2024-09-13T22:56:18.469 INFO:tasks.workunit.client.1.smithi047.stdout:3/762: fdatasync d0/d3/d4/d16/d1c/f82 0 2024-09-13T22:56:18.470 INFO:tasks.workunit.client.0.smithi002.stdout:3/725: chown d9/d15/d46 0 1 2024-09-13T22:56:18.471 INFO:tasks.workunit.client.1.smithi047.stdout:6/718: creat d3/d11/d2b/d1c/d23/feb x:0 0 0 2024-09-13T22:56:18.472 INFO:tasks.workunit.client.0.smithi002.stdout:3/726: read d9/dd1/fd4 [102072,115793] 0 2024-09-13T22:56:18.474 INFO:tasks.workunit.client.0.smithi002.stdout:8/649: dwrite d3/dc/da4/fa9 [0,4194304] 0 2024-09-13T22:56:18.477 INFO:tasks.workunit.client.1.smithi047.stdout:8/665: dwrite d8/f21 [4194304,4194304] 0 2024-09-13T22:56:18.485 INFO:tasks.workunit.client.0.smithi002.stdout:2/665: creat d1/d7/d8/fdd x:0 0 0 2024-09-13T22:56:18.485 INFO:tasks.workunit.client.1.smithi047.stdout:0/735: creat d1/fef x:0 0 0 2024-09-13T22:56:18.487 INFO:tasks.workunit.client.1.smithi047.stdout:9/685: creat d1/dc/d14/dd/d54/d8d/fde x:0 0 0 2024-09-13T22:56:18.487 INFO:tasks.workunit.client.1.smithi047.stdout:5/637: write d19/d64/f93 [881673,104358] 0 2024-09-13T22:56:18.493 INFO:tasks.workunit.client.0.smithi002.stdout:5/663: chown d1/d2a/d6b/d88/d55/d56/de4/le9 1474390322 1 2024-09-13T22:56:18.494 INFO:tasks.workunit.client.1.smithi047.stdout:7/719: write d0/d7/da/f34 [2400521,82575] 0 2024-09-13T22:56:18.495 INFO:tasks.workunit.client.1.smithi047.stdout:7/720: chown d0/d7/da/d1e/d93 6612471 1 2024-09-13T22:56:18.495 INFO:tasks.workunit.client.0.smithi002.stdout:4/613: creat d3/d62/fbf x:0 0 0 2024-09-13T22:56:18.496 INFO:tasks.workunit.client.0.smithi002.stdout:7/626: dwrite d8/d10/d39/d60/db8/d26/d4c/d81/f54 [0,4194304] 0 2024-09-13T22:56:18.499 INFO:tasks.workunit.client.0.smithi002.stdout:7/627: chown d8/d10/d39/d60/db8/d26/d88 532466 1 2024-09-13T22:56:18.501 INFO:tasks.workunit.client.1.smithi047.stdout:3/763: rmdir d0/d3/d4/d16/d32/d42/d79/d9c 39 2024-09-13T22:56:18.504 INFO:tasks.workunit.client.1.smithi047.stdout:6/719: truncate d3/d11/d2b/d4c/fcc 1339921 0 2024-09-13T22:56:18.506 INFO:tasks.workunit.client.0.smithi002.stdout:6/678: creat d12/d17/d28/d67/dca/fd9 x:0 0 0 2024-09-13T22:56:18.507 INFO:tasks.workunit.client.0.smithi002.stdout:6/679: chown d12/f5d 1254196 1 2024-09-13T22:56:18.508 INFO:tasks.workunit.client.1.smithi047.stdout:8/666: mkdir d8/d77/d89/de7 0 2024-09-13T22:56:18.510 INFO:tasks.workunit.client.0.smithi002.stdout:8/650: rmdir d3/dc/d16/d60/db4 39 2024-09-13T22:56:18.512 INFO:tasks.workunit.client.1.smithi047.stdout:0/736: truncate d1/d5/d16/d47/f4a 1460959 0 2024-09-13T22:56:18.513 INFO:tasks.workunit.client.0.smithi002.stdout:1/696: fdatasync d1/d13/d30/d31/d3d/d5d/fc3 0 2024-09-13T22:56:18.513 INFO:tasks.workunit.client.1.smithi047.stdout:9/686: dread d1/dc/d14/dd/d4c/fa1 [0,4194304] 0 2024-09-13T22:56:18.517 INFO:tasks.workunit.client.0.smithi002.stdout:1/697: dread d1/d13/d30/d31/d3d/db6/fd0 [0,4194304] 0 2024-09-13T22:56:18.522 INFO:tasks.workunit.client.1.smithi047.stdout:8/667: creat d8/d64/dc5/fe8 x:0 0 0 2024-09-13T22:56:18.524 INFO:tasks.workunit.client.1.smithi047.stdout:0/737: symlink d1/d5/d11/d2f/lf0 0 2024-09-13T22:56:18.533 INFO:tasks.workunit.client.1.smithi047.stdout:9/687: rename d1/dc/d14/dd/d54/d50/d60/db0/lc8 to d1/dc/d14/dd/d54/d50/d91/ldf 0 2024-09-13T22:56:18.534 INFO:tasks.workunit.client.1.smithi047.stdout:9/688: chown d1/dc/d14/dd/d54/d50/d91/lbe 11 1 2024-09-13T22:56:18.537 INFO:tasks.workunit.client.1.smithi047.stdout:7/721: write d0/d7/da/d4e/f66 [3461981,82814] 0 2024-09-13T22:56:18.539 INFO:tasks.workunit.client.0.smithi002.stdout:1/698: creat d1/d13/d1d/d34/feb x:0 0 0 2024-09-13T22:56:18.540 INFO:tasks.workunit.client.0.smithi002.stdout:1/699: dread - d1/d13/d30/fe6 zero size 2024-09-13T22:56:18.541 INFO:tasks.workunit.client.1.smithi047.stdout:5/638: dwrite d19/d34/d42/d5d/f6e [0,4194304] 0 2024-09-13T22:56:18.542 INFO:tasks.workunit.client.0.smithi002.stdout:4/614: symlink d3/lc0 0 2024-09-13T22:56:18.543 INFO:tasks.workunit.client.1.smithi047.stdout:0/738: fsync d1/d5/d16/d23/d45/d84/fc7 0 2024-09-13T22:56:18.548 INFO:tasks.workunit.client.1.smithi047.stdout:9/689: creat d1/dc/d14/fe0 x:0 0 0 2024-09-13T22:56:18.549 INFO:tasks.workunit.client.1.smithi047.stdout:9/690: readlink d1/dc/d14/dd/d54/d4e/ldd 0 2024-09-13T22:56:18.549 INFO:tasks.workunit.client.0.smithi002.stdout:9/725: getdents d8/d2c/dbc/dc8 0 2024-09-13T22:56:18.550 INFO:tasks.workunit.client.1.smithi047.stdout:9/691: fsync d1/dc/d14/dd/d54/d50/d91/da3/fa9 0 2024-09-13T22:56:18.557 INFO:tasks.workunit.client.1.smithi047.stdout:6/720: creat d3/d11/fec x:0 0 0 2024-09-13T22:56:18.557 INFO:tasks.workunit.client.1.smithi047.stdout:8/668: dwrite d8/d6b/da9/fb7 [0,4194304] 0 2024-09-13T22:56:18.560 INFO:tasks.workunit.client.0.smithi002.stdout:4/615: fdatasync d3/d14/f1d 0 2024-09-13T22:56:18.561 INFO:tasks.workunit.client.0.smithi002.stdout:4/616: read - d3/d14/d29/d2a/da6/d5e/f79 zero size 2024-09-13T22:56:18.562 INFO:tasks.workunit.client.0.smithi002.stdout:7/628: mkdir d8/d10/d11/db9 0 2024-09-13T22:56:18.563 INFO:tasks.workunit.client.0.smithi002.stdout:7/629: write d8/d10/d39/d60/db8/d26/d4c/fa7 [2164324,114545] 0 2024-09-13T22:56:18.567 INFO:tasks.workunit.client.0.smithi002.stdout:9/726: rename d8/d10/d1c/d3d/f44 to d8/d91/d96/da8/dc3/ff1 0 2024-09-13T22:56:18.571 INFO:tasks.workunit.client.0.smithi002.stdout:8/651: link d3/dc/d18/ca8 d3/d27/d39/d80/cc9 0 2024-09-13T22:56:18.571 INFO:tasks.workunit.client.0.smithi002.stdout:8/652: write d3/dc/fa2 [577925,58346] 0 2024-09-13T22:56:18.572 INFO:tasks.workunit.client.1.smithi047.stdout:3/764: link d0/d3/d4/d16/d32/d42/d79/d9c/fb8 d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/fef 0 2024-09-13T22:56:18.574 INFO:tasks.workunit.client.0.smithi002.stdout:2/666: getdents d1/d7/d8/d2c/d9d/dab 0 2024-09-13T22:56:18.577 INFO:tasks.workunit.client.0.smithi002.stdout:5/664: getdents d1/d2a/d6b/d88/d45/d4f 0 2024-09-13T22:56:18.577 INFO:tasks.workunit.client.0.smithi002.stdout:5/665: write d1/fe [3874851,107752] 0 2024-09-13T22:56:18.578 INFO:tasks.workunit.client.1.smithi047.stdout:7/722: mknod d0/d7/da/cec 0 2024-09-13T22:56:18.583 INFO:tasks.workunit.client.1.smithi047.stdout:0/739: dwrite d1/f2 [4194304,4194304] 0 2024-09-13T22:56:18.585 INFO:tasks.workunit.client.0.smithi002.stdout:4/617: creat d3/d14/d29/d2a/da6/d69/d7e/fc1 x:0 0 0 2024-09-13T22:56:18.585 INFO:tasks.workunit.client.0.smithi002.stdout:8/653: dread d3/f8 [0,4194304] 0 2024-09-13T22:56:18.586 INFO:tasks.workunit.client.1.smithi047.stdout:9/692: write d1/dc/d18/f35 [3846964,127165] 0 2024-09-13T22:56:18.586 INFO:tasks.workunit.client.1.smithi047.stdout:9/693: chown d1/dc/d14 2 1 2024-09-13T22:56:18.588 INFO:tasks.workunit.client.0.smithi002.stdout:1/700: write d1/d13/d30/d31/fa8 [685311,95560] 0 2024-09-13T22:56:18.588 INFO:tasks.workunit.client.0.smithi002.stdout:6/680: link d12/d17/f6e d12/d17/d28/d67/d9f/dc3/fda 0 2024-09-13T22:56:18.591 INFO:tasks.workunit.client.0.smithi002.stdout:7/630: symlink d8/d10/d39/d60/db8/d26/d4c/d81/db6/lba 0 2024-09-13T22:56:18.596 INFO:tasks.workunit.client.0.smithi002.stdout:4/618: dwrite d3/fac [0,4194304] 0 2024-09-13T22:56:18.596 INFO:tasks.workunit.client.0.smithi002.stdout:0/675: sync 2024-09-13T22:56:18.597 INFO:tasks.workunit.client.0.smithi002.stdout:8/654: mknod d3/dc/d18/d2e/cca 0 2024-09-13T22:56:18.599 INFO:tasks.workunit.client.0.smithi002.stdout:6/681: mknod d12/d17/d28/d7d/cdb 0 2024-09-13T22:56:18.599 INFO:tasks.workunit.client.0.smithi002.stdout:1/701: mknod d1/d13/d30/d31/d3d/cec 0 2024-09-13T22:56:18.601 INFO:tasks.workunit.client.0.smithi002.stdout:9/727: dwrite d8/d10/d42/f76 [0,4194304] 0 2024-09-13T22:56:18.603 INFO:tasks.workunit.client.0.smithi002.stdout:9/728: dread - d8/d91/fd8 zero size 2024-09-13T22:56:18.603 INFO:tasks.workunit.client.0.smithi002.stdout:0/676: mknod d1/d4/d75/d76/cf3 0 2024-09-13T22:56:18.606 INFO:tasks.workunit.client.0.smithi002.stdout:1/702: rmdir d1/d13/d21/d39 39 2024-09-13T22:56:18.609 INFO:tasks.workunit.client.0.smithi002.stdout:1/703: write d1/ff [3259649,121956] 0 2024-09-13T22:56:18.610 INFO:tasks.workunit.client.0.smithi002.stdout:5/666: creat d1/ff0 x:0 0 0 2024-09-13T22:56:18.612 INFO:tasks.workunit.client.0.smithi002.stdout:9/729: creat d8/d91/da3/ff2 x:0 0 0 2024-09-13T22:56:18.614 INFO:tasks.workunit.client.0.smithi002.stdout:2/667: dwrite d1/d7/d8/f10 [0,4194304] 0 2024-09-13T22:56:18.615 INFO:tasks.workunit.client.0.smithi002.stdout:0/677: mkdir d1/d2/d81/d8f/df4 0 2024-09-13T22:56:18.615 INFO:tasks.workunit.client.0.smithi002.stdout:2/668: readlink d1/d32/l40 0 2024-09-13T22:56:18.615 INFO:tasks.workunit.client.0.smithi002.stdout:4/619: dread f2 [4194304,4194304] 0 2024-09-13T22:56:18.616 INFO:tasks.workunit.client.0.smithi002.stdout:9/730: truncate d8/d91/da3/ff2 235514 0 2024-09-13T22:56:18.616 INFO:tasks.workunit.client.0.smithi002.stdout:6/682: write d12/f51 [4455455,127481] 0 2024-09-13T22:56:18.617 INFO:tasks.workunit.client.0.smithi002.stdout:5/667: symlink d1/d57/lf1 0 2024-09-13T22:56:18.617 INFO:tasks.workunit.client.0.smithi002.stdout:0/678: readlink d1/d7e/d9d/lb4 0 2024-09-13T22:56:18.618 INFO:tasks.workunit.client.0.smithi002.stdout:4/620: chown d3/d62/fbf 32224 1 2024-09-13T22:56:18.618 INFO:tasks.workunit.client.0.smithi002.stdout:8/655: rename d3/dc/d18/d2e/cca to d3/d21/ccb 0 2024-09-13T22:56:18.619 INFO:tasks.workunit.client.0.smithi002.stdout:1/704: mknod d1/d13/d21/d40/dc4/ced 0 2024-09-13T22:56:18.627 INFO:tasks.workunit.client.0.smithi002.stdout:4/621: unlink d3/d14/d29/d2a/da6/f5c 0 2024-09-13T22:56:18.628 INFO:tasks.workunit.client.1.smithi047.stdout:8/669: mknod d8/d6b/dce/ce9 0 2024-09-13T22:56:18.629 INFO:tasks.workunit.client.0.smithi002.stdout:8/656: creat d3/dc/d16/d4b/d72/fcc x:0 0 0 2024-09-13T22:56:18.630 INFO:tasks.workunit.client.0.smithi002.stdout:1/705: symlink d1/d13/d21/d40/dc4/dc8/lee 0 2024-09-13T22:56:18.633 INFO:tasks.workunit.client.1.smithi047.stdout:5/639: link d19/d34/d42/f5b d19/d25/fc9 0 2024-09-13T22:56:18.634 INFO:tasks.workunit.client.0.smithi002.stdout:7/631: link d8/d10/d39/d60/db8/d26/d38/c74 d8/d10/d39/d60/db8/d26/cbb 0 2024-09-13T22:56:18.634 INFO:tasks.workunit.client.0.smithi002.stdout:8/657: dwrite d3/d21/f9d [0,4194304] 0 2024-09-13T22:56:18.638 INFO:tasks.workunit.client.1.smithi047.stdout:6/721: creat d3/d11/d2b/d4c/dc0/d89/fed x:0 0 0 2024-09-13T22:56:18.639 INFO:tasks.workunit.client.1.smithi047.stdout:7/723: dread d0/d7/da/d1e/f68 [0,4194304] 0 2024-09-13T22:56:18.642 INFO:tasks.workunit.client.0.smithi002.stdout:6/683: write d12/d17/d28/f2e [7165280,15066] 0 2024-09-13T22:56:18.642 INFO:tasks.workunit.client.1.smithi047.stdout:0/740: dread d1/d5/d11/f20 [0,4194304] 0 2024-09-13T22:56:18.645 INFO:tasks.workunit.client.0.smithi002.stdout:9/731: dwrite d8/d10/d61/fcb [0,4194304] 0 2024-09-13T22:56:18.646 INFO:tasks.workunit.client.0.smithi002.stdout:9/732: write d8/d10/d61/f8d [2659920,130594] 0 2024-09-13T22:56:18.647 INFO:tasks.workunit.client.0.smithi002.stdout:0/679: truncate d1/d4/da3/d7d/f88 857029 0 2024-09-13T22:56:18.647 INFO:tasks.workunit.client.1.smithi047.stdout:7/724: truncate d0/d57/d5b/d8b/d95/fcb 520041 0 2024-09-13T22:56:18.648 INFO:tasks.workunit.client.1.smithi047.stdout:6/722: mkdir d3/d11/d2b/d4c/dc0/dee 0 2024-09-13T22:56:18.648 INFO:tasks.workunit.client.1.smithi047.stdout:7/725: dread - d0/d57/d5b/d8b/fd5 zero size 2024-09-13T22:56:18.650 INFO:tasks.workunit.client.1.smithi047.stdout:7/726: fsync d0/d7/f6 0 2024-09-13T22:56:18.654 INFO:tasks.workunit.client.1.smithi047.stdout:8/670: creat d8/d64/d4e/d4d/d8f/d91/de2/fea x:0 0 0 2024-09-13T22:56:18.657 INFO:tasks.workunit.client.1.smithi047.stdout:8/671: chown d8/d64/d4e/d70/d98/fad 14 1 2024-09-13T22:56:18.658 INFO:tasks.workunit.client.1.smithi047.stdout:6/723: dwrite d3/d11/d2b/d4c/d30/d48/f4e [0,4194304] 0 2024-09-13T22:56:18.658 INFO:tasks.workunit.client.1.smithi047.stdout:5/640: mknod d19/d23/d32/cca 0 2024-09-13T22:56:18.659 INFO:tasks.workunit.client.1.smithi047.stdout:6/724: readlink d3/l6a 0 2024-09-13T22:56:18.661 INFO:tasks.workunit.client.0.smithi002.stdout:1/706: mkdir d1/d13/d30/d73/def 0 2024-09-13T22:56:18.661 INFO:tasks.workunit.client.1.smithi047.stdout:8/672: read d8/d64/f47 [200547,47378] 0 2024-09-13T22:56:18.662 INFO:tasks.workunit.client.1.smithi047.stdout:0/741: rmdir d1/d5/d16/d6a 39 2024-09-13T22:56:18.664 INFO:tasks.workunit.client.1.smithi047.stdout:9/694: truncate d1/dc/d14/dd/d54/f4f 6978031 0 2024-09-13T22:56:18.666 INFO:tasks.workunit.client.0.smithi002.stdout:7/632: unlink d8/d10/d39/d60/la0 0 2024-09-13T22:56:18.667 INFO:tasks.workunit.client.0.smithi002.stdout:7/633: write d8/d10/d39/f9b [2860707,30536] 0 2024-09-13T22:56:18.670 INFO:tasks.workunit.client.1.smithi047.stdout:7/727: dread d0/d7/fc6 [0,4194304] 0 2024-09-13T22:56:18.671 INFO:tasks.workunit.client.0.smithi002.stdout:8/658: mknod d3/dc/d16/d60/da7/ccd 0 2024-09-13T22:56:18.672 INFO:tasks.workunit.client.0.smithi002.stdout:3/727: sync 2024-09-13T22:56:18.673 INFO:tasks.workunit.client.0.smithi002.stdout:2/669: creat d1/d7/d35/fde x:0 0 0 2024-09-13T22:56:18.682 INFO:tasks.workunit.client.1.smithi047.stdout:8/673: dread d8/d64/d4e/d4d/d8f/d91/d38/f45 [0,4194304] 0 2024-09-13T22:56:18.733 INFO:tasks.workunit.client.1.smithi047.stdout:4/851: sync 2024-09-13T22:56:18.734 INFO:tasks.workunit.client.1.smithi047.stdout:1/808: sync 2024-09-13T22:56:18.734 INFO:tasks.workunit.client.1.smithi047.stdout:2/750: sync 2024-09-13T22:56:18.735 INFO:tasks.workunit.client.1.smithi047.stdout:1/809: write d0/d7/d13/d5d/fc5 [75990,78120] 0 2024-09-13T22:56:18.750 INFO:tasks.workunit.client.1.smithi047.stdout:1/810: dread d0/d1d/daa/fe0 [0,4194304] 0 2024-09-13T22:56:18.778 INFO:tasks.workunit.client.0.smithi002.stdout:9/733: mkdir d8/d10/d1c/dbf/df3 0 2024-09-13T22:56:18.782 INFO:tasks.workunit.client.1.smithi047.stdout:6/725: mknod d3/d11/d2b/d4c/d9d/dac/cef 0 2024-09-13T22:56:18.783 INFO:tasks.workunit.client.0.smithi002.stdout:4/622: fsync d3/f73 0 2024-09-13T22:56:18.784 INFO:tasks.workunit.client.0.smithi002.stdout:4/623: stat d3/d14/f5b 0 2024-09-13T22:56:18.792 INFO:tasks.workunit.client.0.smithi002.stdout:7/634: rmdir d8/d10/d39/d60/db8/d2e/d3c 39 2024-09-13T22:56:18.796 INFO:tasks.workunit.client.1.smithi047.stdout:8/674: symlink d8/d64/d4e/d70/d98/leb 0 2024-09-13T22:56:18.804 INFO:tasks.workunit.client.0.smithi002.stdout:3/728: dread d9/fb [0,4194304] 0 2024-09-13T22:56:18.811 INFO:tasks.workunit.client.1.smithi047.stdout:1/811: mkdir d0/d7/db/deb 0 2024-09-13T22:56:18.812 INFO:tasks.workunit.client.1.smithi047.stdout:1/812: truncate d0/d7/f4e 1477961 0 2024-09-13T22:56:18.814 INFO:tasks.workunit.client.1.smithi047.stdout:3/765: sync 2024-09-13T22:56:18.817 INFO:tasks.workunit.client.1.smithi047.stdout:3/766: read d0/d3/d4/d16/d2c/de/d1f/d3b/d69/f7d [866027,39111] 0 2024-09-13T22:56:18.818 INFO:tasks.workunit.client.1.smithi047.stdout:6/726: dread d3/d11/d2b/d1c/fa8 [0,4194304] 0 2024-09-13T22:56:18.820 INFO:tasks.workunit.client.1.smithi047.stdout:0/742: dread - d1/d5/d16/d6a/d92/fb1 zero size 2024-09-13T22:56:18.829 INFO:tasks.workunit.client.1.smithi047.stdout:8/675: readlink d8/d77/d89/lbc 0 2024-09-13T22:56:18.847 INFO:tasks.workunit.client.1.smithi047.stdout:3/767: mknod d0/d3/d4/d16/d32/d76/cf0 0 2024-09-13T22:56:18.855 INFO:tasks.workunit.client.1.smithi047.stdout:8/676: symlink d8/d6b/da9/dc3/lec 0 2024-09-13T22:56:18.862 INFO:tasks.workunit.client.1.smithi047.stdout:1/813: creat d0/d7/d14/d28/d36/dcc/fec x:0 0 0 2024-09-13T22:56:18.864 INFO:tasks.workunit.client.1.smithi047.stdout:5/641: getdents d19/d83/d98 0 2024-09-13T22:56:18.871 INFO:tasks.workunit.client.1.smithi047.stdout:3/768: creat d0/d3/d5e/ff1 x:0 0 0 2024-09-13T22:56:18.875 INFO:tasks.workunit.client.1.smithi047.stdout:6/727: creat d3/d11/d2b/d1c/dbd/de8/ff0 x:0 0 0 2024-09-13T22:56:18.879 INFO:tasks.workunit.client.1.smithi047.stdout:8/677: truncate d8/d6b/fbb 879086 0 2024-09-13T22:56:18.880 INFO:tasks.workunit.client.1.smithi047.stdout:4/852: getdents dc/de/d23/dc4/ddb 0 2024-09-13T22:56:18.885 INFO:tasks.workunit.client.1.smithi047.stdout:1/814: creat d0/d7/d14/d28/fed x:0 0 0 2024-09-13T22:56:18.886 INFO:tasks.workunit.client.1.smithi047.stdout:1/815: chown d0/d7/d14/faf 24 1 2024-09-13T22:56:18.892 INFO:tasks.workunit.client.1.smithi047.stdout:6/728: symlink d3/d11/d2b/d76/lf1 0 2024-09-13T22:56:18.898 INFO:tasks.workunit.client.1.smithi047.stdout:8/678: read - d8/d64/d4e/d4d/d8f/d91/d78/fa1 zero size 2024-09-13T22:56:18.900 INFO:tasks.workunit.client.1.smithi047.stdout:1/816: dread d0/d7/d13/d5d/f6a [0,4194304] 0 2024-09-13T22:56:18.906 INFO:tasks.workunit.client.1.smithi047.stdout:3/769: mkdir d0/d3/d4/d16/d32/d42/d79/df2 0 2024-09-13T22:56:18.907 INFO:tasks.workunit.client.1.smithi047.stdout:3/770: readlink d0/d3/d4/d16/d73/d86/lb3 0 2024-09-13T22:56:18.909 INFO:tasks.workunit.client.1.smithi047.stdout:6/729: truncate d3/d11/d2b/d1c/d4d/d69/f6d 106741 0 2024-09-13T22:56:18.914 INFO:tasks.workunit.client.1.smithi047.stdout:6/730: dread d3/d11/f6b [0,4194304] 0 2024-09-13T22:56:18.922 INFO:tasks.workunit.client.1.smithi047.stdout:3/771: dread d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/f49 [0,4194304] 0 2024-09-13T22:56:18.924 INFO:tasks.workunit.client.1.smithi047.stdout:3/772: write d0/f98 [305301,110132] 0 2024-09-13T22:56:18.925 INFO:tasks.workunit.client.1.smithi047.stdout:1/817: dwrite d0/d7/d14/d28/d36/f84 [4194304,4194304] 0 2024-09-13T22:56:18.928 INFO:tasks.workunit.client.0.smithi002.stdout:9/734: mkdir d8/d10/d61/df4 0 2024-09-13T22:56:18.930 INFO:tasks.workunit.client.0.smithi002.stdout:9/735: write d8/d1e/f25 [4069799,107760] 0 2024-09-13T22:56:18.931 INFO:tasks.workunit.client.0.smithi002.stdout:9/736: write d8/d1e/fca [2650234,54394] 0 2024-09-13T22:56:18.931 INFO:tasks.workunit.client.0.smithi002.stdout:9/737: fsync d8/d10/d1c/d3d/f48 0 2024-09-13T22:56:18.937 INFO:tasks.workunit.client.1.smithi047.stdout:6/731: creat d3/d11/d2b/d4c/dc0/ff2 x:0 0 0 2024-09-13T22:56:18.938 INFO:tasks.workunit.client.1.smithi047.stdout:6/732: stat d3/d11/d2b/d1c/dbf 0 2024-09-13T22:56:18.939 INFO:tasks.workunit.client.1.smithi047.stdout:6/733: chown d3/d11/d2b/d1c/d4d/l4f 3 1 2024-09-13T22:56:18.944 INFO:tasks.workunit.client.0.smithi002.stdout:9/738: dread d8/d10/d42/f6e [0,4194304] 0 2024-09-13T22:56:18.946 INFO:tasks.workunit.client.0.smithi002.stdout:8/659: link d3/dc/f13 d3/d27/da3/fce 0 2024-09-13T22:56:18.949 INFO:tasks.workunit.client.0.smithi002.stdout:3/729: stat d9/d15/d36/d4e/d5e/la0 0 2024-09-13T22:56:18.950 INFO:tasks.workunit.client.1.smithi047.stdout:1/818: mknod d0/d7/d13/cee 0 2024-09-13T22:56:18.951 INFO:tasks.workunit.client.1.smithi047.stdout:1/819: chown d0/d7/db 2685 1 2024-09-13T22:56:18.953 INFO:tasks.workunit.client.1.smithi047.stdout:3/773: unlink d0/d3/d4/d16/d32/d42/d79/d9c/c9d 0 2024-09-13T22:56:18.957 INFO:tasks.workunit.client.1.smithi047.stdout:4/853: getdents dc/de/d23/dc4/dc8 0 2024-09-13T22:56:18.963 INFO:tasks.workunit.client.1.smithi047.stdout:8/679: rename d8/c28 to d8/ced 0 2024-09-13T22:56:18.964 INFO:tasks.workunit.client.1.smithi047.stdout:8/680: stat d8/d64/d4e/d4d/d8f/d91/d38/c97 0 2024-09-13T22:56:18.968 INFO:tasks.workunit.client.1.smithi047.stdout:1/820: mknod d0/d7/d13/cef 0 2024-09-13T22:56:18.969 INFO:tasks.workunit.client.1.smithi047.stdout:1/821: write d0/d7/d14/d28/fed [512943,99916] 0 2024-09-13T22:56:18.972 INFO:tasks.workunit.client.1.smithi047.stdout:3/774: fdatasync d0/d3/d4/d16/d1c/f92 0 2024-09-13T22:56:18.973 INFO:tasks.workunit.client.1.smithi047.stdout:6/734: dread d3/d11/d2b/d4c/dc0/fbc [0,4194304] 0 2024-09-13T22:56:18.978 INFO:tasks.workunit.client.1.smithi047.stdout:6/735: rmdir d3 39 2024-09-13T22:56:18.980 INFO:tasks.workunit.client.0.smithi002.stdout:8/660: creat d3/dc/d16/d2f/d83/d85/dc8/fcf x:0 0 0 2024-09-13T22:56:18.982 INFO:tasks.workunit.client.1.smithi047.stdout:3/775: unlink d0/d3/d5e/fe8 0 2024-09-13T22:56:18.983 INFO:tasks.workunit.client.1.smithi047.stdout:1/822: getdents d0/d7/db/deb 0 2024-09-13T22:56:18.984 INFO:tasks.workunit.client.0.smithi002.stdout:4/624: getdents d3/d14/d85 0 2024-09-13T22:56:18.984 INFO:tasks.workunit.client.0.smithi002.stdout:2/670: write d1/d7/d35/d3e/d5e/f76 [1184971,36896] 0 2024-09-13T22:56:18.986 INFO:tasks.workunit.client.0.smithi002.stdout:2/671: write d1/d32/d37/d79/f84 [601852,90025] 0 2024-09-13T22:56:18.988 INFO:tasks.workunit.client.0.smithi002.stdout:8/661: mkdir d3/dc/d18/d56/dd0 0 2024-09-13T22:56:18.990 INFO:tasks.workunit.client.0.smithi002.stdout:2/672: dread d1/d4d/fac [0,4194304] 0 2024-09-13T22:56:18.993 INFO:tasks.workunit.client.1.smithi047.stdout:3/776: creat d0/d3/d4/d16/d73/d86/ff3 x:0 0 0 2024-09-13T22:56:18.998 INFO:tasks.workunit.client.0.smithi002.stdout:1/707: symlink d1/d13/d30/d31/lf0 0 2024-09-13T22:56:18.999 INFO:tasks.workunit.client.1.smithi047.stdout:3/777: creat d0/d3/d5e/ff4 x:0 0 0 2024-09-13T22:56:19.004 INFO:tasks.workunit.client.0.smithi002.stdout:3/730: rename d9/df/d71/fc8 to d9/d3b/f108 0 2024-09-13T22:56:19.005 INFO:tasks.workunit.client.1.smithi047.stdout:3/778: symlink d0/d3/d4/d16/d1c/lf5 0 2024-09-13T22:56:19.007 INFO:tasks.workunit.client.1.smithi047.stdout:3/779: chown d0/d3/d4/d16/d1c/fae 5810 1 2024-09-13T22:56:19.008 INFO:tasks.workunit.client.0.smithi002.stdout:1/708: rmdir d1/d13/d30/d31/d86/d90 39 2024-09-13T22:56:19.009 INFO:tasks.workunit.client.0.smithi002.stdout:1/709: write d1/d13/d30/d31/d3d/fe0 [6939227,52516] 0 2024-09-13T22:56:19.010 INFO:tasks.workunit.client.1.smithi047.stdout:3/780: truncate d0/d3/d4/d16/d32/f39 205275 0 2024-09-13T22:56:19.011 INFO:tasks.workunit.client.0.smithi002.stdout:5/668: creat d1/d2a/ff2 x:0 0 0 2024-09-13T22:56:19.012 INFO:tasks.workunit.client.0.smithi002.stdout:8/662: creat d3/dc/d16/d2f/db7/fd1 x:0 0 0 2024-09-13T22:56:19.012 INFO:tasks.workunit.client.0.smithi002.stdout:8/663: chown d3/d27/d39 263705914 1 2024-09-13T22:56:19.013 INFO:tasks.workunit.client.0.smithi002.stdout:3/731: mkdir d9/d3b/d53/d83/d100/d109 0 2024-09-13T22:56:19.014 INFO:tasks.workunit.client.0.smithi002.stdout:2/673: symlink d1/d7/d35/d3e/d59/d87/ldf 0 2024-09-13T22:56:19.016 INFO:tasks.workunit.client.1.smithi047.stdout:3/781: mkdir d0/d3/d4/d16/d32/d42/d79/d9c/dad/d95/dc3/df6 0 2024-09-13T22:56:19.021 INFO:tasks.workunit.client.0.smithi002.stdout:5/669: dread d1/d57/fdf [0,4194304] 0 2024-09-13T22:56:19.022 INFO:tasks.workunit.client.1.smithi047.stdout:2/751: write d1/df/d1d/f8d [1156874,50875] 0 2024-09-13T22:56:19.027 INFO:tasks.workunit.client.0.smithi002.stdout:8/664: dwrite d3/dc/d18/d2e/d94/f88 [0,4194304] 0 2024-09-13T22:56:19.029 INFO:tasks.workunit.client.1.smithi047.stdout:2/752: creat d1/df/d35/d8b/dd1/def/df8/ffa x:0 0 0 2024-09-13T22:56:19.033 INFO:tasks.workunit.client.0.smithi002.stdout:3/732: unlink d9/d15/l28 0 2024-09-13T22:56:19.035 INFO:tasks.workunit.client.1.smithi047.stdout:2/753: chown d1/df/d26/d4b/c53 0 1 2024-09-13T22:56:19.035 INFO:tasks.workunit.client.0.smithi002.stdout:3/733: dread - d9/d7e/ff5 zero size 2024-09-13T22:56:19.035 INFO:tasks.workunit.client.0.smithi002.stdout:2/674: mknod d1/d7/ce0 0 2024-09-13T22:56:19.037 INFO:tasks.workunit.client.0.smithi002.stdout:1/710: creat d1/d13/d21/ff1 x:0 0 0 2024-09-13T22:56:19.037 INFO:tasks.workunit.client.0.smithi002.stdout:1/711: chown d1/d13/d30/d73/da1/d7d/cc2 2 1 2024-09-13T22:56:19.039 INFO:tasks.workunit.client.0.smithi002.stdout:8/665: unlink d3/dc/d18/f2d 0 2024-09-13T22:56:19.045 INFO:tasks.workunit.client.0.smithi002.stdout:2/675: unlink d1/d4a/c8c 0 2024-09-13T22:56:19.046 INFO:tasks.workunit.client.0.smithi002.stdout:1/712: rmdir d1/d13/d30/d73/da1/d9d 39 2024-09-13T22:56:19.051 INFO:tasks.workunit.client.0.smithi002.stdout:8/666: symlink d3/dc/d16/d2f/d83/d85/dba/ld2 0 2024-09-13T22:56:19.052 INFO:tasks.workunit.client.0.smithi002.stdout:1/713: fsync d1/d13/d21/d39/d70/f96 0 2024-09-13T22:56:19.056 INFO:tasks.workunit.client.0.smithi002.stdout:1/714: symlink d1/d13/d52/dcf/lf2 0 2024-09-13T22:56:19.056 INFO:tasks.workunit.client.0.smithi002.stdout:8/667: dread d3/fa [0,4194304] 0 2024-09-13T22:56:19.059 INFO:tasks.workunit.client.0.smithi002.stdout:8/668: symlink d3/dc/d16/d97/ld3 0 2024-09-13T22:56:19.061 INFO:tasks.workunit.client.0.smithi002.stdout:1/715: mknod d1/d13/d21/d40/dc4/dc8/ddf/cf3 0 2024-09-13T22:56:19.067 INFO:tasks.workunit.client.1.smithi047.stdout:9/695: creat d1/fe1 x:0 0 0 2024-09-13T22:56:19.068 INFO:tasks.workunit.client.0.smithi002.stdout:1/716: dread - d1/d13/d1d/d34/da7/fb2 zero size 2024-09-13T22:56:19.068 INFO:tasks.workunit.client.0.smithi002.stdout:8/669: dread d3/dc/d18/d2e/d94/f7f [0,4194304] 0 2024-09-13T22:56:19.070 INFO:tasks.workunit.client.0.smithi002.stdout:1/717: rmdir d1/d13/d30/d73/da1/d7d 39 2024-09-13T22:56:19.075 INFO:tasks.workunit.client.0.smithi002.stdout:0/680: rmdir d1/d4/d75/d76 39 2024-09-13T22:56:19.075 INFO:tasks.workunit.client.0.smithi002.stdout:1/718: dread - d1/d13/d1d/d34/f6b zero size 2024-09-13T22:56:19.082 INFO:tasks.workunit.client.0.smithi002.stdout:9/739: sync 2024-09-13T22:56:19.087 INFO:tasks.workunit.client.0.smithi002.stdout:9/740: dwrite d8/d10/d1c/d3d/f48 [0,4194304] 0 2024-09-13T22:56:19.094 INFO:tasks.workunit.client.0.smithi002.stdout:9/741: dwrite d8/d10/d42/f51 [4194304,4194304] 0 2024-09-13T22:56:19.100 INFO:tasks.workunit.client.0.smithi002.stdout:9/742: dread d8/d10/d1c/d3d/f92 [0,4194304] 0 2024-09-13T22:56:19.112 INFO:tasks.workunit.client.0.smithi002.stdout:1/719: unlink d1/d13/d30/d31/d86/l7c 0 2024-09-13T22:56:19.116 INFO:tasks.workunit.client.1.smithi047.stdout:0/743: rename d1/d5/d16/d47/dde/ce7 to d1/cf1 0 2024-09-13T22:56:19.118 INFO:tasks.workunit.client.0.smithi002.stdout:9/743: dread d8/d10/d42/f6e [0,4194304] 0 2024-09-13T22:56:19.118 INFO:tasks.workunit.client.1.smithi047.stdout:0/744: chown d1/d5/d16/d23/d2d/f5a 357 1 2024-09-13T22:56:19.121 INFO:tasks.workunit.client.1.smithi047.stdout:5/642: rename d19/d25/f2b to d19/d83/fcb 0 2024-09-13T22:56:19.127 INFO:tasks.workunit.client.0.smithi002.stdout:9/744: truncate d8/d1e/fac 1628417 0 2024-09-13T22:56:19.130 INFO:tasks.workunit.client.1.smithi047.stdout:8/681: rename d8/d64/d4e/d4d/d8f/d91/d38/l39 to d8/d77/lee 0 2024-09-13T22:56:19.131 INFO:tasks.workunit.client.0.smithi002.stdout:1/720: link d1/ccc d1/d13/d1d/d34/cf4 0 2024-09-13T22:56:19.133 INFO:tasks.workunit.client.0.smithi002.stdout:5/670: rename d1/d2a/d6b/d88/f70 to d1/d2a/d6b/d88/d45/d4f/da7/ff3 0 2024-09-13T22:56:19.136 INFO:tasks.workunit.client.1.smithi047.stdout:2/754: rename d1/df/d1d/d20/d37/d7b/l88 to d1/df/d1d/d20/d29/lfb 0 2024-09-13T22:56:19.139 INFO:tasks.workunit.client.1.smithi047.stdout:5/643: dwrite d19/d83/fb5 [0,4194304] 0 2024-09-13T22:56:19.140 INFO:tasks.workunit.client.0.smithi002.stdout:2/676: rename d1/d7/d8/d51 to d1/d4d/d8b/de1 0 2024-09-13T22:56:19.147 INFO:tasks.workunit.client.1.smithi047.stdout:0/745: rename d1/d5/d16/d97/ccb to d1/d5/d16/d6a/cf2 0 2024-09-13T22:56:19.148 INFO:tasks.workunit.client.1.smithi047.stdout:8/682: creat d8/d64/d4e/dbd/fef x:0 0 0 2024-09-13T22:56:19.150 INFO:tasks.workunit.client.1.smithi047.stdout:5/644: rmdir d19/d25/d90 39 2024-09-13T22:56:19.154 INFO:tasks.workunit.client.1.smithi047.stdout:6/736: fsync d3/d11/d2b/d1c/d4d/d69/f6d 0 2024-09-13T22:56:19.157 INFO:tasks.workunit.client.0.smithi002.stdout:2/677: creat d1/d7/d35/d3e/d59/d6b/fe2 x:0 0 0 2024-09-13T22:56:19.159 INFO:tasks.workunit.client.0.smithi002.stdout:5/671: mkdir d1/d2a/d6b/d88/d45/df4 0 2024-09-13T22:56:19.162 INFO:tasks.workunit.client.1.smithi047.stdout:8/683: creat d8/d64/d4e/d4d/d8f/d91/d38/ff0 x:0 0 0 2024-09-13T22:56:19.165 INFO:tasks.workunit.client.0.smithi002.stdout:1/721: creat d1/d13/d1d/d34/d51/dc6/ff5 x:0 0 0 2024-09-13T22:56:19.165 INFO:tasks.workunit.client.0.smithi002.stdout:1/722: dread - d1/d13/d30/fe6 zero size 2024-09-13T22:56:19.166 INFO:tasks.workunit.client.1.smithi047.stdout:0/746: dread d1/d5/d16/d23/d2d/fc3 [4194304,4194304] 0 2024-09-13T22:56:19.166 INFO:tasks.workunit.client.0.smithi002.stdout:6/684: truncate d12/d17/d34/d39/d8a/fc2 4164331 0 2024-09-13T22:56:19.170 INFO:tasks.workunit.client.0.smithi002.stdout:2/678: write d1/d4a/fa8 [61004,105946] 0 2024-09-13T22:56:19.172 INFO:tasks.workunit.client.1.smithi047.stdout:6/737: creat d3/d11/d2b/d76/ff3 x:0 0 0 2024-09-13T22:56:19.174 INFO:tasks.workunit.client.0.smithi002.stdout:9/745: getdents d8/d10/d1c/dbf 0 2024-09-13T22:56:19.175 INFO:tasks.workunit.client.1.smithi047.stdout:5/645: fsync d19/d34/f46 0 2024-09-13T22:56:19.176 INFO:tasks.workunit.client.1.smithi047.stdout:5/646: chown d19/d23/d2e/f59 1853992 1 2024-09-13T22:56:19.178 INFO:tasks.workunit.client.0.smithi002.stdout:6/685: fsync d12/d17/d34/d39/f92 0 2024-09-13T22:56:19.181 INFO:tasks.workunit.client.0.smithi002.stdout:2/679: mkdir d1/d7/d41/d96/dba/de3 0 2024-09-13T22:56:19.183 INFO:tasks.workunit.client.1.smithi047.stdout:2/755: link d1/f11 d1/df/d1d/d20/d37/d7b/db6/de9/ded/ffc 0 2024-09-13T22:56:19.186 INFO:tasks.workunit.client.0.smithi002.stdout:0/681: rename d1/d4/d75/d31/d32/dce to d1/d7e/d9d/de6/df5 0 2024-09-13T22:56:19.187 INFO:tasks.workunit.client.1.smithi047.stdout:6/738: truncate d3/f42 1403206 0 2024-09-13T22:56:19.188 INFO:tasks.workunit.client.1.smithi047.stdout:2/756: dread d1/df/d1d/d2e/fa7 [0,4194304] 0 2024-09-13T22:56:19.191 INFO:tasks.workunit.client.1.smithi047.stdout:9/696: creat d1/dc/d14/dd/d54/fe2 x:0 0 0 2024-09-13T22:56:19.192 INFO:tasks.workunit.client.0.smithi002.stdout:2/680: rmdir d1/d7/d35/d3e 39 2024-09-13T22:56:19.196 INFO:tasks.workunit.client.1.smithi047.stdout:7/728: creat d0/fed x:0 0 0 2024-09-13T22:56:19.198 INFO:tasks.workunit.client.0.smithi002.stdout:5/672: rename d1/d2a/d6b/d88/l44 to d1/d2a/d69/db8/lf5 0 2024-09-13T22:56:19.199 INFO:tasks.workunit.client.1.smithi047.stdout:0/747: mknod d1/d5/d11/cf3 0 2024-09-13T22:56:19.200 INFO:tasks.workunit.client.0.smithi002.stdout:0/682: chown d1/d4/d75/d31/d32/l6a 915593771 1 2024-09-13T22:56:19.203 INFO:tasks.workunit.client.0.smithi002.stdout:2/681: symlink d1/d7/d41/d96/dba/le4 0 2024-09-13T22:56:19.204 INFO:tasks.workunit.client.1.smithi047.stdout:6/739: symlink d3/d11/d2b/d4c/d9d/dac/lf4 0 2024-09-13T22:56:19.205 INFO:tasks.workunit.client.1.smithi047.stdout:6/740: chown d3/f26 131 1 2024-09-13T22:56:19.207 INFO:tasks.workunit.client.1.smithi047.stdout:6/741: write d3/d77/d8f/db9/fc3 [707065,101196] 0 2024-09-13T22:56:19.209 INFO:tasks.workunit.client.0.smithi002.stdout:1/723: rename d1/d13/d21/c46 to d1/d13/d30/dc1/cf6 0 2024-09-13T22:56:19.209 INFO:tasks.workunit.client.1.smithi047.stdout:2/757: creat d1/df/d1d/d2e/d5e/ffd x:0 0 0 2024-09-13T22:56:19.210 INFO:tasks.workunit.client.0.smithi002.stdout:5/673: rmdir d1/d2a/d5a 39 2024-09-13T22:56:19.215 INFO:tasks.workunit.client.0.smithi002.stdout:6/686: rename d12/d17/d28/d67/d6b/f9d to d12/d17/d28/d67/d6b/daa/dc6/fdc 0 2024-09-13T22:56:19.217 INFO:tasks.workunit.client.1.smithi047.stdout:7/729: truncate d0/d7/da/d4e/f4f 4063264 0 2024-09-13T22:56:19.218 INFO:tasks.workunit.client.1.smithi047.stdout:7/730: write d0/db/f16 [1596725,123472] 0 2024-09-13T22:56:19.218 INFO:tasks.workunit.client.0.smithi002.stdout:5/674: creat d1/d2a/d6b/d88/d55/d56/ff6 x:0 0 0 2024-09-13T22:56:19.218 INFO:tasks.workunit.client.1.smithi047.stdout:7/731: chown d0/d7/da/d1e/d51/f99 316 1 2024-09-13T22:56:19.220 INFO:tasks.workunit.client.0.smithi002.stdout:0/683: mkdir d1/df6 0 2024-09-13T22:56:19.222 INFO:tasks.workunit.client.0.smithi002.stdout:8/670: rmdir d3/dc/d16 39 2024-09-13T22:56:19.228 INFO:tasks.workunit.client.0.smithi002.stdout:4/625: write d3/d14/d29/d2a/da6/f84 [879766,27368] 0 2024-09-13T22:56:19.230 INFO:tasks.workunit.client.0.smithi002.stdout:6/687: dread d12/fb5 [0,4194304] 0 2024-09-13T22:56:19.230 INFO:tasks.workunit.client.0.smithi002.stdout:5/675: fdatasync d1/d2a/d6b/d88/d45/f9f 0 2024-09-13T22:56:19.235 INFO:tasks.workunit.client.0.smithi002.stdout:8/671: mkdir d3/dc/da4/dd4 0 2024-09-13T22:56:19.237 INFO:tasks.workunit.client.1.smithi047.stdout:3/782: truncate d0/d3/d4/d16/d2c/de/d1f/d3b/f51 1590427 0 2024-09-13T22:56:19.238 INFO:tasks.workunit.client.0.smithi002.stdout:0/684: dwrite d1/d2/d81/d8f/f47 [4194304,4194304] 0 2024-09-13T22:56:19.239 INFO:tasks.workunit.client.0.smithi002.stdout:4/626: creat d3/d14/d29/d2a/dbc/fc2 x:0 0 0 2024-09-13T22:56:19.246 INFO:tasks.workunit.client.1.smithi047.stdout:2/758: creat d1/df/d35/ffe x:0 0 0 2024-09-13T22:56:19.247 INFO:tasks.workunit.client.1.smithi047.stdout:3/783: dwrite d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/fca [0,4194304] 0 2024-09-13T22:56:19.260 INFO:tasks.workunit.client.0.smithi002.stdout:7/635: rmdir d8/d10/d39/d60/db8/d26 39 2024-09-13T22:56:19.262 INFO:tasks.workunit.client.1.smithi047.stdout:2/759: dread d1/df/d35/f45 [0,4194304] 0 2024-09-13T22:56:19.265 INFO:tasks.workunit.client.0.smithi002.stdout:5/676: mkdir d1/d57/dd0/df7 0 2024-09-13T22:56:19.265 INFO:tasks.workunit.client.0.smithi002.stdout:5/677: chown d1/d2a/d6b/d88/d55 5282 1 2024-09-13T22:56:19.265 INFO:tasks.workunit.client.0.smithi002.stdout:5/678: dread d1/d57/fdf [0,4194304] 0 2024-09-13T22:56:19.270 INFO:tasks.workunit.client.0.smithi002.stdout:0/685: creat d1/d4/d75/d31/d32/dbb/de1/ff7 x:0 0 0 2024-09-13T22:56:19.270 INFO:tasks.workunit.client.0.smithi002.stdout:7/636: chown d8/d10/d39/d60/db8/d26/d4c/d81/fd 12673834 1 2024-09-13T22:56:19.271 INFO:tasks.workunit.client.0.smithi002.stdout:3/734: write d9/d15/d26/d93/f6b [56038,30206] 0 2024-09-13T22:56:19.275 INFO:tasks.workunit.client.0.smithi002.stdout:3/735: mknod d9/dd1/c10a 0 2024-09-13T22:56:19.279 INFO:tasks.workunit.client.0.smithi002.stdout:1/724: rename d1/d13/d52 to d1/d13/d21/d39/df7 0 2024-09-13T22:56:19.280 INFO:tasks.workunit.client.0.smithi002.stdout:7/637: creat d8/d10/d39/d60/db8/d26/d95/fbc x:0 0 0 2024-09-13T22:56:19.281 INFO:tasks.workunit.client.0.smithi002.stdout:1/725: write d1/d13/d30/d31/d3d/fc9 [875418,122494] 0 2024-09-13T22:56:19.281 INFO:tasks.workunit.client.0.smithi002.stdout:4/627: link d3/d40/d45/c4c d3/d14/d29/d2a/da6/d69/cc3 0 2024-09-13T22:56:19.282 INFO:tasks.workunit.client.0.smithi002.stdout:1/726: dread - d1/d13/d1d/d34/d51/dc6/ff5 zero size 2024-09-13T22:56:19.283 INFO:tasks.workunit.client.0.smithi002.stdout:4/628: write d3/d62/fbf [773633,85961] 0 2024-09-13T22:56:19.284 INFO:tasks.workunit.client.0.smithi002.stdout:0/686: rename d1/d2/d81/d8f to d1/d4/da3/d7d/df8 0 2024-09-13T22:56:19.285 INFO:tasks.workunit.client.0.smithi002.stdout:0/687: dread d1/d4/f96 [4194304,4194304] 0 2024-09-13T22:56:19.286 INFO:tasks.workunit.client.0.smithi002.stdout:3/736: mknod d9/d15/d36/c10b 0 2024-09-13T22:56:19.290 INFO:tasks.workunit.client.0.smithi002.stdout:2/682: sync 2024-09-13T22:56:19.292 INFO:tasks.workunit.client.0.smithi002.stdout:0/688: creat d1/d4/d75/dca/ff9 x:0 0 0 2024-09-13T22:56:19.292 INFO:tasks.workunit.client.1.smithi047.stdout:1/823: sync 2024-09-13T22:56:19.293 INFO:tasks.workunit.client.1.smithi047.stdout:4/854: sync 2024-09-13T22:56:19.297 INFO:tasks.workunit.client.0.smithi002.stdout:1/727: creat d1/d13/d30/de1/ff8 x:0 0 0 2024-09-13T22:56:19.300 INFO:tasks.workunit.client.0.smithi002.stdout:4/629: creat d3/d14/d86/db1/fc4 x:0 0 0 2024-09-13T22:56:19.303 INFO:tasks.workunit.client.1.smithi047.stdout:1/824: mkdir d0/d1d/daa/df0 0 2024-09-13T22:56:19.304 INFO:tasks.workunit.client.1.smithi047.stdout:1/825: fsync d0/d7/d13/d8c/fb4 0 2024-09-13T22:56:19.305 INFO:tasks.workunit.client.0.smithi002.stdout:2/683: dread d1/d7/d41/d96/f97 [0,4194304] 0 2024-09-13T22:56:19.305 INFO:tasks.workunit.client.1.smithi047.stdout:2/760: chown d1/df/d1d/d20/d29/lfb 43000686 1 2024-09-13T22:56:19.310 INFO:tasks.workunit.client.0.smithi002.stdout:1/728: dread d1/d13/d21/d39/d70/f96 [0,4194304] 0 2024-09-13T22:56:19.311 INFO:tasks.workunit.client.0.smithi002.stdout:7/638: symlink d8/d10/d11/d3a/lbd 0 2024-09-13T22:56:19.311 INFO:tasks.workunit.client.0.smithi002.stdout:7/639: fdatasync d8/d10/f23 0 2024-09-13T22:56:19.313 INFO:tasks.workunit.client.1.smithi047.stdout:0/748: rename d1/cf1 to d1/d5/d16/cf4 0 2024-09-13T22:56:19.315 INFO:tasks.workunit.client.1.smithi047.stdout:1/826: chown d0/c3b 108315 1 2024-09-13T22:56:19.320 INFO:tasks.workunit.client.1.smithi047.stdout:6/742: rename d3/d11/d2b/d1c/lcb to d3/d11/d2b/d4c/d30/d48/lf5 0 2024-09-13T22:56:19.323 INFO:tasks.workunit.client.0.smithi002.stdout:6/688: read d12/d17/d34/d39/d8a/fc2 [346949,64584] 0 2024-09-13T22:56:19.324 INFO:tasks.workunit.client.0.smithi002.stdout:4/630: symlink d3/d40/d45/lc5 0 2024-09-13T22:56:19.327 INFO:tasks.workunit.client.1.smithi047.stdout:2/761: rename d1/df/d1d/d20/d37/d7b to d1/df/d1d/d20/d29/dcd/dff 0 2024-09-13T22:56:19.328 INFO:tasks.workunit.client.1.smithi047.stdout:2/762: fsync d1/df/d26/f30 0 2024-09-13T22:56:19.329 INFO:tasks.workunit.client.1.smithi047.stdout:2/763: stat d1/df/d1d/da9 0 2024-09-13T22:56:19.330 INFO:tasks.workunit.client.1.smithi047.stdout:1/827: mkdir d0/d1d/daa/df0/df1 0 2024-09-13T22:56:19.332 INFO:tasks.workunit.client.1.smithi047.stdout:5/647: write d19/d34/f46 [664964,77829] 0 2024-09-13T22:56:19.337 INFO:tasks.workunit.client.0.smithi002.stdout:9/746: write d8/d91/d96/d87/fea [997084,27970] 0 2024-09-13T22:56:19.340 INFO:tasks.workunit.client.1.smithi047.stdout:8/684: dwrite d8/d64/d4e/d4d/d8f/d91/d40/f5c [0,4194304] 0 2024-09-13T22:56:19.343 INFO:tasks.workunit.client.0.smithi002.stdout:9/747: dread d8/d10/db1/fe8 [0,4194304] 0 2024-09-13T22:56:19.347 INFO:tasks.workunit.client.1.smithi047.stdout:6/743: rename d3/d11/d2b/cb6 to d3/d11/d2b/d4c/dc0/cf6 0 2024-09-13T22:56:19.349 INFO:tasks.workunit.client.0.smithi002.stdout:0/689: rename d1/d2/f67 to d1/d4/d75/d76/ffa 0 2024-09-13T22:56:19.351 INFO:tasks.workunit.client.1.smithi047.stdout:6/744: dread d3/f26 [0,4194304] 0 2024-09-13T22:56:19.354 INFO:tasks.workunit.client.0.smithi002.stdout:0/690: dwrite d1/d4/f3e [0,4194304] 0 2024-09-13T22:56:19.358 INFO:tasks.workunit.client.0.smithi002.stdout:2/684: mknod d1/d7/d35/ce5 0 2024-09-13T22:56:19.359 INFO:tasks.workunit.client.1.smithi047.stdout:8/685: readlink d8/d64/d4e/d4d/l68 0 2024-09-13T22:56:19.361 INFO:tasks.workunit.client.1.smithi047.stdout:8/686: chown d8/d64/d4e/d4d/d8f/cd1 0 1 2024-09-13T22:56:19.362 INFO:tasks.workunit.client.0.smithi002.stdout:1/729: mkdir d1/d13/d30/d73/da1/d7d/df9 0 2024-09-13T22:56:19.363 INFO:tasks.workunit.client.0.smithi002.stdout:2/685: dwrite d1/d80/fb6 [0,4194304] 0 2024-09-13T22:56:19.366 INFO:tasks.workunit.client.0.smithi002.stdout:7/640: mknod d8/d10/d39/d60/db8/d26/d4c/d81/d51/da9/cbe 0 2024-09-13T22:56:19.368 INFO:tasks.workunit.client.0.smithi002.stdout:7/641: write d8/d10/d39/d60/db8/d26/f92 [261286,1021] 0 2024-09-13T22:56:19.370 INFO:tasks.workunit.client.0.smithi002.stdout:7/642: write d8/d10/d39/d60/db8/d26/d38/fac [563096,45169] 0 2024-09-13T22:56:19.375 INFO:tasks.workunit.client.1.smithi047.stdout:6/745: creat d3/d11/d2b/d1c/dbd/de8/ff7 x:0 0 0 2024-09-13T22:56:19.376 INFO:tasks.workunit.client.1.smithi047.stdout:6/746: chown d3/d11/d2b/d4c/d30/d48/dd7 3251 1 2024-09-13T22:56:19.377 INFO:tasks.workunit.client.1.smithi047.stdout:8/687: creat d8/d77/ff1 x:0 0 0 2024-09-13T22:56:19.379 INFO:tasks.workunit.client.1.smithi047.stdout:9/697: truncate d1/dc/d14/dd/d54/d50/f66 2664033 0 2024-09-13T22:56:19.380 INFO:tasks.workunit.client.1.smithi047.stdout:7/732: write d0/f29 [4042474,103771] 0 2024-09-13T22:56:19.387 INFO:tasks.workunit.client.0.smithi002.stdout:1/730: symlink d1/d13/d30/dc1/lfa 0 2024-09-13T22:56:19.387 INFO:tasks.workunit.client.0.smithi002.stdout:1/731: chown d1/d13/d30/d73/da1/d7d/df9 0 1 2024-09-13T22:56:19.393 INFO:tasks.workunit.client.0.smithi002.stdout:1/732: dwrite d1/ff [0,4194304] 0 2024-09-13T22:56:19.393 INFO:tasks.workunit.client.1.smithi047.stdout:8/688: fdatasync d8/d77/fb3 0 2024-09-13T22:56:19.396 INFO:tasks.workunit.client.1.smithi047.stdout:3/784: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/fc5 [764654,79388] 0 2024-09-13T22:56:19.398 INFO:tasks.workunit.client.1.smithi047.stdout:1/828: rename d0/d7/db/deb to d0/d7/d14/df2 0 2024-09-13T22:56:19.401 INFO:tasks.workunit.client.1.smithi047.stdout:3/785: read d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d3a/d81/fa8 [3282061,33239] 0 2024-09-13T22:56:19.402 INFO:tasks.workunit.client.0.smithi002.stdout:8/672: truncate d3/dc/d18/f67 1360801 0 2024-09-13T22:56:19.402 INFO:tasks.workunit.client.1.smithi047.stdout:9/698: mknod d1/dc/d14/dd/dba/ce3 0 2024-09-13T22:56:19.405 INFO:tasks.workunit.client.0.smithi002.stdout:7/643: dwrite d8/d10/d39/d60/db8/d2e/d3c/f97 [0,4194304] 0 2024-09-13T22:56:19.409 INFO:tasks.workunit.client.0.smithi002.stdout:5/679: dwrite d1/f18 [0,4194304] 0 2024-09-13T22:56:19.412 INFO:tasks.workunit.client.0.smithi002.stdout:4/631: rename d3/d14/f8c to d3/d14/d85/fc6 0 2024-09-13T22:56:19.425 INFO:tasks.workunit.client.0.smithi002.stdout:8/673: dread - d3/dc/d16/d2f/d83/f9b zero size 2024-09-13T22:56:19.426 INFO:tasks.workunit.client.1.smithi047.stdout:4/855: write dc/d29/d8e/dda/ff0 [844612,110292] 0 2024-09-13T22:56:19.427 INFO:tasks.workunit.client.1.smithi047.stdout:4/856: chown dc/da3/f117 682561023 1 2024-09-13T22:56:19.431 INFO:tasks.workunit.client.0.smithi002.stdout:8/674: dwrite d3/dc/d16/d60/f64 [0,4194304] 0 2024-09-13T22:56:19.434 INFO:tasks.workunit.client.0.smithi002.stdout:5/680: rename d1/d2a/d6b/d88/f5b to d1/d2a/d6b/ff8 0 2024-09-13T22:56:19.435 INFO:tasks.workunit.client.0.smithi002.stdout:4/632: dread d3/d14/d29/d2a/f43 [0,4194304] 0 2024-09-13T22:56:19.438 INFO:tasks.workunit.client.0.smithi002.stdout:6/689: sync 2024-09-13T22:56:19.440 INFO:tasks.workunit.client.0.smithi002.stdout:3/737: write d9/d15/d36/d4e/d5e/f105 [509252,50816] 0 2024-09-13T22:56:19.442 INFO:tasks.workunit.client.0.smithi002.stdout:1/733: mkdir d1/d13/d21/d40/ddc/dfb 0 2024-09-13T22:56:19.445 INFO:tasks.workunit.client.0.smithi002.stdout:1/734: dread d1/d13/f32 [0,4194304] 0 2024-09-13T22:56:19.446 INFO:tasks.workunit.client.0.smithi002.stdout:1/735: readlink d1/d13/d30/d31/lf0 0 2024-09-13T22:56:19.450 INFO:tasks.workunit.client.1.smithi047.stdout:2/764: write d1/d16/f23 [359483,97975] 0 2024-09-13T22:56:19.461 INFO:tasks.workunit.client.0.smithi002.stdout:6/690: mkdir d12/d17/d28/d67/d9f/ddd 0 2024-09-13T22:56:19.463 INFO:tasks.workunit.client.0.smithi002.stdout:0/691: link d1/d2/d6c/d8b/ld0 d1/lfb 0 2024-09-13T22:56:19.468 INFO:tasks.workunit.client.1.smithi047.stdout:5/648: getdents d19/d34 0 2024-09-13T22:56:19.473 INFO:tasks.workunit.client.1.smithi047.stdout:6/747: mkdir d3/d11/d2b/d1c/dca/df8 0 2024-09-13T22:56:19.473 INFO:tasks.workunit.client.1.smithi047.stdout:6/748: write d3/f7 [1839120,8016] 0 2024-09-13T22:56:19.475 INFO:tasks.workunit.client.0.smithi002.stdout:6/691: creat d12/d17/d28/d67/d9f/fde x:0 0 0 2024-09-13T22:56:19.476 INFO:tasks.workunit.client.0.smithi002.stdout:6/692: fdatasync d12/d17/fd2 0 2024-09-13T22:56:19.480 INFO:tasks.workunit.client.1.smithi047.stdout:6/749: dwrite d3/d11/d2b/d4c/dc0/ff2 [0,4194304] 0 2024-09-13T22:56:19.481 INFO:tasks.workunit.client.1.smithi047.stdout:6/750: readlink d3/d11/d2b/d4c/d30/d48/la0 0 2024-09-13T22:56:19.483 INFO:tasks.workunit.client.0.smithi002.stdout:3/738: creat d9/d3b/da5/f10c x:0 0 0 2024-09-13T22:56:19.483 INFO:tasks.workunit.client.0.smithi002.stdout:3/739: chown d9/d15/d51/c72 89 1 2024-09-13T22:56:19.484 INFO:tasks.workunit.client.0.smithi002.stdout:3/740: chown d9/d15/d51/f1d 182065372 1 2024-09-13T22:56:19.484 INFO:tasks.workunit.client.1.smithi047.stdout:1/829: mkdir d0/d7/d14/d28/df3 0 2024-09-13T22:56:19.486 INFO:tasks.workunit.client.1.smithi047.stdout:1/830: chown d0/d7/d13/d2d/fda 1886 1 2024-09-13T22:56:19.487 INFO:tasks.workunit.client.1.smithi047.stdout:1/831: write d0/d7/d14/fe4 [654452,50763] 0 2024-09-13T22:56:19.494 INFO:tasks.workunit.client.0.smithi002.stdout:2/686: sync 2024-09-13T22:56:19.495 INFO:tasks.workunit.client.0.smithi002.stdout:3/741: dread d9/d3b/d7c/f80 [0,4194304] 0 2024-09-13T22:56:19.497 INFO:tasks.workunit.client.0.smithi002.stdout:9/748: truncate d8/d10/d1c/f83 1474672 0 2024-09-13T22:56:19.498 INFO:tasks.workunit.client.0.smithi002.stdout:9/749: stat d8/caa 0 2024-09-13T22:56:19.498 INFO:tasks.workunit.client.0.smithi002.stdout:2/687: dread d1/d7/d35/f48 [0,4194304] 0 2024-09-13T22:56:19.498 INFO:tasks.workunit.client.1.smithi047.stdout:9/699: fdatasync d1/dc/d14/dd/d54/fbf 0 2024-09-13T22:56:19.499 INFO:tasks.workunit.client.1.smithi047.stdout:7/733: write d0/d7/da/d2e/fbe [760916,54340] 0 2024-09-13T22:56:19.499 INFO:tasks.workunit.client.0.smithi002.stdout:6/693: dread - d12/d17/d4e/fa6 zero size 2024-09-13T22:56:19.500 INFO:tasks.workunit.client.0.smithi002.stdout:3/742: dread d9/d3b/d53/d83/fe4 [0,4194304] 0 2024-09-13T22:56:19.503 INFO:tasks.workunit.client.0.smithi002.stdout:0/692: creat d1/d7e/ffc x:0 0 0 2024-09-13T22:56:19.505 INFO:tasks.workunit.client.1.smithi047.stdout:4/857: symlink dc/de/d23/d40/d7b/dab/dae/l127 0 2024-09-13T22:56:19.506 INFO:tasks.workunit.client.0.smithi002.stdout:1/736: creat d1/d13/d30/d73/da1/ffc x:0 0 0 2024-09-13T22:56:19.508 INFO:tasks.workunit.client.0.smithi002.stdout:5/681: link d1/d2a/d6b/d88/f74 d1/ff9 0 2024-09-13T22:56:19.513 INFO:tasks.workunit.client.0.smithi002.stdout:9/750: chown d8/d10/c38 362799 1 2024-09-13T22:56:19.516 INFO:tasks.workunit.client.1.smithi047.stdout:5/649: unlink d19/d34/f46 0 2024-09-13T22:56:19.517 INFO:tasks.workunit.client.1.smithi047.stdout:0/749: sync 2024-09-13T22:56:19.518 INFO:tasks.workunit.client.1.smithi047.stdout:4/858: dread dc/de/d23/d40/d7b/dab/ff1 [0,4194304] 0 2024-09-13T22:56:19.519 INFO:tasks.workunit.client.1.smithi047.stdout:0/750: chown d1/d5/d11/d2f/l70 236034340 1 2024-09-13T22:56:19.519 INFO:tasks.workunit.client.1.smithi047.stdout:4/859: dread - dc/de/d23/ddf/f11a zero size 2024-09-13T22:56:19.520 INFO:tasks.workunit.client.1.smithi047.stdout:0/751: read d1/d5/d16/d23/d2d/fc3 [4684834,76939] 0 2024-09-13T22:56:19.522 INFO:tasks.workunit.client.0.smithi002.stdout:8/675: sync 2024-09-13T22:56:19.523 INFO:tasks.workunit.client.0.smithi002.stdout:8/676: chown d3/dc/d16/d4b/d72/d73/cc0 242927496 1 2024-09-13T22:56:19.524 INFO:tasks.workunit.client.0.smithi002.stdout:3/743: symlink d9/d3b/d53/db9/l10d 0 2024-09-13T22:56:19.524 INFO:tasks.workunit.client.0.smithi002.stdout:3/744: chown d9/d15/d26/fc4 1985369203 1 2024-09-13T22:56:19.527 INFO:tasks.workunit.client.0.smithi002.stdout:7/644: truncate d8/d10/f2a 1691368 0 2024-09-13T22:56:19.532 INFO:tasks.workunit.client.0.smithi002.stdout:0/693: dread d1/f63 [0,4194304] 0 2024-09-13T22:56:19.537 INFO:tasks.workunit.client.0.smithi002.stdout:5/682: creat d1/d10/ffa x:0 0 0 2024-09-13T22:56:19.538 INFO:tasks.workunit.client.0.smithi002.stdout:4/633: dwrite d3/d40/f70 [0,4194304] 0 2024-09-13T22:56:19.539 INFO:tasks.workunit.client.0.smithi002.stdout:4/634: fsync d3/d14/d29/d2a/da6/f84 0 2024-09-13T22:56:19.542 INFO:tasks.workunit.client.0.smithi002.stdout:9/751: read d8/d10/d42/f7f [3875496,118612] 0 2024-09-13T22:56:19.543 INFO:tasks.workunit.client.1.smithi047.stdout:3/786: mkdir d0/d3/d4/d16/d32/d42/d79/d9c/dad/d95/dc3/df6/df7 0 2024-09-13T22:56:19.553 INFO:tasks.workunit.client.0.smithi002.stdout:7/645: symlink d8/d10/d39/d60/db8/d26/d4c/d81/lbf 0 2024-09-13T22:56:19.554 INFO:tasks.workunit.client.0.smithi002.stdout:7/646: write d8/d10/f45 [2896639,66443] 0 2024-09-13T22:56:19.554 INFO:tasks.workunit.client.1.smithi047.stdout:2/765: symlink d1/df/d26/d9f/df2/l100 0 2024-09-13T22:56:19.562 INFO:tasks.workunit.client.1.smithi047.stdout:0/752: fdatasync d1/d5/d16/d23/d2d/f61 0 2024-09-13T22:56:19.563 INFO:tasks.workunit.client.0.smithi002.stdout:4/635: mknod d3/d14/d29/d2a/da6/d69/d7e/cc7 0 2024-09-13T22:56:19.564 INFO:tasks.workunit.client.0.smithi002.stdout:7/647: dread d8/f5d [0,4194304] 0 2024-09-13T22:56:19.568 INFO:tasks.workunit.client.1.smithi047.stdout:1/832: symlink d0/d1d/daa/df0/df1/lf4 0 2024-09-13T22:56:19.570 INFO:tasks.workunit.client.0.smithi002.stdout:3/745: symlink d9/d15/d36/d4e/d5e/dae/de6/l10e 0 2024-09-13T22:56:19.574 INFO:tasks.workunit.client.0.smithi002.stdout:6/694: rename d12/d17/d28/d67/d9f/dc3 to d12/d17/ddf 0 2024-09-13T22:56:19.584 INFO:tasks.workunit.client.1.smithi047.stdout:2/766: creat d1/df/d1d/d20/d37/f101 x:0 0 0 2024-09-13T22:56:19.588 INFO:tasks.workunit.client.0.smithi002.stdout:9/752: mknod d8/d10/d42/ddd/cf5 0 2024-09-13T22:56:19.593 INFO:tasks.workunit.client.1.smithi047.stdout:8/689: link d8/c15 d8/d6b/da9/dc3/cf2 0 2024-09-13T22:56:19.595 INFO:tasks.workunit.client.1.smithi047.stdout:1/833: write d0/d7/d14/d28/d36/f32 [513544,114049] 0 2024-09-13T22:56:19.596 INFO:tasks.workunit.client.0.smithi002.stdout:1/737: dwrite d1/f15 [0,4194304] 0 2024-09-13T22:56:19.596 INFO:tasks.workunit.client.0.smithi002.stdout:3/746: symlink d9/d15/d36/d4e/l10f 0 2024-09-13T22:56:19.597 INFO:tasks.workunit.client.1.smithi047.stdout:6/751: dwrite d3/d11/d2b/d4c/d30/f72 [0,4194304] 0 2024-09-13T22:56:19.604 INFO:tasks.workunit.client.1.smithi047.stdout:7/734: getdents d0/d7/da/d1e/d93/db7 0 2024-09-13T22:56:19.607 INFO:tasks.workunit.client.0.smithi002.stdout:6/695: creat d12/d17/d28/d67/d6b/daa/dc6/fe0 x:0 0 0 2024-09-13T22:56:19.611 INFO:tasks.workunit.client.1.smithi047.stdout:2/767: fsync d1/de/f25 0 2024-09-13T22:56:19.613 INFO:tasks.workunit.client.0.smithi002.stdout:5/683: creat d1/ffb x:0 0 0 2024-09-13T22:56:19.614 INFO:tasks.workunit.client.0.smithi002.stdout:5/684: chown d1/d2a/d6b/d88/d45/f9f 45510569 1 2024-09-13T22:56:19.617 INFO:tasks.workunit.client.0.smithi002.stdout:9/753: fdatasync d8/d1e/f36 0 2024-09-13T22:56:19.619 INFO:tasks.workunit.client.1.smithi047.stdout:8/690: unlink d8/f1c 0 2024-09-13T22:56:19.620 INFO:tasks.workunit.client.1.smithi047.stdout:8/691: write d8/d64/d4e/d4d/d8f/d91/d40/f5c [3534597,79351] 0 2024-09-13T22:56:19.625 INFO:tasks.workunit.client.0.smithi002.stdout:8/677: getdents d3/dc/d18/d2e 0 2024-09-13T22:56:19.627 INFO:tasks.workunit.client.1.smithi047.stdout:6/752: rename d3/d11/d2b/f9b to d3/d11/d2b/d76/ff9 0 2024-09-13T22:56:19.627 INFO:tasks.workunit.client.0.smithi002.stdout:1/738: fdatasync d1/d13/d21/d40/f93 0 2024-09-13T22:56:19.628 INFO:tasks.workunit.client.1.smithi047.stdout:6/753: readlink d3/d11/d2b/d1c/dbf/lb7 0 2024-09-13T22:56:19.628 INFO:tasks.workunit.client.1.smithi047.stdout:3/787: dwrite d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/f49 [0,4194304] 0 2024-09-13T22:56:19.629 INFO:tasks.workunit.client.1.smithi047.stdout:9/700: getdents d1/dc/d14/dd/d54/d50/d5b/d9e 0 2024-09-13T22:56:19.632 INFO:tasks.workunit.client.1.smithi047.stdout:3/788: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/fc5 [410573,44406] 0 2024-09-13T22:56:19.635 INFO:tasks.workunit.client.0.smithi002.stdout:4/636: creat d3/fc8 x:0 0 0 2024-09-13T22:56:19.637 INFO:tasks.workunit.client.0.smithi002.stdout:5/685: rmdir d1/d2a/d6b/d88/d55/d56/de4 39 2024-09-13T22:56:19.642 INFO:tasks.workunit.client.0.smithi002.stdout:6/696: dread d12/d17/f18 [0,4194304] 0 2024-09-13T22:56:19.644 INFO:tasks.workunit.client.0.smithi002.stdout:8/678: fsync d3/dc/d51/d99/f7e 0 2024-09-13T22:56:19.644 INFO:tasks.workunit.client.0.smithi002.stdout:8/679: readlink d3/dc/d16/d4b/d72/lc7 0 2024-09-13T22:56:19.646 INFO:tasks.workunit.client.0.smithi002.stdout:7/648: truncate d8/d10/d39/d60/db8/d26/d4c/d81/f57 11408754 0 2024-09-13T22:56:19.646 INFO:tasks.workunit.client.0.smithi002.stdout:1/739: dread - d1/d13/d30/d31/d86/d9e/fba zero size 2024-09-13T22:56:19.648 INFO:tasks.workunit.client.0.smithi002.stdout:2/688: rename d1/d7/d41/d96/f97 to d1/d7/d35/d3e/d59/fe6 0 2024-09-13T22:56:19.652 INFO:tasks.workunit.client.0.smithi002.stdout:7/649: dread d8/d10/d39/d60/db8/d26/d38/fac [0,4194304] 0 2024-09-13T22:56:19.653 INFO:tasks.workunit.client.0.smithi002.stdout:1/740: dread d1/f63 [8388608,4194304] 0 2024-09-13T22:56:19.654 INFO:tasks.workunit.client.0.smithi002.stdout:2/689: creat d1/d7/d41/fe7 x:0 0 0 2024-09-13T22:56:19.657 INFO:tasks.workunit.client.0.smithi002.stdout:8/680: dread d3/dc/d18/d2e/f6b [0,4194304] 0 2024-09-13T22:56:19.657 INFO:tasks.workunit.client.0.smithi002.stdout:1/741: creat d1/d13/d30/d31/d3d/ffd x:0 0 0 2024-09-13T22:56:19.658 INFO:tasks.workunit.client.0.smithi002.stdout:9/754: getdents d8/d10/d61/de4 0 2024-09-13T22:56:19.658 INFO:tasks.workunit.client.0.smithi002.stdout:8/681: dread - d3/dc/d16/d2f/d83/f9b zero size 2024-09-13T22:56:19.659 INFO:tasks.workunit.client.0.smithi002.stdout:8/682: chown d3/dc/d16/l87 7 1 2024-09-13T22:56:19.659 INFO:tasks.workunit.client.0.smithi002.stdout:2/690: rename d1/d7/d8/d2c/d9d/fb2 to d1/d7/d8/d4f/fe8 0 2024-09-13T22:56:19.660 INFO:tasks.workunit.client.0.smithi002.stdout:7/650: creat d8/d10/d39/d60/db8/d26/d38/d68/fc0 x:0 0 0 2024-09-13T22:56:19.660 INFO:tasks.workunit.client.0.smithi002.stdout:8/683: write d3/d21/d57/da1/fac [18568,53379] 0 2024-09-13T22:56:19.661 INFO:tasks.workunit.client.0.smithi002.stdout:9/755: getdents d8/d10/d61/de4 0 2024-09-13T22:56:19.663 INFO:tasks.workunit.client.0.smithi002.stdout:2/691: creat d1/d7/d8/fe9 x:0 0 0 2024-09-13T22:56:19.665 INFO:tasks.workunit.client.0.smithi002.stdout:1/742: getdents d1/d13 0 2024-09-13T22:56:19.665 INFO:tasks.workunit.client.0.smithi002.stdout:8/684: truncate d3/dc/d18/f67 255857 0 2024-09-13T22:56:19.667 INFO:tasks.workunit.client.0.smithi002.stdout:9/756: rename d8/d10/d42/f4d to d8/d2c/ff6 0 2024-09-13T22:56:19.668 INFO:tasks.workunit.client.0.smithi002.stdout:9/757: readlink d8/d10/d1c/l73 0 2024-09-13T22:56:19.668 INFO:tasks.workunit.client.0.smithi002.stdout:9/758: chown d8/d10/d61/f81 118266 1 2024-09-13T22:56:19.669 INFO:tasks.workunit.client.0.smithi002.stdout:1/743: mkdir d1/d13/d1d/d34/dfe 0 2024-09-13T22:56:19.669 INFO:tasks.workunit.client.0.smithi002.stdout:1/744: dread - d1/d13/d21/ff1 zero size 2024-09-13T22:56:19.672 INFO:tasks.workunit.client.0.smithi002.stdout:8/685: creat d3/dc/d18/fd5 x:0 0 0 2024-09-13T22:56:19.673 INFO:tasks.workunit.client.1.smithi047.stdout:7/735: mkdir d0/d57/dee 0 2024-09-13T22:56:19.674 INFO:tasks.workunit.client.1.smithi047.stdout:4/860: getdents dc/de/db9 0 2024-09-13T22:56:19.674 INFO:tasks.workunit.client.0.smithi002.stdout:1/745: chown d1/d13/d30/d31/d3d/c50 1783977 1 2024-09-13T22:56:19.675 INFO:tasks.workunit.client.0.smithi002.stdout:7/651: read d8/d10/d39/d60/db8/d26/f96 [7351857,110574] 0 2024-09-13T22:56:19.675 INFO:tasks.workunit.client.0.smithi002.stdout:0/694: sync 2024-09-13T22:56:19.675 INFO:tasks.workunit.client.0.smithi002.stdout:8/686: creat d3/dc/d18/d2e/d94/fd6 x:0 0 0 2024-09-13T22:56:19.675 INFO:tasks.workunit.client.0.smithi002.stdout:2/692: read d1/f5 [7851084,21826] 0 2024-09-13T22:56:19.676 INFO:tasks.workunit.client.1.smithi047.stdout:1/834: unlink d0/d7/d13/f39 0 2024-09-13T22:56:19.677 INFO:tasks.workunit.client.1.smithi047.stdout:5/650: rename d19/d34/d6c/fbe to d19/d83/d98/fcc 0 2024-09-13T22:56:19.678 INFO:tasks.workunit.client.1.smithi047.stdout:4/861: chown dc/de/d23/ddf/led 0 1 2024-09-13T22:56:19.681 INFO:tasks.workunit.client.1.smithi047.stdout:5/651: dread - d19/d64/fbc zero size 2024-09-13T22:56:19.682 INFO:tasks.workunit.client.0.smithi002.stdout:8/687: mknod d3/dc/d16/d4b/cd7 0 2024-09-13T22:56:19.683 INFO:tasks.workunit.client.1.smithi047.stdout:9/701: dwrite d1/dc/d18/f35 [0,4194304] 0 2024-09-13T22:56:19.683 INFO:tasks.workunit.client.1.smithi047.stdout:7/736: symlink d0/d57/da6/lef 0 2024-09-13T22:56:19.685 INFO:tasks.workunit.client.0.smithi002.stdout:0/695: dread d1/d2/f29 [0,4194304] 0 2024-09-13T22:56:19.686 INFO:tasks.workunit.client.0.smithi002.stdout:1/746: rename d1/d13/d1d/d34/cf4 to d1/d13/d21/d39/df7/cff 0 2024-09-13T22:56:19.687 INFO:tasks.workunit.client.0.smithi002.stdout:0/696: truncate d1/d4/da3/d7d/f9a 940238 0 2024-09-13T22:56:19.688 INFO:tasks.workunit.client.0.smithi002.stdout:0/697: chown d1/d4/da3/fa5 821221287 1 2024-09-13T22:56:19.689 INFO:tasks.workunit.client.1.smithi047.stdout:0/753: dwrite d1/d5/d16/d23/d2d/f55 [0,4194304] 0 2024-09-13T22:56:19.692 INFO:tasks.workunit.client.0.smithi002.stdout:8/688: symlink d3/d27/d39/ld8 0 2024-09-13T22:56:19.693 INFO:tasks.workunit.client.1.smithi047.stdout:8/692: dread d8/d64/d4e/d70/da7/fa8 [0,4194304] 0 2024-09-13T22:56:19.696 INFO:tasks.workunit.client.1.smithi047.stdout:3/789: unlink d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/f1e 0 2024-09-13T22:56:19.697 INFO:tasks.workunit.client.0.smithi002.stdout:1/747: symlink d1/d13/d30/d73/da1/d7d/l100 0 2024-09-13T22:56:19.698 INFO:tasks.workunit.client.1.smithi047.stdout:4/862: symlink dc/de/d23/d40/d7b/dab/dae/d102/l128 0 2024-09-13T22:56:19.701 INFO:tasks.workunit.client.0.smithi002.stdout:0/698: mknod d1/d4/da3/d7d/cfd 0 2024-09-13T22:56:19.702 INFO:tasks.workunit.client.1.smithi047.stdout:8/693: dwrite d8/d6b/fdd [0,4194304] 0 2024-09-13T22:56:19.709 INFO:tasks.workunit.client.1.smithi047.stdout:6/754: write d3/f8 [1140722,52910] 0 2024-09-13T22:56:19.710 INFO:tasks.workunit.client.1.smithi047.stdout:9/702: mknod d1/dc/d14/dd/d54/d50/d5b/ce4 0 2024-09-13T22:56:19.713 INFO:tasks.workunit.client.1.smithi047.stdout:8/694: dwrite d8/d64/d4e/dbd/fef [0,4194304] 0 2024-09-13T22:56:19.714 INFO:tasks.workunit.client.1.smithi047.stdout:1/835: dread d0/d7/db/f6b [0,4194304] 0 2024-09-13T22:56:19.714 INFO:tasks.workunit.client.1.smithi047.stdout:6/755: chown d3/d11/d2b/d1c/d4d/f84 3344 1 2024-09-13T22:56:19.715 INFO:tasks.workunit.client.1.smithi047.stdout:8/695: chown d8/cb1 51794014 1 2024-09-13T22:56:19.718 INFO:tasks.workunit.client.1.smithi047.stdout:8/696: chown d8/d64/d4e/d4d/d8f/l9b 381053 1 2024-09-13T22:56:19.718 INFO:tasks.workunit.client.1.smithi047.stdout:1/836: fdatasync d0/d7/d14/d57/d62/d76/fcb 0 2024-09-13T22:56:19.722 INFO:tasks.workunit.client.1.smithi047.stdout:1/837: truncate d0/d7/d14/d57/d62/d76/d94/fab 4471454 0 2024-09-13T22:56:19.722 INFO:tasks.workunit.client.0.smithi002.stdout:4/637: write f1 [2834083,108668] 0 2024-09-13T22:56:19.723 INFO:tasks.workunit.client.0.smithi002.stdout:4/638: fdatasync d3/d14/d86/fbd 0 2024-09-13T22:56:19.724 INFO:tasks.workunit.client.0.smithi002.stdout:5/686: write d1/d2a/d6b/d88/f5d [1343127,65483] 0 2024-09-13T22:56:19.724 INFO:tasks.workunit.client.1.smithi047.stdout:1/838: chown d0/d7/d14/l6f 3766 1 2024-09-13T22:56:19.726 INFO:tasks.workunit.client.1.smithi047.stdout:1/839: readlink d0/d7/db/d79/l83 0 2024-09-13T22:56:19.726 INFO:tasks.workunit.client.1.smithi047.stdout:8/697: dread d8/d64/f47 [0,4194304] 0 2024-09-13T22:56:19.729 INFO:tasks.workunit.client.1.smithi047.stdout:3/790: dwrite d0/d3/d4/d16/d2c/de/dcc/dd1/fe7 [0,4194304] 0 2024-09-13T22:56:19.735 INFO:tasks.workunit.client.0.smithi002.stdout:6/697: truncate d12/d17/fd1 245107 0 2024-09-13T22:56:19.741 INFO:tasks.workunit.client.1.smithi047.stdout:4/863: dread dc/de/d23/d40/f59 [0,4194304] 0 2024-09-13T22:56:19.744 INFO:tasks.workunit.client.0.smithi002.stdout:8/689: creat d3/dc/fd9 x:0 0 0 2024-09-13T22:56:19.747 INFO:tasks.workunit.client.0.smithi002.stdout:8/690: dread d3/dc/f13 [0,4194304] 0 2024-09-13T22:56:19.748 INFO:tasks.workunit.client.0.smithi002.stdout:5/687: getdents d1/d2a/d6b/d88/d55/d56/dc7 0 2024-09-13T22:56:19.753 INFO:tasks.workunit.client.0.smithi002.stdout:5/688: creat d1/d57/ffc x:0 0 0 2024-09-13T22:56:19.753 INFO:tasks.workunit.client.0.smithi002.stdout:8/691: mkdir d3/dc/d16/d2f/d83/d95/dda 0 2024-09-13T22:56:19.754 INFO:tasks.workunit.client.1.smithi047.stdout:8/698: mkdir d8/d77/df3 0 2024-09-13T22:56:19.755 INFO:tasks.workunit.client.0.smithi002.stdout:8/692: write d3/dc/da4/fa9 [1461106,27601] 0 2024-09-13T22:56:19.756 INFO:tasks.workunit.client.1.smithi047.stdout:8/699: write d8/d64/d4e/d4d/d8f/d91/d38/ff0 [902562,112872] 0 2024-09-13T22:56:19.756 INFO:tasks.workunit.client.0.smithi002.stdout:8/693: dread - d3/d21/d57/fc4 zero size 2024-09-13T22:56:19.757 INFO:tasks.workunit.client.1.smithi047.stdout:8/700: stat d8/d64/d4e/d4d/d8f/d91/f3c 0 2024-09-13T22:56:19.759 INFO:tasks.workunit.client.0.smithi002.stdout:7/652: dwrite d8/d10/d39/f4a [0,4194304] 0 2024-09-13T22:56:19.759 INFO:tasks.workunit.client.0.smithi002.stdout:3/747: sync 2024-09-13T22:56:19.759 INFO:tasks.workunit.client.0.smithi002.stdout:7/653: fdatasync d8/d10/d39/d60/db8/d2e/d50/d85/fb0 0 2024-09-13T22:56:19.760 INFO:tasks.workunit.client.0.smithi002.stdout:3/748: fsync d9/d91/fc9 0 2024-09-13T22:56:19.760 INFO:tasks.workunit.client.1.smithi047.stdout:1/840: rename d0/d7/d14/d28/d36/c4a to d0/d7/d14/d57/d62/cf5 0 2024-09-13T22:56:19.761 INFO:tasks.workunit.client.0.smithi002.stdout:3/749: dread - d9/d7e/ff5 zero size 2024-09-13T22:56:19.767 INFO:tasks.workunit.client.1.smithi047.stdout:9/703: symlink d1/d5f/dc7/le5 0 2024-09-13T22:56:19.770 INFO:tasks.workunit.client.1.smithi047.stdout:6/756: symlink d3/d11/lfa 0 2024-09-13T22:56:19.774 INFO:tasks.workunit.client.1.smithi047.stdout:4/864: mkdir dc/de/d23/dc4/d129 0 2024-09-13T22:56:19.774 INFO:tasks.workunit.client.1.smithi047.stdout:0/754: write d1/d5/d16/d23/d2d/fc3 [7051005,66880] 0 2024-09-13T22:56:19.775 INFO:tasks.workunit.client.1.smithi047.stdout:7/737: dwrite d0/d57/d5b/f8a [0,4194304] 0 2024-09-13T22:56:19.777 INFO:tasks.workunit.client.1.smithi047.stdout:1/841: read d0/d7/d14/d28/d36/f96 [459894,95408] 0 2024-09-13T22:56:19.777 INFO:tasks.workunit.client.1.smithi047.stdout:0/755: chown d1/d5/d11/d2f/fb0 9 1 2024-09-13T22:56:19.778 INFO:tasks.workunit.client.1.smithi047.stdout:8/701: dread d8/d64/d4e/d4d/d8f/d91/f3d [0,4194304] 0 2024-09-13T22:56:19.779 INFO:tasks.workunit.client.0.smithi002.stdout:1/748: truncate d1/d13/d30/d31/d3d/db6/fd0 2345948 0 2024-09-13T22:56:19.779 INFO:tasks.workunit.client.0.smithi002.stdout:9/759: dwrite d8/d10/d1c/f83 [0,4194304] 0 2024-09-13T22:56:19.781 INFO:tasks.workunit.client.0.smithi002.stdout:9/760: truncate d8/d2c/dbc/dc8/fc0 1805660 0 2024-09-13T22:56:19.785 INFO:tasks.workunit.client.1.smithi047.stdout:8/702: dread d8/f9e [0,4194304] 0 2024-09-13T22:56:19.790 INFO:tasks.workunit.client.1.smithi047.stdout:8/703: dread d8/d64/d4e/d4d/d8f/d91/d38/f3b [0,4194304] 0 2024-09-13T22:56:19.790 INFO:tasks.workunit.client.1.smithi047.stdout:9/704: mknod d1/dc/d14/dd/d54/d4e/ce6 0 2024-09-13T22:56:19.791 INFO:tasks.workunit.client.0.smithi002.stdout:0/699: truncate d1/d4/d75/d31/fbc 2807377 0 2024-09-13T22:56:19.792 INFO:tasks.workunit.client.1.smithi047.stdout:9/705: fsync d1/d5f/d6a/fd1 0 2024-09-13T22:56:19.798 INFO:tasks.workunit.client.1.smithi047.stdout:4/865: mkdir dc/de/d17/d25/d4a/d11c/d12a 0 2024-09-13T22:56:19.802 INFO:tasks.workunit.client.0.smithi002.stdout:2/693: sync 2024-09-13T22:56:19.806 INFO:tasks.workunit.client.1.smithi047.stdout:0/756: symlink d1/d5/d16/d47/lf5 0 2024-09-13T22:56:19.806 INFO:tasks.workunit.client.1.smithi047.stdout:1/842: dwrite d0/d7/d87/fcf [0,4194304] 0 2024-09-13T22:56:19.807 INFO:tasks.workunit.client.1.smithi047.stdout:3/791: write d0/d3/f96 [1502374,72929] 0 2024-09-13T22:56:19.814 INFO:tasks.workunit.client.1.smithi047.stdout:9/706: unlink d1/dc/d14/dd/d54/d4e/l74 0 2024-09-13T22:56:19.829 INFO:tasks.workunit.client.1.smithi047.stdout:0/757: dwrite d1/d5/d16/d97/de4/fec [4194304,4194304] 0 2024-09-13T22:56:19.830 INFO:tasks.workunit.client.1.smithi047.stdout:0/758: dread - d1/d5/d16/d6a/d92/fb1 zero size 2024-09-13T22:56:19.840 INFO:tasks.workunit.client.0.smithi002.stdout:4/639: sync 2024-09-13T22:56:19.844 INFO:tasks.workunit.client.1.smithi047.stdout:4/866: link dc/d29/d4c/ff8 dc/de/d23/d40/d7b/dab/dae/f12b 0 2024-09-13T22:56:19.849 INFO:tasks.workunit.client.0.smithi002.stdout:8/694: fsync d3/dc/d18/d56/f7c 0 2024-09-13T22:56:19.851 INFO:tasks.workunit.client.1.smithi047.stdout:8/704: creat d8/d6b/ff4 x:0 0 0 2024-09-13T22:56:19.852 INFO:tasks.workunit.client.1.smithi047.stdout:8/705: write d8/d64/d4e/d70/d98/fad [4731485,125923] 0 2024-09-13T22:56:19.855 INFO:tasks.workunit.client.1.smithi047.stdout:6/757: getdents d3/d11 0 2024-09-13T22:56:19.856 INFO:tasks.workunit.client.1.smithi047.stdout:6/758: stat d3/d11/d2b/d4c/dc0/d89 0 2024-09-13T22:56:19.859 INFO:tasks.workunit.client.1.smithi047.stdout:8/706: dread d8/d64/d4e/d4d/d8f/d91/d38/ff0 [0,4194304] 0 2024-09-13T22:56:19.860 INFO:tasks.workunit.client.1.smithi047.stdout:0/759: creat d1/d5/d16/d47/dd0/ff6 x:0 0 0 2024-09-13T22:56:19.861 INFO:tasks.workunit.client.1.smithi047.stdout:8/707: write d8/d64/d4e/d4d/d8f/d91/d78/fcc [269597,47884] 0 2024-09-13T22:56:19.862 INFO:tasks.workunit.client.0.smithi002.stdout:1/749: creat d1/d13/d21/d39/df7/f101 x:0 0 0 2024-09-13T22:56:19.862 INFO:tasks.workunit.client.1.smithi047.stdout:0/760: chown d1/d5/d16/d47/fd6 1023 1 2024-09-13T22:56:19.864 INFO:tasks.workunit.client.1.smithi047.stdout:1/843: write d0/d7/d14/d28/d36/fa8 [384257,72684] 0 2024-09-13T22:56:19.865 INFO:tasks.workunit.client.1.smithi047.stdout:1/844: write d0/fdc [551805,12580] 0 2024-09-13T22:56:19.866 INFO:tasks.workunit.client.1.smithi047.stdout:3/792: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/fef [171745,26413] 0 2024-09-13T22:56:19.868 INFO:tasks.workunit.client.1.smithi047.stdout:3/793: chown d0/d3/d4/d16/d2c/de/d1f/d2e 2 1 2024-09-13T22:56:19.869 INFO:tasks.workunit.client.1.smithi047.stdout:8/708: symlink d8/d64/d4e/dbd/lf5 0 2024-09-13T22:56:19.872 INFO:tasks.workunit.client.1.smithi047.stdout:8/709: write d8/f21 [8030423,73125] 0 2024-09-13T22:56:19.873 INFO:tasks.workunit.client.1.smithi047.stdout:9/707: dwrite d1/f8e [0,4194304] 0 2024-09-13T22:56:19.876 INFO:tasks.workunit.client.1.smithi047.stdout:0/761: symlink d1/d5/d16/d97/de4/lf7 0 2024-09-13T22:56:19.877 INFO:tasks.workunit.client.0.smithi002.stdout:6/698: getdents d12/d17/d28/d67/dca 0 2024-09-13T22:56:19.879 INFO:tasks.workunit.client.1.smithi047.stdout:8/710: dread d8/d64/d4e/d4d/f6a [0,4194304] 0 2024-09-13T22:56:19.886 INFO:tasks.workunit.client.1.smithi047.stdout:4/867: write dc/d29/d4d/fc6 [887399,68540] 0 2024-09-13T22:56:19.886 INFO:tasks.workunit.client.1.smithi047.stdout:8/711: dread d8/d64/d4e/d4d/d8f/d91/d40/f5c [0,4194304] 0 2024-09-13T22:56:19.889 INFO:tasks.workunit.client.0.smithi002.stdout:8/695: truncate d3/dc/f5f 4917287 0 2024-09-13T22:56:19.892 INFO:tasks.workunit.client.0.smithi002.stdout:8/696: dread d3/d27/f9c [0,4194304] 0 2024-09-13T22:56:19.893 INFO:tasks.workunit.client.0.smithi002.stdout:8/697: read - d3/d27/fc6 zero size 2024-09-13T22:56:19.894 INFO:tasks.workunit.client.0.smithi002.stdout:7/654: mknod d8/d10/d39/d60/db8/d2e/d3c/db2/cc1 0 2024-09-13T22:56:19.900 INFO:tasks.workunit.client.0.smithi002.stdout:5/689: truncate d1/f3e 6063139 0 2024-09-13T22:56:19.900 INFO:tasks.workunit.client.0.smithi002.stdout:8/698: dwrite d3/d27/fc6 [0,4194304] 0 2024-09-13T22:56:19.901 INFO:tasks.workunit.client.0.smithi002.stdout:4/640: dread d3/d14/d29/d2a/da6/d5e/f5f [0,4194304] 0 2024-09-13T22:56:19.901 INFO:tasks.workunit.client.1.smithi047.stdout:6/759: write d3/d11/d2b/d4c/f80 [990346,91029] 0 2024-09-13T22:56:19.902 INFO:tasks.workunit.client.1.smithi047.stdout:3/794: dread d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/f60 [0,4194304] 0 2024-09-13T22:56:19.906 INFO:tasks.workunit.client.1.smithi047.stdout:4/868: mknod dc/de/d23/d40/c12c 0 2024-09-13T22:56:19.911 INFO:tasks.workunit.client.0.smithi002.stdout:2/694: creat d1/d4d/d8b/de1/dd6/fea x:0 0 0 2024-09-13T22:56:19.914 INFO:tasks.workunit.client.1.smithi047.stdout:0/762: dwrite d1/d5/f8c [0,4194304] 0 2024-09-13T22:56:19.918 INFO:tasks.workunit.client.0.smithi002.stdout:7/655: symlink d8/d10/d39/d60/db8/d26/d38/lc2 0 2024-09-13T22:56:19.920 INFO:tasks.workunit.client.1.smithi047.stdout:1/845: rename d0/d7/d14/d28/l35 to d0/d7/d14/lf6 0 2024-09-13T22:56:19.924 INFO:tasks.workunit.client.1.smithi047.stdout:8/712: dwrite d8/fc [0,4194304] 0 2024-09-13T22:56:19.925 INFO:tasks.workunit.client.0.smithi002.stdout:3/750: rename d9/df/f23 to d9/d15/d36/d4e/d5e/f110 0 2024-09-13T22:56:19.929 INFO:tasks.workunit.client.0.smithi002.stdout:8/699: rmdir d3/dc/d16/d4b 39 2024-09-13T22:56:19.933 INFO:tasks.workunit.client.1.smithi047.stdout:9/708: rename d1/dc/d18/f35 to d1/dc/d14/dd/d54/d50/fe7 0 2024-09-13T22:56:19.935 INFO:tasks.workunit.client.0.smithi002.stdout:0/700: link d1/d4/d75/d31/d32/dbb/fcf d1/d4/d75/d31/d32/dbb/ffe 0 2024-09-13T22:56:19.937 INFO:tasks.workunit.client.0.smithi002.stdout:2/695: unlink d1/d4d/f71 0 2024-09-13T22:56:19.939 INFO:tasks.workunit.client.0.smithi002.stdout:7/656: dread - d8/d10/d39/d60/db8/f83 zero size 2024-09-13T22:56:19.941 INFO:tasks.workunit.client.1.smithi047.stdout:4/869: rename dc/de/d23/l6a to dc/de/d23/dc4/dc8/l12d 0 2024-09-13T22:56:19.944 INFO:tasks.workunit.client.0.smithi002.stdout:4/641: rename d3/d40/f76 to d3/d14/d29/d2a/da6/d69/fc9 0 2024-09-13T22:56:19.944 INFO:tasks.workunit.client.1.smithi047.stdout:8/713: fdatasync d8/f1f 0 2024-09-13T22:56:19.946 INFO:tasks.workunit.client.1.smithi047.stdout:0/763: link d1/d5/d16/d6a/d92/l98 d1/d5/d16/d6a/lf8 0 2024-09-13T22:56:19.947 INFO:tasks.workunit.client.0.smithi002.stdout:8/700: rmdir d3/dc/d16/d2f/d83/d85 39 2024-09-13T22:56:19.950 INFO:tasks.workunit.client.0.smithi002.stdout:9/761: getdents d8/d10/d1c/dd6 0 2024-09-13T22:56:19.956 INFO:tasks.workunit.client.0.smithi002.stdout:7/657: rmdir d8/d10/d39/d60/db8/d26/d4c/d81 39 2024-09-13T22:56:19.959 INFO:tasks.workunit.client.0.smithi002.stdout:4/642: mkdir d3/d14/d29/d2a/da6/d69/d7e/dca 0 2024-09-13T22:56:19.962 INFO:tasks.workunit.client.1.smithi047.stdout:8/714: rename d8/d64/d4e/d4d/d8f/d91/d38/la2 to d8/d77/de3/lf6 0 2024-09-13T22:56:19.964 INFO:tasks.workunit.client.1.smithi047.stdout:1/846: getdents d0/d1d/daa 0 2024-09-13T22:56:19.966 INFO:tasks.workunit.client.1.smithi047.stdout:0/764: mkdir d1/d5/d16/df9 0 2024-09-13T22:56:19.968 INFO:tasks.workunit.client.1.smithi047.stdout:1/847: mkdir d0/d7/db/d79/df7 0 2024-09-13T22:56:19.969 INFO:tasks.workunit.client.1.smithi047.stdout:8/715: dwrite d8/d64/d4e/d4d/dda/fe4 [0,4194304] 0 2024-09-13T22:56:19.971 INFO:tasks.workunit.client.0.smithi002.stdout:4/643: fdatasync d3/d14/d29/d2a/da6/f98 0 2024-09-13T22:56:19.973 INFO:tasks.workunit.client.0.smithi002.stdout:8/701: symlink d3/d21/d57/da1/dbc/ldb 0 2024-09-13T22:56:19.975 INFO:tasks.workunit.client.0.smithi002.stdout:1/750: link d1/d13/d30/d73/da1/d7d/ca9 d1/d13/d30/d73/da1/c102 0 2024-09-13T22:56:19.976 INFO:tasks.workunit.client.0.smithi002.stdout:6/699: sync 2024-09-13T22:56:19.981 INFO:tasks.workunit.client.1.smithi047.stdout:6/760: dread d3/d77/d93/f9a [0,4194304] 0 2024-09-13T22:56:19.983 INFO:tasks.workunit.client.1.smithi047.stdout:0/765: creat d1/d5/d16/d23/ffa x:0 0 0 2024-09-13T22:56:19.985 INFO:tasks.workunit.client.0.smithi002.stdout:4/644: creat d3/d14/d29/d2a/da6/d9f/fcb x:0 0 0 2024-09-13T22:56:19.986 INFO:tasks.workunit.client.1.smithi047.stdout:1/848: dread d0/d1d/f2c [0,4194304] 0 2024-09-13T22:56:19.986 INFO:tasks.workunit.client.0.smithi002.stdout:8/702: symlink d3/dc/d18/d2e/ldc 0 2024-09-13T22:56:19.988 INFO:tasks.workunit.client.1.smithi047.stdout:8/716: dread d8/d64/d4e/f49 [0,4194304] 0 2024-09-13T22:56:19.990 INFO:tasks.workunit.client.0.smithi002.stdout:1/751: creat d1/d13/d1d/d34/d51/dc6/f103 x:0 0 0 2024-09-13T22:56:19.993 INFO:tasks.workunit.client.0.smithi002.stdout:9/762: link d8/d10/d1c/d68/d74/ce1 d8/d91/d96/d87/da5/d94/cf7 0 2024-09-13T22:56:19.994 INFO:tasks.workunit.client.0.smithi002.stdout:9/763: chown d8/d91/d96/fb4 824992 1 2024-09-13T22:56:19.995 INFO:tasks.workunit.client.1.smithi047.stdout:1/849: creat d0/d7/d14/d57/d62/d8a/ff8 x:0 0 0 2024-09-13T22:56:19.996 INFO:tasks.workunit.client.0.smithi002.stdout:2/696: link d1/d32/d37/f45 d1/d32/feb 0 2024-09-13T22:56:19.997 INFO:tasks.workunit.client.0.smithi002.stdout:2/697: write d1/d7/d41/fc2 [818213,102100] 0 2024-09-13T22:56:19.998 INFO:tasks.workunit.client.1.smithi047.stdout:0/766: dread d1/d5/d16/d23/d45/f99 [0,4194304] 0 2024-09-13T22:56:20.001 INFO:tasks.workunit.client.0.smithi002.stdout:4/645: symlink d3/d14/d29/d2a/da6/d9f/lcc 0 2024-09-13T22:56:20.001 INFO:tasks.workunit.client.0.smithi002.stdout:5/690: write d1/d2a/d6b/f72 [1401283,81453] 0 2024-09-13T22:56:20.004 INFO:tasks.workunit.client.1.smithi047.stdout:1/850: rename d0/d7/d10/d55/l65 to d0/d7/d14/d57/d62/lf9 0 2024-09-13T22:56:20.009 INFO:tasks.workunit.client.1.smithi047.stdout:8/717: creat d8/d6b/da9/dc3/ddc/ff7 x:0 0 0 2024-09-13T22:56:20.009 INFO:tasks.workunit.client.1.smithi047.stdout:8/718: stat d8/d64/d4e/d4d/dda/fe4 0 2024-09-13T22:56:20.012 INFO:tasks.workunit.client.0.smithi002.stdout:6/700: mkdir d12/d17/d28/d67/dca/dd8/de1 0 2024-09-13T22:56:20.014 INFO:tasks.workunit.client.1.smithi047.stdout:1/851: write d0/f5 [3354049,23196] 0 2024-09-13T22:56:20.016 INFO:tasks.workunit.client.1.smithi047.stdout:0/767: dread d1/d5/d11/d52/f8e [0,4194304] 0 2024-09-13T22:56:20.017 INFO:tasks.workunit.client.1.smithi047.stdout:8/719: write d8/f1f [2397158,9105] 0 2024-09-13T22:56:20.020 INFO:tasks.workunit.client.0.smithi002.stdout:9/764: creat d8/d10/d1c/dd6/ff8 x:0 0 0 2024-09-13T22:56:20.020 INFO:tasks.workunit.client.0.smithi002.stdout:1/752: dread d1/d13/d21/f8c [0,4194304] 0 2024-09-13T22:56:20.021 INFO:tasks.workunit.client.1.smithi047.stdout:9/709: truncate d1/f8e 1488259 0 2024-09-13T22:56:20.022 INFO:tasks.workunit.client.0.smithi002.stdout:2/698: rmdir d1/d7/d41/d96/dba 39 2024-09-13T22:56:20.023 INFO:tasks.workunit.client.1.smithi047.stdout:1/852: unlink d0/d7/d14/d28/d36/fa8 0 2024-09-13T22:56:20.025 INFO:tasks.workunit.client.0.smithi002.stdout:5/691: creat d1/d2a/d69/db8/ffd x:0 0 0 2024-09-13T22:56:20.025 INFO:tasks.workunit.client.0.smithi002.stdout:1/753: truncate d1/d13/d30/d73/da1/ffc 797056 0 2024-09-13T22:56:20.027 INFO:tasks.workunit.client.0.smithi002.stdout:4/646: fsync d3/d14/d29/d2a/da6/d5e/f79 0 2024-09-13T22:56:20.027 INFO:tasks.workunit.client.0.smithi002.stdout:3/751: dwrite d9/d15/d26/f48 [0,4194304] 0 2024-09-13T22:56:20.027 INFO:tasks.workunit.client.1.smithi047.stdout:4/870: truncate dc/de/d23/dc4/dc8/ffa 4041487 0 2024-09-13T22:56:20.028 INFO:tasks.workunit.client.0.smithi002.stdout:1/754: chown d1/d13/d21/d39 9815 1 2024-09-13T22:56:20.029 INFO:tasks.workunit.client.0.smithi002.stdout:0/701: dwrite d1/d2/fa9 [0,4194304] 0 2024-09-13T22:56:20.030 INFO:tasks.workunit.client.1.smithi047.stdout:8/720: creat d8/d64/d4e/d4d/d8f/d91/d78/ff8 x:0 0 0 2024-09-13T22:56:20.030 INFO:tasks.workunit.client.0.smithi002.stdout:1/755: write d1/d13/d21/d40/f94 [353982,34310] 0 2024-09-13T22:56:20.033 INFO:tasks.workunit.client.0.smithi002.stdout:6/701: rename d12/d17/d2a/l90 to d12/d17/d28/d67/dca/dd8/le2 0 2024-09-13T22:56:20.036 INFO:tasks.workunit.client.1.smithi047.stdout:9/710: symlink d1/dc/d14/dd/d54/d4e/le8 0 2024-09-13T22:56:20.045 INFO:tasks.workunit.client.1.smithi047.stdout:1/853: mknod d0/d1d/daa/df0/df1/cfa 0 2024-09-13T22:56:20.046 INFO:tasks.workunit.client.0.smithi002.stdout:7/658: write d8/d10/d39/f9b [360212,108159] 0 2024-09-13T22:56:20.051 INFO:tasks.workunit.client.1.smithi047.stdout:8/721: dread d8/d64/d4e/d4d/d8f/d91/d38/f45 [0,4194304] 0 2024-09-13T22:56:20.054 INFO:tasks.workunit.client.0.smithi002.stdout:3/752: mkdir d9/d7e/dce/d111 0 2024-09-13T22:56:20.056 INFO:tasks.workunit.client.1.smithi047.stdout:6/761: dwrite d3/d11/d2b/d1c/d4d/fa6 [0,4194304] 0 2024-09-13T22:56:20.058 INFO:tasks.workunit.client.1.smithi047.stdout:6/762: chown d3/d2c/fc9 498980 1 2024-09-13T22:56:20.060 INFO:tasks.workunit.client.0.smithi002.stdout:8/703: write d3/dc/f13 [4690202,1910] 0 2024-09-13T22:56:20.062 INFO:tasks.workunit.client.0.smithi002.stdout:5/692: dread d1/d2a/d6b/d88/d45/f76 [0,4194304] 0 2024-09-13T22:56:20.063 INFO:tasks.workunit.client.0.smithi002.stdout:0/702: mknod d1/d2/d81/cff 0 2024-09-13T22:56:20.064 INFO:tasks.workunit.client.0.smithi002.stdout:0/703: dread - d1/d4/d75/fea zero size 2024-09-13T22:56:20.065 INFO:tasks.workunit.client.1.smithi047.stdout:8/722: dread d8/f9e [0,4194304] 0 2024-09-13T22:56:20.068 INFO:tasks.workunit.client.0.smithi002.stdout:8/704: dwrite d3/d27/da3/fce [0,4194304] 0 2024-09-13T22:56:20.080 INFO:tasks.workunit.client.0.smithi002.stdout:2/699: mknod d1/d7/d35/d3e/d59/cec 0 2024-09-13T22:56:20.082 INFO:tasks.workunit.client.0.smithi002.stdout:7/659: dread d8/d10/d39/d60/db8/d2e/f9d [0,4194304] 0 2024-09-13T22:56:20.085 INFO:tasks.workunit.client.0.smithi002.stdout:3/753: creat d9/d15/d36/d4e/d5e/dae/d89/f112 x:0 0 0 2024-09-13T22:56:20.085 INFO:tasks.workunit.client.0.smithi002.stdout:9/765: write d8/d10/d1c/d3d/f3e [353999,84715] 0 2024-09-13T22:56:20.086 INFO:tasks.workunit.client.1.smithi047.stdout:4/871: getdents dc/de/dfb 0 2024-09-13T22:56:20.086 INFO:tasks.workunit.client.0.smithi002.stdout:3/754: chown d9/d91 0 1 2024-09-13T22:56:20.086 INFO:tasks.workunit.client.1.smithi047.stdout:6/763: dwrite d3/d77/fe3 [0,4194304] 0 2024-09-13T22:56:20.087 INFO:tasks.workunit.client.0.smithi002.stdout:6/702: dread d12/d17/d34/f36 [0,4194304] 0 2024-09-13T22:56:20.088 INFO:tasks.workunit.client.0.smithi002.stdout:3/755: truncate d9/d7e/daf/f103 411341 0 2024-09-13T22:56:20.088 INFO:tasks.workunit.client.1.smithi047.stdout:8/723: symlink d8/d64/d4e/d4d/d8f/d91/d38/dc8/lf9 0 2024-09-13T22:56:20.088 INFO:tasks.workunit.client.0.smithi002.stdout:6/703: write d12/f51 [4611850,21140] 0 2024-09-13T22:56:20.089 INFO:tasks.workunit.client.1.smithi047.stdout:4/872: read dc/fd [906732,121776] 0 2024-09-13T22:56:20.091 INFO:tasks.workunit.client.1.smithi047.stdout:4/873: chown dc/de/d23/dc4/dc8/dc9 403 1 2024-09-13T22:56:20.093 INFO:tasks.workunit.client.0.smithi002.stdout:1/756: mknod d1/d13/d1d/d34/dfe/c104 0 2024-09-13T22:56:20.095 INFO:tasks.workunit.client.1.smithi047.stdout:8/724: mkdir d8/d64/d4e/d70/d98/dfa 0 2024-09-13T22:56:20.095 INFO:tasks.workunit.client.0.smithi002.stdout:1/757: write d1/d13/d1d/d34/feb [41178,26343] 0 2024-09-13T22:56:20.095 INFO:tasks.workunit.client.0.smithi002.stdout:4/647: write d3/d14/d29/d2a/da6/f31 [284562,72500] 0 2024-09-13T22:56:20.097 INFO:tasks.workunit.client.0.smithi002.stdout:4/648: chown d3/d40/f4e 0 1 2024-09-13T22:56:20.097 INFO:tasks.workunit.client.0.smithi002.stdout:0/704: unlink d1/d4/d75/d31/d32/fb6 0 2024-09-13T22:56:20.105 INFO:tasks.workunit.client.0.smithi002.stdout:2/700: mknod d1/d7/d8/d2c/da4/ced 0 2024-09-13T22:56:20.106 INFO:tasks.workunit.client.1.smithi047.stdout:9/711: truncate d1/dc/d14/dd/f1d 4193800 0 2024-09-13T22:56:20.106 INFO:tasks.workunit.client.1.smithi047.stdout:2/768: sync 2024-09-13T22:56:20.109 INFO:tasks.workunit.client.1.smithi047.stdout:1/854: truncate d0/d7/d14/d57/d62/d76/d94/fb5 3782030 0 2024-09-13T22:56:20.109 INFO:tasks.workunit.client.0.smithi002.stdout:6/704: unlink d12/d17/d2a/l93 0 2024-09-13T22:56:20.111 INFO:tasks.workunit.client.1.smithi047.stdout:4/874: read f4 [838344,38656] 0 2024-09-13T22:56:20.113 INFO:tasks.workunit.client.0.smithi002.stdout:1/758: chown d1/d13/d30/d73/da1/d9d 0 1 2024-09-13T22:56:20.113 INFO:tasks.workunit.client.1.smithi047.stdout:2/769: creat d1/d16/f102 x:0 0 0 2024-09-13T22:56:20.114 INFO:tasks.workunit.client.0.smithi002.stdout:4/649: readlink d3/d14/l47 0 2024-09-13T22:56:20.115 INFO:tasks.workunit.client.1.smithi047.stdout:9/712: mkdir d1/d5f/de9 0 2024-09-13T22:56:20.116 INFO:tasks.workunit.client.1.smithi047.stdout:9/713: write d1/dc/d14/fe0 [584957,11904] 0 2024-09-13T22:56:20.116 INFO:tasks.workunit.client.0.smithi002.stdout:8/705: creat d3/dc/d16/d2f/d83/d85/fdd x:0 0 0 2024-09-13T22:56:20.119 INFO:tasks.workunit.client.1.smithi047.stdout:1/855: creat d0/d7/d14/d57/d62/d8a/ffb x:0 0 0 2024-09-13T22:56:20.119 INFO:tasks.workunit.client.1.smithi047.stdout:1/856: chown d0/d7/d13/d8c 12048 1 2024-09-13T22:56:20.121 INFO:tasks.workunit.client.1.smithi047.stdout:4/875: mkdir dc/de/d23/dc4/dc8/d12e 0 2024-09-13T22:56:20.122 INFO:tasks.workunit.client.0.smithi002.stdout:5/693: creat d1/d2a/d6b/d88/d55/ffe x:0 0 0 2024-09-13T22:56:20.123 INFO:tasks.workunit.client.1.smithi047.stdout:9/714: creat d1/dc/d14/dd/d54/d4e/fea x:0 0 0 2024-09-13T22:56:20.125 INFO:tasks.workunit.client.1.smithi047.stdout:8/725: creat d8/d64/ffb x:0 0 0 2024-09-13T22:56:20.128 INFO:tasks.workunit.client.0.smithi002.stdout:4/650: creat d3/d14/d86/db1/fcd x:0 0 0 2024-09-13T22:56:20.129 INFO:tasks.workunit.client.1.smithi047.stdout:4/876: mkdir dc/d29/d8e/dda/d12f 0 2024-09-13T22:56:20.131 INFO:tasks.workunit.client.0.smithi002.stdout:0/705: creat d1/d7e/d9d/de3/f100 x:0 0 0 2024-09-13T22:56:20.136 INFO:tasks.workunit.client.0.smithi002.stdout:0/706: dwrite d1/d4/da3/d7d/df8/f47 [8388608,4194304] 0 2024-09-13T22:56:20.138 INFO:tasks.workunit.client.0.smithi002.stdout:9/766: link d8/d2c/f58 d8/d10/d42/ff9 0 2024-09-13T22:56:20.139 INFO:tasks.workunit.client.0.smithi002.stdout:9/767: chown d8/d10/d1c/d68/d74/ccd 2644060 1 2024-09-13T22:56:20.140 INFO:tasks.workunit.client.0.smithi002.stdout:5/694: creat d1/d57/fff x:0 0 0 2024-09-13T22:56:20.140 INFO:tasks.workunit.client.0.smithi002.stdout:9/768: write d8/d10/d61/f81 [567481,110102] 0 2024-09-13T22:56:20.141 INFO:tasks.workunit.client.1.smithi047.stdout:2/770: link d1/cee d1/d8a/da6/dc3/c103 0 2024-09-13T22:56:20.142 INFO:tasks.workunit.client.0.smithi002.stdout:9/769: write d8/d91/d96/d87/f90 [1077413,43787] 0 2024-09-13T22:56:20.142 INFO:tasks.workunit.client.0.smithi002.stdout:1/759: mkdir d1/d13/d1d/d105 0 2024-09-13T22:56:20.142 INFO:tasks.workunit.client.0.smithi002.stdout:4/651: read - d3/d14/d29/d2a/da6/d69/f91 zero size 2024-09-13T22:56:20.147 INFO:tasks.workunit.client.0.smithi002.stdout:2/701: link d1/d4d/l62 d1/d7/d8/d2c/d9d/dab/db1/lee 0 2024-09-13T22:56:20.148 INFO:tasks.workunit.client.1.smithi047.stdout:2/771: dread - d1/d16/d40/d57/db0/fdd zero size 2024-09-13T22:56:20.148 INFO:tasks.workunit.client.0.smithi002.stdout:7/660: getdents d8/d10/d39/d60/db8/d2e 0 2024-09-13T22:56:20.150 INFO:tasks.workunit.client.0.smithi002.stdout:7/661: dread d8/d10/d39/d60/db8/d2e/f9d [0,4194304] 0 2024-09-13T22:56:20.153 INFO:tasks.workunit.client.1.smithi047.stdout:2/772: unlink d1/df/d1d/d20/d54/f72 0 2024-09-13T22:56:20.154 INFO:tasks.workunit.client.0.smithi002.stdout:1/760: dread d1/d13/d30/d31/d3b/f58 [0,4194304] 0 2024-09-13T22:56:20.154 INFO:tasks.workunit.client.0.smithi002.stdout:2/702: mknod d1/d4d/cef 0 2024-09-13T22:56:20.155 INFO:tasks.workunit.client.1.smithi047.stdout:2/773: mkdir d1/df/d35/dd7/d104 0 2024-09-13T22:56:20.155 INFO:tasks.workunit.client.0.smithi002.stdout:2/703: write d1/d7/d41/d96/fc9 [34624,11308] 0 2024-09-13T22:56:20.158 INFO:tasks.workunit.client.0.smithi002.stdout:1/761: truncate d1/d13/d30/f99 1230215 0 2024-09-13T22:56:20.160 INFO:tasks.workunit.client.0.smithi002.stdout:0/707: rename d1/lfb to d1/d4/l101 0 2024-09-13T22:56:20.161 INFO:tasks.workunit.client.0.smithi002.stdout:0/708: write d1/d2/d81/fdf [818918,56191] 0 2024-09-13T22:56:20.162 INFO:tasks.workunit.client.1.smithi047.stdout:2/774: getdents d1/d8a/da6 0 2024-09-13T22:56:20.163 INFO:tasks.workunit.client.0.smithi002.stdout:4/652: link d3/d14/d29/d2a/da6/d5e/f64 d3/d14/fce 0 2024-09-13T22:56:20.167 INFO:tasks.workunit.client.0.smithi002.stdout:9/770: rename d8/d91/d96 to d8/d91/da3/db9/dfa 0 2024-09-13T22:56:20.169 INFO:tasks.workunit.client.0.smithi002.stdout:7/662: getdents d8/d10 0 2024-09-13T22:56:20.171 INFO:tasks.workunit.client.1.smithi047.stdout:2/775: rename d1/df/d35/f45 to d1/df/d1d/d20/d37/df0/f105 0 2024-09-13T22:56:20.173 INFO:tasks.workunit.client.0.smithi002.stdout:0/709: mkdir d1/d4/d75/d31/de0/d102 0 2024-09-13T22:56:20.178 INFO:tasks.workunit.client.0.smithi002.stdout:9/771: fdatasync f0 0 2024-09-13T22:56:20.180 INFO:tasks.workunit.client.0.smithi002.stdout:1/762: link d1/d13/d1d/d34/d51/f9b d1/d13/d21/d39/d70/de2/f106 0 2024-09-13T22:56:20.182 INFO:tasks.workunit.client.0.smithi002.stdout:7/663: mkdir d8/d10/d39/d60/db8/d26/d4c/d81/db6/dc3 0 2024-09-13T22:56:20.183 INFO:tasks.workunit.client.0.smithi002.stdout:4/653: creat d3/d14/d29/d2a/da6/fcf x:0 0 0 2024-09-13T22:56:20.184 INFO:tasks.workunit.client.0.smithi002.stdout:1/763: mkdir d1/d13/d1d/d34/d107 0 2024-09-13T22:56:20.185 INFO:tasks.workunit.client.0.smithi002.stdout:9/772: dwrite d8/d91/fee [0,4194304] 0 2024-09-13T22:56:20.185 INFO:tasks.workunit.client.0.smithi002.stdout:7/664: write d8/d10/d39/d60/db8/d26/f96 [7048294,88114] 0 2024-09-13T22:56:20.188 INFO:tasks.workunit.client.0.smithi002.stdout:9/773: rmdir d8/d10/d1c 39 2024-09-13T22:56:20.190 INFO:tasks.workunit.client.0.smithi002.stdout:4/654: rename d3/d14/d29/d2a/da6/d5e/c82 to d3/d14/d29/d2a/dbc/cd0 0 2024-09-13T22:56:20.190 INFO:tasks.workunit.client.0.smithi002.stdout:7/665: mknod d8/d10/d39/d60/db8/d2e/d50/d52/cc4 0 2024-09-13T22:56:20.191 INFO:tasks.workunit.client.0.smithi002.stdout:9/774: creat d8/d10/db1/ffb x:0 0 0 2024-09-13T22:56:20.199 INFO:tasks.workunit.client.0.smithi002.stdout:7/666: dwrite d8/d10/d39/d60/db8/f79 [4194304,4194304] 0 2024-09-13T22:56:20.201 INFO:tasks.workunit.client.0.smithi002.stdout:9/775: dwrite d8/d91/da3/db9/dfa/da8/dc3/fd1 [0,4194304] 0 2024-09-13T22:56:20.208 INFO:tasks.workunit.client.0.smithi002.stdout:9/776: creat d8/d10/d1c/d3d/ffc x:0 0 0 2024-09-13T22:56:20.208 INFO:tasks.workunit.client.0.smithi002.stdout:4/655: dread d3/d14/d29/d2a/da6/d69/d7e/fa0 [0,4194304] 0 2024-09-13T22:56:20.211 INFO:tasks.workunit.client.0.smithi002.stdout:5/695: read d1/d2a/d6b/d88/d45/d4f/d78/f79 [506333,96506] 0 2024-09-13T22:56:20.211 INFO:tasks.workunit.client.0.smithi002.stdout:4/656: creat d3/d14/d86/fd1 x:0 0 0 2024-09-13T22:56:20.215 INFO:tasks.workunit.client.0.smithi002.stdout:9/777: link d8/d10/db1/ffb d8/d10/d1c/ffd 0 2024-09-13T22:56:20.217 INFO:tasks.workunit.client.0.smithi002.stdout:4/657: symlink d3/d14/d29/d2a/da6/d9f/ld2 0 2024-09-13T22:56:20.217 INFO:tasks.workunit.client.0.smithi002.stdout:4/658: chown d3/d14/d29/d2a/da6/d5e 28071 1 2024-09-13T22:56:20.219 INFO:tasks.workunit.client.0.smithi002.stdout:5/696: mkdir d1/d2a/d6b/d88/d55/d56/d86/d100 0 2024-09-13T22:56:20.220 INFO:tasks.workunit.client.0.smithi002.stdout:9/778: creat d8/d10/db1/ffe x:0 0 0 2024-09-13T22:56:20.220 INFO:tasks.workunit.client.0.smithi002.stdout:4/659: mknod d3/d14/d29/d2a/d30/cd3 0 2024-09-13T22:56:20.227 INFO:tasks.workunit.client.0.smithi002.stdout:4/660: unlink d3/d62/f74 0 2024-09-13T22:56:20.229 INFO:tasks.workunit.client.0.smithi002.stdout:9/779: mkdir d8/d10/d1c/dbf/df3/dff 0 2024-09-13T22:56:20.230 INFO:tasks.workunit.client.0.smithi002.stdout:9/780: stat d8/d2c/f79 0 2024-09-13T22:56:20.234 INFO:tasks.workunit.client.0.smithi002.stdout:8/706: sync 2024-09-13T22:56:20.236 INFO:tasks.workunit.client.1.smithi047.stdout:6/764: dwrite d3/d77/fe9 [0,4194304] 0 2024-09-13T22:56:20.237 INFO:tasks.workunit.client.0.smithi002.stdout:5/697: dread d1/d10/f50 [4194304,4194304] 0 2024-09-13T22:56:20.238 INFO:tasks.workunit.client.0.smithi002.stdout:9/781: creat d8/d1e/f100 x:0 0 0 2024-09-13T22:56:20.239 INFO:tasks.workunit.client.0.smithi002.stdout:9/782: readlink d8/d10/db1/ldc 0 2024-09-13T22:56:20.241 INFO:tasks.workunit.client.0.smithi002.stdout:4/661: getdents d3 0 2024-09-13T22:56:20.242 INFO:tasks.workunit.client.1.smithi047.stdout:5/652: sync 2024-09-13T22:56:20.243 INFO:tasks.workunit.client.0.smithi002.stdout:3/756: dwrite d9/d3b/d53/fb3 [0,4194304] 0 2024-09-13T22:56:20.244 INFO:tasks.workunit.client.1.smithi047.stdout:6/765: unlink d3/d11/d74/fb3 0 2024-09-13T22:56:20.245 INFO:tasks.workunit.client.0.smithi002.stdout:4/662: chown d3/d14/d29/d2a/da6/d5e/f94 201195 1 2024-09-13T22:56:20.252 INFO:tasks.workunit.client.0.smithi002.stdout:6/705: write d12/d17/d4e/f52 [727033,118327] 0 2024-09-13T22:56:20.253 INFO:tasks.workunit.client.1.smithi047.stdout:6/766: dread - d3/d11/d2b/d1c/dca/fd5 zero size 2024-09-13T22:56:20.257 INFO:tasks.workunit.client.1.smithi047.stdout:1/857: write d0/d7/d14/d57/d72/fb0 [151439,72376] 0 2024-09-13T22:56:20.257 INFO:tasks.workunit.client.1.smithi047.stdout:1/858: stat d0/d7/d14/f2b 0 2024-09-13T22:56:20.259 INFO:tasks.workunit.client.1.smithi047.stdout:6/767: dread - d3/d2c/fb0 zero size 2024-09-13T22:56:20.261 INFO:tasks.workunit.client.0.smithi002.stdout:3/757: read d9/d15/d51/f12 [1470152,25296] 0 2024-09-13T22:56:20.261 INFO:tasks.workunit.client.0.smithi002.stdout:8/707: creat d3/dc/d16/d60/db4/fde x:0 0 0 2024-09-13T22:56:20.262 INFO:tasks.workunit.client.1.smithi047.stdout:5/653: creat d19/d34/d42/d5d/d80/fcd x:0 0 0 2024-09-13T22:56:20.263 INFO:tasks.workunit.client.0.smithi002.stdout:4/663: truncate d3/f9e 3947631 0 2024-09-13T22:56:20.263 INFO:tasks.workunit.client.1.smithi047.stdout:5/654: write d19/d34/d42/d5d/fb4 [1134991,18281] 0 2024-09-13T22:56:20.264 INFO:tasks.workunit.client.1.smithi047.stdout:5/655: dread - d19/d23/d4c/fb3 zero size 2024-09-13T22:56:20.268 INFO:tasks.workunit.client.1.smithi047.stdout:9/715: write d1/f5 [9420990,32483] 0 2024-09-13T22:56:20.268 INFO:tasks.workunit.client.0.smithi002.stdout:5/698: mkdir d1/d57/dd0/df7/d101 0 2024-09-13T22:56:20.269 INFO:tasks.workunit.client.0.smithi002.stdout:5/699: fdatasync d1/d2a/d6b/d88/d55/d56/d81/fa5 0 2024-09-13T22:56:20.269 INFO:tasks.workunit.client.1.smithi047.stdout:8/726: write d8/d64/d4e/d4d/d8f/d91/f3a [4375841,41307] 0 2024-09-13T22:56:20.271 INFO:tasks.workunit.client.0.smithi002.stdout:9/783: link d8/d10/d1c/f19 d8/d91/da3/db9/dfa/da8/f101 0 2024-09-13T22:56:20.275 INFO:tasks.workunit.client.1.smithi047.stdout:4/877: write dc/de/d23/f49 [1458801,81799] 0 2024-09-13T22:56:20.275 INFO:tasks.workunit.client.0.smithi002.stdout:3/758: dread d9/d15/d36/f38 [0,4194304] 0 2024-09-13T22:56:20.275 INFO:tasks.workunit.client.0.smithi002.stdout:3/759: readlink d9/df/lfa 0 2024-09-13T22:56:20.278 INFO:tasks.workunit.client.0.smithi002.stdout:8/708: symlink d3/d21/d57/da1/ldf 0 2024-09-13T22:56:20.287 INFO:tasks.workunit.client.0.smithi002.stdout:5/700: mknod d1/d10/c102 0 2024-09-13T22:56:20.288 INFO:tasks.workunit.client.0.smithi002.stdout:2/704: write d1/d7/d35/d3e/d59/f90 [627844,31506] 0 2024-09-13T22:56:20.289 INFO:tasks.workunit.client.0.smithi002.stdout:9/784: creat d8/d10/d1c/d68/d74/f102 x:0 0 0 2024-09-13T22:56:20.291 INFO:tasks.workunit.client.1.smithi047.stdout:4/878: symlink dc/de/d23/d40/d7b/l130 0 2024-09-13T22:56:20.293 INFO:tasks.workunit.client.1.smithi047.stdout:1/859: link d0/d7/d13/f56 d0/d7/d14/d57/db6/ffc 0 2024-09-13T22:56:20.296 INFO:tasks.workunit.client.0.smithi002.stdout:0/710: write d1/d2/d81/fa6 [769424,83651] 0 2024-09-13T22:56:20.297 INFO:tasks.workunit.client.1.smithi047.stdout:8/727: mkdir d8/d6b/dfc 0 2024-09-13T22:56:20.298 INFO:tasks.workunit.client.0.smithi002.stdout:8/709: symlink d3/d27/le0 0 2024-09-13T22:56:20.299 INFO:tasks.workunit.client.0.smithi002.stdout:8/710: chown d3/dc/d18/f5a 977641 1 2024-09-13T22:56:20.299 INFO:tasks.workunit.client.1.smithi047.stdout:2/776: dwrite d1/df/d1d/d20/d29/dcd/dff/fab [0,4194304] 0 2024-09-13T22:56:20.303 INFO:tasks.workunit.client.0.smithi002.stdout:1/764: write d1/d13/d21/d39/df7/f95 [1674456,59568] 0 2024-09-13T22:56:20.306 INFO:tasks.workunit.client.1.smithi047.stdout:8/728: dwrite d8/f2b [4194304,4194304] 0 2024-09-13T22:56:20.310 INFO:tasks.workunit.client.0.smithi002.stdout:9/785: chown d8/d10/c1f 71 1 2024-09-13T22:56:20.311 INFO:tasks.workunit.client.0.smithi002.stdout:6/706: link d12/d17/d4e/l7c d12/d17/d28/d67/d9f/ddd/le3 0 2024-09-13T22:56:20.313 INFO:tasks.workunit.client.0.smithi002.stdout:7/667: write d8/d10/f1e [35421,101235] 0 2024-09-13T22:56:20.316 INFO:tasks.workunit.client.0.smithi002.stdout:6/707: write d12/d17/d28/d67/d6b/f49 [3282917,111562] 0 2024-09-13T22:56:20.316 INFO:tasks.workunit.client.0.smithi002.stdout:3/760: mknod d9/d3b/c113 0 2024-09-13T22:56:20.316 INFO:tasks.workunit.client.1.smithi047.stdout:8/729: symlink d8/d6b/da9/dc3/ddc/lfd 0 2024-09-13T22:56:20.317 INFO:tasks.workunit.client.0.smithi002.stdout:7/668: dread d8/d10/d39/d60/db8/d2e/d50/f61 [0,4194304] 0 2024-09-13T22:56:20.317 INFO:tasks.workunit.client.0.smithi002.stdout:0/711: fsync d1/d4/d75/d31/fc5 0 2024-09-13T22:56:20.320 INFO:tasks.workunit.client.1.smithi047.stdout:5/656: getdents d19/d34/d8e 0 2024-09-13T22:56:20.322 INFO:tasks.workunit.client.0.smithi002.stdout:8/711: creat d3/dc/d18/d6f/fe1 x:0 0 0 2024-09-13T22:56:20.324 INFO:tasks.workunit.client.1.smithi047.stdout:8/730: dwrite d8/d3f/d8c/da6/fca [0,4194304] 0 2024-09-13T22:56:20.325 INFO:tasks.workunit.client.0.smithi002.stdout:5/701: mknod d1/d57/dd0/df7/d101/c103 0 2024-09-13T22:56:20.325 INFO:tasks.workunit.client.1.smithi047.stdout:8/731: dread - d8/d64/dc5/fe8 zero size 2024-09-13T22:56:20.327 INFO:tasks.workunit.client.0.smithi002.stdout:1/765: chown d1/d13/d1d/d34/fb9 6675386 1 2024-09-13T22:56:20.328 INFO:tasks.workunit.client.0.smithi002.stdout:1/766: chown d1/d13/d30/d31/d86/l87 28499024 1 2024-09-13T22:56:20.331 INFO:tasks.workunit.client.1.smithi047.stdout:5/657: mkdir d19/d23/d2e/d41/d58/dce 0 2024-09-13T22:56:20.332 INFO:tasks.workunit.client.0.smithi002.stdout:2/705: truncate d1/d7/d35/d78/f4b 195 0 2024-09-13T22:56:20.333 INFO:tasks.workunit.client.1.smithi047.stdout:2/777: link d1/d16/d40/cbd d1/df/d1d/d20/d29/dcd/dff/db6/c106 0 2024-09-13T22:56:20.334 INFO:tasks.workunit.client.1.smithi047.stdout:2/778: chown d1/df/d26/d9f/cdb 24 1 2024-09-13T22:56:20.335 INFO:tasks.workunit.client.0.smithi002.stdout:9/786: mkdir d8/d2c/dbc/d103 0 2024-09-13T22:56:20.335 INFO:tasks.workunit.client.0.smithi002.stdout:2/706: dread d1/d7/d8/f10 [0,4194304] 0 2024-09-13T22:56:20.350 INFO:tasks.workunit.client.0.smithi002.stdout:9/787: dread d8/d1e/fca [0,4194304] 0 2024-09-13T22:56:20.355 INFO:tasks.workunit.client.0.smithi002.stdout:8/712: dread d3/d21/d57/f55 [0,4194304] 0 2024-09-13T22:56:20.356 INFO:tasks.workunit.client.1.smithi047.stdout:5/658: mknod d19/ccf 0 2024-09-13T22:56:20.357 INFO:tasks.workunit.client.1.smithi047.stdout:6/768: dwrite d3/d11/d2b/d1c/f27 [0,4194304] 0 2024-09-13T22:56:20.359 INFO:tasks.workunit.client.0.smithi002.stdout:5/702: unlink d1/d2a/d6b/d88/d45/d4f/caf 0 2024-09-13T22:56:20.359 INFO:tasks.workunit.client.1.smithi047.stdout:6/769: chown d3/d11/d2b/d1c/d4d/l4f 2 1 2024-09-13T22:56:20.360 INFO:tasks.workunit.client.1.smithi047.stdout:6/770: chown d3/d11/d2b/d1c/d4d/d69/dc2/ld2 76157025 1 2024-09-13T22:56:20.361 INFO:tasks.workunit.client.0.smithi002.stdout:8/713: dwrite d3/dc/d16/d60/db4/fde [0,4194304] 0 2024-09-13T22:56:20.362 INFO:tasks.workunit.client.0.smithi002.stdout:1/767: mkdir d1/d13/d1d/d34/d51/d108 0 2024-09-13T22:56:20.370 INFO:tasks.workunit.client.1.smithi047.stdout:9/716: dwrite d1/dc/d18/f48 [0,4194304] 0 2024-09-13T22:56:20.371 INFO:tasks.workunit.client.0.smithi002.stdout:4/664: dwrite d3/d14/d29/d2a/f60 [0,4194304] 0 2024-09-13T22:56:20.372 INFO:tasks.workunit.client.1.smithi047.stdout:5/659: mkdir d19/d83/d98/dd0 0 2024-09-13T22:56:20.373 INFO:tasks.workunit.client.1.smithi047.stdout:5/660: stat d19/d34/d42/d5d/d9d/ca5 0 2024-09-13T22:56:20.373 INFO:tasks.workunit.client.0.smithi002.stdout:2/707: symlink d1/d4d/d8b/de1/lf0 0 2024-09-13T22:56:20.374 INFO:tasks.workunit.client.1.smithi047.stdout:5/661: truncate d19/d25/fc3 314454 0 2024-09-13T22:56:20.375 INFO:tasks.workunit.client.1.smithi047.stdout:6/771: mknod d3/d11/d2b/d1c/dbd/de8/cfb 0 2024-09-13T22:56:20.376 INFO:tasks.workunit.client.1.smithi047.stdout:6/772: dread - d3/d2c/fb0 zero size 2024-09-13T22:56:20.379 INFO:tasks.workunit.client.1.smithi047.stdout:6/773: dread d3/d11/d2b/d1c/fa8 [0,4194304] 0 2024-09-13T22:56:20.386 INFO:tasks.workunit.client.0.smithi002.stdout:7/669: symlink d8/d10/d39/lc5 0 2024-09-13T22:56:20.389 INFO:tasks.workunit.client.0.smithi002.stdout:9/788: unlink d8/d10/d1c/d3d/l49 0 2024-09-13T22:56:20.394 INFO:tasks.workunit.client.1.smithi047.stdout:6/774: rmdir d3 39 2024-09-13T22:56:20.398 INFO:tasks.workunit.client.0.smithi002.stdout:5/703: rename d1/d2a/d6b/d88/d55/d56/dc7/fea to d1/d2a/d6b/d88/d55/d56/d86/d100/f104 0 2024-09-13T22:56:20.402 INFO:tasks.workunit.client.0.smithi002.stdout:8/714: unlink d3/dc/da4/fa9 0 2024-09-13T22:56:20.402 INFO:tasks.workunit.client.1.smithi047.stdout:8/732: write d8/d6b/f99 [909054,96367] 0 2024-09-13T22:56:20.405 INFO:tasks.workunit.client.0.smithi002.stdout:1/768: fsync d1/d13/d21/d39/df7/f6d 0 2024-09-13T22:56:20.406 INFO:tasks.workunit.client.0.smithi002.stdout:6/708: write fa [2502081,47612] 0 2024-09-13T22:56:20.407 INFO:tasks.workunit.client.0.smithi002.stdout:6/709: dread - d12/d17/d28/d67/dca/fd9 zero size 2024-09-13T22:56:20.410 INFO:tasks.workunit.client.1.smithi047.stdout:8/733: dwrite d8/d64/d4e/d4d/d8f/d91/d38/f45 [4194304,4194304] 0 2024-09-13T22:56:20.410 INFO:tasks.workunit.client.0.smithi002.stdout:3/761: write d9/d15/d35/f96 [808372,55218] 0 2024-09-13T22:56:20.412 INFO:tasks.workunit.client.1.smithi047.stdout:2/779: write d1/d8a/fd4 [1029194,31437] 0 2024-09-13T22:56:20.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:20 smithi047 ceph-mon[34560]: pgmap v20: 65 pgs: 65 active+clean; 2.8 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 82 MiB/s rd, 194 MiB/s wr, 414 op/s 2024-09-13T22:56:20.419 INFO:tasks.workunit.client.1.smithi047.stdout:1/860: link d0/d7/d14/d57/d62/d76/d94/fb5 d0/d7/d13/d2d/ffd 0 2024-09-13T22:56:20.421 INFO:tasks.workunit.client.0.smithi002.stdout:7/670: fdatasync d8/d10/d39/d60/db8/d26/d38/fac 0 2024-09-13T22:56:20.423 INFO:tasks.workunit.client.0.smithi002.stdout:2/708: dwrite d1/d7/d41/f7a [0,4194304] 0 2024-09-13T22:56:20.427 INFO:tasks.workunit.client.0.smithi002.stdout:0/712: dwrite d1/d4/d75/f2c [4194304,4194304] 0 2024-09-13T22:56:20.434 INFO:tasks.workunit.client.0.smithi002.stdout:8/715: rmdir d3 39 2024-09-13T22:56:20.438 INFO:tasks.workunit.client.1.smithi047.stdout:9/717: write d1/dc/d14/dd/d54/d50/f92 [560629,6810] 0 2024-09-13T22:56:20.442 INFO:tasks.workunit.client.0.smithi002.stdout:6/710: mkdir d12/d17/d34/d39/d8a/de4 0 2024-09-13T22:56:20.445 INFO:tasks.workunit.client.0.smithi002.stdout:3/762: unlink d9/d15/d51/f92 0 2024-09-13T22:56:20.452 INFO:tasks.workunit.client.0.smithi002.stdout:7/671: creat d8/d10/d39/d60/db8/d26/d38/fc6 x:0 0 0 2024-09-13T22:56:20.460 INFO:tasks.workunit.client.0.smithi002.stdout:8/716: fdatasync d3/dc/d16/d2f/d83/d95/fb0 0 2024-09-13T22:56:20.464 INFO:tasks.workunit.client.0.smithi002.stdout:1/769: write d1/d13/d30/d73/da1/f4f [919376,54722] 0 2024-09-13T22:56:20.467 INFO:tasks.workunit.client.0.smithi002.stdout:3/763: mknod d9/df/d71/c114 0 2024-09-13T22:56:20.473 INFO:tasks.workunit.client.0.smithi002.stdout:4/665: rename d3/d14/d85/fa5 to d3/d14/d29/d2a/fd4 0 2024-09-13T22:56:20.478 INFO:tasks.workunit.client.0.smithi002.stdout:2/709: write d1/d7/d8/d2c/f44 [479606,93166] 0 2024-09-13T22:56:20.479 INFO:tasks.workunit.client.0.smithi002.stdout:6/711: symlink d12/d17/d34/d39/d8a/de4/le5 0 2024-09-13T22:56:20.480 INFO:tasks.workunit.client.0.smithi002.stdout:1/770: mknod d1/d13/d1d/d34/d51/dc6/c109 0 2024-09-13T22:56:20.481 INFO:tasks.workunit.client.1.smithi047.stdout:5/662: mkdir d19/d23/d2e/dd1 0 2024-09-13T22:56:20.483 INFO:tasks.workunit.client.0.smithi002.stdout:3/764: symlink d9/d91/l115 0 2024-09-13T22:56:20.484 INFO:tasks.workunit.client.0.smithi002.stdout:9/789: sync 2024-09-13T22:56:20.489 INFO:tasks.workunit.client.0.smithi002.stdout:6/712: dread d12/f5d [0,4194304] 0 2024-09-13T22:56:20.489 INFO:tasks.workunit.client.1.smithi047.stdout:7/738: sync 2024-09-13T22:56:20.490 INFO:tasks.workunit.client.0.smithi002.stdout:5/704: rename d1/d10/fae to d1/d2a/d6b/d88/d55/d56/d81/f105 0 2024-09-13T22:56:20.491 INFO:tasks.workunit.client.1.smithi047.stdout:8/734: dread d8/d64/d4e/d4d/d8f/d91/d40/f5c [0,4194304] 0 2024-09-13T22:56:20.496 INFO:tasks.workunit.client.0.smithi002.stdout:8/717: symlink d3/dc/d16/d2f/d83/le2 0 2024-09-13T22:56:20.498 INFO:tasks.workunit.client.1.smithi047.stdout:9/718: mknod d1/dc/d14/dd/d54/d4e/ceb 0 2024-09-13T22:56:20.499 INFO:tasks.workunit.client.0.smithi002.stdout:7/672: dwrite d8/fb [0,4194304] 0 2024-09-13T22:56:20.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:20 smithi002 ceph-mon[27637]: pgmap v20: 65 pgs: 65 active+clean; 2.8 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 82 MiB/s rd, 194 MiB/s wr, 414 op/s 2024-09-13T22:56:20.503 INFO:tasks.workunit.client.1.smithi047.stdout:6/775: symlink d3/d11/d2b/d1c/dbf/lfc 0 2024-09-13T22:56:20.505 INFO:tasks.workunit.client.0.smithi002.stdout:1/771: mknod d1/d13/d30/d73/da1/d9d/dbd/c10a 0 2024-09-13T22:56:20.511 INFO:tasks.workunit.client.0.smithi002.stdout:9/790: mkdir d8/d91/da3/db9/dfa/d87/da5/d94/d104 0 2024-09-13T22:56:20.513 INFO:tasks.workunit.client.0.smithi002.stdout:6/713: fdatasync d12/d17/d28/f66 0 2024-09-13T22:56:20.514 INFO:tasks.workunit.client.1.smithi047.stdout:5/663: dread d19/d25/d45/f4e [0,4194304] 0 2024-09-13T22:56:20.515 INFO:tasks.workunit.client.1.smithi047.stdout:5/664: write d19/f4f [4521693,40247] 0 2024-09-13T22:56:20.517 INFO:tasks.workunit.client.0.smithi002.stdout:0/713: rename d1/d4/d75/dca/fde to d1/d4/d75/d31/d32/dbb/de1/f103 0 2024-09-13T22:56:20.519 INFO:tasks.workunit.client.0.smithi002.stdout:5/705: mknod d1/d57/c106 0 2024-09-13T22:56:20.522 INFO:tasks.workunit.client.0.smithi002.stdout:0/714: dwrite d1/d7e/ffc [0,4194304] 0 2024-09-13T22:56:20.524 INFO:tasks.workunit.client.1.smithi047.stdout:2/780: write d1/d16/d40/d57/fbe [3896770,31358] 0 2024-09-13T22:56:20.525 INFO:tasks.workunit.client.1.smithi047.stdout:2/781: stat d1/df/d35/d8b/fda 0 2024-09-13T22:56:20.527 INFO:tasks.workunit.client.0.smithi002.stdout:8/718: mkdir d3/dc/d16/d2f/d83/d85/dc8/de3 0 2024-09-13T22:56:20.528 INFO:tasks.workunit.client.0.smithi002.stdout:2/710: write d1/d32/d37/d79/f7c [359004,22899] 0 2024-09-13T22:56:20.529 INFO:tasks.workunit.client.0.smithi002.stdout:2/711: stat d1/d7/d35/fde 0 2024-09-13T22:56:20.529 INFO:tasks.workunit.client.0.smithi002.stdout:7/673: mknod d8/d10/d39/d60/db8/d2e/d50/d52/d72/cc7 0 2024-09-13T22:56:20.532 INFO:tasks.workunit.client.0.smithi002.stdout:1/772: chown d1/d13/d30/d73/ld1 4236 1 2024-09-13T22:56:20.533 INFO:tasks.workunit.client.0.smithi002.stdout:3/765: creat d9/d7e/dce/d111/f116 x:0 0 0 2024-09-13T22:56:20.534 INFO:tasks.workunit.client.1.smithi047.stdout:6/776: symlink d3/d11/d2b/d4c/de2/lfd 0 2024-09-13T22:56:20.535 INFO:tasks.workunit.client.0.smithi002.stdout:9/791: mknod d8/d2c/dbc/dc8/dd0/c105 0 2024-09-13T22:56:20.538 INFO:tasks.workunit.client.1.smithi047.stdout:7/739: rename d0/d7/da/lf to d0/d57/d5b/d8b/lf0 0 2024-09-13T22:56:20.541 INFO:tasks.workunit.client.0.smithi002.stdout:7/674: dread d8/d10/d39/d60/db8/d26/d4c/d81/f1a [8388608,4194304] 0 2024-09-13T22:56:20.542 INFO:tasks.workunit.client.1.smithi047.stdout:8/735: rmdir d8/d77/d89/de7 0 2024-09-13T22:56:20.545 INFO:tasks.workunit.client.0.smithi002.stdout:6/714: rename d12/d17/d34/d4b/f68 to d12/d17/d34/d39/d8a/fe6 0 2024-09-13T22:56:20.547 INFO:tasks.workunit.client.1.smithi047.stdout:1/861: getdents d0/d7/d14 0 2024-09-13T22:56:20.549 INFO:tasks.workunit.client.1.smithi047.stdout:5/665: symlink d19/d34/ld2 0 2024-09-13T22:56:20.550 INFO:tasks.workunit.client.0.smithi002.stdout:4/666: link d3/d14/d29/d2a/da6/d69/f91 d3/db3/db9/fd5 0 2024-09-13T22:56:20.551 INFO:tasks.workunit.client.0.smithi002.stdout:4/667: dread - d3/d14/d86/db1/fcd zero size 2024-09-13T22:56:20.554 INFO:tasks.workunit.client.1.smithi047.stdout:3/795: sync 2024-09-13T22:56:20.555 INFO:tasks.workunit.client.0.smithi002.stdout:7/675: dread d8/d10/d39/d60/db8/d2e/d3c/f48 [0,4194304] 0 2024-09-13T22:56:20.558 INFO:tasks.workunit.client.0.smithi002.stdout:1/773: chown d1/d13/d21/d39/df7/cff 1 1 2024-09-13T22:56:20.559 INFO:tasks.workunit.client.1.smithi047.stdout:2/782: write d1/d16/f6a [287910,114526] 0 2024-09-13T22:56:20.561 INFO:tasks.workunit.client.1.smithi047.stdout:3/796: dread d0/d3/d4/d16/d2c/de/dcc/dd1/dc4/fd7 [0,4194304] 0 2024-09-13T22:56:20.562 INFO:tasks.workunit.client.1.smithi047.stdout:1/862: creat d0/d7/d10/d55/ffe x:0 0 0 2024-09-13T22:56:20.566 INFO:tasks.workunit.client.1.smithi047.stdout:6/777: dread d3/d11/d2b/d1c/d23/fba [0,4194304] 0 2024-09-13T22:56:20.567 INFO:tasks.workunit.client.1.smithi047.stdout:9/719: getdents d1/dc/d14/dd/d54/d4e/d51 0 2024-09-13T22:56:20.569 INFO:tasks.workunit.client.0.smithi002.stdout:5/706: rename d1/d2a/d6b/d88/d45/d4f/d8f/lb3 to d1/d2a/d6b/d88/d55/d56/d81/l107 0 2024-09-13T22:56:20.570 INFO:tasks.workunit.client.0.smithi002.stdout:3/766: dread d9/d7e/dce/fdc [0,4194304] 0 2024-09-13T22:56:20.571 INFO:tasks.workunit.client.0.smithi002.stdout:3/767: dread - d9/d3b/fe9 zero size 2024-09-13T22:56:20.571 INFO:tasks.workunit.client.1.smithi047.stdout:8/736: mkdir d8/d64/d4e/d4d/d8f/d91/d40/de5/dfe 0 2024-09-13T22:56:20.572 INFO:tasks.workunit.client.1.smithi047.stdout:5/666: write d19/d23/d4c/f7b [560746,94719] 0 2024-09-13T22:56:20.573 INFO:tasks.workunit.client.1.smithi047.stdout:5/667: stat d19/d23/d2e/d41/l4a 0 2024-09-13T22:56:20.576 INFO:tasks.workunit.client.0.smithi002.stdout:8/719: mknod d3/dc/d16/d2f/d83/d85/dc8/de3/ce4 0 2024-09-13T22:56:20.576 INFO:tasks.workunit.client.1.smithi047.stdout:3/797: symlink d0/d3/d5e/lf8 0 2024-09-13T22:56:20.576 INFO:tasks.workunit.client.0.smithi002.stdout:8/720: chown d3/d27/c7d 11 1 2024-09-13T22:56:20.578 INFO:tasks.workunit.client.1.smithi047.stdout:1/863: symlink d0/d7/d14/d57/d62/d76/d94/lff 0 2024-09-13T22:56:20.579 INFO:tasks.workunit.client.0.smithi002.stdout:8/721: truncate d3/dc/d51/fb2 846082 0 2024-09-13T22:56:20.579 INFO:tasks.workunit.client.0.smithi002.stdout:7/676: mknod d8/d10/d39/d60/db8/d26/d4c/d81/d51/cc8 0 2024-09-13T22:56:20.580 INFO:tasks.workunit.client.0.smithi002.stdout:2/712: mkdir d1/d7/d41/d96/dba/df1 0 2024-09-13T22:56:20.581 INFO:tasks.workunit.client.0.smithi002.stdout:0/715: truncate d1/d4/f21 2155461 0 2024-09-13T22:56:20.582 INFO:tasks.workunit.client.1.smithi047.stdout:6/778: creat d3/d11/d2b/d1c/dca/ffe x:0 0 0 2024-09-13T22:56:20.582 INFO:tasks.workunit.client.1.smithi047.stdout:9/720: rmdir d1/dc/d14/dd/d54/d50/d5b/d9e 39 2024-09-13T22:56:20.583 INFO:tasks.workunit.client.1.smithi047.stdout:7/740: link d0/d7/le6 d0/d7/da/d2e/db5/lf1 0 2024-09-13T22:56:20.585 INFO:tasks.workunit.client.1.smithi047.stdout:8/737: creat d8/d6b/da9/dc3/fff x:0 0 0 2024-09-13T22:56:20.586 INFO:tasks.workunit.client.0.smithi002.stdout:4/668: symlink d3/d14/d29/ld6 0 2024-09-13T22:56:20.587 INFO:tasks.workunit.client.1.smithi047.stdout:2/783: mkdir d1/d107 0 2024-09-13T22:56:20.588 INFO:tasks.workunit.client.0.smithi002.stdout:3/768: rmdir d9/d15/d36 39 2024-09-13T22:56:20.590 INFO:tasks.workunit.client.1.smithi047.stdout:1/864: dread - d0/d7/d14/d57/d62/d76/d94/fae zero size 2024-09-13T22:56:20.591 INFO:tasks.workunit.client.0.smithi002.stdout:0/716: readlink d1/d4/da3/l77 0 2024-09-13T22:56:20.594 INFO:tasks.workunit.client.1.smithi047.stdout:9/721: mkdir d1/d5f/d6a/dec 0 2024-09-13T22:56:20.599 INFO:tasks.workunit.client.1.smithi047.stdout:7/741: mkdir d0/d19/df2 0 2024-09-13T22:56:20.599 INFO:tasks.workunit.client.0.smithi002.stdout:5/707: mkdir d1/d108 0 2024-09-13T22:56:20.600 INFO:tasks.workunit.client.1.smithi047.stdout:5/668: getdents d19/d25/d85/dc5 0 2024-09-13T22:56:20.601 INFO:tasks.workunit.client.0.smithi002.stdout:5/708: truncate d1/d57/ffc 321358 0 2024-09-13T22:56:20.601 INFO:tasks.workunit.client.0.smithi002.stdout:4/669: mknod d3/d14/d29/d2a/da6/d69/cd7 0 2024-09-13T22:56:20.603 INFO:tasks.workunit.client.1.smithi047.stdout:8/738: unlink d8/d64/d4e/d70/d98/la5 0 2024-09-13T22:56:20.607 INFO:tasks.workunit.client.1.smithi047.stdout:2/784: rmdir d1/df/d1d/da9 39 2024-09-13T22:56:20.609 INFO:tasks.workunit.client.0.smithi002.stdout:2/713: creat d1/da9/dbd/ff2 x:0 0 0 2024-09-13T22:56:20.612 INFO:tasks.workunit.client.1.smithi047.stdout:7/742: dread d0/db/fda [0,4194304] 0 2024-09-13T22:56:20.613 INFO:tasks.workunit.client.1.smithi047.stdout:3/798: dwrite d0/d3/d4/d16/d1c/f92 [0,4194304] 0 2024-09-13T22:56:20.614 INFO:tasks.workunit.client.1.smithi047.stdout:3/799: dread - d0/d3/d5e/ff4 zero size 2024-09-13T22:56:20.615 INFO:tasks.workunit.client.0.smithi002.stdout:1/774: creat d1/d13/d30/d31/d86/f10b x:0 0 0 2024-09-13T22:56:20.620 INFO:tasks.workunit.client.0.smithi002.stdout:9/792: getdents d8/d91/da3/db9/dfa/d87/da5/d94 0 2024-09-13T22:56:20.622 INFO:tasks.workunit.client.0.smithi002.stdout:5/709: mknod d1/d57/dd0/df7/d101/c109 0 2024-09-13T22:56:20.624 INFO:tasks.workunit.client.0.smithi002.stdout:5/710: chown d1/d2a/f53 14423 1 2024-09-13T22:56:20.625 INFO:tasks.workunit.client.0.smithi002.stdout:4/670: rename d3/d40/d45/fa9 to d3/d14/d29/d2a/da6/d69/fd8 0 2024-09-13T22:56:20.626 INFO:tasks.workunit.client.1.smithi047.stdout:5/669: mknod d19/d23/d2e/d41/d58/cd3 0 2024-09-13T22:56:20.628 INFO:tasks.workunit.client.1.smithi047.stdout:8/739: creat d8/d64/d4e/d4d/d8f/d91/d38/dc8/f100 x:0 0 0 2024-09-13T22:56:20.630 INFO:tasks.workunit.client.0.smithi002.stdout:9/793: dwrite d8/d10/db1/ffe [0,4194304] 0 2024-09-13T22:56:20.630 INFO:tasks.workunit.client.1.smithi047.stdout:0/768: sync 2024-09-13T22:56:20.630 INFO:tasks.workunit.client.1.smithi047.stdout:4/879: sync 2024-09-13T22:56:20.631 INFO:tasks.workunit.client.0.smithi002.stdout:2/714: rmdir d1/d7/d35/d3e/d59/d6b/d75 39 2024-09-13T22:56:20.631 INFO:tasks.workunit.client.0.smithi002.stdout:3/769: dwrite d9/d15/d51/f37 [0,4194304] 0 2024-09-13T22:56:20.631 INFO:tasks.workunit.client.0.smithi002.stdout:5/711: chown d1/d2a/d6b/d88/d45/d4f/da7/ff3 5677581 1 2024-09-13T22:56:20.632 INFO:tasks.workunit.client.1.smithi047.stdout:2/785: rmdir d1/df/d1d/d20/d29/dcd/dff 39 2024-09-13T22:56:20.633 INFO:tasks.workunit.client.1.smithi047.stdout:6/779: dwrite d3/d77/fa9 [0,4194304] 0 2024-09-13T22:56:20.635 INFO:tasks.workunit.client.0.smithi002.stdout:0/717: dwrite d1/d4/d75/d31/f46 [0,4194304] 0 2024-09-13T22:56:20.645 INFO:tasks.workunit.client.1.smithi047.stdout:9/722: symlink d1/dd2/led 0 2024-09-13T22:56:20.650 INFO:tasks.workunit.client.0.smithi002.stdout:1/775: rename d1/d13/d30/d31 to d1/d13/d21/d39/d70/d10c 0 2024-09-13T22:56:20.651 INFO:tasks.workunit.client.0.smithi002.stdout:3/770: dread d9/d3b/d53/d83/fbe [0,4194304] 0 2024-09-13T22:56:20.652 INFO:tasks.workunit.client.1.smithi047.stdout:1/865: write d0/d7/d13/d2d/fde [359986,35638] 0 2024-09-13T22:56:20.652 INFO:tasks.workunit.client.0.smithi002.stdout:4/671: truncate d3/f1e 7668172 0 2024-09-13T22:56:20.652 INFO:tasks.workunit.client.0.smithi002.stdout:6/715: sync 2024-09-13T22:56:20.653 INFO:tasks.workunit.client.1.smithi047.stdout:5/670: rename l6 to d19/d83/ld4 0 2024-09-13T22:56:20.658 INFO:tasks.workunit.client.1.smithi047.stdout:4/880: mknod dc/de/db9/c131 0 2024-09-13T22:56:20.660 INFO:tasks.workunit.client.0.smithi002.stdout:2/715: creat d1/d7/d8/d2c/ff3 x:0 0 0 2024-09-13T22:56:20.665 INFO:tasks.workunit.client.1.smithi047.stdout:7/743: mkdir d0/d57/d5b/d5c/db6/df3 0 2024-09-13T22:56:20.667 INFO:tasks.workunit.client.0.smithi002.stdout:2/716: dwrite d1/d7/d35/d3e/d59/d6b/fe2 [0,4194304] 0 2024-09-13T22:56:20.668 INFO:tasks.workunit.client.1.smithi047.stdout:3/800: getdents d0/d3/d4/d16/de2 0 2024-09-13T22:56:20.669 INFO:tasks.workunit.client.0.smithi002.stdout:1/776: mknod d1/d13/d30/d73/da1/d9d/dbd/dd8/c10d 0 2024-09-13T22:56:20.669 INFO:tasks.workunit.client.0.smithi002.stdout:0/718: dwrite d1/d2/d6c/fd8 [0,4194304] 0 2024-09-13T22:56:20.669 INFO:tasks.workunit.client.1.smithi047.stdout:3/801: write d0/d3/d4/d16/d73/d86/ff3 [728346,60335] 0 2024-09-13T22:56:20.671 INFO:tasks.workunit.client.1.smithi047.stdout:9/723: creat d1/d5f/d6a/fee x:0 0 0 2024-09-13T22:56:20.674 INFO:tasks.workunit.client.0.smithi002.stdout:6/716: read d12/d17/f1e [30509,72275] 0 2024-09-13T22:56:20.675 INFO:tasks.workunit.client.1.smithi047.stdout:0/769: rename d1/d5/d16/d23/d45/f99 to d1/d5/d16/d23/dd8/ffb 0 2024-09-13T22:56:20.676 INFO:tasks.workunit.client.0.smithi002.stdout:9/794: mkdir d8/d2c/dbc/d103/d106 0 2024-09-13T22:56:20.678 INFO:tasks.workunit.client.1.smithi047.stdout:5/671: creat d19/d83/fd5 x:0 0 0 2024-09-13T22:56:20.679 INFO:tasks.workunit.client.1.smithi047.stdout:8/740: mknod d8/d6b/c101 0 2024-09-13T22:56:20.680 INFO:tasks.workunit.client.0.smithi002.stdout:5/712: mkdir d1/d2a/d6b/d88/d45/d4f/d8f/dd5/d10a 0 2024-09-13T22:56:20.681 INFO:tasks.workunit.client.0.smithi002.stdout:6/717: dwrite d12/d17/d34/d39/d8b/fa3 [0,4194304] 0 2024-09-13T22:56:20.682 INFO:tasks.workunit.client.1.smithi047.stdout:4/881: dread - dc/de/d23/d40/d7b/dab/feb zero size 2024-09-13T22:56:20.685 INFO:tasks.workunit.client.0.smithi002.stdout:2/717: rename d1/d7/d35/d3e/d59/d6b to d1/d7/d35/d3e/d59/d6b/d75/df4 22 2024-09-13T22:56:20.689 INFO:tasks.workunit.client.1.smithi047.stdout:7/744: mkdir d0/d7/da/d1e/de7/df4 0 2024-09-13T22:56:20.690 INFO:tasks.workunit.client.0.smithi002.stdout:8/722: sync 2024-09-13T22:56:20.690 INFO:tasks.workunit.client.1.smithi047.stdout:3/802: dread d0/d3/d4/d16/d32/d42/fd6 [0,4194304] 0 2024-09-13T22:56:20.691 INFO:tasks.workunit.client.0.smithi002.stdout:0/719: symlink d1/d4/d75/dca/l104 0 2024-09-13T22:56:20.693 INFO:tasks.workunit.client.1.smithi047.stdout:9/724: mkdir d1/dc/d14/dd/d54/d50/d91/da3/def 0 2024-09-13T22:56:20.695 INFO:tasks.workunit.client.0.smithi002.stdout:4/672: mknod d3/d14/d29/d2a/cd9 0 2024-09-13T22:56:20.698 INFO:tasks.workunit.client.1.smithi047.stdout:5/672: dread d19/d25/fc9 [0,4194304] 0 2024-09-13T22:56:20.699 INFO:tasks.workunit.client.1.smithi047.stdout:0/770: chown d1/d5/d16/d6a/cf2 3268 1 2024-09-13T22:56:20.701 INFO:tasks.workunit.client.0.smithi002.stdout:6/718: unlink d12/c3a 0 2024-09-13T22:56:20.701 INFO:tasks.workunit.client.0.smithi002.stdout:6/719: readlink l11 0 2024-09-13T22:56:20.701 INFO:tasks.workunit.client.0.smithi002.stdout:6/720: chown d12/d17/d2a 6828209 1 2024-09-13T22:56:20.702 INFO:tasks.workunit.client.0.smithi002.stdout:6/721: readlink d12/d17/d34/d4b/la8 0 2024-09-13T22:56:20.704 INFO:tasks.workunit.client.1.smithi047.stdout:8/741: truncate d8/f1e 988617 0 2024-09-13T22:56:20.706 INFO:tasks.workunit.client.0.smithi002.stdout:2/718: rename d1/d4a/fa8 to d1/d7/d8/d2c/ff5 0 2024-09-13T22:56:20.706 INFO:tasks.workunit.client.1.smithi047.stdout:8/742: dread d8/d64/d4e/d4d/d8f/d91/d78/fcc [0,4194304] 0 2024-09-13T22:56:20.706 INFO:tasks.workunit.client.1.smithi047.stdout:2/786: truncate d1/d16/f23 1170705 0 2024-09-13T22:56:20.708 INFO:tasks.workunit.client.0.smithi002.stdout:3/771: link d9/d7e/dce/fdc d9/d7e/daf/f117 0 2024-09-13T22:56:20.708 INFO:tasks.workunit.client.1.smithi047.stdout:2/787: write d1/df/d1d/d20/d2b/ff7 [340116,87043] 0 2024-09-13T22:56:20.711 INFO:tasks.workunit.client.0.smithi002.stdout:1/777: mknod d1/d13/d21/c10e 0 2024-09-13T22:56:20.711 INFO:tasks.workunit.client.0.smithi002.stdout:2/719: dwrite d1/d7/d35/d3e/d59/fcb [0,4194304] 0 2024-09-13T22:56:20.713 INFO:tasks.workunit.client.0.smithi002.stdout:1/778: truncate d1/d13/d30/fe7 249703 0 2024-09-13T22:56:20.714 INFO:tasks.workunit.client.0.smithi002.stdout:2/720: write d1/d7/d41/fe7 [668391,38324] 0 2024-09-13T22:56:20.714 INFO:tasks.workunit.client.1.smithi047.stdout:3/803: mkdir d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d85/df9 0 2024-09-13T22:56:20.725 INFO:tasks.workunit.client.1.smithi047.stdout:5/673: read - d19/d34/d8e/f8f zero size 2024-09-13T22:56:20.726 INFO:tasks.workunit.client.0.smithi002.stdout:6/722: truncate d12/d17/d28/d67/d6b/fb3 25881 0 2024-09-13T22:56:20.731 INFO:tasks.workunit.client.1.smithi047.stdout:0/771: rename d1/d5/d16/d23 to d1/d5/d16/d97/dfc 0 2024-09-13T22:56:20.731 INFO:tasks.workunit.client.1.smithi047.stdout:0/772: readlink d1/ddb/le2 0 2024-09-13T22:56:20.736 INFO:tasks.workunit.client.1.smithi047.stdout:7/745: symlink d0/lf5 0 2024-09-13T22:56:20.737 INFO:tasks.workunit.client.0.smithi002.stdout:2/721: dread d1/d7/d8/d2c/f44 [0,4194304] 0 2024-09-13T22:56:20.740 INFO:tasks.workunit.client.0.smithi002.stdout:5/713: write d1/d2a/d6b/d88/d55/f84 [901287,50811] 0 2024-09-13T22:56:20.740 INFO:tasks.workunit.client.1.smithi047.stdout:9/725: dwrite d1/dc/d14/dd/d54/d50/d91/da3/f7e [4194304,4194304] 0 2024-09-13T22:56:20.741 INFO:tasks.workunit.client.0.smithi002.stdout:8/723: creat d3/dc/d18/d56/dd0/fe5 x:0 0 0 2024-09-13T22:56:20.741 INFO:tasks.workunit.client.0.smithi002.stdout:5/714: write d1/d57/fff [765354,104664] 0 2024-09-13T22:56:20.742 INFO:tasks.workunit.client.0.smithi002.stdout:6/723: dread d12/f51 [0,4194304] 0 2024-09-13T22:56:20.746 INFO:tasks.workunit.client.1.smithi047.stdout:1/866: getdents d0/d7/d75 0 2024-09-13T22:56:20.747 INFO:tasks.workunit.client.0.smithi002.stdout:1/779: mkdir d1/d13/d30/d73/da1/d7d/d10f 0 2024-09-13T22:56:20.748 INFO:tasks.workunit.client.1.smithi047.stdout:3/804: fdatasync d0/d3/d4/d16/d2c/f24 0 2024-09-13T22:56:20.754 INFO:tasks.workunit.client.1.smithi047.stdout:2/788: write d1/df/d35/d8b/fbf [361798,69960] 0 2024-09-13T22:56:20.755 INFO:tasks.workunit.client.1.smithi047.stdout:3/805: dread d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/f60 [0,4194304] 0 2024-09-13T22:56:20.757 INFO:tasks.workunit.client.0.smithi002.stdout:2/722: rmdir d1/d7/d8/d2c 39 2024-09-13T22:56:20.760 INFO:tasks.workunit.client.1.smithi047.stdout:7/746: symlink d0/d57/d5b/d5c/lf6 0 2024-09-13T22:56:20.761 INFO:tasks.workunit.client.0.smithi002.stdout:8/724: creat d3/dc/d8b/fe6 x:0 0 0 2024-09-13T22:56:20.762 INFO:tasks.workunit.client.0.smithi002.stdout:3/772: dwrite d9/d15/d51/fcc [0,4194304] 0 2024-09-13T22:56:20.764 INFO:tasks.workunit.client.0.smithi002.stdout:3/773: chown d9/d15/f42 0 1 2024-09-13T22:56:20.766 INFO:tasks.workunit.client.0.smithi002.stdout:1/780: write d1/d13/d1d/d34/fa0 [532808,88878] 0 2024-09-13T22:56:20.766 INFO:tasks.workunit.client.0.smithi002.stdout:2/723: dwrite d1/d7/d41/fc2 [0,4194304] 0 2024-09-13T22:56:20.775 INFO:tasks.workunit.client.0.smithi002.stdout:7/677: sync 2024-09-13T22:56:20.776 INFO:tasks.workunit.client.1.smithi047.stdout:3/806: mknod d0/d3/d4/d91/cfa 0 2024-09-13T22:56:20.782 INFO:tasks.workunit.client.1.smithi047.stdout:9/726: dread d1/dc/d14/f17 [4194304,4194304] 0 2024-09-13T22:56:20.783 INFO:tasks.workunit.client.1.smithi047.stdout:5/674: write d19/d34/d42/f48 [2278691,119275] 0 2024-09-13T22:56:20.793 INFO:tasks.workunit.client.0.smithi002.stdout:9/795: sync 2024-09-13T22:56:20.793 INFO:tasks.workunit.client.0.smithi002.stdout:9/796: chown d8/d2c/c5f 6455555 1 2024-09-13T22:56:20.816 INFO:tasks.workunit.client.0.smithi002.stdout:8/725: unlink d3/d27/c37 0 2024-09-13T22:56:20.819 INFO:tasks.workunit.client.0.smithi002.stdout:6/724: mknod d12/d17/ce7 0 2024-09-13T22:56:20.819 INFO:tasks.workunit.client.0.smithi002.stdout:3/774: unlink d9/d15/d35/lad 0 2024-09-13T22:56:20.820 INFO:tasks.workunit.client.0.smithi002.stdout:0/720: link d1/d2/d6c/f84 d1/d4/d75/d31/d32/f105 0 2024-09-13T22:56:20.825 INFO:tasks.workunit.client.0.smithi002.stdout:8/726: symlink d3/dc/d16/d60/db4/le7 0 2024-09-13T22:56:20.826 INFO:tasks.workunit.client.0.smithi002.stdout:3/775: dread - d9/fb8 zero size 2024-09-13T22:56:20.826 INFO:tasks.workunit.client.0.smithi002.stdout:0/721: dwrite d1/d7e/d9d/de3/f100 [0,4194304] 0 2024-09-13T22:56:20.826 INFO:tasks.workunit.client.0.smithi002.stdout:1/781: truncate d1/d13/d1d/d34/f6f 106980 0 2024-09-13T22:56:20.829 INFO:tasks.workunit.client.0.smithi002.stdout:0/722: read - d1/d4/d75/d31/d32/dbb/fe2 zero size 2024-09-13T22:56:20.829 INFO:tasks.workunit.client.0.smithi002.stdout:7/678: getdents d8/d10/d39/d60/db8/d2e/d50/d52/dab 0 2024-09-13T22:56:20.830 INFO:tasks.workunit.client.0.smithi002.stdout:9/797: mkdir d8/d10/d1c/dbf/df3/dff/d107 0 2024-09-13T22:56:20.830 INFO:tasks.workunit.client.0.smithi002.stdout:1/782: write d1/d13/d21/d39/d70/d10c/d3b/fda [724388,10183] 0 2024-09-13T22:56:20.833 INFO:tasks.workunit.client.0.smithi002.stdout:3/776: symlink d9/d15/d46/l118 0 2024-09-13T22:56:20.835 INFO:tasks.workunit.client.0.smithi002.stdout:4/673: getdents d3 0 2024-09-13T22:56:20.835 INFO:tasks.workunit.client.0.smithi002.stdout:6/725: dread d12/f74 [0,4194304] 0 2024-09-13T22:56:20.838 INFO:tasks.workunit.client.0.smithi002.stdout:9/798: creat d8/d10/dc4/f108 x:0 0 0 2024-09-13T22:56:20.838 INFO:tasks.workunit.client.0.smithi002.stdout:8/727: dwrite d3/dc/d16/d2f/d83/d95/fc2 [0,4194304] 0 2024-09-13T22:56:20.841 INFO:tasks.workunit.client.0.smithi002.stdout:1/783: mkdir d1/d13/d21/d40/dc4/dc8/ddf/d110 0 2024-09-13T22:56:20.841 INFO:tasks.workunit.client.0.smithi002.stdout:7/679: mknod d8/d10/d39/d60/db8/d2e/d50/d52/cc9 0 2024-09-13T22:56:20.843 INFO:tasks.workunit.client.0.smithi002.stdout:4/674: dread d3/d14/d29/d2a/f60 [0,4194304] 0 2024-09-13T22:56:20.845 INFO:tasks.workunit.client.0.smithi002.stdout:4/675: write d3/d14/d29/d2a/da6/f31 [183927,42772] 0 2024-09-13T22:56:20.846 INFO:tasks.workunit.client.0.smithi002.stdout:6/726: creat d12/d17/d34/d39/d8b/fe8 x:0 0 0 2024-09-13T22:56:20.849 INFO:tasks.workunit.client.0.smithi002.stdout:9/799: rename d8/lc6 to d8/d10/d1c/dbf/df3/l109 0 2024-09-13T22:56:20.853 INFO:tasks.workunit.client.0.smithi002.stdout:9/800: chown d8/d91/cbd 25847 1 2024-09-13T22:56:20.854 INFO:tasks.workunit.client.0.smithi002.stdout:7/680: dread d8/d10/d11/f9f [0,4194304] 0 2024-09-13T22:56:20.855 INFO:tasks.workunit.client.0.smithi002.stdout:2/724: dread d1/d7/d8/d2c/da4/f85 [0,4194304] 0 2024-09-13T22:56:20.855 INFO:tasks.workunit.client.0.smithi002.stdout:5/715: dwrite d1/d2a/d5a/f8c [4194304,4194304] 0 2024-09-13T22:56:20.857 INFO:tasks.workunit.client.0.smithi002.stdout:4/676: chown d3/d14/fad 4576508 1 2024-09-13T22:56:20.858 INFO:tasks.workunit.client.0.smithi002.stdout:0/723: write d1/d4/d75/d31/d32/dbb/fc9 [596426,84414] 0 2024-09-13T22:56:20.859 INFO:tasks.workunit.client.0.smithi002.stdout:8/728: dwrite d3/dc/d18/d2e/f6b [0,4194304] 0 2024-09-13T22:56:20.861 INFO:tasks.workunit.client.0.smithi002.stdout:5/716: write d1/d2a/d6b/d88/f4d [1972695,59602] 0 2024-09-13T22:56:20.868 INFO:tasks.workunit.client.0.smithi002.stdout:9/801: mkdir d8/d10/d1c/dd6/d10a 0 2024-09-13T22:56:20.869 INFO:tasks.workunit.client.0.smithi002.stdout:7/681: truncate d8/f5d 3427026 0 2024-09-13T22:56:20.870 INFO:tasks.workunit.client.0.smithi002.stdout:6/727: dread d12/d17/f33 [0,4194304] 0 2024-09-13T22:56:20.871 INFO:tasks.workunit.client.0.smithi002.stdout:2/725: mknod d1/d7/d52/cf6 0 2024-09-13T22:56:20.873 INFO:tasks.workunit.client.0.smithi002.stdout:1/784: link d1/d13/d21/d39/df7/f6d d1/d13/d30/d73/da1/d9d/dbd/f111 0 2024-09-13T22:56:20.873 INFO:tasks.workunit.client.0.smithi002.stdout:4/677: dwrite d3/d14/d29/d2a/da6/d5e/f65 [0,4194304] 0 2024-09-13T22:56:20.876 INFO:tasks.workunit.client.0.smithi002.stdout:2/726: write d1/d7/d35/d3e/d59/f70 [4382182,30809] 0 2024-09-13T22:56:20.877 INFO:tasks.workunit.client.0.smithi002.stdout:3/777: getdents d9/d15/d36/d4e/d5e/dae/d89 0 2024-09-13T22:56:20.878 INFO:tasks.workunit.client.0.smithi002.stdout:4/678: write d3/d14/f16 [7208539,29097] 0 2024-09-13T22:56:20.883 INFO:tasks.workunit.client.0.smithi002.stdout:7/682: mknod d8/d10/d39/d60/db8/d26/d95/cca 0 2024-09-13T22:56:20.883 INFO:tasks.workunit.client.0.smithi002.stdout:2/727: read d1/d7/f26 [68405,130689] 0 2024-09-13T22:56:20.886 INFO:tasks.workunit.client.0.smithi002.stdout:1/785: dwrite d1/d13/d30/d73/da1/f4f [0,4194304] 0 2024-09-13T22:56:20.888 INFO:tasks.workunit.client.0.smithi002.stdout:1/786: stat d1/d13/d1d/d34/fa0 0 2024-09-13T22:56:20.888 INFO:tasks.workunit.client.0.smithi002.stdout:8/729: getdents d3/dc/d16/d2f/d83/d95/dbb 0 2024-09-13T22:56:20.890 INFO:tasks.workunit.client.0.smithi002.stdout:0/724: dwrite d1/d2/f56 [0,4194304] 0 2024-09-13T22:56:20.892 INFO:tasks.workunit.client.0.smithi002.stdout:8/730: write d3/dc/d8b/fe6 [169545,51479] 0 2024-09-13T22:56:20.896 INFO:tasks.workunit.client.1.smithi047.stdout:0/773: creat d1/ffd x:0 0 0 2024-09-13T22:56:20.896 INFO:tasks.workunit.client.1.smithi047.stdout:7/747: write d0/d57/d5b/d8b/fbd [777451,66209] 0 2024-09-13T22:56:20.897 INFO:tasks.workunit.client.0.smithi002.stdout:6/728: dwrite d12/fa5 [0,4194304] 0 2024-09-13T22:56:20.897 INFO:tasks.workunit.client.0.smithi002.stdout:3/778: rmdir d9/d15 39 2024-09-13T22:56:20.897 INFO:tasks.workunit.client.1.smithi047.stdout:2/789: dwrite d1/df/fc9 [0,4194304] 0 2024-09-13T22:56:20.898 INFO:tasks.workunit.client.0.smithi002.stdout:4/679: creat d3/fda x:0 0 0 2024-09-13T22:56:20.898 INFO:tasks.workunit.client.1.smithi047.stdout:1/867: truncate d0/d7/f80 2180975 0 2024-09-13T22:56:20.898 INFO:tasks.workunit.client.0.smithi002.stdout:5/717: truncate d1/d2a/d5a/f8c 414861 0 2024-09-13T22:56:20.900 INFO:tasks.workunit.client.1.smithi047.stdout:8/743: getdents d8/d64/d4e/d4d/d8f/d91/d38/d7a 0 2024-09-13T22:56:20.900 INFO:tasks.workunit.client.1.smithi047.stdout:9/727: unlink d1/dc/d14/dd/d54/d4e/f7b 0 2024-09-13T22:56:20.903 INFO:tasks.workunit.client.0.smithi002.stdout:9/802: getdents d8/d10/d1c/dbf 0 2024-09-13T22:56:20.903 INFO:tasks.workunit.client.0.smithi002.stdout:2/728: dread d1/d7/d8/d2c/f44 [0,4194304] 0 2024-09-13T22:56:20.903 INFO:tasks.workunit.client.0.smithi002.stdout:1/787: write d1/d13/d21/faa [8440192,106870] 0 2024-09-13T22:56:20.903 INFO:tasks.workunit.client.1.smithi047.stdout:3/807: write d0/d3/d4/d91/d8d/fb6 [1189198,117383] 0 2024-09-13T22:56:20.904 INFO:tasks.workunit.client.0.smithi002.stdout:9/803: fdatasync d8/d10/d42/fd5 0 2024-09-13T22:56:20.907 INFO:tasks.workunit.client.1.smithi047.stdout:3/808: fsync d0/d3/d4/d16/d32/d42/d79/d9c/dad/fcf 0 2024-09-13T22:56:20.907 INFO:tasks.workunit.client.1.smithi047.stdout:2/790: dread d1/de/fe4 [0,4194304] 0 2024-09-13T22:56:20.909 INFO:tasks.workunit.client.0.smithi002.stdout:8/731: creat d3/d21/d57/da1/fe8 x:0 0 0 2024-09-13T22:56:20.909 INFO:tasks.workunit.client.1.smithi047.stdout:9/728: creat d1/dc/d14/dd/d4c/ff0 x:0 0 0 2024-09-13T22:56:20.910 INFO:tasks.workunit.client.0.smithi002.stdout:6/729: truncate d12/fb5 4353749 0 2024-09-13T22:56:20.911 INFO:tasks.workunit.client.0.smithi002.stdout:7/683: mknod d8/d10/d39/d60/db8/d2e/d50/d52/dab/ccb 0 2024-09-13T22:56:20.912 INFO:tasks.workunit.client.0.smithi002.stdout:6/730: write d12/d17/d34/d39/d8a/fa7 [1940977,8666] 0 2024-09-13T22:56:20.913 INFO:tasks.workunit.client.0.smithi002.stdout:6/731: dread - d12/d17/d28/d67/d6b/fd7 zero size 2024-09-13T22:56:20.914 INFO:tasks.workunit.client.0.smithi002.stdout:3/779: truncate d9/d3b/f64 1565137 0 2024-09-13T22:56:20.914 INFO:tasks.workunit.client.1.smithi047.stdout:3/809: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/fef [1132971,54947] 0 2024-09-13T22:56:20.915 INFO:tasks.workunit.client.0.smithi002.stdout:6/732: fdatasync d12/f14 0 2024-09-13T22:56:20.916 INFO:tasks.workunit.client.0.smithi002.stdout:4/680: unlink d3/d14/d29/d2a/da6/d69/c7b 0 2024-09-13T22:56:20.917 INFO:tasks.workunit.client.1.smithi047.stdout:3/810: write d0/d3/d5e/ff4 [6900,40106] 0 2024-09-13T22:56:20.924 INFO:tasks.workunit.client.1.smithi047.stdout:0/774: dread d1/d7/f6c [0,4194304] 0 2024-09-13T22:56:20.924 INFO:tasks.workunit.client.1.smithi047.stdout:8/744: creat d8/d6b/dfc/f102 x:0 0 0 2024-09-13T22:56:20.925 INFO:tasks.workunit.client.1.smithi047.stdout:5/675: dread d19/f36 [0,4194304] 0 2024-09-13T22:56:20.926 INFO:tasks.workunit.client.0.smithi002.stdout:1/788: fsync d1/d13/d21/d39/d70/d10c/d3d/f6a 0 2024-09-13T22:56:20.926 INFO:tasks.workunit.client.1.smithi047.stdout:2/791: truncate d1/df/d1d/d20/d29/f2d 5943376 0 2024-09-13T22:56:20.930 INFO:tasks.workunit.client.0.smithi002.stdout:8/732: readlink d3/dc/d18/l1b 0 2024-09-13T22:56:20.931 INFO:tasks.workunit.client.1.smithi047.stdout:7/748: rmdir d0/d7/da/d1e/d93/db7/ddc 0 2024-09-13T22:56:20.931 INFO:tasks.workunit.client.0.smithi002.stdout:2/729: dread d1/d7/d8/f1b [0,4194304] 0 2024-09-13T22:56:20.933 INFO:tasks.workunit.client.0.smithi002.stdout:4/681: dread d3/f5d [0,4194304] 0 2024-09-13T22:56:20.935 INFO:tasks.workunit.client.1.smithi047.stdout:3/811: creat d0/d3/d4/d16/d2c/de/d1f/d3b/ffb x:0 0 0 2024-09-13T22:56:20.938 INFO:tasks.workunit.client.0.smithi002.stdout:3/780: stat d9/d15/d36/d4e/d5e/dc0 0 2024-09-13T22:56:20.938 INFO:tasks.workunit.client.1.smithi047.stdout:5/676: dread - d19/d23/d4c/faf zero size 2024-09-13T22:56:20.939 INFO:tasks.workunit.client.0.smithi002.stdout:3/781: read d9/d15/d51/f2e [478629,30325] 0 2024-09-13T22:56:20.940 INFO:tasks.workunit.client.0.smithi002.stdout:3/782: chown d9/d15/d26 246163 1 2024-09-13T22:56:20.942 INFO:tasks.workunit.client.1.smithi047.stdout:0/775: creat d1/d5/d16/d97/de4/ffe x:0 0 0 2024-09-13T22:56:20.943 INFO:tasks.workunit.client.0.smithi002.stdout:5/718: mknod d1/d2a/d6b/d88/d45/d4f/d78/c10b 0 2024-09-13T22:56:20.944 INFO:tasks.workunit.client.0.smithi002.stdout:5/719: fdatasync d1/d2a/d6b/d88/d45/d4f/db7/fcb 0 2024-09-13T22:56:20.947 INFO:tasks.workunit.client.0.smithi002.stdout:5/720: truncate d1/d2a/d6b/d88/d45/d4f/da7/daa/fe5 697476 0 2024-09-13T22:56:20.948 INFO:tasks.workunit.client.0.smithi002.stdout:5/721: stat d1/d57/cde 0 2024-09-13T22:56:20.948 INFO:tasks.workunit.client.1.smithi047.stdout:9/729: link d1/f5 d1/dc/d14/dd/d54/d50/d91/ff1 0 2024-09-13T22:56:20.949 INFO:tasks.workunit.client.0.smithi002.stdout:9/804: symlink d8/d10/d1c/dd6/dda/l10b 0 2024-09-13T22:56:20.949 INFO:tasks.workunit.client.1.smithi047.stdout:9/730: write d1/dc/d14/f13 [3073412,53962] 0 2024-09-13T22:56:20.952 INFO:tasks.workunit.client.1.smithi047.stdout:9/731: dread - d1/dc/d14/dd/d54/d8d/fd9 zero size 2024-09-13T22:56:20.955 INFO:tasks.workunit.client.0.smithi002.stdout:0/725: creat d1/d4/da3/f106 x:0 0 0 2024-09-13T22:56:20.956 INFO:tasks.workunit.client.1.smithi047.stdout:1/868: link d0/d7/d14/d28/cc6 d0/d7/d14/d57/d62/d8a/c100 0 2024-09-13T22:56:20.957 INFO:tasks.workunit.client.1.smithi047.stdout:1/869: write d0/d7/d14/d57/d72/fb0 [1343417,109727] 0 2024-09-13T22:56:20.957 INFO:tasks.workunit.client.0.smithi002.stdout:2/730: mkdir d1/d7/d8/d4f/df7 0 2024-09-13T22:56:20.957 INFO:tasks.workunit.client.0.smithi002.stdout:7/684: dwrite d8/d10/f32 [0,4194304] 0 2024-09-13T22:56:20.958 INFO:tasks.workunit.client.0.smithi002.stdout:2/731: fdatasync d1/d7/d8/d2c/f39 0 2024-09-13T22:56:20.962 INFO:tasks.workunit.client.1.smithi047.stdout:1/870: dread d0/d7/d14/d28/fed [0,4194304] 0 2024-09-13T22:56:20.963 INFO:tasks.workunit.client.1.smithi047.stdout:8/745: unlink d8/d64/d4e/d70/f93 0 2024-09-13T22:56:20.964 INFO:tasks.workunit.client.1.smithi047.stdout:6/780: sync 2024-09-13T22:56:20.964 INFO:tasks.workunit.client.1.smithi047.stdout:4/882: sync 2024-09-13T22:56:20.967 INFO:tasks.workunit.client.1.smithi047.stdout:0/776: unlink d1/fef 0 2024-09-13T22:56:20.970 INFO:tasks.workunit.client.1.smithi047.stdout:2/792: dwrite d1/df/d1d/d20/d2b/f75 [0,4194304] 0 2024-09-13T22:56:20.975 INFO:tasks.workunit.client.0.smithi002.stdout:3/783: unlink d9/d15/d51/deb/fff 0 2024-09-13T22:56:20.977 INFO:tasks.workunit.client.1.smithi047.stdout:3/812: symlink d0/d3/d4/d16/de2/lfc 0 2024-09-13T22:56:20.979 INFO:tasks.workunit.client.1.smithi047.stdout:7/749: dwrite d0/fb2 [0,4194304] 0 2024-09-13T22:56:20.981 INFO:tasks.workunit.client.1.smithi047.stdout:9/732: rename d1/dc/d18 to d1/dc/d14/dd/d4c/df2 0 2024-09-13T22:56:20.987 INFO:tasks.workunit.client.1.smithi047.stdout:5/677: creat d19/d23/d2e/d41/d58/dbf/fd6 x:0 0 0 2024-09-13T22:56:20.989 INFO:tasks.workunit.client.0.smithi002.stdout:9/805: mkdir d8/d2c/dbc/d10c 0 2024-09-13T22:56:20.990 INFO:tasks.workunit.client.0.smithi002.stdout:1/789: fdatasync d1/d13/d21/d39/d70/d10c/d3d/f8b 0 2024-09-13T22:56:20.992 INFO:tasks.workunit.client.1.smithi047.stdout:8/746: symlink d8/d64/dc5/l103 0 2024-09-13T22:56:20.994 INFO:tasks.workunit.client.1.smithi047.stdout:6/781: symlink d3/d11/d2b/d76/lff 0 2024-09-13T22:56:20.995 INFO:tasks.workunit.client.1.smithi047.stdout:6/782: read d3/d77/d93/f9a [1668702,124138] 0 2024-09-13T22:56:20.996 INFO:tasks.workunit.client.1.smithi047.stdout:4/883: fdatasync dc/de/d23/dc4/fbb 0 2024-09-13T22:56:20.997 INFO:tasks.workunit.client.1.smithi047.stdout:8/747: dread d8/f2b [4194304,4194304] 0 2024-09-13T22:56:20.997 INFO:tasks.workunit.client.1.smithi047.stdout:6/783: readlink d3/d11/d2b/d4c/d9d/dac/lf4 0 2024-09-13T22:56:20.999 INFO:tasks.workunit.client.1.smithi047.stdout:6/784: chown d3/f2f 488 1 2024-09-13T22:56:21.001 INFO:tasks.workunit.client.1.smithi047.stdout:0/777: rmdir d1/d5/d16/d97/dfc/d45 39 2024-09-13T22:56:21.002 INFO:tasks.workunit.client.1.smithi047.stdout:0/778: write d1/d5/d16/d47/f4d [7315657,112821] 0 2024-09-13T22:56:21.006 INFO:tasks.workunit.client.0.smithi002.stdout:3/784: unlink d9/df/f6d 0 2024-09-13T22:56:21.009 INFO:tasks.workunit.client.1.smithi047.stdout:7/750: creat d0/d57/d5b/d8b/d95/ff7 x:0 0 0 2024-09-13T22:56:21.013 INFO:tasks.workunit.client.0.smithi002.stdout:9/806: creat d8/d10/d42/ddd/f10d x:0 0 0 2024-09-13T22:56:21.014 INFO:tasks.workunit.client.0.smithi002.stdout:9/807: dread - d8/d10/dc4/f108 zero size 2024-09-13T22:56:21.014 INFO:tasks.workunit.client.1.smithi047.stdout:1/871: rename d0/d7/d10 to d0/d7/db/d101 0 2024-09-13T22:56:21.015 INFO:tasks.workunit.client.1.smithi047.stdout:2/793: write d1/df/d26/d4b/f50 [2409355,118501] 0 2024-09-13T22:56:21.016 INFO:tasks.workunit.client.0.smithi002.stdout:7/685: dwrite d8/d10/d39/d60/db8/d2e/d3c/f59 [0,4194304] 0 2024-09-13T22:56:21.017 INFO:tasks.workunit.client.1.smithi047.stdout:2/794: chown d1/df/dc8 174 1 2024-09-13T22:56:21.018 INFO:tasks.workunit.client.1.smithi047.stdout:5/678: read d19/d34/d42/f88 [3761139,76475] 0 2024-09-13T22:56:21.022 INFO:tasks.workunit.client.1.smithi047.stdout:1/872: dwrite d0/d7/d14/d28/d36/f32 [0,4194304] 0 2024-09-13T22:56:21.022 INFO:tasks.workunit.client.0.smithi002.stdout:1/790: rename d1/d13/d21/d39/d70/d10c/d86 to d1/d13/d21/d39/d70/d10c/d3b/d71/d80/d112 0 2024-09-13T22:56:21.025 INFO:tasks.workunit.client.0.smithi002.stdout:8/733: sync 2024-09-13T22:56:21.027 INFO:tasks.workunit.client.0.smithi002.stdout:4/682: creat d3/d40/fdb x:0 0 0 2024-09-13T22:56:21.030 INFO:tasks.workunit.client.0.smithi002.stdout:5/722: dwrite d1/d2a/d6b/d88/d45/f97 [0,4194304] 0 2024-09-13T22:56:21.030 INFO:tasks.workunit.client.0.smithi002.stdout:2/732: mkdir d1/d7/d35/d3e/df8 0 2024-09-13T22:56:21.035 INFO:tasks.workunit.client.1.smithi047.stdout:6/785: unlink d3/d11/d2b/d1c/dbf/lb7 0 2024-09-13T22:56:21.036 INFO:tasks.workunit.client.0.smithi002.stdout:4/683: dread d3/d40/d45/f52 [0,4194304] 0 2024-09-13T22:56:21.037 INFO:tasks.workunit.client.0.smithi002.stdout:3/785: fdatasync d9/d15/d51/f2e 0 2024-09-13T22:56:21.040 INFO:tasks.workunit.client.0.smithi002.stdout:6/733: getdents d12/d17/d34/d39 0 2024-09-13T22:56:21.041 INFO:tasks.workunit.client.0.smithi002.stdout:6/734: truncate d12/d17/fbe 671325 0 2024-09-13T22:56:21.043 INFO:tasks.workunit.client.1.smithi047.stdout:6/786: dread d3/d11/d2b/d4c/f80 [0,4194304] 0 2024-09-13T22:56:21.045 INFO:tasks.workunit.client.1.smithi047.stdout:1/873: dread d0/d7/d14/d28/d36/f4c [0,4194304] 0 2024-09-13T22:56:21.046 INFO:tasks.workunit.client.1.smithi047.stdout:6/787: fsync d3/d11/d2b/d1c/d23/feb 0 2024-09-13T22:56:21.048 INFO:tasks.workunit.client.1.smithi047.stdout:6/788: write d3/d11/d2b/d4c/d30/f5d [2457318,120146] 0 2024-09-13T22:56:21.049 INFO:tasks.workunit.client.0.smithi002.stdout:7/686: read d8/f27 [211202,94850] 0 2024-09-13T22:56:21.051 INFO:tasks.workunit.client.0.smithi002.stdout:8/734: rmdir d3/dc/d16/d89 39 2024-09-13T22:56:21.053 INFO:tasks.workunit.client.1.smithi047.stdout:4/884: dread dc/de/d17/f74 [0,4194304] 0 2024-09-13T22:56:21.056 INFO:tasks.workunit.client.1.smithi047.stdout:3/813: truncate d0/f98 2315012 0 2024-09-13T22:56:21.057 INFO:tasks.workunit.client.0.smithi002.stdout:8/735: dwrite d3/d21/d57/da1/fe8 [0,4194304] 0 2024-09-13T22:56:21.057 INFO:tasks.workunit.client.0.smithi002.stdout:8/736: stat d3/cc5 0 2024-09-13T22:56:21.058 INFO:tasks.workunit.client.0.smithi002.stdout:8/737: write d3/d21/d57/fc4 [539034,60204] 0 2024-09-13T22:56:21.059 INFO:tasks.workunit.client.1.smithi047.stdout:3/814: write d0/d3/d4/d91/d8d/fb6 [767631,78063] 0 2024-09-13T22:56:21.063 INFO:tasks.workunit.client.1.smithi047.stdout:3/815: chown d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/f30 7820 1 2024-09-13T22:56:21.064 INFO:tasks.workunit.client.1.smithi047.stdout:0/779: dread - d1/d5/d16/d97/dfc/d45/d7f/fce zero size 2024-09-13T22:56:21.064 INFO:tasks.workunit.client.0.smithi002.stdout:8/738: dread d3/d27/f8a [0,4194304] 0 2024-09-13T22:56:21.065 INFO:tasks.workunit.client.0.smithi002.stdout:6/735: chown d12/d17/f4a 192 1 2024-09-13T22:56:21.067 INFO:tasks.workunit.client.1.smithi047.stdout:5/679: dread d19/f43 [0,4194304] 0 2024-09-13T22:56:21.067 INFO:tasks.workunit.client.1.smithi047.stdout:1/874: creat d0/d7/d14/f102 x:0 0 0 2024-09-13T22:56:21.068 INFO:tasks.workunit.client.1.smithi047.stdout:9/733: mkdir d1/dc/d14/df3 0 2024-09-13T22:56:21.069 INFO:tasks.workunit.client.1.smithi047.stdout:1/875: dread - d0/d7/db/d101/d55/ffe zero size 2024-09-13T22:56:21.069 INFO:tasks.workunit.client.1.smithi047.stdout:9/734: chown d1/dc/d14/dd/ccd 187068 1 2024-09-13T22:56:21.070 INFO:tasks.workunit.client.1.smithi047.stdout:9/735: chown d1/f40 15577374 1 2024-09-13T22:56:21.070 INFO:tasks.workunit.client.0.smithi002.stdout:8/739: dwrite d3/f24 [0,4194304] 0 2024-09-13T22:56:21.072 INFO:tasks.workunit.client.0.smithi002.stdout:2/733: symlink d1/d32/lf9 0 2024-09-13T22:56:21.073 INFO:tasks.workunit.client.1.smithi047.stdout:2/795: mknod d1/df/d1d/d20/d29/dcd/dff/db6/c108 0 2024-09-13T22:56:21.074 INFO:tasks.workunit.client.0.smithi002.stdout:5/723: dread d1/d2a/d6b/d88/d45/d4f/d78/d8b/f9b [0,4194304] 0 2024-09-13T22:56:21.079 INFO:tasks.workunit.client.0.smithi002.stdout:2/734: dwrite d1/d7/d41/fe7 [0,4194304] 0 2024-09-13T22:56:21.081 INFO:tasks.workunit.client.1.smithi047.stdout:4/885: truncate dc/de/d23/d40/d7b/dab/dae/fd5 922635 0 2024-09-13T22:56:21.086 INFO:tasks.workunit.client.1.smithi047.stdout:2/796: dwrite d1/df/d1d/d20/d29/ff4 [0,4194304] 0 2024-09-13T22:56:21.087 INFO:tasks.workunit.client.1.smithi047.stdout:2/797: chown d1/df/d26 15 1 2024-09-13T22:56:21.088 INFO:tasks.workunit.client.1.smithi047.stdout:6/789: dread d3/d11/d2b/d1c/d4d/f84 [0,4194304] 0 2024-09-13T22:56:21.090 INFO:tasks.workunit.client.1.smithi047.stdout:6/790: chown d3/d11/d2b/d4c/d30/fa7 0 1 2024-09-13T22:56:21.092 INFO:tasks.workunit.client.0.smithi002.stdout:9/808: creat d8/d1e/f10e x:0 0 0 2024-09-13T22:56:21.094 INFO:tasks.workunit.client.0.smithi002.stdout:0/726: link d1/c25 d1/c107 0 2024-09-13T22:56:21.096 INFO:tasks.workunit.client.1.smithi047.stdout:0/780: creat d1/d5/d16/d97/dfc/d45/fff x:0 0 0 2024-09-13T22:56:21.097 INFO:tasks.workunit.client.1.smithi047.stdout:0/781: chown d1/ddb/le2 113439284 1 2024-09-13T22:56:21.098 INFO:tasks.workunit.client.0.smithi002.stdout:8/740: fdatasync d3/dc/d18/f5a 0 2024-09-13T22:56:21.099 INFO:tasks.workunit.client.0.smithi002.stdout:8/741: fsync d3/dc/d16/d2f/d83/d85/f98 0 2024-09-13T22:56:21.105 INFO:tasks.workunit.client.0.smithi002.stdout:8/742: dwrite d3/dc/d16/d2f/db7/fd1 [0,4194304] 0 2024-09-13T22:56:21.106 INFO:tasks.workunit.client.0.smithi002.stdout:4/684: creat d3/d14/d29/fdc x:0 0 0 2024-09-13T22:56:21.107 INFO:tasks.workunit.client.1.smithi047.stdout:4/886: rename f6 to dc/d29/d4d/f132 0 2024-09-13T22:56:21.108 INFO:tasks.workunit.client.0.smithi002.stdout:4/685: read f2 [1835139,105069] 0 2024-09-13T22:56:21.109 INFO:tasks.workunit.client.0.smithi002.stdout:2/735: symlink d1/da9/dbd/lfa 0 2024-09-13T22:56:21.110 INFO:tasks.workunit.client.0.smithi002.stdout:3/786: link d9/d15/d26/d93/l79 d9/d3b/d53/d83/d100/l119 0 2024-09-13T22:56:21.111 INFO:tasks.workunit.client.1.smithi047.stdout:8/748: getdents d8/d6b 0 2024-09-13T22:56:21.114 INFO:tasks.workunit.client.0.smithi002.stdout:3/787: dread d9/d3b/d53/d83/fbe [0,4194304] 0 2024-09-13T22:56:21.115 INFO:tasks.workunit.client.1.smithi047.stdout:3/816: dwrite d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/f60 [0,4194304] 0 2024-09-13T22:56:21.118 INFO:tasks.workunit.client.0.smithi002.stdout:8/743: dread d3/d21/f44 [4194304,4194304] 0 2024-09-13T22:56:21.121 INFO:tasks.workunit.client.1.smithi047.stdout:5/680: getdents d19/d23/d2e/d41/d58/dce 0 2024-09-13T22:56:21.121 INFO:tasks.workunit.client.1.smithi047.stdout:0/782: creat d1/d5/d16/d47/f100 x:0 0 0 2024-09-13T22:56:21.121 INFO:tasks.workunit.client.1.smithi047.stdout:5/681: dread - d19/d23/fc7 zero size 2024-09-13T22:56:21.122 INFO:tasks.workunit.client.1.smithi047.stdout:0/783: write d1/f37 [2052823,20737] 0 2024-09-13T22:56:21.127 INFO:tasks.workunit.client.1.smithi047.stdout:9/736: mkdir d1/dc/d14/dd/d54/d50/d60/db0/db2/df4 0 2024-09-13T22:56:21.128 INFO:tasks.workunit.client.0.smithi002.stdout:2/736: truncate d1/d32/d37/f73 358524 0 2024-09-13T22:56:21.131 INFO:tasks.workunit.client.0.smithi002.stdout:6/736: rename d12/d17/d28/d7d/fa2 to d12/d17/d34/fe9 0 2024-09-13T22:56:21.132 INFO:tasks.workunit.client.0.smithi002.stdout:6/737: write d12/fa5 [2834660,116506] 0 2024-09-13T22:56:21.132 INFO:tasks.workunit.client.1.smithi047.stdout:4/887: fdatasync dc/de/d23/f95 0 2024-09-13T22:56:21.133 INFO:tasks.workunit.client.0.smithi002.stdout:9/809: mknod d8/d10/c10f 0 2024-09-13T22:56:21.134 INFO:tasks.workunit.client.1.smithi047.stdout:2/798: creat d1/d107/f109 x:0 0 0 2024-09-13T22:56:21.135 INFO:tasks.workunit.client.0.smithi002.stdout:3/788: rmdir d9/d3b 39 2024-09-13T22:56:21.135 INFO:tasks.workunit.client.0.smithi002.stdout:4/686: write d3/d14/d29/d2a/f36 [180514,127715] 0 2024-09-13T22:56:21.136 INFO:tasks.workunit.client.1.smithi047.stdout:6/791: creat d3/d11/d2b/d76/daf/f100 x:0 0 0 2024-09-13T22:56:21.142 INFO:tasks.workunit.client.0.smithi002.stdout:8/744: write d3/dc/d16/d4b/fb3 [356722,20962] 0 2024-09-13T22:56:21.143 INFO:tasks.workunit.client.1.smithi047.stdout:6/792: dwrite d3/d77/fa9 [0,4194304] 0 2024-09-13T22:56:21.144 INFO:tasks.workunit.client.1.smithi047.stdout:3/817: creat d0/d3/d4/d16/d2c/de/d1f/d2e/ffd x:0 0 0 2024-09-13T22:56:21.146 INFO:tasks.workunit.client.0.smithi002.stdout:5/724: creat d1/d2a/d6b/d88/d55/d56/f10c x:0 0 0 2024-09-13T22:56:21.148 INFO:tasks.workunit.client.1.smithi047.stdout:5/682: mknod d19/d34/d42/d5d/d80/cd7 0 2024-09-13T22:56:21.150 INFO:tasks.workunit.client.1.smithi047.stdout:5/683: read d19/d83/fcb [159555,50568] 0 2024-09-13T22:56:21.152 INFO:tasks.workunit.client.1.smithi047.stdout:8/749: write d8/d64/d4e/d4d/d8f/d91/d78/fa1 [786310,19150] 0 2024-09-13T22:56:21.152 INFO:tasks.workunit.client.0.smithi002.stdout:2/737: mkdir d1/d7/d8/d2c/d9d/dfb 0 2024-09-13T22:56:21.155 INFO:tasks.workunit.client.1.smithi047.stdout:8/750: truncate d8/d64/d4e/d4d/fe6 5097971 0 2024-09-13T22:56:21.158 INFO:tasks.workunit.client.0.smithi002.stdout:6/738: symlink d12/d17/d34/d39/d8b/dcb/lea 0 2024-09-13T22:56:21.159 INFO:tasks.workunit.client.0.smithi002.stdout:6/739: write d12/d17/d28/fcf [427426,79235] 0 2024-09-13T22:56:21.159 INFO:tasks.workunit.client.0.smithi002.stdout:9/810: readlink d8/d1e/l7c 0 2024-09-13T22:56:21.161 INFO:tasks.workunit.client.0.smithi002.stdout:1/791: sync 2024-09-13T22:56:21.161 INFO:tasks.workunit.client.0.smithi002.stdout:9/811: fdatasync d8/d1e/f3a 0 2024-09-13T22:56:21.163 INFO:tasks.workunit.client.0.smithi002.stdout:3/789: truncate d9/d15/d26/f8f 222124 0 2024-09-13T22:56:21.165 INFO:tasks.workunit.client.0.smithi002.stdout:8/745: mknod d3/d27/ce9 0 2024-09-13T22:56:21.167 INFO:tasks.workunit.client.1.smithi047.stdout:6/793: dread d3/d11/d2b/d1c/d23/f39 [0,4194304] 0 2024-09-13T22:56:21.170 INFO:tasks.workunit.client.1.smithi047.stdout:5/684: mkdir d19/d34/d42/d5d/dd8 0 2024-09-13T22:56:21.170 INFO:tasks.workunit.client.1.smithi047.stdout:9/737: dwrite d1/dc/d14/dd/d4c/fa1 [0,4194304] 0 2024-09-13T22:56:21.171 INFO:tasks.workunit.client.0.smithi002.stdout:4/687: write d3/f3d [4792697,70743] 0 2024-09-13T22:56:21.172 INFO:tasks.workunit.client.0.smithi002.stdout:4/688: readlink d3/d14/d29/ld6 0 2024-09-13T22:56:21.175 INFO:tasks.workunit.client.0.smithi002.stdout:2/738: rename d1/d7/d35/d3e/d59 to d1/d7/d35/d78/dfc 0 2024-09-13T22:56:21.177 INFO:tasks.workunit.client.1.smithi047.stdout:8/751: readlink d8/d64/l81 0 2024-09-13T22:56:21.179 INFO:tasks.workunit.client.1.smithi047.stdout:2/799: creat d1/df/d35/dd7/dca/df5/f10a x:0 0 0 2024-09-13T22:56:21.181 INFO:tasks.workunit.client.0.smithi002.stdout:5/725: dwrite d1/d2a/d6b/d88/d45/d4f/da7/ff3 [0,4194304] 0 2024-09-13T22:56:21.186 INFO:tasks.workunit.client.0.smithi002.stdout:8/746: creat d3/dc/d18/d56/fea x:0 0 0 2024-09-13T22:56:21.187 INFO:tasks.workunit.client.1.smithi047.stdout:9/738: creat d1/dc/d14/dd/d54/d8d/ff5 x:0 0 0 2024-09-13T22:56:21.190 INFO:tasks.workunit.client.0.smithi002.stdout:3/790: dwrite d9/df/f7d [0,4194304] 0 2024-09-13T22:56:21.190 INFO:tasks.workunit.client.1.smithi047.stdout:8/752: unlink d8/d64/d4e/d4d/d8f/d91/d38/d7a/lb4 0 2024-09-13T22:56:21.193 INFO:tasks.workunit.client.0.smithi002.stdout:1/792: dread d1/d13/d21/d39/d70/d10c/d3d/db6/fd0 [0,4194304] 0 2024-09-13T22:56:21.195 INFO:tasks.workunit.client.1.smithi047.stdout:3/818: creat d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/ffe x:0 0 0 2024-09-13T22:56:21.197 INFO:tasks.workunit.client.0.smithi002.stdout:2/739: readlink d1/d7/d8/l11 0 2024-09-13T22:56:21.199 INFO:tasks.workunit.client.1.smithi047.stdout:6/794: write d3/d11/d2b/d1c/d4d/f84 [811415,45940] 0 2024-09-13T22:56:21.202 INFO:tasks.workunit.client.1.smithi047.stdout:1/876: link d0/d7/db/d101/c11 d0/d7/d14/d57/d62/c103 0 2024-09-13T22:56:21.202 INFO:tasks.workunit.client.0.smithi002.stdout:7/687: sync 2024-09-13T22:56:21.202 INFO:tasks.workunit.client.0.smithi002.stdout:0/727: sync 2024-09-13T22:56:21.203 INFO:tasks.workunit.client.0.smithi002.stdout:6/740: truncate d12/f14 3369069 0 2024-09-13T22:56:21.204 INFO:tasks.workunit.client.0.smithi002.stdout:2/740: dwrite d1/d7/d8/d4f/fdc [0,4194304] 0 2024-09-13T22:56:21.204 INFO:tasks.workunit.client.0.smithi002.stdout:0/728: fsync d1/d4/d75/d76/f85 0 2024-09-13T22:56:21.205 INFO:tasks.workunit.client.0.smithi002.stdout:6/741: dread - d12/d17/d4e/fc9 zero size 2024-09-13T22:56:21.206 INFO:tasks.workunit.client.0.smithi002.stdout:2/741: chown d1/d32/cc8 2252 1 2024-09-13T22:56:21.206 INFO:tasks.workunit.client.1.smithi047.stdout:5/685: mknod d19/d34/cd9 0 2024-09-13T22:56:21.207 INFO:tasks.workunit.client.0.smithi002.stdout:2/742: readlink d1/d4d/d8b/de1/la0 0 2024-09-13T22:56:21.208 INFO:tasks.workunit.client.1.smithi047.stdout:5/686: dread - d19/d23/d2e/d41/d58/d77/fc4 zero size 2024-09-13T22:56:21.209 INFO:tasks.workunit.client.1.smithi047.stdout:9/739: creat d1/dc/d14/dd/d54/d50/d91/da3/ff6 x:0 0 0 2024-09-13T22:56:21.212 INFO:tasks.workunit.client.0.smithi002.stdout:3/791: fsync d9/d15/d46/f5f 0 2024-09-13T22:56:21.214 INFO:tasks.workunit.client.0.smithi002.stdout:4/689: dwrite d3/d14/d85/f8d [0,4194304] 0 2024-09-13T22:56:21.217 INFO:tasks.workunit.client.1.smithi047.stdout:1/877: stat d0/d7/d14/d28/f48 0 2024-09-13T22:56:21.218 INFO:tasks.workunit.client.1.smithi047.stdout:1/878: fsync d0/f5a 0 2024-09-13T22:56:21.218 INFO:tasks.workunit.client.1.smithi047.stdout:6/795: dread d3/d11/d2b/d1c/d4d/d69/dc2/fde [0,4194304] 0 2024-09-13T22:56:21.221 INFO:tasks.workunit.client.0.smithi002.stdout:1/793: dwrite d1/d13/f3f [0,4194304] 0 2024-09-13T22:56:21.222 INFO:tasks.workunit.client.1.smithi047.stdout:8/753: mkdir d8/d64/d104 0 2024-09-13T22:56:21.225 INFO:tasks.workunit.client.0.smithi002.stdout:9/812: link d8/d1e/f36 d8/d91/da3/db9/dfa/d87/da5/d94/deb/f110 0 2024-09-13T22:56:21.227 INFO:tasks.workunit.client.1.smithi047.stdout:2/800: creat d1/df/d26/d4b/f10b x:0 0 0 2024-09-13T22:56:21.228 INFO:tasks.workunit.client.0.smithi002.stdout:5/726: getdents d1/d2a/d6b/d88/d45/d4f/d8f/dd5/d10a 0 2024-09-13T22:56:21.232 INFO:tasks.workunit.client.0.smithi002.stdout:2/743: creat d1/d7/d8/d2c/da4/ffd x:0 0 0 2024-09-13T22:56:21.235 INFO:tasks.workunit.client.1.smithi047.stdout:3/819: write d0/d3/d4/d16/f94 [1802122,33883] 0 2024-09-13T22:56:21.237 INFO:tasks.workunit.client.1.smithi047.stdout:8/754: mknod d8/d64/d4e/d70/c105 0 2024-09-13T22:56:21.238 INFO:tasks.workunit.client.1.smithi047.stdout:8/755: dread - d8/d6b/da9/dc3/ddc/ff7 zero size 2024-09-13T22:56:21.239 INFO:tasks.workunit.client.0.smithi002.stdout:0/729: write d1/d4/d75/d31/d32/dbb/fcf [703030,78495] 0 2024-09-13T22:56:21.240 INFO:tasks.workunit.client.1.smithi047.stdout:2/801: mknod d1/df/d1d/d20/d2b/c10c 0 2024-09-13T22:56:21.241 INFO:tasks.workunit.client.0.smithi002.stdout:3/792: fdatasync d9/d3b/d53/fb3 0 2024-09-13T22:56:21.242 INFO:tasks.workunit.client.0.smithi002.stdout:4/690: symlink d3/d14/d29/d2a/da6/d69/d7e/ldd 0 2024-09-13T22:56:21.242 INFO:tasks.workunit.client.1.smithi047.stdout:1/879: write d0/d7/d14/d57/d62/d76/d94/fae [143871,89468] 0 2024-09-13T22:56:21.243 INFO:tasks.workunit.client.0.smithi002.stdout:6/742: dwrite d12/d17/d4e/fa6 [0,4194304] 0 2024-09-13T22:56:21.249 INFO:tasks.workunit.client.0.smithi002.stdout:1/794: dread d1/d13/d21/d39/d70/d10c/d3d/db6/fdb [0,4194304] 0 2024-09-13T22:56:21.250 INFO:tasks.workunit.client.1.smithi047.stdout:8/756: creat d8/d64/d4e/d4d/d8f/d91/d38/f106 x:0 0 0 2024-09-13T22:56:21.251 INFO:tasks.workunit.client.1.smithi047.stdout:8/757: stat d8/d64/fcb 0 2024-09-13T22:56:21.251 INFO:tasks.workunit.client.0.smithi002.stdout:7/688: truncate d8/d10/f1e 3739387 0 2024-09-13T22:56:21.251 INFO:tasks.workunit.client.0.smithi002.stdout:7/689: chown d8/f27 4763155 1 2024-09-13T22:56:21.251 INFO:tasks.workunit.client.0.smithi002.stdout:9/813: write d8/d91/da3/db9/dfa/da8/dc3/ff1 [8243953,66466] 0 2024-09-13T22:56:21.253 INFO:tasks.workunit.client.1.smithi047.stdout:9/740: getdents d1/d5f/d6a 0 2024-09-13T22:56:21.256 INFO:tasks.workunit.client.1.smithi047.stdout:6/796: creat d3/d11/d2b/f101 x:0 0 0 2024-09-13T22:56:21.258 INFO:tasks.workunit.client.1.smithi047.stdout:3/820: creat d0/d3/d4/d16/d2c/dcb/fff x:0 0 0 2024-09-13T22:56:21.260 INFO:tasks.workunit.client.0.smithi002.stdout:8/747: rename d3/d27/f59 to d3/dc/d16/d2f/d83/feb 0 2024-09-13T22:56:21.261 INFO:tasks.workunit.client.0.smithi002.stdout:8/748: chown d3/d27/d39/f5c 28 1 2024-09-13T22:56:21.261 INFO:tasks.workunit.client.1.smithi047.stdout:8/758: mknod d8/d64/d4e/d4d/d8f/d91/d38/d7a/c107 0 2024-09-13T22:56:21.263 INFO:tasks.workunit.client.1.smithi047.stdout:2/802: fsync d1/de/f4a 0 2024-09-13T22:56:21.264 INFO:tasks.workunit.client.1.smithi047.stdout:2/803: write d1/df/fc9 [4807683,92948] 0 2024-09-13T22:56:21.265 INFO:tasks.workunit.client.1.smithi047.stdout:9/741: creat d1/dc/d14/dd/d54/d50/ff7 x:0 0 0 2024-09-13T22:56:21.267 INFO:tasks.workunit.client.1.smithi047.stdout:1/880: dread d0/d7/d13/d2d/ffd [0,4194304] 0 2024-09-13T22:56:21.268 INFO:tasks.workunit.client.1.smithi047.stdout:9/742: read - d1/dc/d14/dd/d54/d8d/fde zero size 2024-09-13T22:56:21.268 INFO:tasks.workunit.client.0.smithi002.stdout:0/730: creat d1/d4/d75/d31/d32/dbb/de1/f108 x:0 0 0 2024-09-13T22:56:21.269 INFO:tasks.workunit.client.0.smithi002.stdout:0/731: chown d1/d7e/cad 11 1 2024-09-13T22:56:21.270 INFO:tasks.workunit.client.0.smithi002.stdout:9/814: dread d8/d10/d1c/d3d/f7b [4194304,4194304] 0 2024-09-13T22:56:21.271 INFO:tasks.workunit.client.0.smithi002.stdout:8/749: dread d3/dc/d18/d6f/f90 [0,4194304] 0 2024-09-13T22:56:21.272 INFO:tasks.workunit.client.1.smithi047.stdout:8/759: mknod d8/d64/d4e/d4d/dda/c108 0 2024-09-13T22:56:21.273 INFO:tasks.workunit.client.1.smithi047.stdout:8/760: dread - d8/d64/ffb zero size 2024-09-13T22:56:21.273 INFO:tasks.workunit.client.0.smithi002.stdout:4/691: mknod d3/d14/d29/d2a/da6/d5e/cde 0 2024-09-13T22:56:21.274 INFO:tasks.workunit.client.1.smithi047.stdout:2/804: dwrite d1/df/d35/d8b/dd1/def/ff9 [0,4194304] 0 2024-09-13T22:56:21.280 INFO:tasks.workunit.client.1.smithi047.stdout:6/797: link d3/d11/d2b/d76/daf/f100 d3/d77/f102 0 2024-09-13T22:56:21.284 INFO:tasks.workunit.client.0.smithi002.stdout:5/727: mknod d1/d2a/c10d 0 2024-09-13T22:56:21.286 INFO:tasks.workunit.client.0.smithi002.stdout:2/744: symlink d1/d7/d8/lfe 0 2024-09-13T22:56:21.289 INFO:tasks.workunit.client.0.smithi002.stdout:3/793: rename d9/d15/d36/d4e/fcd to d9/d7e/dce/d111/f11a 0 2024-09-13T22:56:21.289 INFO:tasks.workunit.client.0.smithi002.stdout:3/794: chown d9/d15/d26/cb2 169621 1 2024-09-13T22:56:21.292 INFO:tasks.workunit.client.0.smithi002.stdout:8/750: symlink d3/dc/d16/d4b/d72/d73/lec 0 2024-09-13T22:56:21.295 INFO:tasks.workunit.client.0.smithi002.stdout:4/692: mknod d3/db3/cdf 0 2024-09-13T22:56:21.296 INFO:tasks.workunit.client.1.smithi047.stdout:3/821: truncate d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/fca 3614208 0 2024-09-13T22:56:21.299 INFO:tasks.workunit.client.1.smithi047.stdout:9/743: rmdir d1/dc/d14/dd/d54/d50/d5b/d9e 39 2024-09-13T22:56:21.306 INFO:tasks.workunit.client.0.smithi002.stdout:1/795: rename d1/d13/d21/d39/d70/d10c/d3b/fda to d1/d13/d21/d40/dc4/dc8/f113 0 2024-09-13T22:56:21.309 INFO:tasks.workunit.client.1.smithi047.stdout:8/761: dwrite d8/d64/f47 [0,4194304] 0 2024-09-13T22:56:21.310 INFO:tasks.workunit.client.1.smithi047.stdout:6/798: dread d3/d11/d2b/d4c/d30/d48/f7e [0,4194304] 0 2024-09-13T22:56:21.311 INFO:tasks.workunit.client.1.smithi047.stdout:1/881: truncate d0/d7/d14/d28/d36/f84 7887302 0 2024-09-13T22:56:21.312 INFO:tasks.workunit.client.1.smithi047.stdout:1/882: chown d0/d7/lb1 114703512 1 2024-09-13T22:56:21.314 INFO:tasks.workunit.client.1.smithi047.stdout:1/883: chown d0/d7/d14/d28/d36 221817638 1 2024-09-13T22:56:21.315 INFO:tasks.workunit.client.1.smithi047.stdout:9/744: creat d1/dc/d14/dd/d4c/df2/ff8 x:0 0 0 2024-09-13T22:56:21.319 INFO:tasks.workunit.client.0.smithi002.stdout:7/690: fdatasync d8/d10/f1e 0 2024-09-13T22:56:21.320 INFO:tasks.workunit.client.1.smithi047.stdout:8/762: truncate d8/f2e 694019 0 2024-09-13T22:56:21.320 INFO:tasks.workunit.client.0.smithi002.stdout:6/743: sync 2024-09-13T22:56:21.321 INFO:tasks.workunit.client.0.smithi002.stdout:7/691: chown d8/d10/f45 7 1 2024-09-13T22:56:21.321 INFO:tasks.workunit.client.0.smithi002.stdout:5/728: symlink d1/de7/l10e 0 2024-09-13T22:56:21.321 INFO:tasks.workunit.client.1.smithi047.stdout:6/799: readlink d3/d11/d2b/d1c/d4d/d69/dc2/dcd/ld3 0 2024-09-13T22:56:21.323 INFO:tasks.workunit.client.0.smithi002.stdout:2/745: creat d1/d7/d35/d3e/df8/fff x:0 0 0 2024-09-13T22:56:21.323 INFO:tasks.workunit.client.1.smithi047.stdout:8/763: dread d8/d64/d4e/d4d/dda/fe4 [0,4194304] 0 2024-09-13T22:56:21.326 INFO:tasks.workunit.client.1.smithi047.stdout:1/884: fdatasync d0/d7/db/fb8 0 2024-09-13T22:56:21.334 INFO:tasks.workunit.client.0.smithi002.stdout:0/732: rmdir d1/d4/d75/d31/df1/df2 0 2024-09-13T22:56:21.335 INFO:tasks.workunit.client.1.smithi047.stdout:2/805: rename d1/df/d26/d9f/fad to d1/df/d26/f10d 0 2024-09-13T22:56:21.336 INFO:tasks.workunit.client.0.smithi002.stdout:8/751: mknod d3/dc/da4/dd4/ced 0 2024-09-13T22:56:21.339 INFO:tasks.workunit.client.0.smithi002.stdout:4/693: symlink d3/db3/db9/le0 0 2024-09-13T22:56:21.340 INFO:tasks.workunit.client.1.smithi047.stdout:3/822: creat d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/f100 x:0 0 0 2024-09-13T22:56:21.345 INFO:tasks.workunit.client.0.smithi002.stdout:1/796: dwrite d1/d13/d21/d39/d70/f96 [4194304,4194304] 0 2024-09-13T22:56:21.345 INFO:tasks.workunit.client.1.smithi047.stdout:1/885: creat d0/d1d/daa/df0/df1/f104 x:0 0 0 2024-09-13T22:56:21.346 INFO:tasks.workunit.client.0.smithi002.stdout:1/797: chown d1/d13/d1d/d34/d107 26677 1 2024-09-13T22:56:21.346 INFO:tasks.workunit.client.1.smithi047.stdout:1/886: chown d0/d7/db/f8b 333572 1 2024-09-13T22:56:21.347 INFO:tasks.workunit.client.1.smithi047.stdout:1/887: dread - d0/d7/d14/f102 zero size 2024-09-13T22:56:21.348 INFO:tasks.workunit.client.1.smithi047.stdout:2/806: dread d1/df/d26/f30 [0,4194304] 0 2024-09-13T22:56:21.349 INFO:tasks.workunit.client.1.smithi047.stdout:2/807: stat d1/df/d26/d9f/fc1 0 2024-09-13T22:56:21.350 INFO:tasks.workunit.client.1.smithi047.stdout:2/808: dread - d1/d16/d40/fe6 zero size 2024-09-13T22:56:21.350 INFO:tasks.workunit.client.0.smithi002.stdout:2/746: symlink d1/d32/d37/l100 0 2024-09-13T22:56:21.356 INFO:tasks.workunit.client.0.smithi002.stdout:9/815: rename d8/d91/da3/db9/dfa/da8/dc3/fe6 to d8/d10/d1c/dd6/dda/f111 0 2024-09-13T22:56:21.359 INFO:tasks.workunit.client.1.smithi047.stdout:3/823: mknod d0/d3/d4/d16/d2c/de/d1f/d3b/c101 0 2024-09-13T22:56:21.361 INFO:tasks.workunit.client.0.smithi002.stdout:6/744: dwrite d12/d17/d34/d39/f62 [0,4194304] 0 2024-09-13T22:56:21.362 INFO:tasks.workunit.client.0.smithi002.stdout:7/692: link d8/d10/d39/d60/db8/d26/d4c/fa7 d8/d10/d39/d60/db8/d26/d38/fcc 0 2024-09-13T22:56:21.364 INFO:tasks.workunit.client.1.smithi047.stdout:9/745: link d1/dc/d14/dd/d54/d50/d5b/d9e/f83 d1/dc/d14/dd/d4c/df2/ff9 0 2024-09-13T22:56:21.365 INFO:tasks.workunit.client.1.smithi047.stdout:9/746: stat d1/dc/d14/dd/d4c/df2/cae 0 2024-09-13T22:56:21.366 INFO:tasks.workunit.client.1.smithi047.stdout:9/747: write d1/dc/d14/dd/d54/d50/f92 [1366614,118556] 0 2024-09-13T22:56:21.366 INFO:tasks.workunit.client.1.smithi047.stdout:1/888: creat d0/d7/d13/f105 x:0 0 0 2024-09-13T22:56:21.368 INFO:tasks.workunit.client.1.smithi047.stdout:1/889: write d0/f5a [620999,3243] 0 2024-09-13T22:56:21.370 INFO:tasks.workunit.client.1.smithi047.stdout:2/809: mkdir d1/df/d35/dd7/dca/d10e 0 2024-09-13T22:56:21.373 INFO:tasks.workunit.client.0.smithi002.stdout:3/795: rename d9/d91/fb6 to d9/d15/d51/deb/f11b 0 2024-09-13T22:56:21.376 INFO:tasks.workunit.client.1.smithi047.stdout:3/824: unlink d0/d3/d4/f3e 0 2024-09-13T22:56:21.376 INFO:tasks.workunit.client.1.smithi047.stdout:1/890: dwrite d0/d7/d14/d28/f48 [0,4194304] 0 2024-09-13T22:56:21.377 INFO:tasks.workunit.client.1.smithi047.stdout:1/891: fsync d0/d7/db/f58 0 2024-09-13T22:56:21.378 INFO:tasks.workunit.client.1.smithi047.stdout:1/892: fsync d0/d7/d13/d8c/fb4 0 2024-09-13T22:56:21.384 INFO:tasks.workunit.client.1.smithi047.stdout:9/748: creat d1/dc/d14/dd/d4c/d6b/ffa x:0 0 0 2024-09-13T22:56:21.385 INFO:tasks.workunit.client.1.smithi047.stdout:9/749: write d1/dc/d14/dd/d4c/fac [1120454,5087] 0 2024-09-13T22:56:21.387 INFO:tasks.workunit.client.1.smithi047.stdout:9/750: chown d1/c32 125 1 2024-09-13T22:56:21.391 INFO:tasks.workunit.client.1.smithi047.stdout:2/810: symlink d1/df/d35/d8b/l10f 0 2024-09-13T22:56:21.392 INFO:tasks.workunit.client.1.smithi047.stdout:2/811: chown d1/df/d1d/d2e/d5e/ffd 574811236 1 2024-09-13T22:56:21.399 INFO:tasks.workunit.client.0.smithi002.stdout:6/745: dwrite d12/f6a [4194304,4194304] 0 2024-09-13T22:56:21.399 INFO:tasks.workunit.client.0.smithi002.stdout:5/729: link d1/d2a/d6b/d88/d55/d56/l7c d1/d2a/d6b/d88/d55/d56/d86/d100/l10f 0 2024-09-13T22:56:21.400 INFO:tasks.workunit.client.1.smithi047.stdout:1/893: dread d0/d7/db/d101/f43 [0,4194304] 0 2024-09-13T22:56:21.401 INFO:tasks.workunit.client.0.smithi002.stdout:2/747: dwrite d1/f95 [0,4194304] 0 2024-09-13T22:56:21.401 INFO:tasks.workunit.client.0.smithi002.stdout:5/730: chown d1/d2a/d6b/d88/d55/d56/de4/le9 1563770 1 2024-09-13T22:56:21.402 INFO:tasks.workunit.client.0.smithi002.stdout:5/731: chown d1/d2a/c10d 5 1 2024-09-13T22:56:21.404 INFO:tasks.workunit.client.0.smithi002.stdout:1/798: creat d1/d13/d30/d73/def/f114 x:0 0 0 2024-09-13T22:56:21.407 INFO:tasks.workunit.client.1.smithi047.stdout:6/800: getdents d3/d11/d2b/d1c/dbd/de8 0 2024-09-13T22:56:21.409 INFO:tasks.workunit.client.1.smithi047.stdout:1/894: dwrite d0/d7/d13/d5d/fd9 [0,4194304] 0 2024-09-13T22:56:21.412 INFO:tasks.workunit.client.0.smithi002.stdout:4/694: sync 2024-09-13T22:56:21.412 INFO:tasks.workunit.client.0.smithi002.stdout:8/752: dwrite d3/dc/d18/f23 [0,4194304] 0 2024-09-13T22:56:21.414 INFO:tasks.workunit.client.0.smithi002.stdout:9/816: mknod d8/d91/da3/db9/dfa/c112 0 2024-09-13T22:56:21.418 INFO:tasks.workunit.client.0.smithi002.stdout:0/733: rmdir d1/d4/da3/d7d/df8/dda 0 2024-09-13T22:56:21.422 INFO:tasks.workunit.client.0.smithi002.stdout:7/693: symlink d8/d10/d39/d60/db8/d26/d4c/lcd 0 2024-09-13T22:56:21.424 INFO:tasks.workunit.client.1.smithi047.stdout:9/751: write d1/dc/d14/f17 [3421077,125548] 0 2024-09-13T22:56:21.424 INFO:tasks.workunit.client.0.smithi002.stdout:3/796: dwrite d9/fb [0,4194304] 0 2024-09-13T22:56:21.425 INFO:tasks.workunit.client.0.smithi002.stdout:3/797: fsync d9/df/f7d 0 2024-09-13T22:56:21.426 INFO:tasks.workunit.client.0.smithi002.stdout:5/732: symlink d1/d2a/d6b/d88/d55/d56/dc7/l110 0 2024-09-13T22:56:21.427 INFO:tasks.workunit.client.0.smithi002.stdout:3/798: chown d9/d3b/d53/d83/d100 1013057040 1 2024-09-13T22:56:21.428 INFO:tasks.workunit.client.0.smithi002.stdout:3/799: dread - d9/fb8 zero size 2024-09-13T22:56:21.431 INFO:tasks.workunit.client.0.smithi002.stdout:4/695: symlink d3/d14/d86/db1/le1 0 2024-09-13T22:56:21.432 INFO:tasks.workunit.client.0.smithi002.stdout:8/753: creat d3/d27/fee x:0 0 0 2024-09-13T22:56:21.453 INFO:tasks.workunit.client.0.smithi002.stdout:2/748: sync 2024-09-13T22:56:21.463 INFO:tasks.workunit.client.0.smithi002.stdout:6/746: mknod d12/d17/d28/d67/dca/dd8/de1/ceb 0 2024-09-13T22:56:21.464 INFO:tasks.workunit.client.0.smithi002.stdout:6/747: read d12/d17/ddf/fda [2448985,30042] 0 2024-09-13T22:56:21.464 INFO:tasks.workunit.client.0.smithi002.stdout:6/748: chown d12/d17/d34/d4b 1320402 1 2024-09-13T22:56:21.470 INFO:tasks.workunit.client.0.smithi002.stdout:9/817: write d8/d10/d1c/d3d/fb3 [886493,20637] 0 2024-09-13T22:56:21.471 INFO:tasks.workunit.client.0.smithi002.stdout:4/696: creat d3/d14/d29/d2a/dbc/fe2 x:0 0 0 2024-09-13T22:56:21.472 INFO:tasks.workunit.client.0.smithi002.stdout:4/697: fsync d3/d14/d29/f96 0 2024-09-13T22:56:21.473 INFO:tasks.workunit.client.0.smithi002.stdout:8/754: write d3/d27/d39/f3b [3718118,87747] 0 2024-09-13T22:56:21.476 INFO:tasks.workunit.client.0.smithi002.stdout:7/694: mknod d8/cce 0 2024-09-13T22:56:21.480 INFO:tasks.workunit.client.0.smithi002.stdout:3/800: getdents d9/d3b/d53/db9/df2 0 2024-09-13T22:56:21.481 INFO:tasks.workunit.client.0.smithi002.stdout:5/733: dwrite d1/d2a/d6b/d88/d45/d4f/d78/d8b/fab [0,4194304] 0 2024-09-13T22:56:21.481 INFO:tasks.workunit.client.0.smithi002.stdout:9/818: mkdir d8/d2c/dbc/d113 0 2024-09-13T22:56:21.487 INFO:tasks.workunit.client.0.smithi002.stdout:6/749: fsync d12/d17/d34/d39/d8a/fe6 0 2024-09-13T22:56:21.489 INFO:tasks.workunit.client.0.smithi002.stdout:6/750: write d12/d17/d34/d39/d8b/fa3 [2113154,89217] 0 2024-09-13T22:56:21.509 INFO:tasks.workunit.client.0.smithi002.stdout:0/734: rename d1/f2d to d1/d2/f109 0 2024-09-13T22:56:21.509 INFO:tasks.workunit.client.0.smithi002.stdout:7/695: dread d8/d10/d39/d60/db8/d26/d4c/d81/f5c [0,4194304] 0 2024-09-13T22:56:21.513 INFO:tasks.workunit.client.0.smithi002.stdout:6/751: dread - d12/d17/d4e/f9a zero size 2024-09-13T22:56:21.514 INFO:tasks.workunit.client.0.smithi002.stdout:7/696: dread d8/d10/d39/d60/db8/d2e/d3c/f91 [0,4194304] 0 2024-09-13T22:56:21.515 INFO:tasks.workunit.client.0.smithi002.stdout:1/799: link d1/d13/d21/d39/d70/d10c/d3b/d71/d80/d112/l79 d1/d13/d30/l115 0 2024-09-13T22:56:21.515 INFO:tasks.workunit.client.0.smithi002.stdout:7/697: write d8/d10/d39/d60/db8/d2e/d50/f55 [1066521,113704] 0 2024-09-13T22:56:21.520 INFO:tasks.workunit.client.0.smithi002.stdout:4/698: creat d3/d14/d29/fe3 x:0 0 0 2024-09-13T22:56:21.521 INFO:tasks.workunit.client.0.smithi002.stdout:8/755: creat d3/dc/d51/d99/fef x:0 0 0 2024-09-13T22:56:21.523 INFO:tasks.workunit.client.0.smithi002.stdout:2/749: rename d1/d32/d37/fda to d1/d7/d8/d2c/f101 0 2024-09-13T22:56:21.528 INFO:tasks.workunit.client.1.smithi047.stdout:8/764: rename d8/d64/d4e/d4d/d8f/d91/d38/c41 to d8/d64/c109 0 2024-09-13T22:56:21.529 INFO:tasks.workunit.client.1.smithi047.stdout:8/765: write d8/d6b/da9/fb7 [2245235,111396] 0 2024-09-13T22:56:21.530 INFO:tasks.workunit.client.1.smithi047.stdout:3/825: symlink d0/d3/d4/d16/d2c/de/l102 0 2024-09-13T22:56:21.532 INFO:tasks.workunit.client.0.smithi002.stdout:6/752: creat d12/d17/d2a/d88/fec x:0 0 0 2024-09-13T22:56:21.533 INFO:tasks.workunit.client.0.smithi002.stdout:3/801: dwrite d9/d3b/f61 [0,4194304] 0 2024-09-13T22:56:21.533 INFO:tasks.workunit.client.0.smithi002.stdout:6/753: stat d12/d17/d34/d39/d8a/caf 0 2024-09-13T22:56:21.534 INFO:tasks.workunit.client.0.smithi002.stdout:9/819: write d8/d91/fab [424576,55263] 0 2024-09-13T22:56:21.534 INFO:tasks.workunit.client.1.smithi047.stdout:8/766: dread d8/d64/d4e/d4d/d8f/d91/d38/f45 [0,4194304] 0 2024-09-13T22:56:21.535 INFO:tasks.workunit.client.1.smithi047.stdout:6/801: fdatasync d3/d11/f63 0 2024-09-13T22:56:21.535 INFO:tasks.workunit.client.1.smithi047.stdout:8/767: stat d8/l61 0 2024-09-13T22:56:21.542 INFO:tasks.workunit.client.0.smithi002.stdout:5/734: dwrite d1/d2a/d6b/d88/d55/d56/d86/fb0 [0,4194304] 0 2024-09-13T22:56:21.544 INFO:tasks.workunit.client.0.smithi002.stdout:8/756: mknod d3/d27/d39/d80/cf0 0 2024-09-13T22:56:21.544 INFO:tasks.workunit.client.1.smithi047.stdout:2/812: getdents d1/df/dc8 0 2024-09-13T22:56:21.553 INFO:tasks.workunit.client.1.smithi047.stdout:3/826: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d3a/fd3 [1308116,62675] 0 2024-09-13T22:56:21.554 INFO:tasks.workunit.client.0.smithi002.stdout:3/802: fsync d9/d3b/d53/d83/fe4 0 2024-09-13T22:56:21.558 INFO:tasks.workunit.client.1.smithi047.stdout:6/802: mknod d3/d11/d2b/d4c/d9d/c103 0 2024-09-13T22:56:21.560 INFO:tasks.workunit.client.1.smithi047.stdout:8/768: mknod d8/d64/d4e/d4d/d8f/d91/d38/d7a/c10a 0 2024-09-13T22:56:21.561 INFO:tasks.workunit.client.1.smithi047.stdout:8/769: chown d8/d6b/ca0 96676881 1 2024-09-13T22:56:21.561 INFO:tasks.workunit.client.0.smithi002.stdout:1/800: fsync d1/d13/d21/d39/d70/d10c/d3d/d5d/f4e 0 2024-09-13T22:56:21.563 INFO:tasks.workunit.client.1.smithi047.stdout:1/895: mkdir d0/d7/dd3/d106 0 2024-09-13T22:56:21.565 INFO:tasks.workunit.client.0.smithi002.stdout:7/698: mkdir d8/d10/d39/d60/db8/d2e/d3c/dcf 0 2024-09-13T22:56:21.567 INFO:tasks.workunit.client.0.smithi002.stdout:1/801: readlink d1/d13/d21/d39/d70/d10c/d3d/d5d/lea 0 2024-09-13T22:56:21.568 INFO:tasks.workunit.client.1.smithi047.stdout:2/813: rename d1/df/d1d/d20/d29/f9b to d1/df/d35/dd7/f110 0 2024-09-13T22:56:21.568 INFO:tasks.workunit.client.0.smithi002.stdout:6/754: dwrite d12/d17/d28/d67/d6b/daa/dc6/fdc [0,4194304] 0 2024-09-13T22:56:21.569 INFO:tasks.workunit.client.0.smithi002.stdout:0/735: dwrite d1/d7e/d9d/fc6 [0,4194304] 0 2024-09-13T22:56:21.572 INFO:tasks.workunit.client.0.smithi002.stdout:4/699: write d3/d14/d85/fbb [319111,19088] 0 2024-09-13T22:56:21.573 INFO:tasks.workunit.client.0.smithi002.stdout:7/699: write d8/d10/d39/d60/db8/d26/f92 [534316,111910] 0 2024-09-13T22:56:21.573 INFO:tasks.workunit.client.0.smithi002.stdout:3/803: dread d9/fd [0,4194304] 0 2024-09-13T22:56:21.574 INFO:tasks.workunit.client.1.smithi047.stdout:6/803: mknod d3/d11/d74/c104 0 2024-09-13T22:56:21.575 INFO:tasks.workunit.client.0.smithi002.stdout:2/750: write d1/d7/d8/d2c/f44 [4460549,35148] 0 2024-09-13T22:56:21.576 INFO:tasks.workunit.client.1.smithi047.stdout:6/804: chown d3/d11/d2b/d4c/d9d/dc1/de0 0 1 2024-09-13T22:56:21.579 INFO:tasks.workunit.client.0.smithi002.stdout:8/757: mkdir d3/dc/d16/d2f/d83/d85/dc8/de3/df1 0 2024-09-13T22:56:21.580 INFO:tasks.workunit.client.0.smithi002.stdout:5/735: dread d1/d2a/d5a/f62 [0,4194304] 0 2024-09-13T22:56:21.580 INFO:tasks.workunit.client.1.smithi047.stdout:8/770: symlink d8/d64/d4e/d4d/d8f/d91/d78/l10b 0 2024-09-13T22:56:21.581 INFO:tasks.workunit.client.0.smithi002.stdout:4/700: dread d3/d14/d29/d2a/f2d [0,4194304] 0 2024-09-13T22:56:21.584 INFO:tasks.workunit.client.0.smithi002.stdout:9/820: write d8/d1e/fca [1896363,116866] 0 2024-09-13T22:56:21.590 INFO:tasks.workunit.client.0.smithi002.stdout:9/821: dwrite d8/d10/d1c/f15 [0,4194304] 0 2024-09-13T22:56:21.599 INFO:tasks.workunit.client.1.smithi047.stdout:8/771: dread d8/d64/d4e/d4d/d8f/d91/fc2 [0,4194304] 0 2024-09-13T22:56:21.602 INFO:tasks.workunit.client.1.smithi047.stdout:9/752: getdents d1/dc/d14/dd/dba 0 2024-09-13T22:56:21.604 INFO:tasks.workunit.client.1.smithi047.stdout:9/753: read - d1/dc/d14/dd/d54/d50/fd0 zero size 2024-09-13T22:56:21.606 INFO:tasks.workunit.client.1.smithi047.stdout:1/896: dwrite d0/d7/d75/f85 [0,4194304] 0 2024-09-13T22:56:21.607 INFO:tasks.workunit.client.1.smithi047.stdout:8/772: mkdir d8/d6b/dfc/d10c 0 2024-09-13T22:56:21.611 INFO:tasks.workunit.client.1.smithi047.stdout:3/827: rename d0/d3/d4/d91/dd5 to d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d103 0 2024-09-13T22:56:21.612 INFO:tasks.workunit.client.1.smithi047.stdout:2/814: write d1/df/d1d/d20/d29/dcd/dff/db6/de9/ded/ffc [1465,7502] 0 2024-09-13T22:56:21.613 INFO:tasks.workunit.client.1.smithi047.stdout:3/828: readlink d0/d3/d4/d16/d32/d76/l8f 0 2024-09-13T22:56:21.613 INFO:tasks.workunit.client.1.smithi047.stdout:2/815: chown d1/df/f1b 35486 1 2024-09-13T22:56:21.615 INFO:tasks.workunit.client.0.smithi002.stdout:8/758: write d3/dc/d18/d56/f7c [3784132,9533] 0 2024-09-13T22:56:21.615 INFO:tasks.workunit.client.1.smithi047.stdout:3/829: chown d0/d3/d4/d16/cb5 595119 1 2024-09-13T22:56:21.615 INFO:tasks.workunit.client.1.smithi047.stdout:6/805: creat d3/f105 x:0 0 0 2024-09-13T22:56:21.620 INFO:tasks.workunit.client.0.smithi002.stdout:1/802: read - d1/d13/d21/d39/d70/d10c/d3d/d5d/d8e/fcd zero size 2024-09-13T22:56:21.621 INFO:tasks.workunit.client.0.smithi002.stdout:6/755: mknod d12/d17/d28/d67/d9f/ddd/ced 0 2024-09-13T22:56:21.622 INFO:tasks.workunit.client.0.smithi002.stdout:1/803: readlink d1/d13/d21/d39/d70/d10c/d3b/d71/d80/d112/l87 0 2024-09-13T22:56:21.623 INFO:tasks.workunit.client.0.smithi002.stdout:0/736: creat d1/d4/d75/d31/de0/d102/f10a x:0 0 0 2024-09-13T22:56:21.624 INFO:tasks.workunit.client.0.smithi002.stdout:9/822: dread d8/d10/d1c/f12 [0,4194304] 0 2024-09-13T22:56:21.625 INFO:tasks.workunit.client.1.smithi047.stdout:2/816: unlink d1/df/d1d/d20/d29/dcd/dff/db6/c108 0 2024-09-13T22:56:21.625 INFO:tasks.workunit.client.1.smithi047.stdout:1/897: write d0/d7/d14/d28/d36/f9b [289529,90262] 0 2024-09-13T22:56:21.625 INFO:tasks.workunit.client.0.smithi002.stdout:0/737: write d1/d2/d6c/d8b/f8c [3947937,106018] 0 2024-09-13T22:56:21.626 INFO:tasks.workunit.client.0.smithi002.stdout:0/738: chown d1/d4/f3e 6 1 2024-09-13T22:56:21.626 INFO:tasks.workunit.client.0.smithi002.stdout:2/751: symlink d1/d7/d8/d4f/df7/l102 0 2024-09-13T22:56:21.627 INFO:tasks.workunit.client.1.smithi047.stdout:1/898: fdatasync d0/d7/d14/f102 0 2024-09-13T22:56:21.627 INFO:tasks.workunit.client.1.smithi047.stdout:2/817: dread - d1/df/d1d/d2e/d5e/ffd zero size 2024-09-13T22:56:21.627 INFO:tasks.workunit.client.1.smithi047.stdout:3/830: creat d0/d3/d4/d16/d2c/de/dcc/f104 x:0 0 0 2024-09-13T22:56:21.627 INFO:tasks.workunit.client.1.smithi047.stdout:1/899: stat d0/d1d/d7f 0 2024-09-13T22:56:21.628 INFO:tasks.workunit.client.0.smithi002.stdout:3/804: truncate d9/d15/d36/d4e/d5e/fb7 4053569 0 2024-09-13T22:56:21.628 INFO:tasks.workunit.client.0.smithi002.stdout:2/752: write d1/d7/d8/d2c/da4/fc0 [90650,7768] 0 2024-09-13T22:56:21.629 INFO:tasks.workunit.client.1.smithi047.stdout:1/900: fsync d0/d7/d14/d28/d36/dcc/fec 0 2024-09-13T22:56:21.630 INFO:tasks.workunit.client.0.smithi002.stdout:2/753: chown d1/d7/d35/d3e/d5e/ccf 227619583 1 2024-09-13T22:56:21.630 INFO:tasks.workunit.client.1.smithi047.stdout:9/754: creat d1/dc/d14/df3/ffb x:0 0 0 2024-09-13T22:56:21.631 INFO:tasks.workunit.client.1.smithi047.stdout:9/755: chown d1/c23 2 1 2024-09-13T22:56:21.632 INFO:tasks.workunit.client.1.smithi047.stdout:6/806: getdents d3/d11/d2b/d4c/d9d/dc1/de0 0 2024-09-13T22:56:21.634 INFO:tasks.workunit.client.1.smithi047.stdout:5/687: sync 2024-09-13T22:56:21.635 INFO:tasks.workunit.client.1.smithi047.stdout:4/888: sync 2024-09-13T22:56:21.635 INFO:tasks.workunit.client.1.smithi047.stdout:7/751: sync 2024-09-13T22:56:21.635 INFO:tasks.workunit.client.1.smithi047.stdout:0/784: sync 2024-09-13T22:56:21.635 INFO:tasks.workunit.client.0.smithi002.stdout:1/804: mkdir d1/d13/d30/d73/da1/d7d/dce/d116 0 2024-09-13T22:56:21.636 INFO:tasks.workunit.client.1.smithi047.stdout:2/818: dwrite d1/df/d1d/d20/d2b/ff7 [0,4194304] 0 2024-09-13T22:56:21.637 INFO:tasks.workunit.client.1.smithi047.stdout:0/785: chown d1/d5/d11/c28 8 1 2024-09-13T22:56:21.637 INFO:tasks.workunit.client.0.smithi002.stdout:8/759: dwrite d3/dc/f42 [0,4194304] 0 2024-09-13T22:56:21.637 INFO:tasks.workunit.client.1.smithi047.stdout:2/819: readlink d1/df/d35/d8b/lcf 0 2024-09-13T22:56:21.640 INFO:tasks.workunit.client.0.smithi002.stdout:8/760: read d3/dc/d18/d2e/d94/f7f [1164975,48425] 0 2024-09-13T22:56:21.642 INFO:tasks.workunit.client.0.smithi002.stdout:9/823: mknod d8/d2c/dbc/dc8/c114 0 2024-09-13T22:56:21.643 INFO:tasks.workunit.client.1.smithi047.stdout:8/773: link d8/d64/d4e/d4d/dda/c108 d8/d64/d4e/d4d/d8f/d91/d38/c10d 0 2024-09-13T22:56:21.644 INFO:tasks.workunit.client.0.smithi002.stdout:8/761: truncate d3/dc/fa2 698258 0 2024-09-13T22:56:21.644 INFO:tasks.workunit.client.1.smithi047.stdout:8/774: fsync d8/d64/d4e/d4d/d8f/d91/d78/ff8 0 2024-09-13T22:56:21.645 INFO:tasks.workunit.client.0.smithi002.stdout:7/700: sync 2024-09-13T22:56:21.646 INFO:tasks.workunit.client.1.smithi047.stdout:8/775: dread - d8/d6b/da9/dc3/ddc/ff7 zero size 2024-09-13T22:56:21.647 INFO:tasks.workunit.client.0.smithi002.stdout:8/762: chown d3/dc/d16/d2f/d83/le2 222230 1 2024-09-13T22:56:21.647 INFO:tasks.workunit.client.1.smithi047.stdout:9/756: symlink d1/dc/d14/dd/d4c/d6b/lfc 0 2024-09-13T22:56:21.648 INFO:tasks.workunit.client.0.smithi002.stdout:8/763: write d3/d27/d39/d80/fb9 [495720,78126] 0 2024-09-13T22:56:21.649 INFO:tasks.workunit.client.1.smithi047.stdout:9/757: write d1/dc/d14/f13 [1757767,113818] 0 2024-09-13T22:56:21.651 INFO:tasks.workunit.client.0.smithi002.stdout:3/805: creat d9/d15/d36/d4e/d5e/dae/d89/de5/f11c x:0 0 0 2024-09-13T22:56:21.655 INFO:tasks.workunit.client.1.smithi047.stdout:8/776: dwrite d8/d6b/da9/fb7 [0,4194304] 0 2024-09-13T22:56:21.655 INFO:tasks.workunit.client.0.smithi002.stdout:4/701: creat d3/d14/fe4 x:0 0 0 2024-09-13T22:56:21.658 INFO:tasks.workunit.client.0.smithi002.stdout:8/764: dwrite d3/dc/d18/fd5 [0,4194304] 0 2024-09-13T22:56:21.659 INFO:tasks.workunit.client.0.smithi002.stdout:4/702: write d3/d14/d29/d2a/da6/f9b [619926,5792] 0 2024-09-13T22:56:21.660 INFO:tasks.workunit.client.0.smithi002.stdout:6/756: dwrite d12/d17/d34/f36 [0,4194304] 0 2024-09-13T22:56:21.660 INFO:tasks.workunit.client.1.smithi047.stdout:5/688: truncate d19/d23/d32/f55 4548605 0 2024-09-13T22:56:21.661 INFO:tasks.workunit.client.1.smithi047.stdout:5/689: chown d19/d23/c24 695 1 2024-09-13T22:56:21.661 INFO:tasks.workunit.client.1.smithi047.stdout:4/889: dread dc/d29/ff3 [0,4194304] 0 2024-09-13T22:56:21.662 INFO:tasks.workunit.client.1.smithi047.stdout:5/690: stat d19/d23/d4c/c5f 0 2024-09-13T22:56:21.664 INFO:tasks.workunit.client.0.smithi002.stdout:4/703: write d3/d14/d29/d2a/da6/fcf [789762,57705] 0 2024-09-13T22:56:21.665 INFO:tasks.workunit.client.0.smithi002.stdout:4/704: chown d3/d14/d85/lb7 85672362 1 2024-09-13T22:56:21.666 INFO:tasks.workunit.client.1.smithi047.stdout:7/752: rename d0/d57/d5b/d8b/fbd to d0/d57/d5b/d5c/db6/df3/ff8 0 2024-09-13T22:56:21.671 INFO:tasks.workunit.client.0.smithi002.stdout:1/805: truncate d1/d13/d30/d73/da1/f26 3457908 0 2024-09-13T22:56:21.672 INFO:tasks.workunit.client.0.smithi002.stdout:0/739: dwrite d1/d4/d75/d31/f65 [0,4194304] 0 2024-09-13T22:56:21.675 INFO:tasks.workunit.client.0.smithi002.stdout:9/824: rename d8/d10/d1c/d68/faf to d8/d2c/dbc/d103/d106/f115 0 2024-09-13T22:56:21.677 INFO:tasks.workunit.client.1.smithi047.stdout:3/831: write d0/d3/d4/d91/f66 [2500242,109130] 0 2024-09-13T22:56:21.678 INFO:tasks.workunit.client.1.smithi047.stdout:9/758: creat d1/ffd x:0 0 0 2024-09-13T22:56:21.679 INFO:tasks.workunit.client.1.smithi047.stdout:6/807: dwrite d3/d11/d2b/d4c/f36 [0,4194304] 0 2024-09-13T22:56:21.683 INFO:tasks.workunit.client.0.smithi002.stdout:9/825: dwrite d8/d1e/f34 [4194304,4194304] 0 2024-09-13T22:56:21.684 INFO:tasks.workunit.client.1.smithi047.stdout:1/901: write d0/d7/d14/d57/d62/d76/fe7 [250554,48699] 0 2024-09-13T22:56:21.685 INFO:tasks.workunit.client.1.smithi047.stdout:8/777: chown d8/f2e 409458 1 2024-09-13T22:56:21.691 INFO:tasks.workunit.client.0.smithi002.stdout:5/736: link d1/d2a/d6b/d88/d45/d4f/d78/ld8 d1/d2a/d6b/d88/d45/d4f/d78/l111 0 2024-09-13T22:56:21.694 INFO:tasks.workunit.client.0.smithi002.stdout:6/757: symlink d12/d17/d28/d67/d6b/lee 0 2024-09-13T22:56:21.694 INFO:tasks.workunit.client.0.smithi002.stdout:8/765: dwrite d3/f20 [4194304,4194304] 0 2024-09-13T22:56:21.698 INFO:tasks.workunit.client.1.smithi047.stdout:4/890: write dc/de/d23/f3b [436937,28683] 0 2024-09-13T22:56:21.701 INFO:tasks.workunit.client.0.smithi002.stdout:1/806: creat d1/d13/d30/d73/f117 x:0 0 0 2024-09-13T22:56:21.705 INFO:tasks.workunit.client.0.smithi002.stdout:0/740: creat d1/d4/da3/d7d/f10b x:0 0 0 2024-09-13T22:56:21.706 INFO:tasks.workunit.client.1.smithi047.stdout:9/759: mknod d1/dc/d14/dd/dba/cfe 0 2024-09-13T22:56:21.709 INFO:tasks.workunit.client.0.smithi002.stdout:9/826: mkdir d8/d10/d61/d116 0 2024-09-13T22:56:21.711 INFO:tasks.workunit.client.0.smithi002.stdout:2/754: rmdir d1/d4d/d8b/dd2 0 2024-09-13T22:56:21.716 INFO:tasks.workunit.client.0.smithi002.stdout:5/737: unlink d1/d57/cde 0 2024-09-13T22:56:21.717 INFO:tasks.workunit.client.0.smithi002.stdout:5/738: dread d1/d2a/d6b/d88/d45/d4f/da7/daa/fe5 [0,4194304] 0 2024-09-13T22:56:21.717 INFO:tasks.workunit.client.0.smithi002.stdout:5/739: read - d1/f37 zero size 2024-09-13T22:56:21.717 INFO:tasks.workunit.client.1.smithi047.stdout:5/691: read d19/d23/d2e/d41/f9c [149573,21870] 0 2024-09-13T22:56:21.717 INFO:tasks.workunit.client.1.smithi047.stdout:1/902: dread d0/d7/db/f38 [0,4194304] 0 2024-09-13T22:56:21.718 INFO:tasks.workunit.client.0.smithi002.stdout:6/758: write d12/f63 [1615388,32905] 0 2024-09-13T22:56:21.718 INFO:tasks.workunit.client.1.smithi047.stdout:7/753: creat d0/db/de8/ff9 x:0 0 0 2024-09-13T22:56:21.718 INFO:tasks.workunit.client.1.smithi047.stdout:1/903: write d0/d7/d14/d57/d62/d76/fcb [1076402,32659] 0 2024-09-13T22:56:21.719 INFO:tasks.workunit.client.1.smithi047.stdout:4/891: fdatasync dc/d29/fe4 0 2024-09-13T22:56:21.721 INFO:tasks.workunit.client.1.smithi047.stdout:3/832: mknod d0/d3/d4/d16/d32/d42/d79/c105 0 2024-09-13T22:56:21.723 INFO:tasks.workunit.client.0.smithi002.stdout:1/807: chown d1/d13/d21/d39/d70/d10c/d3d/d5d/f37 2 1 2024-09-13T22:56:21.723 INFO:tasks.workunit.client.0.smithi002.stdout:0/741: symlink d1/d7e/d9d/l10c 0 2024-09-13T22:56:21.724 INFO:tasks.workunit.client.0.smithi002.stdout:6/759: dwrite d12/fc1 [0,4194304] 0 2024-09-13T22:56:21.726 INFO:tasks.workunit.client.0.smithi002.stdout:7/701: rename d8/d10/d39/d60/db8/d26/c31 to d8/d10/d11/d3a/cd0 0 2024-09-13T22:56:21.728 INFO:tasks.workunit.client.1.smithi047.stdout:2/820: rename d1/df/d1d/d20/cde to d1/df/d1d/d20/d29/dcd/c111 0 2024-09-13T22:56:21.732 INFO:tasks.workunit.client.0.smithi002.stdout:2/755: creat d1/d7/d8/d4f/f103 x:0 0 0 2024-09-13T22:56:21.735 INFO:tasks.workunit.client.1.smithi047.stdout:6/808: write d3/d11/d2b/d76/ff9 [1424448,45074] 0 2024-09-13T22:56:21.736 INFO:tasks.workunit.client.1.smithi047.stdout:1/904: unlink d0/d7/d13/d2d/l45 0 2024-09-13T22:56:21.738 INFO:tasks.workunit.client.0.smithi002.stdout:4/705: creat d3/d14/d29/d2a/fe5 x:0 0 0 2024-09-13T22:56:21.739 INFO:tasks.workunit.client.1.smithi047.stdout:5/692: write d19/d23/d2e/d41/f9c [826094,75939] 0 2024-09-13T22:56:21.743 INFO:tasks.workunit.client.0.smithi002.stdout:6/760: mknod d12/cef 0 2024-09-13T22:56:21.744 INFO:tasks.workunit.client.0.smithi002.stdout:5/740: dread d1/d10/f51 [0,4194304] 0 2024-09-13T22:56:21.745 INFO:tasks.workunit.client.1.smithi047.stdout:3/833: creat d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/f106 x:0 0 0 2024-09-13T22:56:21.747 INFO:tasks.workunit.client.1.smithi047.stdout:7/754: dwrite d0/d19/fc2 [0,4194304] 0 2024-09-13T22:56:21.748 INFO:tasks.workunit.client.1.smithi047.stdout:3/834: fdatasync d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/f49 0 2024-09-13T22:56:21.748 INFO:tasks.workunit.client.0.smithi002.stdout:8/766: rename d3/d27/le0 to d3/d21/d57/da1/lf2 0 2024-09-13T22:56:21.749 INFO:tasks.workunit.client.0.smithi002.stdout:8/767: write d3/dc/d16/d60/f74 [2676692,83392] 0 2024-09-13T22:56:21.750 INFO:tasks.workunit.client.1.smithi047.stdout:9/760: truncate d1/dc/d14/dd/d4c/df2/f48 3294004 0 2024-09-13T22:56:21.751 INFO:tasks.workunit.client.1.smithi047.stdout:9/761: readlink d1/dc/d14/l3d 0 2024-09-13T22:56:21.753 INFO:tasks.workunit.client.1.smithi047.stdout:8/778: rename d8/fc to d8/d64/d4e/d4d/d8f/d91/d40/f10e 0 2024-09-13T22:56:21.753 INFO:tasks.workunit.client.0.smithi002.stdout:3/806: sync 2024-09-13T22:56:21.755 INFO:tasks.workunit.client.1.smithi047.stdout:2/821: creat d1/d8a/f112 x:0 0 0 2024-09-13T22:56:21.762 INFO:tasks.workunit.client.0.smithi002.stdout:4/706: rmdir d3/d14/d29/d2a/da6/d9f 39 2024-09-13T22:56:21.768 INFO:tasks.workunit.client.0.smithi002.stdout:6/761: creat d12/d17/ddf/ff0 x:0 0 0 2024-09-13T22:56:21.769 INFO:tasks.workunit.client.0.smithi002.stdout:5/741: mkdir d1/d2a/d6b/d88/d45/d4f/db7/d112 0 2024-09-13T22:56:21.771 INFO:tasks.workunit.client.0.smithi002.stdout:9/827: truncate d8/d91/da3/db9/dfa/fa2 6218414 0 2024-09-13T22:56:21.772 INFO:tasks.workunit.client.0.smithi002.stdout:0/742: link d1/d4/da3/d7d/f9a d1/df6/f10d 0 2024-09-13T22:56:21.773 INFO:tasks.workunit.client.1.smithi047.stdout:6/809: write d3/d11/d2b/d4c/fcc [236145,72773] 0 2024-09-13T22:56:21.779 INFO:tasks.workunit.client.0.smithi002.stdout:8/768: symlink d3/d21/d57/da1/dbc/lf3 0 2024-09-13T22:56:21.781 INFO:tasks.workunit.client.0.smithi002.stdout:7/702: creat d8/d10/d39/d60/db8/d26/d4c/d81/db5/fd1 x:0 0 0 2024-09-13T22:56:21.781 INFO:tasks.workunit.client.0.smithi002.stdout:7/703: readlink d8/d10/d39/d60/db8/d2e/d3c/l7b 0 2024-09-13T22:56:21.783 INFO:tasks.workunit.client.0.smithi002.stdout:7/704: chown d8/d10/d39/d60/db8/d26/d38/la8 92848082 1 2024-09-13T22:56:21.786 INFO:tasks.workunit.client.1.smithi047.stdout:8/779: rmdir d8/d64/d4e/d4d 39 2024-09-13T22:56:21.787 INFO:tasks.workunit.client.1.smithi047.stdout:8/780: readlink d8/l24 0 2024-09-13T22:56:21.790 INFO:tasks.workunit.client.1.smithi047.stdout:1/905: mkdir d0/d7/d14/d107 0 2024-09-13T22:56:21.792 INFO:tasks.workunit.client.1.smithi047.stdout:4/892: link dc/d29/d4d/ca2 dc/d29/d8e/c133 0 2024-09-13T22:56:21.794 INFO:tasks.workunit.client.1.smithi047.stdout:5/693: symlink d19/d23/d2e/dba/lda 0 2024-09-13T22:56:21.796 INFO:tasks.workunit.client.1.smithi047.stdout:7/755: creat d0/d7/da/d1e/d93/ddf/ffa x:0 0 0 2024-09-13T22:56:21.798 INFO:tasks.workunit.client.0.smithi002.stdout:3/807: dwrite d9/d15/f2f [0,4194304] 0 2024-09-13T22:56:21.802 INFO:tasks.workunit.client.1.smithi047.stdout:3/835: mknod d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/c107 0 2024-09-13T22:56:21.804 INFO:tasks.workunit.client.1.smithi047.stdout:3/836: readlink d0/d3/d4/d16/d2c/de/d1f/d2e/l5d 0 2024-09-13T22:56:21.808 INFO:tasks.workunit.client.1.smithi047.stdout:4/893: rmdir dc/de/d23/d40 39 2024-09-13T22:56:21.813 INFO:tasks.workunit.client.1.smithi047.stdout:7/756: rmdir d0/d7/da/d2e/d64 39 2024-09-13T22:56:21.813 INFO:tasks.workunit.client.1.smithi047.stdout:5/694: dread d19/d34/d42/f48 [0,4194304] 0 2024-09-13T22:56:21.814 INFO:tasks.workunit.client.1.smithi047.stdout:1/906: dread d0/fb2 [0,4194304] 0 2024-09-13T22:56:21.817 INFO:tasks.workunit.client.1.smithi047.stdout:6/810: dwrite d3/d11/d2b/d1c/d4d/d69/fb1 [0,4194304] 0 2024-09-13T22:56:21.819 INFO:tasks.workunit.client.1.smithi047.stdout:8/781: getdents d8/d77/df3 0 2024-09-13T22:56:21.819 INFO:tasks.workunit.client.1.smithi047.stdout:6/811: write d3/d11/d2b/d4c/d30/f72 [3938219,65227] 0 2024-09-13T22:56:21.826 INFO:tasks.workunit.client.1.smithi047.stdout:5/695: symlink d19/d23/d4c/ldb 0 2024-09-13T22:56:21.828 INFO:tasks.workunit.client.1.smithi047.stdout:1/907: dread - d0/d7/d14/d57/d62/d8a/ffb zero size 2024-09-13T22:56:21.829 INFO:tasks.workunit.client.1.smithi047.stdout:9/762: getdents d1/dc/d14/dd/d4c/df2 0 2024-09-13T22:56:21.832 INFO:tasks.workunit.client.1.smithi047.stdout:7/757: rename d0/d7/da/d4e/ce4 to d0/d7/da/d47/d92/cfb 0 2024-09-13T22:56:21.835 INFO:tasks.workunit.client.1.smithi047.stdout:8/782: mkdir d8/d6b/dce/d10f 0 2024-09-13T22:56:21.836 INFO:tasks.workunit.client.1.smithi047.stdout:6/812: creat d3/d11/d2b/d1c/d4d/f106 x:0 0 0 2024-09-13T22:56:21.841 INFO:tasks.workunit.client.0.smithi002.stdout:1/808: creat d1/d13/d21/f118 x:0 0 0 2024-09-13T22:56:21.841 INFO:tasks.workunit.client.0.smithi002.stdout:1/809: readlink d1/d13/d30/d73/lb4 0 2024-09-13T22:56:21.843 INFO:tasks.workunit.client.0.smithi002.stdout:1/810: write d1/d13/d21/d39/d70/d10c/d3d/d5d/fc3 [785589,23852] 0 2024-09-13T22:56:21.844 INFO:tasks.workunit.client.0.smithi002.stdout:1/811: fdatasync d1/d13/d30/d73/da1/d9d/dbd/dd8/fe8 0 2024-09-13T22:56:21.845 INFO:tasks.workunit.client.0.smithi002.stdout:5/742: read d1/d2a/d69/fa4 [163995,112029] 0 2024-09-13T22:56:21.846 INFO:tasks.workunit.client.0.smithi002.stdout:1/812: read d1/d13/d21/d39/d70/d10c/fa8 [639074,55633] 0 2024-09-13T22:56:21.847 INFO:tasks.workunit.client.0.smithi002.stdout:9/828: rmdir d8/d10/d1c/dd6/dda 39 2024-09-13T22:56:21.849 INFO:tasks.workunit.client.1.smithi047.stdout:8/783: truncate d8/f9e 1049311 0 2024-09-13T22:56:21.849 INFO:tasks.workunit.client.1.smithi047.stdout:9/763: dread d1/dc/fbd [0,4194304] 0 2024-09-13T22:56:21.854 INFO:tasks.workunit.client.1.smithi047.stdout:9/764: dread d1/dc/d14/dd/d54/d50/d5b/d9e/f81 [0,4194304] 0 2024-09-13T22:56:21.854 INFO:tasks.workunit.client.0.smithi002.stdout:7/705: sync 2024-09-13T22:56:21.857 INFO:tasks.workunit.client.1.smithi047.stdout:1/908: write d0/d7/d14/d57/f9e [822647,7284] 0 2024-09-13T22:56:21.861 INFO:tasks.workunit.client.1.smithi047.stdout:7/758: dread d0/d7/da/d1e/d93/f96 [0,4194304] 0 2024-09-13T22:56:21.861 INFO:tasks.workunit.client.0.smithi002.stdout:7/706: dwrite d8/fae [0,4194304] 0 2024-09-13T22:56:21.861 INFO:tasks.workunit.client.1.smithi047.stdout:5/696: dwrite d19/d23/d4c/fa1 [0,4194304] 0 2024-09-13T22:56:21.863 INFO:tasks.workunit.client.0.smithi002.stdout:8/769: dwrite d3/dc/d16/f4d [0,4194304] 0 2024-09-13T22:56:21.864 INFO:tasks.workunit.client.0.smithi002.stdout:7/707: readlink d8/d10/d39/d60/db8/d2e/d50/d52/l6d 0 2024-09-13T22:56:21.866 INFO:tasks.workunit.client.0.smithi002.stdout:5/743: write d1/d10/f50 [6373982,125873] 0 2024-09-13T22:56:21.870 INFO:tasks.workunit.client.0.smithi002.stdout:1/813: fdatasync d1/fde 0 2024-09-13T22:56:21.871 INFO:tasks.workunit.client.0.smithi002.stdout:6/762: write d12/d17/d34/f73 [4159622,45227] 0 2024-09-13T22:56:21.873 INFO:tasks.workunit.client.0.smithi002.stdout:9/829: creat d8/d2c/dbc/d103/f117 x:0 0 0 2024-09-13T22:56:21.874 INFO:tasks.workunit.client.0.smithi002.stdout:0/743: truncate d1/d4/d75/d31/fbc 3349664 0 2024-09-13T22:56:21.876 INFO:tasks.workunit.client.0.smithi002.stdout:8/770: dwrite d3/dc/d16/d2f/d83/d85/fdd [0,4194304] 0 2024-09-13T22:56:21.878 INFO:tasks.workunit.client.1.smithi047.stdout:8/784: symlink d8/d64/d4e/d70/da7/de0/l110 0 2024-09-13T22:56:21.883 INFO:tasks.workunit.client.1.smithi047.stdout:4/894: getdents dc/de/d23/d40/d7b/dab/dae 0 2024-09-13T22:56:21.885 INFO:tasks.workunit.client.1.smithi047.stdout:6/813: link d3/d11/lfa d3/d11/d2b/d1c/dbd/l107 0 2024-09-13T22:56:21.886 INFO:tasks.workunit.client.1.smithi047.stdout:6/814: readlink d3/d11/d2b/d4c/d9d/dac/ld6 0 2024-09-13T22:56:21.886 INFO:tasks.workunit.client.0.smithi002.stdout:7/708: creat d8/d10/d39/d60/fd2 x:0 0 0 2024-09-13T22:56:21.887 INFO:tasks.workunit.client.1.smithi047.stdout:6/815: chown d3/d11/d2b/d4c/fcc 55 1 2024-09-13T22:56:21.889 INFO:tasks.workunit.client.1.smithi047.stdout:9/765: creat d1/dc/d14/dd/d54/d8d/dbc/fff x:0 0 0 2024-09-13T22:56:21.893 INFO:tasks.workunit.client.0.smithi002.stdout:8/771: dread d3/f5 [4194304,4194304] 0 2024-09-13T22:56:21.894 INFO:tasks.workunit.client.1.smithi047.stdout:1/909: rename d0/d7/d13/f56 to d0/d7/d14/d57/d62/d76/d94/f108 0 2024-09-13T22:56:21.896 INFO:tasks.workunit.client.1.smithi047.stdout:5/697: write d19/d23/f6a [759160,109946] 0 2024-09-13T22:56:21.899 INFO:tasks.workunit.client.0.smithi002.stdout:3/808: dwrite d9/d3b/d53/d83/dda/fde [0,4194304] 0 2024-09-13T22:56:21.901 INFO:tasks.workunit.client.0.smithi002.stdout:2/756: rename d1/d32/feb to d1/d7/d35/d78/dfc/d6b/f104 0 2024-09-13T22:56:21.902 INFO:tasks.workunit.client.1.smithi047.stdout:4/895: rmdir dc/d29/d6c 39 2024-09-13T22:56:21.902 INFO:tasks.workunit.client.1.smithi047.stdout:7/759: dwrite d0/d7/f3e [4194304,4194304] 0 2024-09-13T22:56:21.903 INFO:tasks.workunit.client.0.smithi002.stdout:6/763: creat d12/d17/d34/d39/ff1 x:0 0 0 2024-09-13T22:56:21.904 INFO:tasks.workunit.client.0.smithi002.stdout:2/757: dread - d1/d7/d35/d78/dfc/d6b/d75/fc1 zero size 2024-09-13T22:56:21.904 INFO:tasks.workunit.client.1.smithi047.stdout:1/910: dwrite d0/d7/d14/d57/f9e [0,4194304] 0 2024-09-13T22:56:21.905 INFO:tasks.workunit.client.1.smithi047.stdout:6/816: creat d3/d77/d8f/db9/f108 x:0 0 0 2024-09-13T22:56:21.907 INFO:tasks.workunit.client.1.smithi047.stdout:6/817: chown d3/d11/d2b/fe4 462306895 1 2024-09-13T22:56:21.907 INFO:tasks.workunit.client.0.smithi002.stdout:0/744: creat d1/d4/d75/d31/d32/dbb/de1/f10e x:0 0 0 2024-09-13T22:56:21.908 INFO:tasks.workunit.client.1.smithi047.stdout:9/766: symlink d1/dd2/l100 0 2024-09-13T22:56:21.908 INFO:tasks.workunit.client.0.smithi002.stdout:5/744: dwrite d1/d2a/d69/f92 [0,4194304] 0 2024-09-13T22:56:21.910 INFO:tasks.workunit.client.0.smithi002.stdout:5/745: readlink d1/d2a/d6b/d88/d45/d4f/db7/lcc 0 2024-09-13T22:56:21.913 INFO:tasks.workunit.client.1.smithi047.stdout:5/698: creat d19/d23/d2e/d41/fdc x:0 0 0 2024-09-13T22:56:21.915 INFO:tasks.workunit.client.0.smithi002.stdout:8/772: mkdir d3/dc/d18/d2e/df4 0 2024-09-13T22:56:21.917 INFO:tasks.workunit.client.0.smithi002.stdout:8/773: read d3/dc/f42 [5059310,19602] 0 2024-09-13T22:56:21.921 INFO:tasks.workunit.client.1.smithi047.stdout:1/911: rmdir d0/d7/d13/d5d/d89 39 2024-09-13T22:56:21.921 INFO:tasks.workunit.client.1.smithi047.stdout:6/818: creat d3/d11/d2b/d4c/d30/d48/f109 x:0 0 0 2024-09-13T22:56:21.921 INFO:tasks.workunit.client.0.smithi002.stdout:5/746: dwrite d1/ffb [0,4194304] 0 2024-09-13T22:56:21.921 INFO:tasks.workunit.client.0.smithi002.stdout:5/747: chown d1/d2a/d6b/f72 945714 1 2024-09-13T22:56:21.921 INFO:tasks.workunit.client.0.smithi002.stdout:2/758: dread d1/d7/f47 [0,4194304] 0 2024-09-13T22:56:21.925 INFO:tasks.workunit.client.1.smithi047.stdout:6/819: write d3/d11/d2b/d1c/dbd/de8/ff0 [587262,11216] 0 2024-09-13T22:56:21.927 INFO:tasks.workunit.client.1.smithi047.stdout:7/760: dwrite d0/d7/da/d2e/d64/fc3 [4194304,4194304] 0 2024-09-13T22:56:21.927 INFO:tasks.workunit.client.1.smithi047.stdout:9/767: rename d1/dc/d14/dd/d54/d50/d91/da3/def to d1/dc/d14/dd/d54/d50/d5b/d9e/d101 0 2024-09-13T22:56:21.928 INFO:tasks.workunit.client.0.smithi002.stdout:5/748: dwrite d1/d2a/d6b/d88/f4d [0,4194304] 0 2024-09-13T22:56:21.929 INFO:tasks.workunit.client.0.smithi002.stdout:2/759: dwrite d1/f1d [4194304,4194304] 0 2024-09-13T22:56:21.931 INFO:tasks.workunit.client.0.smithi002.stdout:4/707: rename d3/d14/d29/d2a/da6/d69/fc9 to d3/d14/d29/d2a/dbc/fe6 0 2024-09-13T22:56:21.936 INFO:tasks.workunit.client.1.smithi047.stdout:5/699: mkdir d19/d64/ddd 0 2024-09-13T22:56:21.936 INFO:tasks.workunit.client.1.smithi047.stdout:5/700: chown d19/d23 348186762 1 2024-09-13T22:56:21.938 INFO:tasks.workunit.client.1.smithi047.stdout:8/785: write d8/d64/d4e/d4d/d8f/d91/f3c [816016,37264] 0 2024-09-13T22:56:21.941 INFO:tasks.workunit.client.1.smithi047.stdout:4/896: dwrite dc/d29/d4d/fc6 [0,4194304] 0 2024-09-13T22:56:21.944 INFO:tasks.workunit.client.0.smithi002.stdout:1/814: write d1/d13/d21/d39/f9c [1734849,74990] 0 2024-09-13T22:56:21.945 INFO:tasks.workunit.client.0.smithi002.stdout:1/815: fdatasync d1/d13/d21/d39/d70/d10c/d3d/ffd 0 2024-09-13T22:56:21.948 INFO:tasks.workunit.client.1.smithi047.stdout:6/820: creat d3/d11/d2b/d76/daf/f10a x:0 0 0 2024-09-13T22:56:21.951 INFO:tasks.workunit.client.1.smithi047.stdout:9/768: dread d1/dc/d14/dd/d54/d8d/fc0 [0,4194304] 0 2024-09-13T22:56:21.952 INFO:tasks.workunit.client.1.smithi047.stdout:9/769: chown d1/dc/d14/dd/d54/d50/f92 19769 1 2024-09-13T22:56:21.953 INFO:tasks.workunit.client.1.smithi047.stdout:7/761: creat d0/d7/da/d1e/d93/db7/ffc x:0 0 0 2024-09-13T22:56:21.954 INFO:tasks.workunit.client.0.smithi002.stdout:3/809: dwrite d9/dd1/fee [0,4194304] 0 2024-09-13T22:56:21.962 INFO:tasks.workunit.client.0.smithi002.stdout:9/830: creat d8/d10/f118 x:0 0 0 2024-09-13T22:56:21.962 INFO:tasks.workunit.client.1.smithi047.stdout:8/786: creat d8/d64/d4e/d4d/d8f/d91/d38/dc8/f111 x:0 0 0 2024-09-13T22:56:21.965 INFO:tasks.workunit.client.0.smithi002.stdout:2/760: rename d1/d7/f26 to d1/d7/d8/d2c/d9d/dab/dd4/f105 0 2024-09-13T22:56:21.966 INFO:tasks.workunit.client.0.smithi002.stdout:2/761: readlink d1/d4d/d8b/de1/ld5 0 2024-09-13T22:56:21.967 INFO:tasks.workunit.client.1.smithi047.stdout:7/762: creat d0/d57/da6/ffd x:0 0 0 2024-09-13T22:56:21.968 INFO:tasks.workunit.client.0.smithi002.stdout:5/749: unlink d1/d2a/d6b/d88/d45/d4f/d8f/ca2 0 2024-09-13T22:56:21.969 INFO:tasks.workunit.client.1.smithi047.stdout:9/770: creat d1/dc/d14/dd/d54/d50/d5b/d9e/d101/f102 x:0 0 0 2024-09-13T22:56:21.972 INFO:tasks.workunit.client.0.smithi002.stdout:4/708: mknod d3/d14/d29/d2a/da6/d69/d7e/ce7 0 2024-09-13T22:56:21.973 INFO:tasks.workunit.client.1.smithi047.stdout:4/897: dread dc/de/d23/f42 [0,4194304] 0 2024-09-13T22:56:21.975 INFO:tasks.workunit.client.1.smithi047.stdout:4/898: readlink dc/de/d23/d40/d7b/dab/le2 0 2024-09-13T22:56:21.975 INFO:tasks.workunit.client.0.smithi002.stdout:4/709: dread d3/d14/d29/d2a/da6/f31 [0,4194304] 0 2024-09-13T22:56:21.977 INFO:tasks.workunit.client.0.smithi002.stdout:7/709: creat d8/d10/d39/fd3 x:0 0 0 2024-09-13T22:56:21.978 INFO:tasks.workunit.client.1.smithi047.stdout:7/763: symlink d0/d7/da/d1e/d93/db7/lfe 0 2024-09-13T22:56:21.979 INFO:tasks.workunit.client.0.smithi002.stdout:1/816: dread d1/d13/d1d/d34/f6f [0,4194304] 0 2024-09-13T22:56:21.980 INFO:tasks.workunit.client.1.smithi047.stdout:9/771: mknod d1/dc/d14/dd/d4c/df2/d82/c103 0 2024-09-13T22:56:21.982 INFO:tasks.workunit.client.0.smithi002.stdout:1/817: fdatasync d1/d13/d1d/d34/d51/dc6/ff5 0 2024-09-13T22:56:21.983 INFO:tasks.workunit.client.1.smithi047.stdout:9/772: write d1/dc/d14/f4d [392103,78374] 0 2024-09-13T22:56:21.984 INFO:tasks.workunit.client.1.smithi047.stdout:5/701: rmdir d19/d23/d2e/d41/d58/dce 0 2024-09-13T22:56:21.985 INFO:tasks.workunit.client.1.smithi047.stdout:5/702: stat d19/d64/fbc 0 2024-09-13T22:56:21.985 INFO:tasks.workunit.client.1.smithi047.stdout:5/703: chown c18 0 1 2024-09-13T22:56:21.988 INFO:tasks.workunit.client.1.smithi047.stdout:6/821: rename d3/d11/d2b/d4c/d30 to d3/d2c/d10b 0 2024-09-13T22:56:21.988 INFO:tasks.workunit.client.0.smithi002.stdout:4/710: dread d3/d14/d29/d2a/dbc/fe6 [0,4194304] 0 2024-09-13T22:56:21.989 INFO:tasks.workunit.client.1.smithi047.stdout:6/822: chown d3/l6a 0 1 2024-09-13T22:56:21.990 INFO:tasks.workunit.client.0.smithi002.stdout:3/810: rmdir d9/d3b/d53/d95 39 2024-09-13T22:56:21.991 INFO:tasks.workunit.client.1.smithi047.stdout:8/787: truncate d8/d64/d4e/d4d/d8f/d91/f96 36806 0 2024-09-13T22:56:21.991 INFO:tasks.workunit.client.0.smithi002.stdout:6/764: write d12/d17/d28/f2f [1022141,77071] 0 2024-09-13T22:56:21.992 INFO:tasks.workunit.client.0.smithi002.stdout:1/818: dread d1/d13/d1d/f29 [0,4194304] 0 2024-09-13T22:56:21.992 INFO:tasks.workunit.client.0.smithi002.stdout:8/774: symlink d3/dc/d16/d2f/lf5 0 2024-09-13T22:56:21.994 INFO:tasks.workunit.client.1.smithi047.stdout:9/773: dread d1/dc/d14/f16 [0,4194304] 0 2024-09-13T22:56:21.994 INFO:tasks.workunit.client.0.smithi002.stdout:6/765: truncate d12/d17/d28/d67/d6b/daa/dc6/fe0 362543 0 2024-09-13T22:56:21.995 INFO:tasks.workunit.client.1.smithi047.stdout:9/774: dread - d1/dc/d14/dd/d54/d8d/fd9 zero size 2024-09-13T22:56:21.997 INFO:tasks.workunit.client.1.smithi047.stdout:7/764: creat d0/d57/d5b/d5c/db6/df3/fff x:0 0 0 2024-09-13T22:56:22.001 INFO:tasks.workunit.client.0.smithi002.stdout:2/762: creat d1/da9/f106 x:0 0 0 2024-09-13T22:56:22.004 INFO:tasks.workunit.client.0.smithi002.stdout:5/750: truncate d1/d10/f51 3455432 0 2024-09-13T22:56:22.005 INFO:tasks.workunit.client.0.smithi002.stdout:4/711: dread d3/d14/d29/d2a/fa3 [0,4194304] 0 2024-09-13T22:56:22.007 INFO:tasks.workunit.client.1.smithi047.stdout:4/899: write dc/de/d23/d40/fd4 [4967026,120620] 0 2024-09-13T22:56:22.008 INFO:tasks.workunit.client.1.smithi047.stdout:8/788: rmdir d8/d64/d4e/d4d/d8f/d91/d38/dbe 39 2024-09-13T22:56:22.008 INFO:tasks.workunit.client.1.smithi047.stdout:4/900: stat dc/de/d23/f99 0 2024-09-13T22:56:22.011 INFO:tasks.workunit.client.1.smithi047.stdout:9/775: creat d1/dc/d14/dd/d54/d50/d60/f104 x:0 0 0 2024-09-13T22:56:22.014 INFO:tasks.workunit.client.0.smithi002.stdout:9/831: dwrite d8/d1e/fb8 [0,4194304] 0 2024-09-13T22:56:22.014 INFO:tasks.workunit.client.1.smithi047.stdout:7/765: creat d0/d7/da/d4e/f100 x:0 0 0 2024-09-13T22:56:22.016 INFO:tasks.workunit.client.1.smithi047.stdout:7/766: fdatasync d0/f29 0 2024-09-13T22:56:22.018 INFO:tasks.workunit.client.0.smithi002.stdout:3/811: dread - d9/d91/fab zero size 2024-09-13T22:56:22.018 INFO:tasks.workunit.client.0.smithi002.stdout:3/812: readlink d9/d15/d51/l45 0 2024-09-13T22:56:22.020 INFO:tasks.workunit.client.1.smithi047.stdout:6/823: mknod d3/d11/d2b/c10c 0 2024-09-13T22:56:22.022 INFO:tasks.workunit.client.1.smithi047.stdout:5/704: dwrite d19/d23/d4c/fa4 [0,4194304] 0 2024-09-13T22:56:22.022 INFO:tasks.workunit.client.0.smithi002.stdout:8/775: rmdir d3/dc/d16/d60 39 2024-09-13T22:56:22.024 INFO:tasks.workunit.client.1.smithi047.stdout:9/776: dwrite d1/dc/d14/dd/d54/d8d/fd9 [0,4194304] 0 2024-09-13T22:56:22.024 INFO:tasks.workunit.client.1.smithi047.stdout:5/705: read - d19/d23/fc7 zero size 2024-09-13T22:56:22.030 INFO:tasks.workunit.client.0.smithi002.stdout:6/766: mkdir d12/d17/d28/d7d/df2 0 2024-09-13T22:56:22.031 INFO:tasks.workunit.client.0.smithi002.stdout:6/767: fsync d12/d17/f18 0 2024-09-13T22:56:22.031 INFO:tasks.workunit.client.1.smithi047.stdout:5/706: dwrite d19/d23/d4c/f52 [0,4194304] 0 2024-09-13T22:56:22.032 INFO:tasks.workunit.client.0.smithi002.stdout:6/768: chown d12/d17/d4e/fc9 0 1 2024-09-13T22:56:22.035 INFO:tasks.workunit.client.1.smithi047.stdout:7/767: mknod d0/da2/c101 0 2024-09-13T22:56:22.035 INFO:tasks.workunit.client.0.smithi002.stdout:4/712: write d3/d14/d29/d2a/fd4 [109461,79825] 0 2024-09-13T22:56:22.037 INFO:tasks.workunit.client.0.smithi002.stdout:4/713: read - d3/d40/fdb zero size 2024-09-13T22:56:22.037 INFO:tasks.workunit.client.1.smithi047.stdout:5/707: dread d19/d25/d45/f4d [0,4194304] 0 2024-09-13T22:56:22.038 INFO:tasks.workunit.client.0.smithi002.stdout:5/751: creat d1/d2a/d6b/d88/d55/d56/d86/d100/f113 x:0 0 0 2024-09-13T22:56:22.039 INFO:tasks.workunit.client.0.smithi002.stdout:1/819: write d1/d13/d1d/f6c [3906407,84520] 0 2024-09-13T22:56:22.042 INFO:tasks.workunit.client.0.smithi002.stdout:5/752: read d1/d2a/d6b/d88/d45/f8a [594092,18643] 0 2024-09-13T22:56:22.042 INFO:tasks.workunit.client.0.smithi002.stdout:0/745: getdents d1/d7e 0 2024-09-13T22:56:22.042 INFO:tasks.workunit.client.0.smithi002.stdout:8/776: dread d3/dc/d51/f4c [0,4194304] 0 2024-09-13T22:56:22.043 INFO:tasks.workunit.client.0.smithi002.stdout:8/777: readlink d3/d27/d39/ld8 0 2024-09-13T22:56:22.044 INFO:tasks.workunit.client.0.smithi002.stdout:9/832: rmdir d8/d10/d1c/dbf 39 2024-09-13T22:56:22.048 INFO:tasks.workunit.client.1.smithi047.stdout:8/789: creat d8/d64/d4e/f112 x:0 0 0 2024-09-13T22:56:22.050 INFO:tasks.workunit.client.1.smithi047.stdout:8/790: readlink d8/d64/d4e/d4d/d8f/d91/d38/l69 0 2024-09-13T22:56:22.055 INFO:tasks.workunit.client.1.smithi047.stdout:5/708: creat d19/d25/d85/dc5/fde x:0 0 0 2024-09-13T22:56:22.056 INFO:tasks.workunit.client.1.smithi047.stdout:9/777: dread d1/dc/d14/dd/d54/d8d/fcb [4194304,4194304] 0 2024-09-13T22:56:22.062 INFO:tasks.workunit.client.0.smithi002.stdout:4/714: fsync d3/fb 0 2024-09-13T22:56:22.063 INFO:tasks.workunit.client.1.smithi047.stdout:6/824: write d3/d2c/d10b/d48/f7d [3666447,126588] 0 2024-09-13T22:56:22.064 INFO:tasks.workunit.client.0.smithi002.stdout:4/715: write d3/d40/f70 [710212,32494] 0 2024-09-13T22:56:22.064 INFO:tasks.workunit.client.1.smithi047.stdout:9/778: mkdir d1/dc/d14/dd/d54/d8d/d105 0 2024-09-13T22:56:22.066 INFO:tasks.workunit.client.1.smithi047.stdout:4/901: dread dc/f2f [0,4194304] 0 2024-09-13T22:56:22.068 INFO:tasks.workunit.client.0.smithi002.stdout:0/746: creat d1/d2/d6c/f10f x:0 0 0 2024-09-13T22:56:22.068 INFO:tasks.workunit.client.0.smithi002.stdout:9/833: mkdir d8/d2c/dbc/d119 0 2024-09-13T22:56:22.069 INFO:tasks.workunit.client.0.smithi002.stdout:9/834: stat d8/d91/da3/db9/dfa/d87/da5/l89 0 2024-09-13T22:56:22.070 INFO:tasks.workunit.client.1.smithi047.stdout:6/825: creat d3/d11/d2b/d1c/dbd/de8/f10d x:0 0 0 2024-09-13T22:56:22.070 INFO:tasks.workunit.client.0.smithi002.stdout:9/835: fsync d8/d1e/fb8 0 2024-09-13T22:56:22.071 INFO:tasks.workunit.client.1.smithi047.stdout:6/826: fsync d3/d2c/d10b/d48/f109 0 2024-09-13T22:56:22.073 INFO:tasks.workunit.client.0.smithi002.stdout:5/753: rename d1/d2a/d69/ce3 to d1/d108/c114 0 2024-09-13T22:56:22.074 INFO:tasks.workunit.client.0.smithi002.stdout:5/754: stat d1/d2a/d6b/d88/d45/d4f/d78/f79 0 2024-09-13T22:56:22.076 INFO:tasks.workunit.client.1.smithi047.stdout:8/791: dread d8/d3f/d8c/fab [0,4194304] 0 2024-09-13T22:56:22.077 INFO:tasks.workunit.client.1.smithi047.stdout:9/779: mkdir d1/dc/d14/dd/d54/d50/d5b/d106 0 2024-09-13T22:56:22.078 INFO:tasks.workunit.client.0.smithi002.stdout:2/763: truncate d1/d7/d35/d78/dfc/fcb 1132542 0 2024-09-13T22:56:22.080 INFO:tasks.workunit.client.1.smithi047.stdout:5/709: write d19/f36 [2188011,124574] 0 2024-09-13T22:56:22.081 INFO:tasks.workunit.client.1.smithi047.stdout:5/710: dread - d19/d64/fbc zero size 2024-09-13T22:56:22.089 INFO:tasks.workunit.client.1.smithi047.stdout:4/902: write dc/de/d23/dc4/f47 [1047454,31214] 0 2024-09-13T22:56:22.092 INFO:tasks.workunit.client.1.smithi047.stdout:5/711: chown cc 662132 1 2024-09-13T22:56:22.093 INFO:tasks.workunit.client.1.smithi047.stdout:5/712: chown d19/d23/d2e/d41/fdc 623604038 1 2024-09-13T22:56:22.093 INFO:tasks.workunit.client.1.smithi047.stdout:8/792: stat d8/d64/d4e/d4d/d8f/d91/d40/f59 0 2024-09-13T22:56:22.094 INFO:tasks.workunit.client.1.smithi047.stdout:9/780: write d1/dc/d14/dd/d54/f37 [1316354,58450] 0 2024-09-13T22:56:22.094 INFO:tasks.workunit.client.0.smithi002.stdout:7/710: link d8/d10/d11/d3a/cd0 d8/d10/d39/d60/db8/d26/d4c/d81/d46/cd4 0 2024-09-13T22:56:22.096 INFO:tasks.workunit.client.1.smithi047.stdout:6/827: truncate d3/d11/d2b/d1c/d4d/fa6 1270580 0 2024-09-13T22:56:22.097 INFO:tasks.workunit.client.0.smithi002.stdout:7/711: read d8/d10/d39/d60/db8/d26/d4c/d81/f54 [874699,11943] 0 2024-09-13T22:56:22.100 INFO:tasks.workunit.client.0.smithi002.stdout:5/755: creat d1/d2a/d6b/d88/d45/d4f/d78/d8b/ddb/f115 x:0 0 0 2024-09-13T22:56:22.102 INFO:tasks.workunit.client.1.smithi047.stdout:6/828: dwrite d3/f105 [0,4194304] 0 2024-09-13T22:56:22.103 INFO:tasks.workunit.client.0.smithi002.stdout:3/813: creat d9/d15/f11d x:0 0 0 2024-09-13T22:56:22.104 INFO:tasks.workunit.client.1.smithi047.stdout:6/829: stat d3/d11/d2b/d4c/c1a 0 2024-09-13T22:56:22.106 INFO:tasks.workunit.client.1.smithi047.stdout:4/903: write dc/de/d23/f42 [2455501,83593] 0 2024-09-13T22:56:22.107 INFO:tasks.workunit.client.0.smithi002.stdout:6/769: link d12/d17/d28/fcf d12/d17/d28/d67/ff3 0 2024-09-13T22:56:22.110 INFO:tasks.workunit.client.0.smithi002.stdout:2/764: truncate d1/d4d/f56 2330091 0 2024-09-13T22:56:22.111 INFO:tasks.workunit.client.0.smithi002.stdout:4/716: fdatasync d3/f1e 0 2024-09-13T22:56:22.111 INFO:tasks.workunit.client.1.smithi047.stdout:8/793: write d8/d77/fb3 [2161855,65192] 0 2024-09-13T22:56:22.115 INFO:tasks.workunit.client.0.smithi002.stdout:9/836: getdents d8/d2c/dbc/d119 0 2024-09-13T22:56:22.117 INFO:tasks.workunit.client.0.smithi002.stdout:9/837: dread - d8/d10/d1c/d68/fe7 zero size 2024-09-13T22:56:22.118 INFO:tasks.workunit.client.1.smithi047.stdout:4/904: fsync dc/de/d17/d25/d9b/fbf 0 2024-09-13T22:56:22.120 INFO:tasks.workunit.client.1.smithi047.stdout:9/781: mkdir d1/d5f/de9/d107 0 2024-09-13T22:56:22.125 INFO:tasks.workunit.client.1.smithi047.stdout:9/782: write d1/dc/d14/f4d [1095557,39315] 0 2024-09-13T22:56:22.125 INFO:tasks.workunit.client.1.smithi047.stdout:9/783: chown d1/dc/d14/dd/d54/d8d/dbc 1056555662 1 2024-09-13T22:56:22.125 INFO:tasks.workunit.client.0.smithi002.stdout:9/838: dwrite d8/d10/d61/f81 [0,4194304] 0 2024-09-13T22:56:22.127 INFO:tasks.workunit.client.1.smithi047.stdout:8/794: rename d8/d64/d4e/l82 to d8/d77/df3/l113 0 2024-09-13T22:56:22.127 INFO:tasks.workunit.client.0.smithi002.stdout:0/747: truncate d1/d2/f1d 2950248 0 2024-09-13T22:56:22.128 INFO:tasks.workunit.client.0.smithi002.stdout:0/748: chown d1/d4/d75/d76 4158 1 2024-09-13T22:56:22.132 INFO:tasks.workunit.client.0.smithi002.stdout:6/770: symlink d12/d17/d4e/lf4 0 2024-09-13T22:56:22.133 INFO:tasks.workunit.client.0.smithi002.stdout:6/771: dread - d12/d17/d34/d4b/fa0 zero size 2024-09-13T22:56:22.137 INFO:tasks.workunit.client.0.smithi002.stdout:7/712: dread d8/d10/d39/d60/db8/f34 [0,4194304] 0 2024-09-13T22:56:22.137 INFO:tasks.workunit.client.0.smithi002.stdout:4/717: creat d3/d14/d29/d2a/da6/d69/fe8 x:0 0 0 2024-09-13T22:56:22.139 INFO:tasks.workunit.client.0.smithi002.stdout:7/713: write d8/d10/d39/d60/db8/d26/d4c/f4e [1073481,108185] 0 2024-09-13T22:56:22.140 INFO:tasks.workunit.client.1.smithi047.stdout:9/784: creat d1/dc/d14/dd/d54/d50/d91/f108 x:0 0 0 2024-09-13T22:56:22.144 INFO:tasks.workunit.client.1.smithi047.stdout:8/795: symlink d8/d6b/dfc/l114 0 2024-09-13T22:56:22.146 INFO:tasks.workunit.client.1.smithi047.stdout:5/713: getdents d19/d23/d2e/d41/d58/dbf 0 2024-09-13T22:56:22.146 INFO:tasks.workunit.client.1.smithi047.stdout:8/796: dread d8/d6b/fbb [0,4194304] 0 2024-09-13T22:56:22.147 INFO:tasks.workunit.client.0.smithi002.stdout:3/814: mkdir d9/d3b/d53/db9/df2/d11e 0 2024-09-13T22:56:22.148 INFO:tasks.workunit.client.0.smithi002.stdout:3/815: chown d9/d15/d26 737 1 2024-09-13T22:56:22.149 INFO:tasks.workunit.client.0.smithi002.stdout:0/749: creat d1/d4/da3/d7d/f110 x:0 0 0 2024-09-13T22:56:22.152 INFO:tasks.workunit.client.1.smithi047.stdout:4/905: creat dc/de/d17/d25/d4a/d11c/d12a/f134 x:0 0 0 2024-09-13T22:56:22.153 INFO:tasks.workunit.client.0.smithi002.stdout:7/714: dread d8/f27 [0,4194304] 0 2024-09-13T22:56:22.153 INFO:tasks.workunit.client.0.smithi002.stdout:2/765: symlink d1/d7/d35/l107 0 2024-09-13T22:56:22.154 INFO:tasks.workunit.client.0.smithi002.stdout:7/715: write d8/d10/f32 [1994195,56166] 0 2024-09-13T22:56:22.154 INFO:tasks.workunit.client.0.smithi002.stdout:2/766: write d1/d7/d41/f7a [3957206,4083] 0 2024-09-13T22:56:22.156 INFO:tasks.workunit.client.0.smithi002.stdout:7/716: stat d8/d10/d39/d60/c6a 0 2024-09-13T22:56:22.156 INFO:tasks.workunit.client.0.smithi002.stdout:2/767: dread - d1/d7/d35/d78/dfc/d6b/d75/fc1 zero size 2024-09-13T22:56:22.157 INFO:tasks.workunit.client.0.smithi002.stdout:7/717: write d8/d10/d39/d60/db8/f21 [3522369,95515] 0 2024-09-13T22:56:22.158 INFO:tasks.workunit.client.0.smithi002.stdout:6/772: write d12/f5d [2148902,71102] 0 2024-09-13T22:56:22.161 INFO:tasks.workunit.client.0.smithi002.stdout:5/756: creat d1/d2a/d6b/d88/d55/f116 x:0 0 0 2024-09-13T22:56:22.161 INFO:tasks.workunit.client.0.smithi002.stdout:3/816: rmdir d9/d15/d36/d4e/d5e 39 2024-09-13T22:56:22.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:21 smithi047 ceph-mon[34560]: pgmap v21: 65 pgs: 65 active+clean; 2.9 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 103 MiB/s rd, 226 MiB/s wr, 522 op/s 2024-09-13T22:56:22.162 INFO:tasks.workunit.client.0.smithi002.stdout:0/750: fdatasync d1/d4/d75/d31/fc5 0 2024-09-13T22:56:22.164 INFO:tasks.workunit.client.0.smithi002.stdout:3/817: truncate d9/d15/f30 2385209 0 2024-09-13T22:56:22.164 INFO:tasks.workunit.client.0.smithi002.stdout:0/751: stat d1/d7e/d9d/de3 0 2024-09-13T22:56:22.166 INFO:tasks.workunit.client.1.smithi047.stdout:8/797: unlink d8/d6b/da9/dc3/cdb 0 2024-09-13T22:56:22.166 INFO:tasks.workunit.client.0.smithi002.stdout:6/773: dwrite d12/d17/fd2 [0,4194304] 0 2024-09-13T22:56:22.166 INFO:tasks.workunit.client.0.smithi002.stdout:0/752: write d1/d4/f3e [4872936,113368] 0 2024-09-13T22:56:22.167 INFO:tasks.workunit.client.1.smithi047.stdout:6/830: getdents d3/d11/d2b/d4c/dc0/d89 0 2024-09-13T22:56:22.168 INFO:tasks.workunit.client.0.smithi002.stdout:2/768: rename d1/f18 to d1/d4d/d8b/de1/f108 0 2024-09-13T22:56:22.171 INFO:tasks.workunit.client.1.smithi047.stdout:9/785: getdents d1/d5f/dd4 0 2024-09-13T22:56:22.173 INFO:tasks.workunit.client.1.smithi047.stdout:8/798: rmdir d8/d77/de3 39 2024-09-13T22:56:22.174 INFO:tasks.workunit.client.1.smithi047.stdout:4/906: truncate dc/de/d23/d40/d7b/d90/da6/f10a 1004227 0 2024-09-13T22:56:22.176 INFO:tasks.workunit.client.0.smithi002.stdout:9/839: dwrite d8/d10/d1c/d3d/f7e [0,4194304] 0 2024-09-13T22:56:22.176 INFO:tasks.workunit.client.1.smithi047.stdout:6/831: dwrite d3/d11/d2b/fe4 [0,4194304] 0 2024-09-13T22:56:22.177 INFO:tasks.workunit.client.0.smithi002.stdout:0/753: dwrite d1/d2/fa9 [4194304,4194304] 0 2024-09-13T22:56:22.179 INFO:tasks.workunit.client.1.smithi047.stdout:6/832: write d3/d11/d2b/d4c/dc0/d89/fed [484995,21206] 0 2024-09-13T22:56:22.181 INFO:tasks.workunit.client.1.smithi047.stdout:8/799: creat d8/d77/de3/f115 x:0 0 0 2024-09-13T22:56:22.182 INFO:tasks.workunit.client.0.smithi002.stdout:5/757: dread d1/d10/f51 [0,4194304] 0 2024-09-13T22:56:22.182 INFO:tasks.workunit.client.0.smithi002.stdout:3/818: truncate d9/d15/fbd 443935 0 2024-09-13T22:56:22.184 INFO:tasks.workunit.client.1.smithi047.stdout:8/800: write d8/f21 [661686,74088] 0 2024-09-13T22:56:22.186 INFO:tasks.workunit.client.0.smithi002.stdout:6/774: mknod d12/d17/d2a/d88/cf5 0 2024-09-13T22:56:22.189 INFO:tasks.workunit.client.1.smithi047.stdout:9/786: dwrite d1/dc/d14/dd/d54/d50/fe7 [0,4194304] 0 2024-09-13T22:56:22.191 INFO:tasks.workunit.client.1.smithi047.stdout:5/714: dread d19/d23/d2e/d41/f5a [0,4194304] 0 2024-09-13T22:56:22.191 INFO:tasks.workunit.client.0.smithi002.stdout:3/819: dwrite d9/d3b/d53/d83/fbe [0,4194304] 0 2024-09-13T22:56:22.194 INFO:tasks.workunit.client.1.smithi047.stdout:6/833: symlink d3/d11/d2b/d4c/d9d/dc1/de0/l10e 0 2024-09-13T22:56:22.197 INFO:tasks.workunit.client.0.smithi002.stdout:4/718: link d3/d40/d45/l68 d3/d40/d45/le9 0 2024-09-13T22:56:22.202 INFO:tasks.workunit.client.1.smithi047.stdout:9/787: rmdir d1/d5f/dc7 39 2024-09-13T22:56:22.205 INFO:tasks.workunit.client.1.smithi047.stdout:5/715: creat d19/d34/d8e/fdf x:0 0 0 2024-09-13T22:56:22.206 INFO:tasks.workunit.client.1.smithi047.stdout:5/716: stat d19/f43 0 2024-09-13T22:56:22.207 INFO:tasks.workunit.client.0.smithi002.stdout:9/840: creat d8/d91/da3/db9/f11a x:0 0 0 2024-09-13T22:56:22.208 INFO:tasks.workunit.client.1.smithi047.stdout:5/717: write d19/d34/d42/d5d/fb4 [314953,43546] 0 2024-09-13T22:56:22.209 INFO:tasks.workunit.client.1.smithi047.stdout:6/834: symlink d3/d11/d2b/d1c/dbd/de8/l10f 0 2024-09-13T22:56:22.210 INFO:tasks.workunit.client.1.smithi047.stdout:6/835: write d3/d11/fec [687828,117570] 0 2024-09-13T22:56:22.212 INFO:tasks.workunit.client.0.smithi002.stdout:1/820: sync 2024-09-13T22:56:22.212 INFO:tasks.workunit.client.0.smithi002.stdout:8/778: sync 2024-09-13T22:56:22.216 INFO:tasks.workunit.client.0.smithi002.stdout:6/775: truncate d12/d17/d28/f66 3378797 0 2024-09-13T22:56:22.218 INFO:tasks.workunit.client.1.smithi047.stdout:5/718: fsync d19/f1d 0 2024-09-13T22:56:22.218 INFO:tasks.workunit.client.1.smithi047.stdout:9/788: dread d1/dc/d14/dd/d54/d4e/d51/f5d [0,4194304] 0 2024-09-13T22:56:22.219 INFO:tasks.workunit.client.0.smithi002.stdout:8/779: dwrite d3/d21/d57/da1/fe8 [0,4194304] 0 2024-09-13T22:56:22.220 INFO:tasks.workunit.client.0.smithi002.stdout:4/719: fsync d3/f3d 0 2024-09-13T22:56:22.223 INFO:tasks.workunit.client.0.smithi002.stdout:8/780: read d3/dc/d16/d2f/db7/fd1 [2655604,100692] 0 2024-09-13T22:56:22.225 INFO:tasks.workunit.client.0.smithi002.stdout:5/758: write d1/d2a/d5a/f6d [2523712,58502] 0 2024-09-13T22:56:22.225 INFO:tasks.workunit.client.0.smithi002.stdout:5/759: stat d1/d2a/l66 0 2024-09-13T22:56:22.227 INFO:tasks.workunit.client.1.smithi047.stdout:8/801: getdents d8/d64/d4e/d70/d98 0 2024-09-13T22:56:22.228 INFO:tasks.workunit.client.1.smithi047.stdout:6/836: dread d3/d11/f6b [0,4194304] 0 2024-09-13T22:56:22.231 INFO:tasks.workunit.client.1.smithi047.stdout:5/719: mkdir d19/d64/ddd/de0 0 2024-09-13T22:56:22.241 INFO:tasks.workunit.client.1.smithi047.stdout:8/802: dwrite d8/f9 [4194304,4194304] 0 2024-09-13T22:56:22.242 INFO:tasks.workunit.client.0.smithi002.stdout:6/776: unlink d12/d17/f3c 0 2024-09-13T22:56:22.242 INFO:tasks.workunit.client.0.smithi002.stdout:3/820: mkdir d9/d3b/d53/d11f 0 2024-09-13T22:56:22.243 INFO:tasks.workunit.client.1.smithi047.stdout:6/837: symlink d3/l110 0 2024-09-13T22:56:22.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:21 smithi002 ceph-mon[27637]: pgmap v21: 65 pgs: 65 active+clean; 2.9 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 103 MiB/s rd, 226 MiB/s wr, 522 op/s 2024-09-13T22:56:22.250 INFO:tasks.workunit.client.0.smithi002.stdout:7/718: getdents d8/d10/d39/d60/db8/d26/d38 0 2024-09-13T22:56:22.251 INFO:tasks.workunit.client.1.smithi047.stdout:8/803: fdatasync d8/d3f/d8c/da6/faf 0 2024-09-13T22:56:22.253 INFO:tasks.workunit.client.1.smithi047.stdout:8/804: truncate d8/d3f/d8c/da6/fca 5106811 0 2024-09-13T22:56:22.255 INFO:tasks.workunit.client.1.smithi047.stdout:9/789: getdents d1/dc/d14/dd/d54/d8d 0 2024-09-13T22:56:22.256 INFO:tasks.workunit.client.0.smithi002.stdout:4/720: write d3/d14/d86/f95 [685465,53734] 0 2024-09-13T22:56:22.257 INFO:tasks.workunit.client.0.smithi002.stdout:4/721: write d3/d14/fe4 [239066,92920] 0 2024-09-13T22:56:22.259 INFO:tasks.workunit.client.1.smithi047.stdout:5/720: rmdir d19/d23/d2e/dd1 0 2024-09-13T22:56:22.259 INFO:tasks.workunit.client.1.smithi047.stdout:6/838: write d3/d11/f7b [472070,72094] 0 2024-09-13T22:56:22.261 INFO:tasks.workunit.client.0.smithi002.stdout:0/754: creat d1/d4/d75/d31/d32/f111 x:0 0 0 2024-09-13T22:56:22.262 INFO:tasks.workunit.client.0.smithi002.stdout:5/760: write d1/f37 [315662,57457] 0 2024-09-13T22:56:22.263 INFO:tasks.workunit.client.0.smithi002.stdout:1/821: mknod d1/d13/d1d/c119 0 2024-09-13T22:56:22.263 INFO:tasks.workunit.client.0.smithi002.stdout:1/822: stat d1/d13/d1d/d34/feb 0 2024-09-13T22:56:22.263 INFO:tasks.workunit.client.0.smithi002.stdout:2/769: mknod d1/d7/d8/c109 0 2024-09-13T22:56:22.264 INFO:tasks.workunit.client.0.smithi002.stdout:1/823: readlink d1/d13/d30/l1b 0 2024-09-13T22:56:22.264 INFO:tasks.workunit.client.1.smithi047.stdout:9/790: truncate d1/dc/d14/dd/d54/d50/d5b/d9e/f81 659433 0 2024-09-13T22:56:22.267 INFO:tasks.workunit.client.0.smithi002.stdout:6/777: creat d12/d17/d34/d39/ff6 x:0 0 0 2024-09-13T22:56:22.267 INFO:tasks.workunit.client.1.smithi047.stdout:9/791: truncate d1/dc/d14/dd/d54/d50/d5b/d9e/d101/f102 619117 0 2024-09-13T22:56:22.268 INFO:tasks.workunit.client.0.smithi002.stdout:3/821: mkdir d9/d3b/da5/d120 0 2024-09-13T22:56:22.270 INFO:tasks.workunit.client.0.smithi002.stdout:1/824: dwrite d1/d13/d1d/d34/fa0 [0,4194304] 0 2024-09-13T22:56:22.271 INFO:tasks.workunit.client.1.smithi047.stdout:8/805: mkdir d8/d64/d4e/d4d/d8f/d116 0 2024-09-13T22:56:22.276 INFO:tasks.workunit.client.0.smithi002.stdout:7/719: creat d8/d10/d39/d60/db8/d26/d4c/d81/db5/fd5 x:0 0 0 2024-09-13T22:56:22.281 INFO:tasks.workunit.client.1.smithi047.stdout:5/721: dwrite d19/d23/d4c/f7c [0,4194304] 0 2024-09-13T22:56:22.282 INFO:tasks.workunit.client.1.smithi047.stdout:8/806: mknod d8/d77/df3/c117 0 2024-09-13T22:56:22.286 INFO:tasks.workunit.client.1.smithi047.stdout:6/839: link d3/d2c/d10b/caa d3/d2c/d10b/d48/c111 0 2024-09-13T22:56:22.293 INFO:tasks.workunit.client.0.smithi002.stdout:0/755: truncate d1/d2/f29 1782259 0 2024-09-13T22:56:22.293 INFO:tasks.workunit.client.0.smithi002.stdout:5/761: truncate d1/d10/f75 110326 0 2024-09-13T22:56:22.294 INFO:tasks.workunit.client.0.smithi002.stdout:5/762: stat d1/d2a/d6b/d88/fa3 0 2024-09-13T22:56:22.296 INFO:tasks.workunit.client.0.smithi002.stdout:6/778: dread - d12/d17/d28/d67/d6b/daa/fad zero size 2024-09-13T22:56:22.297 INFO:tasks.workunit.client.1.smithi047.stdout:5/722: fsync d19/d25/f3f 0 2024-09-13T22:56:22.297 INFO:tasks.workunit.client.0.smithi002.stdout:6/779: chown d12/f14 30 1 2024-09-13T22:56:22.299 INFO:tasks.workunit.client.1.smithi047.stdout:8/807: mkdir d8/d64/d4e/d4d/d8f/d91/d40/de5/dfe/d118 0 2024-09-13T22:56:22.299 INFO:tasks.workunit.client.1.smithi047.stdout:5/723: truncate d19/d34/d42/d5d/fb4 1372284 0 2024-09-13T22:56:22.300 INFO:tasks.workunit.client.1.smithi047.stdout:5/724: chown d19/d23/d2e/d41/fdc 908144 1 2024-09-13T22:56:22.300 INFO:tasks.workunit.client.0.smithi002.stdout:2/770: dwrite d1/f14 [0,4194304] 0 2024-09-13T22:56:22.301 INFO:tasks.workunit.client.1.smithi047.stdout:5/725: dread - d19/d34/d8e/f8f zero size 2024-09-13T22:56:22.301 INFO:tasks.workunit.client.0.smithi002.stdout:1/825: read d1/d13/d21/f5b [6463531,60155] 0 2024-09-13T22:56:22.302 INFO:tasks.workunit.client.0.smithi002.stdout:6/780: dread d12/d17/d28/d67/ff3 [0,4194304] 0 2024-09-13T22:56:22.303 INFO:tasks.workunit.client.0.smithi002.stdout:7/720: creat d8/d10/d39/d60/db8/d26/d4c/d81/d46/fd6 x:0 0 0 2024-09-13T22:56:22.303 INFO:tasks.workunit.client.1.smithi047.stdout:9/792: link d1/dc/d14/dd/d54/d50/d60/cb6 d1/d5f/dc7/c109 0 2024-09-13T22:56:22.304 INFO:tasks.workunit.client.0.smithi002.stdout:6/781: read fd [2142807,26862] 0 2024-09-13T22:56:22.305 INFO:tasks.workunit.client.0.smithi002.stdout:8/781: mknod d3/dc/d16/d60/cf6 0 2024-09-13T22:56:22.306 INFO:tasks.workunit.client.0.smithi002.stdout:9/841: getdents d8/d91/da3/db9/dfa/da8/dc3 0 2024-09-13T22:56:22.307 INFO:tasks.workunit.client.1.smithi047.stdout:8/808: fsync d8/d64/d4e/d4d/dda/fe4 0 2024-09-13T22:56:22.309 INFO:tasks.workunit.client.0.smithi002.stdout:4/722: rename d3/d14/d29/d2a/da6/d9f/fcb to d3/d40/d45/fea 0 2024-09-13T22:56:22.311 INFO:tasks.workunit.client.0.smithi002.stdout:0/756: rmdir d1/d2/d81 39 2024-09-13T22:56:22.312 INFO:tasks.workunit.client.0.smithi002.stdout:6/782: dwrite d12/d17/d28/f2f [4194304,4194304] 0 2024-09-13T22:56:22.313 INFO:tasks.workunit.client.0.smithi002.stdout:5/763: dread d1/d10/f50 [4194304,4194304] 0 2024-09-13T22:56:22.315 INFO:tasks.workunit.client.0.smithi002.stdout:6/783: chown d12/d17/d28/d67/ff3 44003409 1 2024-09-13T22:56:22.315 INFO:tasks.workunit.client.1.smithi047.stdout:8/809: dwrite d8/d64/d4e/d4d/d8f/d91/f3c [0,4194304] 0 2024-09-13T22:56:22.316 INFO:tasks.workunit.client.1.smithi047.stdout:9/793: rename d1/dc/d14/c12 to d1/dc/d14/da5/c10a 0 2024-09-13T22:56:22.317 INFO:tasks.workunit.client.1.smithi047.stdout:6/840: link d3/d77/d8f/ccf d3/d2c/c112 0 2024-09-13T22:56:22.319 INFO:tasks.workunit.client.1.smithi047.stdout:5/726: creat d19/d83/d98/dd0/fe1 x:0 0 0 2024-09-13T22:56:22.322 INFO:tasks.workunit.client.0.smithi002.stdout:0/757: dwrite d1/d4/d75/d31/f8d [0,4194304] 0 2024-09-13T22:56:22.322 INFO:tasks.workunit.client.1.smithi047.stdout:9/794: unlink d1/dd2/led 0 2024-09-13T22:56:22.323 INFO:tasks.workunit.client.0.smithi002.stdout:0/758: chown d1/d4 1220 1 2024-09-13T22:56:22.323 INFO:tasks.workunit.client.1.smithi047.stdout:9/795: chown d1/dc/d14/dd/d54/d50/d91/da3/fa9 951117640 1 2024-09-13T22:56:22.324 INFO:tasks.workunit.client.0.smithi002.stdout:0/759: chown d1/d2/fa9 1492701 1 2024-09-13T22:56:22.332 INFO:tasks.workunit.client.1.smithi047.stdout:5/727: creat d19/d23/d2e/d41/d58/d77/fe2 x:0 0 0 2024-09-13T22:56:22.332 INFO:tasks.workunit.client.1.smithi047.stdout:8/810: getdents d8/d64/d4e/d4d/d8f/d91/d40/de5/dfe/d118 0 2024-09-13T22:56:22.332 INFO:tasks.workunit.client.1.smithi047.stdout:5/728: fdatasync d19/d23/d4c/f7c 0 2024-09-13T22:56:22.334 INFO:tasks.workunit.client.1.smithi047.stdout:9/796: mknod d1/dc/d14/dd/d54/d8d/c10b 0 2024-09-13T22:56:22.344 INFO:tasks.workunit.client.1.smithi047.stdout:5/729: unlink d19/d34/d42/d5d/f6e 0 2024-09-13T22:56:22.344 INFO:tasks.workunit.client.1.smithi047.stdout:8/811: rename d8/c4b to d8/d6b/da9/dc3/ddc/c119 0 2024-09-13T22:56:22.344 INFO:tasks.workunit.client.0.smithi002.stdout:7/721: dwrite d8/d10/d39/d60/f7a [0,4194304] 0 2024-09-13T22:56:22.347 INFO:tasks.workunit.client.0.smithi002.stdout:5/764: symlink d1/d2a/d6b/d88/d45/d4f/l117 0 2024-09-13T22:56:22.352 INFO:tasks.workunit.client.1.smithi047.stdout:5/730: symlink d19/d23/d2e/d41/le3 0 2024-09-13T22:56:22.353 INFO:tasks.workunit.client.0.smithi002.stdout:4/723: dread d3/d14/fce [0,4194304] 0 2024-09-13T22:56:22.353 INFO:tasks.workunit.client.1.smithi047.stdout:2/822: sync 2024-09-13T22:56:22.353 INFO:tasks.workunit.client.1.smithi047.stdout:0/786: sync 2024-09-13T22:56:22.353 INFO:tasks.workunit.client.1.smithi047.stdout:3/837: sync 2024-09-13T22:56:22.354 INFO:tasks.workunit.client.1.smithi047.stdout:9/797: mkdir d1/d5f/de9/d107/d10c 0 2024-09-13T22:56:22.354 INFO:tasks.workunit.client.0.smithi002.stdout:4/724: chown d3/d14/d29/d2a/dbc/cbe 118127 1 2024-09-13T22:56:22.355 INFO:tasks.workunit.client.1.smithi047.stdout:9/798: fsync d1/dc/d14/dd/d54/d50/fd0 0 2024-09-13T22:56:22.357 INFO:tasks.workunit.client.0.smithi002.stdout:0/760: unlink d1/d4/d75/d31/de0/d102/f10a 0 2024-09-13T22:56:22.358 INFO:tasks.workunit.client.1.smithi047.stdout:3/838: dread - d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/f106 zero size 2024-09-13T22:56:22.358 INFO:tasks.workunit.client.1.smithi047.stdout:6/841: getdents d3/d11/d2b/d1c 0 2024-09-13T22:56:22.360 INFO:tasks.workunit.client.0.smithi002.stdout:4/725: dwrite d3/d14/d29/f96 [0,4194304] 0 2024-09-13T22:56:22.361 INFO:tasks.workunit.client.1.smithi047.stdout:0/787: fsync d1/d7/f81 0 2024-09-13T22:56:22.362 INFO:tasks.workunit.client.0.smithi002.stdout:3/822: rename d9/d15/c20 to d9/d3b/d53/d95/c121 0 2024-09-13T22:56:22.373 INFO:tasks.workunit.client.1.smithi047.stdout:8/812: truncate d8/d6b/fdd 1616975 0 2024-09-13T22:56:22.374 INFO:tasks.workunit.client.0.smithi002.stdout:8/782: truncate d3/dc/d18/f23 4168951 0 2024-09-13T22:56:22.375 INFO:tasks.workunit.client.0.smithi002.stdout:1/826: rmdir d1/d13/d30/d73/da1/d7d/d10f 0 2024-09-13T22:56:22.376 INFO:tasks.workunit.client.0.smithi002.stdout:1/827: dread - d1/d13/d21/d39/d70/d10c/d3b/d71/d80/d112/f10b zero size 2024-09-13T22:56:22.378 INFO:tasks.workunit.client.1.smithi047.stdout:6/842: write d3/d11/d2b/d76/fa2 [3531914,47956] 0 2024-09-13T22:56:22.379 INFO:tasks.workunit.client.1.smithi047.stdout:2/823: mkdir d1/df/d1d/d20/d54/d113 0 2024-09-13T22:56:22.384 INFO:tasks.workunit.client.1.smithi047.stdout:8/813: dread d8/f27 [0,4194304] 0 2024-09-13T22:56:22.388 INFO:tasks.workunit.client.0.smithi002.stdout:9/842: rename d8/d10/d61/d116 to d8/d10/d1c/dbf/d11b 0 2024-09-13T22:56:22.390 INFO:tasks.workunit.client.0.smithi002.stdout:3/823: mknod d9/d15/d26/c122 0 2024-09-13T22:56:22.392 INFO:tasks.workunit.client.0.smithi002.stdout:1/828: dread d1/f15 [0,4194304] 0 2024-09-13T22:56:22.392 INFO:tasks.workunit.client.0.smithi002.stdout:1/829: chown d1/d13/d1d/f6c 47250277 1 2024-09-13T22:56:22.393 INFO:tasks.workunit.client.1.smithi047.stdout:0/788: link d1/f2 d1/d5/d16/d97/db6/f101 0 2024-09-13T22:56:22.393 INFO:tasks.workunit.client.0.smithi002.stdout:1/830: write d1/d13/d30/d73/da1/ffc [1584328,39967] 0 2024-09-13T22:56:22.395 INFO:tasks.workunit.client.0.smithi002.stdout:7/722: link d8/d10/d39/d60/db8/d26/d38/d68/fc0 d8/d10/d39/d60/db8/d2e/d50/d52/fd7 0 2024-09-13T22:56:22.396 INFO:tasks.workunit.client.1.smithi047.stdout:6/843: mknod d3/d11/d2b/d4c/dc0/c113 0 2024-09-13T22:56:22.401 INFO:tasks.workunit.client.0.smithi002.stdout:2/771: getdents d1/d7/d8 0 2024-09-13T22:56:22.402 INFO:tasks.workunit.client.0.smithi002.stdout:0/761: dwrite d1/d4/d75/d31/fc5 [0,4194304] 0 2024-09-13T22:56:22.404 INFO:tasks.workunit.client.1.smithi047.stdout:9/799: write d1/f2b [1296542,128733] 0 2024-09-13T22:56:22.406 INFO:tasks.workunit.client.1.smithi047.stdout:8/814: symlink d8/d64/d4e/d4d/d8f/d91/d38/d7a/l11a 0 2024-09-13T22:56:22.406 INFO:tasks.workunit.client.0.smithi002.stdout:7/723: dwrite d8/d10/d39/d60/db8/d26/d4c/d81/db5/fd5 [0,4194304] 0 2024-09-13T22:56:22.408 INFO:tasks.workunit.client.1.smithi047.stdout:0/789: fsync d1/d7/f3e 0 2024-09-13T22:56:22.412 INFO:tasks.workunit.client.0.smithi002.stdout:1/831: dread d1/d13/d21/d39/d70/d10c/d3d/d5d/f37 [4194304,4194304] 0 2024-09-13T22:56:22.412 INFO:tasks.workunit.client.1.smithi047.stdout:9/800: read d1/dc/d14/fe0 [571087,115421] 0 2024-09-13T22:56:22.413 INFO:tasks.workunit.client.1.smithi047.stdout:3/839: dwrite d0/d3/d4/d16/d32/f39 [0,4194304] 0 2024-09-13T22:56:22.413 INFO:tasks.workunit.client.0.smithi002.stdout:1/832: fdatasync d1/d13/f3f 0 2024-09-13T22:56:22.417 INFO:tasks.workunit.client.0.smithi002.stdout:6/784: rename d12/fc1 to d12/d17/d2a/d88/ff7 0 2024-09-13T22:56:22.419 INFO:tasks.workunit.client.1.smithi047.stdout:2/824: mknod d1/df/d26/c114 0 2024-09-13T22:56:22.420 INFO:tasks.workunit.client.0.smithi002.stdout:5/765: write d1/d2a/d6b/d88/d45/f54 [1043839,59696] 0 2024-09-13T22:56:22.422 INFO:tasks.workunit.client.0.smithi002.stdout:5/766: chown d1/d10/l3b 34 1 2024-09-13T22:56:22.428 INFO:tasks.workunit.client.0.smithi002.stdout:5/767: dwrite d1/ffb [4194304,4194304] 0 2024-09-13T22:56:22.429 INFO:tasks.workunit.client.1.smithi047.stdout:6/844: dwrite d3/d11/d2b/d1c/dca/fd5 [0,4194304] 0 2024-09-13T22:56:22.438 INFO:tasks.workunit.client.0.smithi002.stdout:7/724: creat d8/d10/d39/d60/db8/d2e/d50/d52/dab/fd8 x:0 0 0 2024-09-13T22:56:22.443 INFO:tasks.workunit.client.0.smithi002.stdout:1/833: mknod d1/d13/d21/d40/dc4/dc8/ddf/c11a 0 2024-09-13T22:56:22.443 INFO:tasks.workunit.client.0.smithi002.stdout:1/834: fsync d1/d13/d1d/f6c 0 2024-09-13T22:56:22.447 INFO:tasks.workunit.client.0.smithi002.stdout:6/785: creat d12/d17/d28/d67/dca/dd8/ff8 x:0 0 0 2024-09-13T22:56:22.449 INFO:tasks.workunit.client.0.smithi002.stdout:6/786: dread - d12/d17/d28/d67/dca/dd8/ff8 zero size 2024-09-13T22:56:22.451 INFO:tasks.workunit.client.0.smithi002.stdout:3/824: creat d9/d15/d36/d4e/d5e/dae/d89/f123 x:0 0 0 2024-09-13T22:56:22.452 INFO:tasks.workunit.client.0.smithi002.stdout:3/825: truncate d9/d3b/d53/d83/fbe 4978156 0 2024-09-13T22:56:22.456 INFO:tasks.workunit.client.0.smithi002.stdout:5/768: symlink d1/d108/l118 0 2024-09-13T22:56:22.459 INFO:tasks.workunit.client.0.smithi002.stdout:2/772: mkdir d1/d7/d10a 0 2024-09-13T22:56:22.461 INFO:tasks.workunit.client.0.smithi002.stdout:5/769: dwrite d1/fe [4194304,4194304] 0 2024-09-13T22:56:22.461 INFO:tasks.workunit.client.0.smithi002.stdout:2/773: write d1/d7/d8/d2c/da4/ffd [453112,114916] 0 2024-09-13T22:56:22.462 INFO:tasks.workunit.client.0.smithi002.stdout:0/762: unlink d1/lf 0 2024-09-13T22:56:22.464 INFO:tasks.workunit.client.0.smithi002.stdout:4/726: sync 2024-09-13T22:56:22.470 INFO:tasks.workunit.client.0.smithi002.stdout:1/835: symlink d1/d13/d21/d40/dc4/dc8/ddf/l11b 0 2024-09-13T22:56:22.474 INFO:tasks.workunit.client.0.smithi002.stdout:6/787: rmdir d12/d17/d28/d67 39 2024-09-13T22:56:22.479 INFO:tasks.workunit.client.0.smithi002.stdout:8/783: getdents d3/dc/d18/d2e/d94 0 2024-09-13T22:56:22.481 INFO:tasks.workunit.client.0.smithi002.stdout:7/725: write d8/d10/d39/d60/db8/d26/d38/fac [538618,52761] 0 2024-09-13T22:56:22.482 INFO:tasks.workunit.client.0.smithi002.stdout:5/770: write d1/f18 [2125938,52015] 0 2024-09-13T22:56:22.483 INFO:tasks.workunit.client.0.smithi002.stdout:7/726: fsync d8/d10/d39/d60/db8/d26/f92 0 2024-09-13T22:56:22.486 INFO:tasks.workunit.client.0.smithi002.stdout:7/727: chown d8/d10/d39/d60/db8/d26/d4c/d81/f1a 344578 1 2024-09-13T22:56:22.489 INFO:tasks.workunit.client.0.smithi002.stdout:7/728: write d8/d10/d39/d60/db8/d26/f92 [1015916,85287] 0 2024-09-13T22:56:22.490 INFO:tasks.workunit.client.0.smithi002.stdout:9/843: getdents d8/d91/da3/db9 0 2024-09-13T22:56:22.492 INFO:tasks.workunit.client.1.smithi047.stdout:9/801: truncate d1/dc/d14/dd/d4c/df2/fab 789284 0 2024-09-13T22:56:22.493 INFO:tasks.workunit.client.0.smithi002.stdout:8/784: dread d3/f6 [0,4194304] 0 2024-09-13T22:56:22.493 INFO:tasks.workunit.client.0.smithi002.stdout:8/785: fdatasync d3/d27/da3/fce 0 2024-09-13T22:56:22.493 INFO:tasks.workunit.client.0.smithi002.stdout:3/826: fsync d9/d7e/dce/d111/f11a 0 2024-09-13T22:56:22.494 INFO:tasks.workunit.client.0.smithi002.stdout:3/827: readlink d9/d15/d26/l43 0 2024-09-13T22:56:22.494 INFO:tasks.workunit.client.0.smithi002.stdout:8/786: chown d3/dc/d16/d4b/fb3 1005 1 2024-09-13T22:56:22.495 INFO:tasks.workunit.client.0.smithi002.stdout:1/836: write d1/d13/d1d/d34/d51/f9b [4110809,30211] 0 2024-09-13T22:56:22.497 INFO:tasks.workunit.client.1.smithi047.stdout:2/825: fdatasync d1/df/d1d/d20/d37/f39 0 2024-09-13T22:56:22.500 INFO:tasks.workunit.client.1.smithi047.stdout:6/845: fsync d3/d11/d2b/d4c/dc0/f75 0 2024-09-13T22:56:22.501 INFO:tasks.workunit.client.0.smithi002.stdout:2/774: dread d1/d80/f83 [0,4194304] 0 2024-09-13T22:56:22.501 INFO:tasks.workunit.client.0.smithi002.stdout:0/763: mknod d1/c112 0 2024-09-13T22:56:22.508 INFO:tasks.workunit.client.0.smithi002.stdout:4/727: mknod d3/d40/ceb 0 2024-09-13T22:56:22.509 INFO:tasks.workunit.client.1.smithi047.stdout:0/790: symlink d1/d5/d11/d52/l102 0 2024-09-13T22:56:22.510 INFO:tasks.workunit.client.1.smithi047.stdout:8/815: fdatasync d8/d64/d4e/d4d/d8f/d91/d40/f5c 0 2024-09-13T22:56:22.512 INFO:tasks.workunit.client.0.smithi002.stdout:7/729: mkdir d8/d10/d39/d60/db8/d2e/d50/d52/dab/dd9 0 2024-09-13T22:56:22.513 INFO:tasks.workunit.client.1.smithi047.stdout:9/802: rename d1/dc/d14/dd/d54/cb8 to d1/dc/d14/dd/d4c/df2/c10d 0 2024-09-13T22:56:22.515 INFO:tasks.workunit.client.1.smithi047.stdout:9/803: read d1/dc/d14/dd/d54/d50/d5b/fa6 [956974,29373] 0 2024-09-13T22:56:22.516 INFO:tasks.workunit.client.1.smithi047.stdout:3/840: link d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/f60 d0/d3/d4/d16/d32/d42/d79/d9c/dad/d95/f108 0 2024-09-13T22:56:22.516 INFO:tasks.workunit.client.0.smithi002.stdout:6/788: getdents d12/d17/d28/d7d/df2 0 2024-09-13T22:56:22.517 INFO:tasks.workunit.client.1.smithi047.stdout:3/841: chown d0/d3/d4/d16/d2c/de/d3d/fc9 28570 1 2024-09-13T22:56:22.519 INFO:tasks.workunit.client.0.smithi002.stdout:3/828: chown d9/d15/d36/c63 17063 1 2024-09-13T22:56:22.519 INFO:tasks.workunit.client.1.smithi047.stdout:3/842: truncate d0/d3/d4/d16/d2c/de/dcc/f104 711785 0 2024-09-13T22:56:22.520 INFO:tasks.workunit.client.0.smithi002.stdout:5/771: write d1/d2a/d6b/d88/d45/d4f/d78/fac [136878,112453] 0 2024-09-13T22:56:22.520 INFO:tasks.workunit.client.0.smithi002.stdout:3/829: readlink d9/d15/d36/d4e/d5e/dae/de6/l10e 0 2024-09-13T22:56:22.522 INFO:tasks.workunit.client.1.smithi047.stdout:6/846: symlink d3/d11/d74/l114 0 2024-09-13T22:56:22.523 INFO:tasks.workunit.client.0.smithi002.stdout:1/837: fdatasync d1/d13/d21/d39/d70/d10c/d3d/db6/fdb 0 2024-09-13T22:56:22.524 INFO:tasks.workunit.client.1.smithi047.stdout:0/791: mknod d1/d7/c103 0 2024-09-13T22:56:22.526 INFO:tasks.workunit.client.0.smithi002.stdout:0/764: read d1/d2/f1d [2024369,84504] 0 2024-09-13T22:56:22.532 INFO:tasks.workunit.client.1.smithi047.stdout:8/816: dwrite d8/d64/d4e/d4d/d8f/d91/fc2 [0,4194304] 0 2024-09-13T22:56:22.541 INFO:tasks.workunit.client.0.smithi002.stdout:9/844: fdatasync d8/d10/d42/ff9 0 2024-09-13T22:56:22.541 INFO:tasks.workunit.client.0.smithi002.stdout:7/730: write d8/f27 [1437302,87301] 0 2024-09-13T22:56:22.541 INFO:tasks.workunit.client.1.smithi047.stdout:3/843: symlink d0/l109 0 2024-09-13T22:56:22.541 INFO:tasks.workunit.client.0.smithi002.stdout:2/775: dwrite d1/d7/d8/d2c/da4/fbc [0,4194304] 0 2024-09-13T22:56:22.542 INFO:tasks.workunit.client.1.smithi047.stdout:3/844: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/f49 [3281979,27038] 0 2024-09-13T22:56:22.544 INFO:tasks.workunit.client.0.smithi002.stdout:9/845: read d8/d1e/f36 [2523328,123780] 0 2024-09-13T22:56:22.544 INFO:tasks.workunit.client.0.smithi002.stdout:5/772: unlink d1/d2a/d6b/d88/d55/f83 0 2024-09-13T22:56:22.545 INFO:tasks.workunit.client.1.smithi047.stdout:3/845: dread d0/d3/d4/d16/d2c/de/dcc/f104 [0,4194304] 0 2024-09-13T22:56:22.545 INFO:tasks.workunit.client.0.smithi002.stdout:9/846: fdatasync d8/d2c/fba 0 2024-09-13T22:56:22.546 INFO:tasks.workunit.client.1.smithi047.stdout:9/804: dread d1/f25 [0,4194304] 0 2024-09-13T22:56:22.547 INFO:tasks.workunit.client.0.smithi002.stdout:1/838: dread d1/d13/d21/d39/d70/d10c/d3d/d5d/f4e [0,4194304] 0 2024-09-13T22:56:22.547 INFO:tasks.workunit.client.1.smithi047.stdout:9/805: readlink d1/dd2/l100 0 2024-09-13T22:56:22.548 INFO:tasks.workunit.client.0.smithi002.stdout:3/830: unlink d9/d15/d26/l3d 0 2024-09-13T22:56:22.549 INFO:tasks.workunit.client.0.smithi002.stdout:9/847: truncate d8/d10/d1c/d68/d74/f102 22207 0 2024-09-13T22:56:22.550 INFO:tasks.workunit.client.1.smithi047.stdout:8/817: mknod d8/d6b/c11b 0 2024-09-13T22:56:22.552 INFO:tasks.workunit.client.0.smithi002.stdout:0/765: rename d1/d4/d75/d31/d32/dbb/de1/ff7 to d1/d4/d75/d31/d32/dbb/de1/f113 0 2024-09-13T22:56:22.554 INFO:tasks.workunit.client.0.smithi002.stdout:4/728: truncate d3/d14/f53 504044 0 2024-09-13T22:56:22.556 INFO:tasks.workunit.client.1.smithi047.stdout:9/806: readlink d1/dc/l46 0 2024-09-13T22:56:22.558 INFO:tasks.workunit.client.1.smithi047.stdout:0/792: mknod d1/d5/d11/c104 0 2024-09-13T22:56:22.558 INFO:tasks.workunit.client.0.smithi002.stdout:6/789: mkdir d12/d17/d28/d67/dca/df9 0 2024-09-13T22:56:22.561 INFO:tasks.workunit.client.1.smithi047.stdout:8/818: dread d8/d64/d4e/d4d/f6a [0,4194304] 0 2024-09-13T22:56:22.562 INFO:tasks.workunit.client.1.smithi047.stdout:2/826: rename d1/df/c65 to d1/df/c115 0 2024-09-13T22:56:22.564 INFO:tasks.workunit.client.0.smithi002.stdout:6/790: dwrite d12/d17/d34/f36 [0,4194304] 0 2024-09-13T22:56:22.564 INFO:tasks.workunit.client.0.smithi002.stdout:7/731: creat d8/d10/d11/d3a/fda x:0 0 0 2024-09-13T22:56:22.571 INFO:tasks.workunit.client.1.smithi047.stdout:8/819: dread d8/d64/d4e/f49 [0,4194304] 0 2024-09-13T22:56:22.581 INFO:tasks.workunit.client.0.smithi002.stdout:3/831: rename d9/c6a to d9/d15/d36/d4e/d5e/dae/c124 0 2024-09-13T22:56:22.582 INFO:tasks.workunit.client.1.smithi047.stdout:6/847: getdents d3/d11/d2b/d1c/d4d/d69/dc2/dcd 0 2024-09-13T22:56:22.583 INFO:tasks.workunit.client.0.smithi002.stdout:9/848: creat d8/d91/da3/db9/dfa/d87/f11c x:0 0 0 2024-09-13T22:56:22.585 INFO:tasks.workunit.client.1.smithi047.stdout:3/846: creat d0/d3/d4/d16/d32/d42/d79/d9c/f10a x:0 0 0 2024-09-13T22:56:22.586 INFO:tasks.workunit.client.0.smithi002.stdout:0/766: rmdir d1/d7e/d9d/de6 39 2024-09-13T22:56:22.588 INFO:tasks.workunit.client.1.smithi047.stdout:3/847: readlink d0/d3/d4/d16/d1c/l67 0 2024-09-13T22:56:22.588 INFO:tasks.workunit.client.0.smithi002.stdout:4/729: creat d3/d14/d29/d2a/dbc/fec x:0 0 0 2024-09-13T22:56:22.589 INFO:tasks.workunit.client.0.smithi002.stdout:4/730: chown d3/d14/d29/d2a/fa3 85392 1 2024-09-13T22:56:22.590 INFO:tasks.workunit.client.0.smithi002.stdout:4/731: dread - d3/d14/d86/db1/fc4 zero size 2024-09-13T22:56:22.591 INFO:tasks.workunit.client.1.smithi047.stdout:0/793: dwrite d1/d5/d11/d2f/fb0 [0,4194304] 0 2024-09-13T22:56:22.594 INFO:tasks.workunit.client.1.smithi047.stdout:2/827: fdatasync d1/df/d1d/da9/fdc 0 2024-09-13T22:56:22.595 INFO:tasks.workunit.client.0.smithi002.stdout:6/791: creat d12/d17/d28/d67/dca/dd8/ffa x:0 0 0 2024-09-13T22:56:22.597 INFO:tasks.workunit.client.1.smithi047.stdout:6/848: dread d3/d2c/d10b/f72 [0,4194304] 0 2024-09-13T22:56:22.597 INFO:tasks.workunit.client.0.smithi002.stdout:7/732: symlink d8/d10/d39/d60/db8/d2e/d50/d52/ldb 0 2024-09-13T22:56:22.600 INFO:tasks.workunit.client.1.smithi047.stdout:0/794: dwrite d1/f37 [0,4194304] 0 2024-09-13T22:56:22.601 INFO:tasks.workunit.client.0.smithi002.stdout:2/776: rmdir d1/da9 39 2024-09-13T22:56:22.601 INFO:tasks.workunit.client.1.smithi047.stdout:0/795: readlink d1/d5/l5b 0 2024-09-13T22:56:22.605 INFO:tasks.workunit.client.1.smithi047.stdout:9/807: creat d1/d5f/f10e x:0 0 0 2024-09-13T22:56:22.606 INFO:tasks.workunit.client.0.smithi002.stdout:8/787: getdents d3/dc/d51 0 2024-09-13T22:56:22.607 INFO:tasks.workunit.client.1.smithi047.stdout:8/820: write d8/d64/d4e/d4d/d8f/d91/d38/dbe/fde [836174,42776] 0 2024-09-13T22:56:22.609 INFO:tasks.workunit.client.0.smithi002.stdout:7/733: dread d8/d10/f1e [0,4194304] 0 2024-09-13T22:56:22.610 INFO:tasks.workunit.client.0.smithi002.stdout:5/773: link d1/d2a/d6b/d88/d55/ffe d1/d57/dd0/df7/d101/f119 0 2024-09-13T22:56:22.612 INFO:tasks.workunit.client.0.smithi002.stdout:3/832: dread - d9/d15/d26/fef zero size 2024-09-13T22:56:22.612 INFO:tasks.workunit.client.0.smithi002.stdout:7/734: write d8/d10/d39/d60/db8/d26/d4c/f8a [4290727,99124] 0 2024-09-13T22:56:22.612 INFO:tasks.workunit.client.1.smithi047.stdout:2/828: dread - d1/d16/d40/d57/f71 zero size 2024-09-13T22:56:22.612 INFO:tasks.workunit.client.1.smithi047.stdout:3/848: dread d0/d3/d4/d16/d2c/de/dcc/dd1/dc4/fd7 [0,4194304] 0 2024-09-13T22:56:22.614 INFO:tasks.workunit.client.1.smithi047.stdout:2/829: write d1/df/d26/f30 [4391546,14332] 0 2024-09-13T22:56:22.615 INFO:tasks.workunit.client.1.smithi047.stdout:3/849: dread - d0/d3/d4/d16/d2c/de/d1f/d3b/ffb zero size 2024-09-13T22:56:22.615 INFO:tasks.workunit.client.1.smithi047.stdout:6/849: mknod d3/d11/d2b/d1c/d23/dda/c115 0 2024-09-13T22:56:22.617 INFO:tasks.workunit.client.1.smithi047.stdout:0/796: fdatasync d1/d5/d11/d52/f72 0 2024-09-13T22:56:22.618 INFO:tasks.workunit.client.1.smithi047.stdout:6/850: dread - d3/d11/d2b/d1c/dca/ffe zero size 2024-09-13T22:56:22.618 INFO:tasks.workunit.client.0.smithi002.stdout:6/792: rmdir d12/d17/d28/d67/dca/dd8 39 2024-09-13T22:56:22.621 INFO:tasks.workunit.client.0.smithi002.stdout:3/833: dwrite d9/d15/d26/d93/f6b [0,4194304] 0 2024-09-13T22:56:22.625 INFO:tasks.workunit.client.1.smithi047.stdout:8/821: creat d8/d64/dc5/f11c x:0 0 0 2024-09-13T22:56:22.627 INFO:tasks.workunit.client.0.smithi002.stdout:5/774: mknod d1/d57/dd0/c11a 0 2024-09-13T22:56:22.628 INFO:tasks.workunit.client.1.smithi047.stdout:9/808: write d1/d5f/f9b [610732,37219] 0 2024-09-13T22:56:22.633 INFO:tasks.workunit.client.0.smithi002.stdout:1/839: rename d1/d13/d21/d39/df7/f6d to d1/d13/d30/d73/da1/d7d/df9/f11c 0 2024-09-13T22:56:22.633 INFO:tasks.workunit.client.0.smithi002.stdout:9/849: dwrite d8/d10/d1c/fb0 [0,4194304] 0 2024-09-13T22:56:22.635 INFO:tasks.workunit.client.1.smithi047.stdout:6/851: mknod d3/d11/d2b/d1c/dca/c116 0 2024-09-13T22:56:22.637 INFO:tasks.workunit.client.0.smithi002.stdout:0/767: dwrite d1/d2/f6b [0,4194304] 0 2024-09-13T22:56:22.637 INFO:tasks.workunit.client.1.smithi047.stdout:0/797: write d1/d5/d16/d97/dfc/dd8/ffb [1715646,72513] 0 2024-09-13T22:56:22.638 INFO:tasks.workunit.client.0.smithi002.stdout:6/793: dread d12/f74 [0,4194304] 0 2024-09-13T22:56:22.638 INFO:tasks.workunit.client.0.smithi002.stdout:4/732: dread d3/f73 [0,4194304] 0 2024-09-13T22:56:22.641 INFO:tasks.workunit.client.0.smithi002.stdout:8/788: dwrite d3/d27/f62 [0,4194304] 0 2024-09-13T22:56:22.643 INFO:tasks.workunit.client.1.smithi047.stdout:8/822: creat d8/d3f/d8c/f11d x:0 0 0 2024-09-13T22:56:22.644 INFO:tasks.workunit.client.0.smithi002.stdout:4/733: read d3/d14/d86/f95 [634554,61875] 0 2024-09-13T22:56:22.645 INFO:tasks.workunit.client.1.smithi047.stdout:2/830: creat d1/df/d35/dd7/d104/f116 x:0 0 0 2024-09-13T22:56:22.646 INFO:tasks.workunit.client.1.smithi047.stdout:2/831: stat d1/df/d1d/d2e/fe7 0 2024-09-13T22:56:22.647 INFO:tasks.workunit.client.1.smithi047.stdout:3/850: creat d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d85/df9/f10b x:0 0 0 2024-09-13T22:56:22.649 INFO:tasks.workunit.client.1.smithi047.stdout:6/852: symlink d3/d11/d2b/d7c/l117 0 2024-09-13T22:56:22.650 INFO:tasks.workunit.client.0.smithi002.stdout:5/775: creat d1/de7/f11b x:0 0 0 2024-09-13T22:56:22.652 INFO:tasks.workunit.client.1.smithi047.stdout:8/823: stat d8/d64/d4e/d4d/f7e 0 2024-09-13T22:56:22.653 INFO:tasks.workunit.client.0.smithi002.stdout:7/735: mknod d8/d10/d39/d60/db8/d2e/d50/d52/d99/cdc 0 2024-09-13T22:56:22.654 INFO:tasks.workunit.client.0.smithi002.stdout:6/794: dwrite d12/d17/d28/d67/d9f/fde [0,4194304] 0 2024-09-13T22:56:22.654 INFO:tasks.workunit.client.1.smithi047.stdout:9/809: mknod d1/dc/d14/dd/d54/d50/d5b/d106/c10f 0 2024-09-13T22:56:22.655 INFO:tasks.workunit.client.1.smithi047.stdout:2/832: creat d1/df/d1d/d2e/d5e/f117 x:0 0 0 2024-09-13T22:56:22.656 INFO:tasks.workunit.client.0.smithi002.stdout:7/736: write f7 [230054,86030] 0 2024-09-13T22:56:22.657 INFO:tasks.workunit.client.1.smithi047.stdout:3/851: chown d0/d3/cd9 506 1 2024-09-13T22:56:22.657 INFO:tasks.workunit.client.0.smithi002.stdout:6/795: read d12/d17/f48 [3441687,86507] 0 2024-09-13T22:56:22.658 INFO:tasks.workunit.client.0.smithi002.stdout:7/737: readlink d8/d10/d39/d60/db8/l5a 0 2024-09-13T22:56:22.659 INFO:tasks.workunit.client.1.smithi047.stdout:6/853: fsync d3/d2c/d10b/f91 0 2024-09-13T22:56:22.659 INFO:tasks.workunit.client.0.smithi002.stdout:7/738: fsync d8/d10/d39/d60/db8/d26/d38/f9e 0 2024-09-13T22:56:22.661 INFO:tasks.workunit.client.0.smithi002.stdout:7/739: chown d8/d10/d39/d60/db8/d2e/d3c/db2/cc1 129764224 1 2024-09-13T22:56:22.666 INFO:tasks.workunit.client.1.smithi047.stdout:8/824: truncate d8/f7b 1882141 0 2024-09-13T22:56:22.668 INFO:tasks.workunit.client.1.smithi047.stdout:3/852: dwrite d0/d3/d4/d16/d32/d42/d79/d9c/fb8 [0,4194304] 0 2024-09-13T22:56:22.671 INFO:tasks.workunit.client.0.smithi002.stdout:9/850: dread d8/d10/d1c/d3d/f3e [0,4194304] 0 2024-09-13T22:56:22.672 INFO:tasks.workunit.client.0.smithi002.stdout:9/851: fsync d8/d10/d1c/dbf/fc5 0 2024-09-13T22:56:22.674 INFO:tasks.workunit.client.1.smithi047.stdout:2/833: symlink d1/df/d1d/d20/d37/d85/l118 0 2024-09-13T22:56:22.674 INFO:tasks.workunit.client.1.smithi047.stdout:0/798: write d1/f6e [880082,64523] 0 2024-09-13T22:56:22.675 INFO:tasks.workunit.client.1.smithi047.stdout:9/810: dread d1/dc/d14/dd/d4c/df2/f33 [0,4194304] 0 2024-09-13T22:56:22.682 INFO:tasks.workunit.client.0.smithi002.stdout:1/840: mknod d1/d13/d1d/d34/c11d 0 2024-09-13T22:56:22.684 INFO:tasks.workunit.client.1.smithi047.stdout:8/825: mkdir d8/d64/d4e/dbd/d11e 0 2024-09-13T22:56:22.685 INFO:tasks.workunit.client.1.smithi047.stdout:3/853: dread d0/d3/d4/d16/d1c/f92 [0,4194304] 0 2024-09-13T22:56:22.685 INFO:tasks.workunit.client.1.smithi047.stdout:8/826: fdatasync d8/d64/d4e/d70/da7/fd5 0 2024-09-13T22:56:22.686 INFO:tasks.workunit.client.0.smithi002.stdout:5/776: mknod d1/d2a/d6b/d88/d45/d4f/da7/daa/c11c 0 2024-09-13T22:56:22.688 INFO:tasks.workunit.client.1.smithi047.stdout:3/854: read d0/d3/d5e/ff4 [46309,99298] 0 2024-09-13T22:56:22.688 INFO:tasks.workunit.client.0.smithi002.stdout:5/777: stat d1/d2a/d6b/d88/d55/c80 0 2024-09-13T22:56:22.688 INFO:tasks.workunit.client.0.smithi002.stdout:3/834: dwrite d9/d3b/f108 [0,4194304] 0 2024-09-13T22:56:22.689 INFO:tasks.workunit.client.1.smithi047.stdout:3/855: stat d0/d3/d4/d16/d2c/de/dcc/f104 0 2024-09-13T22:56:22.690 INFO:tasks.workunit.client.0.smithi002.stdout:2/777: write d1/d4d/f50 [912253,85516] 0 2024-09-13T22:56:22.697 INFO:tasks.workunit.client.0.smithi002.stdout:6/796: mkdir d12/d17/d28/d67/d6b/daa/dfb 0 2024-09-13T22:56:22.697 INFO:tasks.workunit.client.0.smithi002.stdout:4/734: dwrite d3/f3a [0,4194304] 0 2024-09-13T22:56:22.698 INFO:tasks.workunit.client.0.smithi002.stdout:6/797: chown d12/d17/d34/d39 111860746 1 2024-09-13T22:56:22.699 INFO:tasks.workunit.client.1.smithi047.stdout:9/811: rmdir d1/dc/d14/df3 39 2024-09-13T22:56:22.703 INFO:tasks.workunit.client.1.smithi047.stdout:0/799: dread d1/d5/d16/f94 [0,4194304] 0 2024-09-13T22:56:22.707 INFO:tasks.workunit.client.1.smithi047.stdout:8/827: creat d8/d64/d4e/d70/da7/f11f x:0 0 0 2024-09-13T22:56:22.711 INFO:tasks.workunit.client.1.smithi047.stdout:3/856: symlink d0/d3/d4/d16/d32/d42/d79/d9c/dad/d95/dc3/df6/l10c 0 2024-09-13T22:56:22.713 INFO:tasks.workunit.client.1.smithi047.stdout:2/834: truncate d1/df/d1d/da9/faf 1301052 0 2024-09-13T22:56:22.714 INFO:tasks.workunit.client.1.smithi047.stdout:9/812: mknod d1/dc/d14/dd/d54/d8d/dbc/c110 0 2024-09-13T22:56:22.715 INFO:tasks.workunit.client.1.smithi047.stdout:6/854: link d3/d11/d2b/cb4 d3/d77/d93/c118 0 2024-09-13T22:56:22.717 INFO:tasks.workunit.client.0.smithi002.stdout:0/768: dwrite d1/d4/f21 [0,4194304] 0 2024-09-13T22:56:22.719 INFO:tasks.workunit.client.0.smithi002.stdout:0/769: write d1/d4/d75/d31/d32/fdc [806715,93175] 0 2024-09-13T22:56:22.720 INFO:tasks.workunit.client.0.smithi002.stdout:0/770: chown d1/d4/da3/d7d/df8/c42 56877106 1 2024-09-13T22:56:22.722 INFO:tasks.workunit.client.0.smithi002.stdout:7/740: write d8/d10/d39/d60/fa6 [802160,98130] 0 2024-09-13T22:56:22.727 INFO:tasks.workunit.client.0.smithi002.stdout:5/778: mkdir d1/d2a/d6b/d88/d55/d56/d86/d11d 0 2024-09-13T22:56:22.730 INFO:tasks.workunit.client.1.smithi047.stdout:3/857: symlink d0/d3/d4/d16/d2c/de/d1f/d2e/l10d 0 2024-09-13T22:56:22.734 INFO:tasks.workunit.client.1.smithi047.stdout:9/813: mkdir d1/dd2/d111 0 2024-09-13T22:56:22.737 INFO:tasks.workunit.client.1.smithi047.stdout:6/855: mkdir d3/d11/d2b/d76/d119 0 2024-09-13T22:56:22.738 INFO:tasks.workunit.client.1.smithi047.stdout:0/800: dwrite d1/d5/d16/d97/dfc/d2d/f5a [0,4194304] 0 2024-09-13T22:56:22.739 INFO:tasks.workunit.client.0.smithi002.stdout:1/841: dwrite d1/d13/d21/d39/d70/d10c/d3d/d5d/f4e [0,4194304] 0 2024-09-13T22:56:22.739 INFO:tasks.workunit.client.1.smithi047.stdout:6/856: write d3/d11/f97 [873993,73160] 0 2024-09-13T22:56:22.748 INFO:tasks.workunit.client.0.smithi002.stdout:9/852: link d8/d1e/fb8 d8/d10/dc4/dd4/f11d 0 2024-09-13T22:56:22.749 INFO:tasks.workunit.client.1.smithi047.stdout:2/835: mkdir d1/de/d119 0 2024-09-13T22:56:22.749 INFO:tasks.workunit.client.0.smithi002.stdout:8/789: link d3/dc/d16/d60/da7/ccd d3/dc/d16/d2f/d83/d85/dc8/de3/df1/cf7 0 2024-09-13T22:56:22.756 INFO:tasks.workunit.client.0.smithi002.stdout:5/779: symlink d1/d2a/d6b/d88/d45/d4f/d8f/l11e 0 2024-09-13T22:56:22.757 INFO:tasks.workunit.client.1.smithi047.stdout:3/858: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/fd0 [139626,7832] 0 2024-09-13T22:56:22.758 INFO:tasks.workunit.client.1.smithi047.stdout:6/857: creat d3/d77/d8f/db9/f11a x:0 0 0 2024-09-13T22:56:22.760 INFO:tasks.workunit.client.0.smithi002.stdout:6/798: dwrite d12/d17/f91 [0,4194304] 0 2024-09-13T22:56:22.765 INFO:tasks.workunit.client.1.smithi047.stdout:0/801: write d1/d5/d16/d97/dfc/d2d/f61 [779171,75981] 0 2024-09-13T22:56:22.769 INFO:tasks.workunit.client.0.smithi002.stdout:6/799: dread d12/d17/d4e/fb4 [0,4194304] 0 2024-09-13T22:56:22.770 INFO:tasks.workunit.client.1.smithi047.stdout:4/907: sync 2024-09-13T22:56:22.771 INFO:tasks.workunit.client.1.smithi047.stdout:1/912: sync 2024-09-13T22:56:22.771 INFO:tasks.workunit.client.1.smithi047.stdout:7/768: sync 2024-09-13T22:56:22.771 INFO:tasks.workunit.client.1.smithi047.stdout:5/731: sync 2024-09-13T22:56:22.771 INFO:tasks.workunit.client.1.smithi047.stdout:3/859: mknod d0/d3/d4/d16/d32/d42/d79/d9c/dad/d95/dc3/df6/c10e 0 2024-09-13T22:56:22.773 INFO:tasks.workunit.client.1.smithi047.stdout:6/858: creat d3/d11/d2b/d4c/d9d/dac/f11b x:0 0 0 2024-09-13T22:56:22.775 INFO:tasks.workunit.client.0.smithi002.stdout:0/771: unlink d1/d4/d75/d31/d32/c92 0 2024-09-13T22:56:22.775 INFO:tasks.workunit.client.0.smithi002.stdout:8/790: dread d3/d27/d39/f5c [0,4194304] 0 2024-09-13T22:56:22.776 INFO:tasks.workunit.client.1.smithi047.stdout:6/859: readlink d3/d11/d2b/d7c/l8a 0 2024-09-13T22:56:22.776 INFO:tasks.workunit.client.1.smithi047.stdout:9/814: link d1/dc/d14/dd/dba/cfe d1/dc/d14/dd/d4c/c112 0 2024-09-13T22:56:22.777 INFO:tasks.workunit.client.0.smithi002.stdout:7/741: symlink d8/d10/d39/d60/db8/d2e/d50/d52/dab/dd9/ldd 0 2024-09-13T22:56:22.777 INFO:tasks.workunit.client.0.smithi002.stdout:8/791: chown d3/l12 84699416 1 2024-09-13T22:56:22.777 INFO:tasks.workunit.client.1.smithi047.stdout:2/836: dwrite d1/df/d1d/d20/d2b/f41 [4194304,4194304] 0 2024-09-13T22:56:22.778 INFO:tasks.workunit.client.0.smithi002.stdout:7/742: write d8/d10/d39/d60/db8/d2e/d3c/f48 [4128269,51909] 0 2024-09-13T22:56:22.778 INFO:tasks.workunit.client.1.smithi047.stdout:9/815: stat d1/dc/d14/dd/d54/d8d/fd9 0 2024-09-13T22:56:22.780 INFO:tasks.workunit.client.0.smithi002.stdout:3/835: link d9/d15/d36/d4e/fe2 d9/d15/d36/d4e/d5e/dae/de6/f125 0 2024-09-13T22:56:22.782 INFO:tasks.workunit.client.0.smithi002.stdout:3/836: chown d9/d15/d36/d4e/d5e/dae/d89/de5/f11c 457831 1 2024-09-13T22:56:22.788 INFO:tasks.workunit.client.1.smithi047.stdout:1/913: dread d0/d1d/daa/fe6 [0,4194304] 0 2024-09-13T22:56:22.791 INFO:tasks.workunit.client.1.smithi047.stdout:7/769: symlink d0/d7/da/d4e/dd1/l102 0 2024-09-13T22:56:22.794 INFO:tasks.workunit.client.1.smithi047.stdout:5/732: creat d19/d23/d2e/d41/d58/dbf/fe4 x:0 0 0 2024-09-13T22:56:22.795 INFO:tasks.workunit.client.1.smithi047.stdout:3/860: write d0/d3/d5e/ff4 [215171,41129] 0 2024-09-13T22:56:22.795 INFO:tasks.workunit.client.1.smithi047.stdout:8/828: getdents d8/d6b/da9/dc3 0 2024-09-13T22:56:22.796 INFO:tasks.workunit.client.1.smithi047.stdout:3/861: readlink d0/d3/d4/d16/d2c/de/l102 0 2024-09-13T22:56:22.797 INFO:tasks.workunit.client.1.smithi047.stdout:6/860: mkdir d3/d11/d2b/d1c/d4d/d69/dc2/d11c 0 2024-09-13T22:56:22.798 INFO:tasks.workunit.client.1.smithi047.stdout:6/861: fsync d3/d11/d2b/d1c/d23/f39 0 2024-09-13T22:56:22.799 INFO:tasks.workunit.client.1.smithi047.stdout:2/837: truncate d1/de/f13 1365829 0 2024-09-13T22:56:22.801 INFO:tasks.workunit.client.1.smithi047.stdout:9/816: mkdir d1/dc/d14/dd/d54/d4e/d51/d79/d113 0 2024-09-13T22:56:22.805 INFO:tasks.workunit.client.1.smithi047.stdout:6/862: dwrite d3/d77/d8f/db9/f108 [0,4194304] 0 2024-09-13T22:56:22.806 INFO:tasks.workunit.client.1.smithi047.stdout:9/817: dread d1/dc/d14/dd/d54/d50/d5b/fa6 [0,4194304] 0 2024-09-13T22:56:22.807 INFO:tasks.workunit.client.1.smithi047.stdout:7/770: fdatasync d0/d7/da/d2e/db5/f43 0 2024-09-13T22:56:22.811 INFO:tasks.workunit.client.1.smithi047.stdout:7/771: fdatasync d0/d7/da/d1e/de7/fea 0 2024-09-13T22:56:22.812 INFO:tasks.workunit.client.1.smithi047.stdout:3/862: mknod d0/c10f 0 2024-09-13T22:56:22.813 INFO:tasks.workunit.client.1.smithi047.stdout:3/863: readlink d0/d3/d4/d16/d2c/de/dcc/dd1/la4 0 2024-09-13T22:56:22.817 INFO:tasks.workunit.client.1.smithi047.stdout:2/838: fdatasync d1/df/d1d/d20/d37/df0/f105 0 2024-09-13T22:56:22.821 INFO:tasks.workunit.client.1.smithi047.stdout:4/908: getdents dc/d29/d8e/dda/d12f 0 2024-09-13T22:56:22.832 INFO:tasks.workunit.client.1.smithi047.stdout:5/733: creat d19/d64/ddd/de0/fe5 x:0 0 0 2024-09-13T22:56:22.838 INFO:tasks.workunit.client.0.smithi002.stdout:4/735: creat d3/d14/d29/d2a/da6/fed x:0 0 0 2024-09-13T22:56:22.838 INFO:tasks.workunit.client.0.smithi002.stdout:4/736: chown d3/d14/d86/db1/le1 0 1 2024-09-13T22:56:22.839 INFO:tasks.workunit.client.1.smithi047.stdout:1/914: truncate d0/d7/d14/d57/d62/d76/d94/fab 1662017 0 2024-09-13T22:56:22.839 INFO:tasks.workunit.client.1.smithi047.stdout:1/915: stat d0/d7/d13/d2d/fda 0 2024-09-13T22:56:22.840 INFO:tasks.workunit.client.1.smithi047.stdout:0/802: link d1/d5/l60 d1/d5/d16/d97/dfc/l105 0 2024-09-13T22:56:22.843 INFO:tasks.workunit.client.1.smithi047.stdout:4/909: mknod dc/de/d17/d25/d4a/d11c/c135 0 2024-09-13T22:56:22.845 INFO:tasks.workunit.client.1.smithi047.stdout:4/910: stat dc/de/d23/dc4/dc8/dc9/l105 0 2024-09-13T22:56:22.846 INFO:tasks.workunit.client.1.smithi047.stdout:9/818: mknod d1/d5f/dd4/c114 0 2024-09-13T22:56:22.848 INFO:tasks.workunit.client.1.smithi047.stdout:9/819: chown d1/d5f/d6a/lb9 285264884 1 2024-09-13T22:56:22.849 INFO:tasks.workunit.client.1.smithi047.stdout:0/803: dwrite d1/d5/d16/d97/dfc/d2d/f55 [0,4194304] 0 2024-09-13T22:56:22.850 INFO:tasks.workunit.client.0.smithi002.stdout:8/792: dread d3/dc/f13 [0,4194304] 0 2024-09-13T22:56:22.850 INFO:tasks.workunit.client.1.smithi047.stdout:5/734: rmdir d19/d23/d2e/d41/d58/dbf 39 2024-09-13T22:56:22.851 INFO:tasks.workunit.client.1.smithi047.stdout:5/735: readlink d19/d25/l2c 0 2024-09-13T22:56:22.854 INFO:tasks.workunit.client.1.smithi047.stdout:2/839: dread d1/df/d1d/d20/d37/fb1 [0,4194304] 0 2024-09-13T22:56:22.857 INFO:tasks.workunit.client.1.smithi047.stdout:8/829: creat d8/d3f/f120 x:0 0 0 2024-09-13T22:56:22.858 INFO:tasks.workunit.client.0.smithi002.stdout:2/778: link d1/d7/d35/ce5 d1/d4d/d8b/c10b 0 2024-09-13T22:56:22.863 INFO:tasks.workunit.client.0.smithi002.stdout:9/853: truncate d8/d10/d1c/d3d/f48 2157674 0 2024-09-13T22:56:22.864 INFO:tasks.workunit.client.1.smithi047.stdout:7/772: mkdir d0/d57/d5b/d8b/d103 0 2024-09-13T22:56:22.866 INFO:tasks.workunit.client.0.smithi002.stdout:3/837: symlink d9/d3b/da5/l126 0 2024-09-13T22:56:22.866 INFO:tasks.workunit.client.1.smithi047.stdout:3/864: mkdir d0/d3/d4/d16/d32/d110 0 2024-09-13T22:56:22.866 INFO:tasks.workunit.client.0.smithi002.stdout:1/842: dwrite d1/d13/d21/d39/d70/d10c/d3d/d5d/fca [0,4194304] 0 2024-09-13T22:56:22.869 INFO:tasks.workunit.client.1.smithi047.stdout:1/916: readlink d0/d7/d14/d28/d36/l1c 0 2024-09-13T22:56:22.869 INFO:tasks.workunit.client.1.smithi047.stdout:0/804: dread d1/d5/d16/d97/db6/f101 [4194304,4194304] 0 2024-09-13T22:56:22.871 INFO:tasks.workunit.client.0.smithi002.stdout:4/737: mknod d3/d14/d29/d2a/da6/d69/cee 0 2024-09-13T22:56:22.878 INFO:tasks.workunit.client.0.smithi002.stdout:8/793: mkdir d3/d21/d57/da1/df8 0 2024-09-13T22:56:22.880 INFO:tasks.workunit.client.0.smithi002.stdout:5/780: sync 2024-09-13T22:56:22.881 INFO:tasks.workunit.client.1.smithi047.stdout:9/820: symlink d1/dc/d14/dd/d54/d4e/l115 0 2024-09-13T22:56:22.881 INFO:tasks.workunit.client.0.smithi002.stdout:2/779: fdatasync d1/da9/f106 0 2024-09-13T22:56:22.885 INFO:tasks.workunit.client.0.smithi002.stdout:7/743: link d8/d10/f45 d8/d10/d39/d60/db8/d2e/d50/d52/d58/fde 0 2024-09-13T22:56:22.886 INFO:tasks.workunit.client.0.smithi002.stdout:7/744: chown d8/d10/d39/d60/db8/d26/d4c/d81/db5/fd1 13 1 2024-09-13T22:56:22.887 INFO:tasks.workunit.client.1.smithi047.stdout:8/830: write d8/d64/d4e/d4d/fe6 [5670265,129356] 0 2024-09-13T22:56:22.889 INFO:tasks.workunit.client.1.smithi047.stdout:7/773: chown d0/d7/da/d1e/f24 1 1 2024-09-13T22:56:22.891 INFO:tasks.workunit.client.0.smithi002.stdout:1/843: mknod d1/d13/d1d/d34/dfe/c11e 0 2024-09-13T22:56:22.892 INFO:tasks.workunit.client.1.smithi047.stdout:4/911: write dc/de/f52 [3123437,77369] 0 2024-09-13T22:56:22.895 INFO:tasks.workunit.client.0.smithi002.stdout:6/800: link d12/d17/f91 d12/d17/d28/d67/dca/ffc 0 2024-09-13T22:56:22.897 INFO:tasks.workunit.client.0.smithi002.stdout:8/794: symlink d3/dc/d16/d2f/d83/d85/dc8/lf9 0 2024-09-13T22:56:22.897 INFO:tasks.workunit.client.0.smithi002.stdout:0/772: truncate d1/d4/d75/d31/d32/dbb/fc9 419494 0 2024-09-13T22:56:22.899 INFO:tasks.workunit.client.0.smithi002.stdout:5/781: creat d1/d2a/d6b/d88/d45/d4f/d78/d8b/f11f x:0 0 0 2024-09-13T22:56:22.899 INFO:tasks.workunit.client.1.smithi047.stdout:6/863: link d3/d77/d93/c118 d3/d11/d2b/d1c/d23/c11d 0 2024-09-13T22:56:22.901 INFO:tasks.workunit.client.0.smithi002.stdout:2/780: creat d1/d7/d35/d3e/df8/f10c x:0 0 0 2024-09-13T22:56:22.903 INFO:tasks.workunit.client.1.smithi047.stdout:2/840: dwrite d1/df/d1d/d20/d54/f5c [0,4194304] 0 2024-09-13T22:56:22.904 INFO:tasks.workunit.client.0.smithi002.stdout:7/745: mkdir d8/d10/d39/d60/db8/d2e/d50/d52/d58/ddf 0 2024-09-13T22:56:22.906 INFO:tasks.workunit.client.1.smithi047.stdout:9/821: unlink d1/dc/d14/dd/ld7 0 2024-09-13T22:56:22.908 INFO:tasks.workunit.client.0.smithi002.stdout:8/795: dread d3/d27/fc6 [0,4194304] 0 2024-09-13T22:56:22.909 INFO:tasks.workunit.client.0.smithi002.stdout:1/844: creat d1/d13/d21/d39/d70/d10c/d3b/d71/d80/d112/d9e/f11f x:0 0 0 2024-09-13T22:56:22.910 INFO:tasks.workunit.client.0.smithi002.stdout:6/801: fsync d12/d17/d2a/d88/ff7 0 2024-09-13T22:56:22.912 INFO:tasks.workunit.client.1.smithi047.stdout:3/865: creat d0/d3/d4/d16/d32/d42/dbd/f111 x:0 0 0 2024-09-13T22:56:22.915 INFO:tasks.workunit.client.0.smithi002.stdout:5/782: truncate d1/d2a/d6b/d88/d45/d4f/d8f/dd5/fd7 4280724 0 2024-09-13T22:56:22.917 INFO:tasks.workunit.client.1.smithi047.stdout:0/805: unlink d1/d5/d16/d97/leb 0 2024-09-13T22:56:22.921 INFO:tasks.workunit.client.0.smithi002.stdout:9/854: rename d8/d1e/fc7 to d8/d10/f11e 0 2024-09-13T22:56:22.923 INFO:tasks.workunit.client.0.smithi002.stdout:7/746: rmdir d8/d10/d39/d60/db8/d26/d4c/d81/db6 39 2024-09-13T22:56:22.923 INFO:tasks.workunit.client.0.smithi002.stdout:7/747: stat d8/d10/d39/d60/db8/f79 0 2024-09-13T22:56:22.924 INFO:tasks.workunit.client.0.smithi002.stdout:7/748: chown d8/d10/d39/d60/db8/d26/d4c/d81/d51/da9/cbe 16648220 1 2024-09-13T22:56:22.925 INFO:tasks.workunit.client.1.smithi047.stdout:9/822: mkdir d1/dc/d14/dd/d54/d50/d91/d116 0 2024-09-13T22:56:22.925 INFO:tasks.workunit.client.1.smithi047.stdout:9/823: stat d1/dc/d14/dd/dba 0 2024-09-13T22:56:22.928 INFO:tasks.workunit.client.0.smithi002.stdout:1/845: mkdir d1/d13/d30/d73/d120 0 2024-09-13T22:56:22.930 INFO:tasks.workunit.client.0.smithi002.stdout:8/796: truncate d3/dc/d16/d4b/f6c 3753047 0 2024-09-13T22:56:22.931 INFO:tasks.workunit.client.0.smithi002.stdout:8/797: stat d3/dc/d18/d2e/d94 0 2024-09-13T22:56:22.933 INFO:tasks.workunit.client.0.smithi002.stdout:8/798: chown d3/dc/d16/d4b/d72/lc7 1159709605 1 2024-09-13T22:56:22.933 INFO:tasks.workunit.client.1.smithi047.stdout:9/824: dwrite d1/dc/d14/dd/d54/d50/d5b/d9e/d101/f102 [0,4194304] 0 2024-09-13T22:56:22.933 INFO:tasks.workunit.client.0.smithi002.stdout:1/846: dwrite d1/f63 [8388608,4194304] 0 2024-09-13T22:56:22.934 INFO:tasks.workunit.client.0.smithi002.stdout:8/799: stat d3/dc/d18/d2e/d94/l7a 0 2024-09-13T22:56:22.938 INFO:tasks.workunit.client.0.smithi002.stdout:0/773: mkdir d1/d4/d114 0 2024-09-13T22:56:22.942 INFO:tasks.workunit.client.0.smithi002.stdout:8/800: dread d3/dc/d16/d4b/fb3 [0,4194304] 0 2024-09-13T22:56:22.945 INFO:tasks.workunit.client.0.smithi002.stdout:5/783: creat d1/d2a/d6b/d88/d45/d4f/f120 x:0 0 0 2024-09-13T22:56:22.947 INFO:tasks.workunit.client.0.smithi002.stdout:2/781: mknod d1/d7/d41/d96/c10d 0 2024-09-13T22:56:22.949 INFO:tasks.workunit.client.1.smithi047.stdout:2/841: dwrite d1/f1a [4194304,4194304] 0 2024-09-13T22:56:22.952 INFO:tasks.workunit.client.1.smithi047.stdout:4/912: dread dc/de/d17/d70/fb8 [4194304,4194304] 0 2024-09-13T22:56:22.953 INFO:tasks.workunit.client.1.smithi047.stdout:8/831: rename d8/d6b/da9/fc0 to d8/d64/f121 0 2024-09-13T22:56:22.955 INFO:tasks.workunit.client.0.smithi002.stdout:3/838: rename d9/d3b/d53/d95/la1 to d9/df/l127 0 2024-09-13T22:56:22.957 INFO:tasks.workunit.client.0.smithi002.stdout:3/839: chown d9/d15/d36/d4e/d5e/dae/d89/df7/lfb 150 1 2024-09-13T22:56:22.960 INFO:tasks.workunit.client.1.smithi047.stdout:7/774: creat d0/f104 x:0 0 0 2024-09-13T22:56:22.961 INFO:tasks.workunit.client.0.smithi002.stdout:4/738: getdents d3/db3/db9 0 2024-09-13T22:56:22.963 INFO:tasks.workunit.client.0.smithi002.stdout:6/802: unlink d12/d17/d34/fb2 0 2024-09-13T22:56:22.964 INFO:tasks.workunit.client.1.smithi047.stdout:1/917: getdents d0/d1d/daa/df0 0 2024-09-13T22:56:22.965 INFO:tasks.workunit.client.0.smithi002.stdout:6/803: dread d12/d17/d28/fcf [0,4194304] 0 2024-09-13T22:56:22.966 INFO:tasks.workunit.client.0.smithi002.stdout:1/847: mknod d1/d13/d21/d39/d70/c121 0 2024-09-13T22:56:22.971 INFO:tasks.workunit.client.1.smithi047.stdout:1/918: dwrite d0/d7/d13/d8c/fb4 [0,4194304] 0 2024-09-13T22:56:22.972 INFO:tasks.workunit.client.1.smithi047.stdout:1/919: chown d0/d7/db 190447 1 2024-09-13T22:56:22.974 INFO:tasks.workunit.client.0.smithi002.stdout:0/774: rmdir d1/d4 39 2024-09-13T22:56:22.976 INFO:tasks.workunit.client.1.smithi047.stdout:0/806: mknod d1/d5/d16/dc0/c106 0 2024-09-13T22:56:22.977 INFO:tasks.workunit.client.1.smithi047.stdout:5/736: link d19/d23/d32/c3e d19/d34/d6c/ce6 0 2024-09-13T22:56:22.978 INFO:tasks.workunit.client.1.smithi047.stdout:5/737: chown d19/d23/d2e/d41/d58 1006 1 2024-09-13T22:56:22.979 INFO:tasks.workunit.client.0.smithi002.stdout:8/801: rmdir d3/dc/d18/d6f 39 2024-09-13T22:56:22.982 INFO:tasks.workunit.client.0.smithi002.stdout:5/784: creat d1/d2a/d6b/d88/d55/d56/de4/f121 x:0 0 0 2024-09-13T22:56:22.988 INFO:tasks.workunit.client.0.smithi002.stdout:9/855: rename d8/d91 to d8/d10/d1c/d3d/d11f 0 2024-09-13T22:56:22.989 INFO:tasks.workunit.client.1.smithi047.stdout:6/864: rename d3/d11/d2b/d1c/fa8 to d3/d77/d93/f11e 0 2024-09-13T22:56:22.998 INFO:tasks.workunit.client.1.smithi047.stdout:3/866: creat d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/f112 x:0 0 0 2024-09-13T22:56:22.998 INFO:tasks.workunit.client.0.smithi002.stdout:3/840: write d9/d15/d36/d4e/fe2 [276207,49957] 0 2024-09-13T22:56:22.999 INFO:tasks.workunit.client.0.smithi002.stdout:3/841: chown d9/d15/d36/d4e/d5e/dae/d89/de5/de7/ffd 22 1 2024-09-13T22:56:23.001 INFO:tasks.workunit.client.1.smithi047.stdout:0/807: creat d1/d5/d16/dc0/f107 x:0 0 0 2024-09-13T22:56:23.003 INFO:tasks.workunit.client.0.smithi002.stdout:7/749: dwrite d8/d10/d39/d60/db8/d2e/d50/d52/d72/f8c [0,4194304] 0 2024-09-13T22:56:23.006 INFO:tasks.workunit.client.0.smithi002.stdout:7/750: write d8/d10/d39/d60/db8/d26/f92 [1828912,63756] 0 2024-09-13T22:56:23.007 INFO:tasks.workunit.client.1.smithi047.stdout:9/825: dwrite d1/dc/d14/dd/d54/d50/d5b/d9e/f81 [0,4194304] 0 2024-09-13T22:56:23.007 INFO:tasks.workunit.client.0.smithi002.stdout:8/802: dread - d3/d27/fb6 zero size 2024-09-13T22:56:23.010 INFO:tasks.workunit.client.1.smithi047.stdout:6/865: creat d3/d11/d2b/d4c/de2/f11f x:0 0 0 2024-09-13T22:56:23.011 INFO:tasks.workunit.client.0.smithi002.stdout:5/785: mkdir d1/d57/dd0/df7/d122 0 2024-09-13T22:56:23.013 INFO:tasks.workunit.client.1.smithi047.stdout:5/738: dwrite d19/d25/d45/da3/fb8 [0,4194304] 0 2024-09-13T22:56:23.017 INFO:tasks.workunit.client.0.smithi002.stdout:9/856: mkdir d8/d10/d1c/d3d/d11f/da3/db9/dfa/d87/da5/d120 0 2024-09-13T22:56:23.021 INFO:tasks.workunit.client.1.smithi047.stdout:2/842: link d1/df/le2 d1/df/d1d/d20/d2b/l11a 0 2024-09-13T22:56:23.021 INFO:tasks.workunit.client.1.smithi047.stdout:8/832: creat d8/d3f/f122 x:0 0 0 2024-09-13T22:56:23.022 INFO:tasks.workunit.client.0.smithi002.stdout:3/842: creat d9/d15/d36/d4e/d5e/dae/de6/f128 x:0 0 0 2024-09-13T22:56:23.023 INFO:tasks.workunit.client.1.smithi047.stdout:8/833: dread - d8/d77/de3/f115 zero size 2024-09-13T22:56:23.024 INFO:tasks.workunit.client.0.smithi002.stdout:1/848: dread d1/d13/d21/faa [0,4194304] 0 2024-09-13T22:56:23.025 INFO:tasks.workunit.client.1.smithi047.stdout:1/920: dread d0/d7/d14/d28/d36/f3d [0,4194304] 0 2024-09-13T22:56:23.026 INFO:tasks.workunit.client.1.smithi047.stdout:4/913: dwrite dc/d29/d6c/fad [0,4194304] 0 2024-09-13T22:56:23.026 INFO:tasks.workunit.client.1.smithi047.stdout:3/867: truncate d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/fc6 443265 0 2024-09-13T22:56:23.028 INFO:tasks.workunit.client.0.smithi002.stdout:7/751: dread d8/d10/d39/d60/db8/f21 [0,4194304] 0 2024-09-13T22:56:23.029 INFO:tasks.workunit.client.1.smithi047.stdout:9/826: mknod d1/dc/d14/dd/d54/d8d/dbc/c117 0 2024-09-13T22:56:23.030 INFO:tasks.workunit.client.0.smithi002.stdout:3/843: dwrite d9/d15/f11d [0,4194304] 0 2024-09-13T22:56:23.031 INFO:tasks.workunit.client.1.smithi047.stdout:6/866: mkdir d3/d77/d8f/db9/d120 0 2024-09-13T22:56:23.031 INFO:tasks.workunit.client.0.smithi002.stdout:3/844: dread - d9/d15/d36/d4e/d5e/dae/d89/f123 zero size 2024-09-13T22:56:23.032 INFO:tasks.workunit.client.0.smithi002.stdout:8/803: rmdir d3/d27 39 2024-09-13T22:56:23.035 INFO:tasks.workunit.client.1.smithi047.stdout:0/808: mknod d1/d5/d16/d97/dfc/c108 0 2024-09-13T22:56:23.037 INFO:tasks.workunit.client.0.smithi002.stdout:3/845: dread d9/df/f7d [0,4194304] 0 2024-09-13T22:56:23.038 INFO:tasks.workunit.client.0.smithi002.stdout:9/857: rmdir d8/d10/d1c/d3d/d11f/da3 39 2024-09-13T22:56:23.038 INFO:tasks.workunit.client.0.smithi002.stdout:9/858: readlink d8/d10/db1/ldc 0 2024-09-13T22:56:23.039 INFO:tasks.workunit.client.0.smithi002.stdout:9/859: readlink d8/d10/d1c/d68/d74/lb2 0 2024-09-13T22:56:23.041 INFO:tasks.workunit.client.1.smithi047.stdout:7/775: rename d0/d57/d5b/d8b/d95 to d0/d7/da/d105 0 2024-09-13T22:56:23.043 INFO:tasks.workunit.client.1.smithi047.stdout:7/776: fsync d0/d7/da/d1e/d93/db7/ffc 0 2024-09-13T22:56:23.045 INFO:tasks.workunit.client.1.smithi047.stdout:8/834: creat d8/d64/d4e/dbd/f123 x:0 0 0 2024-09-13T22:56:23.046 INFO:tasks.workunit.client.0.smithi002.stdout:6/804: sync 2024-09-13T22:56:23.055 INFO:tasks.workunit.client.1.smithi047.stdout:2/843: write d1/de/f33 [3532472,6628] 0 2024-09-13T22:56:23.058 INFO:tasks.workunit.client.1.smithi047.stdout:4/914: write dc/de/f18 [686451,29880] 0 2024-09-13T22:56:23.059 INFO:tasks.workunit.client.1.smithi047.stdout:0/809: fsync d1/d5/d16/fdc 0 2024-09-13T22:56:23.063 INFO:tasks.workunit.client.0.smithi002.stdout:2/782: getdents d1/d7/d35/d78/dfc/d6b/d75 0 2024-09-13T22:56:23.067 INFO:tasks.workunit.client.0.smithi002.stdout:9/860: symlink d8/d2c/dbc/dc8/l121 0 2024-09-13T22:56:23.067 INFO:tasks.workunit.client.0.smithi002.stdout:4/739: getdents d3/d14/d29/d2a/da6/d69/d7e 0 2024-09-13T22:56:23.069 INFO:tasks.workunit.client.0.smithi002.stdout:0/775: getdents d1/d2/d6c 0 2024-09-13T22:56:23.071 INFO:tasks.workunit.client.0.smithi002.stdout:7/752: mkdir d8/d10/d39/d60/db8/d2e/d3c/dcf/de0 0 2024-09-13T22:56:23.073 INFO:tasks.workunit.client.0.smithi002.stdout:8/804: mknod d3/dc/cfa 0 2024-09-13T22:56:23.076 INFO:tasks.workunit.client.0.smithi002.stdout:3/846: dwrite d9/d15/d26/f29 [8388608,4194304] 0 2024-09-13T22:56:23.077 INFO:tasks.workunit.client.0.smithi002.stdout:4/740: dwrite d3/fda [0,4194304] 0 2024-09-13T22:56:23.078 INFO:tasks.workunit.client.0.smithi002.stdout:3/847: write d9/d15/d51/f37 [1340418,101977] 0 2024-09-13T22:56:23.079 INFO:tasks.workunit.client.0.smithi002.stdout:9/861: symlink d8/d10/d61/de4/l122 0 2024-09-13T22:56:23.082 INFO:tasks.workunit.client.0.smithi002.stdout:3/848: chown d9/d15/d51/l3e 0 1 2024-09-13T22:56:23.082 INFO:tasks.workunit.client.0.smithi002.stdout:5/786: getdents d1/de7 0 2024-09-13T22:56:23.083 INFO:tasks.workunit.client.0.smithi002.stdout:8/805: creat d3/dc/d16/d2f/d83/d85/ffb x:0 0 0 2024-09-13T22:56:23.083 INFO:tasks.workunit.client.0.smithi002.stdout:7/753: truncate d8/d10/d39/d60/db8/d26/d4c/f64 2755046 0 2024-09-13T22:56:23.085 INFO:tasks.workunit.client.0.smithi002.stdout:4/741: dread - d3/d14/d29/d2a/da6/d5e/f94 zero size 2024-09-13T22:56:23.086 INFO:tasks.workunit.client.0.smithi002.stdout:1/849: getdents d1/d13/d30/d73/da1/d9d 0 2024-09-13T22:56:23.088 INFO:tasks.workunit.client.0.smithi002.stdout:1/850: readlink d1/d13/d21/d39/d70/d10c/lb1 0 2024-09-13T22:56:23.091 INFO:tasks.workunit.client.0.smithi002.stdout:1/851: fdatasync d1/d13/d21/d39/f9c 0 2024-09-13T22:56:23.092 INFO:tasks.workunit.client.0.smithi002.stdout:8/806: mkdir d3/d21/d57/da1/dbc/dfc 0 2024-09-13T22:56:23.092 INFO:tasks.workunit.client.0.smithi002.stdout:4/742: unlink d3/d62/fbf 0 2024-09-13T22:56:23.094 INFO:tasks.workunit.client.0.smithi002.stdout:9/862: dwrite d8/d10/db1/fef [0,4194304] 0 2024-09-13T22:56:23.102 INFO:tasks.workunit.client.0.smithi002.stdout:4/743: creat d3/db3/fef x:0 0 0 2024-09-13T22:56:23.102 INFO:tasks.workunit.client.0.smithi002.stdout:8/807: creat d3/dc/d16/d2f/d83/d85/ffd x:0 0 0 2024-09-13T22:56:23.105 INFO:tasks.workunit.client.0.smithi002.stdout:7/754: creat d8/d10/d11/fe1 x:0 0 0 2024-09-13T22:56:23.106 INFO:tasks.workunit.client.0.smithi002.stdout:7/755: chown d8/d10/d39/d60 3 1 2024-09-13T22:56:23.107 INFO:tasks.workunit.client.0.smithi002.stdout:0/776: rename d1/d4/da3/d7d/f10b to d1/d4/f115 0 2024-09-13T22:56:23.113 INFO:tasks.workunit.client.0.smithi002.stdout:9/863: truncate d8/d10/dc4/dd4/f11d 1783545 0 2024-09-13T22:56:23.113 INFO:tasks.workunit.client.0.smithi002.stdout:3/849: link d9/d15/d51/f18 d9/d3b/d53/d95/f129 0 2024-09-13T22:56:23.114 INFO:tasks.workunit.client.0.smithi002.stdout:2/783: dwrite d1/d32/d37/f73 [0,4194304] 0 2024-09-13T22:56:23.114 INFO:tasks.workunit.client.0.smithi002.stdout:5/787: rename d1/d10/f4b to d1/d2a/d6b/d88/d55/d56/d86/f123 0 2024-09-13T22:56:23.114 INFO:tasks.workunit.client.0.smithi002.stdout:0/777: mknod d1/d7e/d9d/de3/c116 0 2024-09-13T22:56:23.115 INFO:tasks.workunit.client.0.smithi002.stdout:4/744: mknod d3/d40/cf0 0 2024-09-13T22:56:23.119 INFO:tasks.workunit.client.0.smithi002.stdout:5/788: rmdir d1/d57/dd0/df7/d101 39 2024-09-13T22:56:23.119 INFO:tasks.workunit.client.0.smithi002.stdout:4/745: fdatasync d3/d14/d29/d2a/dbc/fec 0 2024-09-13T22:56:23.122 INFO:tasks.workunit.client.0.smithi002.stdout:3/850: mknod d9/d15/d36/d4e/d5e/dc0/c12a 0 2024-09-13T22:56:23.125 INFO:tasks.workunit.client.0.smithi002.stdout:9/864: rename d8/d2c/d50/c71 to d8/d10/d42/ddd/c123 0 2024-09-13T22:56:23.125 INFO:tasks.workunit.client.0.smithi002.stdout:1/852: dwrite d1/d13/d21/d39/d70/d10c/f41 [0,4194304] 0 2024-09-13T22:56:23.127 INFO:tasks.workunit.client.0.smithi002.stdout:0/778: write d1/d4/d75/d31/d32/dbb/de1/f103 [723718,103921] 0 2024-09-13T22:56:23.128 INFO:tasks.workunit.client.0.smithi002.stdout:5/789: creat d1/d2a/d6b/d88/d55/d56/de4/f124 x:0 0 0 2024-09-13T22:56:23.129 INFO:tasks.workunit.client.0.smithi002.stdout:4/746: symlink d3/d14/d29/d2a/da6/d69/d7e/lf1 0 2024-09-13T22:56:23.133 INFO:tasks.workunit.client.0.smithi002.stdout:7/756: write d8/d10/d39/d60/db8/d26/d4c/d81/d51/f86 [98131,255] 0 2024-09-13T22:56:23.136 INFO:tasks.workunit.client.0.smithi002.stdout:0/779: truncate d1/d4/d75/d31/fcd 1960170 0 2024-09-13T22:56:23.137 INFO:tasks.workunit.client.0.smithi002.stdout:1/853: mknod d1/d13/d21/d39/d70/d10c/d3b/d71/d80/d112/c122 0 2024-09-13T22:56:23.139 INFO:tasks.workunit.client.0.smithi002.stdout:5/790: fsync d1/d2a/d6b/d88/f74 0 2024-09-13T22:56:23.142 INFO:tasks.workunit.client.0.smithi002.stdout:1/854: creat d1/d13/d21/d39/d70/d10c/d3d/f123 x:0 0 0 2024-09-13T22:56:23.145 INFO:tasks.workunit.client.0.smithi002.stdout:5/791: unlink d1/d2a/d6b/d88/d55/fcf 0 2024-09-13T22:56:23.146 INFO:tasks.workunit.client.0.smithi002.stdout:2/784: dread d1/d4d/d8b/de1/f5a [0,4194304] 0 2024-09-13T22:56:23.147 INFO:tasks.workunit.client.0.smithi002.stdout:9/865: getdents d8/d10/d1c/dd6/dda 0 2024-09-13T22:56:23.148 INFO:tasks.workunit.client.0.smithi002.stdout:4/747: write d3/d14/d29/d2a/da6/d5e/f94 [27343,95457] 0 2024-09-13T22:56:23.149 INFO:tasks.workunit.client.0.smithi002.stdout:4/748: chown d3/fda 1 1 2024-09-13T22:56:23.150 INFO:tasks.workunit.client.0.smithi002.stdout:5/792: read d1/fe [5369297,90916] 0 2024-09-13T22:56:23.151 INFO:tasks.workunit.client.0.smithi002.stdout:1/855: mkdir d1/d13/d1d/d105/d124 0 2024-09-13T22:56:23.152 INFO:tasks.workunit.client.0.smithi002.stdout:7/757: dwrite d8/d10/d39/d60/db8/d2e/d50/d85/fb0 [0,4194304] 0 2024-09-13T22:56:23.153 INFO:tasks.workunit.client.0.smithi002.stdout:5/793: fsync d1/d2a/d6b/d88/f4d 0 2024-09-13T22:56:23.156 INFO:tasks.workunit.client.1.smithi047.stdout:5/739: rename d19/d23/d2e/d41/f9c to d19/d83/d98/fe7 0 2024-09-13T22:56:23.157 INFO:tasks.workunit.client.1.smithi047.stdout:7/777: write d0/d19/f77 [2331791,91077] 0 2024-09-13T22:56:23.158 INFO:tasks.workunit.client.0.smithi002.stdout:4/749: mknod d3/d14/d29/d2a/cf2 0 2024-09-13T22:56:23.158 INFO:tasks.workunit.client.1.smithi047.stdout:5/740: chown d19/d23/d4c/f7b 337729098 1 2024-09-13T22:56:23.160 INFO:tasks.workunit.client.1.smithi047.stdout:0/810: creat d1/d5/d16/d97/f109 x:0 0 0 2024-09-13T22:56:23.160 INFO:tasks.workunit.client.1.smithi047.stdout:3/868: dwrite d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d85/fab [0,4194304] 0 2024-09-13T22:56:23.161 INFO:tasks.workunit.client.0.smithi002.stdout:4/750: readlink d3/d14/d29/d2a/d30/la1 0 2024-09-13T22:56:23.164 INFO:tasks.workunit.client.0.smithi002.stdout:4/751: chown d3/d14/d29/fdc 48094090 1 2024-09-13T22:56:23.164 INFO:tasks.workunit.client.0.smithi002.stdout:5/794: dwrite d1/d57/fff [0,4194304] 0 2024-09-13T22:56:23.165 INFO:tasks.workunit.client.0.smithi002.stdout:0/780: dwrite d1/d2/d81/fc7 [0,4194304] 0 2024-09-13T22:56:23.166 INFO:tasks.workunit.client.1.smithi047.stdout:1/921: creat d0/d7/f109 x:0 0 0 2024-09-13T22:56:23.167 INFO:tasks.workunit.client.1.smithi047.stdout:4/915: dread dc/de/d23/d40/d7b/dab/dae/f12b [0,4194304] 0 2024-09-13T22:56:23.173 INFO:tasks.workunit.client.0.smithi002.stdout:1/856: mknod d1/d13/d21/d40/ddc/c125 0 2024-09-13T22:56:23.178 INFO:tasks.workunit.client.0.smithi002.stdout:9/866: dwrite d8/d10/d1c/fcf [0,4194304] 0 2024-09-13T22:56:23.178 INFO:tasks.workunit.client.0.smithi002.stdout:0/781: dread d1/d4/d75/d31/d32/dbb/de1/f103 [0,4194304] 0 2024-09-13T22:56:23.178 INFO:tasks.workunit.client.1.smithi047.stdout:7/778: fsync d0/d57/d5b/d8b/fb8 0 2024-09-13T22:56:23.179 INFO:tasks.workunit.client.0.smithi002.stdout:1/857: truncate d1/d13/d21/d39/d70/de2/fe9 381418 0 2024-09-13T22:56:23.179 INFO:tasks.workunit.client.1.smithi047.stdout:7/779: stat d0/d7/da/d2e/d64/fc3 0 2024-09-13T22:56:23.179 INFO:tasks.workunit.client.0.smithi002.stdout:2/785: dread d1/d7/d8/d2c/da4/ffd [0,4194304] 0 2024-09-13T22:56:23.180 INFO:tasks.workunit.client.1.smithi047.stdout:5/741: fsync d19/d83/d98/fe7 0 2024-09-13T22:56:23.183 INFO:tasks.workunit.client.1.smithi047.stdout:0/811: symlink d1/d5/d16/d97/dfc/d77/l10a 0 2024-09-13T22:56:23.185 INFO:tasks.workunit.client.0.smithi002.stdout:7/758: creat d8/d10/d39/d60/db8/d26/d4c/d81/db6/fe2 x:0 0 0 2024-09-13T22:56:23.185 INFO:tasks.workunit.client.1.smithi047.stdout:1/922: symlink d0/d1d/d7f/l10a 0 2024-09-13T22:56:23.187 INFO:tasks.workunit.client.1.smithi047.stdout:9/827: getdents d1/d5f 0 2024-09-13T22:56:23.187 INFO:tasks.workunit.client.0.smithi002.stdout:7/759: read f7 [180927,141] 0 2024-09-13T22:56:23.188 INFO:tasks.workunit.client.1.smithi047.stdout:9/828: readlink d1/dc/d14/dd/d54/d4e/l8a 0 2024-09-13T22:56:23.189 INFO:tasks.workunit.client.0.smithi002.stdout:7/760: chown d8/d10/d39/d60/db8/d26/d4c/d81/fd 39 1 2024-09-13T22:56:23.189 INFO:tasks.workunit.client.0.smithi002.stdout:5/795: dread d1/f36 [0,4194304] 0 2024-09-13T22:56:23.190 INFO:tasks.workunit.client.0.smithi002.stdout:1/858: unlink d1/d13/d21/f8c 0 2024-09-13T22:56:23.191 INFO:tasks.workunit.client.0.smithi002.stdout:7/761: truncate d8/d10/d39/d60/db8/d26/d4c/f4e 4971058 0 2024-09-13T22:56:23.192 INFO:tasks.workunit.client.1.smithi047.stdout:6/867: getdents d3 0 2024-09-13T22:56:23.194 INFO:tasks.workunit.client.0.smithi002.stdout:2/786: fdatasync d1/d7/d8/d2c/f101 0 2024-09-13T22:56:23.195 INFO:tasks.workunit.client.0.smithi002.stdout:6/805: sync 2024-09-13T22:56:23.196 INFO:tasks.workunit.client.1.smithi047.stdout:7/780: unlink d0/d7/f2c 0 2024-09-13T22:56:23.196 INFO:tasks.workunit.client.1.smithi047.stdout:2/844: dwrite d1/df/d1d/d20/d29/f2d [0,4194304] 0 2024-09-13T22:56:23.197 INFO:tasks.workunit.client.0.smithi002.stdout:4/752: write d3/f10 [1551648,63704] 0 2024-09-13T22:56:23.202 INFO:tasks.workunit.client.1.smithi047.stdout:5/742: read - d19/d23/d2e/d41/d58/dbf/fd6 zero size 2024-09-13T22:56:23.203 INFO:tasks.workunit.client.0.smithi002.stdout:9/867: mkdir d8/d10/d1c/dd6/d10a/d124 0 2024-09-13T22:56:23.204 INFO:tasks.workunit.client.0.smithi002.stdout:9/868: dread - d8/d10/d42/ddd/f10d zero size 2024-09-13T22:56:23.205 INFO:tasks.workunit.client.0.smithi002.stdout:9/869: dread - d8/d10/d1c/dd6/ff8 zero size 2024-09-13T22:56:23.206 INFO:tasks.workunit.client.1.smithi047.stdout:4/916: write dc/de/d17/d25/d9b/fe9 [364868,10086] 0 2024-09-13T22:56:23.210 INFO:tasks.workunit.client.1.smithi047.stdout:3/869: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/fca [198180,55498] 0 2024-09-13T22:56:23.211 INFO:tasks.workunit.client.0.smithi002.stdout:1/859: fsync d1/d13/f68 0 2024-09-13T22:56:23.213 INFO:tasks.workunit.client.0.smithi002.stdout:7/762: creat d8/d10/fe3 x:0 0 0 2024-09-13T22:56:23.213 INFO:tasks.workunit.client.1.smithi047.stdout:6/868: creat d3/d11/d2b/d4c/dc0/f121 x:0 0 0 2024-09-13T22:56:23.214 INFO:tasks.workunit.client.0.smithi002.stdout:7/763: write d8/d10/d39/d60/f7a [35862,120668] 0 2024-09-13T22:56:23.218 INFO:tasks.workunit.client.1.smithi047.stdout:7/781: rmdir d0/db/de8 39 2024-09-13T22:56:23.221 INFO:tasks.workunit.client.1.smithi047.stdout:5/743: creat d19/d23/d2e/d41/d58/d77/fe8 x:0 0 0 2024-09-13T22:56:23.222 INFO:tasks.workunit.client.0.smithi002.stdout:9/870: dread d8/d10/db1/ffe [0,4194304] 0 2024-09-13T22:56:23.223 INFO:tasks.workunit.client.0.smithi002.stdout:4/753: dread d3/d14/d29/d2a/d30/f58 [0,4194304] 0 2024-09-13T22:56:23.224 INFO:tasks.workunit.client.0.smithi002.stdout:5/796: mkdir d1/d2a/d6b/d88/d125 0 2024-09-13T22:56:23.224 INFO:tasks.workunit.client.1.smithi047.stdout:4/917: creat dc/da3/f136 x:0 0 0 2024-09-13T22:56:23.225 INFO:tasks.workunit.client.0.smithi002.stdout:6/806: dwrite d12/d17/d28/d67/d6b/f69 [0,4194304] 0 2024-09-13T22:56:23.227 INFO:tasks.workunit.client.0.smithi002.stdout:6/807: chown d12/d17/d34/d39/d8b/fa3 927 1 2024-09-13T22:56:23.229 INFO:tasks.workunit.client.0.smithi002.stdout:6/808: write d12/f24 [1960108,128778] 0 2024-09-13T22:56:23.234 INFO:tasks.workunit.client.1.smithi047.stdout:3/870: symlink d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d85/df9/l113 0 2024-09-13T22:56:23.236 INFO:tasks.workunit.client.1.smithi047.stdout:1/923: write d0/d7/d14/f2b [2038933,93456] 0 2024-09-13T22:56:23.315 INFO:tasks.workunit.client.1.smithi047.stdout:3/871: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/f106 [185810,94639] 0 2024-09-13T22:56:23.318 INFO:tasks.workunit.client.1.smithi047.stdout:1/924: readlink d0/d7/d14/d57/lc2 0 2024-09-13T22:56:23.318 INFO:tasks.workunit.client.0.smithi002.stdout:0/782: rename d1/d2/d6c/d8b/f8c to d1/d4/d75/d31/d32/f117 0 2024-09-13T22:56:23.321 INFO:tasks.workunit.client.0.smithi002.stdout:7/764: creat d8/d10/d39/d60/db8/d2e/d3c/dcf/fe4 x:0 0 0 2024-09-13T22:56:23.321 INFO:tasks.workunit.client.0.smithi002.stdout:8/808: sync 2024-09-13T22:56:23.325 INFO:tasks.workunit.client.1.smithi047.stdout:0/812: creat d1/d5/d11/d52/f10b x:0 0 0 2024-09-13T22:56:23.325 INFO:tasks.workunit.client.1.smithi047.stdout:9/829: dwrite d1/dc/f15 [0,4194304] 0 2024-09-13T22:56:23.325 INFO:tasks.workunit.client.1.smithi047.stdout:1/925: dread d0/d7/d13/d8c/fb4 [0,4194304] 0 2024-09-13T22:56:23.326 INFO:tasks.workunit.client.1.smithi047.stdout:2/845: write d1/d16/f23 [1368275,80298] 0 2024-09-13T22:56:23.327 INFO:tasks.workunit.client.0.smithi002.stdout:0/783: dwrite d1/d2/f56 [4194304,4194304] 0 2024-09-13T22:56:23.329 INFO:tasks.workunit.client.1.smithi047.stdout:2/846: write d1/df/d35/ffe [1026590,16029] 0 2024-09-13T22:56:23.330 INFO:tasks.workunit.client.0.smithi002.stdout:0/784: chown d1/d4/fba 23048 1 2024-09-13T22:56:23.330 INFO:tasks.workunit.client.0.smithi002.stdout:1/860: dwrite d1/d13/d21/d39/d70/d10c/fa8 [0,4194304] 0 2024-09-13T22:56:23.331 INFO:tasks.workunit.client.1.smithi047.stdout:4/918: chown dc/de/d23/d40/c67 5822 1 2024-09-13T22:56:23.332 INFO:tasks.workunit.client.1.smithi047.stdout:5/744: dread d19/d23/d2e/d41/d58/f97 [0,4194304] 0 2024-09-13T22:56:23.333 INFO:tasks.workunit.client.1.smithi047.stdout:4/919: chown dc/de/d17/d70 52554874 1 2024-09-13T22:56:23.334 INFO:tasks.workunit.client.1.smithi047.stdout:9/830: truncate d1/dc/d14/dd/d54/d50/d60/f104 100349 0 2024-09-13T22:56:23.336 INFO:tasks.workunit.client.1.smithi047.stdout:9/831: truncate d1/fe1 697147 0 2024-09-13T22:56:23.337 INFO:tasks.workunit.client.0.smithi002.stdout:5/797: creat d1/d2a/d6b/d88/d55/d56/dc7/f126 x:0 0 0 2024-09-13T22:56:23.337 INFO:tasks.workunit.client.1.smithi047.stdout:9/832: stat d1/d5f/f9b 0 2024-09-13T22:56:23.338 INFO:tasks.workunit.client.0.smithi002.stdout:5/798: chown d1/d10/l27 2 1 2024-09-13T22:56:23.338 INFO:tasks.workunit.client.0.smithi002.stdout:8/809: dread d3/dc/d18/d2e/d94/f93 [0,4194304] 0 2024-09-13T22:56:23.345 INFO:tasks.workunit.client.1.smithi047.stdout:0/813: creat d1/d7/dc9/f10c x:0 0 0 2024-09-13T22:56:23.348 INFO:tasks.workunit.client.1.smithi047.stdout:1/926: dread d0/d7/d13/d2d/ffd [0,4194304] 0 2024-09-13T22:56:23.349 INFO:tasks.workunit.client.1.smithi047.stdout:1/927: write d0/d7/d14/d28/f48 [2476696,54407] 0 2024-09-13T22:56:23.351 INFO:tasks.workunit.client.1.smithi047.stdout:1/928: write d0/d7/d13/d5d/fd9 [2017742,99474] 0 2024-09-13T22:56:23.351 INFO:tasks.workunit.client.1.smithi047.stdout:4/920: rmdir dc/d29/d8e/dda 39 2024-09-13T22:56:23.355 INFO:tasks.workunit.client.0.smithi002.stdout:4/754: mkdir d3/d14/d29/d2a/da6/d69/d7e/dca/df3 0 2024-09-13T22:56:23.355 INFO:tasks.workunit.client.1.smithi047.stdout:3/872: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d95/dc3/fd2 [453619,61488] 0 2024-09-13T22:56:23.357 INFO:tasks.workunit.client.0.smithi002.stdout:7/765: dread d8/d10/d39/d60/db8/d26/f3f [0,4194304] 0 2024-09-13T22:56:23.358 INFO:tasks.workunit.client.0.smithi002.stdout:7/766: fdatasync d8/fb 0 2024-09-13T22:56:23.358 INFO:tasks.workunit.client.0.smithi002.stdout:9/871: symlink d8/l125 0 2024-09-13T22:56:23.360 INFO:tasks.workunit.client.1.smithi047.stdout:7/782: truncate d0/d7/f87 1880280 0 2024-09-13T22:56:23.364 INFO:tasks.workunit.client.0.smithi002.stdout:3/851: sync 2024-09-13T22:56:23.365 INFO:tasks.workunit.client.1.smithi047.stdout:0/814: fsync d1/f40 0 2024-09-13T22:56:23.365 INFO:tasks.workunit.client.1.smithi047.stdout:0/815: readlink d1/d5/d11/d2f/lf0 0 2024-09-13T22:56:23.365 INFO:tasks.workunit.client.1.smithi047.stdout:2/847: mknod d1/de/db4/c11b 0 2024-09-13T22:56:23.365 INFO:tasks.workunit.client.1.smithi047.stdout:2/848: chown d1/d16/d40/d57/l73 125643 1 2024-09-13T22:56:23.366 INFO:tasks.workunit.client.0.smithi002.stdout:0/785: mknod d1/d7e/d9d/de6/c118 0 2024-09-13T22:56:23.367 INFO:tasks.workunit.client.0.smithi002.stdout:0/786: write d1/d4/da3/d7d/f110 [240238,121919] 0 2024-09-13T22:56:23.371 INFO:tasks.workunit.client.0.smithi002.stdout:4/755: mknod d3/db3/db9/cf4 0 2024-09-13T22:56:23.372 INFO:tasks.workunit.client.1.smithi047.stdout:0/816: dwrite d1/d5/d16/d97/dfc/d2d/f61 [0,4194304] 0 2024-09-13T22:56:23.372 INFO:tasks.workunit.client.1.smithi047.stdout:9/833: write d1/dc/d14/dd/dba/fce [764685,27326] 0 2024-09-13T22:56:23.373 INFO:tasks.workunit.client.0.smithi002.stdout:8/810: dread d3/f36 [0,4194304] 0 2024-09-13T22:56:23.374 INFO:tasks.workunit.client.1.smithi047.stdout:0/817: write d1/d5/d16/dc0/f107 [684325,23877] 0 2024-09-13T22:56:23.377 INFO:tasks.workunit.client.1.smithi047.stdout:1/929: dread - d0/d7/d14/fd1 zero size 2024-09-13T22:56:23.378 INFO:tasks.workunit.client.0.smithi002.stdout:9/872: mkdir d8/d2c/dbc/dc8/d126 0 2024-09-13T22:56:23.379 INFO:tasks.workunit.client.0.smithi002.stdout:9/873: dread - d8/d10/f118 zero size 2024-09-13T22:56:23.379 INFO:tasks.workunit.client.1.smithi047.stdout:4/921: truncate dc/de/d23/dc4/ddb/fe7 1285389 0 2024-09-13T22:56:23.380 INFO:tasks.workunit.client.0.smithi002.stdout:5/799: getdents d1/de7 0 2024-09-13T22:56:23.381 INFO:tasks.workunit.client.1.smithi047.stdout:6/869: mknod d3/d11/d2b/d1c/d4d/d69/dc2/d11c/c122 0 2024-09-13T22:56:23.383 INFO:tasks.workunit.client.0.smithi002.stdout:2/787: rename d1/d7/d8/l28 to d1/d7/d41/d96/l10e 0 2024-09-13T22:56:23.385 INFO:tasks.workunit.client.0.smithi002.stdout:9/874: dwrite d8/d1e/fca [0,4194304] 0 2024-09-13T22:56:23.385 INFO:tasks.workunit.client.1.smithi047.stdout:3/873: fsync d0/d3/d4/d16/d2c/f24 0 2024-09-13T22:56:23.387 INFO:tasks.workunit.client.1.smithi047.stdout:3/874: dread - d0/d3/d4/d16/d32/d42/d79/f93 zero size 2024-09-13T22:56:23.390 INFO:tasks.workunit.client.0.smithi002.stdout:1/861: creat d1/d13/d30/d73/da1/d7d/df9/f126 x:0 0 0 2024-09-13T22:56:23.394 INFO:tasks.workunit.client.0.smithi002.stdout:8/811: fsync d3/dc/f13 0 2024-09-13T22:56:23.397 INFO:tasks.workunit.client.1.smithi047.stdout:4/922: dread dc/de/d17/f74 [0,4194304] 0 2024-09-13T22:56:23.398 INFO:tasks.workunit.client.0.smithi002.stdout:3/852: write d9/d3b/da5/fdb [1169037,43345] 0 2024-09-13T22:56:23.399 INFO:tasks.workunit.client.1.smithi047.stdout:5/745: creat d19/d23/d2e/d41/d58/fe9 x:0 0 0 2024-09-13T22:56:23.400 INFO:tasks.workunit.client.0.smithi002.stdout:5/800: truncate d1/d2a/d6b/d88/f74 898782 0 2024-09-13T22:56:23.401 INFO:tasks.workunit.client.1.smithi047.stdout:2/849: symlink d1/df/d1d/d20/d37/d85/l11c 0 2024-09-13T22:56:23.403 INFO:tasks.workunit.client.0.smithi002.stdout:7/767: rename d8/d10/d39/d60/db8/d26/d4c/d81/db6/lba to d8/d10/d39/d60/db8/d2e/d3c/d3e/da1/le5 0 2024-09-13T22:56:23.405 INFO:tasks.workunit.client.0.smithi002.stdout:9/875: symlink d8/d10/d42/ddd/l127 0 2024-09-13T22:56:23.408 INFO:tasks.workunit.client.0.smithi002.stdout:2/788: creat d1/d7/d35/d78/dfc/d6b/d75/f10f x:0 0 0 2024-09-13T22:56:23.408 INFO:tasks.workunit.client.1.smithi047.stdout:9/834: truncate d1/dc/d14/dd/d54/d50/d60/db0/fca 980680 0 2024-09-13T22:56:23.411 INFO:tasks.workunit.client.1.smithi047.stdout:5/746: dwrite d19/d25/d45/da3/fb8 [4194304,4194304] 0 2024-09-13T22:56:23.414 INFO:tasks.workunit.client.0.smithi002.stdout:4/756: symlink d3/d40/lf5 0 2024-09-13T22:56:23.419 INFO:tasks.workunit.client.1.smithi047.stdout:6/870: rename d3/d77/d93/fdd to d3/d11/d2b/d4c/d9d/dc1/f123 0 2024-09-13T22:56:23.421 INFO:tasks.workunit.client.0.smithi002.stdout:6/809: sync 2024-09-13T22:56:23.424 INFO:tasks.workunit.client.1.smithi047.stdout:0/818: dwrite d1/d5/d11/d2f/f82 [0,4194304] 0 2024-09-13T22:56:23.425 INFO:tasks.workunit.client.1.smithi047.stdout:0/819: chown d1/d7/ca8 767044 1 2024-09-13T22:56:23.427 INFO:tasks.workunit.client.1.smithi047.stdout:3/875: creat d0/d3/d4/d16/d32/d42/f114 x:0 0 0 2024-09-13T22:56:23.427 INFO:tasks.workunit.client.1.smithi047.stdout:1/930: dread d0/d7/d14/d57/d62/d76/d94/f108 [0,4194304] 0 2024-09-13T22:56:23.429 INFO:tasks.workunit.client.1.smithi047.stdout:1/931: write d0/d7/db/d101/d55/ffe [595054,122243] 0 2024-09-13T22:56:23.432 INFO:tasks.workunit.client.1.smithi047.stdout:3/876: dread d0/d3/d4/d16/d32/d42/d79/d9c/fb8 [0,4194304] 0 2024-09-13T22:56:23.433 INFO:tasks.workunit.client.0.smithi002.stdout:0/787: rename d1/d2/d6c/fd8 to d1/d4/da3/d7d/f119 0 2024-09-13T22:56:23.435 INFO:tasks.workunit.client.0.smithi002.stdout:0/788: chown d1/d4/da3/f68 102 1 2024-09-13T22:56:23.435 INFO:tasks.workunit.client.1.smithi047.stdout:3/877: truncate d0/d3/d4/d16/d2c/de/dcc/dd1/fe7 5043312 0 2024-09-13T22:56:23.436 INFO:tasks.workunit.client.0.smithi002.stdout:7/768: write d8/d10/d39/d60/db8/d26/d38/fb7 [1033375,62331] 0 2024-09-13T22:56:23.438 INFO:tasks.workunit.client.1.smithi047.stdout:2/850: mknod d1/df/d35/dd7/dca/c11d 0 2024-09-13T22:56:23.438 INFO:tasks.workunit.client.0.smithi002.stdout:7/769: dread - d8/d10/d39/d60/db8/d26/d4c/d81/d46/fd6 zero size 2024-09-13T22:56:23.439 INFO:tasks.workunit.client.0.smithi002.stdout:7/770: chown d8/d10/d39/d60/db8/d2e/d3c/f48 0 1 2024-09-13T22:56:23.441 INFO:tasks.workunit.client.0.smithi002.stdout:7/771: write d8/d10/fe3 [305956,11045] 0 2024-09-13T22:56:23.442 INFO:tasks.workunit.client.0.smithi002.stdout:4/757: mkdir d3/d62/df6 0 2024-09-13T22:56:23.445 INFO:tasks.workunit.client.0.smithi002.stdout:5/801: dwrite d1/d2a/d6b/d88/d55/f7a [0,4194304] 0 2024-09-13T22:56:23.448 INFO:tasks.workunit.client.0.smithi002.stdout:6/810: fsync d12/d17/d34/d4b/f76 0 2024-09-13T22:56:23.452 INFO:tasks.workunit.client.0.smithi002.stdout:8/812: mkdir d3/d27/d39/d80/dfe 0 2024-09-13T22:56:23.463 INFO:tasks.workunit.client.0.smithi002.stdout:7/772: symlink d8/d10/le6 0 2024-09-13T22:56:23.464 INFO:tasks.workunit.client.0.smithi002.stdout:7/773: write d8/f5d [4686100,85310] 0 2024-09-13T22:56:23.465 INFO:tasks.workunit.client.1.smithi047.stdout:8/835: sync 2024-09-13T22:56:23.466 INFO:tasks.workunit.client.0.smithi002.stdout:7/774: read d8/d10/d39/d60/db8/f79 [708972,124396] 0 2024-09-13T22:56:23.467 INFO:tasks.workunit.client.0.smithi002.stdout:7/775: write d8/d10/d39/d60/db8/d26/d4c/d81/d46/fd6 [878784,87715] 0 2024-09-13T22:56:23.469 INFO:tasks.workunit.client.0.smithi002.stdout:7/776: write d8/d10/d39/d60/db8/d26/d4c/d81/db5/fd5 [3056868,78365] 0 2024-09-13T22:56:23.470 INFO:tasks.workunit.client.0.smithi002.stdout:9/876: truncate d8/d10/d42/f76 3705296 0 2024-09-13T22:56:23.475 INFO:tasks.workunit.client.0.smithi002.stdout:8/813: symlink d3/dc/d8b/lff 0 2024-09-13T22:56:23.476 INFO:tasks.workunit.client.0.smithi002.stdout:2/789: dwrite d1/d4d/d8b/de1/f108 [0,4194304] 0 2024-09-13T22:56:23.479 INFO:tasks.workunit.client.0.smithi002.stdout:0/789: mkdir d1/d4/d114/d11a 0 2024-09-13T22:56:23.488 INFO:tasks.workunit.client.0.smithi002.stdout:1/862: getdents d1/d13/d21/d39/d70/d10c/d3b/d71/d80/d112 0 2024-09-13T22:56:23.492 INFO:tasks.workunit.client.0.smithi002.stdout:5/802: getdents d1/d2a/d6b/d88/d55/d56/d86/d11d 0 2024-09-13T22:56:23.494 INFO:tasks.workunit.client.0.smithi002.stdout:7/777: unlink d8/d10/d39/d60/db8/d2e/d50/l71 0 2024-09-13T22:56:23.496 INFO:tasks.workunit.client.0.smithi002.stdout:9/877: fdatasync d8/d10/d1c/d3d/d11f/da3/db9/dfa/d87/fea 0 2024-09-13T22:56:23.498 INFO:tasks.workunit.client.1.smithi047.stdout:9/835: mkdir d1/dc/d14/dd/dba/d118 0 2024-09-13T22:56:23.499 INFO:tasks.workunit.client.1.smithi047.stdout:9/836: write d1/dc/d14/f4d [175286,47533] 0 2024-09-13T22:56:23.499 INFO:tasks.workunit.client.0.smithi002.stdout:6/811: creat d12/d17/d28/d7d/df2/ffd x:0 0 0 2024-09-13T22:56:23.503 INFO:tasks.workunit.client.0.smithi002.stdout:3/853: getdents d9/d15/d36/d4e/d5e/dae/d89/de5 0 2024-09-13T22:56:23.509 INFO:tasks.workunit.client.1.smithi047.stdout:7/783: link d0/d7/da/f74 d0/d7/da/d1e/d93/f106 0 2024-09-13T22:56:23.514 INFO:tasks.workunit.client.0.smithi002.stdout:4/758: rename d3/d14/d29/d2a/dbc to d3/d14/d29/df7 0 2024-09-13T22:56:23.520 INFO:tasks.workunit.client.1.smithi047.stdout:2/851: creat d1/df/d1d/d20/d37/d85/f11e x:0 0 0 2024-09-13T22:56:23.522 INFO:tasks.workunit.client.1.smithi047.stdout:2/852: dread d1/de/fe4 [0,4194304] 0 2024-09-13T22:56:23.523 INFO:tasks.workunit.client.1.smithi047.stdout:6/871: write d3/d77/f102 [539549,83682] 0 2024-09-13T22:56:23.524 INFO:tasks.workunit.client.1.smithi047.stdout:6/872: readlink d3/d11/d74/l114 0 2024-09-13T22:56:23.529 INFO:tasks.workunit.client.0.smithi002.stdout:1/863: write d1/d13/d21/d39/d70/d10c/d3d/db6/fdb [2035802,74185] 0 2024-09-13T22:56:23.531 INFO:tasks.workunit.client.0.smithi002.stdout:9/878: write d8/d10/d42/f4c [4473861,37936] 0 2024-09-13T22:56:23.531 INFO:tasks.workunit.client.0.smithi002.stdout:5/803: dread d1/d2a/d6b/d88/d55/d56/d86/f123 [0,4194304] 0 2024-09-13T22:56:23.534 INFO:tasks.workunit.client.0.smithi002.stdout:7/778: symlink d8/d10/d39/d60/db8/le7 0 2024-09-13T22:56:23.534 INFO:tasks.workunit.client.1.smithi047.stdout:3/878: symlink d0/d3/d4/l115 0 2024-09-13T22:56:23.538 INFO:tasks.workunit.client.1.smithi047.stdout:2/853: symlink d1/df/d26/d9f/df2/l11f 0 2024-09-13T22:56:23.538 INFO:tasks.workunit.client.1.smithi047.stdout:0/820: dwrite d1/f2 [4194304,4194304] 0 2024-09-13T22:56:23.539 INFO:tasks.workunit.client.0.smithi002.stdout:2/790: dwrite d1/d7/d8/fdd [0,4194304] 0 2024-09-13T22:56:23.539 INFO:tasks.workunit.client.0.smithi002.stdout:6/812: dread d12/d17/f48 [0,4194304] 0 2024-09-13T22:56:23.540 INFO:tasks.workunit.client.1.smithi047.stdout:0/821: chown d1/d5/d11/d52 22791760 1 2024-09-13T22:56:23.540 INFO:tasks.workunit.client.0.smithi002.stdout:8/814: rmdir d3/d21/d57/da1/df8 0 2024-09-13T22:56:23.542 INFO:tasks.workunit.client.0.smithi002.stdout:3/854: dread d9/d15/d35/f9d [0,4194304] 0 2024-09-13T22:56:23.543 INFO:tasks.workunit.client.0.smithi002.stdout:0/790: rmdir d1/d4/d114/d11a 0 2024-09-13T22:56:23.544 INFO:tasks.workunit.client.1.smithi047.stdout:8/836: write d8/f9e [268728,91402] 0 2024-09-13T22:56:23.544 INFO:tasks.workunit.client.1.smithi047.stdout:5/747: link d19/d34/d6c/ce6 d19/d23/d2e/dba/cea 0 2024-09-13T22:56:23.547 INFO:tasks.workunit.client.1.smithi047.stdout:7/784: dread d0/d7/da/d4e/f70 [0,4194304] 0 2024-09-13T22:56:23.547 INFO:tasks.workunit.client.1.smithi047.stdout:4/923: getdents dc/de/d17/d25/d4a/d11c/d12a 0 2024-09-13T22:56:23.548 INFO:tasks.workunit.client.1.smithi047.stdout:7/785: stat d0/d57/cd8 0 2024-09-13T22:56:23.549 INFO:tasks.workunit.client.1.smithi047.stdout:4/924: dread - dc/de/d23/dc4/ddb/fdc zero size 2024-09-13T22:56:23.550 INFO:tasks.workunit.client.1.smithi047.stdout:7/786: dread - d0/d7/da/d2e/d64/f6c zero size 2024-09-13T22:56:23.550 INFO:tasks.workunit.client.1.smithi047.stdout:1/932: rename d0/d7/d14/d57/d62/d8a/ff8 to d0/d7/d14/d28/d36/f10b 0 2024-09-13T22:56:23.555 INFO:tasks.workunit.client.0.smithi002.stdout:4/759: truncate d3/d14/d85/fbb 694009 0 2024-09-13T22:56:23.556 INFO:tasks.workunit.client.0.smithi002.stdout:9/879: readlink d8/d10/d1c/d3d/d11f/da3/db9/dfa/l64 0 2024-09-13T22:56:23.557 INFO:tasks.workunit.client.0.smithi002.stdout:7/779: fdatasync d8/d10/d39/d60/db8/d2e/d50/d52/d58/fde 0 2024-09-13T22:56:23.560 INFO:tasks.workunit.client.1.smithi047.stdout:0/822: creat d1/d5/d16/d97/db6/f10d x:0 0 0 2024-09-13T22:56:23.562 INFO:tasks.workunit.client.0.smithi002.stdout:5/804: rename d1/d2a/d6b/d88/d45/d4f/da7/daa/led to d1/d2a/d6b/d88/d45/d4f/d8f/l127 0 2024-09-13T22:56:23.568 INFO:tasks.workunit.client.1.smithi047.stdout:4/925: stat dc/de/d23/dc4/dc8/dc9/c107 0 2024-09-13T22:56:23.569 INFO:tasks.workunit.client.1.smithi047.stdout:2/854: rename d1/df/d1d/d20/d37/fb1 to d1/d16/d40/d57/f120 0 2024-09-13T22:56:23.570 INFO:tasks.workunit.client.1.smithi047.stdout:4/926: dread dc/de/d23/d40/d7b/d90/da6/fd6 [0,4194304] 0 2024-09-13T22:56:23.571 INFO:tasks.workunit.client.1.smithi047.stdout:7/787: fdatasync d0/d19/fc0 0 2024-09-13T22:56:23.574 INFO:tasks.workunit.client.1.smithi047.stdout:1/933: read d0/d7/d13/f42 [1109490,5839] 0 2024-09-13T22:56:23.575 INFO:tasks.workunit.client.0.smithi002.stdout:1/864: symlink d1/d13/d1d/d105/d124/l127 0 2024-09-13T22:56:23.576 INFO:tasks.workunit.client.1.smithi047.stdout:7/788: dread d0/d7/da/d2e/d64/f6a [0,4194304] 0 2024-09-13T22:56:23.576 INFO:tasks.workunit.client.1.smithi047.stdout:3/879: mknod d0/d3/d5e/ded/c116 0 2024-09-13T22:56:23.577 INFO:tasks.workunit.client.0.smithi002.stdout:4/760: creat d3/d14/d29/d2a/da6/d9f/ff8 x:0 0 0 2024-09-13T22:56:23.580 INFO:tasks.workunit.client.0.smithi002.stdout:9/880: rename d8/d2c/f56 to d8/d2c/dbc/f128 0 2024-09-13T22:56:23.581 INFO:tasks.workunit.client.0.smithi002.stdout:9/881: fdatasync d8/d2c/fba 0 2024-09-13T22:56:23.581 INFO:tasks.workunit.client.1.smithi047.stdout:8/837: mknod d8/d64/d4e/c124 0 2024-09-13T22:56:23.584 INFO:tasks.workunit.client.0.smithi002.stdout:6/813: creat d12/d17/d28/d67/dca/dd8/ffe x:0 0 0 2024-09-13T22:56:23.584 INFO:tasks.workunit.client.0.smithi002.stdout:3/855: dread d9/d15/d36/d4e/d5e/fb7 [0,4194304] 0 2024-09-13T22:56:23.584 INFO:tasks.workunit.client.1.smithi047.stdout:0/823: write d1/d5/d16/d97/db6/fc4 [721300,89381] 0 2024-09-13T22:56:23.585 INFO:tasks.workunit.client.1.smithi047.stdout:5/748: rename d19/d23/d2e/f59 to d19/d83/feb 0 2024-09-13T22:56:23.585 INFO:tasks.workunit.client.1.smithi047.stdout:5/749: chown d19/d34 23526 1 2024-09-13T22:56:23.589 INFO:tasks.workunit.client.1.smithi047.stdout:4/927: mkdir dc/d29/d6c/d137 0 2024-09-13T22:56:23.593 INFO:tasks.workunit.client.0.smithi002.stdout:4/761: creat d3/db3/ff9 x:0 0 0 2024-09-13T22:56:23.593 INFO:tasks.workunit.client.0.smithi002.stdout:4/762: dread - d3/d14/d29/fe3 zero size 2024-09-13T22:56:23.595 INFO:tasks.workunit.client.0.smithi002.stdout:2/791: truncate d1/d7/d41/fe7 180770 0 2024-09-13T22:56:23.595 INFO:tasks.workunit.client.1.smithi047.stdout:0/824: dwrite d1/d5/d16/d97/dfc/d45/fff [0,4194304] 0 2024-09-13T22:56:23.596 INFO:tasks.workunit.client.0.smithi002.stdout:2/792: readlink d1/d4d/d8b/de1/l98 0 2024-09-13T22:56:23.596 INFO:tasks.workunit.client.1.smithi047.stdout:5/750: dwrite d19/d25/fc3 [0,4194304] 0 2024-09-13T22:56:23.597 INFO:tasks.workunit.client.0.smithi002.stdout:4/763: dread d3/d14/d29/d2a/da6/fcf [0,4194304] 0 2024-09-13T22:56:23.600 INFO:tasks.workunit.client.0.smithi002.stdout:5/805: rename d1/d2a/d6b/d88/d55/d56/de4/f124 to d1/d2a/d6b/d88/d45/df4/f128 0 2024-09-13T22:56:23.602 INFO:tasks.workunit.client.1.smithi047.stdout:7/789: fsync d0/d7/da/fcc 0 2024-09-13T22:56:23.605 INFO:tasks.workunit.client.0.smithi002.stdout:8/815: creat d3/dc/d18/f100 x:0 0 0 2024-09-13T22:56:23.605 INFO:tasks.workunit.client.0.smithi002.stdout:3/856: dread - d9/d15/d46/ff9 zero size 2024-09-13T22:56:23.606 INFO:tasks.workunit.client.1.smithi047.stdout:3/880: creat d0/d3/d4/d16/d73/f117 x:0 0 0 2024-09-13T22:56:23.607 INFO:tasks.workunit.client.1.smithi047.stdout:3/881: readlink d0/d3/d4/d16/d32/d42/d79/dba/ldd 0 2024-09-13T22:56:23.607 INFO:tasks.workunit.client.0.smithi002.stdout:6/814: rmdir d12/d17/d28/d7d/df2 39 2024-09-13T22:56:23.608 INFO:tasks.workunit.client.0.smithi002.stdout:0/791: link d1/d4/f24 d1/d4/d75/d31/de0/f11b 0 2024-09-13T22:56:23.609 INFO:tasks.workunit.client.0.smithi002.stdout:6/815: write d12/d17/ddf/ff0 [692716,48303] 0 2024-09-13T22:56:23.609 INFO:tasks.workunit.client.1.smithi047.stdout:2/855: dread d1/df/d1d/d20/d29/dcd/dff/f86 [4194304,4194304] 0 2024-09-13T22:56:23.619 INFO:tasks.workunit.client.1.smithi047.stdout:4/928: rmdir dc/de/d17/d25/d9b 39 2024-09-13T22:56:23.621 INFO:tasks.workunit.client.0.smithi002.stdout:9/882: mknod d8/d2c/dbc/d10c/c129 0 2024-09-13T22:56:23.622 INFO:tasks.workunit.client.1.smithi047.stdout:0/825: symlink d1/d5/d11/d2f/l10e 0 2024-09-13T22:56:23.624 INFO:tasks.workunit.client.0.smithi002.stdout:1/865: rename d1/d13/d21/d39/d70/d10c/d3d/d5d/d8e/ca6 to d1/d13/d21/d39/d70/d10c/d3b/d71/d80/c128 0 2024-09-13T22:56:23.625 INFO:tasks.workunit.client.1.smithi047.stdout:8/838: dwrite d8/d3f/d8c/fc1 [0,4194304] 0 2024-09-13T22:56:23.627 INFO:tasks.workunit.client.1.smithi047.stdout:1/934: mkdir d0/d7/db/d79/df7/d10c 0 2024-09-13T22:56:23.627 INFO:tasks.workunit.client.0.smithi002.stdout:5/806: creat d1/d2a/d69/f129 x:0 0 0 2024-09-13T22:56:23.630 INFO:tasks.workunit.client.1.smithi047.stdout:5/751: unlink d19/d23/c7e 0 2024-09-13T22:56:23.631 INFO:tasks.workunit.client.0.smithi002.stdout:8/816: mknod d3/dc/d51/c101 0 2024-09-13T22:56:23.632 INFO:tasks.workunit.client.0.smithi002.stdout:0/792: rmdir d1/d4/d75/d31/d32/dbb 39 2024-09-13T22:56:23.633 INFO:tasks.workunit.client.1.smithi047.stdout:5/752: chown d19/d34/d42/d5d/d9d/lc0 5102022 1 2024-09-13T22:56:23.633 INFO:tasks.workunit.client.0.smithi002.stdout:0/793: stat d1/d4/d75/d31/f41 0 2024-09-13T22:56:23.634 INFO:tasks.workunit.client.1.smithi047.stdout:7/790: chown d0/d57/d5b/d8b/lf0 46955 1 2024-09-13T22:56:23.634 INFO:tasks.workunit.client.0.smithi002.stdout:6/816: mkdir d12/d17/d28/d67/dca/dd8/de1/dff 0 2024-09-13T22:56:23.635 INFO:tasks.workunit.client.1.smithi047.stdout:8/839: dwrite d8/d64/dc5/fe8 [0,4194304] 0 2024-09-13T22:56:23.635 INFO:tasks.workunit.client.1.smithi047.stdout:6/873: getdents d3/d11/d2b/d1c/dbf 0 2024-09-13T22:56:23.636 INFO:tasks.workunit.client.1.smithi047.stdout:8/840: fdatasync d8/d64/d4e/dbd/fef 0 2024-09-13T22:56:23.637 INFO:tasks.workunit.client.1.smithi047.stdout:3/882: creat d0/d3/d4/d16/d73/f118 x:0 0 0 2024-09-13T22:56:23.638 INFO:tasks.workunit.client.0.smithi002.stdout:2/793: mknod d1/d4a/c110 0 2024-09-13T22:56:23.639 INFO:tasks.workunit.client.0.smithi002.stdout:2/794: write d1/d32/d37/f73 [2597499,58428] 0 2024-09-13T22:56:23.640 INFO:tasks.workunit.client.0.smithi002.stdout:4/764: mknod d3/d62/df6/cfa 0 2024-09-13T22:56:23.643 INFO:tasks.workunit.client.1.smithi047.stdout:4/929: unlink dc/de/d23/f42 0 2024-09-13T22:56:23.645 INFO:tasks.workunit.client.0.smithi002.stdout:3/857: rename d9/df/l31 to d9/d15/d46/l12b 0 2024-09-13T22:56:23.647 INFO:tasks.workunit.client.0.smithi002.stdout:4/765: dwrite d3/fc8 [0,4194304] 0 2024-09-13T22:56:23.648 INFO:tasks.workunit.client.0.smithi002.stdout:5/807: mknod d1/d108/c12a 0 2024-09-13T22:56:23.649 INFO:tasks.workunit.client.1.smithi047.stdout:0/826: dread d1/d5/d16/d47/f93 [0,4194304] 0 2024-09-13T22:56:23.650 INFO:tasks.workunit.client.0.smithi002.stdout:8/817: creat d3/dc/d16/d4b/f102 x:0 0 0 2024-09-13T22:56:23.651 INFO:tasks.workunit.client.0.smithi002.stdout:3/858: dwrite d9/d15/d26/f48 [0,4194304] 0 2024-09-13T22:56:23.652 INFO:tasks.workunit.client.0.smithi002.stdout:0/794: creat d1/d7e/d9d/de6/f11c x:0 0 0 2024-09-13T22:56:23.652 INFO:tasks.workunit.client.0.smithi002.stdout:8/818: read - d3/dc/d16/d2f/d83/d85/ffd zero size 2024-09-13T22:56:23.663 INFO:tasks.workunit.client.0.smithi002.stdout:2/795: mkdir d1/d7/d35/d78/dfc/d87/d111 0 2024-09-13T22:56:23.667 INFO:tasks.workunit.client.1.smithi047.stdout:2/856: mknod d1/df/d35/dd7/dca/d10e/c121 0 2024-09-13T22:56:23.672 INFO:tasks.workunit.client.1.smithi047.stdout:6/874: dread d3/d77/d8f/f92 [0,4194304] 0 2024-09-13T22:56:23.674 INFO:tasks.workunit.client.0.smithi002.stdout:1/866: creat d1/d13/d30/d73/da1/d9d/dbd/dd8/f129 x:0 0 0 2024-09-13T22:56:23.674 INFO:tasks.workunit.client.0.smithi002.stdout:1/867: chown d1/d13/d30/d73/da1/d9d/dbd/c10a 3 1 2024-09-13T22:56:23.692 INFO:tasks.workunit.client.1.smithi047.stdout:9/837: sync 2024-09-13T22:56:23.692 INFO:tasks.workunit.client.0.smithi002.stdout:7/780: sync 2024-09-13T22:56:23.733 INFO:tasks.workunit.client.0.smithi002.stdout:4/766: dread - d3/d40/f93 zero size 2024-09-13T22:56:23.778 INFO:tasks.workunit.client.1.smithi047.stdout:7/791: symlink d0/l107 0 2024-09-13T22:56:23.779 INFO:tasks.workunit.client.1.smithi047.stdout:5/753: write d19/d23/d2e/d41/d58/f97 [1834713,17294] 0 2024-09-13T22:56:23.780 INFO:tasks.workunit.client.0.smithi002.stdout:8/819: creat d3/dc/d18/d56/f103 x:0 0 0 2024-09-13T22:56:23.780 INFO:tasks.workunit.client.1.smithi047.stdout:7/792: read d0/d7/f36 [1143138,96182] 0 2024-09-13T22:56:23.781 INFO:tasks.workunit.client.1.smithi047.stdout:5/754: write d19/d23/d4c/f7b [3152787,115068] 0 2024-09-13T22:56:23.782 INFO:tasks.workunit.client.1.smithi047.stdout:5/755: readlink d19/d25/l50 0 2024-09-13T22:56:23.785 INFO:tasks.workunit.client.0.smithi002.stdout:0/795: creat d1/d4/d75/d31/de0/d102/f11d x:0 0 0 2024-09-13T22:56:23.789 INFO:tasks.workunit.client.0.smithi002.stdout:2/796: truncate d1/d7/d8/d2c/ff3 273855 0 2024-09-13T22:56:23.794 INFO:tasks.workunit.client.1.smithi047.stdout:3/883: mknod d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/c119 0 2024-09-13T22:56:23.796 INFO:tasks.workunit.client.1.smithi047.stdout:3/884: readlink d0/d3/d4/d16/d2c/de/d1f/d2e/l10d 0 2024-09-13T22:56:23.799 INFO:tasks.workunit.client.1.smithi047.stdout:6/875: write d3/d11/d2b/d1c/dbd/de8/ff7 [998590,2866] 0 2024-09-13T22:56:23.800 INFO:tasks.workunit.client.1.smithi047.stdout:4/930: rmdir dc/de/d17/d25/d9b 39 2024-09-13T22:56:23.821 INFO:tasks.workunit.client.1.smithi047.stdout:8/841: creat d8/d64/d4e/f125 x:0 0 0 2024-09-13T22:56:23.830 INFO:tasks.workunit.client.1.smithi047.stdout:6/876: readlink d3/d11/d2b/d1c/lc7 0 2024-09-13T22:56:23.831 INFO:tasks.workunit.client.1.smithi047.stdout:6/877: dread - d3/d11/d2b/d1c/dbd/de8/f10d zero size 2024-09-13T22:56:23.834 INFO:tasks.workunit.client.1.smithi047.stdout:4/931: truncate dc/de/d17/d25/d4a/f9f 4163785 0 2024-09-13T22:56:23.841 INFO:tasks.workunit.client.0.smithi002.stdout:4/767: sync 2024-09-13T22:56:23.841 INFO:tasks.workunit.client.1.smithi047.stdout:7/793: symlink d0/d7/da/d1e/de7/df4/l108 0 2024-09-13T22:56:23.843 INFO:tasks.workunit.client.1.smithi047.stdout:5/756: symlink d19/d25/d45/da3/lec 0 2024-09-13T22:56:23.843 INFO:tasks.workunit.client.1.smithi047.stdout:5/757: chown d19/d34/d42/d5d/dd8 3909 1 2024-09-13T22:56:23.845 INFO:tasks.workunit.client.1.smithi047.stdout:8/842: dread - d8/d64/fcb zero size 2024-09-13T22:56:23.848 INFO:tasks.workunit.client.1.smithi047.stdout:8/843: truncate d8/d64/d4e/d4d/d8f/d91/d38/dc8/f111 330859 0 2024-09-13T22:56:23.852 INFO:tasks.workunit.client.1.smithi047.stdout:0/827: getdents d1/d5/d16/d97/db6 0 2024-09-13T22:56:23.858 INFO:tasks.workunit.client.1.smithi047.stdout:5/758: creat d19/d34/d42/d5d/fed x:0 0 0 2024-09-13T22:56:23.874 INFO:tasks.workunit.client.1.smithi047.stdout:5/759: unlink d19/d23/d2e/d41/d58/c68 0 2024-09-13T22:56:23.874 INFO:tasks.workunit.client.1.smithi047.stdout:5/760: chown d19/lc8 769347 1 2024-09-13T22:56:23.878 INFO:tasks.workunit.client.1.smithi047.stdout:6/878: truncate d3/d11/d2b/d1c/d23/f39 27178 0 2024-09-13T22:56:23.882 INFO:tasks.workunit.client.1.smithi047.stdout:8/844: link d8/d64/d4e/d4d/d8f/d91/d78/ff8 d8/d6b/da9/dc3/ddc/f126 0 2024-09-13T22:56:23.886 INFO:tasks.workunit.client.1.smithi047.stdout:5/761: truncate d19/f43 1518702 0 2024-09-13T22:56:23.887 INFO:tasks.workunit.client.1.smithi047.stdout:5/762: write d19/d23/d2e/d41/d58/d77/fe8 [537715,123952] 0 2024-09-13T22:56:23.890 INFO:tasks.workunit.client.1.smithi047.stdout:6/879: symlink d3/d2c/d10b/l124 0 2024-09-13T22:56:23.891 INFO:tasks.workunit.client.1.smithi047.stdout:6/880: write d3/d77/fe9 [2048097,46736] 0 2024-09-13T22:56:23.894 INFO:tasks.workunit.client.1.smithi047.stdout:7/794: getdents d0/d57/d5b/d5c 0 2024-09-13T22:56:23.895 INFO:tasks.workunit.client.1.smithi047.stdout:7/795: fsync d0/d7/da/d4e/dd1/feb 0 2024-09-13T22:56:23.897 INFO:tasks.workunit.client.1.smithi047.stdout:5/763: mknod d19/d83/cee 0 2024-09-13T22:56:23.908 INFO:tasks.workunit.client.1.smithi047.stdout:6/881: dread d3/d2c/d10b/fa7 [0,4194304] 0 2024-09-13T22:56:23.911 INFO:tasks.workunit.client.1.smithi047.stdout:5/764: rmdir d19/d83/d98/dd0 39 2024-09-13T22:56:23.916 INFO:tasks.workunit.client.1.smithi047.stdout:7/796: mknod d0/db/de8/c109 0 2024-09-13T22:56:23.925 INFO:tasks.workunit.client.1.smithi047.stdout:7/797: mkdir d0/d7/da/d1e/d93/db7/d10a 0 2024-09-13T22:56:23.930 INFO:tasks.workunit.client.1.smithi047.stdout:5/765: rmdir d19/d83/d98/dd0 39 2024-09-13T22:56:23.934 INFO:tasks.workunit.client.1.smithi047.stdout:7/798: mknod d0/d7/da/d1e/d93/c10b 0 2024-09-13T22:56:23.936 INFO:tasks.workunit.client.0.smithi002.stdout:6/817: creat d12/d17/d28/d67/dca/f100 x:0 0 0 2024-09-13T22:56:23.940 INFO:tasks.workunit.client.0.smithi002.stdout:9/883: getdents d8/d10/d1c/d3d/d11f/da3/db9/dfa/d87/da5/d94/deb 0 2024-09-13T22:56:23.944 INFO:tasks.workunit.client.1.smithi047.stdout:7/799: creat d0/d7/dc5/f10c x:0 0 0 2024-09-13T22:56:23.947 INFO:tasks.workunit.client.0.smithi002.stdout:8/820: truncate d3/dc/d16/d2f/d83/d85/f98 546449 0 2024-09-13T22:56:23.950 INFO:tasks.workunit.client.1.smithi047.stdout:7/800: mkdir d0/d7/da/d4e/d10d 0 2024-09-13T22:56:23.951 INFO:tasks.workunit.client.0.smithi002.stdout:2/797: creat d1/d7/d8/d2c/d9d/dab/db1/f112 x:0 0 0 2024-09-13T22:56:23.955 INFO:tasks.workunit.client.0.smithi002.stdout:6/818: mkdir d12/d17/d28/d67/dca/df9/d101 0 2024-09-13T22:56:23.956 INFO:tasks.workunit.client.0.smithi002.stdout:6/819: fdatasync d12/d17/d28/d67/d6b/fd7 0 2024-09-13T22:56:23.958 INFO:tasks.workunit.client.0.smithi002.stdout:2/798: mkdir d1/d7/d10a/d113 0 2024-09-13T22:56:23.959 INFO:tasks.workunit.client.0.smithi002.stdout:2/799: chown d1/d4d/d8b/de1/f108 3905 1 2024-09-13T22:56:23.961 INFO:tasks.workunit.client.0.smithi002.stdout:5/808: write d1/d2a/d69/fa4 [398821,74381] 0 2024-09-13T22:56:23.962 INFO:tasks.workunit.client.0.smithi002.stdout:3/859: write d9/d15/d35/fb1 [789632,108477] 0 2024-09-13T22:56:23.965 INFO:tasks.workunit.client.0.smithi002.stdout:4/768: sync 2024-09-13T22:56:23.967 INFO:tasks.workunit.client.1.smithi047.stdout:1/935: dwrite d0/d7/db/d101/fa7 [0,4194304] 0 2024-09-13T22:56:23.969 INFO:tasks.workunit.client.0.smithi002.stdout:5/809: fdatasync d1/f36 0 2024-09-13T22:56:23.970 INFO:tasks.workunit.client.0.smithi002.stdout:2/800: dwrite d1/d4d/d8b/de1/dd6/fea [0,4194304] 0 2024-09-13T22:56:23.973 INFO:tasks.workunit.client.0.smithi002.stdout:1/868: mkdir d1/d13/d30/d73/da1/d12a 0 2024-09-13T22:56:23.973 INFO:tasks.workunit.client.0.smithi002.stdout:5/810: chown d1/d2a/d6b/d88/d55/d56/f10c 1 1 2024-09-13T22:56:23.976 INFO:tasks.workunit.client.1.smithi047.stdout:1/936: truncate d0/d7/d14/d28/d36/f3d 1112560 0 2024-09-13T22:56:23.977 INFO:tasks.workunit.client.1.smithi047.stdout:2/857: dwrite d1/f2a [0,4194304] 0 2024-09-13T22:56:23.981 INFO:tasks.workunit.client.0.smithi002.stdout:2/801: read d1/d4d/f56 [1163212,73244] 0 2024-09-13T22:56:23.983 INFO:tasks.workunit.client.1.smithi047.stdout:1/937: rmdir d0/d7/d14/d57/d62/d76 39 2024-09-13T22:56:23.988 INFO:tasks.workunit.client.1.smithi047.stdout:2/858: chown d1/d16/d40/d57/le5 26214662 1 2024-09-13T22:56:23.991 INFO:tasks.workunit.client.0.smithi002.stdout:3/860: getdents d9/d15/d51 0 2024-09-13T22:56:23.998 INFO:tasks.workunit.client.0.smithi002.stdout:1/869: fdatasync d1/d13/d30/d73/da1/fac 0 2024-09-13T22:56:24.000 INFO:tasks.workunit.client.0.smithi002.stdout:3/861: creat d9/d15/d51/f12c x:0 0 0 2024-09-13T22:56:24.000 INFO:tasks.workunit.client.1.smithi047.stdout:9/838: dwrite d1/dc/d14/da5/f99 [0,4194304] 0 2024-09-13T22:56:24.002 INFO:tasks.workunit.client.1.smithi047.stdout:9/839: chown d1/dc/d14/dd/d4c/c87 24166 1 2024-09-13T22:56:24.003 INFO:tasks.workunit.client.0.smithi002.stdout:1/870: creat d1/d13/d30/dc1/f12b x:0 0 0 2024-09-13T22:56:24.005 INFO:tasks.workunit.client.0.smithi002.stdout:3/862: creat d9/dd1/f12d x:0 0 0 2024-09-13T22:56:24.005 INFO:tasks.workunit.client.0.smithi002.stdout:2/802: link d1/d7/d41/d96/dba/le4 d1/d7/d8/d2c/d9d/l114 0 2024-09-13T22:56:24.010 INFO:tasks.workunit.client.0.smithi002.stdout:3/863: unlink d9/d15/d26/d93/f6b 0 2024-09-13T22:56:24.010 INFO:tasks.workunit.client.1.smithi047.stdout:9/840: dwrite d1/d5f/f9b [0,4194304] 0 2024-09-13T22:56:24.013 INFO:tasks.workunit.client.0.smithi002.stdout:2/803: rmdir d1/d7/d8/d2c/d9d/dab/dd4 39 2024-09-13T22:56:24.016 INFO:tasks.workunit.client.1.smithi047.stdout:9/841: dread - d1/dc/d14/dd/d54/d50/fd0 zero size 2024-09-13T22:56:24.017 INFO:tasks.workunit.client.1.smithi047.stdout:9/842: dread - d1/dc/d14/dd/d54/d50/ff7 zero size 2024-09-13T22:56:24.020 INFO:tasks.workunit.client.0.smithi002.stdout:3/864: creat d9/d3b/da5/d120/f12e x:0 0 0 2024-09-13T22:56:24.021 INFO:tasks.workunit.client.0.smithi002.stdout:3/865: stat d9/d15/d35/f52 0 2024-09-13T22:56:24.021 INFO:tasks.workunit.client.0.smithi002.stdout:1/871: getdents d1/d13/d21/d39/d70/d10c/d3b 0 2024-09-13T22:56:24.023 INFO:tasks.workunit.client.0.smithi002.stdout:3/866: chown d9/d15/d36/d4e/d5e/dae/d89 678821 1 2024-09-13T22:56:24.023 INFO:tasks.workunit.client.1.smithi047.stdout:9/843: mknod d1/dc/d14/dd/d4c/df2/d82/c119 0 2024-09-13T22:56:24.024 INFO:tasks.workunit.client.1.smithi047.stdout:9/844: chown d1/dc/d14/dd/ccd 0 1 2024-09-13T22:56:24.028 INFO:tasks.workunit.client.0.smithi002.stdout:1/872: mkdir d1/d13/d12c 0 2024-09-13T22:56:24.031 INFO:tasks.workunit.client.0.smithi002.stdout:2/804: dwrite d1/d7/d8/d4f/fe8 [0,4194304] 0 2024-09-13T22:56:24.033 INFO:tasks.workunit.client.1.smithi047.stdout:9/845: rmdir d1/dd2/d111 0 2024-09-13T22:56:24.038 INFO:tasks.workunit.client.1.smithi047.stdout:9/846: creat d1/dc/d14/dd/d54/d50/d60/db0/db2/f11a x:0 0 0 2024-09-13T22:56:24.039 INFO:tasks.workunit.client.0.smithi002.stdout:3/867: dread d9/d3b/d53/fb3 [0,4194304] 0 2024-09-13T22:56:24.041 INFO:tasks.workunit.client.0.smithi002.stdout:2/805: dwrite d1/d7/d52/daa/fc6 [0,4194304] 0 2024-09-13T22:56:24.046 INFO:tasks.workunit.client.1.smithi047.stdout:9/847: truncate d1/dc/d14/dd/d54/d50/d5b/d9e/f83 2006842 0 2024-09-13T22:56:24.049 INFO:tasks.workunit.client.1.smithi047.stdout:9/848: write d1/dc/d14/dd/d54/d50/d5b/d9e/d101/f102 [1382229,121007] 0 2024-09-13T22:56:24.053 INFO:tasks.workunit.client.1.smithi047.stdout:9/849: dread - d1/dc/d14/dd/d54/d50/d60/db0/fc5 zero size 2024-09-13T22:56:24.056 INFO:tasks.workunit.client.1.smithi047.stdout:9/850: write d1/dc/d14/dd/d4c/fac [685159,130004] 0 2024-09-13T22:56:24.057 INFO:tasks.workunit.client.0.smithi002.stdout:3/868: dread d9/d15/d36/d4e/d5e/f90 [0,4194304] 0 2024-09-13T22:56:24.058 INFO:tasks.workunit.client.0.smithi002.stdout:3/869: chown d9/d91 1 1 2024-09-13T22:56:24.061 INFO:tasks.workunit.client.1.smithi047.stdout:9/851: creat d1/dc/d14/df3/f11b x:0 0 0 2024-09-13T22:56:24.066 INFO:tasks.workunit.client.1.smithi047.stdout:9/852: link d1/dc/d14/dd/d4c/d6b/ffa d1/dc/d14/dd/d54/d50/d60/f11c 0 2024-09-13T22:56:24.068 INFO:tasks.workunit.client.1.smithi047.stdout:9/853: chown d1/dc/d14 17836 1 2024-09-13T22:56:24.068 INFO:tasks.workunit.client.1.smithi047.stdout:4/932: dwrite dc/de/f97 [4194304,4194304] 0 2024-09-13T22:56:24.073 INFO:tasks.workunit.client.1.smithi047.stdout:9/854: write d1/dc/d14/dd/d54/d50/d60/db0/db2/f11a [217377,39329] 0 2024-09-13T22:56:24.075 INFO:tasks.workunit.client.1.smithi047.stdout:4/933: mkdir dc/d29/d138 0 2024-09-13T22:56:24.080 INFO:tasks.workunit.client.1.smithi047.stdout:9/855: link d1/f2b d1/dc/d14/da0/f11d 0 2024-09-13T22:56:24.081 INFO:tasks.workunit.client.1.smithi047.stdout:0/828: write d1/d5/d11/d2f/f48 [66961,12481] 0 2024-09-13T22:56:24.081 INFO:tasks.workunit.client.1.smithi047.stdout:0/829: readlink d1/d7/l7a 0 2024-09-13T22:56:24.081 INFO:tasks.workunit.client.1.smithi047.stdout:4/934: mkdir dc/de/d23/dc4/dc8/d139 0 2024-09-13T22:56:24.083 INFO:tasks.workunit.client.1.smithi047.stdout:0/830: creat d1/d5/d16/d6a/d92/f10f x:0 0 0 2024-09-13T22:56:24.084 INFO:tasks.workunit.client.1.smithi047.stdout:0/831: fsync d1/d5/d11/d2f/f48 0 2024-09-13T22:56:24.085 INFO:tasks.workunit.client.1.smithi047.stdout:3/885: unlink d0/d3/d4/d16/d32/d42/d79/d9c/dad/c47 0 2024-09-13T22:56:24.086 INFO:tasks.workunit.client.1.smithi047.stdout:4/935: unlink dc/de/d23/l34 0 2024-09-13T22:56:24.092 INFO:tasks.workunit.client.1.smithi047.stdout:3/886: rename d0/d3/d4/d16/d32/d110 to d0/d3/d4/d91/d8d/d11a 0 2024-09-13T22:56:24.094 INFO:tasks.workunit.client.1.smithi047.stdout:9/856: link d1/fe1 d1/dc/f11e 0 2024-09-13T22:56:24.095 INFO:tasks.workunit.client.1.smithi047.stdout:9/857: chown d1/d5f/d6a/cb7 14755 1 2024-09-13T22:56:24.095 INFO:tasks.workunit.client.1.smithi047.stdout:4/936: fsync dc/de/d23/dc4/ddb/fec 0 2024-09-13T22:56:24.104 INFO:tasks.workunit.client.1.smithi047.stdout:3/887: mkdir d0/d3/d4/d16/d32/d11b 0 2024-09-13T22:56:24.107 INFO:tasks.workunit.client.1.smithi047.stdout:9/858: mkdir d1/dc/d14/dd/d54/d4e/d51/d79/d113/d11f 0 2024-09-13T22:56:24.112 INFO:tasks.workunit.client.1.smithi047.stdout:9/859: mkdir d1/dc/d14/dd/d54/d50/d5b/d9e/d101/d120 0 2024-09-13T22:56:24.115 INFO:tasks.workunit.client.1.smithi047.stdout:9/860: creat d1/dc/d14/dd/d54/d50/d91/da3/f121 x:0 0 0 2024-09-13T22:56:24.118 INFO:tasks.workunit.client.1.smithi047.stdout:8/845: write d8/f1e [209464,12025] 0 2024-09-13T22:56:24.120 INFO:tasks.workunit.client.1.smithi047.stdout:5/766: mknod d19/d23/cef 0 2024-09-13T22:56:24.127 INFO:tasks.workunit.client.1.smithi047.stdout:6/882: write d3/d77/d93/fa3 [611500,45655] 0 2024-09-13T22:56:24.127 INFO:tasks.workunit.client.1.smithi047.stdout:5/767: dwrite d19/d23/d4c/f7c [0,4194304] 0 2024-09-13T22:56:24.132 INFO:tasks.workunit.client.1.smithi047.stdout:6/883: unlink d3/d77/d93/fa3 0 2024-09-13T22:56:24.136 INFO:tasks.workunit.client.1.smithi047.stdout:6/884: symlink d3/d11/d2b/d1c/l125 0 2024-09-13T22:56:24.138 INFO:tasks.workunit.client.0.smithi002.stdout:0/796: dwrite d1/d2/d6c/d8b/f97 [0,4194304] 0 2024-09-13T22:56:24.139 INFO:tasks.workunit.client.1.smithi047.stdout:6/885: creat d3/d11/d2b/d1c/d4d/d69/f126 x:0 0 0 2024-09-13T22:56:24.140 INFO:tasks.workunit.client.1.smithi047.stdout:6/886: chown d3/d2c/d10b/d48/la0 5 1 2024-09-13T22:56:24.144 INFO:tasks.workunit.client.1.smithi047.stdout:6/887: mkdir d3/d11/d2b/d76/d127 0 2024-09-13T22:56:24.149 INFO:tasks.workunit.client.1.smithi047.stdout:6/888: truncate d3/d11/d2b/d1c/d23/fba 684363 0 2024-09-13T22:56:24.151 INFO:tasks.workunit.client.1.smithi047.stdout:6/889: creat d3/d11/d2b/d76/daf/f128 x:0 0 0 2024-09-13T22:56:24.152 INFO:tasks.workunit.client.1.smithi047.stdout:7/801: write d0/d57/f98 [2190728,112462] 0 2024-09-13T22:56:24.153 INFO:tasks.workunit.client.0.smithi002.stdout:9/884: write d8/d1e/f22 [602961,26355] 0 2024-09-13T22:56:24.155 INFO:tasks.workunit.client.1.smithi047.stdout:6/890: read d3/d2c/fc9 [3223546,83163] 0 2024-09-13T22:56:24.157 INFO:tasks.workunit.client.1.smithi047.stdout:7/802: rename d0/d7/da/d2e/db5/lf1 to d0/d19/df2/l10e 0 2024-09-13T22:56:24.160 INFO:tasks.workunit.client.1.smithi047.stdout:6/891: mknod d3/d11/d2b/d1c/d4d/d69/c129 0 2024-09-13T22:56:24.161 INFO:tasks.workunit.client.1.smithi047.stdout:7/803: fdatasync d0/d7/da/d1e/f6b 0 2024-09-13T22:56:24.163 INFO:tasks.workunit.client.1.smithi047.stdout:6/892: mknod d3/d11/d2b/d1c/d23/dda/c12a 0 2024-09-13T22:56:24.168 INFO:tasks.workunit.client.1.smithi047.stdout:7/804: dwrite d0/db/de8/ff9 [0,4194304] 0 2024-09-13T22:56:24.170 INFO:tasks.workunit.client.0.smithi002.stdout:4/769: dwrite d3/d14/d29/d2a/da6/f98 [0,4194304] 0 2024-09-13T22:56:24.251 INFO:tasks.workunit.client.0.smithi002.stdout:4/770: chown d3/d14/d29/d2a/da6/d5e/fba 352524853 1 2024-09-13T22:56:24.253 INFO:tasks.workunit.client.0.smithi002.stdout:7/781: rename d8/d10/d39/d60/db8/d26/d4c/d81/d46/cd4 to d8/d10/d39/d60/db8/d26/ce8 0 2024-09-13T22:56:24.254 INFO:tasks.workunit.client.1.smithi047.stdout:2/859: write d1/d16/fd8 [941854,82988] 0 2024-09-13T22:56:24.257 INFO:tasks.workunit.client.0.smithi002.stdout:4/771: mkdir d3/d14/d86/db1/dfb 0 2024-09-13T22:56:24.260 INFO:tasks.workunit.client.0.smithi002.stdout:8/821: rename d3/dc/d16/d60/db4/cc3 to d3/d21/d57/da1/dbc/dfc/c104 0 2024-09-13T22:56:24.263 INFO:tasks.workunit.client.1.smithi047.stdout:6/893: link d3/d11/d2b/d4c/d9d/dac/ld6 d3/d11/d2b/d76/d119/l12b 0 2024-09-13T22:56:24.265 INFO:tasks.workunit.client.1.smithi047.stdout:7/805: rename d0/d57/d5b/lad to d0/d57/d5b/l10f 0 2024-09-13T22:56:24.267 INFO:tasks.workunit.client.0.smithi002.stdout:5/811: dwrite d1/d10/f3d [0,4194304] 0 2024-09-13T22:56:24.267 INFO:tasks.workunit.client.1.smithi047.stdout:2/860: truncate d1/df/d26/f10d 2247223 0 2024-09-13T22:56:24.268 INFO:tasks.workunit.client.0.smithi002.stdout:5/812: readlink d1/d2a/d5a/l6c 0 2024-09-13T22:56:24.268 INFO:tasks.workunit.client.0.smithi002.stdout:7/782: dread d8/d10/d39/f4a [0,4194304] 0 2024-09-13T22:56:24.269 INFO:tasks.workunit.client.0.smithi002.stdout:7/783: fdatasync d8/d10/d39/d60/f7a 0 2024-09-13T22:56:24.270 INFO:tasks.workunit.client.0.smithi002.stdout:4/772: truncate d3/d14/d29/d2a/da6/d5e/f5f 1930986 0 2024-09-13T22:56:24.271 INFO:tasks.workunit.client.0.smithi002.stdout:7/784: write d8/d10/f32 [3142367,124982] 0 2024-09-13T22:56:24.272 INFO:tasks.workunit.client.1.smithi047.stdout:7/806: dread d0/d7/f7a [0,4194304] 0 2024-09-13T22:56:24.273 INFO:tasks.workunit.client.1.smithi047.stdout:2/861: rmdir d1/df/d1d/d20/d29/dcd 39 2024-09-13T22:56:24.274 INFO:tasks.workunit.client.0.smithi002.stdout:7/785: truncate d8/d10/d39/d60/db8/d26/f96 13597158 0 2024-09-13T22:56:24.276 INFO:tasks.workunit.client.0.smithi002.stdout:8/822: truncate d3/dc/d16/d4b/d72/d73/f9f 588881 0 2024-09-13T22:56:24.277 INFO:tasks.workunit.client.0.smithi002.stdout:8/823: chown d3/dc/d18/d2e/d94/l7a 4364510 1 2024-09-13T22:56:24.279 INFO:tasks.workunit.client.1.smithi047.stdout:2/862: mknod d1/df/d35/d8b/dd1/def/c122 0 2024-09-13T22:56:24.281 INFO:tasks.workunit.client.0.smithi002.stdout:5/813: fdatasync d1/d2a/d6b/d88/d45/d4f/d78/d8b/fc8 0 2024-09-13T22:56:24.286 INFO:tasks.workunit.client.0.smithi002.stdout:6/820: rename d12/d17/d28/d67/d6b/daa/dfb to d12/d17/d102 0 2024-09-13T22:56:24.289 INFO:tasks.workunit.client.0.smithi002.stdout:5/814: dwrite d1/d2a/d6b/d88/d55/f116 [0,4194304] 0 2024-09-13T22:56:24.289 INFO:tasks.workunit.client.0.smithi002.stdout:2/806: truncate d1/d7/d35/d78/dfc/f70 347188 0 2024-09-13T22:56:24.291 INFO:tasks.workunit.client.0.smithi002.stdout:4/773: creat d3/d14/d29/d2a/da6/d69/d7e/ffc x:0 0 0 2024-09-13T22:56:24.296 INFO:tasks.workunit.client.0.smithi002.stdout:3/870: write d9/df/f7d [869910,10358] 0 2024-09-13T22:56:24.299 INFO:tasks.workunit.client.0.smithi002.stdout:5/815: dwrite d1/d2a/d6b/d88/d45/d4f/d78/fac [0,4194304] 0 2024-09-13T22:56:24.301 INFO:tasks.workunit.client.1.smithi047.stdout:2/863: dread d1/df/d1d/d20/f42 [4194304,4194304] 0 2024-09-13T22:56:24.304 INFO:tasks.workunit.client.0.smithi002.stdout:6/821: creat d12/d17/d34/d39/d8a/de4/f103 x:0 0 0 2024-09-13T22:56:24.306 INFO:tasks.workunit.client.0.smithi002.stdout:6/822: truncate d12/d17/d28/d67/d6b/f49 5064618 0 2024-09-13T22:56:24.306 INFO:tasks.workunit.client.1.smithi047.stdout:2/864: mkdir d1/df/d35/d8b/dd1/d123 0 2024-09-13T22:56:24.311 INFO:tasks.workunit.client.1.smithi047.stdout:2/865: symlink d1/df/d1d/d20/d37/l124 0 2024-09-13T22:56:24.314 INFO:tasks.workunit.client.0.smithi002.stdout:1/873: creat d1/d13/d1d/d34/dfe/f12d x:0 0 0 2024-09-13T22:56:24.314 INFO:tasks.workunit.client.0.smithi002.stdout:3/871: creat d9/d15/d36/d4e/d5e/dae/f12f x:0 0 0 2024-09-13T22:56:24.315 INFO:tasks.workunit.client.1.smithi047.stdout:0/832: write d1/d5/d11/f20 [1569593,105605] 0 2024-09-13T22:56:24.316 INFO:tasks.workunit.client.0.smithi002.stdout:8/824: mknod d3/dc/d18/d6f/c105 0 2024-09-13T22:56:24.317 INFO:tasks.workunit.client.0.smithi002.stdout:8/825: dread - d3/d27/fee zero size 2024-09-13T22:56:24.319 INFO:tasks.workunit.client.0.smithi002.stdout:5/816: stat d1/ff9 0 2024-09-13T22:56:24.323 INFO:tasks.workunit.client.0.smithi002.stdout:8/826: dwrite d3/d27/d39/d80/fb9 [0,4194304] 0 2024-09-13T22:56:24.323 INFO:tasks.workunit.client.1.smithi047.stdout:2/866: getdents d1/d8a/da6 0 2024-09-13T22:56:24.324 INFO:tasks.workunit.client.1.smithi047.stdout:0/833: dwrite d1/d5/d16/d47/f100 [0,4194304] 0 2024-09-13T22:56:24.325 INFO:tasks.workunit.client.1.smithi047.stdout:2/867: chown d1/df/d1d/d20/d29 59243980 1 2024-09-13T22:56:24.329 INFO:tasks.workunit.client.0.smithi002.stdout:5/817: dwrite d1/d2a/d6b/d88/d45/d4f/db7/fcb [0,4194304] 0 2024-09-13T22:56:24.331 INFO:tasks.workunit.client.0.smithi002.stdout:3/872: symlink d9/d15/d36/d4e/d5e/dae/d89/l130 0 2024-09-13T22:56:24.331 INFO:tasks.workunit.client.1.smithi047.stdout:4/937: dwrite dc/de/d23/f81 [0,4194304] 0 2024-09-13T22:56:24.333 INFO:tasks.workunit.client.1.smithi047.stdout:3/888: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/f4b [1767518,20026] 0 2024-09-13T22:56:24.334 INFO:tasks.workunit.client.0.smithi002.stdout:3/873: write d9/d15/d51/f37 [4465698,96768] 0 2024-09-13T22:56:24.340 INFO:tasks.workunit.client.0.smithi002.stdout:5/818: dwrite d1/d10/f3d [4194304,4194304] 0 2024-09-13T22:56:24.342 INFO:tasks.workunit.client.1.smithi047.stdout:2/868: creat d1/df/d35/dd7/dca/d10e/f125 x:0 0 0 2024-09-13T22:56:24.343 INFO:tasks.workunit.client.1.smithi047.stdout:0/834: dwrite d1/d5/d16/d97/dfc/d2d/f55 [0,4194304] 0 2024-09-13T22:56:24.343 INFO:tasks.workunit.client.1.smithi047.stdout:8/846: write d8/d64/d4e/d4d/d8f/d91/d78/fcc [1348109,109417] 0 2024-09-13T22:56:24.349 INFO:tasks.workunit.client.1.smithi047.stdout:3/889: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/ffe [433959,61218] 0 2024-09-13T22:56:24.351 INFO:tasks.workunit.client.0.smithi002.stdout:2/807: link d1/d7/d35/d78/dfc/d87/l8d d1/d7/d52/daa/l115 0 2024-09-13T22:56:24.352 INFO:tasks.workunit.client.1.smithi047.stdout:3/890: write d0/d3/d4/d16/d2c/dcb/fff [476772,22828] 0 2024-09-13T22:56:24.352 INFO:tasks.workunit.client.1.smithi047.stdout:9/861: dwrite d1/f40 [0,4194304] 0 2024-09-13T22:56:24.355 INFO:tasks.workunit.client.1.smithi047.stdout:4/938: creat dc/de/d23/d40/f13a x:0 0 0 2024-09-13T22:56:24.359 INFO:tasks.workunit.client.1.smithi047.stdout:8/847: mkdir d8/d77/de3/d127 0 2024-09-13T22:56:24.360 INFO:tasks.workunit.client.1.smithi047.stdout:8/848: dread - d8/d6b/da9/dc3/ddc/ff7 zero size 2024-09-13T22:56:24.364 INFO:tasks.workunit.client.1.smithi047.stdout:2/869: rename d1/f11 to d1/df/dc8/f126 0 2024-09-13T22:56:24.367 INFO:tasks.workunit.client.1.smithi047.stdout:2/870: write d1/df/d26/d4b/f50 [954862,14659] 0 2024-09-13T22:56:24.369 INFO:tasks.workunit.client.1.smithi047.stdout:9/862: unlink d1/dc/d14/f13 0 2024-09-13T22:56:24.371 INFO:tasks.workunit.client.0.smithi002.stdout:0/797: dwrite d1/d4/d75/d76/ffa [0,4194304] 0 2024-09-13T22:56:24.374 INFO:tasks.workunit.client.1.smithi047.stdout:2/871: dread d1/df/d26/d4b/fba [0,4194304] 0 2024-09-13T22:56:24.376 INFO:tasks.workunit.client.0.smithi002.stdout:5/819: rename d1/d10/lbe to d1/d2a/d6b/d88/d55/d56/de4/l12b 0 2024-09-13T22:56:24.384 INFO:tasks.workunit.client.0.smithi002.stdout:9/885: dwrite d8/d10/d1c/f2b [0,4194304] 0 2024-09-13T22:56:24.387 INFO:tasks.workunit.client.0.smithi002.stdout:6/823: getdents d12/d17/d34/d39 0 2024-09-13T22:56:24.395 INFO:tasks.workunit.client.0.smithi002.stdout:5/820: fdatasync d1/d2a/d6b/d88/d45/d4f/fe2 0 2024-09-13T22:56:24.396 INFO:tasks.workunit.client.1.smithi047.stdout:3/891: dread d0/d3/d4/d16/d32/d42/f9e [0,4194304] 0 2024-09-13T22:56:24.401 INFO:tasks.workunit.client.1.smithi047.stdout:9/863: creat d1/dc/d14/dd/d54/d50/f122 x:0 0 0 2024-09-13T22:56:24.406 INFO:tasks.workunit.client.1.smithi047.stdout:6/894: dwrite d3/d77/fe1 [0,4194304] 0 2024-09-13T22:56:24.410 INFO:tasks.workunit.client.0.smithi002.stdout:6/824: symlink d12/d17/d28/d67/dca/dd8/de1/l104 0 2024-09-13T22:56:24.412 INFO:tasks.workunit.client.1.smithi047.stdout:7/807: truncate d0/d57/d5b/d8b/fd0 2312617 0 2024-09-13T22:56:24.413 INFO:tasks.workunit.client.0.smithi002.stdout:9/886: dwrite d8/d10/f11e [0,4194304] 0 2024-09-13T22:56:24.422 INFO:tasks.workunit.client.0.smithi002.stdout:7/786: dwrite d8/d10/d39/d60/db8/f21 [0,4194304] 0 2024-09-13T22:56:24.422 INFO:tasks.workunit.client.0.smithi002.stdout:2/808: creat d1/d7/d35/d78/dfc/d6b/f116 x:0 0 0 2024-09-13T22:56:24.423 INFO:tasks.workunit.client.0.smithi002.stdout:2/809: stat d1/d7/d35/d78/dfc/l5f 0 2024-09-13T22:56:24.424 INFO:tasks.workunit.client.0.smithi002.stdout:7/787: rename d8/d10/d39/d60 to d8/d10/d39/d60/db8/d26/d88/de9 22 2024-09-13T22:56:24.429 INFO:tasks.workunit.client.0.smithi002.stdout:6/825: truncate d12/d17/d34/d39/d8b/dcb/fd0 880991 0 2024-09-13T22:56:24.435 INFO:tasks.workunit.client.0.smithi002.stdout:4/774: dwrite d3/d14/d29/d2a/f37 [0,4194304] 0 2024-09-13T22:56:24.435 INFO:tasks.workunit.client.0.smithi002.stdout:5/821: creat d1/d2a/d6b/d88/d55/d56/d86/d11d/f12c x:0 0 0 2024-09-13T22:56:24.436 INFO:tasks.workunit.client.1.smithi047.stdout:2/872: truncate d1/d16/d40/d57/f120 3592080 0 2024-09-13T22:56:24.436 INFO:tasks.workunit.client.0.smithi002.stdout:4/775: read - d3/d14/d29/d2a/da6/d69/fe8 zero size 2024-09-13T22:56:24.437 INFO:tasks.workunit.client.1.smithi047.stdout:2/873: dread - d1/df/d1d/d20/d37/f101 zero size 2024-09-13T22:56:24.438 INFO:tasks.workunit.client.1.smithi047.stdout:2/874: chown d1/df/d1d/d20/d37/cb5 46041 1 2024-09-13T22:56:24.439 INFO:tasks.workunit.client.1.smithi047.stdout:2/875: fdatasync d1/df/fc9 0 2024-09-13T22:56:24.440 INFO:tasks.workunit.client.0.smithi002.stdout:7/788: symlink d8/d10/d39/d60/db8/d2e/d50/d52/lea 0 2024-09-13T22:56:24.442 INFO:tasks.workunit.client.1.smithi047.stdout:2/876: write d1/df/d1d/d20/d2b/f41 [5871966,110463] 0 2024-09-13T22:56:24.444 INFO:tasks.workunit.client.1.smithi047.stdout:2/877: stat d1/d16/d40/d57/f71 0 2024-09-13T22:56:24.445 INFO:tasks.workunit.client.0.smithi002.stdout:9/887: mkdir d8/d10/dc4/dde/d12a 0 2024-09-13T22:56:24.451 INFO:tasks.workunit.client.0.smithi002.stdout:5/822: creat d1/d2a/d6b/d88/d45/df4/f12d x:0 0 0 2024-09-13T22:56:24.459 INFO:tasks.workunit.client.0.smithi002.stdout:8/827: dwrite d3/f69 [0,4194304] 0 2024-09-13T22:56:24.460 INFO:tasks.workunit.client.0.smithi002.stdout:6/826: rename d12/d17/d2a/c2c to d12/d17/d28/d67/dca/dd8/de1/dff/c105 0 2024-09-13T22:56:24.460 INFO:tasks.workunit.client.0.smithi002.stdout:8/828: readlink d3/dc/d16/d97/ld3 0 2024-09-13T22:56:24.462 INFO:tasks.workunit.client.0.smithi002.stdout:8/829: write d3/dc/d16/f4d [891301,21347] 0 2024-09-13T22:56:24.463 INFO:tasks.workunit.client.0.smithi002.stdout:5/823: mknod d1/d2a/d6b/d88/d55/d56/d86/d100/c12e 0 2024-09-13T22:56:24.469 INFO:tasks.workunit.client.1.smithi047.stdout:5/768: sync 2024-09-13T22:56:24.469 INFO:tasks.workunit.client.1.smithi047.stdout:1/938: sync 2024-09-13T22:56:24.469 INFO:tasks.workunit.client.0.smithi002.stdout:5/824: dwrite d1/de7/f11b [0,4194304] 0 2024-09-13T22:56:24.474 INFO:tasks.workunit.client.1.smithi047.stdout:4/939: dwrite dc/de/d23/dc4/ddb/fdc [0,4194304] 0 2024-09-13T22:56:24.474 INFO:tasks.workunit.client.0.smithi002.stdout:6/827: creat d12/d17/d34/d4b/f106 x:0 0 0 2024-09-13T22:56:24.475 INFO:tasks.workunit.client.0.smithi002.stdout:0/798: write d1/d4/f96 [4157813,38566] 0 2024-09-13T22:56:24.475 INFO:tasks.workunit.client.1.smithi047.stdout:4/940: chown dc/de/d23/d40/d7b/dab/c124 302 1 2024-09-13T22:56:24.484 INFO:tasks.workunit.client.0.smithi002.stdout:1/874: truncate d1/d13/d30/d73/da1/f4f 3635648 0 2024-09-13T22:56:24.486 INFO:tasks.workunit.client.1.smithi047.stdout:0/835: truncate d1/d5/d16/d47/f4d 5064410 0 2024-09-13T22:56:24.489 INFO:tasks.workunit.client.0.smithi002.stdout:6/828: unlink d12/d17/d34/d39/d8a/l8c 0 2024-09-13T22:56:24.497 INFO:tasks.workunit.client.0.smithi002.stdout:0/799: symlink d1/d7e/d9d/de3/l11e 0 2024-09-13T22:56:24.500 INFO:tasks.workunit.client.0.smithi002.stdout:5/825: dread d1/f2f [0,4194304] 0 2024-09-13T22:56:24.501 INFO:tasks.workunit.client.1.smithi047.stdout:9/864: write d1/fe1 [254924,79220] 0 2024-09-13T22:56:24.502 INFO:tasks.workunit.client.0.smithi002.stdout:1/875: mkdir d1/d13/d1d/d34/d51/d12e 0 2024-09-13T22:56:24.507 INFO:tasks.workunit.client.0.smithi002.stdout:6/829: rmdir d12/d17/d28/d67/dca/dd8/de1 39 2024-09-13T22:56:24.518 INFO:tasks.workunit.client.1.smithi047.stdout:7/808: dwrite d0/d7/fc6 [0,4194304] 0 2024-09-13T22:56:24.519 INFO:tasks.workunit.client.0.smithi002.stdout:0/800: dread d1/d2/d6c/d8b/fbf [4194304,4194304] 0 2024-09-13T22:56:24.521 INFO:tasks.workunit.client.1.smithi047.stdout:6/895: mknod d3/d11/d2b/d1c/c12c 0 2024-09-13T22:56:24.522 INFO:tasks.workunit.client.0.smithi002.stdout:2/810: truncate d1/d7/d8/d2c/f44 1172266 0 2024-09-13T22:56:24.526 INFO:tasks.workunit.client.0.smithi002.stdout:8/830: getdents d3/dc/d16/d2f/d83/d85/dba 0 2024-09-13T22:56:24.526 INFO:tasks.workunit.client.0.smithi002.stdout:7/789: write d8/d10/f45 [612481,116880] 0 2024-09-13T22:56:24.533 INFO:tasks.workunit.client.1.smithi047.stdout:5/769: fdatasync d19/d25/fc9 0 2024-09-13T22:56:24.535 INFO:tasks.workunit.client.1.smithi047.stdout:5/770: read d19/f1d [42964,112570] 0 2024-09-13T22:56:24.538 INFO:tasks.workunit.client.0.smithi002.stdout:8/831: symlink d3/d27/l106 0 2024-09-13T22:56:24.543 INFO:tasks.workunit.client.0.smithi002.stdout:5/826: creat d1/d2a/d6b/d88/d45/d4f/d78/f12f x:0 0 0 2024-09-13T22:56:24.543 INFO:tasks.workunit.client.0.smithi002.stdout:5/827: readlink d1/d10/l63 0 2024-09-13T22:56:24.543 INFO:tasks.workunit.client.0.smithi002.stdout:5/828: chown d1/f36 494387 1 2024-09-13T22:56:24.544 INFO:tasks.workunit.client.0.smithi002.stdout:5/829: write d1/d2a/d69/f129 [477463,21102] 0 2024-09-13T22:56:24.548 INFO:tasks.workunit.client.1.smithi047.stdout:1/939: dread d0/d7/fba [0,4194304] 0 2024-09-13T22:56:24.549 INFO:tasks.workunit.client.0.smithi002.stdout:0/801: mknod d1/d2/c11f 0 2024-09-13T22:56:24.551 INFO:tasks.workunit.client.1.smithi047.stdout:4/941: dwrite dc/de/d17/d25/d9b/fe9 [0,4194304] 0 2024-09-13T22:56:24.551 INFO:tasks.workunit.client.0.smithi002.stdout:3/874: sync 2024-09-13T22:56:24.555 INFO:tasks.workunit.client.0.smithi002.stdout:6/830: creat d12/d17/d28/f107 x:0 0 0 2024-09-13T22:56:24.559 INFO:tasks.workunit.client.1.smithi047.stdout:8/849: getdents d8/d64/d4e 0 2024-09-13T22:56:24.564 INFO:tasks.workunit.client.1.smithi047.stdout:8/850: dread d8/d64/dc5/fe8 [0,4194304] 0 2024-09-13T22:56:24.565 INFO:tasks.workunit.client.1.smithi047.stdout:3/892: rename d0/d3/d4/d16/d32/d42/d79/d9c/dad/d95/dc3/df6 to d0/d3/d4/d16/d32/d42/d79/d9c/d11c 0 2024-09-13T22:56:24.567 INFO:tasks.workunit.client.1.smithi047.stdout:7/809: read d0/faf [1834317,13604] 0 2024-09-13T22:56:24.570 INFO:tasks.workunit.client.0.smithi002.stdout:0/802: unlink d1/d4/da3/fb5 0 2024-09-13T22:56:24.571 INFO:tasks.workunit.client.1.smithi047.stdout:5/771: creat d19/d25/d45/ff0 x:0 0 0 2024-09-13T22:56:24.573 INFO:tasks.workunit.client.0.smithi002.stdout:6/831: fsync fd 0 2024-09-13T22:56:24.575 INFO:tasks.workunit.client.1.smithi047.stdout:0/836: mknod d1/c110 0 2024-09-13T22:56:24.576 INFO:tasks.workunit.client.1.smithi047.stdout:0/837: readlink d1/d5/d16/l6b 0 2024-09-13T22:56:24.576 INFO:tasks.workunit.client.0.smithi002.stdout:0/803: dwrite d1/d7e/d9d/de3/f100 [0,4194304] 0 2024-09-13T22:56:24.576 INFO:tasks.workunit.client.0.smithi002.stdout:6/832: truncate d12/d17/d28/d67/dca/ffc 4371199 0 2024-09-13T22:56:24.578 INFO:tasks.workunit.client.1.smithi047.stdout:4/942: creat dc/de/d23/d40/d7b/dab/dae/d102/f13b x:0 0 0 2024-09-13T22:56:24.579 INFO:tasks.workunit.client.1.smithi047.stdout:4/943: chown dc/d29/d6c 369 1 2024-09-13T22:56:24.581 INFO:tasks.workunit.client.0.smithi002.stdout:0/804: dwrite d1/d4/d75/d31/f65 [0,4194304] 0 2024-09-13T22:56:24.583 INFO:tasks.workunit.client.0.smithi002.stdout:2/811: getdents d1 0 2024-09-13T22:56:24.584 INFO:tasks.workunit.client.1.smithi047.stdout:0/838: dwrite d1/d5/d16/d47/f100 [0,4194304] 0 2024-09-13T22:56:24.584 INFO:tasks.workunit.client.0.smithi002.stdout:2/812: readlink d1/d32/d37/la5 0 2024-09-13T22:56:24.585 INFO:tasks.workunit.client.0.smithi002.stdout:2/813: readlink d1/d7/l2a 0 2024-09-13T22:56:24.585 INFO:tasks.workunit.client.0.smithi002.stdout:0/805: write d1/d4/d75/d76/f85 [3865774,59578] 0 2024-09-13T22:56:24.590 INFO:tasks.workunit.client.1.smithi047.stdout:6/896: rename d3/d11/d2b/d4c/l24 to d3/d11/d2b/d4c/dc0/l12d 0 2024-09-13T22:56:24.594 INFO:tasks.workunit.client.0.smithi002.stdout:6/833: truncate d12/d17/d28/d67/f99 290567 0 2024-09-13T22:56:24.596 INFO:tasks.workunit.client.1.smithi047.stdout:3/893: symlink d0/d3/d4/d16/d2c/de/d1f/d2e/l11d 0 2024-09-13T22:56:24.597 INFO:tasks.workunit.client.0.smithi002.stdout:5/830: getdents d1/d2a/d6b/d88/d45/d4f/db7 0 2024-09-13T22:56:24.598 INFO:tasks.workunit.client.0.smithi002.stdout:1/876: dwrite d1/f4d [0,4194304] 0 2024-09-13T22:56:24.599 INFO:tasks.workunit.client.1.smithi047.stdout:7/810: creat d0/d7/da/d105/f110 x:0 0 0 2024-09-13T22:56:24.602 INFO:tasks.workunit.client.1.smithi047.stdout:2/878: link d1/de/l32 d1/df/d1d/d20/d29/de1/l127 0 2024-09-13T22:56:24.605 INFO:tasks.workunit.client.0.smithi002.stdout:0/806: mkdir d1/d4/d75/d76/d120 0 2024-09-13T22:56:24.610 INFO:tasks.workunit.client.1.smithi047.stdout:1/940: mkdir d0/d7/d14/d57/d62/d10d 0 2024-09-13T22:56:24.612 INFO:tasks.workunit.client.0.smithi002.stdout:5/831: creat d1/d2a/d69/db8/f130 x:0 0 0 2024-09-13T22:56:24.612 INFO:tasks.workunit.client.1.smithi047.stdout:1/941: write d0/d7/d13/f105 [95933,19310] 0 2024-09-13T22:56:24.614 INFO:tasks.workunit.client.0.smithi002.stdout:6/834: dread d12/f24 [4194304,4194304] 0 2024-09-13T22:56:24.617 INFO:tasks.workunit.client.0.smithi002.stdout:7/790: write d8/d10/d39/d60/db8/d26/d4c/d81/f54 [4293351,122319] 0 2024-09-13T22:56:24.618 INFO:tasks.workunit.client.1.smithi047.stdout:4/944: fdatasync dc/de/d23/dc4/ddb/fec 0 2024-09-13T22:56:24.624 INFO:tasks.workunit.client.0.smithi002.stdout:8/832: write d3/d27/fb6 [30904,115993] 0 2024-09-13T22:56:24.624 INFO:tasks.workunit.client.0.smithi002.stdout:5/832: chown d1/d2a/d6b/d88/d45/d4f/d8f/dd5/fd7 2 1 2024-09-13T22:56:24.626 INFO:tasks.workunit.client.0.smithi002.stdout:5/833: write d1/d2a/d6b/d88/d45/f54 [388851,103588] 0 2024-09-13T22:56:24.627 INFO:tasks.workunit.client.1.smithi047.stdout:8/851: truncate d8/d64/d4e/d4d/dda/fe4 3959944 0 2024-09-13T22:56:24.628 INFO:tasks.workunit.client.1.smithi047.stdout:8/852: chown d8/d64/d4e/d4d/d8f/d91/d38/c65 2193651 1 2024-09-13T22:56:24.629 INFO:tasks.workunit.client.0.smithi002.stdout:6/835: dread - d12/d17/d34/d4b/fc5 zero size 2024-09-13T22:56:24.630 INFO:tasks.workunit.client.0.smithi002.stdout:6/836: readlink d12/d17/d28/d67/d6b/l41 0 2024-09-13T22:56:24.630 INFO:tasks.workunit.client.1.smithi047.stdout:6/897: symlink d3/d11/d2b/d4c/d9d/l12e 0 2024-09-13T22:56:24.631 INFO:tasks.workunit.client.0.smithi002.stdout:1/877: mkdir d1/d13/d1d/d34/d12f 0 2024-09-13T22:56:24.635 INFO:tasks.workunit.client.1.smithi047.stdout:2/879: symlink d1/d16/d40/d57/db0/l128 0 2024-09-13T22:56:24.637 INFO:tasks.workunit.client.0.smithi002.stdout:7/791: rename d8/d10/d39/d60/db8/d2e/d50/d52/d72/cc7 to d8/d10/d39/d60/db8/d2e/d50/d52/d58/ddf/ceb 0 2024-09-13T22:56:24.642 INFO:tasks.workunit.client.0.smithi002.stdout:7/792: dwrite d8/d10/d39/d60/db8/d2e/d3c/f97 [0,4194304] 0 2024-09-13T22:56:24.642 INFO:tasks.workunit.client.1.smithi047.stdout:2/880: dwrite d1/df/d1d/d2e/d5e/ffd [0,4194304] 0 2024-09-13T22:56:24.645 INFO:tasks.workunit.client.1.smithi047.stdout:9/865: write d1/dc/d14/dd/d54/d50/d5b/d9e/f81 [1409761,78526] 0 2024-09-13T22:56:24.647 INFO:tasks.workunit.client.1.smithi047.stdout:2/881: truncate d1/df/d1d/d20/d2b/f41 8433675 0 2024-09-13T22:56:24.653 INFO:tasks.workunit.client.1.smithi047.stdout:4/945: creat dc/da3/f13c x:0 0 0 2024-09-13T22:56:24.653 INFO:tasks.workunit.client.1.smithi047.stdout:5/772: write d19/d64/f93 [431732,45000] 0 2024-09-13T22:56:24.654 INFO:tasks.workunit.client.0.smithi002.stdout:2/814: dwrite d1/d7/d8/d2c/f4e [0,4194304] 0 2024-09-13T22:56:24.661 INFO:tasks.workunit.client.1.smithi047.stdout:5/773: dread d19/d23/d2e/d41/f51 [0,4194304] 0 2024-09-13T22:56:24.662 INFO:tasks.workunit.client.0.smithi002.stdout:6/837: rename d12/d17/fb7 to d12/d17/d28/d67/dca/df9/f108 0 2024-09-13T22:56:24.663 INFO:tasks.workunit.client.0.smithi002.stdout:6/838: chown d12/d17/d28/d67/lab 3818286 1 2024-09-13T22:56:24.663 INFO:tasks.workunit.client.0.smithi002.stdout:6/839: stat d12/d17/d4e/l65 0 2024-09-13T22:56:24.669 INFO:tasks.workunit.client.0.smithi002.stdout:8/833: unlink d3/d27/d39/d80/cc9 0 2024-09-13T22:56:24.670 INFO:tasks.workunit.client.0.smithi002.stdout:8/834: write d3/d21/d57/fc4 [909604,66481] 0 2024-09-13T22:56:24.671 INFO:tasks.workunit.client.0.smithi002.stdout:0/807: write d1/d4/d75/d31/d32/f39 [995096,32292] 0 2024-09-13T22:56:24.674 INFO:tasks.workunit.client.0.smithi002.stdout:7/793: creat d8/d10/d39/d60/db8/d26/d4c/d81/d51/fec x:0 0 0 2024-09-13T22:56:24.677 INFO:tasks.workunit.client.1.smithi047.stdout:7/811: rename d0/d7/le6 to d0/d7/da/d2e/db5/l111 0 2024-09-13T22:56:24.679 INFO:tasks.workunit.client.0.smithi002.stdout:4/776: sync 2024-09-13T22:56:24.680 INFO:tasks.workunit.client.0.smithi002.stdout:7/794: dwrite d8/d10/d39/d60/db8/d26/d4c/d81/d51/f86 [0,4194304] 0 2024-09-13T22:56:24.681 INFO:tasks.workunit.client.0.smithi002.stdout:1/878: symlink d1/d13/d21/d39/df7/dcf/l130 0 2024-09-13T22:56:24.683 INFO:tasks.workunit.client.0.smithi002.stdout:7/795: stat d8/d10/d39/d60/db8/d26/d4c/d81/db6/dc3 0 2024-09-13T22:56:24.684 INFO:tasks.workunit.client.0.smithi002.stdout:2/815: mknod d1/d4a/c117 0 2024-09-13T22:56:24.689 INFO:tasks.workunit.client.1.smithi047.stdout:9/866: readlink d1/d5f/l8f 0 2024-09-13T22:56:24.691 INFO:tasks.workunit.client.1.smithi047.stdout:1/942: dread d0/d7/d14/d57/d62/d76/d94/fab [0,4194304] 0 2024-09-13T22:56:24.692 INFO:tasks.workunit.client.0.smithi002.stdout:5/834: dwrite d1/d2a/f53 [0,4194304] 0 2024-09-13T22:56:24.695 INFO:tasks.workunit.client.0.smithi002.stdout:2/816: dwrite d1/d4d/f74 [0,4194304] 0 2024-09-13T22:56:24.696 INFO:tasks.workunit.client.1.smithi047.stdout:4/946: truncate dc/de/db9/fd9 858292 0 2024-09-13T22:56:24.697 INFO:tasks.workunit.client.0.smithi002.stdout:2/817: stat d1/d7/d35/d78/dfc/cec 0 2024-09-13T22:56:24.704 INFO:tasks.workunit.client.1.smithi047.stdout:3/894: creat d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/f11e x:0 0 0 2024-09-13T22:56:24.706 INFO:tasks.workunit.client.0.smithi002.stdout:6/840: write d12/d17/d28/d67/ff3 [1443948,53338] 0 2024-09-13T22:56:24.708 INFO:tasks.workunit.client.1.smithi047.stdout:2/882: write d1/f97 [1175134,5530] 0 2024-09-13T22:56:24.709 INFO:tasks.workunit.client.0.smithi002.stdout:8/835: write d3/dc/d16/d60/fa0 [4890428,83055] 0 2024-09-13T22:56:24.709 INFO:tasks.workunit.client.1.smithi047.stdout:2/883: stat d1/df/d26/d9f/df2/l100 0 2024-09-13T22:56:24.711 INFO:tasks.workunit.client.1.smithi047.stdout:2/884: chown d1/df/d1d/da9/fec 154086148 1 2024-09-13T22:56:24.713 INFO:tasks.workunit.client.1.smithi047.stdout:2/885: write d1/df/d1d/d20/d2b/f41 [3001500,128309] 0 2024-09-13T22:56:24.715 INFO:tasks.workunit.client.0.smithi002.stdout:0/808: mknod d1/d4/da3/d7d/df8/df4/c121 0 2024-09-13T22:56:24.722 INFO:tasks.workunit.client.1.smithi047.stdout:4/947: creat dc/de/d17/d25/d9b/f13d x:0 0 0 2024-09-13T22:56:24.724 INFO:tasks.workunit.client.0.smithi002.stdout:7/796: dwrite d8/d10/d39/d60/db8/f83 [0,4194304] 0 2024-09-13T22:56:24.726 INFO:tasks.workunit.client.1.smithi047.stdout:1/943: dwrite d0/d7/d14/d28/d36/f10b [0,4194304] 0 2024-09-13T22:56:24.728 INFO:tasks.workunit.client.1.smithi047.stdout:7/812: mkdir d0/d7/da/d1e/d112 0 2024-09-13T22:56:24.729 INFO:tasks.workunit.client.0.smithi002.stdout:6/841: unlink d12/d17/d34/f73 0 2024-09-13T22:56:24.732 INFO:tasks.workunit.client.1.smithi047.stdout:8/853: dwrite d8/d64/d4e/d4d/d8f/d91/d40/f8d [4194304,4194304] 0 2024-09-13T22:56:24.732 INFO:tasks.workunit.client.1.smithi047.stdout:6/898: dwrite d3/d11/d2b/d1c/f5b [0,4194304] 0 2024-09-13T22:56:24.734 INFO:tasks.workunit.client.1.smithi047.stdout:8/854: chown d8 25 1 2024-09-13T22:56:24.736 INFO:tasks.workunit.client.0.smithi002.stdout:0/809: creat d1/d2/d81/f122 x:0 0 0 2024-09-13T22:56:24.736 INFO:tasks.workunit.client.0.smithi002.stdout:2/818: write d1/d32/d37/f7b [405326,86209] 0 2024-09-13T22:56:24.737 INFO:tasks.workunit.client.0.smithi002.stdout:4/777: truncate d3/d14/f16 2868803 0 2024-09-13T22:56:24.737 INFO:tasks.workunit.client.0.smithi002.stdout:0/810: chown d1/d2/d6c/d8b 440 1 2024-09-13T22:56:24.738 INFO:tasks.workunit.client.0.smithi002.stdout:4/778: stat d3/f3d 0 2024-09-13T22:56:24.739 INFO:tasks.workunit.client.0.smithi002.stdout:2/819: chown d1/d7/d35/d78/dfc/l7f 271506226 1 2024-09-13T22:56:24.743 INFO:tasks.workunit.client.1.smithi047.stdout:3/895: mknod d0/d3/d4/d16/d32/d42/d79/df2/c11f 0 2024-09-13T22:56:24.746 INFO:tasks.workunit.client.0.smithi002.stdout:7/797: rename d8/d10/d39/d60/db8/d2e/d3c/f97 to d8/d10/fed 0 2024-09-13T22:56:24.753 INFO:tasks.workunit.client.1.smithi047.stdout:1/944: creat d0/d7/d14/d57/d62/d76/d94/f10e x:0 0 0 2024-09-13T22:56:24.755 INFO:tasks.workunit.client.0.smithi002.stdout:4/779: mkdir d3/d40/d45/dfd 0 2024-09-13T22:56:24.756 INFO:tasks.workunit.client.1.smithi047.stdout:8/855: creat d8/d64/d4e/d70/d98/f128 x:0 0 0 2024-09-13T22:56:24.757 INFO:tasks.workunit.client.1.smithi047.stdout:7/813: mknod d0/d7/da/d1e/de7/df4/c113 0 2024-09-13T22:56:24.759 INFO:tasks.workunit.client.1.smithi047.stdout:9/867: symlink d1/dc/d14/dd/d54/d50/d91/d116/l123 0 2024-09-13T22:56:24.761 INFO:tasks.workunit.client.1.smithi047.stdout:2/886: dread - d1/df/d1d/d20/d29/dcd/dff/fe3 zero size 2024-09-13T22:56:24.764 INFO:tasks.workunit.client.1.smithi047.stdout:3/896: truncate d0/d3/d4/d16/d2c/de/d1f/faf 4734695 0 2024-09-13T22:56:24.767 INFO:tasks.workunit.client.1.smithi047.stdout:7/814: dwrite d0/d7/da/d1e/d93/ddf/ffa [0,4194304] 0 2024-09-13T22:56:24.771 INFO:tasks.workunit.client.1.smithi047.stdout:1/945: symlink d0/d7/d14/d28/l10f 0 2024-09-13T22:56:24.771 INFO:tasks.workunit.client.1.smithi047.stdout:9/868: dwrite d1/dc/d14/dd/d54/d50/d91/da3/f121 [0,4194304] 0 2024-09-13T22:56:24.781 INFO:tasks.workunit.client.0.smithi002.stdout:1/879: getdents d1/d13/d30/d73/da1 0 2024-09-13T22:56:24.781 INFO:tasks.workunit.client.0.smithi002.stdout:0/811: rename d1/d2/d6c/d8b/fbf to d1/df6/f123 0 2024-09-13T22:56:24.786 INFO:tasks.workunit.client.1.smithi047.stdout:9/869: creat d1/d5f/de9/f124 x:0 0 0 2024-09-13T22:56:24.794 INFO:tasks.workunit.client.1.smithi047.stdout:4/948: write dc/d29/fe4 [388830,122698] 0 2024-09-13T22:56:24.794 INFO:tasks.workunit.client.1.smithi047.stdout:2/887: symlink d1/df/d1d/d20/d29/de1/l129 0 2024-09-13T22:56:24.798 INFO:tasks.workunit.client.1.smithi047.stdout:6/899: dwrite d3/d11/d2b/d1c/f20 [0,4194304] 0 2024-09-13T22:56:24.800 INFO:tasks.workunit.client.1.smithi047.stdout:3/897: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/f89 [498995,53448] 0 2024-09-13T22:56:24.800 INFO:tasks.workunit.client.1.smithi047.stdout:6/900: chown d3/d11/d2b/d1c/d4d/d69/dc2/d11c 82729 1 2024-09-13T22:56:24.801 INFO:tasks.workunit.client.1.smithi047.stdout:1/946: getdents d0/d7/d14/d57/d62/d76/d94/dea 0 2024-09-13T22:56:24.801 INFO:tasks.workunit.client.1.smithi047.stdout:3/898: chown d0/d3/d4/d16/d1c/lf5 64 1 2024-09-13T22:56:24.803 INFO:tasks.workunit.client.1.smithi047.stdout:1/947: dread d0/d7/d13/f105 [0,4194304] 0 2024-09-13T22:56:24.805 INFO:tasks.workunit.client.1.smithi047.stdout:1/948: write d0/d7/d14/f102 [863909,46016] 0 2024-09-13T22:56:24.807 INFO:tasks.workunit.client.1.smithi047.stdout:4/949: chown dc/d29/f35 1296297 1 2024-09-13T22:56:24.810 INFO:tasks.workunit.client.1.smithi047.stdout:9/870: write d1/dc/d14/dd/d54/d50/d91/da3/fa9 [863131,78572] 0 2024-09-13T22:56:24.813 INFO:tasks.workunit.client.1.smithi047.stdout:6/901: fsync d3/fa5 0 2024-09-13T22:56:24.817 INFO:tasks.workunit.client.1.smithi047.stdout:3/899: creat d0/d3/d4/d16/d32/d42/f120 x:0 0 0 2024-09-13T22:56:24.820 INFO:tasks.workunit.client.1.smithi047.stdout:8/856: getdents d8/d64/d4e/d4d/d8f/d91/d38 0 2024-09-13T22:56:24.822 INFO:tasks.workunit.client.1.smithi047.stdout:8/857: write d8/d64/d4e/d4d/fe6 [2111539,42349] 0 2024-09-13T22:56:24.825 INFO:tasks.workunit.client.1.smithi047.stdout:4/950: unlink dc/de/d17/c32 0 2024-09-13T22:56:24.829 INFO:tasks.workunit.client.1.smithi047.stdout:9/871: creat d1/dc/d14/dd/d54/d8d/dbc/f125 x:0 0 0 2024-09-13T22:56:24.830 INFO:tasks.workunit.client.1.smithi047.stdout:9/872: truncate d1/d5f/d6a/fd1 260430 0 2024-09-13T22:56:24.832 INFO:tasks.workunit.client.1.smithi047.stdout:3/900: rmdir d0 39 2024-09-13T22:56:24.837 INFO:tasks.workunit.client.1.smithi047.stdout:4/951: creat dc/de/db9/f13e x:0 0 0 2024-09-13T22:56:24.839 INFO:tasks.workunit.client.1.smithi047.stdout:2/888: creat d1/df/d1d/d20/d54/f12a x:0 0 0 2024-09-13T22:56:24.842 INFO:tasks.workunit.client.1.smithi047.stdout:6/902: unlink d3/d11/d2b/d1c/l3a 0 2024-09-13T22:56:24.845 INFO:tasks.workunit.client.1.smithi047.stdout:9/873: truncate d1/dc/d14/f2f 4424091 0 2024-09-13T22:56:24.850 INFO:tasks.workunit.client.1.smithi047.stdout:1/949: creat d0/d7/d13/d5d/f110 x:0 0 0 2024-09-13T22:56:24.851 INFO:tasks.workunit.client.1.smithi047.stdout:1/950: fsync d0/d7/d14/d57/d62/d76/d94/fae 0 2024-09-13T22:56:24.854 INFO:tasks.workunit.client.0.smithi002.stdout:8/836: link d3/dc/d16/d4b/d72/fcc d3/dc/d16/d97/f107 0 2024-09-13T22:56:24.856 INFO:tasks.workunit.client.1.smithi047.stdout:2/889: mkdir d1/df/dc8/d12b 0 2024-09-13T22:56:24.856 INFO:tasks.workunit.client.0.smithi002.stdout:5/835: getdents d1/d2a/d6b/d88/d55 0 2024-09-13T22:56:24.856 INFO:tasks.workunit.client.0.smithi002.stdout:3/875: sync 2024-09-13T22:56:24.856 INFO:tasks.workunit.client.0.smithi002.stdout:9/888: sync 2024-09-13T22:56:24.858 INFO:tasks.workunit.client.0.smithi002.stdout:3/876: chown d9/fb8 0 1 2024-09-13T22:56:24.858 INFO:tasks.workunit.client.0.smithi002.stdout:1/880: dread - d1/d13/d1d/d34/d51/dc6/ff5 zero size 2024-09-13T22:56:24.858 INFO:tasks.workunit.client.0.smithi002.stdout:2/820: symlink d1/d7/d8/d2c/d9d/dfb/l118 0 2024-09-13T22:56:24.858 INFO:tasks.workunit.client.1.smithi047.stdout:1/951: dread d0/d7/db/d101/d55/ffe [0,4194304] 0 2024-09-13T22:56:24.858 INFO:tasks.workunit.client.1.smithi047.stdout:6/903: unlink d3/d11/d2b/d1c/dbf/c58 0 2024-09-13T22:56:24.858 INFO:tasks.workunit.client.1.smithi047.stdout:6/904: readlink d3/la 0 2024-09-13T22:56:24.859 INFO:tasks.workunit.client.0.smithi002.stdout:4/780: chown d3/f9e 388145862 1 2024-09-13T22:56:24.859 INFO:tasks.workunit.client.1.smithi047.stdout:6/905: chown d3/d11/d2b/d4c/f80 91 1 2024-09-13T22:56:24.860 INFO:tasks.workunit.client.1.smithi047.stdout:8/858: write d8/d6b/da9/dc3/ddc/f126 [1041764,117302] 0 2024-09-13T22:56:24.861 INFO:tasks.workunit.client.0.smithi002.stdout:5/836: write d1/d2a/d6b/d88/d55/d56/d86/d11d/f12c [135534,97992] 0 2024-09-13T22:56:24.861 INFO:tasks.workunit.client.0.smithi002.stdout:3/877: readlink d9/d15/d36/d4e/d5e/dae/d89/lac 0 2024-09-13T22:56:24.861 INFO:tasks.workunit.client.0.smithi002.stdout:4/781: write d3/f10 [4040072,124039] 0 2024-09-13T22:56:24.862 INFO:tasks.workunit.client.1.smithi047.stdout:8/859: stat d8/d64/lb5 0 2024-09-13T22:56:24.862 INFO:tasks.workunit.client.1.smithi047.stdout:8/860: dread - d8/d6b/da9/dc3/fff zero size 2024-09-13T22:56:24.863 INFO:tasks.workunit.client.1.smithi047.stdout:3/901: creat d0/d3/d4/d16/d73/f121 x:0 0 0 2024-09-13T22:56:24.875 INFO:tasks.workunit.client.0.smithi002.stdout:3/878: chown d9/d15/l59 1022346 1 2024-09-13T22:56:24.876 INFO:tasks.workunit.client.1.smithi047.stdout:4/952: write dc/de/d23/d40/d7b/dab/dae/fd5 [1576795,46563] 0 2024-09-13T22:56:24.877 INFO:tasks.workunit.client.1.smithi047.stdout:2/890: mknod d1/df/dc8/c12c 0 2024-09-13T22:56:24.877 INFO:tasks.workunit.client.0.smithi002.stdout:3/879: dread - d9/d15/d26/f6e zero size 2024-09-13T22:56:24.877 INFO:tasks.workunit.client.0.smithi002.stdout:8/837: dread d3/dc/d18/d2e/d94/f7b [0,4194304] 0 2024-09-13T22:56:24.877 INFO:tasks.workunit.client.0.smithi002.stdout:8/838: read d3/d27/f32 [7722049,88002] 0 2024-09-13T22:56:24.878 INFO:tasks.workunit.client.1.smithi047.stdout:2/891: fsync d1/df/d1d/d20/d29/f2d 0 2024-09-13T22:56:24.878 INFO:tasks.workunit.client.0.smithi002.stdout:8/839: write d3/dc/d16/d2f/d83/d85/fdd [672804,11475] 0 2024-09-13T22:56:24.879 INFO:tasks.workunit.client.0.smithi002.stdout:8/840: chown d3/d27/l3a 18 1 2024-09-13T22:56:24.884 INFO:tasks.workunit.client.0.smithi002.stdout:9/889: write d8/d2c/dbc/fcc [246312,107039] 0 2024-09-13T22:56:24.887 INFO:tasks.workunit.client.1.smithi047.stdout:3/902: mkdir d0/d3/d4/d16/d2c/de/d1f/d3b/d122 0 2024-09-13T22:56:24.889 INFO:tasks.workunit.client.1.smithi047.stdout:8/861: dread d8/d64/d4e/d4d/d8f/d91/f96 [0,4194304] 0 2024-09-13T22:56:24.889 INFO:tasks.workunit.client.0.smithi002.stdout:7/798: getdents d8 0 2024-09-13T22:56:24.890 INFO:tasks.workunit.client.1.smithi047.stdout:2/892: dread d1/df/d1d/d2e/d5e/ffd [0,4194304] 0 2024-09-13T22:56:24.890 INFO:tasks.workunit.client.1.smithi047.stdout:9/874: dwrite d1/d5f/f9b [4194304,4194304] 0 2024-09-13T22:56:24.891 INFO:tasks.workunit.client.0.smithi002.stdout:2/821: fsync d1/d7/d8/f1e 0 2024-09-13T22:56:24.892 INFO:tasks.workunit.client.1.smithi047.stdout:2/893: write d1/f1a [4093037,126011] 0 2024-09-13T22:56:24.892 INFO:tasks.workunit.client.0.smithi002.stdout:2/822: fsync d1/f1d 0 2024-09-13T22:56:24.894 INFO:tasks.workunit.client.1.smithi047.stdout:4/953: creat dc/da3/f13f x:0 0 0 2024-09-13T22:56:24.902 INFO:tasks.workunit.client.0.smithi002.stdout:4/782: dread d3/d14/d29/d2a/f43 [0,4194304] 0 2024-09-13T22:56:24.903 INFO:tasks.workunit.client.0.smithi002.stdout:9/890: unlink d8/d2c/f58 0 2024-09-13T22:56:24.904 INFO:tasks.workunit.client.0.smithi002.stdout:7/799: fsync d8/d10/d39/d60/db8/d26/f3f 0 2024-09-13T22:56:24.910 INFO:tasks.workunit.client.0.smithi002.stdout:1/881: link d1/d13/d21/d40/ddc/c125 d1/d13/d21/d40/dc4/dc8/ddf/c131 0 2024-09-13T22:56:24.914 INFO:tasks.workunit.client.1.smithi047.stdout:6/906: dwrite d3/d11/d2b/d4c/dc0/f86 [0,4194304] 0 2024-09-13T22:56:24.914 INFO:tasks.workunit.client.1.smithi047.stdout:9/875: mknod d1/dc/d14/dd/d54/d50/d91/da3/c126 0 2024-09-13T22:56:24.916 INFO:tasks.workunit.client.0.smithi002.stdout:2/823: write d1/d7/d35/f43 [238987,75774] 0 2024-09-13T22:56:24.919 INFO:tasks.workunit.client.0.smithi002.stdout:4/783: symlink d3/d40/d45/lfe 0 2024-09-13T22:56:24.919 INFO:tasks.workunit.client.0.smithi002.stdout:4/784: fsync d3/d14/fe4 0 2024-09-13T22:56:24.920 INFO:tasks.workunit.client.1.smithi047.stdout:2/894: truncate d1/df/d1d/d20/d37/fbb 1215424 0 2024-09-13T22:56:24.921 INFO:tasks.workunit.client.0.smithi002.stdout:9/891: mknod d8/d10/d1c/dbf/df3/c12b 0 2024-09-13T22:56:24.922 INFO:tasks.workunit.client.0.smithi002.stdout:9/892: readlink d8/d10/d1c/d3d/lb6 0 2024-09-13T22:56:24.923 INFO:tasks.workunit.client.1.smithi047.stdout:8/862: mknod d8/d64/d4e/d70/d98/dfa/c129 0 2024-09-13T22:56:24.927 INFO:tasks.workunit.client.1.smithi047.stdout:4/954: dwrite dc/fea [0,4194304] 0 2024-09-13T22:56:24.928 INFO:tasks.workunit.client.0.smithi002.stdout:7/800: rmdir d8/d10/d39/d60 39 2024-09-13T22:56:24.929 INFO:tasks.workunit.client.1.smithi047.stdout:4/955: stat dc/de/d23/d40/d7b/c7f 0 2024-09-13T22:56:24.931 INFO:tasks.workunit.client.1.smithi047.stdout:3/903: link d0/d3/d5e/ff4 d0/d3/d4/d16/d32/d42/d79/df2/f123 0 2024-09-13T22:56:24.932 INFO:tasks.workunit.client.1.smithi047.stdout:3/904: write d0/d3/d4/d16/d73/f118 [556368,37815] 0 2024-09-13T22:56:24.935 INFO:tasks.workunit.client.0.smithi002.stdout:1/882: mknod d1/d13/d1d/d34/d51/dc6/c132 0 2024-09-13T22:56:24.944 INFO:tasks.workunit.client.0.smithi002.stdout:2/824: symlink d1/d7/d8/d2c/d9d/l119 0 2024-09-13T22:56:24.945 INFO:tasks.workunit.client.1.smithi047.stdout:2/895: fsync d1/df/d1d/da9/fdc 0 2024-09-13T22:56:24.951 INFO:tasks.workunit.client.0.smithi002.stdout:4/785: mkdir d3/db3/db9/dff 0 2024-09-13T22:56:24.952 INFO:tasks.workunit.client.1.smithi047.stdout:9/876: dwrite d1/f2b [4194304,4194304] 0 2024-09-13T22:56:24.953 INFO:tasks.workunit.client.0.smithi002.stdout:6/842: sync 2024-09-13T22:56:24.953 INFO:tasks.workunit.client.1.smithi047.stdout:8/863: symlink d8/d6b/da9/dc3/l12a 0 2024-09-13T22:56:24.954 INFO:tasks.workunit.client.0.smithi002.stdout:4/786: dread d3/d14/d29/d2a/f2d [0,4194304] 0 2024-09-13T22:56:24.958 INFO:tasks.workunit.client.0.smithi002.stdout:9/893: rmdir d8/d10/d1c/d3d/d11f/da3/db9/dfa/da8/dc3 39 2024-09-13T22:56:24.959 INFO:tasks.workunit.client.1.smithi047.stdout:3/905: mknod d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d85/c124 0 2024-09-13T22:56:24.961 INFO:tasks.workunit.client.1.smithi047.stdout:6/907: link d3/d11/f7b d3/d11/d2b/d1c/d23/dda/f12f 0 2024-09-13T22:56:24.961 INFO:tasks.workunit.client.0.smithi002.stdout:8/841: link d3/dc/d16/d4b/d72/fcc d3/dc/d18/d2e/f108 0 2024-09-13T22:56:24.963 INFO:tasks.workunit.client.0.smithi002.stdout:2/825: truncate d1/d7/d41/d96/f9e 757580 0 2024-09-13T22:56:24.963 INFO:tasks.workunit.client.0.smithi002.stdout:2/826: chown d1/d4a/c110 3 1 2024-09-13T22:56:24.965 INFO:tasks.workunit.client.0.smithi002.stdout:6/843: creat d12/d17/d28/d67/d9f/ddd/f109 x:0 0 0 2024-09-13T22:56:24.968 INFO:tasks.workunit.client.0.smithi002.stdout:4/787: unlink d3/d14/d86/db1/fc4 0 2024-09-13T22:56:24.973 INFO:tasks.workunit.client.1.smithi047.stdout:9/877: rename d1/dc/d14/dd/d4c/df2/l69 to d1/d5f/dc7/l127 0 2024-09-13T22:56:24.976 INFO:tasks.workunit.client.0.smithi002.stdout:1/883: symlink d1/d13/d1d/d34/da7/l133 0 2024-09-13T22:56:24.979 INFO:tasks.workunit.client.1.smithi047.stdout:2/896: write d1/df/d1d/d20/d29/f52 [1794444,95650] 0 2024-09-13T22:56:24.980 INFO:tasks.workunit.client.1.smithi047.stdout:3/906: mkdir d0/d3/d4/d16/d32/d42/d79/dba/d125 0 2024-09-13T22:56:24.981 INFO:tasks.workunit.client.0.smithi002.stdout:9/894: dread d8/d10/d1c/d3d/fc2 [0,4194304] 0 2024-09-13T22:56:24.982 INFO:tasks.workunit.client.0.smithi002.stdout:2/827: readlink d1/d32/d37/lce 0 2024-09-13T22:56:24.985 INFO:tasks.workunit.client.1.smithi047.stdout:4/956: write dc/d29/d4c/f82 [6996884,122346] 0 2024-09-13T22:56:24.987 INFO:tasks.workunit.client.1.smithi047.stdout:6/908: write d3/fe6 [185645,118761] 0 2024-09-13T22:56:24.988 INFO:tasks.workunit.client.0.smithi002.stdout:4/788: symlink d3/d62/l100 0 2024-09-13T22:56:24.989 INFO:tasks.workunit.client.1.smithi047.stdout:4/957: truncate dc/de/d23/d40/f13a 693823 0 2024-09-13T22:56:24.990 INFO:tasks.workunit.client.0.smithi002.stdout:7/801: truncate d8/d10/d39/d60/db8/d26/d4c/d81/f57 11001580 0 2024-09-13T22:56:24.991 INFO:tasks.workunit.client.0.smithi002.stdout:7/802: fsync d8/fae 0 2024-09-13T22:56:24.991 INFO:tasks.workunit.client.1.smithi047.stdout:8/864: mknod d8/d64/d104/c12b 0 2024-09-13T22:56:24.992 INFO:tasks.workunit.client.0.smithi002.stdout:1/884: creat d1/d13/d30/d73/da1/d7d/dce/f134 x:0 0 0 2024-09-13T22:56:24.993 INFO:tasks.workunit.client.1.smithi047.stdout:2/897: mknod d1/de/db4/c12d 0 2024-09-13T22:56:24.997 INFO:tasks.workunit.client.1.smithi047.stdout:9/878: dread d1/dc/d14/dd/d54/d50/d5b/d9e/f83 [0,4194304] 0 2024-09-13T22:56:24.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:24 smithi002 ceph-mon[27637]: pgmap v22: 65 pgs: 65 active+clean; 3.2 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 103 MiB/s rd, 231 MiB/s wr, 481 op/s 2024-09-13T22:56:25.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:24 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:25.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:24 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:25.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:24 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:56:25.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:24 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:56:25.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:24 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:56:25.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:24 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:56:25.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:24 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:56:25.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:24 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:56:25.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:24 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:25.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:24 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:56:25.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:24 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:56:25.002 INFO:tasks.workunit.client.1.smithi047.stdout:5/774: sync 2024-09-13T22:56:25.002 INFO:tasks.workunit.client.1.smithi047.stdout:0/839: sync 2024-09-13T22:56:25.002 INFO:tasks.workunit.client.1.smithi047.stdout:6/909: dread d3/d11/d74/f85 [0,4194304] 0 2024-09-13T22:56:25.003 INFO:tasks.workunit.client.1.smithi047.stdout:7/815: sync 2024-09-13T22:56:25.004 INFO:tasks.workunit.client.0.smithi002.stdout:7/803: rmdir d8/d10/d39/d60/db8/d26/d88 39 2024-09-13T22:56:25.004 INFO:tasks.workunit.client.1.smithi047.stdout:7/816: chown d0/d7/da/d1e 14101 1 2024-09-13T22:56:25.005 INFO:tasks.workunit.client.1.smithi047.stdout:7/817: readlink d0/d57/lc9 0 2024-09-13T22:56:25.006 INFO:tasks.workunit.client.1.smithi047.stdout:2/898: fdatasync d1/df/d1d/d20/f2c 0 2024-09-13T22:56:25.009 INFO:tasks.workunit.client.0.smithi002.stdout:9/895: write d8/d10/d1c/d3d/f92 [602891,67984] 0 2024-09-13T22:56:25.010 INFO:tasks.workunit.client.0.smithi002.stdout:6/844: truncate d12/f22 1295827 0 2024-09-13T22:56:25.011 INFO:tasks.workunit.client.0.smithi002.stdout:9/896: chown d8/c20 114725545 1 2024-09-13T22:56:25.012 INFO:tasks.workunit.client.0.smithi002.stdout:6/845: write fd [5070742,119127] 0 2024-09-13T22:56:25.012 INFO:tasks.workunit.client.1.smithi047.stdout:5/775: dwrite d19/d34/d42/d5d/fb4 [0,4194304] 0 2024-09-13T22:56:25.013 INFO:tasks.workunit.client.0.smithi002.stdout:8/842: dwrite d3/dc/d16/d4b/d72/d73/f9f [0,4194304] 0 2024-09-13T22:56:25.013 INFO:tasks.workunit.client.0.smithi002.stdout:7/804: rmdir d8/d10/d39/d60/db8/d2e 39 2024-09-13T22:56:25.013 INFO:tasks.workunit.client.1.smithi047.stdout:4/958: symlink dc/l140 0 2024-09-13T22:56:25.014 INFO:tasks.workunit.client.1.smithi047.stdout:5/776: fsync d19/d34/d42/d5d/fed 0 2024-09-13T22:56:25.017 INFO:tasks.workunit.client.1.smithi047.stdout:9/879: truncate d1/dc/d14/dd/d4c/df2/f48 1338757 0 2024-09-13T22:56:25.017 INFO:tasks.workunit.client.0.smithi002.stdout:1/885: mkdir d1/d13/d30/d73/da1/d12a/d135 0 2024-09-13T22:56:25.019 INFO:tasks.workunit.client.1.smithi047.stdout:9/880: readlink d1/dc/d14/dd/d54/d50/d91/lbe 0 2024-09-13T22:56:25.019 INFO:tasks.workunit.client.0.smithi002.stdout:1/886: write d1/d13/d21/d39/d70/d10c/d3d/ffd [968853,43686] 0 2024-09-13T22:56:25.022 INFO:tasks.workunit.client.1.smithi047.stdout:8/865: dread d8/f32 [0,4194304] 0 2024-09-13T22:56:25.023 INFO:tasks.workunit.client.0.smithi002.stdout:7/805: mkdir d8/dee 0 2024-09-13T22:56:25.024 INFO:tasks.workunit.client.1.smithi047.stdout:0/840: truncate d1/d5/d16/fac 425661 0 2024-09-13T22:56:25.025 INFO:tasks.workunit.client.0.smithi002.stdout:6/846: symlink d12/d17/d34/d4b/l10a 0 2024-09-13T22:56:25.026 INFO:tasks.workunit.client.1.smithi047.stdout:0/841: truncate d1/d5/d16/d97/de4/ffe 667865 0 2024-09-13T22:56:25.029 INFO:tasks.workunit.client.0.smithi002.stdout:9/897: creat d8/d10/d1c/d3d/d11f/da3/db9/f12c x:0 0 0 2024-09-13T22:56:25.029 INFO:tasks.workunit.client.0.smithi002.stdout:9/898: stat d8/d2c/c30 0 2024-09-13T22:56:25.030 INFO:tasks.workunit.client.0.smithi002.stdout:1/887: creat d1/d13/d21/d39/d70/d10c/d3b/f136 x:0 0 0 2024-09-13T22:56:25.036 INFO:tasks.workunit.client.1.smithi047.stdout:4/959: read dc/de/d23/dc4/ddb/fe7 [1118637,111768] 0 2024-09-13T22:56:25.037 INFO:tasks.workunit.client.1.smithi047.stdout:5/777: read d19/d25/d45/da3/fb8 [7689097,112776] 0 2024-09-13T22:56:25.040 INFO:tasks.workunit.client.1.smithi047.stdout:6/910: write d3/d11/f7b [496141,91140] 0 2024-09-13T22:56:25.043 INFO:tasks.workunit.client.0.smithi002.stdout:1/888: symlink d1/d13/d30/d73/da1/l137 0 2024-09-13T22:56:25.045 INFO:tasks.workunit.client.0.smithi002.stdout:1/889: write d1/d13/d21/d39/d70/de2/fe9 [829156,51701] 0 2024-09-13T22:56:25.045 INFO:tasks.workunit.client.0.smithi002.stdout:1/890: chown d1/d13/d1d/d34/d51/c6e 4063 1 2024-09-13T22:56:25.046 INFO:tasks.workunit.client.1.smithi047.stdout:8/866: symlink d8/d64/d4e/d4d/d8f/d91/d40/de5/dfe/l12c 0 2024-09-13T22:56:25.047 INFO:tasks.workunit.client.1.smithi047.stdout:5/778: dwrite d19/d23/d2e/d41/d58/fe9 [0,4194304] 0 2024-09-13T22:56:25.048 INFO:tasks.workunit.client.1.smithi047.stdout:5/779: readlink d19/d23/d4c/ldb 0 2024-09-13T22:56:25.049 INFO:tasks.workunit.client.0.smithi002.stdout:6/847: symlink d12/d17/d2a/l10b 0 2024-09-13T22:56:25.054 INFO:tasks.workunit.client.1.smithi047.stdout:7/818: symlink d0/d57/d5b/l114 0 2024-09-13T22:56:25.059 INFO:tasks.workunit.client.0.smithi002.stdout:8/843: dwrite d3/d21/f9d [0,4194304] 0 2024-09-13T22:56:25.059 INFO:tasks.workunit.client.1.smithi047.stdout:0/842: symlink d1/d5/d16/d97/dfc/d45/d84/l111 0 2024-09-13T22:56:25.066 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:24 smithi047 ceph-mon[34560]: pgmap v22: 65 pgs: 65 active+clean; 3.2 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 103 MiB/s rd, 231 MiB/s wr, 481 op/s 2024-09-13T22:56:25.066 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:24 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:25.066 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:24 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:25.066 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:24 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:56:25.066 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:24 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:56:25.066 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:24 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:56:25.066 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:24 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:56:25.066 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:24 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:56:25.066 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:24 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T22:56:25.066 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:24 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:25.066 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:24 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:56:25.066 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:24 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:56:25.067 INFO:tasks.workunit.client.1.smithi047.stdout:3/907: getdents d0/d3/d4/d91 0 2024-09-13T22:56:25.067 INFO:tasks.workunit.client.0.smithi002.stdout:1/891: mkdir d1/d13/d21/d39/df7/dcf/d138 0 2024-09-13T22:56:25.067 INFO:tasks.workunit.client.0.smithi002.stdout:1/892: write d1/d13/d21/f118 [695879,121808] 0 2024-09-13T22:56:25.068 INFO:tasks.workunit.client.1.smithi047.stdout:2/899: dwrite d1/df/d1d/d3c/f9d [0,4194304] 0 2024-09-13T22:56:25.070 INFO:tasks.workunit.client.0.smithi002.stdout:6/848: unlink d12/d17/d28/d67/dca/dd8/ffe 0 2024-09-13T22:56:25.073 INFO:tasks.workunit.client.1.smithi047.stdout:9/881: write d1/dc/d14/dd/d54/d50/d60/f11c [702072,88436] 0 2024-09-13T22:56:25.077 INFO:tasks.workunit.client.1.smithi047.stdout:4/960: truncate dc/de/d23/d40/f9a 323285 0 2024-09-13T22:56:25.078 INFO:tasks.workunit.client.0.smithi002.stdout:9/899: dwrite d8/d10/d1c/dd6/dda/f111 [0,4194304] 0 2024-09-13T22:56:25.082 INFO:tasks.workunit.client.1.smithi047.stdout:6/911: mknod d3/d11/d2b/d1c/d4d/d69/dc2/dcd/c130 0 2024-09-13T22:56:25.085 INFO:tasks.workunit.client.0.smithi002.stdout:1/893: rename d1/d13/d21/d39/d70/d10c/d3d/d5d/f37 to d1/d13/d21/d39/df7/dcf/d138/f139 0 2024-09-13T22:56:25.089 INFO:tasks.workunit.client.1.smithi047.stdout:8/867: write d8/d64/f121 [3432190,53246] 0 2024-09-13T22:56:25.092 INFO:tasks.workunit.client.0.smithi002.stdout:0/812: sync 2024-09-13T22:56:25.093 INFO:tasks.workunit.client.1.smithi047.stdout:7/819: symlink d0/d7/da/d47/d92/l115 0 2024-09-13T22:56:25.095 INFO:tasks.workunit.client.0.smithi002.stdout:8/844: dwrite d3/dc/d16/d97/fb5 [0,4194304] 0 2024-09-13T22:56:25.097 INFO:tasks.workunit.client.0.smithi002.stdout:9/900: unlink d8/d10/d1c/d3d/d11f/da3/db9/f12c 0 2024-09-13T22:56:25.097 INFO:tasks.workunit.client.0.smithi002.stdout:9/901: write d8/d10/d1c/d3d/fb3 [58654,52442] 0 2024-09-13T22:56:25.102 INFO:tasks.workunit.client.0.smithi002.stdout:1/894: dread d1/d13/d1d/d34/fa0 [0,4194304] 0 2024-09-13T22:56:25.106 INFO:tasks.workunit.client.0.smithi002.stdout:7/806: creat d8/d10/d39/d60/db8/d2e/d50/d52/db1/fef x:0 0 0 2024-09-13T22:56:25.109 INFO:tasks.workunit.client.1.smithi047.stdout:4/961: rmdir dc/de/d23/d40/d7b/d90/da6 39 2024-09-13T22:56:25.114 INFO:tasks.workunit.client.1.smithi047.stdout:6/912: rename d3/f105 to d3/d11/d2b/d76/d127/f131 0 2024-09-13T22:56:25.116 INFO:tasks.workunit.client.1.smithi047.stdout:8/868: unlink d8/d64/d4e/d70/d98/fad 0 2024-09-13T22:56:25.123 INFO:tasks.workunit.client.1.smithi047.stdout:7/820: symlink d0/d7/da/d47/d92/l116 0 2024-09-13T22:56:25.124 INFO:tasks.workunit.client.1.smithi047.stdout:2/900: mknod d1/df/d1d/c12e 0 2024-09-13T22:56:25.128 INFO:tasks.workunit.client.0.smithi002.stdout:8/845: dread d3/f35 [0,4194304] 0 2024-09-13T22:56:25.131 INFO:tasks.workunit.client.0.smithi002.stdout:0/813: fsync d1/d4/d75/d31/d32/dbb/de1/fe9 0 2024-09-13T22:56:25.132 INFO:tasks.workunit.client.0.smithi002.stdout:9/902: write d8/d10/d1c/f12 [1930051,37733] 0 2024-09-13T22:56:25.135 INFO:tasks.workunit.client.0.smithi002.stdout:6/849: rename d12/d17/d34/d39/c60 to d12/d17/d2a/c10c 0 2024-09-13T22:56:25.135 INFO:tasks.workunit.client.0.smithi002.stdout:6/850: readlink lc 0 2024-09-13T22:56:25.138 INFO:tasks.workunit.client.0.smithi002.stdout:8/846: creat d3/dc/da4/f109 x:0 0 0 2024-09-13T22:56:25.138 INFO:tasks.workunit.client.1.smithi047.stdout:5/780: link d19/c1f d19/d34/d42/d5d/dd8/cf1 0 2024-09-13T22:56:25.139 INFO:tasks.workunit.client.1.smithi047.stdout:7/821: mknod d0/d7/da/d4e/dd3/c117 0 2024-09-13T22:56:25.140 INFO:tasks.workunit.client.1.smithi047.stdout:2/901: truncate d1/d16/f64 1765676 0 2024-09-13T22:56:25.141 INFO:tasks.workunit.client.1.smithi047.stdout:2/902: dread - d1/d16/d40/d57/f71 zero size 2024-09-13T22:56:25.143 INFO:tasks.workunit.client.0.smithi002.stdout:9/903: dread - d8/d10/d1c/d3d/d11f/da3/db9/dfa/fb4 zero size 2024-09-13T22:56:25.147 INFO:tasks.workunit.client.0.smithi002.stdout:1/895: unlink d1/d13/d30/d73/da1/ffc 0 2024-09-13T22:56:25.148 INFO:tasks.workunit.client.1.smithi047.stdout:2/903: dwrite d1/d8a/f112 [0,4194304] 0 2024-09-13T22:56:25.149 INFO:tasks.workunit.client.1.smithi047.stdout:7/822: creat d0/d7/da/d1e/d51/f118 x:0 0 0 2024-09-13T22:56:25.152 INFO:tasks.workunit.client.1.smithi047.stdout:3/908: link d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/f90 d0/d3/d4/d16/d2c/de/f126 0 2024-09-13T22:56:25.154 INFO:tasks.workunit.client.0.smithi002.stdout:5/837: sync 2024-09-13T22:56:25.155 INFO:tasks.workunit.client.0.smithi002.stdout:3/880: sync 2024-09-13T22:56:25.156 INFO:tasks.workunit.client.0.smithi002.stdout:5/838: read d1/d2a/d6b/d88/f4d [661315,84717] 0 2024-09-13T22:56:25.156 INFO:tasks.workunit.client.1.smithi047.stdout:3/909: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/f4b [73412,77704] 0 2024-09-13T22:56:25.158 INFO:tasks.workunit.client.1.smithi047.stdout:3/910: readlink d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/la7 0 2024-09-13T22:56:25.160 INFO:tasks.workunit.client.0.smithi002.stdout:0/814: truncate d1/df6/f123 7916817 0 2024-09-13T22:56:25.163 INFO:tasks.workunit.client.1.smithi047.stdout:3/911: dread d0/d3/d4/d16/d32/d42/f9e [0,4194304] 0 2024-09-13T22:56:25.167 INFO:tasks.workunit.client.1.smithi047.stdout:3/912: dread d0/d3/d4/d16/d32/d42/d79/d9c/fb8 [0,4194304] 0 2024-09-13T22:56:25.168 INFO:tasks.workunit.client.1.smithi047.stdout:3/913: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/f89 [448082,85146] 0 2024-09-13T22:56:25.169 INFO:tasks.workunit.client.1.smithi047.stdout:3/914: stat d0/d3/d4/d16/d32/d76/ce6 0 2024-09-13T22:56:25.171 INFO:tasks.workunit.client.1.smithi047.stdout:3/915: dread - d0/d3/d4/d16/d2c/de/d1f/d3b/ffb zero size 2024-09-13T22:56:25.218 INFO:tasks.workunit.client.1.smithi047.stdout:1/952: sync 2024-09-13T22:56:25.219 INFO:tasks.workunit.client.0.smithi002.stdout:7/807: truncate d8/f27 869823 0 2024-09-13T22:56:25.220 INFO:tasks.workunit.client.0.smithi002.stdout:9/904: mkdir d8/d10/d1c/d68/d12d 0 2024-09-13T22:56:25.221 INFO:tasks.workunit.client.0.smithi002.stdout:9/905: stat d8/d10/d61/f81 0 2024-09-13T22:56:25.221 INFO:tasks.workunit.client.1.smithi047.stdout:8/869: symlink d8/d6b/dce/d10f/l12d 0 2024-09-13T22:56:25.222 INFO:tasks.workunit.client.0.smithi002.stdout:6/851: truncate d12/d17/d2a/f32 1150328 0 2024-09-13T22:56:25.223 INFO:tasks.workunit.client.0.smithi002.stdout:6/852: chown d12/d17/d28/d67/d9f 63969399 1 2024-09-13T22:56:25.223 INFO:tasks.workunit.client.1.smithi047.stdout:8/870: write d8/d64/f47 [926339,122657] 0 2024-09-13T22:56:25.224 INFO:tasks.workunit.client.1.smithi047.stdout:1/953: dwrite d0/d7/d87/fcf [0,4194304] 0 2024-09-13T22:56:25.224 INFO:tasks.workunit.client.1.smithi047.stdout:2/904: creat d1/df/d1d/d20/d29/dcd/dff/db6/f12f x:0 0 0 2024-09-13T22:56:25.225 INFO:tasks.workunit.client.1.smithi047.stdout:1/954: stat d0/d7/d14/d28/l10f 0 2024-09-13T22:56:25.226 INFO:tasks.workunit.client.0.smithi002.stdout:8/847: dwrite d3/dc/d18/f81 [4194304,4194304] 0 2024-09-13T22:56:25.228 INFO:tasks.workunit.client.1.smithi047.stdout:4/962: link dc/d29/ff3 dc/de/d23/d40/d7b/dab/dae/dee/f141 0 2024-09-13T22:56:25.229 INFO:tasks.workunit.client.0.smithi002.stdout:8/848: write d3/d27/fee [795357,90691] 0 2024-09-13T22:56:25.229 INFO:tasks.workunit.client.0.smithi002.stdout:1/896: creat d1/d13/d21/d39/f13a x:0 0 0 2024-09-13T22:56:25.233 INFO:tasks.workunit.client.0.smithi002.stdout:5/839: rename d1/d2a/d6b/d88/d55/d56/d86/d11d/f12c to d1/d2a/d6b/d88/d55/d56/d86/f131 0 2024-09-13T22:56:25.234 INFO:tasks.workunit.client.0.smithi002.stdout:5/840: stat d1/d2a/d6b/d88/d45/d4f/cc1 0 2024-09-13T22:56:25.235 INFO:tasks.workunit.client.1.smithi047.stdout:3/916: symlink d0/d3/d4/d16/d2c/de/dcc/dd1/dc4/l127 0 2024-09-13T22:56:25.236 INFO:tasks.workunit.client.0.smithi002.stdout:5/841: dread - d1/d2a/d6b/d88/d45/d4f/d78/d8b/f11f zero size 2024-09-13T22:56:25.236 INFO:tasks.workunit.client.0.smithi002.stdout:0/815: fsync d1/d4/da3/d7d/fb0 0 2024-09-13T22:56:25.238 INFO:tasks.workunit.client.0.smithi002.stdout:7/808: creat d8/d10/d39/d60/ff0 x:0 0 0 2024-09-13T22:56:25.242 INFO:tasks.workunit.client.0.smithi002.stdout:6/853: write d12/d17/d28/d67/f6d [978838,33638] 0 2024-09-13T22:56:25.244 INFO:tasks.workunit.client.0.smithi002.stdout:6/854: fsync d12/d17/d34/d39/d8b/fa3 0 2024-09-13T22:56:25.245 INFO:tasks.workunit.client.0.smithi002.stdout:8/849: symlink d3/dc/d16/d60/da7/l10a 0 2024-09-13T22:56:25.251 INFO:tasks.workunit.client.0.smithi002.stdout:1/897: truncate d1/d13/d1d/d34/da7/fb2 878719 0 2024-09-13T22:56:25.253 INFO:tasks.workunit.client.0.smithi002.stdout:2/828: sync 2024-09-13T22:56:25.253 INFO:tasks.workunit.client.0.smithi002.stdout:4/789: sync 2024-09-13T22:56:25.254 INFO:tasks.workunit.client.0.smithi002.stdout:5/842: mknod d1/d2a/d6b/d88/d45/d4f/d78/d8b/ddb/c132 0 2024-09-13T22:56:25.255 INFO:tasks.workunit.client.0.smithi002.stdout:2/829: dread - d1/d7/d35/d78/dfc/d6b/d75/fc1 zero size 2024-09-13T22:56:25.255 INFO:tasks.workunit.client.0.smithi002.stdout:7/809: creat d8/d10/ff1 x:0 0 0 2024-09-13T22:56:25.256 INFO:tasks.workunit.client.0.smithi002.stdout:2/830: chown d1 181 1 2024-09-13T22:56:25.257 INFO:tasks.workunit.client.0.smithi002.stdout:9/906: fsync d8/d10/f3f 0 2024-09-13T22:56:25.260 INFO:tasks.workunit.client.0.smithi002.stdout:4/790: dwrite d3/f10 [0,4194304] 0 2024-09-13T22:56:25.263 INFO:tasks.workunit.client.0.smithi002.stdout:2/831: dread d1/d7/d8/fdd [0,4194304] 0 2024-09-13T22:56:25.267 INFO:tasks.workunit.client.0.smithi002.stdout:7/810: mknod d8/d10/d39/d60/db8/d2e/d50/d52/d99/cf2 0 2024-09-13T22:56:25.268 INFO:tasks.workunit.client.0.smithi002.stdout:7/811: write d8/d10/f1e [3618866,79876] 0 2024-09-13T22:56:25.273 INFO:tasks.workunit.client.0.smithi002.stdout:0/816: creat d1/d4/d75/f124 x:0 0 0 2024-09-13T22:56:25.274 INFO:tasks.workunit.client.0.smithi002.stdout:1/898: rmdir d1/d13/d30/d73/da1/d9d/dbd 39 2024-09-13T22:56:25.279 INFO:tasks.workunit.client.0.smithi002.stdout:3/881: dwrite d9/d3b/f64 [0,4194304] 0 2024-09-13T22:56:25.280 INFO:tasks.workunit.client.0.smithi002.stdout:6/855: rename d12/d17/d2a/d88/cf5 to d12/d17/d28/d67/dca/c10d 0 2024-09-13T22:56:25.281 INFO:tasks.workunit.client.0.smithi002.stdout:7/812: fsync d8/d10/f89 0 2024-09-13T22:56:25.285 INFO:tasks.workunit.client.0.smithi002.stdout:4/791: symlink d3/d40/d45/dfd/l101 0 2024-09-13T22:56:25.286 INFO:tasks.workunit.client.0.smithi002.stdout:2/832: dwrite d1/d7/d35/d78/dfc/d6b/d75/fc1 [0,4194304] 0 2024-09-13T22:56:25.289 INFO:tasks.workunit.client.0.smithi002.stdout:8/850: truncate d3/dc/d16/d2f/d83/d95/fc2 3023768 0 2024-09-13T22:56:25.293 INFO:tasks.workunit.client.0.smithi002.stdout:1/899: readlink d1/d13/d21/d39/d70/d10c/d3d/d5d/l42 0 2024-09-13T22:56:25.293 INFO:tasks.workunit.client.0.smithi002.stdout:8/851: truncate d3/dc/d8b/fe6 355920 0 2024-09-13T22:56:25.294 INFO:tasks.workunit.client.0.smithi002.stdout:8/852: chown d3/dc/c5e 3186 1 2024-09-13T22:56:25.294 INFO:tasks.workunit.client.0.smithi002.stdout:5/843: getdents d1/d57/dd0/df7 0 2024-09-13T22:56:25.295 INFO:tasks.workunit.client.0.smithi002.stdout:4/792: fsync d3/f24 0 2024-09-13T22:56:25.296 INFO:tasks.workunit.client.0.smithi002.stdout:0/817: write d1/d4/d75/dca/ff9 [721526,38387] 0 2024-09-13T22:56:25.297 INFO:tasks.workunit.client.0.smithi002.stdout:7/813: rmdir d8/d10/d39/d60/db8/d2e/d3c/d3e/da1 39 2024-09-13T22:56:25.297 INFO:tasks.workunit.client.0.smithi002.stdout:5/844: fsync d1/d2a/d6b/d88/d45/d4f/d78/fac 0 2024-09-13T22:56:25.298 INFO:tasks.workunit.client.0.smithi002.stdout:2/833: mknod d1/d7/d52/daa/c11a 0 2024-09-13T22:56:25.301 INFO:tasks.workunit.client.0.smithi002.stdout:7/814: fsync d8/d10/d39/d60/db8/d26/d38/f9e 0 2024-09-13T22:56:25.303 INFO:tasks.workunit.client.0.smithi002.stdout:0/818: creat d1/d4/d114/f125 x:0 0 0 2024-09-13T22:56:25.306 INFO:tasks.workunit.client.0.smithi002.stdout:9/907: rename d8/d1e/f67 to d8/d10/d1c/d3d/d11f/f12e 0 2024-09-13T22:56:25.307 INFO:tasks.workunit.client.0.smithi002.stdout:9/908: stat d8/cd3 0 2024-09-13T22:56:25.309 INFO:tasks.workunit.client.0.smithi002.stdout:5/845: fsync d1/d2a/d6b/d88/d45/d4f/d78/d8b/fc8 0 2024-09-13T22:56:25.311 INFO:tasks.workunit.client.0.smithi002.stdout:3/882: link d9/df/c2b d9/d15/d36/d4e/d5e/dae/d89/de5/de7/c131 0 2024-09-13T22:56:25.314 INFO:tasks.workunit.client.0.smithi002.stdout:0/819: dread - d1/d4/d75/d31/d32/fcc zero size 2024-09-13T22:56:25.315 INFO:tasks.workunit.client.0.smithi002.stdout:2/834: fdatasync d1/d7/d8/fe9 0 2024-09-13T22:56:25.317 INFO:tasks.workunit.client.0.smithi002.stdout:9/909: readlink d8/d10/d61/lce 0 2024-09-13T22:56:25.317 INFO:tasks.workunit.client.0.smithi002.stdout:9/910: write d8/d1e/f100 [82903,26679] 0 2024-09-13T22:56:25.318 INFO:tasks.workunit.client.0.smithi002.stdout:6/856: getdents d12/d17/d28/d67/d6b 0 2024-09-13T22:56:25.320 INFO:tasks.workunit.client.0.smithi002.stdout:5/846: creat d1/d57/f133 x:0 0 0 2024-09-13T22:56:25.321 INFO:tasks.workunit.client.0.smithi002.stdout:4/793: write d3/d14/d29/d2a/da6/d69/d7e/fc1 [320976,111552] 0 2024-09-13T22:56:25.322 INFO:tasks.workunit.client.0.smithi002.stdout:3/883: fsync d9/d15/f2d 0 2024-09-13T22:56:25.323 INFO:tasks.workunit.client.0.smithi002.stdout:4/794: stat d3/d14/d29/df7/fe2 0 2024-09-13T22:56:25.324 INFO:tasks.workunit.client.0.smithi002.stdout:7/815: creat d8/d10/d39/d60/db8/d2e/d50/d52/d72/d8f/ff3 x:0 0 0 2024-09-13T22:56:25.325 INFO:tasks.workunit.client.0.smithi002.stdout:2/835: creat d1/d7/d41/f11b x:0 0 0 2024-09-13T22:56:25.326 INFO:tasks.workunit.client.0.smithi002.stdout:6/857: rmdir d12/d17/ddf 39 2024-09-13T22:56:25.327 INFO:tasks.workunit.client.0.smithi002.stdout:7/816: write f1 [1491791,118555] 0 2024-09-13T22:56:25.329 INFO:tasks.workunit.client.0.smithi002.stdout:9/911: dwrite d8/d10/d1c/d3d/f9e [0,4194304] 0 2024-09-13T22:56:25.330 INFO:tasks.workunit.client.0.smithi002.stdout:7/817: dread - d8/d10/d11/fe1 zero size 2024-09-13T22:56:25.331 INFO:tasks.workunit.client.0.smithi002.stdout:5/847: creat d1/d2a/d6b/d88/d45/d4f/da7/daa/f134 x:0 0 0 2024-09-13T22:56:25.331 INFO:tasks.workunit.client.1.smithi047.stdout:6/913: mknod d3/d2c/c132 0 2024-09-13T22:56:25.332 INFO:tasks.workunit.client.1.smithi047.stdout:8/871: fsync d8/f32 0 2024-09-13T22:56:25.332 INFO:tasks.workunit.client.0.smithi002.stdout:2/836: dread d1/d7/d41/d96/fc9 [0,4194304] 0 2024-09-13T22:56:25.333 INFO:tasks.workunit.client.0.smithi002.stdout:3/884: truncate d9/d3b/f67 1949808 0 2024-09-13T22:56:25.333 INFO:tasks.workunit.client.1.smithi047.stdout:3/917: dread - d0/d3/d4/d16/d32/d42/dbd/f111 zero size 2024-09-13T22:56:25.333 INFO:tasks.workunit.client.1.smithi047.stdout:1/955: creat d0/d7/d13/f111 x:0 0 0 2024-09-13T22:56:25.336 INFO:tasks.workunit.client.0.smithi002.stdout:0/820: link d1/d7e/d9d/cb7 d1/d4/d75/d31/c126 0 2024-09-13T22:56:25.336 INFO:tasks.workunit.client.0.smithi002.stdout:4/795: dread d3/d14/d29/d2a/d30/f6b [0,4194304] 0 2024-09-13T22:56:25.337 INFO:tasks.workunit.client.0.smithi002.stdout:6/858: symlink d12/d17/d102/l10e 0 2024-09-13T22:56:25.339 INFO:tasks.workunit.client.1.smithi047.stdout:8/872: creat d8/d64/d4e/d4d/d8f/d91/d40/de5/f12e x:0 0 0 2024-09-13T22:56:25.341 INFO:tasks.workunit.client.0.smithi002.stdout:7/818: dwrite d8/d10/d39/d60/db8/d2e/d3c/f59 [0,4194304] 0 2024-09-13T22:56:25.346 INFO:tasks.workunit.client.1.smithi047.stdout:4/963: dwrite dc/de/d23/d40/d7b/dab/f10f [0,4194304] 0 2024-09-13T22:56:25.352 INFO:tasks.workunit.client.1.smithi047.stdout:3/918: dwrite d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/f4b [0,4194304] 0 2024-09-13T22:56:25.353 INFO:tasks.workunit.client.1.smithi047.stdout:8/873: dwrite d8/d3f/d8c/f11d [0,4194304] 0 2024-09-13T22:56:25.354 INFO:tasks.workunit.client.1.smithi047.stdout:3/919: chown d0/d3/d4/d16/f94 900 1 2024-09-13T22:56:25.412 INFO:tasks.workunit.client.0.smithi002.stdout:8/853: sync 2024-09-13T22:56:25.412 INFO:tasks.workunit.client.0.smithi002.stdout:1/900: sync 2024-09-13T22:56:25.413 INFO:tasks.workunit.client.0.smithi002.stdout:1/901: write d1/d13/d21/d39/d70/d10c/d3b/f136 [268599,28172] 0 2024-09-13T22:56:25.414 INFO:tasks.workunit.client.0.smithi002.stdout:1/902: chown d1/d13/d1d/d34/dfe 2 1 2024-09-13T22:56:25.417 INFO:tasks.workunit.client.0.smithi002.stdout:2/837: fsync d1/d7/d35/d78/dfc/d6b/fad 0 2024-09-13T22:56:25.419 INFO:tasks.workunit.client.1.smithi047.stdout:6/914: rename d3/d11/d2b/d1c/dbf/lfc to d3/d11/d2b/d1c/d4d/l133 0 2024-09-13T22:56:25.420 INFO:tasks.workunit.client.0.smithi002.stdout:1/903: dwrite d1/d13/d21/d39/d70/de2/f106 [0,4194304] 0 2024-09-13T22:56:25.426 INFO:tasks.workunit.client.1.smithi047.stdout:8/874: creat d8/d64/d4e/d4d/dda/f12f x:0 0 0 2024-09-13T22:56:25.437 INFO:tasks.workunit.client.0.smithi002.stdout:3/885: dwrite d9/d15/d46/f9b [0,4194304] 0 2024-09-13T22:56:25.439 INFO:tasks.workunit.client.1.smithi047.stdout:4/964: write fb [3366761,6874] 0 2024-09-13T22:56:25.447 INFO:tasks.workunit.client.0.smithi002.stdout:7/819: dwrite d8/d10/d39/d60/db8/d26/d4c/d81/d46/f4b [0,4194304] 0 2024-09-13T22:56:25.449 INFO:tasks.workunit.client.1.smithi047.stdout:3/920: dread d0/d3/d65/fde [0,4194304] 0 2024-09-13T22:56:25.449 INFO:tasks.workunit.client.0.smithi002.stdout:0/821: dread d1/d4/d75/d31/f37 [0,4194304] 0 2024-09-13T22:56:25.457 INFO:tasks.workunit.client.0.smithi002.stdout:9/912: link d8/c4b d8/d10/d1c/d3d/d11f/da3/c12f 0 2024-09-13T22:56:25.470 INFO:tasks.workunit.client.0.smithi002.stdout:1/904: mknod d1/d13/d1d/d34/d51/d108/c13b 0 2024-09-13T22:56:25.472 INFO:tasks.workunit.client.0.smithi002.stdout:7/820: symlink d8/d10/d39/d60/db8/d26/d4c/d81/d46/lf4 0 2024-09-13T22:56:25.473 INFO:tasks.workunit.client.0.smithi002.stdout:4/796: truncate d3/d14/d29/d2a/da6/d5e/f65 507672 0 2024-09-13T22:56:25.473 INFO:tasks.workunit.client.0.smithi002.stdout:4/797: chown d3/d14/d29/d2a/da6/d69 137 1 2024-09-13T22:56:25.474 INFO:tasks.workunit.client.0.smithi002.stdout:0/822: truncate d1/f63 1911161 0 2024-09-13T22:56:25.475 INFO:tasks.workunit.client.0.smithi002.stdout:6/859: link lf d12/l10f 0 2024-09-13T22:56:25.480 INFO:tasks.workunit.client.0.smithi002.stdout:8/854: dwrite d3/dc/f5f [0,4194304] 0 2024-09-13T22:56:25.482 INFO:tasks.workunit.client.0.smithi002.stdout:5/848: link d1/d2a/d6b/d88/d45/d4f/d78/d8b/f9b d1/d2a/d6b/d88/d45/f135 0 2024-09-13T22:56:25.483 INFO:tasks.workunit.client.1.smithi047.stdout:8/875: dread - d8/d3f/fbf zero size 2024-09-13T22:56:25.485 INFO:tasks.workunit.client.0.smithi002.stdout:2/838: dwrite d1/d7/d35/d78/dfc/fe6 [0,4194304] 0 2024-09-13T22:56:25.485 INFO:tasks.workunit.client.0.smithi002.stdout:7/821: mkdir d8/d10/d39/d60/db8/d26/d4c/d81/d51/da9/df5 0 2024-09-13T22:56:25.486 INFO:tasks.workunit.client.1.smithi047.stdout:4/965: creat dc/de/d23/d40/d7b/dab/dae/d102/f142 x:0 0 0 2024-09-13T22:56:25.489 INFO:tasks.workunit.client.0.smithi002.stdout:4/798: truncate d3/f12 4805049 0 2024-09-13T22:56:25.491 INFO:tasks.workunit.client.0.smithi002.stdout:4/799: dread - d3/d14/d29/df7/fec zero size 2024-09-13T22:56:25.493 INFO:tasks.workunit.client.0.smithi002.stdout:7/822: dwrite d8/d10/d39/d60/db8/d26/d38/f9e [0,4194304] 0 2024-09-13T22:56:25.495 INFO:tasks.workunit.client.1.smithi047.stdout:3/921: rename d0/d3/d4/d16/d2c/de/d1f/d3b to d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/d128 0 2024-09-13T22:56:25.498 INFO:tasks.workunit.client.0.smithi002.stdout:0/823: rmdir d1/d7e/d9d/de6/df5 39 2024-09-13T22:56:25.501 INFO:tasks.workunit.client.0.smithi002.stdout:7/823: dwrite d8/d10/d39/d60/db8/d2e/d3c/f59 [0,4194304] 0 2024-09-13T22:56:25.505 INFO:tasks.workunit.client.0.smithi002.stdout:3/886: write d9/d15/d51/deb/f11b [212629,17336] 0 2024-09-13T22:56:25.506 INFO:tasks.workunit.client.1.smithi047.stdout:3/922: dwrite d0/d3/d4/d91/f66 [0,4194304] 0 2024-09-13T22:56:25.509 INFO:tasks.workunit.client.1.smithi047.stdout:1/956: truncate d0/d7/d13/d2d/fde 3931903 0 2024-09-13T22:56:25.519 INFO:tasks.workunit.client.1.smithi047.stdout:6/915: truncate d3/d11/d2b/d1c/f27 829319 0 2024-09-13T22:56:25.522 INFO:tasks.workunit.client.0.smithi002.stdout:8/855: dwrite d3/d27/fc6 [0,4194304] 0 2024-09-13T22:56:25.524 INFO:tasks.workunit.client.0.smithi002.stdout:8/856: write d3/dc/d16/f4d [2065847,79897] 0 2024-09-13T22:56:25.525 INFO:tasks.workunit.client.0.smithi002.stdout:6/860: write d12/d17/d28/d67/f9b [3397365,22640] 0 2024-09-13T22:56:25.526 INFO:tasks.workunit.client.0.smithi002.stdout:6/861: chown d12/d17/d28/d67/f6d 13010 1 2024-09-13T22:56:25.530 INFO:tasks.workunit.client.1.smithi047.stdout:4/966: write dc/de/d17/d25/f36 [4067657,84166] 0 2024-09-13T22:56:25.538 INFO:tasks.workunit.client.1.smithi047.stdout:3/923: rename d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/f90 to d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d85/df9/f129 0 2024-09-13T22:56:25.540 INFO:tasks.workunit.client.1.smithi047.stdout:1/957: symlink d0/d7/d14/d57/d62/d76/d94/dea/l112 0 2024-09-13T22:56:25.542 INFO:tasks.workunit.client.1.smithi047.stdout:4/967: truncate dc/da3/fd2 3621420 0 2024-09-13T22:56:25.543 INFO:tasks.workunit.client.1.smithi047.stdout:8/876: link d8/d64/d4e/d4d/d8f/d91/d40/f48 d8/d64/d4e/d4d/d8f/d91/d38/f130 0 2024-09-13T22:56:25.545 INFO:tasks.workunit.client.0.smithi002.stdout:9/913: creat d8/d1e/f130 x:0 0 0 2024-09-13T22:56:25.546 INFO:tasks.workunit.client.1.smithi047.stdout:6/916: mkdir d3/d11/d2b/d1c/d134 0 2024-09-13T22:56:25.546 INFO:tasks.workunit.client.0.smithi002.stdout:9/914: stat d8/d10/d1c/d3d/d11f/da3/db9/dfa/d87/da5/l89 0 2024-09-13T22:56:25.548 INFO:tasks.workunit.client.1.smithi047.stdout:3/924: unlink d0/d3/d4/d16/d1c/f92 0 2024-09-13T22:56:25.548 INFO:tasks.workunit.client.0.smithi002.stdout:1/905: write d1/d13/d21/d39/d70/d10c/d3b/f4b [458596,49564] 0 2024-09-13T22:56:25.550 INFO:tasks.workunit.client.1.smithi047.stdout:1/958: creat d0/d1d/daa/df0/df1/f113 x:0 0 0 2024-09-13T22:56:25.554 INFO:tasks.workunit.client.1.smithi047.stdout:8/877: creat d8/d64/d4e/d70/d98/dfa/f131 x:0 0 0 2024-09-13T22:56:25.556 INFO:tasks.workunit.client.0.smithi002.stdout:4/800: dwrite d3/d14/f1d [0,4194304] 0 2024-09-13T22:56:25.557 INFO:tasks.workunit.client.0.smithi002.stdout:4/801: write d3/d14/d29/f96 [3672764,68633] 0 2024-09-13T22:56:25.560 INFO:tasks.workunit.client.1.smithi047.stdout:3/925: creat d0/d3/d4/d16/d2c/de/dcc/f12a x:0 0 0 2024-09-13T22:56:25.562 INFO:tasks.workunit.client.0.smithi002.stdout:6/862: write d12/d17/d28/f2f [7231584,21029] 0 2024-09-13T22:56:25.564 INFO:tasks.workunit.client.1.smithi047.stdout:0/843: sync 2024-09-13T22:56:25.565 INFO:tasks.workunit.client.1.smithi047.stdout:1/959: creat d0/d7/db/f114 x:0 0 0 2024-09-13T22:56:25.567 INFO:tasks.workunit.client.1.smithi047.stdout:4/968: mknod dc/de/d23/c143 0 2024-09-13T22:56:25.570 INFO:tasks.workunit.client.1.smithi047.stdout:4/969: read dc/de/d23/dc4/f47 [1614406,86878] 0 2024-09-13T22:56:25.571 INFO:tasks.workunit.client.1.smithi047.stdout:8/878: write d8/d64/d4e/d4d/f6a [1919627,41595] 0 2024-09-13T22:56:25.572 INFO:tasks.workunit.client.0.smithi002.stdout:7/824: mkdir d8/d10/d11/df6 0 2024-09-13T22:56:25.574 INFO:tasks.workunit.client.1.smithi047.stdout:3/926: creat d0/d3/d4/d16/de2/f12b x:0 0 0 2024-09-13T22:56:25.575 INFO:tasks.workunit.client.0.smithi002.stdout:5/849: dwrite d1/d2a/d6b/d88/d45/f61 [0,4194304] 0 2024-09-13T22:56:25.577 INFO:tasks.workunit.client.1.smithi047.stdout:6/917: write d3/d11/f3f [4586642,118014] 0 2024-09-13T22:56:25.577 INFO:tasks.workunit.client.1.smithi047.stdout:6/918: dread - d3/d11/fb8 zero size 2024-09-13T22:56:25.579 INFO:tasks.workunit.client.0.smithi002.stdout:9/915: creat d8/d10/d61/f131 x:0 0 0 2024-09-13T22:56:25.580 INFO:tasks.workunit.client.1.smithi047.stdout:0/844: mknod d1/d5/d16/d47/c112 0 2024-09-13T22:56:25.588 INFO:tasks.workunit.client.1.smithi047.stdout:0/845: dwrite d1/d5/d11/f20 [0,4194304] 0 2024-09-13T22:56:25.590 INFO:tasks.workunit.client.1.smithi047.stdout:4/970: mknod dc/de/d23/ddf/c144 0 2024-09-13T22:56:25.590 INFO:tasks.workunit.client.0.smithi002.stdout:8/857: mknod d3/dc/d18/c10b 0 2024-09-13T22:56:25.593 INFO:tasks.workunit.client.1.smithi047.stdout:8/879: truncate d8/d77/ff1 604428 0 2024-09-13T22:56:25.596 INFO:tasks.workunit.client.1.smithi047.stdout:3/927: read d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/d128/d69/f7d [328630,37922] 0 2024-09-13T22:56:25.598 INFO:tasks.workunit.client.0.smithi002.stdout:3/887: dwrite d9/d15/d26/f85 [0,4194304] 0 2024-09-13T22:56:25.599 INFO:tasks.workunit.client.0.smithi002.stdout:4/802: read d3/d14/d29/d2a/da6/d5e/f65 [102773,29408] 0 2024-09-13T22:56:25.599 INFO:tasks.workunit.client.1.smithi047.stdout:6/919: creat d3/d11/d2b/d4c/d9d/dc1/de0/f135 x:0 0 0 2024-09-13T22:56:25.605 INFO:tasks.workunit.client.1.smithi047.stdout:1/960: mknod d0/d7/d13/d5d/d89/c115 0 2024-09-13T22:56:25.609 INFO:tasks.workunit.client.1.smithi047.stdout:6/920: dwrite d3/d2c/d10b/d48/f7d [0,4194304] 0 2024-09-13T22:56:25.610 INFO:tasks.workunit.client.0.smithi002.stdout:0/824: link d1/d4/d75/d76/c89 d1/d4/da3/d7d/df8/df4/c127 0 2024-09-13T22:56:25.610 INFO:tasks.workunit.client.0.smithi002.stdout:4/803: dread d3/d14/d29/d2a/da6/d5e/f65 [0,4194304] 0 2024-09-13T22:56:25.610 INFO:tasks.workunit.client.0.smithi002.stdout:7/825: chown d8/d10/d39/d60/db8/d26/c2c 5538 1 2024-09-13T22:56:25.610 INFO:tasks.workunit.client.0.smithi002.stdout:4/804: chown d3/f24 0 1 2024-09-13T22:56:25.610 INFO:tasks.workunit.client.0.smithi002.stdout:5/850: dread - d1/d2a/d6b/ff8 zero size 2024-09-13T22:56:25.611 INFO:tasks.workunit.client.0.smithi002.stdout:5/851: chown d1/d2a/d6b/d88/d55/ffe 101600 1 2024-09-13T22:56:25.611 INFO:tasks.workunit.client.1.smithi047.stdout:0/846: truncate d1/d5/d16/d97/dfc/d45/d7f/f78 532147 0 2024-09-13T22:56:25.614 INFO:tasks.workunit.client.1.smithi047.stdout:3/928: symlink d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/d128/d69/l12c 0 2024-09-13T22:56:25.615 INFO:tasks.workunit.client.0.smithi002.stdout:8/858: unlink d3/d21/d57/f55 0 2024-09-13T22:56:25.617 INFO:tasks.workunit.client.1.smithi047.stdout:6/921: dread d3/d11/d2b/d1c/d23/dda/f12f [0,4194304] 0 2024-09-13T22:56:25.617 INFO:tasks.workunit.client.0.smithi002.stdout:7/826: dwrite d8/d10/d39/d60/db8/d26/d38/fc6 [0,4194304] 0 2024-09-13T22:56:25.620 INFO:tasks.workunit.client.0.smithi002.stdout:5/852: dread d1/d2a/d6b/d88/d45/d4f/db7/fcb [0,4194304] 0 2024-09-13T22:56:25.621 INFO:tasks.workunit.client.0.smithi002.stdout:6/863: rename d12/d17/d34/d39/d8b/cba to d12/d17/d34/d39/d8b/c110 0 2024-09-13T22:56:25.622 INFO:tasks.workunit.client.0.smithi002.stdout:7/827: write d8/d10/d39/d60/db8/d2e/d50/f55 [4676111,39612] 0 2024-09-13T22:56:25.624 INFO:tasks.workunit.client.0.smithi002.stdout:5/853: readlink d1/d2a/d6b/d88/d55/d56/de4/le9 0 2024-09-13T22:56:25.624 INFO:tasks.workunit.client.0.smithi002.stdout:6/864: read - d12/d17/d34/d4b/f106 zero size 2024-09-13T22:56:25.624 INFO:tasks.workunit.client.1.smithi047.stdout:1/961: rmdir d0/d1d/d7f 39 2024-09-13T22:56:25.625 INFO:tasks.workunit.client.0.smithi002.stdout:5/854: chown d1/d2a/d5a 169435 1 2024-09-13T22:56:25.626 INFO:tasks.workunit.client.1.smithi047.stdout:1/962: fdatasync d0/d7/d14/d57/d62/d76/fcb 0 2024-09-13T22:56:25.627 INFO:tasks.workunit.client.0.smithi002.stdout:2/839: getdents d1/d7/d35/d3e/df8 0 2024-09-13T22:56:25.630 INFO:tasks.workunit.client.0.smithi002.stdout:3/888: rename d9/d15/d36/d4e/d5e/dae/d89/de5/de7/ffd to d9/d91/f132 0 2024-09-13T22:56:25.632 INFO:tasks.workunit.client.0.smithi002.stdout:1/906: dwrite d1/d13/d30/d73/da1/f4c [0,4194304] 0 2024-09-13T22:56:25.633 INFO:tasks.workunit.client.0.smithi002.stdout:1/907: chown d1/ff 4991012 1 2024-09-13T22:56:25.633 INFO:tasks.workunit.client.0.smithi002.stdout:3/889: write d9/d15/d36/d4e/d5e/dae/de6/f128 [860890,79093] 0 2024-09-13T22:56:25.634 INFO:tasks.workunit.client.1.smithi047.stdout:0/847: mkdir d1/d5/d16/d47/dde/d113 0 2024-09-13T22:56:25.635 INFO:tasks.workunit.client.1.smithi047.stdout:8/880: dread d8/d64/d4e/d4d/d8f/d91/d40/f10e [0,4194304] 0 2024-09-13T22:56:25.637 INFO:tasks.workunit.client.0.smithi002.stdout:4/805: creat d3/d14/d86/f102 x:0 0 0 2024-09-13T22:56:25.642 INFO:tasks.workunit.client.1.smithi047.stdout:3/929: mknod d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/c12d 0 2024-09-13T22:56:25.646 INFO:tasks.workunit.client.0.smithi002.stdout:8/859: mknod d3/dc/d18/d56/dd0/c10c 0 2024-09-13T22:56:25.649 INFO:tasks.workunit.client.1.smithi047.stdout:6/922: dwrite d3/fe6 [0,4194304] 0 2024-09-13T22:56:25.653 INFO:tasks.workunit.client.1.smithi047.stdout:4/971: creat dc/d29/d8e/dda/f145 x:0 0 0 2024-09-13T22:56:25.654 INFO:tasks.workunit.client.1.smithi047.stdout:5/781: sync 2024-09-13T22:56:25.654 INFO:tasks.workunit.client.1.smithi047.stdout:9/882: sync 2024-09-13T22:56:25.654 INFO:tasks.workunit.client.1.smithi047.stdout:7/823: sync 2024-09-13T22:56:25.654 INFO:tasks.workunit.client.1.smithi047.stdout:2/905: sync 2024-09-13T22:56:25.656 INFO:tasks.workunit.client.1.smithi047.stdout:0/848: mkdir d1/d5/d16/dc0/d114 0 2024-09-13T22:56:25.657 INFO:tasks.workunit.client.1.smithi047.stdout:5/782: write d19/d23/d4c/fa1 [5178383,86535] 0 2024-09-13T22:56:25.664 INFO:tasks.workunit.client.0.smithi002.stdout:9/916: rename d8/d10/d1c/d3d/d11f/da3/db9/dfa/da8/dc3/ff1 to d8/d10/d61/df4/f132 0 2024-09-13T22:56:25.667 INFO:tasks.workunit.client.1.smithi047.stdout:3/930: symlink d0/d3/d4/d91/d8d/d11a/l12e 0 2024-09-13T22:56:25.669 INFO:tasks.workunit.client.1.smithi047.stdout:1/963: getdents d0/d7/d14/d57/d62/d10d 0 2024-09-13T22:56:25.670 INFO:tasks.workunit.client.0.smithi002.stdout:7/828: dwrite d8/d10/d39/d60/db8/d26/d4c/d81/fd [4194304,4194304] 0 2024-09-13T22:56:25.672 INFO:tasks.workunit.client.0.smithi002.stdout:4/806: mkdir d3/d62/d103 0 2024-09-13T22:56:25.673 INFO:tasks.workunit.client.0.smithi002.stdout:4/807: dread - d3/d14/d29/df7/fe2 zero size 2024-09-13T22:56:25.673 INFO:tasks.workunit.client.1.smithi047.stdout:6/923: truncate d3/d11/d2b/d4c/f80 1691973 0 2024-09-13T22:56:25.673 INFO:tasks.workunit.client.0.smithi002.stdout:0/825: write d1/f63 [1008452,128870] 0 2024-09-13T22:56:25.673 INFO:tasks.workunit.client.0.smithi002.stdout:4/808: chown d3/l59 3435923 1 2024-09-13T22:56:25.678 INFO:tasks.workunit.client.0.smithi002.stdout:6/865: symlink d12/d17/d34/l111 0 2024-09-13T22:56:25.683 INFO:tasks.workunit.client.1.smithi047.stdout:1/964: dread d0/d1d/daa/f7e [0,4194304] 0 2024-09-13T22:56:25.683 INFO:tasks.workunit.client.0.smithi002.stdout:5/855: mknod d1/d2a/d6b/d88/d55/d56/c136 0 2024-09-13T22:56:25.686 INFO:tasks.workunit.client.1.smithi047.stdout:2/906: creat d1/df/d35/dd7/f130 x:0 0 0 2024-09-13T22:56:25.687 INFO:tasks.workunit.client.0.smithi002.stdout:5/856: dwrite d1/ffb [0,4194304] 0 2024-09-13T22:56:25.688 INFO:tasks.workunit.client.1.smithi047.stdout:5/783: creat d19/d64/ff2 x:0 0 0 2024-09-13T22:56:25.689 INFO:tasks.workunit.client.0.smithi002.stdout:5/857: fdatasync d1/f37 0 2024-09-13T22:56:25.693 INFO:tasks.workunit.client.0.smithi002.stdout:9/917: creat d8/d10/dc4/dde/f133 x:0 0 0 2024-09-13T22:56:25.699 INFO:tasks.workunit.client.0.smithi002.stdout:2/840: write d1/d7/d8/f10 [664345,82635] 0 2024-09-13T22:56:25.700 INFO:tasks.workunit.client.1.smithi047.stdout:4/972: truncate dc/de/db9/fd9 1381602 0 2024-09-13T22:56:25.700 INFO:tasks.workunit.client.1.smithi047.stdout:7/824: dwrite d0/d7/da/d47/fa1 [0,4194304] 0 2024-09-13T22:56:25.701 INFO:tasks.workunit.client.0.smithi002.stdout:9/918: dwrite d8/d10/d1c/d3d/d11f/da3/db9/dfa/d87/fea [0,4194304] 0 2024-09-13T22:56:25.701 INFO:tasks.workunit.client.0.smithi002.stdout:1/908: dread d1/d13/d30/d73/da1/d9d/dbd/f111 [0,4194304] 0 2024-09-13T22:56:25.702 INFO:tasks.workunit.client.1.smithi047.stdout:6/924: truncate d3/d11/d2b/d1c/d4d/d69/dc2/dcd/fd1 1503250 0 2024-09-13T22:56:25.704 INFO:tasks.workunit.client.0.smithi002.stdout:7/829: rmdir d8/d10/d39/d60/db8/d2e/d50/d52/d72 39 2024-09-13T22:56:25.706 INFO:tasks.workunit.client.1.smithi047.stdout:9/883: truncate d1/dc/d14/dd/d4c/df2/fab 1174212 0 2024-09-13T22:56:25.707 INFO:tasks.workunit.client.1.smithi047.stdout:9/884: readlink d1/dc/d14/dd/d54/d50/l88 0 2024-09-13T22:56:25.708 INFO:tasks.workunit.client.0.smithi002.stdout:0/826: creat d1/df6/f128 x:0 0 0 2024-09-13T22:56:25.708 INFO:tasks.workunit.client.1.smithi047.stdout:9/885: write d1/dc/d14/dd/dba/fce [103634,56269] 0 2024-09-13T22:56:25.710 INFO:tasks.workunit.client.1.smithi047.stdout:1/965: symlink d0/d7/db/d79/l116 0 2024-09-13T22:56:25.711 INFO:tasks.workunit.client.0.smithi002.stdout:4/809: rmdir d3/d14/d29/df7 39 2024-09-13T22:56:25.711 INFO:tasks.workunit.client.1.smithi047.stdout:1/966: dread - d0/d7/d14/d57/d62/d8a/ffb zero size 2024-09-13T22:56:25.712 INFO:tasks.workunit.client.1.smithi047.stdout:2/907: fsync d1/df/d1d/d20/d29/dcd/dff/f86 0 2024-09-13T22:56:25.713 INFO:tasks.workunit.client.1.smithi047.stdout:1/967: chown d0/l51 238122692 1 2024-09-13T22:56:25.713 INFO:tasks.workunit.client.0.smithi002.stdout:3/890: truncate d9/d15/d36/d4e/f8b 645595 0 2024-09-13T22:56:25.715 INFO:tasks.workunit.client.0.smithi002.stdout:8/860: symlink d3/l10d 0 2024-09-13T22:56:25.716 INFO:tasks.workunit.client.1.smithi047.stdout:5/784: creat d19/d23/d4c/ff3 x:0 0 0 2024-09-13T22:56:25.726 INFO:tasks.workunit.client.0.smithi002.stdout:5/858: read d1/d2a/d6b/d88/d45/d4f/d78/f96 [3962581,82063] 0 2024-09-13T22:56:25.732 INFO:tasks.workunit.client.1.smithi047.stdout:3/931: dwrite d0/d3/d4/d16/d2c/de/f126 [0,4194304] 0 2024-09-13T22:56:25.733 INFO:tasks.workunit.client.1.smithi047.stdout:9/886: mkdir d1/dc/d14/dd/d54/d4e/d51/d128 0 2024-09-13T22:56:25.734 INFO:tasks.workunit.client.1.smithi047.stdout:3/932: readlink d0/d3/d4/d16/d32/d42/d79/d9c/dad/lb1 0 2024-09-13T22:56:25.734 INFO:tasks.workunit.client.0.smithi002.stdout:9/919: write d8/d10/d61/f8d [4030131,116722] 0 2024-09-13T22:56:25.738 INFO:tasks.workunit.client.1.smithi047.stdout:2/908: mkdir d1/df/d1d/da9/d131 0 2024-09-13T22:56:25.739 INFO:tasks.workunit.client.0.smithi002.stdout:6/866: mkdir d12/d17/ddf/d112 0 2024-09-13T22:56:25.741 INFO:tasks.workunit.client.1.smithi047.stdout:1/968: unlink d0/d7/d14/d57/d62/d76/c93 0 2024-09-13T22:56:25.744 INFO:tasks.workunit.client.0.smithi002.stdout:8/861: write d3/d27/f8a [1386123,62848] 0 2024-09-13T22:56:25.745 INFO:tasks.workunit.client.1.smithi047.stdout:5/785: rmdir d19/d34/d42 39 2024-09-13T22:56:25.746 INFO:tasks.workunit.client.1.smithi047.stdout:5/786: stat d19/d25/d85 0 2024-09-13T22:56:25.748 INFO:tasks.workunit.client.1.smithi047.stdout:2/909: dwrite d1/df/d35/dd7/d104/f116 [0,4194304] 0 2024-09-13T22:56:25.748 INFO:tasks.workunit.client.1.smithi047.stdout:5/787: chown d19/d25/fc3 7 1 2024-09-13T22:56:25.749 INFO:tasks.workunit.client.0.smithi002.stdout:2/841: rename d1/d7/d8/f31 to d1/d7/d8/d2c/d9d/f11c 0 2024-09-13T22:56:25.751 INFO:tasks.workunit.client.0.smithi002.stdout:1/909: unlink d1/d13/d1d/d34/f6b 0 2024-09-13T22:56:25.751 INFO:tasks.workunit.client.1.smithi047.stdout:9/887: dread d1/dc/d14/dd/d54/d50/fe7 [0,4194304] 0 2024-09-13T22:56:25.752 INFO:tasks.workunit.client.0.smithi002.stdout:7/830: symlink d8/d10/d39/lf7 0 2024-09-13T22:56:25.756 INFO:tasks.workunit.client.1.smithi047.stdout:9/888: dwrite d1/dc/d14/dd/d54/d50/d5b/d9e/f81 [0,4194304] 0 2024-09-13T22:56:25.757 INFO:tasks.workunit.client.0.smithi002.stdout:4/810: link d3/d14/d29/d2a/da6/d5e/f94 d3/db3/f104 0 2024-09-13T22:56:25.759 INFO:tasks.workunit.client.1.smithi047.stdout:6/925: fdatasync d3/d77/d8f/f92 0 2024-09-13T22:56:25.763 INFO:tasks.workunit.client.0.smithi002.stdout:6/867: mknod d12/d17/d34/d39/c113 0 2024-09-13T22:56:25.768 INFO:tasks.workunit.client.0.smithi002.stdout:6/868: read d12/f1c [1660283,6878] 0 2024-09-13T22:56:25.768 INFO:tasks.workunit.client.0.smithi002.stdout:5/859: link d1/d2a/d6b/d88/d45/d4f/d78/f12f d1/d2a/d6b/d88/d55/d56/de4/f137 0 2024-09-13T22:56:25.769 INFO:tasks.workunit.client.1.smithi047.stdout:3/933: creat d0/d3/d4/d16/d32/d42/d79/df2/f12f x:0 0 0 2024-09-13T22:56:25.771 INFO:tasks.workunit.client.0.smithi002.stdout:8/862: fsync d3/dc/d16/d4b/fb3 0 2024-09-13T22:56:25.772 INFO:tasks.workunit.client.1.smithi047.stdout:7/825: write d0/d57/d5b/d8b/fd0 [3128364,36506] 0 2024-09-13T22:56:25.774 INFO:tasks.workunit.client.0.smithi002.stdout:0/827: rename d1/d4/d75/d31/f41 to d1/d2/d6c/f129 0 2024-09-13T22:56:25.779 INFO:tasks.workunit.client.1.smithi047.stdout:5/788: symlink d19/d34/d6c/lf4 0 2024-09-13T22:56:25.779 INFO:tasks.workunit.client.0.smithi002.stdout:2/842: mkdir d1/d4d/d8b/de1/dd6/d11d 0 2024-09-13T22:56:25.781 INFO:tasks.workunit.client.1.smithi047.stdout:2/910: mknod d1/df/d1d/d20/d37/d85/c132 0 2024-09-13T22:56:25.786 INFO:tasks.workunit.client.0.smithi002.stdout:4/811: rmdir d3/d14 39 2024-09-13T22:56:25.790 INFO:tasks.workunit.client.0.smithi002.stdout:5/860: dread d1/d2a/d6b/d88/d55/f116 [0,4194304] 0 2024-09-13T22:56:25.792 INFO:tasks.workunit.client.0.smithi002.stdout:6/869: creat d12/d17/d28/d67/d6b/daa/dc6/f114 x:0 0 0 2024-09-13T22:56:25.792 INFO:tasks.workunit.client.0.smithi002.stdout:5/861: readlink d1/d2a/d6b/d88/d55/d56/d81/l9a 0 2024-09-13T22:56:25.794 INFO:tasks.workunit.client.0.smithi002.stdout:1/910: dread d1/d13/d21/d39/df7/f9f [0,4194304] 0 2024-09-13T22:56:25.796 INFO:tasks.workunit.client.1.smithi047.stdout:9/889: dread d1/dc/d14/fe0 [0,4194304] 0 2024-09-13T22:56:25.797 INFO:tasks.workunit.client.0.smithi002.stdout:3/891: rename d9/d15/d51/f2e to d9/d15/d36/d4e/d5e/dae/d89/de5/de7/f133 0 2024-09-13T22:56:25.797 INFO:tasks.workunit.client.0.smithi002.stdout:3/892: chown d9/d15/d26/fef 29 1 2024-09-13T22:56:25.799 INFO:tasks.workunit.client.1.smithi047.stdout:1/969: mknod d0/d7/d14/d28/df3/c117 0 2024-09-13T22:56:25.801 INFO:tasks.workunit.client.1.smithi047.stdout:1/970: dread - d0/d1d/daa/df0/df1/f113 zero size 2024-09-13T22:56:25.801 INFO:tasks.workunit.client.1.smithi047.stdout:7/826: dread - d0/d7/da/d105/fcd zero size 2024-09-13T22:56:25.801 INFO:tasks.workunit.client.1.smithi047.stdout:1/971: stat d0/d7/f64 0 2024-09-13T22:56:25.801 INFO:tasks.workunit.client.1.smithi047.stdout:7/827: stat d0/d57 0 2024-09-13T22:56:25.802 INFO:tasks.workunit.client.1.smithi047.stdout:5/789: mknod d19/d25/d85/cf5 0 2024-09-13T22:56:25.804 INFO:tasks.workunit.client.1.smithi047.stdout:2/911: rmdir d1/d16/d40/d57 39 2024-09-13T22:56:25.804 INFO:tasks.workunit.client.1.smithi047.stdout:3/934: dread d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/f87 [0,4194304] 0 2024-09-13T22:56:25.805 INFO:tasks.workunit.client.1.smithi047.stdout:8/881: getdents d8/d64/d4e/d4d/d8f/d91/d38/d7a 0 2024-09-13T22:56:25.807 INFO:tasks.workunit.client.1.smithi047.stdout:4/973: getdents dc/de/d23/d40 0 2024-09-13T22:56:25.816 INFO:tasks.workunit.client.1.smithi047.stdout:1/972: dread d0/d7/d14/d57/db6/ffc [0,4194304] 0 2024-09-13T22:56:25.817 INFO:tasks.workunit.client.1.smithi047.stdout:1/973: fdatasync d0/d7/d14/d57/d62/d76/fcb 0 2024-09-13T22:56:25.817 INFO:tasks.workunit.client.1.smithi047.stdout:1/974: chown d0/d7/d75/l61 278 1 2024-09-13T22:56:25.817 INFO:tasks.workunit.client.1.smithi047.stdout:9/890: mkdir d1/d5f/de9/d129 0 2024-09-13T22:56:25.819 INFO:tasks.workunit.client.1.smithi047.stdout:7/828: dread - d0/f67 zero size 2024-09-13T22:56:25.822 INFO:tasks.workunit.client.1.smithi047.stdout:0/849: sync 2024-09-13T22:56:25.825 INFO:tasks.workunit.client.1.smithi047.stdout:2/912: rmdir d1/df/d35/d8b 39 2024-09-13T22:56:25.826 INFO:tasks.workunit.client.1.smithi047.stdout:2/913: fsync d1/df/d1d/da9/faf 0 2024-09-13T22:56:25.827 INFO:tasks.workunit.client.1.smithi047.stdout:2/914: chown d1/df/d1d/d20/d29/dcd/dff/f6c 2 1 2024-09-13T22:56:25.827 INFO:tasks.workunit.client.1.smithi047.stdout:3/935: mknod d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d3a/c130 0 2024-09-13T22:56:25.833 INFO:tasks.workunit.client.1.smithi047.stdout:4/974: rmdir dc/de/d17/d25/d4a/dc3 39 2024-09-13T22:56:25.836 INFO:tasks.workunit.client.1.smithi047.stdout:7/829: dread d0/db/fda [0,4194304] 0 2024-09-13T22:56:25.837 INFO:tasks.workunit.client.1.smithi047.stdout:1/975: fdatasync d0/d7/d14/d57/db6/ffc 0 2024-09-13T22:56:25.837 INFO:tasks.workunit.client.1.smithi047.stdout:6/926: dwrite d3/d11/d2b/d1c/d23/fba [0,4194304] 0 2024-09-13T22:56:25.838 INFO:tasks.workunit.client.1.smithi047.stdout:5/790: write d19/d34/d6c/f8d [3933112,13596] 0 2024-09-13T22:56:25.842 INFO:tasks.workunit.client.1.smithi047.stdout:9/891: rename d1/dc/d14/dd/d54/d50/d5b/d9e/d101/d120 to d1/d5f/de9/d107/d10c/d12a 0 2024-09-13T22:56:25.848 INFO:tasks.workunit.client.1.smithi047.stdout:5/791: dwrite d19/d23/d2e/d41/d58/d77/fe2 [0,4194304] 0 2024-09-13T22:56:25.853 INFO:tasks.workunit.client.1.smithi047.stdout:8/882: dwrite d8/d64/d4e/d4d/d8f/d91/d40/f59 [0,4194304] 0 2024-09-13T22:56:25.855 INFO:tasks.workunit.client.1.smithi047.stdout:7/830: creat d0/db/de8/f119 x:0 0 0 2024-09-13T22:56:25.856 INFO:tasks.workunit.client.1.smithi047.stdout:2/915: dread d1/df/d1d/d20/f42 [4194304,4194304] 0 2024-09-13T22:56:25.863 INFO:tasks.workunit.client.1.smithi047.stdout:1/976: mkdir d0/d7/d13/d5d/d89/d118 0 2024-09-13T22:56:25.869 INFO:tasks.workunit.client.1.smithi047.stdout:9/892: symlink d1/dc/d14/dd/d54/d50/d60/db0/db2/l12b 0 2024-09-13T22:56:25.873 INFO:tasks.workunit.client.1.smithi047.stdout:9/893: write d1/dc/d14/dd/d54/f37 [331046,126853] 0 2024-09-13T22:56:25.874 INFO:tasks.workunit.client.1.smithi047.stdout:0/850: dwrite d1/d5/d16/d6a/fe9 [0,4194304] 0 2024-09-13T22:56:25.874 INFO:tasks.workunit.client.1.smithi047.stdout:0/851: chown d1/ddb 638 1 2024-09-13T22:56:25.877 INFO:tasks.workunit.client.1.smithi047.stdout:5/792: symlink d19/d64/ddd/lf6 0 2024-09-13T22:56:25.878 INFO:tasks.workunit.client.1.smithi047.stdout:6/927: dread d3/d2c/d10b/f71 [0,4194304] 0 2024-09-13T22:56:25.887 INFO:tasks.workunit.client.1.smithi047.stdout:8/883: truncate d8/d3f/d8c/f90 297900 0 2024-09-13T22:56:25.888 INFO:tasks.workunit.client.1.smithi047.stdout:8/884: read - d8/d64/d4e/d70/d98/f128 zero size 2024-09-13T22:56:25.889 INFO:tasks.workunit.client.1.smithi047.stdout:8/885: dread - d8/d3f/f122 zero size 2024-09-13T22:56:25.890 INFO:tasks.workunit.client.1.smithi047.stdout:2/916: dread d1/d16/d40/d57/db0/fb7 [0,4194304] 0 2024-09-13T22:56:25.893 INFO:tasks.workunit.client.0.smithi002.stdout:2/843: dread d1/d7/d41/d96/fc9 [0,4194304] 0 2024-09-13T22:56:25.893 INFO:tasks.workunit.client.0.smithi002.stdout:2/844: stat d1/d7/d41/f7a 0 2024-09-13T22:56:25.894 INFO:tasks.workunit.client.1.smithi047.stdout:5/793: dread d19/d23/d2e/d41/f5a [0,4194304] 0 2024-09-13T22:56:25.897 INFO:tasks.workunit.client.1.smithi047.stdout:4/975: truncate dc/de/f52 2918684 0 2024-09-13T22:56:25.899 INFO:tasks.workunit.client.0.smithi002.stdout:6/870: rmdir d12/d17/d2a 39 2024-09-13T22:56:25.901 INFO:tasks.workunit.client.1.smithi047.stdout:6/928: chown d3/d2c/d10b/d48/lf5 105685313 1 2024-09-13T22:56:25.902 INFO:tasks.workunit.client.1.smithi047.stdout:5/794: dwrite d19/d64/ff2 [0,4194304] 0 2024-09-13T22:56:25.902 INFO:tasks.workunit.client.1.smithi047.stdout:5/795: readlink l14 0 2024-09-13T22:56:25.903 INFO:tasks.workunit.client.1.smithi047.stdout:7/831: mkdir d0/d7/d11a 0 2024-09-13T22:56:25.905 INFO:tasks.workunit.client.0.smithi002.stdout:7/831: sync 2024-09-13T22:56:25.906 INFO:tasks.workunit.client.0.smithi002.stdout:6/871: dwrite d12/d17/d28/fcf [0,4194304] 0 2024-09-13T22:56:25.908 INFO:tasks.workunit.client.1.smithi047.stdout:8/886: dread d8/d64/d4e/d4d/d8f/d91/f3d [0,4194304] 0 2024-09-13T22:56:25.908 INFO:tasks.workunit.client.1.smithi047.stdout:3/936: rename d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d3a/fdc to d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/f131 0 2024-09-13T22:56:25.910 INFO:tasks.workunit.client.1.smithi047.stdout:3/937: readlink d0/d3/d4/l115 0 2024-09-13T22:56:25.910 INFO:tasks.workunit.client.1.smithi047.stdout:6/929: dread d3/d11/d2b/d1c/d23/fba [0,4194304] 0 2024-09-13T22:56:25.914 INFO:tasks.workunit.client.1.smithi047.stdout:0/852: fdatasync d1/f40 0 2024-09-13T22:56:25.916 INFO:tasks.workunit.client.0.smithi002.stdout:5/862: dread d1/d2a/d6b/d88/d45/d4f/d8f/f94 [0,4194304] 0 2024-09-13T22:56:25.917 INFO:tasks.workunit.client.1.smithi047.stdout:8/887: dwrite d8/d3f/d8c/f11d [4194304,4194304] 0 2024-09-13T22:56:25.917 INFO:tasks.workunit.client.0.smithi002.stdout:0/828: mkdir d1/d2/d12a 0 2024-09-13T22:56:25.919 INFO:tasks.workunit.client.0.smithi002.stdout:9/920: getdents d8/d10/d1c/d3d/d11f/da3/db9/dfa/da8 0 2024-09-13T22:56:25.920 INFO:tasks.workunit.client.1.smithi047.stdout:8/888: read d8/d6b/da9/dc3/ddc/f126 [434217,37445] 0 2024-09-13T22:56:25.923 INFO:tasks.workunit.client.1.smithi047.stdout:7/832: rmdir d0/d7/da 39 2024-09-13T22:56:25.924 INFO:tasks.workunit.client.0.smithi002.stdout:4/812: symlink d3/d14/d29/d2a/da6/d69/d7e/l105 0 2024-09-13T22:56:25.924 INFO:tasks.workunit.client.1.smithi047.stdout:5/796: symlink d19/d83/lf7 0 2024-09-13T22:56:25.929 INFO:tasks.workunit.client.0.smithi002.stdout:7/832: stat d8/l30 0 2024-09-13T22:56:25.931 INFO:tasks.workunit.client.1.smithi047.stdout:1/977: rename d0/d1d/daa/df0/df1/f104 to d0/d7/d13/f119 0 2024-09-13T22:56:25.934 INFO:tasks.workunit.client.0.smithi002.stdout:8/863: link d3/dc/d51/d99/c6a d3/dc/d16/d2f/d83/d95/c10e 0 2024-09-13T22:56:25.935 INFO:tasks.workunit.client.1.smithi047.stdout:3/938: unlink d0/d3/d4/d16/d2c/de/dcc/fda 0 2024-09-13T22:56:25.937 INFO:tasks.workunit.client.1.smithi047.stdout:3/939: write d0/d3/d4/d16/d2c/de/dcc/dd1/fe7 [1243765,64234] 0 2024-09-13T22:56:25.940 INFO:tasks.workunit.client.1.smithi047.stdout:0/853: creat d1/ddb/f115 x:0 0 0 2024-09-13T22:56:25.940 INFO:tasks.workunit.client.1.smithi047.stdout:9/894: truncate d1/dc/d14/dd/d4c/d6b/ffa 666064 0 2024-09-13T22:56:25.942 INFO:tasks.workunit.client.0.smithi002.stdout:3/893: write d9/d7e/daf/f103 [164318,27184] 0 2024-09-13T22:56:25.943 INFO:tasks.workunit.client.0.smithi002.stdout:7/833: dread d8/d10/f89 [0,4194304] 0 2024-09-13T22:56:25.944 INFO:tasks.workunit.client.1.smithi047.stdout:4/976: mknod dc/d29/d8e/dda/d12f/c146 0 2024-09-13T22:56:25.944 INFO:tasks.workunit.client.0.smithi002.stdout:9/921: write d8/d2c/ff6 [868956,37180] 0 2024-09-13T22:56:25.947 INFO:tasks.workunit.client.0.smithi002.stdout:2/845: rename d1/c89 to d1/d80/c11e 0 2024-09-13T22:56:25.959 INFO:tasks.workunit.client.1.smithi047.stdout:6/930: rename d3/d2c/d10b/f5d to d3/d2c/d10b/d48/f136 0 2024-09-13T22:56:25.960 INFO:tasks.workunit.client.0.smithi002.stdout:3/894: mknod d9/d3b/d53/db9/df2/c134 0 2024-09-13T22:56:25.960 INFO:tasks.workunit.client.0.smithi002.stdout:0/829: dwrite d1/d4/d75/d76/fa8 [0,4194304] 0 2024-09-13T22:56:25.961 INFO:tasks.workunit.client.0.smithi002.stdout:0/830: stat d1/d2/d81/l87 0 2024-09-13T22:56:25.966 INFO:tasks.workunit.client.0.smithi002.stdout:2/846: symlink d1/d4d/l11f 0 2024-09-13T22:56:25.967 INFO:tasks.workunit.client.1.smithi047.stdout:9/895: creat d1/dc/d14/dd/d54/d50/d5b/d106/f12c x:0 0 0 2024-09-13T22:56:25.967 INFO:tasks.workunit.client.0.smithi002.stdout:2/847: truncate d1/d7/d8/d4f/f103 282682 0 2024-09-13T22:56:25.968 INFO:tasks.workunit.client.0.smithi002.stdout:4/813: link d3/f23 d3/d14/d86/db1/dfb/f106 0 2024-09-13T22:56:25.971 INFO:tasks.workunit.client.0.smithi002.stdout:6/872: creat d12/d17/d28/d67/f115 x:0 0 0 2024-09-13T22:56:25.972 INFO:tasks.workunit.client.1.smithi047.stdout:8/889: symlink d8/d3f/l132 0 2024-09-13T22:56:25.973 INFO:tasks.workunit.client.0.smithi002.stdout:5/863: link d1/f3 d1/d57/dd0/df7/f138 0 2024-09-13T22:56:25.973 INFO:tasks.workunit.client.0.smithi002.stdout:5/864: read - d1/d2a/d6b/d88/d55/ffe zero size 2024-09-13T22:56:25.977 INFO:tasks.workunit.client.0.smithi002.stdout:7/834: unlink d8/d10/d39/d60/db8/d26/ce8 0 2024-09-13T22:56:25.977 INFO:tasks.workunit.client.1.smithi047.stdout:5/797: mknod d19/d34/d42/d5d/d80/cf8 0 2024-09-13T22:56:25.980 INFO:tasks.workunit.client.1.smithi047.stdout:1/978: unlink d0/d1d/d7f/cd0 0 2024-09-13T22:56:25.983 INFO:tasks.workunit.client.0.smithi002.stdout:3/895: rename d9/d15/d36/d4e/d5e/cf8 to d9/d7e/daf/c135 0 2024-09-13T22:56:25.987 INFO:tasks.workunit.client.0.smithi002.stdout:5/865: dread d1/d2a/d6b/d88/d55/d56/d81/f105 [0,4194304] 0 2024-09-13T22:56:25.989 INFO:tasks.workunit.client.1.smithi047.stdout:3/940: mkdir d0/d3/d4/d16/d32/d42/d79/d9c/d11c/df7/d132 0 2024-09-13T22:56:25.991 INFO:tasks.workunit.client.1.smithi047.stdout:7/833: write d0/d7/da/d4e/f66 [5235782,59521] 0 2024-09-13T22:56:25.992 INFO:tasks.workunit.client.0.smithi002.stdout:8/864: link d3/dc/d51/c101 d3/dc/d16/d4b/d72/c10f 0 2024-09-13T22:56:25.996 INFO:tasks.workunit.client.1.smithi047.stdout:9/896: creat d1/d5f/d6a/f12d x:0 0 0 2024-09-13T22:56:25.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:25 smithi002 ceph-mon[27637]: Adjusting osd_memory_target on smithi047 to 2241M 2024-09-13T22:56:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:25 smithi002 ceph-mon[27637]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-13T22:56:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:25 smithi002 ceph-mon[27637]: Updating smithi047:/etc/ceph/ceph.conf 2024-09-13T22:56:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:25 smithi002 ceph-mon[27637]: Updating smithi002:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:56:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:25 smithi002 ceph-mon[27637]: Updating smithi047:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:56:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:25 smithi002 ceph-mon[27637]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:56:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:25 smithi002 ceph-mon[27637]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:56:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:25 smithi002 ceph-mon[27637]: Updating smithi002:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:56:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:25 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:25 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:25 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:25 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:25 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:26.002 INFO:tasks.workunit.client.1.smithi047.stdout:0/854: write d1/d5/d16/fac [777948,118194] 0 2024-09-13T22:56:26.003 INFO:tasks.workunit.client.1.smithi047.stdout:9/897: dwrite d1/d5f/f9b [0,4194304] 0 2024-09-13T22:56:26.005 INFO:tasks.workunit.client.0.smithi002.stdout:0/831: fdatasync d1/fa 0 2024-09-13T22:56:26.009 INFO:tasks.workunit.client.1.smithi047.stdout:5/798: rename d19/d34/d42/l44 to d19/d83/lf9 0 2024-09-13T22:56:26.010 INFO:tasks.workunit.client.0.smithi002.stdout:0/832: dread d1/d4/d75/d31/d32/f39 [0,4194304] 0 2024-09-13T22:56:26.011 INFO:tasks.workunit.client.0.smithi002.stdout:1/911: sync 2024-09-13T22:56:26.014 INFO:tasks.workunit.client.0.smithi002.stdout:5/866: read - d1/d2a/d6b/d88/d55/d56/d81/f82 zero size 2024-09-13T22:56:26.016 INFO:tasks.workunit.client.1.smithi047.stdout:7/834: unlink d0/d7/da/d47/d92/lab 0 2024-09-13T22:56:26.016 INFO:tasks.workunit.client.0.smithi002.stdout:4/814: mkdir d3/d14/d107 0 2024-09-13T22:56:26.021 INFO:tasks.workunit.client.0.smithi002.stdout:4/815: chown d3/d14/d29/d2a/f60 15802 1 2024-09-13T22:56:26.021 INFO:tasks.workunit.client.0.smithi002.stdout:4/816: chown d3/d14/d86/db1 40203 1 2024-09-13T22:56:26.021 INFO:tasks.workunit.client.0.smithi002.stdout:7/835: mknod d8/d10/d39/d60/db8/d26/d4c/cf8 0 2024-09-13T22:56:26.022 INFO:tasks.workunit.client.1.smithi047.stdout:4/977: creat dc/de/d17/d25/d4a/f147 x:0 0 0 2024-09-13T22:56:26.022 INFO:tasks.workunit.client.1.smithi047.stdout:8/890: symlink d8/d64/l133 0 2024-09-13T22:56:26.022 INFO:tasks.workunit.client.1.smithi047.stdout:0/855: mknod d1/d5/d16/d97/db6/c116 0 2024-09-13T22:56:26.023 INFO:tasks.workunit.client.1.smithi047.stdout:9/898: rename d1/dc/d14/dd/d4c/df2/d82 to d1/d5f/de9/d107/d12e 0 2024-09-13T22:56:26.024 INFO:tasks.workunit.client.0.smithi002.stdout:0/833: dread d1/d4/d75/d31/f65 [0,4194304] 0 2024-09-13T22:56:26.024 INFO:tasks.workunit.client.1.smithi047.stdout:8/891: dread d8/f1e [0,4194304] 0 2024-09-13T22:56:26.025 INFO:tasks.workunit.client.0.smithi002.stdout:0/834: chown d1/d4/d75/d31/c60 2819673 1 2024-09-13T22:56:26.026 INFO:tasks.workunit.client.0.smithi002.stdout:3/896: dread d9/d15/fd6 [0,4194304] 0 2024-09-13T22:56:26.027 INFO:tasks.workunit.client.1.smithi047.stdout:1/979: dread d0/d7/d13/d2d/fde [0,4194304] 0 2024-09-13T22:56:26.030 INFO:tasks.workunit.client.0.smithi002.stdout:9/922: getdents d8/d2c/dbc/d103/d106 0 2024-09-13T22:56:26.032 INFO:tasks.workunit.client.0.smithi002.stdout:1/912: mkdir d1/d13/d1d/d34/d51/dc6/d13c 0 2024-09-13T22:56:26.033 INFO:tasks.workunit.client.1.smithi047.stdout:1/980: dread d0/d7/d14/d28/d36/f9b [0,4194304] 0 2024-09-13T22:56:26.033 INFO:tasks.workunit.client.0.smithi002.stdout:2/848: creat d1/d7/d41/d96/f120 x:0 0 0 2024-09-13T22:56:26.034 INFO:tasks.workunit.client.1.smithi047.stdout:1/981: write d0/d7/db/f114 [727751,81661] 0 2024-09-13T22:56:26.036 INFO:tasks.workunit.client.0.smithi002.stdout:2/849: dread d1/f95 [0,4194304] 0 2024-09-13T22:56:26.038 INFO:tasks.workunit.client.0.smithi002.stdout:2/850: write d1/d7/d35/d78/dfc/d6b/d75/fc1 [666491,59704] 0 2024-09-13T22:56:26.039 INFO:tasks.workunit.client.0.smithi002.stdout:2/851: stat d1/d7/d35/d3e 0 2024-09-13T22:56:26.039 INFO:tasks.workunit.client.1.smithi047.stdout:5/799: write d19/d23/d32/d69/f70 [4768372,113751] 0 2024-09-13T22:56:26.040 INFO:tasks.workunit.client.0.smithi002.stdout:8/865: symlink d3/dc/d18/d2e/df4/l110 0 2024-09-13T22:56:26.041 INFO:tasks.workunit.client.0.smithi002.stdout:2/852: dread - d1/d7/d41/f11b zero size 2024-09-13T22:56:26.041 INFO:tasks.workunit.client.0.smithi002.stdout:8/866: write d3/d27/fee [1922681,42537] 0 2024-09-13T22:56:26.042 INFO:tasks.workunit.client.0.smithi002.stdout:8/867: chown d3/dc/da4/cad 599143 1 2024-09-13T22:56:26.043 INFO:tasks.workunit.client.0.smithi002.stdout:8/868: stat d3/dc/d16/d97/fb5 0 2024-09-13T22:56:26.044 INFO:tasks.workunit.client.1.smithi047.stdout:8/892: read - d8/d64/d4e/d4d/d8f/d91/d38/dc8/f100 zero size 2024-09-13T22:56:26.045 INFO:tasks.workunit.client.1.smithi047.stdout:6/931: link d3/d11/d2b/d1c/fce d3/d2c/d10b/d48/dd7/f137 0 2024-09-13T22:56:26.046 INFO:tasks.workunit.client.1.smithi047.stdout:6/932: chown d3/d11/d2b/d1c/dbd/de8/f10d 400388 1 2024-09-13T22:56:26.047 INFO:tasks.workunit.client.1.smithi047.stdout:0/856: write d1/d5/d11/d2f/f8d [344105,31726] 0 2024-09-13T22:56:26.048 INFO:tasks.workunit.client.1.smithi047.stdout:6/933: readlink d3/d11/d2b/d1c/d4d/d69/dc2/lc8 0 2024-09-13T22:56:26.049 INFO:tasks.workunit.client.0.smithi002.stdout:6/873: rename d12/d17/d34/d39/d8a/caf to d12/d17/d28/d67/c116 0 2024-09-13T22:56:26.054 INFO:tasks.workunit.client.1.smithi047.stdout:9/899: dwrite d1/dc/d14/dd/d54/d50/d5b/fcc [0,4194304] 0 2024-09-13T22:56:26.056 INFO:tasks.workunit.client.1.smithi047.stdout:4/978: symlink dc/d29/d8e/l148 0 2024-09-13T22:56:26.056 INFO:tasks.workunit.client.0.smithi002.stdout:6/874: dwrite d12/d17/d28/d67/d9f/ddd/f109 [0,4194304] 0 2024-09-13T22:56:26.057 INFO:tasks.workunit.client.0.smithi002.stdout:7/836: dread d8/fb [0,4194304] 0 2024-09-13T22:56:26.058 INFO:tasks.workunit.client.0.smithi002.stdout:6/875: write d12/d17/ddf/ff0 [891386,53899] 0 2024-09-13T22:56:26.061 INFO:tasks.workunit.client.0.smithi002.stdout:5/867: mknod d1/c139 0 2024-09-13T22:56:26.062 INFO:tasks.workunit.client.0.smithi002.stdout:7/837: read d8/d10/d39/d60/db8/f34 [2164751,49917] 0 2024-09-13T22:56:26.065 INFO:tasks.workunit.client.0.smithi002.stdout:1/913: rename d1/d13/d30/f2a to d1/d13/d21/d40/dc4/f13d 0 2024-09-13T22:56:26.066 INFO:tasks.workunit.client.1.smithi047.stdout:0/857: mknod d1/d5/d16/d97/dfc/dd8/c117 0 2024-09-13T22:56:26.069 INFO:tasks.workunit.client.0.smithi002.stdout:9/923: link d8/d10/d61/f131 d8/d2c/dbc/d10c/f134 0 2024-09-13T22:56:26.069 INFO:tasks.workunit.client.0.smithi002.stdout:0/835: dwrite d1/d2/d6c/f84 [0,4194304] 0 2024-09-13T22:56:26.070 INFO:tasks.workunit.client.1.smithi047.stdout:6/934: mkdir d3/d11/d138 0 2024-09-13T22:56:26.070 INFO:tasks.workunit.client.0.smithi002.stdout:1/914: write d1/d13/d21/d39/d70/d10c/d3b/d71/d80/d112/f10b [672674,130557] 0 2024-09-13T22:56:26.072 INFO:tasks.workunit.client.1.smithi047.stdout:2/917: sync 2024-09-13T22:56:26.074 INFO:tasks.workunit.client.1.smithi047.stdout:3/941: getdents d0/d3/d4/d16/d2c/de/d1f 0 2024-09-13T22:56:26.074 INFO:tasks.workunit.client.0.smithi002.stdout:0/836: write d1/d4/d75/d31/d32/dbb/de1/f10e [672011,61360] 0 2024-09-13T22:56:26.079 INFO:tasks.workunit.client.1.smithi047.stdout:7/835: creat d0/d7/da/f11b x:0 0 0 2024-09-13T22:56:26.079 INFO:tasks.workunit.client.0.smithi002.stdout:6/876: mknod d12/d17/d28/d67/d9f/ddd/c117 0 2024-09-13T22:56:26.080 INFO:tasks.workunit.client.0.smithi002.stdout:2/853: creat d1/d4d/d8b/de1/dd6/d11d/f121 x:0 0 0 2024-09-13T22:56:26.081 INFO:tasks.workunit.client.0.smithi002.stdout:2/854: chown d1/d32/d37/d79/fb3 920904031 1 2024-09-13T22:56:26.083 INFO:tasks.workunit.client.0.smithi002.stdout:9/924: dread d8/d10/d1c/d3d/d11f/da3/db9/dfa/d87/fdf [0,4194304] 0 2024-09-13T22:56:26.083 INFO:tasks.workunit.client.0.smithi002.stdout:9/925: chown d8/d10/db1/l85 23434711 1 2024-09-13T22:56:26.083 INFO:tasks.workunit.client.0.smithi002.stdout:7/838: creat d8/d10/ff9 x:0 0 0 2024-09-13T22:56:26.085 INFO:tasks.workunit.client.1.smithi047.stdout:4/979: chown dc/de/d23/d40/d7b/dab/l104 19 1 2024-09-13T22:56:26.093 INFO:tasks.workunit.client.0.smithi002.stdout:8/869: rename d3/dc/d16/d4b/d72/d73/cc0 to d3/dc/d16/d2f/d83/d95/dbb/c111 0 2024-09-13T22:56:26.096 INFO:tasks.workunit.client.1.smithi047.stdout:6/935: chown d3/d11/d2b/d1c/dca 338 1 2024-09-13T22:56:26.097 INFO:tasks.workunit.client.0.smithi002.stdout:8/870: dread d3/d27/fee [0,4194304] 0 2024-09-13T22:56:26.098 INFO:tasks.workunit.client.0.smithi002.stdout:5/868: write d1/d2a/d6b/d88/d45/d4f/d8f/fa9 [754671,35298] 0 2024-09-13T22:56:26.099 INFO:tasks.workunit.client.1.smithi047.stdout:7/836: symlink d0/d7/da/d47/l11c 0 2024-09-13T22:56:26.100 INFO:tasks.workunit.client.0.smithi002.stdout:0/837: read d1/f5f [329527,73794] 0 2024-09-13T22:56:26.100 INFO:tasks.workunit.client.0.smithi002.stdout:6/877: dread - d12/d17/d28/d67/dca/fd9 zero size 2024-09-13T22:56:26.101 INFO:tasks.workunit.client.1.smithi047.stdout:9/900: stat d1/dc/d14/dd/d54/d4e/d51/c8b 0 2024-09-13T22:56:26.102 INFO:tasks.workunit.client.1.smithi047.stdout:4/980: readlink dc/d29/l3d 0 2024-09-13T22:56:26.104 INFO:tasks.workunit.client.1.smithi047.stdout:5/800: dwrite d19/d83/feb [0,4194304] 0 2024-09-13T22:56:26.111 INFO:tasks.workunit.client.1.smithi047.stdout:6/936: unlink d3/d77/d8f/db9/f11a 0 2024-09-13T22:56:26.114 INFO:tasks.workunit.client.0.smithi002.stdout:1/915: mknod d1/d13/d1d/d34/c13e 0 2024-09-13T22:56:26.115 INFO:tasks.workunit.client.0.smithi002.stdout:0/838: dread d1/d2/f1d [0,4194304] 0 2024-09-13T22:56:26.116 INFO:tasks.workunit.client.0.smithi002.stdout:5/869: dread d1/d2a/d6b/d88/d55/f7a [0,4194304] 0 2024-09-13T22:56:26.117 INFO:tasks.workunit.client.0.smithi002.stdout:0/839: fdatasync d1/d4/d75/d31/d32/dbb/ffe 0 2024-09-13T22:56:26.120 INFO:tasks.workunit.client.1.smithi047.stdout:9/901: mkdir d1/dc/d14/dd/d54/d4e/d12f 0 2024-09-13T22:56:26.122 INFO:tasks.workunit.client.0.smithi002.stdout:6/878: rename d12/d17/ld4 to d12/d17/d34/d4b/l118 0 2024-09-13T22:56:26.122 INFO:tasks.workunit.client.1.smithi047.stdout:1/982: link d0/d7/db/d101/c11 d0/d7/d13/d5d/c11a 0 2024-09-13T22:56:26.127 INFO:tasks.workunit.client.0.smithi002.stdout:7/839: creat d8/d10/d39/d60/db8/d26/d38/d84/ffa x:0 0 0 2024-09-13T22:56:26.131 INFO:tasks.workunit.client.1.smithi047.stdout:8/893: getdents d8/d64/d4e/d4d/d8f/d91/d38/dc8 0 2024-09-13T22:56:26.132 INFO:tasks.workunit.client.0.smithi002.stdout:9/926: truncate d8/fd7 3325969 0 2024-09-13T22:56:26.133 INFO:tasks.workunit.client.1.smithi047.stdout:3/942: dwrite d0/d3/d4/d16/f61 [0,4194304] 0 2024-09-13T22:56:26.134 INFO:tasks.workunit.client.1.smithi047.stdout:7/837: dwrite d0/d7/f6 [4194304,4194304] 0 2024-09-13T22:56:26.135 INFO:tasks.workunit.client.1.smithi047.stdout:0/858: rename d1/d7/cdd to d1/d5/d11/d52/c118 0 2024-09-13T22:56:26.140 INFO:tasks.workunit.client.0.smithi002.stdout:5/870: creat d1/d2a/d6b/d88/d45/d4f/db7/f13a x:0 0 0 2024-09-13T22:56:26.140 INFO:tasks.workunit.client.0.smithi002.stdout:0/840: creat d1/d4/da3/d7d/f12b x:0 0 0 2024-09-13T22:56:26.142 INFO:tasks.workunit.client.1.smithi047.stdout:9/902: mkdir d1/d5f/dd4/d130 0 2024-09-13T22:56:26.144 INFO:tasks.workunit.client.1.smithi047.stdout:9/903: write d1/dc/d14/dd/f1d [3766327,110491] 0 2024-09-13T22:56:26.145 INFO:tasks.workunit.client.0.smithi002.stdout:7/840: creat d8/d10/d39/d60/db8/d26/d95/ffb x:0 0 0 2024-09-13T22:56:26.152 INFO:tasks.workunit.client.1.smithi047.stdout:3/943: dread d0/d3/d4/d91/d8d/fb6 [0,4194304] 0 2024-09-13T22:56:26.153 INFO:tasks.workunit.client.1.smithi047.stdout:9/904: dwrite d1/dc/d14/dd/d54/d8d/fde [0,4194304] 0 2024-09-13T22:56:26.155 INFO:tasks.workunit.client.1.smithi047.stdout:5/801: creat d19/d83/d98/dd0/ffa x:0 0 0 2024-09-13T22:56:26.156 INFO:tasks.workunit.client.0.smithi002.stdout:9/927: rmdir d8/d2c/dbc/d10c 39 2024-09-13T22:56:26.160 INFO:tasks.workunit.client.0.smithi002.stdout:1/916: dwrite d1/d13/d30/de1/ff8 [0,4194304] 0 2024-09-13T22:56:26.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:25 smithi047 ceph-mon[34560]: Adjusting osd_memory_target on smithi047 to 2241M 2024-09-13T22:56:26.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:25 smithi047 ceph-mon[34560]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-13T22:56:26.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:25 smithi047 ceph-mon[34560]: Updating smithi047:/etc/ceph/ceph.conf 2024-09-13T22:56:26.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:25 smithi047 ceph-mon[34560]: Updating smithi002:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:56:26.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:25 smithi047 ceph-mon[34560]: Updating smithi047:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:56:26.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:25 smithi047 ceph-mon[34560]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:56:26.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:25 smithi047 ceph-mon[34560]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:56:26.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:25 smithi047 ceph-mon[34560]: Updating smithi002:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:56:26.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:25 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:26.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:25 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:26.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:25 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:26.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:25 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:26.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:25 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:26.165 INFO:tasks.workunit.client.0.smithi002.stdout:5/871: rename d1/d57/fff to d1/d2a/d6b/d88/d45/d4f/db7/f13b 0 2024-09-13T22:56:26.168 INFO:tasks.workunit.client.1.smithi047.stdout:8/894: dread d8/d6b/f99 [0,4194304] 0 2024-09-13T22:56:26.169 INFO:tasks.workunit.client.0.smithi002.stdout:6/879: truncate d12/f22 344039 0 2024-09-13T22:56:26.169 INFO:tasks.workunit.client.0.smithi002.stdout:6/880: readlink d12/l10f 0 2024-09-13T22:56:26.169 INFO:tasks.workunit.client.0.smithi002.stdout:7/841: dread d8/d10/d39/d60/db8/f34 [0,4194304] 0 2024-09-13T22:56:26.170 INFO:tasks.workunit.client.0.smithi002.stdout:8/871: getdents d3/dc/d16 0 2024-09-13T22:56:26.172 INFO:tasks.workunit.client.1.smithi047.stdout:4/981: dwrite dc/de/d23/d40/d7b/d90/da6/f11b [0,4194304] 0 2024-09-13T22:56:26.173 INFO:tasks.workunit.client.0.smithi002.stdout:5/872: dwrite d1/d2a/d6b/d88/d45/f61 [0,4194304] 0 2024-09-13T22:56:26.173 INFO:tasks.workunit.client.0.smithi002.stdout:9/928: creat d8/d10/d61/f135 x:0 0 0 2024-09-13T22:56:26.173 INFO:tasks.workunit.client.1.smithi047.stdout:4/982: readlink dc/d29/d4c/l111 0 2024-09-13T22:56:26.174 INFO:tasks.workunit.client.0.smithi002.stdout:7/842: write d8/d10/d39/d60/db8/d26/d38/d84/ffa [254015,87061] 0 2024-09-13T22:56:26.174 INFO:tasks.workunit.client.1.smithi047.stdout:6/937: creat d3/d11/d2b/d1c/d134/f139 x:0 0 0 2024-09-13T22:56:26.176 INFO:tasks.workunit.client.1.smithi047.stdout:1/983: mkdir d0/d7/dd3/d106/d11b 0 2024-09-13T22:56:26.177 INFO:tasks.workunit.client.0.smithi002.stdout:9/929: write d8/d10/dc4/f108 [149908,23763] 0 2024-09-13T22:56:26.179 INFO:tasks.workunit.client.0.smithi002.stdout:7/843: write d8/d10/d39/d60/db8/d26/d38/f9e [1153175,130973] 0 2024-09-13T22:56:26.184 INFO:tasks.workunit.client.1.smithi047.stdout:3/944: read d0/d3/d4/d16/d2c/de/d68/f88 [257523,19473] 0 2024-09-13T22:56:26.186 INFO:tasks.workunit.client.0.smithi002.stdout:6/881: rename d12/d17/d34/d39/d8a/cb9 to d12/d17/d28/d67/d6b/daa/c119 0 2024-09-13T22:56:26.187 INFO:tasks.workunit.client.1.smithi047.stdout:3/945: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/ffe [762389,56427] 0 2024-09-13T22:56:26.188 INFO:tasks.workunit.client.1.smithi047.stdout:9/905: mkdir d1/d131 0 2024-09-13T22:56:26.189 INFO:tasks.workunit.client.0.smithi002.stdout:8/872: truncate d3/dc/d16/d97/f107 175652 0 2024-09-13T22:56:26.191 INFO:tasks.workunit.client.1.smithi047.stdout:3/946: dread d0/d3/d4/d16/d32/d42/d79/df2/f123 [0,4194304] 0 2024-09-13T22:56:26.193 INFO:tasks.workunit.client.0.smithi002.stdout:0/841: creat d1/d7e/d9d/de6/f12c x:0 0 0 2024-09-13T22:56:26.195 INFO:tasks.workunit.client.1.smithi047.stdout:9/906: dwrite d1/dc/d14/dd/d54/d8d/fd9 [0,4194304] 0 2024-09-13T22:56:26.199 INFO:tasks.workunit.client.0.smithi002.stdout:9/930: creat d8/d10/d61/f136 x:0 0 0 2024-09-13T22:56:26.202 INFO:tasks.workunit.client.1.smithi047.stdout:8/895: mkdir d8/d64/d4e/d70/da7/de0/d134 0 2024-09-13T22:56:26.202 INFO:tasks.workunit.client.0.smithi002.stdout:7/844: read - d8/d10/d39/d60/db8/d2e/d50/d52/d72/d8f/ff3 zero size 2024-09-13T22:56:26.205 INFO:tasks.workunit.client.0.smithi002.stdout:1/917: dwrite d1/d13/d1d/d34/d51/dc6/f103 [0,4194304] 0 2024-09-13T22:56:26.207 INFO:tasks.workunit.client.0.smithi002.stdout:7/845: write d8/d10/d39/d60/db8/d26/d4c/d81/d46/fd6 [798300,58990] 0 2024-09-13T22:56:26.207 INFO:tasks.workunit.client.0.smithi002.stdout:8/873: creat d3/dc/d16/d2f/d83/d95/f112 x:0 0 0 2024-09-13T22:56:26.209 INFO:tasks.workunit.client.0.smithi002.stdout:9/931: dread d8/d10/d1c/d3d/d11f/da3/db9/dfa/d87/fea [0,4194304] 0 2024-09-13T22:56:26.210 INFO:tasks.workunit.client.0.smithi002.stdout:5/873: write d1/d2a/d6b/d88/d55/d56/d86/f123 [5227834,69193] 0 2024-09-13T22:56:26.210 INFO:tasks.workunit.client.0.smithi002.stdout:0/842: dread - d1/d4/d75/d31/de0/fec zero size 2024-09-13T22:56:26.210 INFO:tasks.workunit.client.1.smithi047.stdout:4/983: fsync dc/de/d23/dc4/ddb/fe7 0 2024-09-13T22:56:26.221 INFO:tasks.workunit.client.0.smithi002.stdout:8/874: dread d3/d21/d57/fc4 [0,4194304] 0 2024-09-13T22:56:26.222 INFO:tasks.workunit.client.0.smithi002.stdout:6/882: symlink d12/d17/d28/d67/dca/dd8/l11a 0 2024-09-13T22:56:26.225 INFO:tasks.workunit.client.0.smithi002.stdout:1/918: symlink d1/d13/d21/d39/d70/d10c/d3b/d71/d80/d112/d9e/l13f 0 2024-09-13T22:56:26.227 INFO:tasks.workunit.client.0.smithi002.stdout:1/919: write d1/d13/d21/d39/d70/d10c/d3b/d71/d80/d112/d9e/f11f [631206,109169] 0 2024-09-13T22:56:26.231 INFO:tasks.workunit.client.1.smithi047.stdout:3/947: write d0/d3/d4/d16/d32/d42/d79/d9c/fb8 [4832463,21099] 0 2024-09-13T22:56:26.232 INFO:tasks.workunit.client.0.smithi002.stdout:9/932: unlink d8/d2c/d50/l9d 0 2024-09-13T22:56:26.234 INFO:tasks.workunit.client.1.smithi047.stdout:9/907: rmdir d1/dc/d14/dd/d54/d4e 39 2024-09-13T22:56:26.236 INFO:tasks.workunit.client.0.smithi002.stdout:5/874: symlink d1/d2a/d6b/d88/d55/l13c 0 2024-09-13T22:56:26.237 INFO:tasks.workunit.client.1.smithi047.stdout:8/896: mkdir d8/d6b/dce/d135 0 2024-09-13T22:56:26.238 INFO:tasks.workunit.client.0.smithi002.stdout:7/846: write d8/d10/d39/d60/db8/d26/d4c/d81/d51/f66 [748353,22006] 0 2024-09-13T22:56:26.239 INFO:tasks.workunit.client.0.smithi002.stdout:1/920: dread d1/d13/d21/d39/d70/d10c/f44 [0,4194304] 0 2024-09-13T22:56:26.240 INFO:tasks.workunit.client.0.smithi002.stdout:9/933: dread d8/d1e/f36 [0,4194304] 0 2024-09-13T22:56:26.240 INFO:tasks.workunit.client.1.smithi047.stdout:2/918: rename d1/df/d35/ffe to d1/d16/d40/f133 0 2024-09-13T22:56:26.242 INFO:tasks.workunit.client.1.smithi047.stdout:0/859: rmdir d1/d5/d16/dc0/d114 0 2024-09-13T22:56:26.243 INFO:tasks.workunit.client.0.smithi002.stdout:8/875: creat d3/dc/d8b/f113 x:0 0 0 2024-09-13T22:56:26.245 INFO:tasks.workunit.client.1.smithi047.stdout:4/984: creat dc/de/d23/dc4/f149 x:0 0 0 2024-09-13T22:56:26.248 INFO:tasks.workunit.client.1.smithi047.stdout:1/984: creat d0/d7/d14/d107/f11c x:0 0 0 2024-09-13T22:56:26.249 INFO:tasks.workunit.client.0.smithi002.stdout:0/843: creat d1/d4/d75/d76/d120/f12d x:0 0 0 2024-09-13T22:56:26.250 INFO:tasks.workunit.client.1.smithi047.stdout:5/802: creat d19/d23/d2e/ffb x:0 0 0 2024-09-13T22:56:26.255 INFO:tasks.workunit.client.1.smithi047.stdout:3/948: chown d0/f12 719 1 2024-09-13T22:56:26.257 INFO:tasks.workunit.client.1.smithi047.stdout:9/908: mkdir d1/dc/d14/dd/d4c/df2/d132 0 2024-09-13T22:56:26.261 INFO:tasks.workunit.client.0.smithi002.stdout:8/876: symlink d3/dc/d16/d60/da7/l114 0 2024-09-13T22:56:26.261 INFO:tasks.workunit.client.0.smithi002.stdout:8/877: readlink d3/dc/d18/d2e/ldc 0 2024-09-13T22:56:26.262 INFO:tasks.workunit.client.0.smithi002.stdout:8/878: read - d3/dc/d51/d99/fef zero size 2024-09-13T22:56:26.263 INFO:tasks.workunit.client.1.smithi047.stdout:8/897: rename d8/d64/d4e/c6c to d8/d64/d4e/d70/da7/de0/c136 0 2024-09-13T22:56:26.263 INFO:tasks.workunit.client.1.smithi047.stdout:5/803: dread d19/d25/f38 [0,4194304] 0 2024-09-13T22:56:26.264 INFO:tasks.workunit.client.1.smithi047.stdout:9/909: dwrite d1/dc/d14/dd/d4c/fa1 [0,4194304] 0 2024-09-13T22:56:26.266 INFO:tasks.workunit.client.0.smithi002.stdout:6/883: creat d12/d17/d28/d67/dca/dd8/de1/dff/f11b x:0 0 0 2024-09-13T22:56:26.267 INFO:tasks.workunit.client.0.smithi002.stdout:6/884: chown l3 117220 1 2024-09-13T22:56:26.267 INFO:tasks.workunit.client.1.smithi047.stdout:2/919: chown d1/df/d35/d8b/fbf 27498067 1 2024-09-13T22:56:26.268 INFO:tasks.workunit.client.0.smithi002.stdout:5/875: mkdir d1/d2a/d6b/d88/d13d 0 2024-09-13T22:56:26.269 INFO:tasks.workunit.client.0.smithi002.stdout:7/847: dwrite d8/d10/d39/d60/db8/f1c [0,4194304] 0 2024-09-13T22:56:26.269 INFO:tasks.workunit.client.1.smithi047.stdout:0/860: symlink d1/d5/d16/d6a/d92/l119 0 2024-09-13T22:56:26.271 INFO:tasks.workunit.client.1.smithi047.stdout:0/861: write d1/d5/d16/d97/dfc/d2d/f31 [7960843,70294] 0 2024-09-13T22:56:26.272 INFO:tasks.workunit.client.1.smithi047.stdout:6/938: creat d3/f13a x:0 0 0 2024-09-13T22:56:26.274 INFO:tasks.workunit.client.1.smithi047.stdout:7/838: getdents d0/d57/d5b/d5c/db6/df3 0 2024-09-13T22:56:26.275 INFO:tasks.workunit.client.0.smithi002.stdout:1/921: dwrite d1/d13/d21/d40/f93 [4194304,4194304] 0 2024-09-13T22:56:26.280 INFO:tasks.workunit.client.1.smithi047.stdout:9/910: dread d1/d5f/f9b [4194304,4194304] 0 2024-09-13T22:56:26.283 INFO:tasks.workunit.client.1.smithi047.stdout:4/985: rename dc/de/d23/d40/d7b/dab/dae/d102 to dc/de/d23/ddf/d14a 0 2024-09-13T22:56:26.283 INFO:tasks.workunit.client.0.smithi002.stdout:5/876: dwrite d1/d2a/d69/db8/f130 [0,4194304] 0 2024-09-13T22:56:26.286 INFO:tasks.workunit.client.0.smithi002.stdout:7/848: creat d8/d10/d39/d60/db8/d26/d38/ffc x:0 0 0 2024-09-13T22:56:26.296 INFO:tasks.workunit.client.0.smithi002.stdout:0/844: rename d1/d4/d75/d31/d32/dbb/de1/f113 to d1/f12e 0 2024-09-13T22:56:26.298 INFO:tasks.workunit.client.0.smithi002.stdout:1/922: truncate d1/d13/d1d/f75 4014 0 2024-09-13T22:56:26.300 INFO:tasks.workunit.client.1.smithi047.stdout:7/839: mknod d0/d7/da/d47/c11d 0 2024-09-13T22:56:26.301 INFO:tasks.workunit.client.1.smithi047.stdout:7/840: chown d0/db/de8/c109 126099 1 2024-09-13T22:56:26.305 INFO:tasks.workunit.client.1.smithi047.stdout:3/949: link d0/d3/d4/d16/d32/d42/dbd/f111 d0/d3/d4/d16/d32/d42/d79/d9c/dad/d95/f133 0 2024-09-13T22:56:26.305 INFO:tasks.workunit.client.0.smithi002.stdout:9/934: dwrite d8/d10/d61/df4/f132 [0,4194304] 0 2024-09-13T22:56:26.307 INFO:tasks.workunit.client.0.smithi002.stdout:8/879: dwrite d3/dc/d8b/f9e [0,4194304] 0 2024-09-13T22:56:26.307 INFO:tasks.workunit.client.1.smithi047.stdout:3/950: dread - d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/d128/ffb zero size 2024-09-13T22:56:26.307 INFO:tasks.workunit.client.0.smithi002.stdout:8/880: stat d3/d27/fee 0 2024-09-13T22:56:26.309 INFO:tasks.workunit.client.1.smithi047.stdout:9/911: fsync d1/dc/d14/dd/f3e 0 2024-09-13T22:56:26.309 INFO:tasks.workunit.client.1.smithi047.stdout:3/951: readlink d0/d3/d4/d91/d8d/d11a/l12e 0 2024-09-13T22:56:26.310 INFO:tasks.workunit.client.1.smithi047.stdout:4/986: dread dc/de/d23/d40/d7b/dab/dae/f12b [0,4194304] 0 2024-09-13T22:56:26.312 INFO:tasks.workunit.client.0.smithi002.stdout:5/877: rename d1/d2a/d6b/d88/d45/f54 to d1/d2a/d6b/d88/d45/d4f/da7/daa/f13e 0 2024-09-13T22:56:26.314 INFO:tasks.workunit.client.0.smithi002.stdout:7/849: dread d8/d10/d39/d60/db8/d26/d4c/fa7 [0,4194304] 0 2024-09-13T22:56:26.319 INFO:tasks.workunit.client.0.smithi002.stdout:6/885: dwrite d12/d17/d28/d67/d6b/daa/fad [0,4194304] 0 2024-09-13T22:56:26.320 INFO:tasks.workunit.client.1.smithi047.stdout:4/987: dwrite dc/d29/d6c/fad [0,4194304] 0 2024-09-13T22:56:26.320 INFO:tasks.workunit.client.1.smithi047.stdout:0/862: dwrite d1/f69 [0,4194304] 0 2024-09-13T22:56:26.320 INFO:tasks.workunit.client.0.smithi002.stdout:1/923: mknod d1/d13/d21/d39/d70/d10c/d3d/c140 0 2024-09-13T22:56:26.326 INFO:tasks.workunit.client.1.smithi047.stdout:1/985: write d0/d7/d14/d28/d36/f84 [2477567,56918] 0 2024-09-13T22:56:26.327 INFO:tasks.workunit.client.0.smithi002.stdout:6/886: dwrite d12/d17/d28/d67/f6d [0,4194304] 0 2024-09-13T22:56:26.331 INFO:tasks.workunit.client.1.smithi047.stdout:2/920: mkdir d1/de/d134 0 2024-09-13T22:56:26.336 INFO:tasks.workunit.client.0.smithi002.stdout:8/881: fdatasync d3/dc/d16/d2f/d83/d95/fb0 0 2024-09-13T22:56:26.337 INFO:tasks.workunit.client.0.smithi002.stdout:5/878: dread d1/d2a/d6b/d88/d45/d4f/d78/fac [0,4194304] 0 2024-09-13T22:56:26.338 INFO:tasks.workunit.client.0.smithi002.stdout:5/879: dread - d1/d2a/d6b/d88/d45/d4f/f120 zero size 2024-09-13T22:56:26.340 INFO:tasks.workunit.client.0.smithi002.stdout:8/882: read d3/d21/d57/da1/fe8 [955582,92501] 0 2024-09-13T22:56:26.342 INFO:tasks.workunit.client.1.smithi047.stdout:6/939: creat d3/d11/d2b/d1c/dca/df8/f13b x:0 0 0 2024-09-13T22:56:26.343 INFO:tasks.workunit.client.0.smithi002.stdout:0/845: mknod d1/d4/d75/d31/d32/c12f 0 2024-09-13T22:56:26.346 INFO:tasks.workunit.client.0.smithi002.stdout:8/883: dwrite d3/dc/d18/d56/f103 [0,4194304] 0 2024-09-13T22:56:26.348 INFO:tasks.workunit.client.0.smithi002.stdout:7/850: symlink d8/d10/d39/d60/db8/d2e/d50/d52/d72/lfd 0 2024-09-13T22:56:26.350 INFO:tasks.workunit.client.1.smithi047.stdout:9/912: dread d1/dc/d14/dd/d54/d50/fe7 [0,4194304] 0 2024-09-13T22:56:26.351 INFO:tasks.workunit.client.1.smithi047.stdout:3/952: creat d0/d3/d4/d91/d8d/d11a/f134 x:0 0 0 2024-09-13T22:56:26.352 INFO:tasks.workunit.client.1.smithi047.stdout:9/913: fsync d1/dc/d14/dd/d54/d8d/fc0 0 2024-09-13T22:56:26.353 INFO:tasks.workunit.client.1.smithi047.stdout:9/914: chown d1/dc/f15 13378335 1 2024-09-13T22:56:26.355 INFO:tasks.workunit.client.1.smithi047.stdout:9/915: readlink d1/dc/d14/dd/d54/d50/d5b/d9e/l80 0 2024-09-13T22:56:26.356 INFO:tasks.workunit.client.0.smithi002.stdout:1/924: dread d1/d13/d30/fe7 [0,4194304] 0 2024-09-13T22:56:26.366 INFO:tasks.workunit.client.0.smithi002.stdout:5/880: truncate d1/d2a/d6b/d88/d45/d4f/d8f/f94 392867 0 2024-09-13T22:56:26.370 INFO:tasks.workunit.client.0.smithi002.stdout:4/817: sync 2024-09-13T22:56:26.370 INFO:tasks.workunit.client.0.smithi002.stdout:3/897: sync 2024-09-13T22:56:26.373 INFO:tasks.workunit.client.0.smithi002.stdout:0/846: mknod d1/d4/d75/d31/de0/d102/c130 0 2024-09-13T22:56:26.374 INFO:tasks.workunit.client.1.smithi047.stdout:4/988: dwrite dc/de/d23/d40/d7b/dab/feb [0,4194304] 0 2024-09-13T22:56:26.376 INFO:tasks.workunit.client.1.smithi047.stdout:3/953: mknod d0/d3/d4/d16/d32/d42/d79/d9c/dad/d34/c135 0 2024-09-13T22:56:26.383 INFO:tasks.workunit.client.1.smithi047.stdout:5/804: rename d19/d34/d42 to d19/d23/d2e/d41/d58/dfc 0 2024-09-13T22:56:26.384 INFO:tasks.workunit.client.0.smithi002.stdout:9/935: truncate d8/d10/d42/f7f 2294192 0 2024-09-13T22:56:26.385 INFO:tasks.workunit.client.1.smithi047.stdout:8/898: getdents d8/d6b/da9/dc3 0 2024-09-13T22:56:26.386 INFO:tasks.workunit.client.0.smithi002.stdout:6/887: rename d12/d17/c29 to d12/d17/d28/d67/dca/df9/c11c 0 2024-09-13T22:56:26.387 INFO:tasks.workunit.client.0.smithi002.stdout:7/851: write d8/d10/d39/d60/db8/d26/d4c/d81/f40 [3936794,5798] 0 2024-09-13T22:56:26.388 INFO:tasks.workunit.client.0.smithi002.stdout:6/888: dread - d12/d17/d28/d67/dca/f100 zero size 2024-09-13T22:56:26.389 INFO:tasks.workunit.client.1.smithi047.stdout:1/986: mkdir d0/d7/d14/df2/d11d 0 2024-09-13T22:56:26.389 INFO:tasks.workunit.client.1.smithi047.stdout:5/805: dwrite d19/f36 [0,4194304] 0 2024-09-13T22:56:26.391 INFO:tasks.workunit.client.1.smithi047.stdout:2/921: symlink d1/df/d1d/d20/d29/dcd/l135 0 2024-09-13T22:56:26.393 INFO:tasks.workunit.client.0.smithi002.stdout:5/881: fdatasync d1/f2f 0 2024-09-13T22:56:26.393 INFO:tasks.workunit.client.1.smithi047.stdout:2/922: chown d1/df/d1d/d20/d29/dcd/dff/db6 774791688 1 2024-09-13T22:56:26.399 INFO:tasks.workunit.client.1.smithi047.stdout:3/954: mknod d0/d3/d4/d16/d32/d42/d79/d9c/dad/d95/c136 0 2024-09-13T22:56:26.401 INFO:tasks.workunit.client.0.smithi002.stdout:8/884: mknod d3/dc/d16/d2f/c115 0 2024-09-13T22:56:26.406 INFO:tasks.workunit.client.1.smithi047.stdout:7/841: rename d0/d7/da/d4e/c9b to d0/d57/c11e 0 2024-09-13T22:56:26.409 INFO:tasks.workunit.client.0.smithi002.stdout:9/936: mkdir d8/d10/d1c/d68/d74/d137 0 2024-09-13T22:56:26.413 INFO:tasks.workunit.client.1.smithi047.stdout:4/989: write dc/de/d17/d25/d9b/fbf [957263,30065] 0 2024-09-13T22:56:26.414 INFO:tasks.workunit.client.0.smithi002.stdout:7/852: creat d8/d10/d39/d60/db8/d2e/d50/d52/dab/ffe x:0 0 0 2024-09-13T22:56:26.418 INFO:tasks.workunit.client.0.smithi002.stdout:0/847: dwrite d1/d4/d75/d31/f65 [0,4194304] 0 2024-09-13T22:56:26.419 INFO:tasks.workunit.client.0.smithi002.stdout:3/898: mknod d9/d3b/d53/d11f/c136 0 2024-09-13T22:56:26.420 INFO:tasks.workunit.client.0.smithi002.stdout:0/848: truncate d1/d4/d75/d31/f65 5200844 0 2024-09-13T22:56:26.423 INFO:tasks.workunit.client.0.smithi002.stdout:8/885: creat d3/dc/d18/d56/f116 x:0 0 0 2024-09-13T22:56:26.424 INFO:tasks.workunit.client.1.smithi047.stdout:9/916: unlink d1/dc/d14/dd/d54/d4e/d51/f5d 0 2024-09-13T22:56:26.424 INFO:tasks.workunit.client.1.smithi047.stdout:7/842: dread d0/f29 [0,4194304] 0 2024-09-13T22:56:26.425 INFO:tasks.workunit.client.1.smithi047.stdout:0/863: rename d1/d5/d16/d97/dfc/d2d/f5e to d1/d5/d16/df9/f11a 0 2024-09-13T22:56:26.428 INFO:tasks.workunit.client.0.smithi002.stdout:2/855: sync 2024-09-13T22:56:26.429 INFO:tasks.workunit.client.0.smithi002.stdout:7/853: symlink d8/d10/lff 0 2024-09-13T22:56:26.429 INFO:tasks.workunit.client.1.smithi047.stdout:5/806: mkdir d19/d23/d2e/d41/dc1/dfd 0 2024-09-13T22:56:26.429 INFO:tasks.workunit.client.1.smithi047.stdout:6/940: link d3/f8 d3/d11/d2b/d4c/dc0/d89/d8e/f13c 0 2024-09-13T22:56:26.429 INFO:tasks.workunit.client.1.smithi047.stdout:2/923: mkdir d1/df/d35/d8b/dd1/d123/d136 0 2024-09-13T22:56:26.429 INFO:tasks.workunit.client.1.smithi047.stdout:7/843: chown d0/d57/d5b/d5c 417702 1 2024-09-13T22:56:26.429 INFO:tasks.workunit.client.1.smithi047.stdout:6/941: readlink d3/d11/d2b/d4c/d9d/l12e 0 2024-09-13T22:56:26.434 INFO:tasks.workunit.client.0.smithi002.stdout:7/854: dwrite d8/d10/f1e [0,4194304] 0 2024-09-13T22:56:26.436 INFO:tasks.workunit.client.0.smithi002.stdout:0/849: creat d1/d7e/f131 x:0 0 0 2024-09-13T22:56:26.439 INFO:tasks.workunit.client.0.smithi002.stdout:4/818: link d3/d14/d29/d2a/f44 d3/d14/d29/d2a/da6/f108 0 2024-09-13T22:56:26.439 INFO:tasks.workunit.client.1.smithi047.stdout:3/955: dread d0/d3/d4/d16/d32/d42/f64 [0,4194304] 0 2024-09-13T22:56:26.440 INFO:tasks.workunit.client.0.smithi002.stdout:7/855: dread d8/d10/fe3 [0,4194304] 0 2024-09-13T22:56:26.441 INFO:tasks.workunit.client.0.smithi002.stdout:3/899: dread d9/d15/d36/d4e/d5e/f110 [0,4194304] 0 2024-09-13T22:56:26.441 INFO:tasks.workunit.client.0.smithi002.stdout:9/937: creat d8/d10/d1c/d3d/d11f/da3/db9/dfa/d87/da5/d120/f138 x:0 0 0 2024-09-13T22:56:26.444 INFO:tasks.workunit.client.0.smithi002.stdout:6/889: link l11 d12/d17/d28/d67/d6b/daa/l11d 0 2024-09-13T22:56:26.449 INFO:tasks.workunit.client.0.smithi002.stdout:0/850: creat d1/d4/d114/f132 x:0 0 0 2024-09-13T22:56:26.454 INFO:tasks.workunit.client.0.smithi002.stdout:8/886: dread d3/dc/f13 [0,4194304] 0 2024-09-13T22:56:26.456 INFO:tasks.workunit.client.0.smithi002.stdout:1/925: rename d1/d13/d30/d73/da1/d7d/df9/f11c to d1/d13/f141 0 2024-09-13T22:56:26.456 INFO:tasks.workunit.client.0.smithi002.stdout:7/856: dread d8/f27 [0,4194304] 0 2024-09-13T22:56:26.460 INFO:tasks.workunit.client.0.smithi002.stdout:3/900: unlink d9/d15/d36/d4e/d5e/dae/de6/f128 0 2024-09-13T22:56:26.464 INFO:tasks.workunit.client.0.smithi002.stdout:0/851: symlink d1/d4/d75/d31/de0/l133 0 2024-09-13T22:56:26.467 INFO:tasks.workunit.client.0.smithi002.stdout:9/938: truncate d8/fd7 1557132 0 2024-09-13T22:56:26.469 INFO:tasks.workunit.client.0.smithi002.stdout:8/887: creat d3/d27/f117 x:0 0 0 2024-09-13T22:56:26.473 INFO:tasks.workunit.client.0.smithi002.stdout:7/857: creat d8/d10/d39/d60/f100 x:0 0 0 2024-09-13T22:56:26.474 INFO:tasks.workunit.client.0.smithi002.stdout:8/888: dwrite d3/dc/d16/d4b/d72/d73/f9f [0,4194304] 0 2024-09-13T22:56:26.477 INFO:tasks.workunit.client.0.smithi002.stdout:7/858: dread d8/d10/f89 [0,4194304] 0 2024-09-13T22:56:26.480 INFO:tasks.workunit.client.0.smithi002.stdout:5/882: write d1/d2a/d6b/d88/d55/ffe [643863,117729] 0 2024-09-13T22:56:26.480 INFO:tasks.workunit.client.0.smithi002.stdout:7/859: chown d8/d10/d39/d60/db8/d26/d4c/d81/c22 14 1 2024-09-13T22:56:26.487 INFO:tasks.workunit.client.0.smithi002.stdout:6/890: rename d12/d17/c5b to d12/d17/ddf/d112/c11e 0 2024-09-13T22:56:26.487 INFO:tasks.workunit.client.0.smithi002.stdout:6/891: stat d12/f6a 0 2024-09-13T22:56:26.489 INFO:tasks.workunit.client.0.smithi002.stdout:1/926: rmdir d1/d13/d30/d73/da1/d9d/dbd/dd8 39 2024-09-13T22:56:26.493 INFO:tasks.workunit.client.0.smithi002.stdout:8/889: creat d3/dc/d16/d4b/f118 x:0 0 0 2024-09-13T22:56:26.493 INFO:tasks.workunit.client.0.smithi002.stdout:2/856: write d1/d32/d37/f45 [4914713,25377] 0 2024-09-13T22:56:26.495 INFO:tasks.workunit.client.0.smithi002.stdout:3/901: mknod d9/d3b/c137 0 2024-09-13T22:56:26.499 INFO:tasks.workunit.client.0.smithi002.stdout:2/857: dwrite d1/d7/d8/d2c/f4e [0,4194304] 0 2024-09-13T22:56:26.501 INFO:tasks.workunit.client.0.smithi002.stdout:4/819: getdents d3/d40/d45 0 2024-09-13T22:56:26.508 INFO:tasks.workunit.client.0.smithi002.stdout:7/860: symlink d8/d10/d39/d60/db8/d2e/d50/l101 0 2024-09-13T22:56:26.509 INFO:tasks.workunit.client.1.smithi047.stdout:7/844: rmdir d0/d7/da/d47 39 2024-09-13T22:56:26.512 INFO:tasks.workunit.client.1.smithi047.stdout:2/924: mknod d1/df/d1d/d20/d2b/c137 0 2024-09-13T22:56:26.515 INFO:tasks.workunit.client.0.smithi002.stdout:6/892: rmdir d12/d17/ddf 39 2024-09-13T22:56:26.517 INFO:tasks.workunit.client.1.smithi047.stdout:9/917: dread d1/f1a [0,4194304] 0 2024-09-13T22:56:26.519 INFO:tasks.workunit.client.1.smithi047.stdout:0/864: truncate d1/d5/d16/d97/dfc/d77/fa6 968074 0 2024-09-13T22:56:26.519 INFO:tasks.workunit.client.0.smithi002.stdout:0/852: write d1/d7e/fd3 [328174,11500] 0 2024-09-13T22:56:26.520 INFO:tasks.workunit.client.1.smithi047.stdout:0/865: write d1/d5/d11/f20 [1884682,96216] 0 2024-09-13T22:56:26.520 INFO:tasks.workunit.client.0.smithi002.stdout:8/890: mknod d3/dc/d16/d2f/db7/c119 0 2024-09-13T22:56:26.522 INFO:tasks.workunit.client.0.smithi002.stdout:9/939: write d8/d2c/dbc/dc8/fc0 [1543823,108036] 0 2024-09-13T22:56:26.524 INFO:tasks.workunit.client.0.smithi002.stdout:3/902: mknod d9/df/c138 0 2024-09-13T22:56:26.528 INFO:tasks.workunit.client.1.smithi047.stdout:6/942: symlink d3/d11/d2b/l13d 0 2024-09-13T22:56:26.529 INFO:tasks.workunit.client.0.smithi002.stdout:5/883: creat d1/d2a/d6b/d88/d55/d56/d81/f13f x:0 0 0 2024-09-13T22:56:26.529 INFO:tasks.workunit.client.1.smithi047.stdout:6/943: dread - d3/d11/d2b/d4c/d9d/dac/f11b zero size 2024-09-13T22:56:26.530 INFO:tasks.workunit.client.1.smithi047.stdout:6/944: dread - d3/d2c/d10b/d48/dd7/f137 zero size 2024-09-13T22:56:26.531 INFO:tasks.workunit.client.0.smithi002.stdout:7/861: creat d8/d10/d39/d60/db8/d2e/d50/d52/dab/dd9/f102 x:0 0 0 2024-09-13T22:56:26.532 INFO:tasks.workunit.client.0.smithi002.stdout:6/893: symlink d12/d17/d28/d67/d6b/l11f 0 2024-09-13T22:56:26.534 INFO:tasks.workunit.client.0.smithi002.stdout:1/927: mkdir d1/d13/d30/d142 0 2024-09-13T22:56:26.535 INFO:tasks.workunit.client.1.smithi047.stdout:0/866: mknod d1/ddb/c11b 0 2024-09-13T22:56:26.536 INFO:tasks.workunit.client.1.smithi047.stdout:3/956: mknod d0/d3/d4/d16/d32/d42/d79/c137 0 2024-09-13T22:56:26.536 INFO:tasks.workunit.client.0.smithi002.stdout:7/862: dwrite d8/d10/d39/d60/db8/d26/d4c/f4e [0,4194304] 0 2024-09-13T22:56:26.540 INFO:tasks.workunit.client.1.smithi047.stdout:1/987: rename d0/d7/d14/d57/l99 to d0/d7/d14/d57/d62/l11e 0 2024-09-13T22:56:26.543 INFO:tasks.workunit.client.0.smithi002.stdout:2/858: getdents d1/d7/d41/d96/dba/de3 0 2024-09-13T22:56:26.545 INFO:tasks.workunit.client.0.smithi002.stdout:3/903: symlink d9/d15/d36/d4e/d5e/dae/l139 0 2024-09-13T22:56:26.548 INFO:tasks.workunit.client.1.smithi047.stdout:9/918: creat d1/dc/d14/dd/d4c/df2/d132/f133 x:0 0 0 2024-09-13T22:56:26.549 INFO:tasks.workunit.client.1.smithi047.stdout:5/807: dwrite d19/d23/d2e/d41/d58/dfc/d5d/f8c [0,4194304] 0 2024-09-13T22:56:26.549 INFO:tasks.workunit.client.0.smithi002.stdout:4/820: mknod d3/d14/d29/c109 0 2024-09-13T22:56:26.551 INFO:tasks.workunit.client.1.smithi047.stdout:6/945: symlink d3/d11/d74/l13e 0 2024-09-13T22:56:26.553 INFO:tasks.workunit.client.0.smithi002.stdout:5/884: rmdir d1/d2a/d6b/d88/d45/d4f/d78/d8b/ddb 39 2024-09-13T22:56:26.554 INFO:tasks.workunit.client.0.smithi002.stdout:5/885: chown d1/d2a/d6b/d88/d45/d4f/d8f/fa9 0 1 2024-09-13T22:56:26.555 INFO:tasks.workunit.client.1.smithi047.stdout:2/925: write d1/df/d1d/d20/d54/f5c [5086614,10237] 0 2024-09-13T22:56:26.556 INFO:tasks.workunit.client.1.smithi047.stdout:0/867: symlink d1/d5/d11/d2f/l11c 0 2024-09-13T22:56:26.561 INFO:tasks.workunit.client.0.smithi002.stdout:0/853: creat d1/d7e/d9d/de6/df5/f134 x:0 0 0 2024-09-13T22:56:26.566 INFO:tasks.workunit.client.1.smithi047.stdout:9/919: chown d1/dc/d14/da5 51321315 1 2024-09-13T22:56:26.568 INFO:tasks.workunit.client.1.smithi047.stdout:7/845: truncate d0/db/fda 2322779 0 2024-09-13T22:56:26.568 INFO:tasks.workunit.client.1.smithi047.stdout:5/808: dread - d19/d83/fc6 zero size 2024-09-13T22:56:26.569 INFO:tasks.workunit.client.0.smithi002.stdout:8/891: dwrite d3/d21/d57/fc4 [0,4194304] 0 2024-09-13T22:56:26.570 INFO:tasks.workunit.client.1.smithi047.stdout:6/946: creat d3/d2c/d10b/f13f x:0 0 0 2024-09-13T22:56:26.571 INFO:tasks.workunit.client.1.smithi047.stdout:6/947: stat d3/d77/d8f/db9/f108 0 2024-09-13T22:56:26.583 INFO:tasks.workunit.client.1.smithi047.stdout:4/990: rename dc/de/c5a to dc/de/d17/d70/c14b 0 2024-09-13T22:56:26.583 INFO:tasks.workunit.client.1.smithi047.stdout:1/988: dwrite d0/d7/d14/d57/d62/d76/fc3 [0,4194304] 0 2024-09-13T22:56:26.585 INFO:tasks.workunit.client.0.smithi002.stdout:9/940: truncate d8/d10/d1c/f15 1462362 0 2024-09-13T22:56:26.586 INFO:tasks.workunit.client.1.smithi047.stdout:2/926: write d1/df/d1d/d20/d29/dcd/dff/f86 [4503263,52670] 0 2024-09-13T22:56:26.592 INFO:tasks.workunit.client.1.smithi047.stdout:1/989: dwrite d0/d1d/daa/df0/df1/f113 [0,4194304] 0 2024-09-13T22:56:26.593 INFO:tasks.workunit.client.1.smithi047.stdout:7/846: symlink d0/d7/da/d1e/de7/df4/l11f 0 2024-09-13T22:56:26.593 INFO:tasks.workunit.client.0.smithi002.stdout:3/904: dwrite d9/d15/d35/f52 [0,4194304] 0 2024-09-13T22:56:26.595 INFO:tasks.workunit.client.1.smithi047.stdout:7/847: read d0/d7/f3c [805884,3112] 0 2024-09-13T22:56:26.598 INFO:tasks.workunit.client.1.smithi047.stdout:5/809: write d19/d23/d2e/d41/d58/dfc/f48 [4939535,28722] 0 2024-09-13T22:56:26.601 INFO:tasks.workunit.client.0.smithi002.stdout:1/928: mkdir d1/d13/d30/d73/da1/d7d/dce/d116/d143 0 2024-09-13T22:56:26.605 INFO:tasks.workunit.client.1.smithi047.stdout:6/948: creat d3/d11/d2b/d1c/d134/f140 x:0 0 0 2024-09-13T22:56:26.610 INFO:tasks.workunit.client.1.smithi047.stdout:9/920: dwrite d1/dc/d14/dd/d54/d8d/ff5 [0,4194304] 0 2024-09-13T22:56:26.612 INFO:tasks.workunit.client.1.smithi047.stdout:0/868: truncate d1/d5/d16/d47/f4d 3664823 0 2024-09-13T22:56:26.612 INFO:tasks.workunit.client.1.smithi047.stdout:9/921: chown d1/dc/d14/dd/d54/d8d/fd9 352 1 2024-09-13T22:56:26.613 INFO:tasks.workunit.client.0.smithi002.stdout:8/892: read d3/d21/f58 [3610740,5898] 0 2024-09-13T22:56:26.614 INFO:tasks.workunit.client.0.smithi002.stdout:2/859: mkdir d1/d7/d35/d78/dfc/d87/d111/d122 0 2024-09-13T22:56:26.617 INFO:tasks.workunit.client.0.smithi002.stdout:4/821: symlink d3/d14/d29/l10a 0 2024-09-13T22:56:26.621 INFO:tasks.workunit.client.1.smithi047.stdout:9/922: dread d1/dc/f11e [0,4194304] 0 2024-09-13T22:56:26.624 INFO:tasks.workunit.client.0.smithi002.stdout:6/894: link d12/d17/d34/fe9 d12/d17/d28/d67/d6b/f120 0 2024-09-13T22:56:26.625 INFO:tasks.workunit.client.0.smithi002.stdout:1/929: dread d1/f27 [0,4194304] 0 2024-09-13T22:56:26.632 INFO:tasks.workunit.client.0.smithi002.stdout:3/905: rename d9/d15/d46/l118 to d9/d15/d36/d4e/d5e/dae/d89/l13a 0 2024-09-13T22:56:26.633 INFO:tasks.workunit.client.0.smithi002.stdout:4/822: dread d3/d14/d85/f8d [0,4194304] 0 2024-09-13T22:56:26.633 INFO:tasks.workunit.client.1.smithi047.stdout:2/927: write d1/de/fe4 [700754,27020] 0 2024-09-13T22:56:26.634 INFO:tasks.workunit.client.0.smithi002.stdout:9/941: write d8/d10/d1c/f19 [2022897,119785] 0 2024-09-13T22:56:26.635 INFO:tasks.workunit.client.0.smithi002.stdout:2/860: dread d1/d7/d35/d78/dfc/d6b/d75/f91 [0,4194304] 0 2024-09-13T22:56:26.638 INFO:tasks.workunit.client.1.smithi047.stdout:3/957: getdents d0/d3/d4/d16/d32/d42/d79/dba 0 2024-09-13T22:56:26.639 INFO:tasks.workunit.client.1.smithi047.stdout:4/991: dwrite dc/de/d23/dc4/fbb [0,4194304] 0 2024-09-13T22:56:26.639 INFO:tasks.workunit.client.1.smithi047.stdout:1/990: dwrite d0/d7/db/d101/f43 [0,4194304] 0 2024-09-13T22:56:26.639 INFO:tasks.workunit.client.0.smithi002.stdout:8/893: dread - d3/dc/d16/d2f/d83/f9b zero size 2024-09-13T22:56:26.641 INFO:tasks.workunit.client.0.smithi002.stdout:2/861: dwrite d1/d7/d8/d2c/da4/fc0 [0,4194304] 0 2024-09-13T22:56:26.654 INFO:tasks.workunit.client.1.smithi047.stdout:6/949: rename d3/d11/d2b/d1c/d23/f39 to d3/d11/d2b/d1c/dca/df8/f141 0 2024-09-13T22:56:26.658 INFO:tasks.workunit.client.0.smithi002.stdout:3/906: rename d9/df/c82 to d9/d3b/d53/d11f/c13b 0 2024-09-13T22:56:26.658 INFO:tasks.workunit.client.0.smithi002.stdout:3/907: chown d9/dd1/c10a 51413642 1 2024-09-13T22:56:26.660 INFO:tasks.workunit.client.1.smithi047.stdout:2/928: unlink d1/df/d35/dd7/dca/df5/f10a 0 2024-09-13T22:56:26.661 INFO:tasks.workunit.client.0.smithi002.stdout:7/863: getdents d8/d10/d39/d60/db8/d2e/d50/d52/d99 0 2024-09-13T22:56:26.661 INFO:tasks.workunit.client.0.smithi002.stdout:4/823: read d3/fac [1206110,45239] 0 2024-09-13T22:56:26.663 INFO:tasks.workunit.client.0.smithi002.stdout:4/824: chown d3/d14/d86/db1/dfb/f106 23 1 2024-09-13T22:56:26.667 INFO:tasks.workunit.client.0.smithi002.stdout:8/894: creat d3/dc/d16/d2f/d83/d85/dc8/f11a x:0 0 0 2024-09-13T22:56:26.669 INFO:tasks.workunit.client.1.smithi047.stdout:7/848: link d0/d7/da/d2e/db5/c88 d0/d7/da/d4e/dd1/c120 0 2024-09-13T22:56:26.669 INFO:tasks.workunit.client.1.smithi047.stdout:4/992: dread dc/d29/d4d/fb4 [0,4194304] 0 2024-09-13T22:56:26.671 INFO:tasks.workunit.client.0.smithi002.stdout:2/862: mknod d1/d7/d8/d2c/c123 0 2024-09-13T22:56:26.671 INFO:tasks.workunit.client.0.smithi002.stdout:2/863: write d1/f14 [4939467,114712] 0 2024-09-13T22:56:26.673 INFO:tasks.workunit.client.0.smithi002.stdout:2/864: readlink d1/d7/d35/d78/dfc/d6b/l6e 0 2024-09-13T22:56:26.673 INFO:tasks.workunit.client.1.smithi047.stdout:0/869: rename d1/f36 to d1/d5/d16/d97/dfc/d45/d7f/f11d 0 2024-09-13T22:56:26.674 INFO:tasks.workunit.client.0.smithi002.stdout:2/865: readlink d1/d7/d35/d78/lca 0 2024-09-13T22:56:26.675 INFO:tasks.workunit.client.1.smithi047.stdout:0/870: chown d1/d5/d16/d97/db6/c116 36 1 2024-09-13T22:56:26.675 INFO:tasks.workunit.client.1.smithi047.stdout:0/871: write d1/f69 [3950104,68968] 0 2024-09-13T22:56:26.676 INFO:tasks.workunit.client.1.smithi047.stdout:4/993: dread dc/de/d23/d40/d7b/dab/dae/fd5 [0,4194304] 0 2024-09-13T22:56:26.677 INFO:tasks.workunit.client.1.smithi047.stdout:6/950: mkdir d3/d11/d2b/d4c/dc0/d89/d142 0 2024-09-13T22:56:26.678 INFO:tasks.workunit.client.0.smithi002.stdout:9/942: dwrite d8/d10/d1c/d3d/d11f/fee [0,4194304] 0 2024-09-13T22:56:26.678 INFO:tasks.workunit.client.0.smithi002.stdout:9/943: chown d8/fbe 22 1 2024-09-13T22:56:26.682 INFO:tasks.workunit.client.1.smithi047.stdout:7/849: symlink d0/d7/dc5/l121 0 2024-09-13T22:56:26.683 INFO:tasks.workunit.client.1.smithi047.stdout:3/958: dwrite d0/d3/d4/d16/d2c/de/f80 [0,4194304] 0 2024-09-13T22:56:26.684 INFO:tasks.workunit.client.0.smithi002.stdout:0/854: getdents d1/d4/da3 0 2024-09-13T22:56:26.684 INFO:tasks.workunit.client.1.smithi047.stdout:7/850: dread - d0/d7/da/d4e/dd1/feb zero size 2024-09-13T22:56:26.691 INFO:tasks.workunit.client.0.smithi002.stdout:7/864: unlink d8/d10/d39/d60/db8/d2e/d3c/d3e/lad 0 2024-09-13T22:56:26.692 INFO:tasks.workunit.client.0.smithi002.stdout:7/865: readlink d8/d10/d39/d60/db8/l18 0 2024-09-13T22:56:26.695 INFO:tasks.workunit.client.0.smithi002.stdout:1/930: write d1/d13/f97 [1150699,63893] 0 2024-09-13T22:56:26.697 INFO:tasks.workunit.client.0.smithi002.stdout:8/895: mknod d3/dc/d16/c11b 0 2024-09-13T22:56:26.701 INFO:tasks.workunit.client.1.smithi047.stdout:6/951: creat d3/d11/d74/f143 x:0 0 0 2024-09-13T22:56:26.702 INFO:tasks.workunit.client.1.smithi047.stdout:0/872: write d1/d5/d11/d52/f8e [2013254,31339] 0 2024-09-13T22:56:26.704 INFO:tasks.workunit.client.0.smithi002.stdout:5/886: rmdir d1/d57/dd0/df7/d122 0 2024-09-13T22:56:26.704 INFO:tasks.workunit.client.0.smithi002.stdout:8/896: dwrite d3/dc/fa2 [0,4194304] 0 2024-09-13T22:56:26.706 INFO:tasks.workunit.client.1.smithi047.stdout:3/959: creat d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/d128/f138 x:0 0 0 2024-09-13T22:56:26.706 INFO:tasks.workunit.client.0.smithi002.stdout:8/897: write d3/dc/d18/d2e/f6b [3905496,7689] 0 2024-09-13T22:56:26.712 INFO:tasks.workunit.client.0.smithi002.stdout:7/866: creat d8/d10/f103 x:0 0 0 2024-09-13T22:56:26.713 INFO:tasks.workunit.client.1.smithi047.stdout:1/991: link d0/d7/d14/l40 d0/d7/d13/d5d/d89/l11f 0 2024-09-13T22:56:26.714 INFO:tasks.workunit.client.1.smithi047.stdout:1/992: chown d0/d7/db/c9d 123437960 1 2024-09-13T22:56:26.714 INFO:tasks.workunit.client.0.smithi002.stdout:4/825: mknod d3/db3/db9/dff/c10b 0 2024-09-13T22:56:26.719 INFO:tasks.workunit.client.0.smithi002.stdout:7/867: dwrite d8/d10/d39/d60/db8/d26/d4c/f4e [4194304,4194304] 0 2024-09-13T22:56:26.720 INFO:tasks.workunit.client.1.smithi047.stdout:0/873: mkdir d1/d5/d16/d97/de4/d11e 0 2024-09-13T22:56:26.720 INFO:tasks.workunit.client.1.smithi047.stdout:0/874: fdatasync d1/d7/dc9/f10c 0 2024-09-13T22:56:26.721 INFO:tasks.workunit.client.0.smithi002.stdout:7/868: dread - d8/d10/d39/d60/db8/d2e/d3c/dcf/fe4 zero size 2024-09-13T22:56:26.721 INFO:tasks.workunit.client.0.smithi002.stdout:7/869: chown d8/d10/d39/lc5 1 1 2024-09-13T22:56:26.722 INFO:tasks.workunit.client.1.smithi047.stdout:3/960: fsync d0/d3/d4/d16/d2c/de/dcc/dd1/dc4/fd7 0 2024-09-13T22:56:26.723 INFO:tasks.workunit.client.0.smithi002.stdout:7/870: stat d8/d10/d39/d60/db8/d26/d4c/f4e 0 2024-09-13T22:56:26.725 INFO:tasks.workunit.client.1.smithi047.stdout:9/923: rename d1/dc/d14/dd/d54/d50/d91/lbe to d1/dc/d14/dd/d54/l134 0 2024-09-13T22:56:26.728 INFO:tasks.workunit.client.1.smithi047.stdout:0/875: dwrite d1/d5/d11/d52/f8e [0,4194304] 0 2024-09-13T22:56:26.728 INFO:tasks.workunit.client.0.smithi002.stdout:3/908: dwrite d9/d15/d36/d4e/f8b [0,4194304] 0 2024-09-13T22:56:26.729 INFO:tasks.workunit.client.1.smithi047.stdout:1/993: creat d0/d7/d87/f120 x:0 0 0 2024-09-13T22:56:26.734 INFO:tasks.workunit.client.1.smithi047.stdout:7/851: creat d0/d7/da/d2e/f122 x:0 0 0 2024-09-13T22:56:26.736 INFO:tasks.workunit.client.1.smithi047.stdout:7/852: stat d0/d7/da/d1e/d51/fbb 0 2024-09-13T22:56:26.736 INFO:tasks.workunit.client.1.smithi047.stdout:6/952: dread d3/d11/d2b/d4c/dc0/d89/fed [0,4194304] 0 2024-09-13T22:56:26.738 INFO:tasks.workunit.client.1.smithi047.stdout:3/961: fsync d0/d3/d4/d16/d2c/de/d1f/faf 0 2024-09-13T22:56:26.740 INFO:tasks.workunit.client.1.smithi047.stdout:4/994: getdents dc/de/d23/ddf/d14a 0 2024-09-13T22:56:26.742 INFO:tasks.workunit.client.1.smithi047.stdout:4/995: chown dc/de/d23/dc4/ddb/fdc 42 1 2024-09-13T22:56:26.743 INFO:tasks.workunit.client.1.smithi047.stdout:4/996: chown dc/de/d23/f83 370121 1 2024-09-13T22:56:26.743 INFO:tasks.workunit.client.0.smithi002.stdout:1/931: creat d1/d13/d21/d39/df7/dcf/d138/f144 x:0 0 0 2024-09-13T22:56:26.744 INFO:tasks.workunit.client.0.smithi002.stdout:1/932: write d1/d13/d30/f2f [4483710,120012] 0 2024-09-13T22:56:26.745 INFO:tasks.workunit.client.1.smithi047.stdout:9/924: creat d1/dc/d14/dd/d54/d50/d5b/d9e/f135 x:0 0 0 2024-09-13T22:56:26.749 INFO:tasks.workunit.client.0.smithi002.stdout:1/933: dwrite d1/d13/d21/d39/d70/d10c/fa8 [0,4194304] 0 2024-09-13T22:56:26.750 INFO:tasks.workunit.client.0.smithi002.stdout:0/855: write d1/d4/f24 [1915963,54987] 0 2024-09-13T22:56:26.750 INFO:tasks.workunit.client.1.smithi047.stdout:0/876: dread d1/d5/d11/d2f/fb0 [0,4194304] 0 2024-09-13T22:56:26.751 INFO:tasks.workunit.client.0.smithi002.stdout:0/856: write d1/d2/f56 [7370892,722] 0 2024-09-13T22:56:26.756 INFO:tasks.workunit.client.1.smithi047.stdout:7/853: read d0/d19/f7c [1067897,14956] 0 2024-09-13T22:56:26.756 INFO:tasks.workunit.client.0.smithi002.stdout:1/934: dread d1/d13/d21/d39/d70/d10c/d3b/d71/d80/d112/f10b [0,4194304] 0 2024-09-13T22:56:26.757 INFO:tasks.workunit.client.0.smithi002.stdout:8/898: truncate d3/dc/d18/f67 448441 0 2024-09-13T22:56:26.759 INFO:tasks.workunit.client.0.smithi002.stdout:3/909: mknod d9/d3b/d53/d95/c13c 0 2024-09-13T22:56:26.760 INFO:tasks.workunit.client.0.smithi002.stdout:3/910: write d9/d7e/daf/f103 [804065,107517] 0 2024-09-13T22:56:26.761 INFO:tasks.workunit.client.1.smithi047.stdout:6/953: creat d3/d11/d2b/d1c/dca/df8/f144 x:0 0 0 2024-09-13T22:56:26.762 INFO:tasks.workunit.client.0.smithi002.stdout:9/944: rmdir d8/d10/d1c/dbf/d11b 0 2024-09-13T22:56:26.763 INFO:tasks.workunit.client.1.smithi047.stdout:1/994: dwrite d0/d7/d14/d28/d36/f32 [0,4194304] 0 2024-09-13T22:56:26.763 INFO:tasks.workunit.client.0.smithi002.stdout:9/945: fsync d8/d10/d1c/d68/fe7 0 2024-09-13T22:56:26.764 INFO:tasks.workunit.client.1.smithi047.stdout:3/962: symlink d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d85/l139 0 2024-09-13T22:56:26.765 INFO:tasks.workunit.client.1.smithi047.stdout:1/995: write d0/d7/d14/d57/f9e [188403,99072] 0 2024-09-13T22:56:26.768 INFO:tasks.workunit.client.1.smithi047.stdout:4/997: creat dc/de/d23/dc4/dc8/dc9/f14c x:0 0 0 2024-09-13T22:56:26.768 INFO:tasks.workunit.client.0.smithi002.stdout:2/866: getdents d1/d7/d8/d2c/d9d/dfb 0 2024-09-13T22:56:26.769 INFO:tasks.workunit.client.1.smithi047.stdout:4/998: stat dc/de/d23/dc4/ddb/cff 0 2024-09-13T22:56:26.770 INFO:tasks.workunit.client.0.smithi002.stdout:5/887: creat d1/d2a/d6b/d88/d55/d56/f140 x:0 0 0 2024-09-13T22:56:26.775 INFO:tasks.workunit.client.1.smithi047.stdout:7/854: fdatasync d0/d7/da/d1e/f68 0 2024-09-13T22:56:26.775 INFO:tasks.workunit.client.0.smithi002.stdout:2/867: dwrite d1/d32/d37/f73 [0,4194304] 0 2024-09-13T22:56:26.777 INFO:tasks.workunit.client.0.smithi002.stdout:2/868: write d1/d7/d35/d78/dfc/d6b/f104 [1815241,109683] 0 2024-09-13T22:56:26.778 INFO:tasks.workunit.client.0.smithi002.stdout:7/871: link d8/d10/d39/d60/db8/d2e/d3c/f59 d8/d10/d11/d3a/f104 0 2024-09-13T22:56:26.778 INFO:tasks.workunit.client.1.smithi047.stdout:4/999: dwrite dc/de/d23/d40/fd4 [0,4194304] 0 2024-09-13T22:56:26.779 INFO:tasks.workunit.client.0.smithi002.stdout:7/872: dread - d8/d10/d39/d60/fd2 zero size 2024-09-13T22:56:26.784 INFO:tasks.workunit.client.1.smithi047.stdout:6/954: mkdir d3/d11/d2b/d1c/d4d/d69/dc2/d145 0 2024-09-13T22:56:26.785 INFO:tasks.workunit.client.1.smithi047.stdout:9/925: write d1/dc/d14/dd/d54/d50/d60/fb1 [4348405,30843] 0 2024-09-13T22:56:26.791 INFO:tasks.workunit.client.1.smithi047.stdout:1/996: creat d0/d7/dd3/f121 x:0 0 0 2024-09-13T22:56:26.792 INFO:tasks.workunit.client.0.smithi002.stdout:3/911: dread - d9/d15/d35/ff4 zero size 2024-09-13T22:56:26.794 INFO:tasks.workunit.client.0.smithi002.stdout:9/946: creat d8/d10/d1c/d3d/d11f/da3/db9/dfa/d87/da5/d94/deb/f139 x:0 0 0 2024-09-13T22:56:26.795 INFO:tasks.workunit.client.0.smithi002.stdout:4/826: creat d3/d40/f10c x:0 0 0 2024-09-13T22:56:26.799 INFO:tasks.workunit.client.1.smithi047.stdout:6/955: truncate d3/d77/fa9 1677245 0 2024-09-13T22:56:26.801 INFO:tasks.workunit.client.1.smithi047.stdout:9/926: symlink d1/dc/d14/dd/d54/d8d/dbc/l136 0 2024-09-13T22:56:26.802 INFO:tasks.workunit.client.1.smithi047.stdout:1/997: fdatasync d0/d7/f4e 0 2024-09-13T22:56:26.803 INFO:tasks.workunit.client.1.smithi047.stdout:7/855: dread d0/d57/d5b/fb4 [0,4194304] 0 2024-09-13T22:56:26.805 INFO:tasks.workunit.client.0.smithi002.stdout:7/873: unlink d8/d10/d39/d60/c6a 0 2024-09-13T22:56:26.807 INFO:tasks.workunit.client.1.smithi047.stdout:3/963: creat d0/d3/d4/d16/d32/d42/d79/dba/d125/f13a x:0 0 0 2024-09-13T22:56:26.807 INFO:tasks.workunit.client.0.smithi002.stdout:8/899: dread d3/dc/d18/d2e/d94/f88 [0,4194304] 0 2024-09-13T22:56:26.809 INFO:tasks.workunit.client.1.smithi047.stdout:0/877: rename d1/d5/d16/d97/dfc/d2d/c9f to d1/d5/d16/d97/dfc/c11f 0 2024-09-13T22:56:26.813 INFO:tasks.workunit.client.1.smithi047.stdout:1/998: dwrite d0/d7/d14/d57/d62/d76/fc3 [0,4194304] 0 2024-09-13T22:56:26.813 INFO:tasks.workunit.client.1.smithi047.stdout:0/878: fsync d1/d5/d16/d97/db6/f10d 0 2024-09-13T22:56:26.814 INFO:tasks.workunit.client.1.smithi047.stdout:7/856: dwrite d0/d7/f3e [0,4194304] 0 2024-09-13T22:56:26.815 INFO:tasks.workunit.client.0.smithi002.stdout:7/874: dwrite d8/d10/d39/d60/db8/d26/d4c/d81/db6/fe2 [0,4194304] 0 2024-09-13T22:56:26.815 INFO:tasks.workunit.client.0.smithi002.stdout:5/888: dread d1/d2a/d5a/fd2 [0,4194304] 0 2024-09-13T22:56:26.818 INFO:tasks.workunit.client.0.smithi002.stdout:7/875: chown d8/d10/d39/d60/db8/d2e/d50/d52/d72/lfd 2 1 2024-09-13T22:56:26.818 INFO:tasks.workunit.client.0.smithi002.stdout:5/889: chown d1/d2a/d6b/d88/d45/d4f/db7/lcc 46 1 2024-09-13T22:56:26.818 INFO:tasks.workunit.client.1.smithi047.stdout:0/879: dread - d1/d5/d16/d97/db6/f10d zero size 2024-09-13T22:56:26.820 INFO:tasks.workunit.client.0.smithi002.stdout:5/890: chown d1/d2a/d6b/d88/d55/d56/de4/f121 167398 1 2024-09-13T22:56:26.822 INFO:tasks.workunit.client.1.smithi047.stdout:3/964: dwrite d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/f106 [0,4194304] 0 2024-09-13T22:56:26.836 INFO:tasks.workunit.client.1.smithi047.stdout:6/956: write d3/d11/d2b/d1c/fce [149048,63232] 0 2024-09-13T22:56:26.838 INFO:tasks.workunit.client.1.smithi047.stdout:1/999: fdatasync d0/d7/d13/f3c 0 2024-09-13T22:56:26.839 INFO:tasks.workunit.client.1.smithi047.stdout:9/927: mknod d1/d131/c137 0 2024-09-13T22:56:26.845 INFO:tasks.workunit.client.1.smithi047.stdout:3/965: truncate d0/d3/d4/d16/f94 1972604 0 2024-09-13T22:56:26.846 INFO:tasks.workunit.client.1.smithi047.stdout:3/966: chown d0/d3/d4/d16/d32/d42/d79/d9c/fce 4428 1 2024-09-13T22:56:26.847 INFO:tasks.workunit.client.1.smithi047.stdout:6/957: chown d3/d11/d2b/d4c/d9d/dac/ld6 231481 1 2024-09-13T22:56:26.860 INFO:tasks.workunit.client.1.smithi047.stdout:6/958: unlink d3/d11/d2b/d1c/d4d/d69/f6d 0 2024-09-13T22:56:26.862 INFO:tasks.workunit.client.1.smithi047.stdout:7/857: dwrite d0/f1f [0,4194304] 0 2024-09-13T22:56:26.863 INFO:tasks.workunit.client.1.smithi047.stdout:9/928: rename d1/dc/d14/dd/d54/d50/d91/lc4 to d1/dc/d14/dd/d54/d4e/d51/d79/d113/l138 0 2024-09-13T22:56:26.866 INFO:tasks.workunit.client.1.smithi047.stdout:8/899: sync 2024-09-13T22:56:26.866 INFO:tasks.workunit.client.1.smithi047.stdout:5/810: sync 2024-09-13T22:56:26.866 INFO:tasks.workunit.client.1.smithi047.stdout:2/929: sync 2024-09-13T22:56:26.869 INFO:tasks.workunit.client.1.smithi047.stdout:6/959: dwrite d3/d11/d2b/d1c/dca/fd5 [0,4194304] 0 2024-09-13T22:56:26.878 INFO:tasks.workunit.client.1.smithi047.stdout:5/811: dwrite d19/d23/d2e/d41/d58/d77/fe8 [0,4194304] 0 2024-09-13T22:56:26.887 INFO:tasks.workunit.client.1.smithi047.stdout:0/880: dwrite d1/d5/d16/df9/f11a [0,4194304] 0 2024-09-13T22:56:26.891 INFO:tasks.workunit.client.1.smithi047.stdout:3/967: dwrite d0/d3/d4/d16/d73/d86/f99 [0,4194304] 0 2024-09-13T22:56:26.891 INFO:tasks.workunit.client.1.smithi047.stdout:2/930: dread d1/f2a [0,4194304] 0 2024-09-13T22:56:26.895 INFO:tasks.workunit.client.1.smithi047.stdout:3/968: truncate d0/d3/d4/d91/d8d/d11a/f134 929323 0 2024-09-13T22:56:26.898 INFO:tasks.workunit.client.1.smithi047.stdout:3/969: chown d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d103 5 1 2024-09-13T22:56:26.900 INFO:tasks.workunit.client.1.smithi047.stdout:3/970: write d0/d3/d4/d16/d2c/de/f126 [2524053,98381] 0 2024-09-13T22:56:26.916 INFO:tasks.workunit.client.1.smithi047.stdout:7/858: dwrite d0/d57/d5b/fb4 [0,4194304] 0 2024-09-13T22:56:26.916 INFO:tasks.workunit.client.1.smithi047.stdout:5/812: dwrite d19/d25/f38 [4194304,4194304] 0 2024-09-13T22:56:26.917 INFO:tasks.workunit.client.1.smithi047.stdout:9/929: dwrite d1/dc/d14/dd/d54/d50/d91/ff1 [4194304,4194304] 0 2024-09-13T22:56:26.919 INFO:tasks.workunit.client.1.smithi047.stdout:5/813: stat d19/d23/d2e/d41/d58/dfc/d5d/d9d/cb0 0 2024-09-13T22:56:26.921 INFO:tasks.workunit.client.1.smithi047.stdout:6/960: fdatasync d3/d11/d2b/d1c/d4d/d69/dc2/dcd/fd1 0 2024-09-13T22:56:26.930 INFO:tasks.workunit.client.0.smithi002.stdout:3/912: creat d9/d15/d36/d4e/d5e/dae/d89/f13d x:0 0 0 2024-09-13T22:56:26.930 INFO:tasks.workunit.client.0.smithi002.stdout:9/947: dread - d8/d2c/dbc/fe9 zero size 2024-09-13T22:56:26.932 INFO:tasks.workunit.client.1.smithi047.stdout:2/931: dwrite d1/df/d35/f78 [0,4194304] 0 2024-09-13T22:56:26.933 INFO:tasks.workunit.client.0.smithi002.stdout:2/869: link d1/f14 d1/f124 0 2024-09-13T22:56:26.936 INFO:tasks.workunit.client.0.smithi002.stdout:3/913: dwrite d9/d7e/daf/f103 [0,4194304] 0 2024-09-13T22:56:26.937 INFO:tasks.workunit.client.0.smithi002.stdout:3/914: chown d9/d15/d51/d107 5909054 1 2024-09-13T22:56:26.939 INFO:tasks.workunit.client.1.smithi047.stdout:9/930: creat d1/d5f/d6a/f139 x:0 0 0 2024-09-13T22:56:26.947 INFO:tasks.workunit.client.1.smithi047.stdout:6/961: unlink d3/d11/d2b/d4c/c41 0 2024-09-13T22:56:26.950 INFO:tasks.workunit.client.0.smithi002.stdout:9/948: unlink d8/d10/d61/f6b 0 2024-09-13T22:56:26.951 INFO:tasks.workunit.client.1.smithi047.stdout:0/881: link d1/d7/l68 d1/d5/d16/d47/l120 0 2024-09-13T22:56:26.951 INFO:tasks.workunit.client.0.smithi002.stdout:9/949: write d8/d1e/f34 [1619715,130042] 0 2024-09-13T22:56:26.951 INFO:tasks.workunit.client.1.smithi047.stdout:0/882: stat d1/d5/f74 0 2024-09-13T22:56:26.953 INFO:tasks.workunit.client.0.smithi002.stdout:0/857: sync 2024-09-13T22:56:26.953 INFO:tasks.workunit.client.0.smithi002.stdout:6/895: sync 2024-09-13T22:56:26.953 INFO:tasks.workunit.client.0.smithi002.stdout:1/935: rename d1/d13/d1d/d34/c13e to d1/d13/d30/c145 0 2024-09-13T22:56:26.954 INFO:tasks.workunit.client.1.smithi047.stdout:5/814: write d19/d23/d4c/fb3 [477955,5372] 0 2024-09-13T22:56:26.955 INFO:tasks.workunit.client.0.smithi002.stdout:5/891: write d1/d2a/d6b/ff8 [354195,28378] 0 2024-09-13T22:56:26.958 INFO:tasks.workunit.client.0.smithi002.stdout:3/915: dread - d9/d91/f132 zero size 2024-09-13T22:56:26.961 INFO:tasks.workunit.client.1.smithi047.stdout:7/859: unlink d0/d7/f87 0 2024-09-13T22:56:26.962 INFO:tasks.workunit.client.1.smithi047.stdout:7/860: chown d0/d7/da/d4e/l8f 767050969 1 2024-09-13T22:56:26.963 INFO:tasks.workunit.client.1.smithi047.stdout:7/861: readlink d0/l107 0 2024-09-13T22:56:26.963 INFO:tasks.workunit.client.0.smithi002.stdout:7/876: mknod d8/d10/d39/d60/db8/d26/d4c/c105 0 2024-09-13T22:56:26.963 INFO:tasks.workunit.client.1.smithi047.stdout:8/900: write d8/d64/d4e/d4d/d8f/d91/d38/f44 [714006,8186] 0 2024-09-13T22:56:26.964 INFO:tasks.workunit.client.1.smithi047.stdout:9/931: creat d1/d5f/d6a/f13a x:0 0 0 2024-09-13T22:56:26.967 INFO:tasks.workunit.client.0.smithi002.stdout:9/950: creat d8/d2c/dbc/dc8/dd0/f13a x:0 0 0 2024-09-13T22:56:26.967 INFO:tasks.workunit.client.0.smithi002.stdout:7/877: dread d8/d10/d39/d60/db8/d26/d4c/d81/d51/f66 [0,4194304] 0 2024-09-13T22:56:26.968 INFO:tasks.workunit.client.0.smithi002.stdout:9/951: chown d8/d10/dc4/dde/d12a 7 1 2024-09-13T22:56:26.969 INFO:tasks.workunit.client.1.smithi047.stdout:6/962: dread d3/ff [0,4194304] 0 2024-09-13T22:56:26.970 INFO:tasks.workunit.client.1.smithi047.stdout:3/971: rename d0/d3/d4/d16/d32/d42/d79/d9c/d11c/c10e to d0/d3/d4/d16/c13b 0 2024-09-13T22:56:26.970 INFO:tasks.workunit.client.0.smithi002.stdout:6/896: chown d12/d17/ddf/fda 252357 1 2024-09-13T22:56:26.971 INFO:tasks.workunit.client.1.smithi047.stdout:0/883: dread - d1/d5/d11/d52/fe8 zero size 2024-09-13T22:56:26.973 INFO:tasks.workunit.client.0.smithi002.stdout:1/936: dread d1/d13/f32 [0,4194304] 0 2024-09-13T22:56:26.974 INFO:tasks.workunit.client.0.smithi002.stdout:1/937: chown d1/d13/d30/d73/lb4 477011 1 2024-09-13T22:56:26.975 INFO:tasks.workunit.client.0.smithi002.stdout:4/827: rename d3/d14/d85 to d3/d14/d86/db1/dfb/d10d 0 2024-09-13T22:56:26.977 INFO:tasks.workunit.client.0.smithi002.stdout:2/870: mknod d1/d7/d8/d2c/d9d/dab/dd4/c125 0 2024-09-13T22:56:26.977 INFO:tasks.workunit.client.0.smithi002.stdout:4/828: truncate d3/d14/d29/d2a/da6/d69/d7e/ffc 684502 0 2024-09-13T22:56:26.979 INFO:tasks.workunit.client.0.smithi002.stdout:3/916: fdatasync d9/fd 0 2024-09-13T22:56:26.981 INFO:tasks.workunit.client.0.smithi002.stdout:2/871: read d1/d7/d35/d78/dfc/d6b/f104 [2107557,66005] 0 2024-09-13T22:56:26.981 INFO:tasks.workunit.client.0.smithi002.stdout:0/858: dread d1/f6f [0,4194304] 0 2024-09-13T22:56:26.984 INFO:tasks.workunit.client.1.smithi047.stdout:5/815: write d19/d25/d45/f4e [3877237,21225] 0 2024-09-13T22:56:26.990 INFO:tasks.workunit.client.1.smithi047.stdout:6/963: creat d3/d77/d8f/f146 x:0 0 0 2024-09-13T22:56:26.991 INFO:tasks.workunit.client.0.smithi002.stdout:8/900: write d3/dc/d16/d4b/fb3 [590521,74081] 0 2024-09-13T22:56:26.992 INFO:tasks.workunit.client.1.smithi047.stdout:3/972: rmdir d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44 39 2024-09-13T22:56:26.994 INFO:tasks.workunit.client.0.smithi002.stdout:9/952: creat d8/d10/d1c/dd6/dda/f13b x:0 0 0 2024-09-13T22:56:26.994 INFO:tasks.workunit.client.1.smithi047.stdout:2/932: dwrite d1/de/d17/fea [0,4194304] 0 2024-09-13T22:56:26.995 INFO:tasks.workunit.client.0.smithi002.stdout:9/953: fsync d8/d10/d1c/f2b 0 2024-09-13T22:56:26.996 INFO:tasks.workunit.client.0.smithi002.stdout:6/897: rmdir d12/d17/d34/d39/d8a/de4 39 2024-09-13T22:56:26.997 INFO:tasks.workunit.client.0.smithi002.stdout:6/898: readlink d12/d17/d4e/l65 0 2024-09-13T22:56:26.998 INFO:tasks.workunit.client.0.smithi002.stdout:6/899: chown d12/d17/d28/d67/d6b/daa/dc6/fe0 160 1 2024-09-13T22:56:26.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:26 smithi002 ceph-mon[27637]: Updating smithi047:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:56:26.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:26 smithi002 ceph-mon[27637]: pgmap v23: 65 pgs: 65 active+clean; 3.2 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 82 MiB/s rd, 172 MiB/s wr, 406 op/s 2024-09-13T22:56:26.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:26 smithi002 ceph-mon[27637]: Reconfiguring prometheus.smithi002 (dependencies changed)... 2024-09-13T22:56:26.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:26 smithi002 ceph-mon[27637]: Reconfiguring daemon prometheus.smithi002 on smithi002 2024-09-13T22:56:27.000 INFO:tasks.workunit.client.0.smithi002.stdout:1/938: fdatasync d1/d13/d21/d40/f5c 0 2024-09-13T22:56:27.002 INFO:tasks.workunit.client.1.smithi047.stdout:7/862: creat d0/d7/da/d47/f123 x:0 0 0 2024-09-13T22:56:27.003 INFO:tasks.workunit.client.1.smithi047.stdout:2/933: dwrite d1/df/d1d/d20/d29/dcd/dff/f86 [8388608,4194304] 0 2024-09-13T22:56:27.004 INFO:tasks.workunit.client.0.smithi002.stdout:7/878: dread d8/fae [0,4194304] 0 2024-09-13T22:56:27.007 INFO:tasks.workunit.client.0.smithi002.stdout:4/829: rename d3/d40/d45 to d3/d14/d29/d2a/da6/d9f/d10e 0 2024-09-13T22:56:27.007 INFO:tasks.workunit.client.0.smithi002.stdout:4/830: fdatasync d3/f10 0 2024-09-13T22:56:27.013 INFO:tasks.workunit.client.0.smithi002.stdout:3/917: mknod d9/d15/d36/d4e/d5e/dae/d89/de5/de7/c13e 0 2024-09-13T22:56:27.017 INFO:tasks.workunit.client.1.smithi047.stdout:6/964: symlink d3/d11/d2b/d1c/dbd/de8/l147 0 2024-09-13T22:56:27.019 INFO:tasks.workunit.client.0.smithi002.stdout:2/872: mknod d1/d7/d8/d4f/df7/c126 0 2024-09-13T22:56:27.020 INFO:tasks.workunit.client.1.smithi047.stdout:9/932: write d1/dc/d14/dd/d54/f4f [2379334,62208] 0 2024-09-13T22:56:27.022 INFO:tasks.workunit.client.1.smithi047.stdout:8/901: dwrite d8/d64/d4e/d4d/d8f/d91/d38/f3b [0,4194304] 0 2024-09-13T22:56:27.022 INFO:tasks.workunit.client.1.smithi047.stdout:3/973: rename d0/d3/d4/d16/d73/f117 to d0/d3/d4/d16/d73/d86/f13c 0 2024-09-13T22:56:27.024 INFO:tasks.workunit.client.0.smithi002.stdout:0/859: creat d1/d7e/d9d/de3/f135 x:0 0 0 2024-09-13T22:56:27.029 INFO:tasks.workunit.client.1.smithi047.stdout:7/863: creat d0/d7/da/d1e/d51/f124 x:0 0 0 2024-09-13T22:56:27.029 INFO:tasks.workunit.client.1.smithi047.stdout:5/816: dwrite d19/d23/d4c/fa9 [0,4194304] 0 2024-09-13T22:56:27.030 INFO:tasks.workunit.client.1.smithi047.stdout:7/864: read - d0/d7/dc5/f10c zero size 2024-09-13T22:56:27.031 INFO:tasks.workunit.client.1.smithi047.stdout:5/817: dread - d19/d83/d98/fcc zero size 2024-09-13T22:56:27.032 INFO:tasks.workunit.client.0.smithi002.stdout:9/954: mkdir d8/d10/d61/df4/d13c 0 2024-09-13T22:56:27.032 INFO:tasks.workunit.client.1.smithi047.stdout:5/818: write d19/d25/fc9 [1895312,112405] 0 2024-09-13T22:56:27.034 INFO:tasks.workunit.client.1.smithi047.stdout:5/819: chown d19/d25/d45/ff0 93861282 1 2024-09-13T22:56:27.035 INFO:tasks.workunit.client.0.smithi002.stdout:1/939: symlink d1/d13/d1d/d34/da7/l146 0 2024-09-13T22:56:27.038 INFO:tasks.workunit.client.1.smithi047.stdout:6/965: unlink d3/d11/d2b/d1c/l125 0 2024-09-13T22:56:27.041 INFO:tasks.workunit.client.0.smithi002.stdout:9/955: dwrite d8/d10/d1c/d3d/d11f/da3/db9/dfa/d87/da5/d120/f138 [0,4194304] 0 2024-09-13T22:56:27.046 INFO:tasks.workunit.client.1.smithi047.stdout:9/933: fsync d1/dc/d14/dd/d54/d50/d91/faf 0 2024-09-13T22:56:27.052 INFO:tasks.workunit.client.0.smithi002.stdout:8/901: dread d3/dc/d18/f23 [0,4194304] 0 2024-09-13T22:56:27.052 INFO:tasks.workunit.client.0.smithi002.stdout:8/902: chown d3/l12 90461180 1 2024-09-13T22:56:27.055 INFO:tasks.workunit.client.1.smithi047.stdout:0/884: dwrite d1/d5/d16/d47/f4d [0,4194304] 0 2024-09-13T22:56:27.058 INFO:tasks.workunit.client.1.smithi047.stdout:8/902: dread d8/f2c [0,4194304] 0 2024-09-13T22:56:27.058 INFO:tasks.workunit.client.1.smithi047.stdout:7/865: dread d0/d7/da/d1e/fac [0,4194304] 0 2024-09-13T22:56:27.059 INFO:tasks.workunit.client.1.smithi047.stdout:2/934: mknod d1/df/d1d/d20/d29/dcd/dff/db6/de9/ded/c138 0 2024-09-13T22:56:27.066 INFO:tasks.workunit.client.0.smithi002.stdout:2/873: dread d1/d7/d8/d2c/f2d [0,4194304] 0 2024-09-13T22:56:27.066 INFO:tasks.workunit.client.1.smithi047.stdout:6/966: creat d3/d11/d2b/d1c/dbf/f148 x:0 0 0 2024-09-13T22:56:27.067 INFO:tasks.workunit.client.1.smithi047.stdout:6/967: chown d3/d2c/d10b/d48/lf5 127065 1 2024-09-13T22:56:27.068 INFO:tasks.workunit.client.0.smithi002.stdout:7/879: dwrite d8/d10/d39/d60/db8/d2e/d3c/f59 [0,4194304] 0 2024-09-13T22:56:27.069 INFO:tasks.workunit.client.0.smithi002.stdout:7/880: readlink d8/l30 0 2024-09-13T22:56:27.073 INFO:tasks.workunit.client.0.smithi002.stdout:9/956: stat d8/d1e/c5d 0 2024-09-13T22:56:27.073 INFO:tasks.workunit.client.0.smithi002.stdout:6/900: write d12/d17/d28/d67/f99 [971754,3888] 0 2024-09-13T22:56:27.076 INFO:tasks.workunit.client.1.smithi047.stdout:7/866: fsync d0/d7/da/d4e/f70 0 2024-09-13T22:56:27.077 INFO:tasks.workunit.client.0.smithi002.stdout:9/957: chown d8/d1e/f130 12 1 2024-09-13T22:56:27.077 INFO:tasks.workunit.client.1.smithi047.stdout:3/974: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/d3a/d81/fa8 [3339669,126408] 0 2024-09-13T22:56:27.078 INFO:tasks.workunit.client.0.smithi002.stdout:3/918: dwrite d9/d15/d35/f3a [0,4194304] 0 2024-09-13T22:56:27.079 INFO:tasks.workunit.client.0.smithi002.stdout:7/881: dwrite d8/d10/d11/fe1 [0,4194304] 0 2024-09-13T22:56:27.080 INFO:tasks.workunit.client.0.smithi002.stdout:3/919: chown d9/d15/f30 130397595 1 2024-09-13T22:56:27.081 INFO:tasks.workunit.client.0.smithi002.stdout:8/903: creat d3/dc/d18/d2e/df4/f11c x:0 0 0 2024-09-13T22:56:27.082 INFO:tasks.workunit.client.0.smithi002.stdout:3/920: chown d9/d15/d26/fc4 87 1 2024-09-13T22:56:27.082 INFO:tasks.workunit.client.1.smithi047.stdout:5/820: rename d19/d83/ld4 to d19/d83/d98/dd0/lfe 0 2024-09-13T22:56:27.083 INFO:tasks.workunit.client.0.smithi002.stdout:3/921: chown d9/d15/d36/d4e/d5e/la0 356435850 1 2024-09-13T22:56:27.084 INFO:tasks.workunit.client.1.smithi047.stdout:5/821: fsync d19/d64/ff2 0 2024-09-13T22:56:27.085 INFO:tasks.workunit.client.1.smithi047.stdout:7/867: dwrite d0/d7/da/d1e/f6b [0,4194304] 0 2024-09-13T22:56:27.088 INFO:tasks.workunit.client.1.smithi047.stdout:5/822: chown d19/d23/d2e/d41/d58/dfc 16136 1 2024-09-13T22:56:27.088 INFO:tasks.workunit.client.0.smithi002.stdout:2/874: fdatasync d1/d7/d35/d3e/d5e/fd7 0 2024-09-13T22:56:27.088 INFO:tasks.workunit.client.0.smithi002.stdout:4/831: dwrite d3/d14/d29/d2a/da6/d5e/f64 [0,4194304] 0 2024-09-13T22:56:27.089 INFO:tasks.workunit.client.0.smithi002.stdout:2/875: chown d1/d7/d8/d2c/c123 246 1 2024-09-13T22:56:27.089 INFO:tasks.workunit.client.1.smithi047.stdout:9/934: symlink d1/dc/d14/dd/d54/d4e/d51/l13b 0 2024-09-13T22:56:27.090 INFO:tasks.workunit.client.1.smithi047.stdout:5/823: write d19/d25/f38 [2054971,13474] 0 2024-09-13T22:56:27.094 INFO:tasks.workunit.client.1.smithi047.stdout:0/885: unlink d1/d5/d11/cd7 0 2024-09-13T22:56:27.096 INFO:tasks.workunit.client.0.smithi002.stdout:4/832: dread d3/d14/d29/d2a/da6/d9f/d10e/f52 [0,4194304] 0 2024-09-13T22:56:27.097 INFO:tasks.workunit.client.0.smithi002.stdout:6/901: rmdir d12/d17/d28/d67/d9f 39 2024-09-13T22:56:27.105 INFO:tasks.workunit.client.1.smithi047.stdout:2/935: mkdir d1/df/d1d/d2e/d5e/dcb/d139 0 2024-09-13T22:56:27.106 INFO:tasks.workunit.client.0.smithi002.stdout:1/940: write d1/d13/f141 [45949,105728] 0 2024-09-13T22:56:27.107 INFO:tasks.workunit.client.0.smithi002.stdout:1/941: readlink d1/l1a 0 2024-09-13T22:56:27.108 INFO:tasks.workunit.client.0.smithi002.stdout:0/860: link d1/d4/d75/d31/f8d d1/f136 0 2024-09-13T22:56:27.109 INFO:tasks.workunit.client.1.smithi047.stdout:3/975: rmdir d0/d3/d4/d16/d32/d42/d79/d9c/dad/d95/dc3 39 2024-09-13T22:56:27.113 INFO:tasks.workunit.client.0.smithi002.stdout:8/904: dread d3/dc/d18/d2e/f108 [0,4194304] 0 2024-09-13T22:56:27.117 INFO:tasks.workunit.client.0.smithi002.stdout:9/958: dread d8/d10/d1c/d3d/f7b [4194304,4194304] 0 2024-09-13T22:56:27.121 INFO:tasks.workunit.client.1.smithi047.stdout:9/935: mknod d1/dc/d14/dd/d4c/c13c 0 2024-09-13T22:56:27.124 INFO:tasks.workunit.client.1.smithi047.stdout:2/936: dread d1/f1a [4194304,4194304] 0 2024-09-13T22:56:27.126 INFO:tasks.workunit.client.0.smithi002.stdout:7/882: dwrite d8/d10/d39/d60/db8/d26/d38/d68/fc0 [0,4194304] 0 2024-09-13T22:56:27.127 INFO:tasks.workunit.client.0.smithi002.stdout:5/892: sync 2024-09-13T22:56:27.129 INFO:tasks.workunit.client.1.smithi047.stdout:8/903: creat d8/d64/d4e/d4d/d8f/d91/f137 x:0 0 0 2024-09-13T22:56:27.130 INFO:tasks.workunit.client.0.smithi002.stdout:4/833: fdatasync d3/d14/d29/d2a/da6/f84 0 2024-09-13T22:56:27.133 INFO:tasks.workunit.client.1.smithi047.stdout:3/976: mkdir d0/d3/d4/d91/d8d/d13d 0 2024-09-13T22:56:27.133 INFO:tasks.workunit.client.1.smithi047.stdout:6/968: dwrite d3/d2c/d10b/f37 [0,4194304] 0 2024-09-13T22:56:27.133 INFO:tasks.workunit.client.1.smithi047.stdout:5/824: dread d19/d83/fb5 [0,4194304] 0 2024-09-13T22:56:27.133 INFO:tasks.workunit.client.0.smithi002.stdout:6/902: fsync d12/d17/d34/d39/d8a/fa7 0 2024-09-13T22:56:27.135 INFO:tasks.workunit.client.1.smithi047.stdout:9/936: fdatasync d1/dc/d14/dd/f3e 0 2024-09-13T22:56:27.137 INFO:tasks.workunit.client.1.smithi047.stdout:2/937: dread - d1/d16/f102 zero size 2024-09-13T22:56:27.138 INFO:tasks.workunit.client.0.smithi002.stdout:0/861: creat d1/d4/da3/d7d/df8/f137 x:0 0 0 2024-09-13T22:56:27.139 INFO:tasks.workunit.client.0.smithi002.stdout:0/862: fsync d1/d4/d75/d76/fa8 0 2024-09-13T22:56:27.139 INFO:tasks.workunit.client.1.smithi047.stdout:0/886: truncate d1/d5/d16/d97/dfc/d45/d7f/f11d 5182153 0 2024-09-13T22:56:27.145 INFO:tasks.workunit.client.0.smithi002.stdout:3/922: mknod d9/d3b/c13f 0 2024-09-13T22:56:27.145 INFO:tasks.workunit.client.1.smithi047.stdout:3/977: dwrite d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/f11e [0,4194304] 0 2024-09-13T22:56:27.146 INFO:tasks.workunit.client.1.smithi047.stdout:5/825: symlink d19/d83/lff 0 2024-09-13T22:56:27.148 INFO:tasks.workunit.client.1.smithi047.stdout:3/978: dread - d0/d3/d4/d16/d32/d42/f114 zero size 2024-09-13T22:56:27.156 INFO:tasks.workunit.client.0.smithi002.stdout:7/883: creat d8/d10/d39/d60/db8/d2e/d50/d52/d72/d8f/f106 x:0 0 0 2024-09-13T22:56:27.157 INFO:tasks.workunit.client.1.smithi047.stdout:0/887: chown d1/d5/d16/d97/dfc/c96 368 1 2024-09-13T22:56:27.160 INFO:tasks.workunit.client.1.smithi047.stdout:2/938: rename d1/d16/d40/d57/db0/cb9 to d1/df/d1d/da9/d131/c13a 0 2024-09-13T22:56:27.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:26 smithi047 ceph-mon[34560]: Updating smithi047:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:56:27.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:26 smithi047 ceph-mon[34560]: pgmap v23: 65 pgs: 65 active+clean; 3.2 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 82 MiB/s rd, 172 MiB/s wr, 406 op/s 2024-09-13T22:56:27.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:26 smithi047 ceph-mon[34560]: Reconfiguring prometheus.smithi002 (dependencies changed)... 2024-09-13T22:56:27.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:26 smithi047 ceph-mon[34560]: Reconfiguring daemon prometheus.smithi002 on smithi002 2024-09-13T22:56:27.163 INFO:tasks.workunit.client.1.smithi047.stdout:3/979: dread d0/d3/d4/d16/d32/d42/d79/d9c/dad/da3/fca [0,4194304] 0 2024-09-13T22:56:27.166 INFO:tasks.workunit.client.1.smithi047.stdout:8/904: dread d8/d64/d4e/d4d/d8f/d91/d40/f10e [0,4194304] 0 2024-09-13T22:56:27.167 INFO:tasks.workunit.client.1.smithi047.stdout:6/969: creat d3/d2c/d10b/d48/dd7/f149 x:0 0 0 2024-09-13T22:56:27.170 INFO:tasks.workunit.client.1.smithi047.stdout:8/905: fsync d8/d64/d4e/d4d/d8f/d91/d38/f44 0 2024-09-13T22:56:27.172 INFO:tasks.workunit.client.0.smithi002.stdout:5/893: dread d1/d2a/d6b/d88/fe1 [0,4194304] 0 2024-09-13T22:56:27.173 INFO:tasks.workunit.client.0.smithi002.stdout:5/894: write d1/f37 [396054,102662] 0 2024-09-13T22:56:27.174 INFO:tasks.workunit.client.1.smithi047.stdout:9/937: dwrite d1/dc/d14/dd/d54/d50/d91/da3/ff6 [0,4194304] 0 2024-09-13T22:56:27.175 INFO:tasks.workunit.client.0.smithi002.stdout:5/895: write d1/d2a/d69/f92 [5145282,13749] 0 2024-09-13T22:56:27.176 INFO:tasks.workunit.client.1.smithi047.stdout:2/939: symlink d1/df/d1d/d2e/l13b 0 2024-09-13T22:56:27.178 INFO:tasks.workunit.client.0.smithi002.stdout:1/942: truncate d1/f63 11601893 0 2024-09-13T22:56:27.178 INFO:tasks.workunit.client.0.smithi002.stdout:4/834: dwrite d3/f23 [0,4194304] 0 2024-09-13T22:56:27.180 INFO:tasks.workunit.client.0.smithi002.stdout:0/863: mkdir d1/d4/d75/d31/de0/d102/d138 0 2024-09-13T22:56:27.181 INFO:tasks.workunit.client.0.smithi002.stdout:0/864: dread - d1/d2/d81/f122 zero size 2024-09-13T22:56:27.181 INFO:tasks.workunit.client.0.smithi002.stdout:8/905: symlink d3/dc/d51/d99/l11d 0 2024-09-13T22:56:27.182 INFO:tasks.workunit.client.1.smithi047.stdout:3/980: rmdir d0/d3/d4/d16/d32/d42/d79/d9c/d11c/df7 39 2024-09-13T22:56:27.183 INFO:tasks.workunit.client.1.smithi047.stdout:6/970: mknod d3/d11/d2b/d1c/d4d/d69/c14a 0 2024-09-13T22:56:27.184 INFO:tasks.workunit.client.0.smithi002.stdout:3/923: creat d9/d15/d36/d4e/d5e/dae/f140 x:0 0 0 2024-09-13T22:56:27.186 INFO:tasks.workunit.client.0.smithi002.stdout:4/835: dread d3/d14/d86/db1/dfb/d10d/f8d [0,4194304] 0 2024-09-13T22:56:27.186 INFO:tasks.workunit.client.0.smithi002.stdout:2/876: link d1/d7/d8/d2c/ff3 d1/d7/d35/d3e/f127 0 2024-09-13T22:56:27.187 INFO:tasks.workunit.client.0.smithi002.stdout:2/877: fsync d1/d7/d35/d78/dfc/d6b/f116 0 2024-09-13T22:56:27.189 INFO:tasks.workunit.client.1.smithi047.stdout:8/906: mkdir d8/d64/d104/d138 0 2024-09-13T22:56:27.192 INFO:tasks.workunit.client.1.smithi047.stdout:6/971: dwrite d3/d11/d2b/d1c/dca/fd5 [0,4194304] 0 2024-09-13T22:56:27.197 INFO:tasks.workunit.client.0.smithi002.stdout:1/943: dread d1/d13/d21/d39/d70/d10c/f41 [0,4194304] 0 2024-09-13T22:56:27.201 INFO:tasks.workunit.client.0.smithi002.stdout:0/865: rmdir d1/d4/d75/d76/d120 39 2024-09-13T22:56:27.201 INFO:tasks.workunit.client.1.smithi047.stdout:5/826: rename d19/d83/d98/fcc to d19/d23/f100 0 2024-09-13T22:56:27.206 INFO:tasks.workunit.client.0.smithi002.stdout:9/959: rename d8/d1e/f3a to d8/d2c/f13d 0 2024-09-13T22:56:27.208 INFO:tasks.workunit.client.1.smithi047.stdout:6/972: creat d3/d2c/d10b/f14b x:0 0 0 2024-09-13T22:56:27.209 INFO:tasks.workunit.client.0.smithi002.stdout:8/906: mknod d3/dc/d18/d56/dd0/c11e 0 2024-09-13T22:56:27.210 INFO:tasks.workunit.client.0.smithi002.stdout:4/836: dread f2 [0,4194304] 0 2024-09-13T22:56:27.212 INFO:tasks.workunit.client.0.smithi002.stdout:4/837: chown d3/d14/d29/d2a/da6/d9f/ca4 5 1 2024-09-13T22:56:27.213 INFO:tasks.workunit.client.1.smithi047.stdout:3/981: rmdir d0/d3/d4/d16/d32/d42/d79/d9c/dad/d95/dc3 39 2024-09-13T22:56:27.215 INFO:tasks.workunit.client.1.smithi047.stdout:2/940: rename d1/d16/d40/d57/db0/fdd to d1/df/d1d/d2e/d5e/f13c 0 2024-09-13T22:56:27.216 INFO:tasks.workunit.client.0.smithi002.stdout:1/944: mknod d1/d13/d21/d40/dc4/c147 0 2024-09-13T22:56:27.217 INFO:tasks.workunit.client.1.smithi047.stdout:5/827: unlink d19/d23/d2e/dba/cea 0 2024-09-13T22:56:27.219 INFO:tasks.workunit.client.1.smithi047.stdout:5/828: dread - d19/d23/d2e/d41/d58/dfc/d5d/fed zero size 2024-09-13T22:56:27.219 INFO:tasks.workunit.client.1.smithi047.stdout:9/938: link d1/dc/d14/dd/d54/l2c d1/dc/d14/dd/d54/d50/d5b/d106/l13d 0 2024-09-13T22:56:27.224 INFO:tasks.workunit.client.0.smithi002.stdout:7/884: rename d8/d10/d39/d60/db8/d26/d4c/d81/f54 to d8/d10/d39/d60/db8/d26/d38/d84/f107 0 2024-09-13T22:56:27.224 INFO:tasks.workunit.client.0.smithi002.stdout:6/903: dwrite d12/fb5 [4194304,4194304] 0 2024-09-13T22:56:27.226 INFO:tasks.workunit.client.0.smithi002.stdout:9/960: mknod d8/d10/d1c/d3d/d11f/da3/db9/dfa/da8/dc3/c13e 0 2024-09-13T22:56:27.228 INFO:tasks.workunit.client.1.smithi047.stdout:8/907: rename d8/d64/d4e/d4d/d8f/d91/d38/f44 to d8/d64/d4e/dbd/d11e/f139 0 2024-09-13T22:56:27.228 INFO:tasks.workunit.client.0.smithi002.stdout:5/896: dwrite d1/ff9 [0,4194304] 0 2024-09-13T22:56:27.235 INFO:tasks.workunit.client.1.smithi047.stdout:5/829: rmdir d19/d25 39 2024-09-13T22:56:27.242 INFO:tasks.workunit.client.1.smithi047.stdout:6/973: write d3/d11/f7b [887133,41995] 0 2024-09-13T22:56:27.249 INFO:tasks.workunit.client.1.smithi047.stdout:9/939: symlink d1/dc/d14/df3/l13e 0 2024-09-13T22:56:27.250 INFO:tasks.workunit.client.0.smithi002.stdout:1/945: mkdir d1/d13/d21/d39/d70/d10c/d3d/db6/d148 0 2024-09-13T22:56:27.250 INFO:tasks.workunit.client.0.smithi002.stdout:2/878: dwrite d1/d7/f68 [0,4194304] 0 2024-09-13T22:56:27.251 INFO:tasks.workunit.client.0.smithi002.stdout:3/924: rename d9/d15/d26/fef to d9/d3b/d53/db9/df2/d11e/f141 0 2024-09-13T22:56:27.252 INFO:tasks.workunit.client.0.smithi002.stdout:5/897: creat d1/d2a/d6b/d88/d45/d4f/f141 x:0 0 0 2024-09-13T22:56:27.252 INFO:tasks.workunit.client.1.smithi047.stdout:3/982: creat d0/d3/d4/d16/d2c/f13e x:0 0 0 2024-09-13T22:56:27.253 INFO:tasks.workunit.client.1.smithi047.stdout:3/983: chown d0/d3/d4/d16/d32/d42/d79/dba/d125 16 1 2024-09-13T22:56:27.259 INFO:tasks.workunit.client.0.smithi002.stdout:0/866: dwrite d1/d4/d75/d31/f37 [4194304,4194304] 0 2024-09-13T22:56:27.260 INFO:tasks.workunit.client.1.smithi047.stdout:2/941: link d1/df/d1d/d20/d37/d85/c132 d1/de/d119/c13d 0 2024-09-13T22:56:27.263 INFO:tasks.workunit.client.0.smithi002.stdout:2/879: fsync d1/d4a/f6c 0 2024-09-13T22:56:27.264 INFO:tasks.workunit.client.0.smithi002.stdout:3/925: dwrite d9/d15/d36/d4e/f9f [0,4194304] 0 2024-09-13T22:56:27.265 INFO:tasks.workunit.client.1.smithi047.stdout:5/830: mkdir d19/d23/d2e/d41/d58/dfc/d5d/dd8/d101 0 2024-09-13T22:56:27.265 INFO:tasks.workunit.client.0.smithi002.stdout:3/926: chown d9/d15/f30 1034012951 1 2024-09-13T22:56:27.266 INFO:tasks.workunit.client.0.smithi002.stdout:6/904: dread d12/d17/d2a/f4f [0,4194304] 0 2024-09-13T22:56:27.268 INFO:tasks.workunit.client.0.smithi002.stdout:7/885: rename d8/d10/d39/d60/db8/d26/d38/f9e to d8/d10/d39/d60/db8/d26/d4c/d81/d51/f108 0 2024-09-13T22:56:27.268 INFO:tasks.workunit.client.1.smithi047.stdout:2/942: dread d1/df/d26/faa [0,4194304] 0 2024-09-13T22:56:27.269 INFO:tasks.workunit.client.1.smithi047.stdout:2/943: fdatasync d1/df/d26/d4b/f50 0 2024-09-13T22:56:27.270 INFO:tasks.workunit.client.1.smithi047.stdout:9/940: mknod d1/d5f/de9/d107/d10c/c13f 0 2024-09-13T22:56:27.275 INFO:tasks.workunit.client.0.smithi002.stdout:8/907: mknod d3/dc/d16/d2f/d83/d85/dc8/de3/df1/c11f 0 2024-09-13T22:56:27.275 INFO:tasks.workunit.client.0.smithi002.stdout:0/867: dread d1/d4/da3/f68 [0,4194304] 0 2024-09-13T22:56:27.277 INFO:tasks.workunit.client.0.smithi002.stdout:8/908: chown d3/d21/f9d 9 1 2024-09-13T22:56:27.279 INFO:tasks.workunit.client.0.smithi002.stdout:0/868: truncate d1/d7e/d9d/de6/f12c 292611 0 2024-09-13T22:56:27.279 INFO:tasks.workunit.client.0.smithi002.stdout:5/898: chown d1/d2a/d6b/d88/d45/l47 0 1 2024-09-13T22:56:27.283 INFO:tasks.workunit.client.0.smithi002.stdout:7/886: dread d8/d10/d39/d60/db8/d26/d4c/d81/f40 [0,4194304] 0 2024-09-13T22:56:27.284 INFO:tasks.workunit.client.1.smithi047.stdout:5/831: unlink cc 0 2024-09-13T22:56:27.286 INFO:tasks.workunit.client.1.smithi047.stdout:2/944: mknod d1/df/d1d/da9/c13e 0 2024-09-13T22:56:27.287 INFO:tasks.workunit.client.1.smithi047.stdout:9/941: dread d1/dc/d14/dd/d54/f37 [0,4194304] 0 2024-09-13T22:56:27.288 INFO:tasks.workunit.client.0.smithi002.stdout:2/880: truncate d1/d4a/fb8 3157289 0 2024-09-13T22:56:27.289 INFO:tasks.workunit.client.1.smithi047.stdout:3/984: symlink d0/d3/l13f 0 2024-09-13T22:56:27.290 INFO:tasks.workunit.client.1.smithi047.stdout:3/985: dread - d0/d3/d4/d16/d32/d42/d79/dba/d125/f13a zero size 2024-09-13T22:56:27.293 INFO:tasks.workunit.client.1.smithi047.stdout:3/986: truncate d0/d3/d4/d16/d32/d42/d79/df2/f12f 1012715 0 2024-09-13T22:56:27.296 INFO:tasks.workunit.client.0.smithi002.stdout:6/905: creat d12/d17/d4e/f121 x:0 0 0 2024-09-13T22:56:27.297 INFO:tasks.workunit.client.1.smithi047.stdout:5/832: creat d19/d23/d2e/d41/d58/dfc/d5d/d80/f102 x:0 0 0 2024-09-13T22:56:27.299 INFO:tasks.workunit.client.0.smithi002.stdout:4/838: rename d3/d14/d29/df7/fec to d3/db3/db9/dff/f10f 0 2024-09-13T22:56:27.299 INFO:tasks.workunit.client.0.smithi002.stdout:3/927: write d9/d15/d46/ff9 [649460,113408] 0 2024-09-13T22:56:27.300 INFO:tasks.workunit.client.0.smithi002.stdout:4/839: chown d3/d14/f1d 17033203 1 2024-09-13T22:56:27.301 INFO:tasks.workunit.client.1.smithi047.stdout:6/974: link d3/ld0 d3/d77/d93/l14c 0 2024-09-13T22:56:27.302 INFO:tasks.workunit.client.0.smithi002.stdout:1/946: unlink d1/d13/d30/d73/da1/d7d/ca9 0 2024-09-13T22:56:27.303 INFO:tasks.workunit.client.1.smithi047.stdout:3/987: mknod d0/d3/d4/d91/d8d/c140 0 2024-09-13T22:56:27.304 INFO:tasks.workunit.client.1.smithi047.stdout:8/908: link d8/d6b/ff4 d8/d64/d4e/d4d/d8f/f13a 0 2024-09-13T22:56:27.307 INFO:tasks.workunit.client.0.smithi002.stdout:0/869: unlink d1/d7e/d9d/l10c 0 2024-09-13T22:56:27.308 INFO:tasks.workunit.client.1.smithi047.stdout:5/833: mkdir d19/d23/d4c/d103 0 2024-09-13T22:56:27.310 INFO:tasks.workunit.client.1.smithi047.stdout:5/834: readlink d19/d23/d2e/d41/d58/dfc/l87 0 2024-09-13T22:56:27.310 INFO:tasks.workunit.client.0.smithi002.stdout:5/899: fdatasync d1/d2a/d6b/d88/d45/d4f/d8f/dd5/fd7 0 2024-09-13T22:56:27.313 INFO:tasks.workunit.client.1.smithi047.stdout:9/942: creat d1/d5f/de9/d129/f140 x:0 0 0 2024-09-13T22:56:27.314 INFO:tasks.workunit.client.0.smithi002.stdout:7/887: dread - d8/d10/d39/d60/db8/d26/d95/fbc zero size 2024-09-13T22:56:27.315 INFO:tasks.workunit.client.1.smithi047.stdout:6/975: dread d3/d11/f97 [0,4194304] 0 2024-09-13T22:56:27.318 INFO:tasks.workunit.client.0.smithi002.stdout:5/900: dwrite d1/d2a/d6b/d88/d45/d4f/da7/daa/f134 [0,4194304] 0 2024-09-13T22:56:27.319 INFO:tasks.workunit.client.0.smithi002.stdout:1/947: dread d1/d13/d30/d73/da1/f4c [0,4194304] 0 2024-09-13T22:56:27.319 INFO:tasks.workunit.client.0.smithi002.stdout:2/881: read d1/d32/d37/f45 [2834758,6639] 0 2024-09-13T22:56:27.320 INFO:tasks.workunit.client.1.smithi047.stdout:5/835: rmdir d19/d83/d98/dd0 39 2024-09-13T22:56:27.324 INFO:tasks.workunit.client.1.smithi047.stdout:9/943: mkdir d1/dc/d14/dd/dba/d141 0 2024-09-13T22:56:27.325 INFO:tasks.workunit.client.0.smithi002.stdout:8/909: dwrite d3/dc/d18/d2e/d94/f88 [0,4194304] 0 2024-09-13T22:56:27.325 INFO:tasks.workunit.client.0.smithi002.stdout:1/948: dread d1/f27 [0,4194304] 0 2024-09-13T22:56:27.326 INFO:tasks.workunit.client.0.smithi002.stdout:6/906: creat d12/d17/d28/d67/d6b/daa/f122 x:0 0 0 2024-09-13T22:56:27.327 INFO:tasks.workunit.client.0.smithi002.stdout:1/949: read d1/d13/d21/d39/d70/d10c/f41 [2734298,22889] 0 2024-09-13T22:56:27.328 INFO:tasks.workunit.client.1.smithi047.stdout:6/976: rename d3/d77/fe1 to d3/d77/d8f/db9/f14d 0 2024-09-13T22:56:27.329 INFO:tasks.workunit.client.1.smithi047.stdout:5/836: dwrite d19/d23/d2e/d41/d58/d77/fe2 [0,4194304] 0 2024-09-13T22:56:27.332 INFO:tasks.workunit.client.1.smithi047.stdout:3/988: mkdir d0/d3/d4/d16/d141 0 2024-09-13T22:56:27.335 INFO:tasks.workunit.client.0.smithi002.stdout:3/928: read d9/d15/fe3 [2048770,34215] 0 2024-09-13T22:56:27.336 INFO:tasks.workunit.client.0.smithi002.stdout:9/961: sync 2024-09-13T22:56:27.336 INFO:tasks.workunit.client.0.smithi002.stdout:3/929: chown d9/d15/d35/f9d 620 1 2024-09-13T22:56:27.338 INFO:tasks.workunit.client.0.smithi002.stdout:4/840: fdatasync d3/d14/d29/d2a/da6/fcf 0 2024-09-13T22:56:27.339 INFO:tasks.workunit.client.0.smithi002.stdout:4/841: chown d3/d14/d29/fdc 141160369 1 2024-09-13T22:56:27.341 INFO:tasks.workunit.client.0.smithi002.stdout:0/870: symlink d1/d4/da3/d7d/df8/l139 0 2024-09-13T22:56:27.342 INFO:tasks.workunit.client.1.smithi047.stdout:6/977: creat d3/d11/d2b/d4c/d9d/dc1/de0/f14e x:0 0 0 2024-09-13T22:56:27.342 INFO:tasks.workunit.client.1.smithi047.stdout:5/837: mkdir d19/d23/d2e/d41/d58/dfc/d5d/d80/d104 0 2024-09-13T22:56:27.344 INFO:tasks.workunit.client.1.smithi047.stdout:3/989: mkdir d0/d3/d4/d16/d1c/d142 0 2024-09-13T22:56:27.345 INFO:tasks.workunit.client.0.smithi002.stdout:7/888: truncate d8/d10/d11/f9f 1096243 0 2024-09-13T22:56:27.347 INFO:tasks.workunit.client.1.smithi047.stdout:9/944: creat d1/dc/d14/dd/d54/d4e/d51/d79/d113/d11f/f142 x:0 0 0 2024-09-13T22:56:27.349 INFO:tasks.workunit.client.1.smithi047.stdout:5/838: mkdir d19/d23/d2e/d41/d58/dfc/d105 0 2024-09-13T22:56:27.356 INFO:tasks.workunit.client.0.smithi002.stdout:1/950: rename d1/d13/d21/d40/dc4/fd4 to d1/d13/d21/d39/d70/f149 0 2024-09-13T22:56:27.356 INFO:tasks.workunit.client.0.smithi002.stdout:5/901: dread d1/d2a/d6b/d88/f46 [0,4194304] 0 2024-09-13T22:56:27.357 INFO:tasks.workunit.client.0.smithi002.stdout:5/902: stat d1/d2a/d6b/d88/d55/d56/d81/l9a 0 2024-09-13T22:56:27.364 INFO:tasks.workunit.client.0.smithi002.stdout:4/842: read d3/f12 [2476103,121994] 0 2024-09-13T22:56:27.364 INFO:tasks.workunit.client.0.smithi002.stdout:5/903: dwrite d1/d2a/d69/f129 [0,4194304] 0 2024-09-13T22:56:27.364 INFO:tasks.workunit.client.0.smithi002.stdout:4/843: fsync d3/d40/f10c 0 2024-09-13T22:56:27.366 INFO:tasks.workunit.client.0.smithi002.stdout:2/882: fsync d1/d7/d35/d78/dfc/f70 0 2024-09-13T22:56:27.367 INFO:tasks.workunit.client.0.smithi002.stdout:8/910: mknod d3/dc/d16/d97/c120 0 2024-09-13T22:56:27.369 INFO:tasks.workunit.client.0.smithi002.stdout:9/962: write d8/d10/db1/fe5 [1856233,52333] 0 2024-09-13T22:56:27.371 INFO:tasks.workunit.client.0.smithi002.stdout:9/963: dread - d8/d1e/f130 zero size 2024-09-13T22:56:27.373 INFO:tasks.workunit.client.0.smithi002.stdout:0/871: creat d1/d2/d12a/f13a x:0 0 0 2024-09-13T22:56:27.376 INFO:tasks.workunit.client.0.smithi002.stdout:9/964: creat d8/d10/d1c/dbf/df3/dff/f13f x:0 0 0 2024-09-13T22:56:27.443 INFO:tasks.workunit.client.1.smithi047.stdout:9/945: mkdir d1/dc/d14/dd/d54/d50/d91/da3/d143 0 2024-09-13T22:56:27.446 INFO:tasks.workunit.client.0.smithi002.stdout:7/889: rmdir d8/d10/d39/d60/db8/d26/d4c/d81/d51/da9/df5 0 2024-09-13T22:56:27.446 INFO:tasks.workunit.client.0.smithi002.stdout:0/872: stat d1/l99 0 2024-09-13T22:56:27.446 INFO:tasks.workunit.client.0.smithi002.stdout:4/844: symlink d3/d14/d29/d2a/l110 0 2024-09-13T22:56:27.447 INFO:tasks.workunit.client.0.smithi002.stdout:9/965: rmdir d8/d2c/dbc 39 2024-09-13T22:56:27.447 INFO:tasks.workunit.client.1.smithi047.stdout:8/909: dwrite d8/f7b [0,4194304] 0 2024-09-13T22:56:27.477 INFO:tasks.workunit.client.0.smithi002.stdout:3/930: sync 2024-09-13T22:56:27.484 INFO:tasks.workunit.client.0.smithi002.stdout:4/845: creat d3/d14/d29/d2a/da6/d5e/f111 x:0 0 0 2024-09-13T22:56:27.485 INFO:tasks.workunit.client.0.smithi002.stdout:3/931: readlink d9/d15/d46/l12b 0 2024-09-13T22:56:27.487 INFO:tasks.workunit.client.0.smithi002.stdout:6/907: dwrite d12/d17/d28/d67/d6b/daa/fd3 [0,4194304] 0 2024-09-13T22:56:27.487 INFO:tasks.workunit.client.0.smithi002.stdout:1/951: dwrite d1/ff [0,4194304] 0 2024-09-13T22:56:27.489 INFO:tasks.workunit.client.0.smithi002.stdout:0/873: truncate d1/d4/da3/d7d/df8/f47 4363059 0 2024-09-13T22:56:27.491 INFO:tasks.workunit.client.0.smithi002.stdout:8/911: dwrite d3/dc/d18/d2e/f8d [0,4194304] 0 2024-09-13T22:56:27.493 INFO:tasks.workunit.client.0.smithi002.stdout:3/932: symlink d9/d3b/d7c/l142 0 2024-09-13T22:56:27.497 INFO:tasks.workunit.client.0.smithi002.stdout:3/933: chown d9/d15/d26/fc4 836 1 2024-09-13T22:56:27.497 INFO:tasks.workunit.client.0.smithi002.stdout:7/890: dread d8/d10/fed [0,4194304] 0 2024-09-13T22:56:27.497 INFO:tasks.workunit.client.0.smithi002.stdout:9/966: rename d8/d10/d1c/d68/fe7 to d8/d10/d1c/d3d/d11f/da3/db9/dfa/d87/da5/d94/deb/f140 0 2024-09-13T22:56:27.497 INFO:tasks.workunit.client.0.smithi002.stdout:0/874: rmdir d1/d4/d75/d31/de0 39 2024-09-13T22:56:27.499 INFO:tasks.workunit.client.1.smithi047.stdout:3/990: truncate d0/d3/d4/f4c 3151375 0 2024-09-13T22:56:27.499 INFO:tasks.workunit.client.1.smithi047.stdout:9/946: chown d1/d131/c137 13843 1 2024-09-13T22:56:27.500 INFO:tasks.workunit.client.0.smithi002.stdout:7/891: write d8/d10/d39/fd3 [357285,104549] 0 2024-09-13T22:56:27.500 INFO:tasks.workunit.client.0.smithi002.stdout:9/967: dread - d8/d10/d1c/dbf/df3/dff/f13f zero size 2024-09-13T22:56:27.501 INFO:tasks.workunit.client.1.smithi047.stdout:7/868: sync 2024-09-13T22:56:27.501 INFO:tasks.workunit.client.1.smithi047.stdout:0/888: sync 2024-09-13T22:56:27.501 INFO:tasks.workunit.client.1.smithi047.stdout:2/945: sync 2024-09-13T22:56:27.502 INFO:tasks.workunit.client.0.smithi002.stdout:9/968: write d8/d10/d1c/dd6/dda/f111 [2494787,33615] 0 2024-09-13T22:56:27.503 INFO:tasks.workunit.client.1.smithi047.stdout:0/889: fsync d1/d5/d11/d52/f8e 0 2024-09-13T22:56:27.504 INFO:tasks.workunit.client.1.smithi047.stdout:7/869: stat d0/d7/da/d47/lc1 0 2024-09-13T22:56:27.505 INFO:tasks.workunit.client.1.smithi047.stdout:9/947: chown d1/dc/d14/dd/d54/d50/d91/ff1 143117296 1 2024-09-13T22:56:27.507 INFO:tasks.workunit.client.0.smithi002.stdout:8/912: unlink d3/dc/d18/d2e/d94/f93 0 2024-09-13T22:56:27.510 INFO:tasks.workunit.client.0.smithi002.stdout:7/892: dwrite d8/d10/d39/d60/f100 [0,4194304] 0 2024-09-13T22:56:27.512 INFO:tasks.workunit.client.0.smithi002.stdout:7/893: chown d8/d10/d39/d60/db8/d2e/c93 4 1 2024-09-13T22:56:27.514 INFO:tasks.workunit.client.1.smithi047.stdout:8/910: dread - d8/fd3 zero size 2024-09-13T22:56:27.515 INFO:tasks.workunit.client.0.smithi002.stdout:3/934: mkdir d9/d7e/daf/d143 0 2024-09-13T22:56:27.515 INFO:tasks.workunit.client.1.smithi047.stdout:8/911: write d8/d64/d4e/d4d/d8f/d91/f3a [3434418,76263] 0 2024-09-13T22:56:27.519 INFO:tasks.workunit.client.0.smithi002.stdout:0/875: symlink d1/d2/d6c/l13b 0 2024-09-13T22:56:27.523 INFO:tasks.workunit.client.1.smithi047.stdout:0/890: creat d1/d7/f121 x:0 0 0 2024-09-13T22:56:27.526 INFO:tasks.workunit.client.1.smithi047.stdout:0/891: read d1/d5/d11/f20 [1332929,121280] 0 2024-09-13T22:56:27.538 INFO:tasks.workunit.client.1.smithi047.stdout:8/912: dread d8/d3f/d8c/f90 [0,4194304] 0 2024-09-13T22:56:27.539 INFO:tasks.workunit.client.0.smithi002.stdout:4/846: link d3/fc8 d3/d14/d29/d2a/da6/d69/d7e/dca/df3/f112 0 2024-09-13T22:56:27.541 INFO:tasks.workunit.client.1.smithi047.stdout:7/870: dread d0/d7/da/d2e/db5/f43 [0,4194304] 0 2024-09-13T22:56:27.542 INFO:tasks.workunit.client.1.smithi047.stdout:7/871: read - d0/d7/da/d2e/f122 zero size 2024-09-13T22:56:27.545 INFO:tasks.workunit.client.0.smithi002.stdout:3/935: mkdir d9/d15/d51/deb/d144 0 2024-09-13T22:56:27.546 INFO:tasks.workunit.client.1.smithi047.stdout:9/948: dread d1/dc/d14/dd/fc2 [0,4194304] 0 2024-09-13T22:56:27.547 INFO:tasks.workunit.client.1.smithi047.stdout:0/892: dread - d1/d5/d16/d97/dfc/d45/d84/fc7 zero size 2024-09-13T22:56:27.549 INFO:tasks.workunit.client.0.smithi002.stdout:0/876: rename d1/d4/da3/d7d/df8/cd9 to d1/d4/da3/d7d/df8/df4/c13c 0 2024-09-13T22:56:27.550 INFO:tasks.workunit.client.1.smithi047.stdout:7/872: dwrite d0/d7/da/f11b [0,4194304] 0 2024-09-13T22:56:27.551 INFO:tasks.workunit.client.0.smithi002.stdout:6/908: write d12/f22 [227633,105476] 0 2024-09-13T22:56:27.552 INFO:tasks.workunit.client.0.smithi002.stdout:1/952: creat d1/d13/d30/d73/da1/d12a/d135/f14a x:0 0 0 2024-09-13T22:56:27.552 INFO:tasks.workunit.client.1.smithi047.stdout:3/991: write d0/d3/d4/d16/d2c/de/d1f/f8e [1227485,26807] 0 2024-09-13T22:56:27.554 INFO:tasks.workunit.client.1.smithi047.stdout:3/992: chown d0/d3/d4/d16/d32/d76/l8f 236844594 1 2024-09-13T22:56:27.556 INFO:tasks.workunit.client.1.smithi047.stdout:2/946: write d1/f1a [1944552,125448] 0 2024-09-13T22:56:27.557 INFO:tasks.workunit.client.1.smithi047.stdout:9/949: creat d1/d5f/dc7/f144 x:0 0 0 2024-09-13T22:56:27.559 INFO:tasks.workunit.client.0.smithi002.stdout:8/913: symlink d3/dc/d16/d2f/d83/l121 0 2024-09-13T22:56:27.559 INFO:tasks.workunit.client.0.smithi002.stdout:8/914: stat d3/dc 0 2024-09-13T22:56:27.561 INFO:tasks.workunit.client.0.smithi002.stdout:7/894: mknod d8/c109 0 2024-09-13T22:56:27.564 INFO:tasks.workunit.client.1.smithi047.stdout:8/913: rename d8/d64/d4e/d4d/d8f/d91/d40/cac to d8/d3f/d8c/da6/c13b 0 2024-09-13T22:56:27.566 INFO:tasks.workunit.client.0.smithi002.stdout:3/936: unlink d9/l33 0 2024-09-13T22:56:27.570 INFO:tasks.workunit.client.0.smithi002.stdout:6/909: rename d12/d17/d28/d67/f99 to d12/d17/d28/d67/dca/df9/d101/f123 0 2024-09-13T22:56:27.570 INFO:tasks.workunit.client.0.smithi002.stdout:6/910: fdatasync d12/f63 0 2024-09-13T22:56:27.571 INFO:tasks.workunit.client.1.smithi047.stdout:2/947: creat d1/df/d26/d9f/df2/f13f x:0 0 0 2024-09-13T22:56:27.572 INFO:tasks.workunit.client.1.smithi047.stdout:2/948: chown d1/df/d1d/d20/d29/dcd 5 1 2024-09-13T22:56:27.572 INFO:tasks.workunit.client.0.smithi002.stdout:9/969: symlink d8/d2c/dbc/dc8/d126/l141 0 2024-09-13T22:56:27.572 INFO:tasks.workunit.client.0.smithi002.stdout:9/970: fsync d8/d10/d61/fcb 0 2024-09-13T22:56:27.577 INFO:tasks.workunit.client.1.smithi047.stdout:7/873: fsync d0/d7/da/d1e/f86 0 2024-09-13T22:56:27.578 INFO:tasks.workunit.client.0.smithi002.stdout:3/937: rmdir d9/df 39 2024-09-13T22:56:27.579 INFO:tasks.workunit.client.1.smithi047.stdout:2/949: dwrite d1/df/d1d/d20/d54/f12a [0,4194304] 0 2024-09-13T22:56:27.587 INFO:tasks.workunit.client.1.smithi047.stdout:8/914: mknod d8/d64/d4e/d4d/d8f/d91/c13c 0 2024-09-13T22:56:27.587 INFO:tasks.workunit.client.1.smithi047.stdout:8/915: chown d8/d6b 5029 1 2024-09-13T22:56:27.591 INFO:tasks.workunit.client.0.smithi002.stdout:3/938: dread d9/d3b/f108 [0,4194304] 0 2024-09-13T22:56:27.596 INFO:tasks.workunit.client.1.smithi047.stdout:7/874: rmdir d0/d7 39 2024-09-13T22:56:27.597 INFO:tasks.workunit.client.1.smithi047.stdout:7/875: stat d0/d57/da6/lef 0 2024-09-13T22:56:27.599 INFO:tasks.workunit.client.1.smithi047.stdout:0/893: write d1/d5/f8c [3369666,10319] 0 2024-09-13T22:56:27.600 INFO:tasks.workunit.client.0.smithi002.stdout:8/915: mkdir d3/dc/d18/d122 0 2024-09-13T22:56:27.603 INFO:tasks.workunit.client.1.smithi047.stdout:8/916: fsync d8/d64/d4e/dbd/d11e/f139 0 2024-09-13T22:56:27.606 INFO:tasks.workunit.client.1.smithi047.stdout:3/993: write d0/d3/d4/d16/d32/d42/d79/d9c/dad/d44/d43/f6b [1186468,1099] 0 2024-09-13T22:56:27.607 INFO:tasks.workunit.client.1.smithi047.stdout:6/978: sync 2024-09-13T22:56:27.607 INFO:tasks.workunit.client.0.smithi002.stdout:1/953: write d1/d13/d30/d73/da1/fac [3059664,36769] 0 2024-09-13T22:56:27.609 INFO:tasks.workunit.client.1.smithi047.stdout:2/950: creat d1/df/d35/d8b/dd1/d123/d136/f140 x:0 0 0 2024-09-13T22:56:27.609 INFO:tasks.workunit.client.1.smithi047.stdout:9/950: write d1/dc/f47 [2745874,36371] 0 2024-09-13T22:56:27.611 INFO:tasks.workunit.client.1.smithi047.stdout:0/894: rmdir d1/d5/d16/d47/dd0 39 2024-09-13T22:56:27.616 INFO:tasks.workunit.client.0.smithi002.stdout:3/939: creat d9/d3b/d7c/f145 x:0 0 0 2024-09-13T22:56:27.619 INFO:tasks.workunit.client.1.smithi047.stdout:3/994: symlink d0/l143 0 2024-09-13T22:56:27.620 INFO:tasks.workunit.client.1.smithi047.stdout:3/995: readlink d0/d3/d4/d16/d2c/de/d1f/l3f 0 2024-09-13T22:56:27.620 INFO:tasks.workunit.client.0.smithi002.stdout:8/916: symlink d3/dc/d18/d56/l123 0 2024-09-13T22:56:27.621 INFO:tasks.workunit.client.1.smithi047.stdout:7/876: write d0/d57/d5b/d8b/fa8 [4884647,33430] 0 2024-09-13T22:56:27.621 INFO:tasks.workunit.client.0.smithi002.stdout:8/917: fsync d3/dc/d51/d99/fef 0 2024-09-13T22:56:27.622 INFO:tasks.workunit.client.0.smithi002.stdout:9/971: mkdir d8/d10/d1c/d3d/d11f/da3/db9/dfa/d87/da5/d94/d104/d142 0 2024-09-13T22:56:27.625 INFO:tasks.workunit.client.0.smithi002.stdout:7/895: mknod d8/d10/d11/df6/c10a 0 2024-09-13T22:56:27.625 INFO:tasks.workunit.client.1.smithi047.stdout:8/917: write d8/f27 [661756,24575] 0 2024-09-13T22:56:27.628 INFO:tasks.workunit.client.1.smithi047.stdout:2/951: rename d1/df/d1d/d20/d29/dcd/dff/fab to d1/df/d35/dd7/dca/d10e/f141 0 2024-09-13T22:56:27.629 INFO:tasks.workunit.client.1.smithi047.stdout:2/952: stat d1/df/d35/d8b/fda 0 2024-09-13T22:56:27.629 INFO:tasks.workunit.client.0.smithi002.stdout:4/847: link d3/d14/d29/d2a/da6/d9f/d10e/c48 d3/d14/d29/d2a/c113 0 2024-09-13T22:56:27.632 INFO:tasks.workunit.client.0.smithi002.stdout:1/954: unlink d1/d13/d21/d39/f9c 0 2024-09-13T22:56:27.638 INFO:tasks.workunit.client.0.smithi002.stdout:8/918: mkdir d3/dc/d16/d2f/d83/d85/dba/d124 0 2024-09-13T22:56:27.639 INFO:tasks.workunit.client.1.smithi047.stdout:0/895: write d1/d5/d16/d97/dfc/d45/d7f/fce [323114,41063] 0 2024-09-13T22:56:27.640 INFO:tasks.workunit.client.1.smithi047.stdout:0/896: chown d1/d5/d16/d6a/fe9 139274423 1 2024-09-13T22:56:27.642 INFO:tasks.workunit.client.1.smithi047.stdout:6/979: truncate d3/d11/f3f 1571888 0 2024-09-13T22:56:27.643 INFO:tasks.workunit.client.1.smithi047.stdout:9/951: mknod d1/dc/d14/dd/d54/d8d/d105/c145 0 2024-09-13T22:56:27.644 INFO:tasks.workunit.client.1.smithi047.stdout:9/952: stat d1/dd2 0 2024-09-13T22:56:27.646 INFO:tasks.workunit.client.0.smithi002.stdout:9/972: write d8/d10/d1c/d3d/d11f/da3/db9/dfa/d87/da5/d94/deb/f110 [3447702,122487] 0 2024-09-13T22:56:27.647 INFO:tasks.workunit.client.1.smithi047.stdout:2/953: chown d1/df/d26/d4b/l4f 54 1 2024-09-13T22:56:27.649 INFO:tasks.workunit.client.0.smithi002.stdout:1/955: unlink d1/d13/d21/d39/d70/d10c/d3b/c85 0 2024-09-13T22:56:27.650 INFO:tasks.workunit.client.1.smithi047.stdout:0/897: dread d1/d5/d16/d97/dfc/d45/f4f [0,4194304] 0 2024-09-13T22:56:27.651 INFO:tasks.workunit.client.1.smithi047.stdout:7/877: rename d0/d7/da/d1e/d93/db7 to d0/d7/da/d105/d125 0 2024-09-13T22:56:27.651 INFO:tasks.workunit.client.1.smithi047.stdout:0/898: write d1/d5/d16/d97/dfc/d45/d7f/fce [104122,36903] 0 2024-09-13T22:56:27.656 INFO:tasks.workunit.client.1.smithi047.stdout:3/996: creat d0/d3/d4/d16/d32/d42/d79/d9c/d11c/df7/f144 x:0 0 0 2024-09-13T22:56:27.656 INFO:tasks.workunit.client.0.smithi002.stdout:6/911: link d12/d17/d34/fa9 d12/d17/d34/f124 0 2024-09-13T22:56:27.662 INFO:tasks.workunit.client.0.smithi002.stdout:7/896: mkdir d8/d10/d39/d60/db8/d26/d4c/d81/d10b 0 2024-09-13T22:56:27.663 INFO:tasks.workunit.client.0.smithi002.stdout:0/877: sync 2024-09-13T22:56:27.663 INFO:tasks.workunit.client.0.smithi002.stdout:5/904: sync 2024-09-13T22:56:27.663 INFO:tasks.workunit.client.0.smithi002.stdout:2/883: sync 2024-09-13T22:56:27.664 INFO:tasks.workunit.client.0.smithi002.stdout:4/848: truncate d3/fc8 4181023 0 2024-09-13T22:56:27.664 INFO:tasks.workunit.client.1.smithi047.stdout:9/953: write d1/dc/d14/dd/d4c/ff0 [268334,98429] 0 2024-09-13T22:56:27.666 INFO:tasks.workunit.client.0.smithi002.stdout:3/940: dwrite d9/df/fc1 [0,4194304] 0 2024-09-13T22:56:27.667 INFO:tasks.workunit.client.0.smithi002.stdout:5/905: chown d1/d2a/d6b/d88/d45/d4f/da7/fef 573185 1 2024-09-13T22:56:27.668 INFO:tasks.workunit.client.0.smithi002.stdout:1/956: chown d1/d13/d30/d73/da1/c102 10518 1 2024-09-13T22:56:27.668 INFO:tasks.workunit.client.0.smithi002.stdout:5/906: chown d1/f18 400830804 1 2024-09-13T22:56:27.668 INFO:tasks.workunit.client.0.smithi002.stdout:6/912: chown d12/d17/d34/c54 8412543 1 2024-09-13T22:56:27.669 INFO:tasks.workunit.client.1.smithi047.stdout:8/918: link d8/d64/d4e/d4d/d8f/d91/f3c d8/d64/d4e/d4d/d8f/d91/d38/d7a/f13d 0 2024-09-13T22:56:27.671 INFO:tasks.workunit.client.0.smithi002.stdout:8/919: mkdir d3/dc/d16/d89/d125 0 2024-09-13T22:56:27.671 INFO:tasks.workunit.client.1.smithi047.stdout:2/954: symlink d1/df/d35/l142 0 2024-09-13T22:56:27.675 INFO:tasks.workunit.client.0.smithi002.stdout:4/849: dread - d3/d40/f7c zero size 2024-09-13T22:56:27.680 INFO:tasks.workunit.client.1.smithi047.stdout:3/997: creat d0/d3/d4/d16/d32/d11b/f145 x:0 0 0 2024-09-13T22:56:27.682 INFO:tasks.workunit.client.1.smithi047.stdout:7/878: dwrite d0/d19/fc0 [0,4194304] 0 2024-09-13T22:56:27.683 INFO:tasks.workunit.client.0.smithi002.stdout:0/878: dread d1/d4/d75/d31/d32/dbb/fcf [0,4194304] 0 2024-09-13T22:56:27.685 INFO:tasks.workunit.client.1.smithi047.stdout:0/899: dwrite d1/f17 [0,4194304] 0 2024-09-13T22:56:27.685 INFO:tasks.workunit.client.1.smithi047.stdout:8/919: fsync d8/f32 0 2024-09-13T22:56:27.688 INFO:tasks.workunit.client.1.smithi047.stdout:9/954: write d1/dc/d14/dd/d54/fbf [687265,128453] 0 2024-09-13T22:56:27.689 INFO:tasks.workunit.client.0.smithi002.stdout:1/957: fsync d1/d13/d30/dc1/fc7 0 2024-09-13T22:56:27.691 INFO:tasks.workunit.client.1.smithi047.stdout:9/955: write d1/dc/d14/dd/d4c/df2/d132/f133 [483455,64082] 0 2024-09-13T22:56:27.693 INFO:tasks.workunit.client.0.smithi002.stdout:5/907: stat d1/d2a/d6b/d88/d45/d4f/d78/d8b/f9b 0 2024-09-13T22:56:27.695 INFO:tasks.workunit.client.0.smithi002.stdout:6/913: mkdir d12/d17/d28/d67/d6b/daa/d125 0 2024-09-13T22:56:27.698 INFO:tasks.workunit.client.0.smithi002.stdout:8/920: chown d3/dc/d16/d2f/d83/d85/f98 1004398 1 2024-09-13T22:56:27.701 INFO:tasks.workunit.client.1.smithi047.stdout:7/879: rmdir d0/d7/da/d1e 39 2024-09-13T22:56:27.706 INFO:tasks.workunit.client.1.smithi047.stdout:3/998: write d0/d3/d4/d91/d8d/fb6 [1703540,72373] 0 2024-09-13T22:56:27.708 INFO:tasks.workunit.client.1.smithi047.stdout:3/999: write d0/d3/d4/d16/d2c/de/d1f/f8e [1967169,120023] 0 2024-09-13T22:56:27.708 INFO:tasks.workunit.client.1.smithi047.stdout:2/955: mknod d1/df/d26/d4b/c143 0 2024-09-13T22:56:27.711 INFO:tasks.workunit.client.1.smithi047.stdout:0/900: rename d1/d5/d11/d2f/f38 to d1/d5/d16/d97/dfc/d45/f122 0 2024-09-13T22:56:27.712 INFO:tasks.workunit.client.1.smithi047.stdout:0/901: readlink d1/d5/d16/d97/dfc/l105 0 2024-09-13T22:56:27.715 INFO:tasks.workunit.client.1.smithi047.stdout:9/956: mknod d1/dc/d14/dd/d54/d50/d91/c146 0 2024-09-13T22:56:27.726 INFO:tasks.workunit.client.1.smithi047.stdout:2/956: mknod d1/de/db4/c144 0 2024-09-13T22:56:27.727 INFO:tasks.workunit.client.1.smithi047.stdout:0/902: creat d1/d7/dc9/f123 x:0 0 0 2024-09-13T22:56:27.728 INFO:tasks.workunit.client.1.smithi047.stdout:0/903: write d1/d5/d11/d2f/f48 [1461526,48898] 0 2024-09-13T22:56:27.729 INFO:tasks.workunit.client.1.smithi047.stdout:9/957: unlink d1/dc/d14/dd/d54/d50/d5b/d9e/f135 0 2024-09-13T22:56:27.730 INFO:tasks.workunit.client.1.smithi047.stdout:0/904: chown d1/d5/d11/d52/f72 1024190392 1 2024-09-13T22:56:27.732 INFO:tasks.workunit.client.1.smithi047.stdout:8/920: creat d8/d77/f13e x:0 0 0 2024-09-13T22:56:27.735 INFO:tasks.workunit.client.1.smithi047.stdout:7/880: dwrite d0/fca [0,4194304] 0 2024-09-13T22:56:27.736 INFO:tasks.workunit.client.1.smithi047.stdout:9/958: rmdir d1/dc/d14/dd/d4c/df2 39 2024-09-13T22:56:27.740 INFO:tasks.workunit.client.1.smithi047.stdout:8/921: symlink d8/d6b/dce/l13f 0 2024-09-13T22:56:27.743 INFO:tasks.workunit.client.1.smithi047.stdout:0/905: creat d1/d5/d11/f124 x:0 0 0 2024-09-13T22:56:27.745 INFO:tasks.workunit.client.1.smithi047.stdout:7/881: creat d0/d7/da/d105/d125/d10a/f126 x:0 0 0 2024-09-13T22:56:27.746 INFO:tasks.workunit.client.1.smithi047.stdout:9/959: dwrite d1/dc/d14/dd/d54/d4e/d51/d79/d113/d11f/f142 [0,4194304] 0 2024-09-13T22:56:27.748 INFO:tasks.workunit.client.1.smithi047.stdout:8/922: symlink d8/d3f/d8c/da6/l140 0 2024-09-13T22:56:27.750 INFO:tasks.workunit.client.1.smithi047.stdout:7/882: symlink d0/d7/da/d47/l127 0 2024-09-13T22:56:27.753 INFO:tasks.workunit.client.1.smithi047.stdout:9/960: mknod d1/d5f/de9/d107/d10c/d12a/c147 0 2024-09-13T22:56:27.755 INFO:tasks.workunit.client.1.smithi047.stdout:0/906: dwrite d1/d7/f121 [0,4194304] 0 2024-09-13T22:56:27.756 INFO:tasks.workunit.client.1.smithi047.stdout:8/923: symlink d8/d64/d4e/d4d/d8f/d116/l141 0 2024-09-13T22:56:27.760 INFO:tasks.workunit.client.1.smithi047.stdout:2/957: dwrite d1/df/d26/f10d [0,4194304] 0 2024-09-13T22:56:27.766 INFO:tasks.workunit.client.1.smithi047.stdout:2/958: fdatasync d1/df/d26/faa 0 2024-09-13T22:56:27.768 INFO:tasks.workunit.client.1.smithi047.stdout:5/839: sync 2024-09-13T22:56:27.770 INFO:tasks.workunit.client.1.smithi047.stdout:9/961: creat d1/dc/d14/dd/d4c/f148 x:0 0 0 2024-09-13T22:56:27.770 INFO:tasks.workunit.client.1.smithi047.stdout:0/907: dwrite d1/d5/d16/d97/dfc/d2d/f55 [0,4194304] 0 2024-09-13T22:56:27.772 INFO:tasks.workunit.client.1.smithi047.stdout:8/924: getdents d8/d6b/dfc/d10c 0 2024-09-13T22:56:27.774 INFO:tasks.workunit.client.1.smithi047.stdout:2/959: creat d1/df/d1d/d2e/f145 x:0 0 0 2024-09-13T22:56:27.774 INFO:tasks.workunit.client.0.smithi002.stdout:2/884: truncate d1/f14 2481830 0 2024-09-13T22:56:27.775 INFO:tasks.workunit.client.0.smithi002.stdout:9/973: rename d8/d2c/dbc/d113 to d8/d1e/d143 0 2024-09-13T22:56:27.775 INFO:tasks.workunit.client.1.smithi047.stdout:9/962: rmdir d1/d5f/d6a 39 2024-09-13T22:56:27.776 INFO:tasks.workunit.client.0.smithi002.stdout:7/897: truncate d8/d10/d39/d60/db8/d26/d4c/f8a 4068862 0 2024-09-13T22:56:27.777 INFO:tasks.workunit.client.1.smithi047.stdout:7/883: dread d0/d7/da/d1e/d93/ddf/ffa [0,4194304] 0 2024-09-13T22:56:27.777 INFO:tasks.workunit.client.1.smithi047.stdout:9/963: readlink d1/dc/d14/dd/d54/d50/d5b/d9e/l80 0 2024-09-13T22:56:27.778 INFO:tasks.workunit.client.0.smithi002.stdout:1/958: creat d1/d13/d21/d39/d70/d10c/d3d/db6/f14b x:0 0 0 2024-09-13T22:56:27.781 INFO:tasks.workunit.client.1.smithi047.stdout:2/960: dread - d1/df/d1d/d20/f9a zero size 2024-09-13T22:56:27.782 INFO:tasks.workunit.client.0.smithi002.stdout:2/885: fsync d1/d32/d37/f45 0 2024-09-13T22:56:27.782 INFO:tasks.workunit.client.0.smithi002.stdout:8/921: creat d3/dc/d16/d97/f126 x:0 0 0 2024-09-13T22:56:27.782 INFO:tasks.workunit.client.1.smithi047.stdout:2/961: chown d1/de/db4/c12d 227681 1 2024-09-13T22:56:27.782 INFO:tasks.workunit.client.0.smithi002.stdout:0/879: mknod d1/d2/c13d 0 2024-09-13T22:56:27.785 INFO:tasks.workunit.client.0.smithi002.stdout:0/880: chown d1/d4/da3/d7d/df8 178604 1 2024-09-13T22:56:27.785 INFO:tasks.workunit.client.0.smithi002.stdout:5/908: rename d1/d10/f50 to d1/d2a/d6b/d88/d45/d4f/d8f/f142 0 2024-09-13T22:56:27.786 INFO:tasks.workunit.client.1.smithi047.stdout:7/884: fsync d0/f33 0 2024-09-13T22:56:27.787 INFO:tasks.workunit.client.0.smithi002.stdout:1/959: truncate d1/d13/d30/d73/da1/d7d/df9/f126 282706 0 2024-09-13T22:56:27.788 INFO:tasks.workunit.client.0.smithi002.stdout:3/941: dwrite d9/d3b/d53/d95/f129 [4194304,4194304] 0 2024-09-13T22:56:27.793 INFO:tasks.workunit.client.0.smithi002.stdout:9/974: unlink d8/d10/d1c/d68/d74/ca1 0 2024-09-13T22:56:27.795 INFO:tasks.workunit.client.0.smithi002.stdout:9/975: dread - d8/d10/db1/ffb zero size 2024-09-13T22:56:27.798 INFO:tasks.workunit.client.1.smithi047.stdout:2/962: dread d1/df/d1d/d20/d37/d7a/fbc [0,4194304] 0 2024-09-13T22:56:27.799 INFO:tasks.workunit.client.1.smithi047.stdout:7/885: symlink d0/d7/da/d4e/dd3/l128 0 2024-09-13T22:56:27.802 INFO:tasks.workunit.client.1.smithi047.stdout:7/886: write d0/d7/da/d105/d125/d10a/f126 [953674,75377] 0 2024-09-13T22:56:27.802 INFO:tasks.workunit.client.1.smithi047.stdout:7/887: chown d0/d7/da/d47 122419237 1 2024-09-13T22:56:27.803 INFO:tasks.workunit.client.1.smithi047.stdout:7/888: chown d0/d7/f3c 4 1 2024-09-13T22:56:27.803 INFO:tasks.workunit.client.1.smithi047.stdout:8/925: rename d8/d6b/dce/d10f/l12d to d8/d64/d4e/d4d/d8f/d91/l142 0 2024-09-13T22:56:27.805 INFO:tasks.workunit.client.0.smithi002.stdout:3/942: dread d9/d3b/d53/d83/dda/fde [0,4194304] 0 2024-09-13T22:56:27.806 INFO:tasks.workunit.client.0.smithi002.stdout:2/886: creat d1/d7/d10a/f128 x:0 0 0 2024-09-13T22:56:27.806 INFO:tasks.workunit.client.0.smithi002.stdout:7/898: dread d8/d10/d39/d60/db8/d26/d38/fc6 [0,4194304] 0 2024-09-13T22:56:27.806 INFO:tasks.workunit.client.1.smithi047.stdout:5/840: getdents d19/d23/d2e/d41/d58/dfc/d5d/d9d 0 2024-09-13T22:56:27.807 INFO:tasks.workunit.client.0.smithi002.stdout:7/899: fsync d8/d10/d39/d60/db8/d26/d38/ffc 0 2024-09-13T22:56:27.808 INFO:tasks.workunit.client.0.smithi002.stdout:7/900: chown d8/d10/d39/d60/db8/d26/d4c/d81/d46 932509 1 2024-09-13T22:56:27.810 INFO:tasks.workunit.client.0.smithi002.stdout:6/914: rename d12/d17/d2a/d88 to d12/d17/ddf/d112/d126 0 2024-09-13T22:56:27.811 INFO:tasks.workunit.client.1.smithi047.stdout:0/908: link d1/d5/d11/d2f/fd9 d1/d5/d16/d97/dfc/f125 0 2024-09-13T22:56:27.814 INFO:tasks.workunit.client.1.smithi047.stdout:2/963: rename d1/df/d26/f30 to d1/d8a/da6/dc3/f146 0 2024-09-13T22:56:27.814 INFO:tasks.workunit.client.0.smithi002.stdout:7/901: dwrite d8/d10/d39/d60/db8/f1c [0,4194304] 0 2024-09-13T22:56:27.816 INFO:tasks.workunit.client.1.smithi047.stdout:7/889: dread d0/f29 [0,4194304] 0 2024-09-13T22:56:27.816 INFO:tasks.workunit.client.1.smithi047.stdout:2/964: write d1/df/d1d/da9/faf [1914207,83377] 0 2024-09-13T22:56:27.823 INFO:tasks.workunit.client.1.smithi047.stdout:0/909: truncate d1/d5/d16/d97/dfc/d77/fd4 548218 0 2024-09-13T22:56:27.824 INFO:tasks.workunit.client.1.smithi047.stdout:0/910: readlink d1/d7/ldf 0 2024-09-13T22:56:27.825 INFO:tasks.workunit.client.1.smithi047.stdout:8/926: getdents d8/d64/d4e/d4d/d8f/d91/d38/dc8 0 2024-09-13T22:56:27.825 INFO:tasks.workunit.client.1.smithi047.stdout:8/927: chown d8/d64/l7d 3 1 2024-09-13T22:56:27.830 INFO:tasks.workunit.client.1.smithi047.stdout:5/841: symlink d19/d23/d2e/d41/dc1/dfd/l106 0 2024-09-13T22:56:27.833 INFO:tasks.workunit.client.1.smithi047.stdout:5/842: read d19/d23/d4c/f52 [2937365,42662] 0 2024-09-13T22:56:27.840 INFO:tasks.workunit.client.1.smithi047.stdout:2/965: fsync d1/d16/f64 0 2024-09-13T22:56:27.843 INFO:tasks.workunit.client.1.smithi047.stdout:0/911: symlink d1/d5/d16/d47/dd0/l126 0 2024-09-13T22:56:27.843 INFO:tasks.workunit.client.1.smithi047.stdout:8/928: dread d8/d64/d4e/f49 [0,4194304] 0 2024-09-13T22:56:27.845 INFO:tasks.workunit.client.1.smithi047.stdout:7/890: dwrite d0/d7/da/d1e/f22 [0,4194304] 0 2024-09-13T22:56:27.845 INFO:tasks.workunit.client.1.smithi047.stdout:5/843: mknod d19/d23/d2e/d41/dc1/c107 0 2024-09-13T22:56:27.849 INFO:tasks.workunit.client.1.smithi047.stdout:2/966: creat d1/df/d35/dd7/f147 x:0 0 0 2024-09-13T22:56:27.850 INFO:tasks.workunit.client.1.smithi047.stdout:5/844: dread d19/d23/d2e/d41/d58/d77/fe8 [0,4194304] 0 2024-09-13T22:56:27.851 INFO:tasks.workunit.client.1.smithi047.stdout:5/845: write d19/d83/d98/fe7 [5539043,49292] 0 2024-09-13T22:56:27.853 INFO:tasks.workunit.client.1.smithi047.stdout:0/912: symlink d1/d5/d16/d97/dfc/d45/d84/l127 0 2024-09-13T22:56:27.854 INFO:tasks.workunit.client.1.smithi047.stdout:7/891: mkdir d0/d7/da/d4e/d129 0 2024-09-13T22:56:27.860 INFO:tasks.workunit.client.1.smithi047.stdout:2/967: creat d1/d107/f148 x:0 0 0 2024-09-13T22:56:27.863 INFO:tasks.workunit.client.1.smithi047.stdout:5/846: creat d19/d23/d2e/d41/dc1/f108 x:0 0 0 2024-09-13T22:56:27.865 INFO:tasks.workunit.client.1.smithi047.stdout:5/847: write d19/d64/ff2 [2986697,73330] 0 2024-09-13T22:56:27.866 INFO:tasks.workunit.client.1.smithi047.stdout:0/913: mkdir d1/ddb/d128 0 2024-09-13T22:56:27.867 INFO:tasks.workunit.client.1.smithi047.stdout:0/914: read d1/d5/d16/dc0/f107 [641825,13236] 0 2024-09-13T22:56:27.872 INFO:tasks.workunit.client.1.smithi047.stdout:2/968: mkdir d1/df/d1d/d20/d29/dcd/dff/d149 0 2024-09-13T22:56:27.874 INFO:tasks.workunit.client.1.smithi047.stdout:5/848: mkdir d19/d23/d2e/d41/d58/dfc/d5d/d80/d109 0 2024-09-13T22:56:27.877 INFO:tasks.workunit.client.1.smithi047.stdout:0/915: creat d1/d5/d11/d2f/f129 x:0 0 0 2024-09-13T22:56:27.878 INFO:tasks.workunit.client.0.smithi002.stdout:4/850: sync 2024-09-13T22:56:27.879 INFO:tasks.workunit.client.1.smithi047.stdout:8/929: getdents d8/d6b/dce 0 2024-09-13T22:56:27.883 INFO:tasks.workunit.client.1.smithi047.stdout:7/892: rmdir d0/d7/da/d1e/d112 0 2024-09-13T22:56:27.884 INFO:tasks.workunit.client.1.smithi047.stdout:0/916: dwrite d1/d5/d16/d97/dfc/d2d/f55 [0,4194304] 0 2024-09-13T22:56:27.885 INFO:tasks.workunit.client.0.smithi002.stdout:4/851: dwrite d3/d14/d29/d2a/da6/d5e/f5f [0,4194304] 0 2024-09-13T22:56:27.885 INFO:tasks.workunit.client.0.smithi002.stdout:4/852: stat d3/fac 0 2024-09-13T22:56:27.890 INFO:tasks.workunit.client.1.smithi047.stdout:5/849: symlink d19/d25/d45/l10a 0 2024-09-13T22:56:27.893 INFO:tasks.workunit.client.1.smithi047.stdout:7/893: symlink d0/d7/da/d1e/de7/l12a 0 2024-09-13T22:56:27.894 INFO:tasks.workunit.client.1.smithi047.stdout:7/894: dread - d0/d7/da/d1e/d51/f118 zero size 2024-09-13T22:56:27.900 INFO:tasks.workunit.client.1.smithi047.stdout:5/850: unlink d19/d23/d2e/d41/d58/dfc/d5d/f86 0 2024-09-13T22:56:27.903 INFO:tasks.workunit.client.1.smithi047.stdout:0/917: symlink d1/d5/d11/l12a 0 2024-09-13T22:56:27.905 INFO:tasks.workunit.client.1.smithi047.stdout:7/895: dread d0/d7/da/fcc [0,4194304] 0 2024-09-13T22:56:27.905 INFO:tasks.workunit.client.1.smithi047.stdout:0/918: stat d1/d5/d16/d97/dfc/c108 0 2024-09-13T22:56:27.908 INFO:tasks.workunit.client.1.smithi047.stdout:8/930: dread d8/f21 [0,4194304] 0 2024-09-13T22:56:27.909 INFO:tasks.workunit.client.1.smithi047.stdout:5/851: dwrite d19/d23/d32/d69/f70 [0,4194304] 0 2024-09-13T22:56:27.910 INFO:tasks.workunit.client.0.smithi002.stdout:1/960: mknod d1/d13/d21/d39/d70/d10c/d3b/d71/d80/d112/d9e/c14c 0 2024-09-13T22:56:27.911 INFO:tasks.workunit.client.1.smithi047.stdout:0/919: dread d1/d5/f10 [0,4194304] 0 2024-09-13T22:56:27.913 INFO:tasks.workunit.client.1.smithi047.stdout:0/920: chown d1/d7/f81 514 1 2024-09-13T22:56:27.915 INFO:tasks.workunit.client.0.smithi002.stdout:9/976: symlink d8/d10/d1c/d3d/d11f/da3/db9/dfa/d87/da5/d120/l144 0 2024-09-13T22:56:27.917 INFO:tasks.workunit.client.1.smithi047.stdout:5/852: creat d19/d23/d2e/d41/dc1/dfd/f10b x:0 0 0 2024-09-13T22:56:27.923 INFO:tasks.workunit.client.0.smithi002.stdout:3/943: unlink d9/d3b/c137 0 2024-09-13T22:56:27.925 INFO:tasks.workunit.client.0.smithi002.stdout:2/887: creat d1/d4d/d8b/de1/dd6/f129 x:0 0 0 2024-09-13T22:56:27.926 INFO:tasks.workunit.client.1.smithi047.stdout:0/921: mknod d1/d5/d16/d47/c12b 0 2024-09-13T22:56:27.927 INFO:tasks.workunit.client.1.smithi047.stdout:0/922: chown d1/d5/d11 884207 1 2024-09-13T22:56:27.928 INFO:tasks.workunit.client.0.smithi002.stdout:8/922: getdents d3/dc/d18/d122 0 2024-09-13T22:56:27.928 INFO:tasks.workunit.client.0.smithi002.stdout:8/923: stat d3/dc/d16/d2f/d83/d95 0 2024-09-13T22:56:27.928 INFO:tasks.workunit.client.0.smithi002.stdout:8/924: stat d3/dc/d18/d2e/ldc 0 2024-09-13T22:56:27.928 INFO:tasks.workunit.client.1.smithi047.stdout:6/980: sync 2024-09-13T22:56:27.930 INFO:tasks.workunit.client.0.smithi002.stdout:8/925: dread d3/dc/d8b/fe6 [0,4194304] 0 2024-09-13T22:56:27.931 INFO:tasks.workunit.client.1.smithi047.stdout:0/923: symlink d1/ddb/l12c 0 2024-09-13T22:56:27.934 INFO:tasks.workunit.client.0.smithi002.stdout:5/909: unlink d1/d2a/d6b/d88/d55/f7a 0 2024-09-13T22:56:27.936 INFO:tasks.workunit.client.1.smithi047.stdout:6/981: dwrite d3/d11/d2b/d1c/dbd/de8/f10d [0,4194304] 0 2024-09-13T22:56:27.939 INFO:tasks.workunit.client.1.smithi047.stdout:5/853: dread d19/d34/f40 [0,4194304] 0 2024-09-13T22:56:27.940 INFO:tasks.workunit.client.0.smithi002.stdout:5/910: dwrite d1/d57/f133 [0,4194304] 0 2024-09-13T22:56:27.941 INFO:tasks.workunit.client.1.smithi047.stdout:0/924: creat d1/d5/d16/d97/dfc/d77/f12d x:0 0 0 2024-09-13T22:56:27.943 INFO:tasks.workunit.client.1.smithi047.stdout:2/969: dwrite d1/de/fc5 [0,4194304] 0 2024-09-13T22:56:27.944 INFO:tasks.workunit.client.0.smithi002.stdout:5/911: truncate d1/d2a/d6b/d88/d55/d56/d86/d100/f104 343118 0 2024-09-13T22:56:27.952 INFO:tasks.workunit.client.0.smithi002.stdout:3/944: mknod d9/d15/d26/c146 0 2024-09-13T22:56:27.957 INFO:tasks.workunit.client.0.smithi002.stdout:9/977: read d8/fe [1563875,30203] 0 2024-09-13T22:56:27.957 INFO:tasks.workunit.client.1.smithi047.stdout:2/970: mkdir d1/df/d1d/da9/d131/d14a 0 2024-09-13T22:56:27.959 INFO:tasks.workunit.client.0.smithi002.stdout:1/961: rename d1/d13/d21/d39/d70/d10c/d3b/d71/d80/d112/d9e to d1/d13/d21/d39/d70/d10c/d3b/d71/d80/d112/d14d 0 2024-09-13T22:56:27.960 INFO:tasks.workunit.client.0.smithi002.stdout:0/881: creat d1/d7e/d9d/de6/f13e x:0 0 0 2024-09-13T22:56:27.962 INFO:tasks.workunit.client.0.smithi002.stdout:3/945: dread d9/d7e/daf/f103 [0,4194304] 0 2024-09-13T22:56:27.962 INFO:tasks.workunit.client.1.smithi047.stdout:0/925: unlink d1/d5/d16/d97/dfc/c7d 0 2024-09-13T22:56:27.962 INFO:tasks.workunit.client.1.smithi047.stdout:0/926: readlink d1/l4c 0 2024-09-13T22:56:27.962 INFO:tasks.workunit.client.1.smithi047.stdout:0/927: stat d1/d5/d11/c104 0 2024-09-13T22:56:27.964 INFO:tasks.workunit.client.0.smithi002.stdout:2/888: dwrite d1/d7/d8/d2c/da4/ffd [0,4194304] 0 2024-09-13T22:56:27.964 INFO:tasks.workunit.client.1.smithi047.stdout:6/982: creat d3/d2c/f14f x:0 0 0 2024-09-13T22:56:27.965 INFO:tasks.workunit.client.1.smithi047.stdout:6/983: fdatasync d3/d77/fe9 0 2024-09-13T22:56:27.966 INFO:tasks.workunit.client.1.smithi047.stdout:6/984: chown d3/d11/d2b/d76/d119 74962754 1 2024-09-13T22:56:27.967 INFO:tasks.workunit.client.1.smithi047.stdout:8/931: truncate d8/f2b 3806994 0 2024-09-13T22:56:27.970 INFO:tasks.workunit.client.0.smithi002.stdout:8/926: dread d3/f4f [0,4194304] 0 2024-09-13T22:56:27.971 INFO:tasks.workunit.client.0.smithi002.stdout:8/927: fdatasync d3/dc/d16/d97/fb5 0 2024-09-13T22:56:27.973 INFO:tasks.workunit.client.1.smithi047.stdout:0/928: symlink d1/d5/d11/d83/l12e 0 2024-09-13T22:56:27.975 INFO:tasks.workunit.client.1.smithi047.stdout:8/932: dwrite d8/f9e [0,4194304] 0 2024-09-13T22:56:27.980 INFO:tasks.workunit.client.1.smithi047.stdout:5/854: rename d19/d23/d2e/d41/d58/dfc/d5d/d80/cd7 to d19/d23/d2e/d41/d58/c10c 0 2024-09-13T22:56:27.980 INFO:tasks.workunit.client.1.smithi047.stdout:5/855: readlink d19/d25/l50 0 2024-09-13T22:56:27.981 INFO:tasks.workunit.client.0.smithi002.stdout:5/912: mknod d1/d2a/d6b/d88/d45/d4f/da7/daa/c143 0 2024-09-13T22:56:27.982 INFO:tasks.workunit.client.1.smithi047.stdout:5/856: truncate d19/d23/d4c/ff3 670103 0 2024-09-13T22:56:27.983 INFO:tasks.workunit.client.1.smithi047.stdout:5/857: chown d19/d25/l56 9 1 2024-09-13T22:56:27.983 INFO:tasks.workunit.client.0.smithi002.stdout:4/853: write d3/d14/d29/d2a/d30/f58 [47340,67210] 0 2024-09-13T22:56:27.983 INFO:tasks.workunit.client.1.smithi047.stdout:5/858: chown d19/d23/l89 3 1 2024-09-13T22:56:27.990 INFO:tasks.workunit.client.1.smithi047.stdout:5/859: dwrite d19/d23/d4c/fa1 [0,4194304] 0 2024-09-13T22:56:27.997 INFO:tasks.workunit.client.0.smithi002.stdout:7/902: truncate d8/d10/d39/d60/db8/d2e/d50/d52/d72/f8c 2532453 0 2024-09-13T22:56:28.001 INFO:tasks.workunit.client.0.smithi002.stdout:3/946: rmdir d9/d3b/d53/d83 39 2024-09-13T22:56:28.010 INFO:tasks.workunit.client.0.smithi002.stdout:0/882: write d1/d4/da3/f106 [1032404,116958] 0 2024-09-13T22:56:28.012 INFO:tasks.workunit.client.0.smithi002.stdout:8/928: rename d3/f20 to d3/dc/d18/d56/dd0/f127 0 2024-09-13T22:56:28.014 INFO:tasks.workunit.client.1.smithi047.stdout:2/971: link d1/de/f13 d1/df/d1d/d20/d37/df0/f14b 0 2024-09-13T22:56:28.015 INFO:tasks.workunit.client.1.smithi047.stdout:2/972: fdatasync d1/df/d1d/d20/d29/dcd/dff/f86 0 2024-09-13T22:56:28.016 INFO:tasks.workunit.client.0.smithi002.stdout:1/962: write d1/d13/d21/d39/d70/d10c/d3d/d5d/fc3 [1805799,15606] 0 2024-09-13T22:56:28.017 INFO:tasks.workunit.client.1.smithi047.stdout:2/973: write d1/df/d35/dd7/d104/f116 [1341155,8485] 0 2024-09-13T22:56:28.017 INFO:tasks.workunit.client.1.smithi047.stdout:0/929: link d1/d5/d11/d2f/l6f d1/d5/d16/d97/de4/l12f 0 2024-09-13T22:56:28.019 INFO:tasks.workunit.client.1.smithi047.stdout:6/985: truncate d3/d11/d2b/d76/daf/f100 316030 0 2024-09-13T22:56:28.020 INFO:tasks.workunit.client.0.smithi002.stdout:4/854: unlink d3/d14/d29/d2a/da6/d9f/ca4 0 2024-09-13T22:56:28.023 INFO:tasks.workunit.client.1.smithi047.stdout:8/933: rename d8/d3f/d8c/fab to d8/d64/d4e/d4d/f143 0 2024-09-13T22:56:28.030 INFO:tasks.workunit.client.1.smithi047.stdout:5/860: dwrite d19/d83/fd5 [0,4194304] 0 2024-09-13T22:56:28.031 INFO:tasks.workunit.client.1.smithi047.stdout:5/861: readlink d19/d23/d2e/l92 0 2024-09-13T22:56:28.032 INFO:tasks.workunit.client.0.smithi002.stdout:3/947: creat d9/dd1/f147 x:0 0 0 2024-09-13T22:56:28.037 INFO:tasks.workunit.client.1.smithi047.stdout:2/974: rename d1/df/d26/d4b/c53 to d1/de/db4/c14c 0 2024-09-13T22:56:28.039 INFO:tasks.workunit.client.0.smithi002.stdout:6/915: getdents d12/d17/d28/d67/d6b/daa/dc6 0 2024-09-13T22:56:28.040 INFO:tasks.workunit.client.1.smithi047.stdout:8/934: dread d8/d64/d4e/dbd/fef [0,4194304] 0 2024-09-13T22:56:28.040 INFO:tasks.workunit.client.0.smithi002.stdout:3/948: dwrite d9/d15/d36/d4e/f9f [0,4194304] 0 2024-09-13T22:56:28.045 INFO:tasks.workunit.client.1.smithi047.stdout:0/930: mkdir d1/d5/d16/d130 0 2024-09-13T22:56:28.046 INFO:tasks.workunit.client.0.smithi002.stdout:2/889: write d1/f124 [3020673,3793] 0 2024-09-13T22:56:28.047 INFO:tasks.workunit.client.1.smithi047.stdout:5/862: dwrite d19/d25/d45/f4d [0,4194304] 0 2024-09-13T22:56:28.053 INFO:tasks.workunit.client.1.smithi047.stdout:6/986: rename d3/d11/d2b/d4c/dc0/f75 to d3/d11/d2b/d1c/dbf/f150 0 2024-09-13T22:56:28.056 INFO:tasks.workunit.client.0.smithi002.stdout:8/929: write d3/dc/d18/d56/f7c [2037832,94410] 0 2024-09-13T22:56:28.058 INFO:tasks.workunit.client.1.smithi047.stdout:8/935: creat d8/d3f/d8c/da6/f144 x:0 0 0 2024-09-13T22:56:28.060 INFO:tasks.workunit.client.1.smithi047.stdout:0/931: creat d1/d5/d16/d97/dfc/d45/f131 x:0 0 0 2024-09-13T22:56:28.064 INFO:tasks.workunit.client.1.smithi047.stdout:5/863: creat d19/d23/d2e/d41/f10d x:0 0 0 2024-09-13T22:56:28.064 INFO:tasks.workunit.client.0.smithi002.stdout:4/855: write d3/d14/d29/df7/fc2 [354123,18349] 0 2024-09-13T22:56:28.065 INFO:tasks.workunit.client.1.smithi047.stdout:5/864: fdatasync d19/d83/fd5 0 2024-09-13T22:56:28.068 INFO:tasks.workunit.client.1.smithi047.stdout:9/964: sync 2024-09-13T22:56:28.068 INFO:tasks.workunit.client.1.smithi047.stdout:6/987: mknod d3/d11/d2b/d1c/d134/c151 0 2024-09-13T22:56:28.069 INFO:tasks.workunit.client.1.smithi047.stdout:8/936: fdatasync d8/d64/d4e/d4d/f7e 0 2024-09-13T22:56:28.069 INFO:tasks.workunit.client.1.smithi047.stdout:0/932: dwrite d1/d5/d16/df9/f11a [4194304,4194304] 0 2024-09-13T22:56:28.070 INFO:tasks.workunit.client.1.smithi047.stdout:9/965: stat d1/dc/d14/dd/d4c/c87 0 2024-09-13T22:56:28.071 INFO:tasks.workunit.client.0.smithi002.stdout:3/949: fsync d9/f1a 0 2024-09-13T22:56:28.072 INFO:tasks.workunit.client.0.smithi002.stdout:3/950: readlink d9/df/l87 0 2024-09-13T22:56:28.078 INFO:tasks.workunit.client.1.smithi047.stdout:2/975: write d1/df/d1d/d20/d37/fbb [1393762,81040] 0 2024-09-13T22:56:28.081 INFO:tasks.workunit.client.0.smithi002.stdout:1/963: symlink d1/d13/d30/d73/da1/d9d/l14e 0 2024-09-13T22:56:28.084 INFO:tasks.workunit.client.0.smithi002.stdout:9/978: getdents d8/d10/d1c/d68 0 2024-09-13T22:56:28.086 INFO:tasks.workunit.client.0.smithi002.stdout:7/903: write d8/d10/d39/d60/db8/d2e/d50/d52/d72/f8c [1595074,47483] 0 2024-09-13T22:56:28.088 INFO:tasks.workunit.client.0.smithi002.stdout:0/883: rename d1/d4/d75/d31/d32/fdc to d1/d4/d75/f13f 0 2024-09-13T22:56:28.093 INFO:tasks.workunit.client.1.smithi047.stdout:9/966: dread d1/dc/d14/dd/d54/d50/d5b/d9e/f56 [0,4194304] 0 2024-09-13T22:56:28.094 INFO:tasks.workunit.client.1.smithi047.stdout:0/933: rename d1/d5/d16/d97/dfc/c79 to d1/d5/d16/d97/dfc/d77/c132 0 2024-09-13T22:56:28.095 INFO:tasks.workunit.client.1.smithi047.stdout:5/865: dread d19/d23/d4c/f5e [0,4194304] 0 2024-09-13T22:56:28.096 INFO:tasks.workunit.client.0.smithi002.stdout:5/913: getdents d1/d2a/d6b/d88/d55/d56/d86 0 2024-09-13T22:56:28.096 INFO:tasks.workunit.client.0.smithi002.stdout:2/890: dread d1/d7/d35/d78/dfc/d6b/fe2 [0,4194304] 0 2024-09-13T22:56:28.097 INFO:tasks.workunit.client.1.smithi047.stdout:6/988: creat d3/d11/d2b/d1c/f152 x:0 0 0 2024-09-13T22:56:28.098 INFO:tasks.workunit.client.0.smithi002.stdout:4/856: mknod d3/d14/d29/c114 0 2024-09-13T22:56:28.098 INFO:tasks.workunit.client.0.smithi002.stdout:4/857: chown d3/d14/d29 29238613 1 2024-09-13T22:56:28.101 INFO:tasks.workunit.client.0.smithi002.stdout:9/979: truncate d8/d10/d1c/d3d/d11f/da3/db9/dfa/da8/dc3/fd1 4180009 0 2024-09-13T22:56:28.101 INFO:tasks.workunit.client.1.smithi047.stdout:7/896: sync 2024-09-13T22:56:28.102 INFO:tasks.workunit.client.1.smithi047.stdout:7/897: fsync d0/d7/da/d47/f123 0 2024-09-13T22:56:28.103 INFO:tasks.workunit.client.1.smithi047.stdout:8/937: dwrite d8/d64/d4e/d70/f9c [0,4194304] 0 2024-09-13T22:56:28.104 INFO:tasks.workunit.client.0.smithi002.stdout:8/930: rename d3/dc/d16/d2f/db7/fd1 to d3/d21/d57/da1/dbc/dfc/f128 0 2024-09-13T22:56:28.104 INFO:tasks.workunit.client.0.smithi002.stdout:8/931: stat d3/dc/fd 0 2024-09-13T22:56:28.106 INFO:tasks.workunit.client.0.smithi002.stdout:8/932: fdatasync d3/dc/d16/d2f/d83/d95/f112 0 2024-09-13T22:56:28.106 INFO:tasks.workunit.client.1.smithi047.stdout:0/934: creat d1/d5/d11/d2f/f133 x:0 0 0 2024-09-13T22:56:28.108 INFO:tasks.workunit.client.1.smithi047.stdout:0/935: chown d1/d5/d16/df9 0 1 2024-09-13T22:56:28.110 INFO:tasks.workunit.client.1.smithi047.stdout:6/989: write d3/d2c/d10b/d48/f4e [1826149,93441] 0 2024-09-13T22:56:28.110 INFO:tasks.workunit.client.1.smithi047.stdout:2/976: rename d1/df/d1d/d20/d37/df0/f14b to d1/df/d1d/d20/d2b/f14d 0 2024-09-13T22:56:28.111 INFO:tasks.workunit.client.0.smithi002.stdout:0/884: dwrite d1/d4/f7 [4194304,4194304] 0 2024-09-13T22:56:28.112 INFO:tasks.workunit.client.1.smithi047.stdout:9/967: getdents d1/dc/d14/dd/d54/d4e/d51/d128 0 2024-09-13T22:56:28.113 INFO:tasks.workunit.client.1.smithi047.stdout:9/968: fsync d1/fd5 0 2024-09-13T22:56:28.114 INFO:tasks.workunit.client.0.smithi002.stdout:2/891: dread d1/d7/d8/d2c/da4/fc0 [0,4194304] 0 2024-09-13T22:56:28.115 INFO:tasks.workunit.client.0.smithi002.stdout:2/892: chown d1/d32/d37/d79 16273032 1 2024-09-13T22:56:28.121 INFO:tasks.workunit.client.0.smithi002.stdout:7/904: mknod d8/dee/c10c 0 2024-09-13T22:56:28.122 INFO:tasks.workunit.client.1.smithi047.stdout:8/938: symlink d8/d64/d4e/d4d/d8f/d91/d38/dc8/l145 0 2024-09-13T22:56:28.124 INFO:tasks.workunit.client.1.smithi047.stdout:5/866: mknod d19/d23/d4c/d103/c10e 0 2024-09-13T22:56:28.126 INFO:tasks.workunit.client.1.smithi047.stdout:5/867: fdatasync d19/d23/d2e/d41/d58/dfc/d5d/d80/f102 0 2024-09-13T22:56:28.128 INFO:tasks.workunit.client.1.smithi047.stdout:0/936: rmdir d1/d7 39 2024-09-13T22:56:28.130 INFO:tasks.workunit.client.0.smithi002.stdout:6/916: getdents d12/d17/d34/d4b 0 2024-09-13T22:56:28.131 INFO:tasks.workunit.client.1.smithi047.stdout:2/977: read d1/f2a [927901,9772] 0 2024-09-13T22:56:28.132 INFO:tasks.workunit.client.0.smithi002.stdout:9/980: dread d8/d1e/fb8 [0,4194304] 0 2024-09-13T22:56:28.134 INFO:tasks.workunit.client.0.smithi002.stdout:9/981: write d8/d10/d61/f136 [115714,66552] 0 2024-09-13T22:56:28.135 INFO:tasks.workunit.client.0.smithi002.stdout:8/933: write d3/d27/f62 [3492034,71694] 0 2024-09-13T22:56:28.136 INFO:tasks.workunit.client.1.smithi047.stdout:7/898: dwrite d0/d7/f7a [0,4194304] 0 2024-09-13T22:56:28.138 INFO:tasks.workunit.client.1.smithi047.stdout:9/969: mkdir d1/d5f/de9/d107/d12e/d149 0 2024-09-13T22:56:28.139 INFO:tasks.workunit.client.0.smithi002.stdout:2/893: creat d1/d32/d37/f12a x:0 0 0 2024-09-13T22:56:28.141 INFO:tasks.workunit.client.1.smithi047.stdout:6/990: dwrite d3/d77/d8f/db9/fbb [0,4194304] 0 2024-09-13T22:56:28.142 INFO:tasks.workunit.client.0.smithi002.stdout:7/905: creat d8/d10/d11/d3a/f10d x:0 0 0 2024-09-13T22:56:28.144 INFO:tasks.workunit.client.1.smithi047.stdout:5/868: read d19/d23/d2e/d41/d58/faa [1077766,15143] 0 2024-09-13T22:56:28.146 INFO:tasks.workunit.client.1.smithi047.stdout:7/899: dwrite d0/d7/da/d2e/f122 [0,4194304] 0 2024-09-13T22:56:28.148 INFO:tasks.workunit.client.1.smithi047.stdout:7/900: write d0/d7/f3e [6734677,123736] 0 2024-09-13T22:56:28.148 INFO:tasks.workunit.client.1.smithi047.stdout:2/978: symlink d1/df/d1d/d20/d29/de1/l14e 0 2024-09-13T22:56:28.149 INFO:tasks.workunit.client.0.smithi002.stdout:6/917: mkdir d12/d17/d28/d67/dca/dd8/de1/d127 0 2024-09-13T22:56:28.150 INFO:tasks.workunit.client.1.smithi047.stdout:2/979: dread - d1/df/d1d/d20/d37/f101 zero size 2024-09-13T22:56:28.151 INFO:tasks.workunit.client.0.smithi002.stdout:3/951: getdents d9/d7e 0 2024-09-13T22:56:28.152 INFO:tasks.workunit.client.0.smithi002.stdout:7/906: dwrite d8/d10/d39/f9b [4194304,4194304] 0 2024-09-13T22:56:28.153 INFO:tasks.workunit.client.1.smithi047.stdout:9/970: creat d1/dc/d14/df3/f14a x:0 0 0 2024-09-13T22:56:28.153 INFO:tasks.workunit.client.1.smithi047.stdout:9/971: chown d1/d5f/dc7/le5 71271049 1 2024-09-13T22:56:28.156 INFO:tasks.workunit.client.1.smithi047.stdout:6/991: mkdir d3/d11/d2b/d1c/d4d/d69/dc2/d153 0 2024-09-13T22:56:28.157 INFO:tasks.workunit.client.1.smithi047.stdout:6/992: fdatasync d3/d77/d8f/db9/f108 0 2024-09-13T22:56:28.162 INFO:tasks.workunit.client.0.smithi002.stdout:1/964: rename d1/d13/d21/d40/dc4 to d1/d13/d1d/d14f 0 2024-09-13T22:56:28.163 INFO:tasks.workunit.client.0.smithi002.stdout:7/907: rmdir d8/d10/d39/d60/db8/d26/d4c/d81/db5 39 2024-09-13T22:56:28.169 INFO:tasks.workunit.client.1.smithi047.stdout:8/939: write d8/d64/d4e/d4d/d8f/d91/d38/ff0 [1324779,66694] 0 2024-09-13T22:56:28.174 INFO:tasks.workunit.client.1.smithi047.stdout:5/869: creat d19/d83/d98/dd0/f10f x:0 0 0 2024-09-13T22:56:28.176 INFO:tasks.workunit.client.1.smithi047.stdout:0/937: write d1/d5/d16/d47/f4a [1219802,118228] 0 2024-09-13T22:56:28.177 INFO:tasks.workunit.client.1.smithi047.stdout:0/938: chown d1/d5/d11/d2f/f129 54001979 1 2024-09-13T22:56:28.179 INFO:tasks.workunit.client.1.smithi047.stdout:6/993: rename d3/d11/d2b/d1c/dbf/c57 to d3/d11/d2b/d1c/d4d/d69/dc2/dcd/c154 0 2024-09-13T22:56:28.179 INFO:tasks.workunit.client.1.smithi047.stdout:0/939: chown d1/d5/d11/c19 110 1 2024-09-13T22:56:28.180 INFO:tasks.workunit.client.1.smithi047.stdout:7/901: mknod d0/db/c12b 0 2024-09-13T22:56:28.181 INFO:tasks.workunit.client.1.smithi047.stdout:6/994: dread - d3/d11/d2b/d4c/de2/f11f zero size 2024-09-13T22:56:28.183 INFO:tasks.workunit.client.1.smithi047.stdout:9/972: write d1/dc/d14/dd/d4c/f9a [743511,43086] 0 2024-09-13T22:56:28.183 INFO:tasks.workunit.client.1.smithi047.stdout:8/940: mknod d8/d64/d4e/dbd/d11e/c146 0 2024-09-13T22:56:28.186 INFO:tasks.workunit.client.1.smithi047.stdout:0/940: mkdir d1/ddb/d134 0 2024-09-13T22:56:28.188 INFO:tasks.workunit.client.1.smithi047.stdout:9/973: chown d1/dc/d14/dd/d4c/fa1 768014 1 2024-09-13T22:56:28.189 INFO:tasks.workunit.client.1.smithi047.stdout:7/902: symlink d0/d7/da/d4e/d129/l12c 0 2024-09-13T22:56:28.191 INFO:tasks.workunit.client.1.smithi047.stdout:2/980: dwrite d1/df/d26/d4b/f10b [0,4194304] 0 2024-09-13T22:56:28.192 INFO:tasks.workunit.client.1.smithi047.stdout:0/941: rename d1/d5/d16 to d1/d5/d16/d47/dde/d135 22 2024-09-13T22:56:28.195 INFO:tasks.workunit.client.1.smithi047.stdout:5/870: dread d19/d23/d2e/d41/d58/dfc/d5d/f8c [0,4194304] 0 2024-09-13T22:56:28.196 INFO:tasks.workunit.client.1.smithi047.stdout:7/903: write d0/d7/da/d105/d125/d10a/f126 [78799,1898] 0 2024-09-13T22:56:28.196 INFO:tasks.workunit.client.1.smithi047.stdout:6/995: creat d3/d11/d2b/d1c/f155 x:0 0 0 2024-09-13T22:56:28.199 INFO:tasks.workunit.client.1.smithi047.stdout:5/871: chown d19/c66 2 1 2024-09-13T22:56:28.200 INFO:tasks.workunit.client.1.smithi047.stdout:6/996: dread - d3/d11/d2b/d1c/dbf/f148 zero size 2024-09-13T22:56:28.202 INFO:tasks.workunit.client.1.smithi047.stdout:7/904: creat d0/d7/da/d1e/d93/f12d x:0 0 0 2024-09-13T22:56:28.204 INFO:tasks.workunit.client.1.smithi047.stdout:5/872: creat d19/d23/d2e/d41/dc1/f110 x:0 0 0 2024-09-13T22:56:28.208 INFO:tasks.workunit.client.1.smithi047.stdout:8/941: dread d8/d64/d4e/d4d/f6a [0,4194304] 0 2024-09-13T22:56:28.208 INFO:tasks.workunit.client.0.smithi002.stdout:2/894: mkdir d1/d32/d12b 0 2024-09-13T22:56:28.209 INFO:tasks.workunit.client.1.smithi047.stdout:2/981: dwrite d1/f24 [0,4194304] 0 2024-09-13T22:56:28.209 INFO:tasks.workunit.client.1.smithi047.stdout:5/873: rmdir d19/d23/d2e/dba 39 2024-09-13T22:56:28.211 INFO:tasks.workunit.client.0.smithi002.stdout:1/965: truncate d1/d13/d30/fe6 260848 0 2024-09-13T22:56:28.213 INFO:tasks.workunit.client.1.smithi047.stdout:8/942: dread d8/d3f/d8c/f90 [0,4194304] 0 2024-09-13T22:56:28.213 INFO:tasks.workunit.client.0.smithi002.stdout:8/934: creat d3/dc/d18/f129 x:0 0 0 2024-09-13T22:56:28.219 INFO:tasks.workunit.client.0.smithi002.stdout:7/908: dwrite d8/d10/f103 [0,4194304] 0 2024-09-13T22:56:28.219 INFO:tasks.workunit.client.1.smithi047.stdout:9/974: truncate d1/dc/d14/dd/d4c/df2/fab 1168481 0 2024-09-13T22:56:28.219 INFO:tasks.workunit.client.1.smithi047.stdout:6/997: dwrite d3/d11/d2b/d4c/d9d/dac/f11b [0,4194304] 0 2024-09-13T22:56:28.221 INFO:tasks.workunit.client.0.smithi002.stdout:5/914: rename d1/d57/dd0/df7/d101 to d1/d10/d144 0 2024-09-13T22:56:28.221 INFO:tasks.workunit.client.0.smithi002.stdout:9/982: dwrite d8/d10/d1c/fb0 [0,4194304] 0 2024-09-13T22:56:28.223 INFO:tasks.workunit.client.0.smithi002.stdout:0/885: dwrite d1/f1a [0,4194304] 0 2024-09-13T22:56:28.226 INFO:tasks.workunit.client.0.smithi002.stdout:2/895: stat d1/d7/d8/f8a 0 2024-09-13T22:56:28.231 INFO:tasks.workunit.client.0.smithi002.stdout:3/952: link d9/d15/d36/d4e/d5e/dae/d89/de5/l104 d9/df/d71/l148 0 2024-09-13T22:56:28.233 INFO:tasks.workunit.client.0.smithi002.stdout:0/886: dwrite d1/d4/d75/d76/f85 [0,4194304] 0 2024-09-13T22:56:28.234 INFO:tasks.workunit.client.1.smithi047.stdout:7/905: dwrite d0/d57/fe3 [0,4194304] 0 2024-09-13T22:56:28.239 INFO:tasks.workunit.client.0.smithi002.stdout:8/935: unlink d3/dc/d16/d97/ld3 0 2024-09-13T22:56:28.244 INFO:tasks.workunit.client.0.smithi002.stdout:9/983: rmdir d8/d10/db1 39 2024-09-13T22:56:28.246 INFO:tasks.workunit.client.1.smithi047.stdout:7/906: rmdir d0/d7/dc5 39 2024-09-13T22:56:28.248 INFO:tasks.workunit.client.1.smithi047.stdout:0/942: dread d1/d7/dc9/fcd [0,4194304] 0 2024-09-13T22:56:28.251 INFO:tasks.workunit.client.1.smithi047.stdout:6/998: creat d3/d11/d2b/d1c/d4d/d69/dc2/d145/f156 x:0 0 0 2024-09-13T22:56:28.251 INFO:tasks.workunit.client.1.smithi047.stdout:2/982: getdents d1/df/dc8 0 2024-09-13T22:56:28.253 INFO:tasks.workunit.client.0.smithi002.stdout:3/953: mkdir d9/d15/d36/d4e/d5e/dae/d89/df7/d149 0 2024-09-13T22:56:28.256 INFO:tasks.workunit.client.0.smithi002.stdout:0/887: unlink d1/d4/d75/d76/cac 0 2024-09-13T22:56:28.256 INFO:tasks.workunit.client.1.smithi047.stdout:9/975: dread d1/f1a [0,4194304] 0 2024-09-13T22:56:28.257 INFO:tasks.workunit.client.0.smithi002.stdout:0/888: write d1/d2/d81/fc7 [443977,117819] 0 2024-09-13T22:56:28.259 INFO:tasks.workunit.client.1.smithi047.stdout:7/907: read d0/d7/f3e [7100954,50038] 0 2024-09-13T22:56:28.268 INFO:tasks.workunit.client.1.smithi047.stdout:5/874: write d19/d23/d2e/d41/d58/dfc/d5d/fb4 [4595678,68908] 0 2024-09-13T22:56:28.268 INFO:tasks.workunit.client.1.smithi047.stdout:9/976: mknod d1/d5f/de9/d129/c14b 0 2024-09-13T22:56:28.269 INFO:tasks.workunit.client.0.smithi002.stdout:9/984: unlink d8/d2c/dbc/fcc 0 2024-09-13T22:56:28.270 INFO:tasks.workunit.client.1.smithi047.stdout:8/943: dwrite d8/d64/d4e/d4d/d8f/d91/d40/f10e [0,4194304] 0 2024-09-13T22:56:28.271 INFO:tasks.workunit.client.1.smithi047.stdout:9/977: write d1/dc/d14/dd/d54/d50/d5b/fcc [1570632,89025] 0 2024-09-13T22:56:28.274 INFO:tasks.workunit.client.1.smithi047.stdout:9/978: chown d1/dc/d14/dd/d4c/df2/l1f 977231909 1 2024-09-13T22:56:28.274 INFO:tasks.workunit.client.1.smithi047.stdout:6/999: dread d3/f26 [0,4194304] 0 2024-09-13T22:56:28.276 INFO:tasks.workunit.client.0.smithi002.stdout:2/896: write d1/da9/fd9 [778138,99352] 0 2024-09-13T22:56:28.277 INFO:tasks.workunit.client.1.smithi047.stdout:2/983: truncate d1/df/d1d/d20/d29/f2d 5892390 0 2024-09-13T22:56:28.278 INFO:tasks.workunit.client.0.smithi002.stdout:2/897: write d1/da9/f106 [763771,126327] 0 2024-09-13T22:56:28.278 INFO:tasks.workunit.client.1.smithi047.stdout:2/984: fsync d1/df/d35/dd7/f130 0 2024-09-13T22:56:28.279 INFO:tasks.workunit.client.0.smithi002.stdout:2/898: stat d1/d7/d35/d3e/d5e/ccf 0 2024-09-13T22:56:28.282 INFO:tasks.workunit.client.1.smithi047.stdout:5/875: rename d19/d23/f100 to d19/d25/d85/f111 0 2024-09-13T22:56:28.283 INFO:tasks.workunit.client.0.smithi002.stdout:2/899: dread d1/d7/d8/d2c/da4/fc0 [0,4194304] 0 2024-09-13T22:56:28.283 INFO:tasks.workunit.client.1.smithi047.stdout:5/876: dread - d19/d25/d45/ff0 zero size 2024-09-13T22:56:28.284 INFO:tasks.workunit.client.0.smithi002.stdout:8/936: write d3/dc/d18/d6f/fe1 [916135,109826] 0 2024-09-13T22:56:28.285 INFO:tasks.workunit.client.0.smithi002.stdout:8/937: chown d3/d27/l63 81 1 2024-09-13T22:56:28.287 INFO:tasks.workunit.client.1.smithi047.stdout:8/944: mknod d8/d6b/da9/dc3/c147 0 2024-09-13T22:56:28.288 INFO:tasks.workunit.client.0.smithi002.stdout:1/966: dwrite d1/d13/d21/d39/d70/d10c/d3d/d5d/f62 [0,4194304] 0 2024-09-13T22:56:28.288 INFO:tasks.workunit.client.1.smithi047.stdout:7/908: write d0/db/f50 [2520038,62019] 0 2024-09-13T22:56:28.289 INFO:tasks.workunit.client.1.smithi047.stdout:5/877: dread d19/d25/d45/f4d [0,4194304] 0 2024-09-13T22:56:28.289 INFO:tasks.workunit.client.0.smithi002.stdout:5/915: rmdir d1/d2a/d6b/d88/d55/d56/d86/d11d 0 2024-09-13T22:56:28.290 INFO:tasks.workunit.client.1.smithi047.stdout:7/909: chown d0/d7/da/d2e/db5/c4d 0 1 2024-09-13T22:56:28.293 INFO:tasks.workunit.client.0.smithi002.stdout:3/954: write d9/d7e/daf/f117 [2873310,111659] 0 2024-09-13T22:56:28.293 INFO:tasks.workunit.client.1.smithi047.stdout:9/979: mknod d1/dc/d14/dd/d54/d50/d5b/d106/c14c 0 2024-09-13T22:56:28.297 INFO:tasks.workunit.client.1.smithi047.stdout:2/985: symlink d1/df/d1d/d3c/l14f 0 2024-09-13T22:56:28.298 INFO:tasks.workunit.client.1.smithi047.stdout:7/910: dwrite d0/db/f50 [0,4194304] 0 2024-09-13T22:56:28.298 INFO:tasks.workunit.client.0.smithi002.stdout:7/909: creat d8/d10/d39/d60/db8/d2e/d50/d52/f10e x:0 0 0 2024-09-13T22:56:28.300 INFO:tasks.workunit.client.0.smithi002.stdout:7/910: write d8/d10/d39/d60/db8/d26/d38/d68/fc0 [4089096,122351] 0 2024-09-13T22:56:28.308 INFO:tasks.workunit.client.0.smithi002.stdout:3/955: creat d9/df/d71/f14a x:0 0 0 2024-09-13T22:56:28.309 INFO:tasks.workunit.client.1.smithi047.stdout:2/986: dwrite d1/df/d1d/d20/d37/fbb [0,4194304] 0 2024-09-13T22:56:28.309 INFO:tasks.workunit.client.0.smithi002.stdout:9/985: creat d8/d10/d1c/dd6/d10a/d124/f145 x:0 0 0 2024-09-13T22:56:28.310 INFO:tasks.workunit.client.0.smithi002.stdout:9/986: chown d8/d10/d1c/d3d/lb6 65197 1 2024-09-13T22:56:28.310 INFO:tasks.workunit.client.1.smithi047.stdout:2/987: chown d1/df/d35/dd7 303803797 1 2024-09-13T22:56:28.312 INFO:tasks.workunit.client.1.smithi047.stdout:5/878: dread d19/d23/f6a [0,4194304] 0 2024-09-13T22:56:28.314 INFO:tasks.workunit.client.1.smithi047.stdout:5/879: fdatasync d19/d64/ddd/de0/fe5 0 2024-09-13T22:56:28.316 INFO:tasks.workunit.client.1.smithi047.stdout:7/911: creat d0/d7/da/d47/f12e x:0 0 0 2024-09-13T22:56:28.317 INFO:tasks.workunit.client.0.smithi002.stdout:7/911: symlink d8/d10/d39/d60/db8/d2e/d50/d52/d72/d8f/l10f 0 2024-09-13T22:56:28.317 INFO:tasks.workunit.client.1.smithi047.stdout:9/980: dread d1/dc/d14/dd/d54/d50/d91/ff1 [0,4194304] 0 2024-09-13T22:56:28.319 INFO:tasks.workunit.client.0.smithi002.stdout:8/938: fsync d3/d21/f5b 0 2024-09-13T22:56:28.323 INFO:tasks.workunit.client.0.smithi002.stdout:3/956: rmdir d9/d7e 39 2024-09-13T22:56:28.326 INFO:tasks.workunit.client.0.smithi002.stdout:9/987: symlink d8/d2c/dbc/dc8/dd0/l146 0 2024-09-13T22:56:28.327 INFO:tasks.workunit.client.0.smithi002.stdout:5/916: dread d1/f2f [0,4194304] 0 2024-09-13T22:56:28.330 INFO:tasks.workunit.client.0.smithi002.stdout:7/912: symlink d8/d10/d39/d60/db8/d2e/d50/d85/l110 0 2024-09-13T22:56:28.330 INFO:tasks.workunit.client.0.smithi002.stdout:7/913: chown d8/d10/d39/d60/db8/f1c 2045813 1 2024-09-13T22:56:28.333 INFO:tasks.workunit.client.1.smithi047.stdout:7/912: fsync d0/f67 0 2024-09-13T22:56:28.336 INFO:tasks.workunit.client.1.smithi047.stdout:9/981: mkdir d1/dc/d14/dd/d54/d50/d5b/d9e/d101/d14d 0 2024-09-13T22:56:28.338 INFO:tasks.workunit.client.0.smithi002.stdout:5/917: dread d1/d2a/d6b/d88/d45/d4f/d78/fac [0,4194304] 0 2024-09-13T22:56:28.338 INFO:tasks.workunit.client.0.smithi002.stdout:2/900: write d1/d7/d35/d78/f4b [32578,12553] 0 2024-09-13T22:56:28.340 INFO:tasks.workunit.client.0.smithi002.stdout:2/901: chown d1/d7/l2a 69292385 1 2024-09-13T22:56:28.341 INFO:tasks.workunit.client.1.smithi047.stdout:8/945: write d8/d64/d4e/d4d/d8f/f13a [547715,99526] 0 2024-09-13T22:56:28.345 INFO:tasks.workunit.client.1.smithi047.stdout:7/913: symlink d0/d57/d5b/d5c/db6/df3/l12f 0 2024-09-13T22:56:28.345 INFO:tasks.workunit.client.0.smithi002.stdout:8/939: dread d3/dc/d16/d2f/d83/d95/fc2 [0,4194304] 0 2024-09-13T22:56:28.350 INFO:tasks.workunit.client.1.smithi047.stdout:2/988: dwrite d1/df/d1d/d20/f9a [0,4194304] 0 2024-09-13T22:56:28.351 INFO:tasks.workunit.client.0.smithi002.stdout:7/914: creat d8/d10/d39/d60/db8/d2e/d50/d52/f111 x:0 0 0 2024-09-13T22:56:28.353 INFO:tasks.workunit.client.0.smithi002.stdout:8/940: symlink d3/dc/da4/l12a 0 2024-09-13T22:56:28.354 INFO:tasks.workunit.client.1.smithi047.stdout:5/880: dwrite d19/d23/d2e/d41/fdc [0,4194304] 0 2024-09-13T22:56:28.356 INFO:tasks.workunit.client.0.smithi002.stdout:4/858: sync 2024-09-13T22:56:28.356 INFO:tasks.workunit.client.0.smithi002.stdout:2/902: dwrite d1/d7/d8/d2c/da4/fc0 [0,4194304] 0 2024-09-13T22:56:28.357 INFO:tasks.workunit.client.1.smithi047.stdout:8/946: symlink d8/d64/d104/d138/l148 0 2024-09-13T22:56:28.357 INFO:tasks.workunit.client.1.smithi047.stdout:7/914: mkdir d0/d7/da/d4e/dd1/d130 0 2024-09-13T22:56:28.360 INFO:tasks.workunit.client.0.smithi002.stdout:8/941: chown d3/dc/d18/d2e/d94/f7b 255 1 2024-09-13T22:56:28.360 INFO:tasks.workunit.client.0.smithi002.stdout:5/918: dread d1/d57/dd0/df7/f138 [0,4194304] 0 2024-09-13T22:56:28.360 INFO:tasks.workunit.client.0.smithi002.stdout:3/957: dwrite d9/d15/d36/d4e/d5e/dae/d89/df7/f101 [0,4194304] 0 2024-09-13T22:56:28.363 INFO:tasks.workunit.client.0.smithi002.stdout:5/919: chown d1/d2a/d6b/d88/d45/f61 851 1 2024-09-13T22:56:28.364 INFO:tasks.workunit.client.1.smithi047.stdout:5/881: chown d19/d23/d2e/d41/c8b 16193460 1 2024-09-13T22:56:28.366 INFO:tasks.workunit.client.0.smithi002.stdout:9/988: dread d8/d10/d1c/d3d/d11f/da3/db9/dfa/d87/fdf [0,4194304] 0 2024-09-13T22:56:28.366 INFO:tasks.workunit.client.0.smithi002.stdout:8/942: chown d3/dc/d18/d6f/c105 42 1 2024-09-13T22:56:28.374 INFO:tasks.workunit.client.1.smithi047.stdout:9/982: dwrite d1/dc/d14/dd/d54/f8c [0,4194304] 0 2024-09-13T22:56:28.374 INFO:tasks.workunit.client.0.smithi002.stdout:4/859: write d3/d14/d29/d2a/da6/fcf [1688706,22995] 0 2024-09-13T22:56:28.376 INFO:tasks.workunit.client.1.smithi047.stdout:9/983: fsync d1/dc/d14/dd/d4c/fac 0 2024-09-13T22:56:28.377 INFO:tasks.workunit.client.0.smithi002.stdout:5/920: mknod d1/d2a/d6b/d88/d45/d4f/da7/daa/c145 0 2024-09-13T22:56:28.378 INFO:tasks.workunit.client.1.smithi047.stdout:8/947: mkdir d8/d64/d149 0 2024-09-13T22:56:28.379 INFO:tasks.workunit.client.1.smithi047.stdout:9/984: fdatasync d1/dc/d14/dd/d54/d50/d5b/d9e/d101/f102 0 2024-09-13T22:56:28.379 INFO:tasks.workunit.client.0.smithi002.stdout:5/921: read d1/d2a/d6b/d88/d55/d56/d81/f105 [6884073,79001] 0 2024-09-13T22:56:28.380 INFO:tasks.workunit.client.1.smithi047.stdout:2/989: dread d1/de/f13 [0,4194304] 0 2024-09-13T22:56:28.381 INFO:tasks.workunit.client.1.smithi047.stdout:5/882: mkdir d19/d23/d2e/d41/d58/dfc/d105/d112 0 2024-09-13T22:56:28.383 INFO:tasks.workunit.client.1.smithi047.stdout:5/883: fdatasync d19/d23/d2e/d41/dc1/f108 0 2024-09-13T22:56:28.383 INFO:tasks.workunit.client.0.smithi002.stdout:7/915: creat d8/d10/d39/d60/db8/d2e/d3c/d3e/f112 x:0 0 0 2024-09-13T22:56:28.386 INFO:tasks.workunit.client.1.smithi047.stdout:7/915: creat d0/d57/d5b/f131 x:0 0 0 2024-09-13T22:56:28.387 INFO:tasks.workunit.client.0.smithi002.stdout:4/860: symlink d3/d14/d86/db1/l115 0 2024-09-13T22:56:28.389 INFO:tasks.workunit.client.0.smithi002.stdout:8/943: mknod d3/dc/d16/d2f/d83/d85/dba/d124/c12b 0 2024-09-13T22:56:28.390 INFO:tasks.workunit.client.1.smithi047.stdout:5/884: dread - d19/d23/d2e/d41/d58/dfc/d5d/d80/f102 zero size 2024-09-13T22:56:28.391 INFO:tasks.workunit.client.0.smithi002.stdout:3/958: dread d9/d15/f11d [0,4194304] 0 2024-09-13T22:56:28.392 INFO:tasks.workunit.client.1.smithi047.stdout:9/985: dwrite d1/dc/d14/dd/d54/d4e/d51/d79/d113/d11f/f142 [0,4194304] 0 2024-09-13T22:56:28.392 INFO:tasks.workunit.client.1.smithi047.stdout:8/948: rename d8/d3f/d8c/da6/f144 to d8/d64/d4e/d4d/dda/f14a 0 2024-09-13T22:56:28.395 INFO:tasks.workunit.client.1.smithi047.stdout:2/990: creat d1/df/d1d/d20/d29/dcd/dff/f150 x:0 0 0 2024-09-13T22:56:28.398 INFO:tasks.workunit.client.1.smithi047.stdout:7/916: unlink d0/d7/da/d4e/dd3/cde 0 2024-09-13T22:56:28.399 INFO:tasks.workunit.client.0.smithi002.stdout:3/959: dwrite d9/d3b/d7c/f145 [0,4194304] 0 2024-09-13T22:56:28.400 INFO:tasks.workunit.client.1.smithi047.stdout:2/991: dread d1/f97 [0,4194304] 0 2024-09-13T22:56:28.402 INFO:tasks.workunit.client.0.smithi002.stdout:8/944: chown d3/dc/d16/d60/da7/l10a 1669 1 2024-09-13T22:56:28.402 INFO:tasks.workunit.client.1.smithi047.stdout:5/885: creat d19/d23/d2e/d41/d58/dfc/d5d/f113 x:0 0 0 2024-09-13T22:56:28.403 INFO:tasks.workunit.client.0.smithi002.stdout:8/945: fsync d3/dc/d16/d97/fb5 0 2024-09-13T22:56:28.407 INFO:tasks.workunit.client.0.smithi002.stdout:7/916: dread d8/d10/d39/d60/db8/d2e/d3c/f48 [0,4194304] 0 2024-09-13T22:56:28.409 INFO:tasks.workunit.client.1.smithi047.stdout:9/986: truncate d1/dc/d14/dd/d54/d50/d91/faf 2171912 0 2024-09-13T22:56:28.413 INFO:tasks.workunit.client.1.smithi047.stdout:7/917: rmdir d0/d57/d5b 39 2024-09-13T22:56:28.414 INFO:tasks.workunit.client.0.smithi002.stdout:5/922: write d1/d2a/d6b/d88/d55/d56/dc7/fe8 [1424996,128135] 0 2024-09-13T22:56:28.415 INFO:tasks.workunit.client.0.smithi002.stdout:8/946: chown d3/dc/d16/l87 314222805 1 2024-09-13T22:56:28.416 INFO:tasks.workunit.client.0.smithi002.stdout:8/947: fsync d3/d21/d57/fc4 0 2024-09-13T22:56:28.417 INFO:tasks.workunit.client.0.smithi002.stdout:4/861: dread d3/d14/d29/d2a/fd4 [0,4194304] 0 2024-09-13T22:56:28.419 INFO:tasks.workunit.client.1.smithi047.stdout:8/949: write d8/d64/dc5/fe8 [39012,53952] 0 2024-09-13T22:56:28.421 INFO:tasks.workunit.client.0.smithi002.stdout:7/917: dread d8/d10/d39/d60/db8/d2e/d3c/f91 [0,4194304] 0 2024-09-13T22:56:28.425 INFO:tasks.workunit.client.1.smithi047.stdout:5/886: write d19/d23/d4c/fa4 [791804,39323] 0 2024-09-13T22:56:28.427 INFO:tasks.workunit.client.1.smithi047.stdout:9/987: truncate d1/d5f/d6a/f13a 363140 0 2024-09-13T22:56:28.428 INFO:tasks.workunit.client.0.smithi002.stdout:8/948: rename d3/dc/d18/f23 to d3/d27/da3/f12c 0 2024-09-13T22:56:28.431 INFO:tasks.workunit.client.1.smithi047.stdout:5/887: dwrite d19/f36 [0,4194304] 0 2024-09-13T22:56:28.432 INFO:tasks.workunit.client.0.smithi002.stdout:4/862: fdatasync d3/d14/d29/d2a/da6/f90 0 2024-09-13T22:56:28.432 INFO:tasks.workunit.client.0.smithi002.stdout:5/923: dwrite d1/d2a/d5a/fa6 [4194304,4194304] 0 2024-09-13T22:56:28.433 INFO:tasks.workunit.client.1.smithi047.stdout:8/950: mknod d8/d64/d4e/d4d/d8f/d91/de2/c14b 0 2024-09-13T22:56:28.442 INFO:tasks.workunit.client.1.smithi047.stdout:2/992: write d1/df/d1d/d2e/d5e/f13c [1005319,19614] 0 2024-09-13T22:56:28.444 INFO:tasks.workunit.client.0.smithi002.stdout:3/960: getdents d9/d15/d35 0 2024-09-13T22:56:28.445 INFO:tasks.workunit.client.1.smithi047.stdout:2/993: truncate d1/df/d26/d4b/f50 5038319 0 2024-09-13T22:56:28.445 INFO:tasks.workunit.client.0.smithi002.stdout:3/961: write d9/dd1/f12d [310887,121453] 0 2024-09-13T22:56:28.454 INFO:tasks.workunit.client.1.smithi047.stdout:8/951: dread d8/d64/d4e/d4d/d8f/d91/f3a [0,4194304] 0 2024-09-13T22:56:28.454 INFO:tasks.workunit.client.0.smithi002.stdout:4/863: dread d3/d14/d29/d2a/f44 [0,4194304] 0 2024-09-13T22:56:28.455 INFO:tasks.workunit.client.0.smithi002.stdout:8/949: dwrite d3/dc/d16/d60/da7/fb1 [0,4194304] 0 2024-09-13T22:56:28.456 INFO:tasks.workunit.client.0.smithi002.stdout:7/918: mknod d8/d10/d39/d60/db8/d2e/d3c/d3e/c113 0 2024-09-13T22:56:28.457 INFO:tasks.workunit.client.1.smithi047.stdout:7/918: creat d0/d57/f132 x:0 0 0 2024-09-13T22:56:28.457 INFO:tasks.workunit.client.0.smithi002.stdout:7/919: readlink d8/d10/d39/d60/db8/d26/d38/lc2 0 2024-09-13T22:56:28.457 INFO:tasks.workunit.client.0.smithi002.stdout:5/924: creat d1/d2a/d6b/d88/d55/d56/d86/d100/f146 x:0 0 0 2024-09-13T22:56:28.461 INFO:tasks.workunit.client.1.smithi047.stdout:2/994: fsync d1/d16/f64 0 2024-09-13T22:56:28.467 INFO:tasks.workunit.client.1.smithi047.stdout:2/995: truncate d1/df/d35/dd7/dca/d10e/f125 87335 0 2024-09-13T22:56:28.467 INFO:tasks.workunit.client.1.smithi047.stdout:5/888: dwrite d19/d23/f6a [0,4194304] 0 2024-09-13T22:56:28.472 INFO:tasks.workunit.client.1.smithi047.stdout:5/889: dread - d19/d83/d98/dd0/f10f zero size 2024-09-13T22:56:28.472 INFO:tasks.workunit.client.1.smithi047.stdout:2/996: chown d1/df/d1d/d20/d37/d85 532622856 1 2024-09-13T22:56:28.473 INFO:tasks.workunit.client.1.smithi047.stdout:5/890: write d19/d23/d2e/d41/f10d [541643,116837] 0 2024-09-13T22:56:28.474 INFO:tasks.workunit.client.0.smithi002.stdout:5/925: mknod d1/d10/d144/c147 0 2024-09-13T22:56:28.475 INFO:tasks.workunit.client.0.smithi002.stdout:4/864: write d3/d14/d86/fd1 [219851,13339] 0 2024-09-13T22:56:28.475 INFO:tasks.workunit.client.0.smithi002.stdout:5/926: stat d1/d2a/d6b/ff8 0 2024-09-13T22:56:28.478 INFO:tasks.workunit.client.0.smithi002.stdout:3/962: symlink d9/d3b/l14b 0 2024-09-13T22:56:28.480 INFO:tasks.workunit.client.0.smithi002.stdout:3/963: dread - d9/d3b/da5/d120/f12e zero size 2024-09-13T22:56:28.481 INFO:tasks.workunit.client.0.smithi002.stdout:7/920: dread d8/d10/d39/d60/db8/d2e/d50/d52/fd7 [0,4194304] 0 2024-09-13T22:56:28.482 INFO:tasks.workunit.client.0.smithi002.stdout:5/927: dread d1/d2a/d6b/d88/d45/d4f/da7/daa/f134 [0,4194304] 0 2024-09-13T22:56:28.483 INFO:tasks.workunit.client.0.smithi002.stdout:4/865: mkdir d3/d14/d29/d2a/da6/d69/d7e/dca/df3/d116 0 2024-09-13T22:56:28.484 INFO:tasks.workunit.client.0.smithi002.stdout:8/950: dwrite d3/d27/d39/f3b [4194304,4194304] 0 2024-09-13T22:56:28.486 INFO:tasks.workunit.client.0.smithi002.stdout:3/964: dread - d9/d7e/ff5 zero size 2024-09-13T22:56:28.486 INFO:tasks.workunit.client.0.smithi002.stdout:4/866: truncate d3/d14/d86/fd1 574578 0 2024-09-13T22:56:28.487 INFO:tasks.workunit.client.0.smithi002.stdout:3/965: readlink d9/df/l87 0 2024-09-13T22:56:28.487 INFO:tasks.workunit.client.0.smithi002.stdout:7/921: dread d8/d10/d39/d60/db8/f1c [0,4194304] 0 2024-09-13T22:56:28.489 INFO:tasks.workunit.client.0.smithi002.stdout:7/922: stat d8/d10/d39/d60/db8/d26/d4c/d81/d51/cc8 0 2024-09-13T22:56:28.491 INFO:tasks.workunit.client.0.smithi002.stdout:6/918: sync 2024-09-13T22:56:28.491 INFO:tasks.workunit.client.0.smithi002.stdout:0/889: sync 2024-09-13T22:56:28.494 INFO:tasks.workunit.client.0.smithi002.stdout:8/951: creat d3/d27/d39/d80/f12d x:0 0 0 2024-09-13T22:56:28.495 INFO:tasks.workunit.client.0.smithi002.stdout:8/952: chown d3/dc/d18/c9a 130205284 1 2024-09-13T22:56:28.497 INFO:tasks.workunit.client.0.smithi002.stdout:3/966: truncate d9/d7e/dce/d111/f11a 907134 0 2024-09-13T22:56:28.505 INFO:tasks.workunit.client.0.smithi002.stdout:6/919: dread - d12/d17/d34/d39/d8a/de4/f103 zero size 2024-09-13T22:56:28.506 INFO:tasks.workunit.client.0.smithi002.stdout:6/920: dread - d12/d17/d34/d4b/fa0 zero size 2024-09-13T22:56:28.507 INFO:tasks.workunit.client.0.smithi002.stdout:3/967: fsync d9/d3b/d7c/f9c 0 2024-09-13T22:56:28.510 INFO:tasks.workunit.client.0.smithi002.stdout:7/923: write d8/d10/d39/d60/db8/d2e/d50/f61 [1772494,39367] 0 2024-09-13T22:56:28.512 INFO:tasks.workunit.client.0.smithi002.stdout:5/928: write d1/d2a/d6b/d88/d55/fee [67211,13667] 0 2024-09-13T22:56:28.515 INFO:tasks.workunit.client.0.smithi002.stdout:6/921: fsync d12/d17/d34/f124 0 2024-09-13T22:56:28.522 INFO:tasks.workunit.client.0.smithi002.stdout:0/890: creat d1/d7e/d9d/de6/f140 x:0 0 0 2024-09-13T22:56:28.524 INFO:tasks.workunit.client.0.smithi002.stdout:5/929: mkdir d1/d10/d148 0 2024-09-13T22:56:28.530 INFO:tasks.workunit.client.0.smithi002.stdout:7/924: mknod d8/d10/d39/d60/db8/d26/d88/c114 0 2024-09-13T22:56:28.530 INFO:tasks.workunit.client.0.smithi002.stdout:3/968: dread d9/d3b/d53/d83/fe4 [0,4194304] 0 2024-09-13T22:56:28.531 INFO:tasks.workunit.client.0.smithi002.stdout:7/925: read - d8/d10/d39/d60/db8/d26/d38/ffc zero size 2024-09-13T22:56:28.532 INFO:tasks.workunit.client.0.smithi002.stdout:5/930: mkdir d1/d108/d149 0 2024-09-13T22:56:28.533 INFO:tasks.workunit.client.0.smithi002.stdout:7/926: write d8/d10/f1e [2105708,20058] 0 2024-09-13T22:56:28.536 INFO:tasks.workunit.client.1.smithi047.stdout:7/919: creat d0/d7/da/d105/d125/d10a/f133 x:0 0 0 2024-09-13T22:56:28.537 INFO:tasks.workunit.client.0.smithi002.stdout:3/969: symlink d9/d15/d36/d4e/d5e/dae/d89/de5/l14c 0 2024-09-13T22:56:28.539 INFO:tasks.workunit.client.1.smithi047.stdout:9/988: rmdir d1/dc/d14/dd/d54/d50/d91/da3/d143 0 2024-09-13T22:56:28.547 INFO:tasks.workunit.client.1.smithi047.stdout:8/952: unlink d8/d64/d4e/c46 0 2024-09-13T22:56:28.548 INFO:tasks.workunit.client.0.smithi002.stdout:3/970: dread d9/d15/d26/f85 [0,4194304] 0 2024-09-13T22:56:28.551 INFO:tasks.workunit.client.1.smithi047.stdout:9/989: chown d1/dc/d14/f4d 7719829 1 2024-09-13T22:56:28.552 INFO:tasks.workunit.client.0.smithi002.stdout:6/922: link d12/d17/ddf/d112/d126/c8d d12/d17/d28/d7d/c128 0 2024-09-13T22:56:28.554 INFO:tasks.workunit.client.1.smithi047.stdout:5/891: unlink d19/d83/d98/dd0/lfe 0 2024-09-13T22:56:28.555 INFO:tasks.workunit.client.0.smithi002.stdout:0/891: write d1/d4/da3/d7d/df8/f47 [4676944,102223] 0 2024-09-13T22:56:28.556 INFO:tasks.workunit.client.1.smithi047.stdout:5/892: chown d19/d23/d2e/d41/d58/dfc/d5d/fb4 25856886 1 2024-09-13T22:56:28.558 INFO:tasks.workunit.client.1.smithi047.stdout:7/920: unlink d0/d7/da/d2e/db5/l111 0 2024-09-13T22:56:28.559 INFO:tasks.workunit.client.0.smithi002.stdout:3/971: truncate d9/d15/d36/d4e/d5e/f105 442980 0 2024-09-13T22:56:28.560 INFO:tasks.workunit.client.1.smithi047.stdout:9/990: mkdir d1/dc/d14/df3/d14e 0 2024-09-13T22:56:28.562 INFO:tasks.workunit.client.0.smithi002.stdout:6/923: mknod d12/d17/d28/d67/d6b/c129 0 2024-09-13T22:56:28.563 INFO:tasks.workunit.client.0.smithi002.stdout:5/931: write d1/d10/f51 [6386,117739] 0 2024-09-13T22:56:28.563 INFO:tasks.workunit.client.1.smithi047.stdout:5/893: symlink d19/d23/d2e/d41/d58/dfc/l114 0 2024-09-13T22:56:28.563 INFO:tasks.workunit.client.0.smithi002.stdout:6/924: write d12/f24 [1655863,118315] 0 2024-09-13T22:56:28.570 INFO:tasks.workunit.client.1.smithi047.stdout:7/921: mkdir d0/d7/da/d4e/d10d/d134 0 2024-09-13T22:56:28.571 INFO:tasks.workunit.client.0.smithi002.stdout:5/932: dwrite d1/d57/f133 [4194304,4194304] 0 2024-09-13T22:56:28.571 INFO:tasks.workunit.client.1.smithi047.stdout:9/991: mknod d1/dc/d14/dd/d54/d50/d5b/d9e/d101/d14d/c14f 0 2024-09-13T22:56:28.573 INFO:tasks.workunit.client.0.smithi002.stdout:7/927: getdents d8/d10/d39/d60/db8/d26/d4c/d81/db6 0 2024-09-13T22:56:28.580 INFO:tasks.workunit.client.1.smithi047.stdout:5/894: mkdir d19/d23/d115 0 2024-09-13T22:56:28.583 INFO:tasks.workunit.client.0.smithi002.stdout:0/892: rename d1/d2/f6b to d1/d4/d75/d31/de0/f141 0 2024-09-13T22:56:28.584 INFO:tasks.workunit.client.1.smithi047.stdout:7/922: creat d0/d7/da/d1e/de7/df4/f135 x:0 0 0 2024-09-13T22:56:28.590 INFO:tasks.workunit.client.0.smithi002.stdout:3/972: dwrite d9/d15/d26/f6e [0,4194304] 0 2024-09-13T22:56:28.590 INFO:tasks.workunit.client.1.smithi047.stdout:5/895: rename d19/d25/d85 to d19/d23/d4c/d103/d116 0 2024-09-13T22:56:28.591 INFO:tasks.workunit.client.0.smithi002.stdout:0/893: dwrite d1/d4/da3/f106 [0,4194304] 0 2024-09-13T22:56:28.598 INFO:tasks.workunit.client.0.smithi002.stdout:5/933: rename d1/d10/l3c to d1/d2a/d6b/d88/d13d/l14a 0 2024-09-13T22:56:28.599 INFO:tasks.workunit.client.1.smithi047.stdout:7/923: mkdir d0/db/de8/d136 0 2024-09-13T22:56:28.601 INFO:tasks.workunit.client.1.smithi047.stdout:7/924: chown d0/d7/da/d2e/d64/fc3 33569 1 2024-09-13T22:56:28.605 INFO:tasks.workunit.client.0.smithi002.stdout:6/925: truncate d12/d17/d28/d67/ff3 3387655 0 2024-09-13T22:56:28.609 INFO:tasks.workunit.client.1.smithi047.stdout:7/925: dwrite d0/d7/da/d2e/d64/fc3 [4194304,4194304] 0 2024-09-13T22:56:28.609 INFO:tasks.workunit.client.0.smithi002.stdout:3/973: creat d9/d15/d26/d93/f14d x:0 0 0 2024-09-13T22:56:28.615 INFO:tasks.workunit.client.1.smithi047.stdout:5/896: symlink d19/d83/d98/l117 0 2024-09-13T22:56:28.615 INFO:tasks.workunit.client.1.smithi047.stdout:0/943: sync 2024-09-13T22:56:28.618 INFO:tasks.workunit.client.1.smithi047.stdout:7/926: mkdir d0/db/de8/d137 0 2024-09-13T22:56:28.620 INFO:tasks.workunit.client.0.smithi002.stdout:5/934: write d1/d2a/d6b/d88/d55/d56/d86/d100/f104 [981685,124168] 0 2024-09-13T22:56:28.620 INFO:tasks.workunit.client.1.smithi047.stdout:9/992: dwrite d1/dc/d14/dd/d54/d50/d60/db0/fca [0,4194304] 0 2024-09-13T22:56:28.623 INFO:tasks.workunit.client.1.smithi047.stdout:5/897: unlink d19/d25/fc9 0 2024-09-13T22:56:28.635 INFO:tasks.workunit.client.0.smithi002.stdout:0/894: link d1/d4/da3/f106 d1/d7e/d9d/de6/f142 0 2024-09-13T22:56:28.636 INFO:tasks.workunit.client.1.smithi047.stdout:7/927: fdatasync d0/d19/f1c 0 2024-09-13T22:56:28.640 INFO:tasks.workunit.client.0.smithi002.stdout:6/926: write d12/d17/d34/d39/d8a/f8e [89101,56073] 0 2024-09-13T22:56:28.641 INFO:tasks.workunit.client.1.smithi047.stdout:0/944: write d1/f40 [1357750,58901] 0 2024-09-13T22:56:28.642 INFO:tasks.workunit.client.1.smithi047.stdout:5/898: mknod d19/d25/c118 0 2024-09-13T22:56:28.644 INFO:tasks.workunit.client.1.smithi047.stdout:5/899: chown d19/d23/d2e/d41/d58/dfc/d5d/fed 6406376 1 2024-09-13T22:56:28.646 INFO:tasks.workunit.client.0.smithi002.stdout:0/895: unlink d1/d4/d75/c7c 0 2024-09-13T22:56:28.646 INFO:tasks.workunit.client.1.smithi047.stdout:5/900: write d19/d23/d2e/d41/d58/fe9 [677,66757] 0 2024-09-13T22:56:28.647 INFO:tasks.workunit.client.1.smithi047.stdout:5/901: write d19/d23/d4c/f7b [3816260,69228] 0 2024-09-13T22:56:28.648 INFO:tasks.workunit.client.0.smithi002.stdout:3/974: getdents d9/d3b/da5/d120 0 2024-09-13T22:56:28.650 INFO:tasks.workunit.client.1.smithi047.stdout:7/928: dread d0/d7/da/d47/fa1 [0,4194304] 0 2024-09-13T22:56:28.650 INFO:tasks.workunit.client.0.smithi002.stdout:5/935: dwrite d1/d2a/ff2 [0,4194304] 0 2024-09-13T22:56:28.650 INFO:tasks.workunit.client.0.smithi002.stdout:6/927: mkdir d12/d17/d34/d39/d8b/d12a 0 2024-09-13T22:56:28.653 INFO:tasks.workunit.client.1.smithi047.stdout:0/945: readlink d1/d5/d16/d6a/lf8 0 2024-09-13T22:56:28.657 INFO:tasks.workunit.client.0.smithi002.stdout:3/975: rename d9/d3b/fe9 to d9/d7e/daf/d143/f14e 0 2024-09-13T22:56:28.660 INFO:tasks.workunit.client.1.smithi047.stdout:9/993: dwrite d1/dc/d14/da0/faa [0,4194304] 0 2024-09-13T22:56:28.666 INFO:tasks.workunit.client.1.smithi047.stdout:5/902: dread d19/d23/d2e/d41/d58/d77/fe8 [0,4194304] 0 2024-09-13T22:56:28.668 INFO:tasks.workunit.client.1.smithi047.stdout:5/903: dread - d19/d83/d98/dd0/ffa zero size 2024-09-13T22:56:28.668 INFO:tasks.workunit.client.0.smithi002.stdout:6/928: rename d12/d17/d28/d67/d6b/f78 to d12/d17/d28/d67/dca/dd8/de1/d127/f12b 0 2024-09-13T22:56:28.673 INFO:tasks.workunit.client.0.smithi002.stdout:0/896: write d1/d4/fba [620726,103716] 0 2024-09-13T22:56:28.674 INFO:tasks.workunit.client.0.smithi002.stdout:0/897: dread d1/f1a [0,4194304] 0 2024-09-13T22:56:28.674 INFO:tasks.workunit.client.1.smithi047.stdout:0/946: dread d1/d5/f8c [0,4194304] 0 2024-09-13T22:56:28.675 INFO:tasks.workunit.client.1.smithi047.stdout:0/947: dread - d1/d5/d11/d2f/f133 zero size 2024-09-13T22:56:28.676 INFO:tasks.workunit.client.0.smithi002.stdout:6/929: unlink d12/d17/d102/l10e 0 2024-09-13T22:56:28.679 INFO:tasks.workunit.client.0.smithi002.stdout:1/967: sync 2024-09-13T22:56:28.680 INFO:tasks.workunit.client.0.smithi002.stdout:9/989: sync 2024-09-13T22:56:28.680 INFO:tasks.workunit.client.0.smithi002.stdout:2/903: sync 2024-09-13T22:56:28.711 INFO:tasks.workunit.client.1.smithi047.stdout:2/997: sync 2024-09-13T22:56:28.711 INFO:tasks.workunit.client.1.smithi047.stdout:2/998: chown d1/d16/d40/fe6 390291539 1 2024-09-13T22:56:28.712 INFO:tasks.workunit.client.1.smithi047.stdout:2/999: chown d1/df/d35/d8b/fbf 1996 1 2024-09-13T22:56:28.748 INFO:tasks.workunit.client.0.smithi002.stdout:4/867: sync 2024-09-13T22:56:28.748 INFO:tasks.workunit.client.0.smithi002.stdout:4/868: chown d3/d40/ceb 0 1 2024-09-13T22:56:28.759 INFO:tasks.workunit.client.1.smithi047.stdout:8/953: sync 2024-09-13T22:56:28.760 INFO:tasks.workunit.client.1.smithi047.stdout:8/954: readlink d8/d6b/dce/l13f 0 2024-09-13T22:56:28.761 INFO:tasks.workunit.client.1.smithi047.stdout:8/955: readlink d8/d64/d4e/d4d/d8f/d91/d78/l10b 0 2024-09-13T22:56:28.806 INFO:tasks.workunit.client.0.smithi002.stdout:7/928: sync 2024-09-13T22:56:28.807 INFO:tasks.workunit.client.0.smithi002.stdout:8/953: sync 2024-09-13T22:56:28.808 INFO:tasks.workunit.client.0.smithi002.stdout:7/929: dread d8/d10/d39/d60/db8/d2e/d3c/f91 [0,4194304] 0 2024-09-13T22:56:28.818 INFO:tasks.workunit.client.0.smithi002.stdout:3/976: symlink d9/d15/d36/d4e/d5e/dae/d89/df7/d149/l14f 0 2024-09-13T22:56:28.824 INFO:tasks.workunit.client.1.smithi047.stdout:7/929: dwrite d0/d7/da/d4e/f70 [0,4194304] 0 2024-09-13T22:56:28.828 INFO:tasks.workunit.client.1.smithi047.stdout:9/994: mkdir d1/d5f/de9/d107/d12e/d149/d150 0 2024-09-13T22:56:28.829 INFO:tasks.workunit.client.1.smithi047.stdout:7/930: dread d0/d7/da/d2e/d64/f6a [0,4194304] 0 2024-09-13T22:56:28.832 INFO:tasks.workunit.client.0.smithi002.stdout:0/898: rename d1/d4/da3/fa5 to d1/d4/d114/f143 0 2024-09-13T22:56:28.834 INFO:tasks.workunit.client.1.smithi047.stdout:0/948: read - d1/d5/d16/d97/dfc/d45/d7f/fb3 zero size 2024-09-13T22:56:28.836 INFO:tasks.workunit.client.0.smithi002.stdout:1/968: read d1/d13/d30/f99 [1068960,15434] 0 2024-09-13T22:56:28.837 INFO:tasks.workunit.client.1.smithi047.stdout:9/995: dwrite d1/dc/d14/dd/d54/d50/d91/da3/fa9 [0,4194304] 0 2024-09-13T22:56:28.838 INFO:tasks.workunit.client.1.smithi047.stdout:8/956: readlink d8/d64/d4e/d4d/d8f/d91/d38/l6f 0 2024-09-13T22:56:28.893 INFO:tasks.workunit.client.1.smithi047.stdout:0/949: link d1/d5/d16/f9a d1/d5/d16/f136 0 2024-09-13T22:56:28.895 INFO:tasks.workunit.client.1.smithi047.stdout:0/950: write d1/d5/d16/d47/f4a [1884457,126169] 0 2024-09-13T22:56:28.900 INFO:tasks.workunit.client.1.smithi047.stdout:0/951: dread - d1/d5/d16/fdc zero size 2024-09-13T22:56:28.912 INFO:tasks.workunit.client.1.smithi047.stdout:0/952: link d1/d5/d16/d97/f109 d1/d5/d16/d97/dfc/d2d/f137 0 2024-09-13T22:56:28.938 INFO:tasks.workunit.client.0.smithi002.stdout:7/930: creat d8/d10/d39/d60/db8/d2e/d50/d52/d99/f115 x:0 0 0 2024-09-13T22:56:28.938 INFO:tasks.workunit.client.0.smithi002.stdout:3/977: creat d9/df/d71/f150 x:0 0 0 2024-09-13T22:56:28.941 INFO:tasks.workunit.client.0.smithi002.stdout:5/936: getdents d1/d2a/d6b/d88/d45/d4f/da7/daa 0 2024-09-13T22:56:28.945 INFO:tasks.workunit.client.0.smithi002.stdout:9/990: creat d8/d10/d42/ddd/f147 x:0 0 0 2024-09-13T22:56:28.945 INFO:tasks.workunit.client.0.smithi002.stdout:9/991: readlink d8/l125 0 2024-09-13T22:56:28.946 INFO:tasks.workunit.client.0.smithi002.stdout:3/978: symlink d9/d3b/d53/db9/df2/l151 0 2024-09-13T22:56:28.948 INFO:tasks.workunit.client.0.smithi002.stdout:5/937: rmdir d1/d2a/d6b/d88/d45/d4f/d78 39 2024-09-13T22:56:28.953 INFO:tasks.workunit.client.0.smithi002.stdout:3/979: fsync d9/d15/d36/d4e/d5e/dae/d89/f123 0 2024-09-13T22:56:28.954 INFO:tasks.workunit.client.0.smithi002.stdout:5/938: symlink d1/d2a/d6b/d88/d45/df4/l14b 0 2024-09-13T22:56:28.956 INFO:tasks.workunit.client.0.smithi002.stdout:9/992: unlink d8/d10/db1/fe5 0 2024-09-13T22:56:28.957 INFO:tasks.workunit.client.0.smithi002.stdout:3/980: truncate d9/d15/f2f 798474 0 2024-09-13T22:56:28.958 INFO:tasks.workunit.client.0.smithi002.stdout:3/981: read - d9/d3b/da5/d120/f12e zero size 2024-09-13T22:56:28.962 INFO:tasks.workunit.client.0.smithi002.stdout:9/993: creat d8/d2c/d50/f148 x:0 0 0 2024-09-13T22:56:28.962 INFO:tasks.workunit.client.0.smithi002.stdout:9/994: chown d8/d10/dc4/dde 371 1 2024-09-13T22:56:28.966 INFO:tasks.workunit.client.0.smithi002.stdout:5/939: symlink d1/d2a/d6b/d88/d45/d4f/db7/d112/l14c 0 2024-09-13T22:56:28.970 INFO:tasks.workunit.client.0.smithi002.stdout:9/995: read d8/d10/d1c/d3d/f7e [1732408,97968] 0 2024-09-13T22:56:28.973 INFO:tasks.workunit.client.0.smithi002.stdout:9/996: symlink d8/d10/d1c/dd6/d10a/l149 0 2024-09-13T22:56:28.981 INFO:tasks.workunit.client.0.smithi002.stdout:5/940: link d1/d2a/d6b/d88/d45/d4f/db7/lcc d1/d2a/d6b/d88/d45/d4f/d78/d8b/ddb/l14d 0 2024-09-13T22:56:28.984 INFO:tasks.workunit.client.0.smithi002.stdout:5/941: mkdir d1/d2a/d6b/d88/d45/d4f/db7/d112/d14e 0 2024-09-13T22:56:28.986 INFO:tasks.workunit.client.0.smithi002.stdout:5/942: fdatasync d1/d10/f3d 0 2024-09-13T22:56:28.987 INFO:tasks.workunit.client.0.smithi002.stdout:9/997: dread d8/d10/d1c/d3d/d11f/fee [0,4194304] 0 2024-09-13T22:56:28.988 INFO:tasks.workunit.client.0.smithi002.stdout:9/998: truncate d8/d10/d1c/d3d/f92 1537417 0 2024-09-13T22:56:28.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:28 smithi002 ceph-mon[27637]: pgmap v24: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 123 MiB/s rd, 259 MiB/s wr, 617 op/s 2024-09-13T22:56:29.015 INFO:tasks.workunit.client.1.smithi047.stdout:9/996: rename d1/dc/d14/dd/d54/d50/d5b/d9e/c76 to d1/dc/d14/df3/d14e/c151 0 2024-09-13T22:56:29.021 INFO:tasks.workunit.client.1.smithi047.stdout:9/997: getdents d1 0 2024-09-13T22:56:29.023 INFO:tasks.workunit.client.1.smithi047.stdout:9/998: symlink d1/dc/d14/df3/d14e/l152 0 2024-09-13T22:56:29.033 INFO:tasks.workunit.client.0.smithi002.stdout:0/899: mknod d1/d4/da3/d7d/df8/df4/c144 0 2024-09-13T22:56:29.034 INFO:tasks.workunit.client.0.smithi002.stdout:0/900: fdatasync d1/d4/d75/d31/f65 0 2024-09-13T22:56:29.034 INFO:tasks.workunit.client.1.smithi047.stdout:5/904: truncate d19/d34/d6c/f8d 3704727 0 2024-09-13T22:56:29.035 INFO:tasks.workunit.client.0.smithi002.stdout:7/931: sync 2024-09-13T22:56:29.036 INFO:tasks.workunit.client.0.smithi002.stdout:0/901: write d1/d2/d6c/f129 [5480315,119112] 0 2024-09-13T22:56:29.046 INFO:tasks.workunit.client.0.smithi002.stdout:7/932: creat d8/d10/d39/d60/db8/d2e/d3c/f116 x:0 0 0 2024-09-13T22:56:29.047 INFO:tasks.workunit.client.0.smithi002.stdout:0/902: dread d1/d2/fd [0,4194304] 0 2024-09-13T22:56:29.052 INFO:tasks.workunit.client.0.smithi002.stdout:7/933: dwrite d8/d10/d39/d60/db8/d26/d4c/d81/db6/fe2 [0,4194304] 0 2024-09-13T22:56:29.056 INFO:tasks.workunit.client.1.smithi047.stdout:8/957: write d8/d64/d4e/d4d/f7e [559216,86418] 0 2024-09-13T22:56:29.059 INFO:tasks.workunit.client.1.smithi047.stdout:8/958: chown d8/l29 808 1 2024-09-13T22:56:29.063 INFO:tasks.workunit.client.1.smithi047.stdout:8/959: write d8/d64/d4e/d4d/d8f/d91/f3a [2816067,66085] 0 2024-09-13T22:56:29.065 INFO:tasks.workunit.client.1.smithi047.stdout:8/960: stat d8/d64/d4e/d4d/dda/c108 0 2024-09-13T22:56:29.067 INFO:tasks.workunit.client.1.smithi047.stdout:8/961: mkdir d8/d64/d4e/d4d/d8f/d116/d14c 0 2024-09-13T22:56:29.070 INFO:tasks.workunit.client.1.smithi047.stdout:8/962: mkdir d8/d6b/dce/d135/d14d 0 2024-09-13T22:56:29.073 INFO:tasks.workunit.client.1.smithi047.stdout:8/963: creat d8/d64/d4e/d4d/d8f/d116/f14e x:0 0 0 2024-09-13T22:56:29.079 INFO:tasks.workunit.client.1.smithi047.stdout:8/964: dwrite d8/d64/f47 [0,4194304] 0 2024-09-13T22:56:29.084 INFO:tasks.workunit.client.1.smithi047.stdout:8/965: getdents d8/d64/d4e/dbd/d11e 0 2024-09-13T22:56:29.085 INFO:tasks.workunit.client.1.smithi047.stdout:0/953: dwrite d1/d5/d16/d97/dfc/d45/d84/fc7 [0,4194304] 0 2024-09-13T22:56:29.090 INFO:tasks.workunit.client.1.smithi047.stdout:0/954: mknod d1/d7/dc9/c138 0 2024-09-13T22:56:29.094 INFO:tasks.workunit.client.1.smithi047.stdout:8/966: creat d8/d3f/f14f x:0 0 0 2024-09-13T22:56:29.095 INFO:tasks.workunit.client.1.smithi047.stdout:8/967: chown d8/d6b/da9 905 1 2024-09-13T22:56:29.099 INFO:tasks.workunit.client.0.smithi002.stdout:0/903: creat d1/d4/d75/d31/de0/f145 x:0 0 0 2024-09-13T22:56:29.101 INFO:tasks.workunit.client.0.smithi002.stdout:0/904: chown d1/d4/da3/d7d/df8 3403899 1 2024-09-13T22:56:29.104 INFO:tasks.workunit.client.0.smithi002.stdout:1/969: dwrite d1/d13/d21/d40/f5c [0,4194304] 0 2024-09-13T22:56:29.107 INFO:tasks.workunit.client.0.smithi002.stdout:0/905: creat d1/d4/d75/d31/de0/d102/d138/f146 x:0 0 0 2024-09-13T22:56:29.109 INFO:tasks.workunit.client.0.smithi002.stdout:0/906: chown d1/d4/d75/d31/d32 17 1 2024-09-13T22:56:29.110 INFO:tasks.workunit.client.0.smithi002.stdout:1/970: dread d1/d13/d21/d39/d70/d10c/d3d/d5d/f62 [0,4194304] 0 2024-09-13T22:56:29.110 INFO:tasks.workunit.client.0.smithi002.stdout:3/982: truncate d9/d15/d51/fcc 882144 0 2024-09-13T22:56:29.112 INFO:tasks.workunit.client.0.smithi002.stdout:3/983: creat d9/d3b/d53/d83/f152 x:0 0 0 2024-09-13T22:56:29.113 INFO:tasks.workunit.client.0.smithi002.stdout:3/984: chown d9/d15/f42 185 1 2024-09-13T22:56:29.113 INFO:tasks.workunit.client.0.smithi002.stdout:0/907: creat d1/d4/d75/d76/f147 x:0 0 0 2024-09-13T22:56:29.114 INFO:tasks.workunit.client.0.smithi002.stdout:1/971: creat d1/d13/d21/d39/d70/d10c/d3b/f150 x:0 0 0 2024-09-13T22:56:29.115 INFO:tasks.workunit.client.0.smithi002.stdout:0/908: write d1/d4/d75/dca/ff9 [447212,4468] 0 2024-09-13T22:56:29.116 INFO:tasks.workunit.client.0.smithi002.stdout:3/985: creat d9/d15/d51/deb/f153 x:0 0 0 2024-09-13T22:56:29.118 INFO:tasks.workunit.client.0.smithi002.stdout:0/909: creat d1/d7e/f148 x:0 0 0 2024-09-13T22:56:29.120 INFO:tasks.workunit.client.0.smithi002.stdout:5/943: write d1/fe [176544,705] 0 2024-09-13T22:56:29.122 INFO:tasks.workunit.client.0.smithi002.stdout:9/999: truncate d8/d10/d1c/d3d/d11f/da3/db9/dfa/d87/da5/d94/deb/f110 1152240 0 2024-09-13T22:56:29.123 INFO:tasks.workunit.client.1.smithi047.stdout:7/931: unlink d0/d57/c11e 0 2024-09-13T22:56:29.123 INFO:tasks.workunit.client.0.smithi002.stdout:5/944: truncate d1/d2a/d6b/f71 4735908 0 2024-09-13T22:56:29.127 INFO:tasks.workunit.client.1.smithi047.stdout:7/932: dread d0/faf [0,4194304] 0 2024-09-13T22:56:29.128 INFO:tasks.workunit.client.0.smithi002.stdout:6/930: rename d12/d17/d28/d67/dca/fd9 to d12/d17/d34/d39/f12c 0 2024-09-13T22:56:29.130 INFO:tasks.workunit.client.0.smithi002.stdout:3/986: dread d9/d15/d46/fcf [0,4194304] 0 2024-09-13T22:56:29.130 INFO:tasks.workunit.client.1.smithi047.stdout:7/933: rename d0/d7/da/d4e/caa to d0/d57/dee/c138 0 2024-09-13T22:56:29.132 INFO:tasks.workunit.client.0.smithi002.stdout:2/904: rename d1/d7/d8/d2c/f82 to d1/d32/d37/f12c 0 2024-09-13T22:56:29.134 INFO:tasks.workunit.client.0.smithi002.stdout:6/931: creat d12/d17/d34/d39/f12d x:0 0 0 2024-09-13T22:56:29.135 INFO:tasks.workunit.client.1.smithi047.stdout:7/934: symlink d0/d7/da/d105/d125/l139 0 2024-09-13T22:56:29.135 INFO:tasks.workunit.client.0.smithi002.stdout:5/945: dread d1/d2a/d6b/d88/d55/d56/d81/fa5 [0,4194304] 0 2024-09-13T22:56:29.135 INFO:tasks.workunit.client.0.smithi002.stdout:6/932: readlink d12/d17/d28/d67/dca/dd8/de1/l104 0 2024-09-13T22:56:29.138 INFO:tasks.workunit.client.0.smithi002.stdout:8/954: rename d3/dc/d16/d4b/d72/d73/f9f to d3/d27/d39/f12e 0 2024-09-13T22:56:29.139 INFO:tasks.workunit.client.0.smithi002.stdout:4/869: link d3/d14/d29/d2a/da6/d69/fe8 d3/db3/f117 0 2024-09-13T22:56:29.141 INFO:tasks.workunit.client.1.smithi047.stdout:7/935: unlink d0/d7/da/d1e/c9a 0 2024-09-13T22:56:29.143 INFO:tasks.workunit.client.0.smithi002.stdout:2/905: mknod d1/d4d/d8b/de1/c12d 0 2024-09-13T22:56:29.144 INFO:tasks.workunit.client.0.smithi002.stdout:3/987: creat d9/d15/d51/deb/d144/f154 x:0 0 0 2024-09-13T22:56:29.144 INFO:tasks.workunit.client.0.smithi002.stdout:8/955: dwrite d3/dc/d8b/f113 [0,4194304] 0 2024-09-13T22:56:29.145 INFO:tasks.workunit.client.1.smithi047.stdout:9/999: write d1/dc/d14/dd/d54/d4e/fea [385653,29786] 0 2024-09-13T22:56:29.146 INFO:tasks.workunit.client.0.smithi002.stdout:5/946: mknod d1/d2a/d6b/d88/d55/d56/d86/d100/c14f 0 2024-09-13T22:56:29.153 INFO:tasks.workunit.client.0.smithi002.stdout:2/906: rmdir d1/d7/d8 39 2024-09-13T22:56:29.155 INFO:tasks.workunit.client.0.smithi002.stdout:3/988: fdatasync d9/d15/d35/fd7 0 2024-09-13T22:56:29.155 INFO:tasks.workunit.client.1.smithi047.stdout:7/936: dread d0/d7/da/fcc [0,4194304] 0 2024-09-13T22:56:29.158 INFO:tasks.workunit.client.1.smithi047.stdout:5/905: truncate d19/d83/d98/fe7 1507138 0 2024-09-13T22:56:29.161 INFO:tasks.workunit.client.1.smithi047.stdout:5/906: read d19/d23/d2e/d41/d58/f97 [1520201,128062] 0 2024-09-13T22:56:29.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:28 smithi047 ceph-mon[34560]: pgmap v24: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 123 MiB/s rd, 259 MiB/s wr, 617 op/s 2024-09-13T22:56:29.165 INFO:tasks.workunit.client.1.smithi047.stdout:7/937: mkdir d0/d7/da/d4e/d10d/d134/d13a 0 2024-09-13T22:56:29.166 INFO:tasks.workunit.client.0.smithi002.stdout:2/907: fdatasync d1/d7/d41/fc2 0 2024-09-13T22:56:29.175 INFO:tasks.workunit.client.0.smithi002.stdout:7/934: rename d8/d10/d39/d60/db8/d26/d38/d84 to d8/d117 0 2024-09-13T22:56:29.181 INFO:tasks.workunit.client.0.smithi002.stdout:1/972: rename d1/d13/d21/d39/d70/d10c/d3d/ca3 to d1/d13/d30/d73/c151 0 2024-09-13T22:56:29.182 INFO:tasks.workunit.client.0.smithi002.stdout:7/935: mknod d8/d10/d39/d60/db8/d2e/d50/d52/db1/c118 0 2024-09-13T22:56:29.185 INFO:tasks.workunit.client.1.smithi047.stdout:0/955: write d1/d7/f6c [4201918,103353] 0 2024-09-13T22:56:29.187 INFO:tasks.workunit.client.0.smithi002.stdout:0/910: rename d1/df6 to d1/d7e/d9d/de3/d149 0 2024-09-13T22:56:29.189 INFO:tasks.workunit.client.1.smithi047.stdout:8/968: write d8/d64/d4e/d4d/d8f/d91/de2/fea [52641,60770] 0 2024-09-13T22:56:29.190 INFO:tasks.workunit.client.1.smithi047.stdout:0/956: truncate d1/ffd 22009 0 2024-09-13T22:56:29.191 INFO:tasks.workunit.client.1.smithi047.stdout:8/969: creat d8/d64/d4e/d4d/dda/f150 x:0 0 0 2024-09-13T22:56:29.196 INFO:tasks.workunit.client.1.smithi047.stdout:0/957: dread d1/d5/d16/dc0/f107 [0,4194304] 0 2024-09-13T22:56:29.197 INFO:tasks.workunit.client.1.smithi047.stdout:0/958: chown d1/d5/d11/c34 1 1 2024-09-13T22:56:29.198 INFO:tasks.workunit.client.1.smithi047.stdout:0/959: chown d1/f69 1034362 1 2024-09-13T22:56:29.202 INFO:tasks.workunit.client.1.smithi047.stdout:8/970: dwrite d8/f9 [4194304,4194304] 0 2024-09-13T22:56:29.204 INFO:tasks.workunit.client.0.smithi002.stdout:1/973: link d1/d13/d1d/d34/d51/dc6/c132 d1/d13/d1d/d34/dfe/c152 0 2024-09-13T22:56:29.205 INFO:tasks.workunit.client.0.smithi002.stdout:1/974: chown d1/d13/d1d/d14f 319 1 2024-09-13T22:56:29.207 INFO:tasks.workunit.client.1.smithi047.stdout:0/960: dwrite d1/d5/d16/fac [0,4194304] 0 2024-09-13T22:56:29.211 INFO:tasks.workunit.client.0.smithi002.stdout:1/975: rename d1/d13/d1d/d34/d51/c6e to d1/d13/d30/d73/da1/d12a/c153 0 2024-09-13T22:56:29.213 INFO:tasks.workunit.client.0.smithi002.stdout:1/976: read - d1/d13/d30/d73/da1/d12a/d135/f14a zero size 2024-09-13T22:56:29.216 INFO:tasks.workunit.client.0.smithi002.stdout:1/977: write d1/d13/d1d/d14f/f13d [4935386,30102] 0 2024-09-13T22:56:29.220 INFO:tasks.workunit.client.0.smithi002.stdout:1/978: dread d1/d13/d1d/f75 [0,4194304] 0 2024-09-13T22:56:29.224 INFO:tasks.workunit.client.0.smithi002.stdout:6/933: write d12/d17/d34/fa9 [2414609,39390] 0 2024-09-13T22:56:29.227 INFO:tasks.workunit.client.0.smithi002.stdout:6/934: creat d12/d17/d34/d39/d8b/f12e x:0 0 0 2024-09-13T22:56:29.228 INFO:tasks.workunit.client.1.smithi047.stdout:5/907: fsync d19/d34/d6c/f8d 0 2024-09-13T22:56:29.230 INFO:tasks.workunit.client.0.smithi002.stdout:5/947: write d1/d2a/d6b/d88/d45/f76 [4449934,123842] 0 2024-09-13T22:56:29.231 INFO:tasks.workunit.client.1.smithi047.stdout:5/908: creat d19/d25/d45/f119 x:0 0 0 2024-09-13T22:56:29.233 INFO:tasks.workunit.client.0.smithi002.stdout:8/956: dwrite d3/dc/d18/f5a [4194304,4194304] 0 2024-09-13T22:56:29.233 INFO:tasks.workunit.client.0.smithi002.stdout:5/948: write d1/d2a/d6b/d88/d55/d56/d86/f123 [1409381,74440] 0 2024-09-13T22:56:29.235 INFO:tasks.workunit.client.0.smithi002.stdout:3/989: write d9/d15/f30 [1760590,60552] 0 2024-09-13T22:56:29.235 INFO:tasks.workunit.client.1.smithi047.stdout:5/909: mknod d19/d23/c11a 0 2024-09-13T22:56:29.237 INFO:tasks.workunit.client.0.smithi002.stdout:8/957: stat d3/dc/d16/d2f/d83/d95/fb0 0 2024-09-13T22:56:29.238 INFO:tasks.workunit.client.0.smithi002.stdout:5/949: creat d1/de7/f150 x:0 0 0 2024-09-13T22:56:29.240 INFO:tasks.workunit.client.0.smithi002.stdout:3/990: write d9/d15/d26/d93/f14d [721731,13753] 0 2024-09-13T22:56:29.240 INFO:tasks.workunit.client.0.smithi002.stdout:5/950: read d1/f3 [846075,29251] 0 2024-09-13T22:56:29.241 INFO:tasks.workunit.client.0.smithi002.stdout:4/870: dwrite d3/d14/d29/d2a/da6/d69/d7e/dca/df3/f112 [4194304,4194304] 0 2024-09-13T22:56:29.242 INFO:tasks.workunit.client.1.smithi047.stdout:7/938: write d0/d57/d5b/d8b/fb8 [239509,70822] 0 2024-09-13T22:56:29.243 INFO:tasks.workunit.client.0.smithi002.stdout:0/911: write d1/d2/faf [1023970,61979] 0 2024-09-13T22:56:29.246 INFO:tasks.workunit.client.0.smithi002.stdout:7/936: truncate d8/d10/d39/d60/db8/d26/d4c/fa7 1206684 0 2024-09-13T22:56:29.247 INFO:tasks.workunit.client.0.smithi002.stdout:2/908: dwrite d1/d7/d8/d2c/f2d [0,4194304] 0 2024-09-13T22:56:29.252 INFO:tasks.workunit.client.0.smithi002.stdout:5/951: creat d1/d2a/d6b/d88/d13d/f151 x:0 0 0 2024-09-13T22:56:29.256 INFO:tasks.workunit.client.1.smithi047.stdout:7/939: symlink d0/d7/da/d4e/dd1/d130/l13b 0 2024-09-13T22:56:29.258 INFO:tasks.workunit.client.0.smithi002.stdout:2/909: chown d1/d7/d41/d96/c9a 194 1 2024-09-13T22:56:29.261 INFO:tasks.workunit.client.1.smithi047.stdout:0/961: dread d1/d7/f121 [0,4194304] 0 2024-09-13T22:56:29.262 INFO:tasks.workunit.client.1.smithi047.stdout:7/940: mknod d0/d7/da/d105/c13c 0 2024-09-13T22:56:29.263 INFO:tasks.workunit.client.0.smithi002.stdout:1/979: write d1/d13/d30/d73/da1/f4c [5819870,44398] 0 2024-09-13T22:56:29.264 INFO:tasks.workunit.client.0.smithi002.stdout:5/952: readlink d1/d2a/d6b/d88/d45/d4f/d78/d8b/ddb/l14d 0 2024-09-13T22:56:29.266 INFO:tasks.workunit.client.1.smithi047.stdout:0/962: creat d1/d5/d91/f139 x:0 0 0 2024-09-13T22:56:29.269 INFO:tasks.workunit.client.1.smithi047.stdout:7/941: mknod d0/d7/da/d105/d125/c13d 0 2024-09-13T22:56:29.270 INFO:tasks.workunit.client.0.smithi002.stdout:6/935: truncate d12/d17/d34/d4b/fcd 3820618 0 2024-09-13T22:56:29.272 INFO:tasks.workunit.client.1.smithi047.stdout:0/963: unlink d1/d7/ldf 0 2024-09-13T22:56:29.273 INFO:tasks.workunit.client.0.smithi002.stdout:2/910: symlink d1/d4d/d8b/de1/dd6/d11d/l12e 0 2024-09-13T22:56:29.275 INFO:tasks.workunit.client.0.smithi002.stdout:7/937: read d8/d10/d39/d60/db8/d26/d4c/d81/db5/fd5 [1125912,26813] 0 2024-09-13T22:56:29.275 INFO:tasks.workunit.client.1.smithi047.stdout:7/942: rmdir d0/d57/d5b/d8b 39 2024-09-13T22:56:29.275 INFO:tasks.workunit.client.1.smithi047.stdout:7/943: readlink d0/l107 0 2024-09-13T22:56:29.276 INFO:tasks.workunit.client.0.smithi002.stdout:8/958: getdents d3/dc/d16/d97 0 2024-09-13T22:56:29.276 INFO:tasks.workunit.client.0.smithi002.stdout:8/959: stat d3/dc/fd9 0 2024-09-13T22:56:29.281 INFO:tasks.workunit.client.1.smithi047.stdout:7/944: dread d0/d57/d5b/d5c/db6/df3/ff8 [0,4194304] 0 2024-09-13T22:56:29.282 INFO:tasks.workunit.client.0.smithi002.stdout:6/936: rmdir d12 39 2024-09-13T22:56:29.284 INFO:tasks.workunit.client.0.smithi002.stdout:2/911: unlink d1/f6a 0 2024-09-13T22:56:29.285 INFO:tasks.workunit.client.1.smithi047.stdout:5/910: dwrite d19/d83/d98/dd0/fe1 [0,4194304] 0 2024-09-13T22:56:29.285 INFO:tasks.workunit.client.0.smithi002.stdout:4/871: dwrite d3/d40/f8b [0,4194304] 0 2024-09-13T22:56:29.293 INFO:tasks.workunit.client.1.smithi047.stdout:7/945: symlink d0/d7/l13e 0 2024-09-13T22:56:29.297 INFO:tasks.workunit.client.0.smithi002.stdout:0/912: dwrite d1/d4/da3/f64 [0,4194304] 0 2024-09-13T22:56:29.309 INFO:tasks.workunit.client.1.smithi047.stdout:5/911: link d19/d34/d6c/l76 d19/d23/d2e/d41/d58/dfc/l11b 0 2024-09-13T22:56:29.310 INFO:tasks.workunit.client.0.smithi002.stdout:2/912: read d1/d7/d8/fdd [316151,95311] 0 2024-09-13T22:56:29.311 INFO:tasks.workunit.client.0.smithi002.stdout:4/872: mkdir d3/d62/d118 0 2024-09-13T22:56:29.312 INFO:tasks.workunit.client.1.smithi047.stdout:0/964: dwrite d1/d5/d16/d47/dde/fe0 [0,4194304] 0 2024-09-13T22:56:29.317 INFO:tasks.workunit.client.0.smithi002.stdout:5/953: creat d1/d2a/d6b/d88/d55/f152 x:0 0 0 2024-09-13T22:56:29.320 INFO:tasks.workunit.client.1.smithi047.stdout:7/946: write d0/db/fc [1592887,46602] 0 2024-09-13T22:56:29.321 INFO:tasks.workunit.client.0.smithi002.stdout:1/980: link d1/f27 d1/d13/d30/d73/da1/d12a/f154 0 2024-09-13T22:56:29.322 INFO:tasks.workunit.client.0.smithi002.stdout:8/960: dwrite d3/dc/d18/d2e/d94/fd6 [0,4194304] 0 2024-09-13T22:56:29.322 INFO:tasks.workunit.client.1.smithi047.stdout:5/912: dread d19/d34/d6c/f8d [0,4194304] 0 2024-09-13T22:56:29.323 INFO:tasks.workunit.client.0.smithi002.stdout:1/981: chown d1/d13/d21/d39/d70/d10c/d3b/f136 419984 1 2024-09-13T22:56:29.324 INFO:tasks.workunit.client.1.smithi047.stdout:0/965: unlink d1/d5/d16/d97/dfc/d77/fd4 0 2024-09-13T22:56:29.329 INFO:tasks.workunit.client.0.smithi002.stdout:8/961: dwrite d3/d27/f117 [0,4194304] 0 2024-09-13T22:56:29.333 INFO:tasks.workunit.client.1.smithi047.stdout:0/966: mknod d1/d5/d16/d97/dfc/d77/c13a 0 2024-09-13T22:56:29.335 INFO:tasks.workunit.client.1.smithi047.stdout:5/913: symlink d19/d23/d2e/d41/d58/l11c 0 2024-09-13T22:56:29.336 INFO:tasks.workunit.client.1.smithi047.stdout:5/914: read - d19/d23/d2e/d41/dc1/f108 zero size 2024-09-13T22:56:29.337 INFO:tasks.workunit.client.1.smithi047.stdout:7/947: write d0/f33 [2397124,40826] 0 2024-09-13T22:56:29.340 INFO:tasks.workunit.client.0.smithi002.stdout:4/873: write d3/d14/d29/d2a/da6/d69/d7e/faf [592128,69519] 0 2024-09-13T22:56:29.340 INFO:tasks.workunit.client.0.smithi002.stdout:7/938: dread d8/d10/d39/d60/db8/d26/d4c/fa7 [0,4194304] 0 2024-09-13T22:56:29.342 INFO:tasks.workunit.client.1.smithi047.stdout:0/967: mknod d1/d5/d16/d47/dde/d113/c13b 0 2024-09-13T22:56:29.342 INFO:tasks.workunit.client.0.smithi002.stdout:6/937: dwrite d12/d17/ddf/d112/d126/ff7 [0,4194304] 0 2024-09-13T22:56:29.343 INFO:tasks.workunit.client.0.smithi002.stdout:0/913: mkdir d1/d4/d75/d31/d14a 0 2024-09-13T22:56:29.346 INFO:tasks.workunit.client.0.smithi002.stdout:0/914: read - d1/f12e zero size 2024-09-13T22:56:29.347 INFO:tasks.workunit.client.0.smithi002.stdout:2/913: dwrite d1/d7/d35/d3e/d5e/fd7 [0,4194304] 0 2024-09-13T22:56:29.349 INFO:tasks.workunit.client.0.smithi002.stdout:6/938: chown d12/d17/d28/d67/dca/dd8/de1/dff/f11b 23754 1 2024-09-13T22:56:29.352 INFO:tasks.workunit.client.0.smithi002.stdout:2/914: chown d1/d7/d8/d2c/da4/ffd 13106628 1 2024-09-13T22:56:29.353 INFO:tasks.workunit.client.0.smithi002.stdout:8/962: write d3/d21/d57/da1/fe8 [4504832,68785] 0 2024-09-13T22:56:29.354 INFO:tasks.workunit.client.0.smithi002.stdout:5/954: dwrite d1/d57/ffc [0,4194304] 0 2024-09-13T22:56:29.355 INFO:tasks.workunit.client.1.smithi047.stdout:0/968: truncate d1/d5/d16/d47/fd6 3103411 0 2024-09-13T22:56:29.358 INFO:tasks.workunit.client.1.smithi047.stdout:5/915: truncate d19/f36 2777602 0 2024-09-13T22:56:29.361 INFO:tasks.workunit.client.1.smithi047.stdout:7/948: creat d0/d7/da/d2e/f13f x:0 0 0 2024-09-13T22:56:29.362 INFO:tasks.workunit.client.1.smithi047.stdout:0/969: mknod d1/d5/d16/d47/dde/d113/c13c 0 2024-09-13T22:56:29.363 INFO:tasks.workunit.client.1.smithi047.stdout:0/970: stat d1/d5/d11/d52 0 2024-09-13T22:56:29.363 INFO:tasks.workunit.client.0.smithi002.stdout:1/982: mknod d1/d13/d30/d73/da1/c155 0 2024-09-13T22:56:29.365 INFO:tasks.workunit.client.1.smithi047.stdout:5/916: mkdir d19/d34/d8e/d11d 0 2024-09-13T22:56:29.365 INFO:tasks.workunit.client.0.smithi002.stdout:4/874: symlink d3/d14/d29/d2a/da6/d69/d7e/dca/df3/l119 0 2024-09-13T22:56:29.367 INFO:tasks.workunit.client.1.smithi047.stdout:7/949: creat d0/d7/da/d1e/d51/f140 x:0 0 0 2024-09-13T22:56:29.371 INFO:tasks.workunit.client.1.smithi047.stdout:0/971: mkdir d1/d5/d16/d47/dd0/d13d 0 2024-09-13T22:56:29.376 INFO:tasks.workunit.client.0.smithi002.stdout:0/915: rename d1/d4/d75/f2c to d1/d7e/d9d/de6/df5/f14b 0 2024-09-13T22:56:29.378 INFO:tasks.workunit.client.1.smithi047.stdout:0/972: mkdir d1/d5/d16/d47/dde/d13e 0 2024-09-13T22:56:29.379 INFO:tasks.workunit.client.0.smithi002.stdout:2/915: creat d1/d7/d35/d78/dfc/d87/f12f x:0 0 0 2024-09-13T22:56:29.381 INFO:tasks.workunit.client.0.smithi002.stdout:8/963: mkdir d3/dc/d16/d97/d12f 0 2024-09-13T22:56:29.381 INFO:tasks.workunit.client.1.smithi047.stdout:7/950: mkdir d0/db/de8/d136/d141 0 2024-09-13T22:56:29.383 INFO:tasks.workunit.client.0.smithi002.stdout:7/939: symlink d8/d10/d39/d60/db8/d2e/d50/d52/l119 0 2024-09-13T22:56:29.384 INFO:tasks.workunit.client.1.smithi047.stdout:0/973: fdatasync d1/f4 0 2024-09-13T22:56:29.385 INFO:tasks.workunit.client.0.smithi002.stdout:1/983: creat d1/d13/d1d/d34/d51/d108/f156 x:0 0 0 2024-09-13T22:56:29.386 INFO:tasks.workunit.client.1.smithi047.stdout:0/974: truncate d1/d5/d11/d2f/f129 815562 0 2024-09-13T22:56:29.390 INFO:tasks.workunit.client.1.smithi047.stdout:0/975: mknod d1/d5/d16/d47/dd0/d13d/c13f 0 2024-09-13T22:56:29.392 INFO:tasks.workunit.client.0.smithi002.stdout:2/916: mknod d1/d7/d52/daa/c130 0 2024-09-13T22:56:29.393 INFO:tasks.workunit.client.0.smithi002.stdout:8/964: unlink d3/dc/d16/d2f/d83/d85/fdd 0 2024-09-13T22:56:29.394 INFO:tasks.workunit.client.1.smithi047.stdout:0/976: fdatasync d1/d5/f59 0 2024-09-13T22:56:29.398 INFO:tasks.workunit.client.0.smithi002.stdout:4/875: creat d3/d62/d118/f11a x:0 0 0 2024-09-13T22:56:29.399 INFO:tasks.workunit.client.0.smithi002.stdout:4/876: dread - d3/d14/d29/d2a/da6/d69/fe8 zero size 2024-09-13T22:56:29.401 INFO:tasks.workunit.client.0.smithi002.stdout:0/916: mkdir d1/d2/d14c 0 2024-09-13T22:56:29.408 INFO:tasks.workunit.client.1.smithi047.stdout:0/977: write d1/d5/f74 [1505277,85744] 0 2024-09-13T22:56:29.409 INFO:tasks.workunit.client.0.smithi002.stdout:7/940: dwrite d8/d10/d39/d60/db8/d26/d38/fb7 [0,4194304] 0 2024-09-13T22:56:29.411 INFO:tasks.workunit.client.0.smithi002.stdout:7/941: truncate d8/d10/d39/d60/db8/d2e/f9d 2431338 0 2024-09-13T22:56:29.412 INFO:tasks.workunit.client.0.smithi002.stdout:4/877: mkdir d3/db3/db9/d11b 0 2024-09-13T22:56:29.412 INFO:tasks.workunit.client.0.smithi002.stdout:2/917: write d1/d7/d35/d78/dfc/d6b/d75/f10f [61221,66362] 0 2024-09-13T22:56:29.414 INFO:tasks.workunit.client.1.smithi047.stdout:0/978: creat d1/d5/d16/d97/db6/f140 x:0 0 0 2024-09-13T22:56:29.416 INFO:tasks.workunit.client.0.smithi002.stdout:6/939: getdents d12/d17/d28/d67/d6b 0 2024-09-13T22:56:29.416 INFO:tasks.workunit.client.0.smithi002.stdout:0/917: mkdir d1/d7e/d14d 0 2024-09-13T22:56:29.420 INFO:tasks.workunit.client.0.smithi002.stdout:1/984: dwrite d1/d13/d1d/d34/da7/fb2 [0,4194304] 0 2024-09-13T22:56:29.421 INFO:tasks.workunit.client.1.smithi047.stdout:0/979: link d1/d5/f3f d1/d5/d16/d97/dfc/dd8/f141 0 2024-09-13T22:56:29.422 INFO:tasks.workunit.client.0.smithi002.stdout:4/878: symlink d3/d14/d29/d2a/da6/d9f/l11c 0 2024-09-13T22:56:29.422 INFO:tasks.workunit.client.0.smithi002.stdout:1/985: write d1/d13/d1d/d34/d51/dc6/ff5 [871709,109035] 0 2024-09-13T22:56:29.423 INFO:tasks.workunit.client.1.smithi047.stdout:0/980: write d1/d5/d16/d47/f4d [498556,12275] 0 2024-09-13T22:56:29.424 INFO:tasks.workunit.client.0.smithi002.stdout:2/918: creat d1/d7/d35/d78/dfc/d87/f131 x:0 0 0 2024-09-13T22:56:29.424 INFO:tasks.workunit.client.0.smithi002.stdout:1/986: chown d1/d13/d30/d73/da1/d9d/dbd 583 1 2024-09-13T22:56:29.425 INFO:tasks.workunit.client.1.smithi047.stdout:0/981: write d1/d5/d16/d97/dfc/d45/fff [1382230,82304] 0 2024-09-13T22:56:29.426 INFO:tasks.workunit.client.0.smithi002.stdout:2/919: chown d1/d7/d35/l8f 3643313 1 2024-09-13T22:56:29.427 INFO:tasks.workunit.client.1.smithi047.stdout:0/982: write d1/d5/d16/d97/dfc/d77/f12d [679029,89581] 0 2024-09-13T22:56:29.431 INFO:tasks.workunit.client.1.smithi047.stdout:0/983: creat d1/d7/f142 x:0 0 0 2024-09-13T22:56:29.432 INFO:tasks.workunit.client.0.smithi002.stdout:8/965: dwrite d3/dc/d16/d4b/f6c [0,4194304] 0 2024-09-13T22:56:29.436 INFO:tasks.workunit.client.0.smithi002.stdout:7/942: mknod d8/d10/d39/d60/db8/d2e/d3c/c11a 0 2024-09-13T22:56:29.438 INFO:tasks.workunit.client.1.smithi047.stdout:0/984: dwrite d1/d5/f74 [0,4194304] 0 2024-09-13T22:56:29.440 INFO:tasks.workunit.client.0.smithi002.stdout:6/940: write d12/d17/d34/d39/d8a/fe6 [439125,30985] 0 2024-09-13T22:56:29.445 INFO:tasks.workunit.client.0.smithi002.stdout:0/918: write d1/d4/d75/d31/d32/dbb/de1/f103 [816216,101210] 0 2024-09-13T22:56:29.448 INFO:tasks.workunit.client.0.smithi002.stdout:8/966: symlink d3/dc/d16/d2f/d83/d85/dc8/de3/df1/l130 0 2024-09-13T22:56:29.449 INFO:tasks.workunit.client.0.smithi002.stdout:7/943: mknod d8/d10/d39/d60/c11b 0 2024-09-13T22:56:29.450 INFO:tasks.workunit.client.0.smithi002.stdout:4/879: write d3/f3a [454249,76912] 0 2024-09-13T22:56:29.452 INFO:tasks.workunit.client.0.smithi002.stdout:2/920: mkdir d1/d7/d41/d96/dba/df1/d132 0 2024-09-13T22:56:29.453 INFO:tasks.workunit.client.0.smithi002.stdout:2/921: chown d1/d7/d8/fdd 235035397 1 2024-09-13T22:56:29.454 INFO:tasks.workunit.client.0.smithi002.stdout:6/941: rename d12/d17/d34/d4b/l10a to d12/d17/d28/d67/d6b/l12f 0 2024-09-13T22:56:29.456 INFO:tasks.workunit.client.0.smithi002.stdout:0/919: write d1/d4/d75/d31/d32/dbb/ffe [4021753,70170] 0 2024-09-13T22:56:29.458 INFO:tasks.workunit.client.0.smithi002.stdout:1/987: dwrite d1/d13/d21/d39/d70/d10c/d3b/d71/d80/fc5 [0,4194304] 0 2024-09-13T22:56:29.460 INFO:tasks.workunit.client.0.smithi002.stdout:2/922: symlink d1/d7/d52/l133 0 2024-09-13T22:56:29.463 INFO:tasks.workunit.client.1.smithi047.stdout:0/985: dwrite d1/d5/d11/d52/fe8 [0,4194304] 0 2024-09-13T22:56:29.467 INFO:tasks.workunit.client.0.smithi002.stdout:7/944: mknod d8/d10/d39/d60/db8/d2e/d3c/dcf/de0/c11c 0 2024-09-13T22:56:29.469 INFO:tasks.workunit.client.0.smithi002.stdout:8/967: write d3/d21/fbe [323809,65027] 0 2024-09-13T22:56:29.474 INFO:tasks.workunit.client.0.smithi002.stdout:1/988: dread d1/d13/d30/d73/da1/fac [0,4194304] 0 2024-09-13T22:56:29.474 INFO:tasks.workunit.client.0.smithi002.stdout:4/880: dread d3/d14/d29/d2a/da6/d69/d7e/dca/df3/f112 [0,4194304] 0 2024-09-13T22:56:29.475 INFO:tasks.workunit.client.0.smithi002.stdout:0/920: unlink d1/d4/da3/d7d/f110 0 2024-09-13T22:56:29.476 INFO:tasks.workunit.client.0.smithi002.stdout:1/989: truncate d1/d13/d21/d39/d70/d10c/d3d/ffd 1809991 0 2024-09-13T22:56:29.480 INFO:tasks.workunit.client.0.smithi002.stdout:2/923: truncate d1/d7/d35/d78/dfc/d6b/fe2 2059497 0 2024-09-13T22:56:29.481 INFO:tasks.workunit.client.0.smithi002.stdout:7/945: readlink d8/la4 0 2024-09-13T22:56:29.483 INFO:tasks.workunit.client.0.smithi002.stdout:8/968: symlink d3/dc/d16/d2f/d83/d85/dc8/de3/l131 0 2024-09-13T22:56:29.484 INFO:tasks.workunit.client.0.smithi002.stdout:2/924: dread d1/da9/f106 [0,4194304] 0 2024-09-13T22:56:29.485 INFO:tasks.workunit.client.0.smithi002.stdout:4/881: mknod d3/d62/df6/c11d 0 2024-09-13T22:56:29.486 INFO:tasks.workunit.client.0.smithi002.stdout:0/921: fdatasync d1/d2/d6c/f10f 0 2024-09-13T22:56:29.487 INFO:tasks.workunit.client.0.smithi002.stdout:6/942: dwrite d12/d17/d28/d67/d6b/fb3 [0,4194304] 0 2024-09-13T22:56:29.489 INFO:tasks.workunit.client.0.smithi002.stdout:6/943: chown d12/d17/d28/d67/f8f 24370 1 2024-09-13T22:56:29.491 INFO:tasks.workunit.client.0.smithi002.stdout:6/944: chown d12/d17/d28/d67/d6b/daa/f122 1555 1 2024-09-13T22:56:29.492 INFO:tasks.workunit.client.0.smithi002.stdout:4/882: dwrite d3/d14/d29/d2a/da6/d69/d7e/fc1 [0,4194304] 0 2024-09-13T22:56:29.494 INFO:tasks.workunit.client.0.smithi002.stdout:7/946: rmdir d8 39 2024-09-13T22:56:29.504 INFO:tasks.workunit.client.0.smithi002.stdout:2/925: readlink d1/d7/d35/d78/dfc/d87/l8d 0 2024-09-13T22:56:29.505 INFO:tasks.workunit.client.0.smithi002.stdout:2/926: write d1/da9/fd9 [1132674,29112] 0 2024-09-13T22:56:29.515 INFO:tasks.workunit.client.1.smithi047.stdout:0/986: fsync d1/d5/d11/f85 0 2024-09-13T22:56:29.517 INFO:tasks.workunit.client.0.smithi002.stdout:4/883: chown d3/d14/d29/d2a/da6/d69/cc3 731742 1 2024-09-13T22:56:29.520 INFO:tasks.workunit.client.1.smithi047.stdout:0/987: truncate d1/d5/d16/d97/db6/f101 3866978 0 2024-09-13T22:56:29.528 INFO:tasks.workunit.client.0.smithi002.stdout:1/990: rmdir d1/d13/d30/d73/da1/d7d/dce/d116/d143 0 2024-09-13T22:56:29.529 INFO:tasks.workunit.client.0.smithi002.stdout:1/991: truncate d1/d13/d1d/d34/dfe/f12d 81255 0 2024-09-13T22:56:29.530 INFO:tasks.workunit.client.1.smithi047.stdout:0/988: rename d1/d5/d16/d6a/d92/fa2 to d1/d5/f143 0 2024-09-13T22:56:29.534 INFO:tasks.workunit.client.0.smithi002.stdout:8/969: creat d3/f132 x:0 0 0 2024-09-13T22:56:29.535 INFO:tasks.workunit.client.0.smithi002.stdout:0/922: creat d1/d4/f14e x:0 0 0 2024-09-13T22:56:29.536 INFO:tasks.workunit.client.0.smithi002.stdout:6/945: creat d12/d17/d28/d67/dca/dd8/f130 x:0 0 0 2024-09-13T22:56:29.537 INFO:tasks.workunit.client.1.smithi047.stdout:0/989: dwrite d1/d5/d11/d2f/f8d [0,4194304] 0 2024-09-13T22:56:29.539 INFO:tasks.workunit.client.0.smithi002.stdout:8/970: mknod d3/dc/d18/d2e/d94/c133 0 2024-09-13T22:56:29.542 INFO:tasks.workunit.client.0.smithi002.stdout:3/991: sync 2024-09-13T22:56:29.546 INFO:tasks.workunit.client.1.smithi047.stdout:0/990: mkdir d1/d5/d16/d47/d144 0 2024-09-13T22:56:29.548 INFO:tasks.workunit.client.0.smithi002.stdout:7/947: write d8/d10/d39/d60/db8/d26/f3f [1589883,128853] 0 2024-09-13T22:56:29.550 INFO:tasks.workunit.client.0.smithi002.stdout:4/884: getdents d3/d14/d86/db1/dfb/d10d 0 2024-09-13T22:56:29.550 INFO:tasks.workunit.client.1.smithi047.stdout:0/991: mknod d1/d5/d16/d47/d144/c145 0 2024-09-13T22:56:29.552 INFO:tasks.workunit.client.0.smithi002.stdout:2/927: dwrite d1/d4a/f61 [0,4194304] 0 2024-09-13T22:56:29.552 INFO:tasks.workunit.client.1.smithi047.stdout:0/992: dread d1/d5/d16/dc0/f107 [0,4194304] 0 2024-09-13T22:56:29.553 INFO:tasks.workunit.client.0.smithi002.stdout:1/992: write d1/f15 [1086900,72543] 0 2024-09-13T22:56:29.553 INFO:tasks.workunit.client.0.smithi002.stdout:7/948: fsync d8/d10/d39/d60/db8/d26/f96 0 2024-09-13T22:56:29.553 INFO:tasks.workunit.client.0.smithi002.stdout:0/923: dread d1/d4/d75/d31/d32/dbb/ffe [0,4194304] 0 2024-09-13T22:56:29.554 INFO:tasks.workunit.client.0.smithi002.stdout:6/946: dread d12/d17/d2a/f32 [0,4194304] 0 2024-09-13T22:56:29.559 INFO:tasks.workunit.client.0.smithi002.stdout:8/971: link d3/dc/d51/d99/f7e d3/dc/d16/d2f/d83/d95/f134 0 2024-09-13T22:56:29.560 INFO:tasks.workunit.client.1.smithi047.stdout:0/993: link d1/d5/d16/d47/lbe d1/ddb/l146 0 2024-09-13T22:56:29.560 INFO:tasks.workunit.client.0.smithi002.stdout:3/992: dread d9/d15/d46/f5f [0,4194304] 0 2024-09-13T22:56:29.563 INFO:tasks.workunit.client.0.smithi002.stdout:8/972: write d3/d27/f8a [2176477,117683] 0 2024-09-13T22:56:29.566 INFO:tasks.workunit.client.1.smithi047.stdout:0/994: symlink d1/ddb/d128/l147 0 2024-09-13T22:56:29.567 INFO:tasks.workunit.client.0.smithi002.stdout:0/924: dwrite d1/d4/d75/d76/fa8 [4194304,4194304] 0 2024-09-13T22:56:29.567 INFO:tasks.workunit.client.0.smithi002.stdout:8/973: chown d3/dc/d16/d97/f126 393086782 1 2024-09-13T22:56:29.568 INFO:tasks.workunit.client.0.smithi002.stdout:7/949: dwrite d8/d10/d39/d60/db8/d2e/d50/d52/db1/fef [0,4194304] 0 2024-09-13T22:56:29.569 INFO:tasks.workunit.client.0.smithi002.stdout:7/950: dread - d8/d10/d39/d60/fd2 zero size 2024-09-13T22:56:29.572 INFO:tasks.workunit.client.1.smithi047.stdout:0/995: rename d1/d5/d16/fac to d1/d5/d11/d2f/f148 0 2024-09-13T22:56:29.577 INFO:tasks.workunit.client.1.smithi047.stdout:0/996: symlink d1/d5/d11/d2f/l149 0 2024-09-13T22:56:29.578 INFO:tasks.workunit.client.0.smithi002.stdout:1/993: write d1/d13/d21/d39/d70/d10c/d3b/d71/d80/d112/d14d/fba [258669,88551] 0 2024-09-13T22:56:29.579 INFO:tasks.workunit.client.0.smithi002.stdout:4/885: creat d3/d14/d29/d2a/f11e x:0 0 0 2024-09-13T22:56:29.582 INFO:tasks.workunit.client.0.smithi002.stdout:6/947: creat d12/d17/d28/d67/f131 x:0 0 0 2024-09-13T22:56:29.583 INFO:tasks.workunit.client.0.smithi002.stdout:6/948: stat d12/d17/d34/f36 0 2024-09-13T22:56:29.583 INFO:tasks.workunit.client.1.smithi047.stdout:0/997: mkdir d1/d5/d16/d47/dde/d13e/d14a 0 2024-09-13T22:56:29.586 INFO:tasks.workunit.client.0.smithi002.stdout:3/993: dwrite d9/d15/d26/fd2 [0,4194304] 0 2024-09-13T22:56:29.586 INFO:tasks.workunit.client.0.smithi002.stdout:0/925: creat d1/d2/d12a/f14f x:0 0 0 2024-09-13T22:56:29.587 INFO:tasks.workunit.client.0.smithi002.stdout:3/994: fsync d9/d15/d36/d4e/d5e/dae/f12f 0 2024-09-13T22:56:29.589 INFO:tasks.workunit.client.0.smithi002.stdout:8/974: symlink d3/dc/d16/d4b/l135 0 2024-09-13T22:56:29.590 INFO:tasks.workunit.client.0.smithi002.stdout:8/975: fsync d3/dc/d51/d99/fef 0 2024-09-13T22:56:29.591 INFO:tasks.workunit.client.0.smithi002.stdout:7/951: unlink d8/d10/d39/d60/db8/d26/d4c/d81/lbf 0 2024-09-13T22:56:29.593 INFO:tasks.workunit.client.0.smithi002.stdout:1/994: creat d1/d13/d30/d73/f157 x:0 0 0 2024-09-13T22:56:29.596 INFO:tasks.workunit.client.0.smithi002.stdout:2/928: getdents d1/d7/d8 0 2024-09-13T22:56:29.600 INFO:tasks.workunit.client.1.smithi047.stdout:0/998: dwrite d1/d5/d16/f94 [0,4194304] 0 2024-09-13T22:56:29.600 INFO:tasks.workunit.client.0.smithi002.stdout:0/926: symlink d1/d4/da3/d7d/df8/l150 0 2024-09-13T22:56:29.603 INFO:tasks.workunit.client.0.smithi002.stdout:4/886: write f2 [6916818,68497] 0 2024-09-13T22:56:29.604 INFO:tasks.workunit.client.0.smithi002.stdout:3/995: mknod d9/d7e/daf/c155 0 2024-09-13T22:56:29.604 INFO:tasks.workunit.client.0.smithi002.stdout:4/887: write d3/f10 [1053418,2145] 0 2024-09-13T22:56:29.605 INFO:tasks.workunit.client.1.smithi047.stdout:0/999: dread - d1/d5/d11/d52/f10b zero size 2024-09-13T22:56:29.606 INFO:tasks.workunit.client.0.smithi002.stdout:4/888: write d3/f23 [1410615,91109] 0 2024-09-13T22:56:29.608 INFO:tasks.workunit.client.0.smithi002.stdout:7/952: write f7 [5825673,21191] 0 2024-09-13T22:56:29.610 INFO:tasks.workunit.client.0.smithi002.stdout:1/995: dread - d1/d13/d30/d73/da1/d7d/f98 zero size 2024-09-13T22:56:29.612 INFO:tasks.workunit.client.0.smithi002.stdout:7/953: write d8/d10/d39/d60/db8/d2e/d50/d52/f10e [272555,76902] 0 2024-09-13T22:56:29.613 INFO:tasks.workunit.client.0.smithi002.stdout:6/949: mkdir d12/d17/d28/d67/dca/d132 0 2024-09-13T22:56:29.614 INFO:tasks.workunit.client.0.smithi002.stdout:3/996: truncate d9/fb8 742882 0 2024-09-13T22:56:29.615 INFO:tasks.workunit.client.0.smithi002.stdout:4/889: mknod d3/d14/d29/d2a/d30/c11f 0 2024-09-13T22:56:29.616 INFO:tasks.workunit.client.0.smithi002.stdout:1/996: truncate d1/d13/d30/d73/da1/fac 4142833 0 2024-09-13T22:56:29.617 INFO:tasks.workunit.client.0.smithi002.stdout:3/997: stat d9/d15/d36/f38 0 2024-09-13T22:56:29.617 INFO:tasks.workunit.client.0.smithi002.stdout:6/950: fsync d12/d17/d4e/f52 0 2024-09-13T22:56:29.619 INFO:tasks.workunit.client.0.smithi002.stdout:8/976: dwrite d3/f6 [0,4194304] 0 2024-09-13T22:56:29.619 INFO:tasks.workunit.client.0.smithi002.stdout:7/954: symlink d8/d10/d11/d3a/l11d 0 2024-09-13T22:56:29.621 INFO:tasks.workunit.client.0.smithi002.stdout:0/927: rename d1/d4/d75/dca/l104 to d1/d4/da3/l151 0 2024-09-13T22:56:29.621 INFO:tasks.workunit.client.0.smithi002.stdout:3/998: write d9/d7e/dce/fdc [1361688,8713] 0 2024-09-13T22:56:29.625 INFO:tasks.workunit.client.0.smithi002.stdout:5/955: sync 2024-09-13T22:56:29.627 INFO:tasks.workunit.client.0.smithi002.stdout:3/999: fdatasync d9/d15/d36/d4e/d5e/dae/f12f 0 2024-09-13T22:56:29.627 INFO:tasks.workunit.client.0.smithi002.stdout:2/929: dwrite d1/d80/fbb [0,4194304] 0 2024-09-13T22:56:29.628 INFO:tasks.workunit.client.0.smithi002.stdout:8/977: symlink d3/dc/d16/d4b/l136 0 2024-09-13T22:56:29.629 INFO:tasks.workunit.client.0.smithi002.stdout:6/951: truncate d12/d17/fbe 1637881 0 2024-09-13T22:56:29.631 INFO:tasks.workunit.client.0.smithi002.stdout:8/978: write d3/dc/d16/d2f/d83/d95/f112 [515565,115892] 0 2024-09-13T22:56:29.632 INFO:tasks.workunit.client.0.smithi002.stdout:1/997: fsync d1/d13/d1d/d34/f7a 0 2024-09-13T22:56:29.634 INFO:tasks.workunit.client.0.smithi002.stdout:7/955: dread - d8/d10/d39/d60/db8/d2e/d50/d52/dab/fd8 zero size 2024-09-13T22:56:29.635 INFO:tasks.workunit.client.0.smithi002.stdout:0/928: mknod d1/d7e/d9d/de3/c152 0 2024-09-13T22:56:29.636 INFO:tasks.workunit.client.0.smithi002.stdout:8/979: write d3/dc/d16/d60/fa0 [5464421,23218] 0 2024-09-13T22:56:29.638 INFO:tasks.workunit.client.0.smithi002.stdout:6/952: mkdir d12/d17/d34/d4b/d133 0 2024-09-13T22:56:29.638 INFO:tasks.workunit.client.0.smithi002.stdout:0/929: dread - d1/d4/f115 zero size 2024-09-13T22:56:29.640 INFO:tasks.workunit.client.0.smithi002.stdout:1/998: creat d1/d13/d1d/d14f/f158 x:0 0 0 2024-09-13T22:56:29.641 INFO:tasks.workunit.client.0.smithi002.stdout:6/953: chown d12/d17/d28/f107 14 1 2024-09-13T22:56:29.641 INFO:tasks.workunit.client.0.smithi002.stdout:4/890: dwrite d3/f3d [0,4194304] 0 2024-09-13T22:56:29.643 INFO:tasks.workunit.client.0.smithi002.stdout:5/956: mkdir d1/d57/dd0/df7/d153 0 2024-09-13T22:56:29.644 INFO:tasks.workunit.client.0.smithi002.stdout:8/980: rmdir d3/dc/d18/d6f 39 2024-09-13T22:56:29.646 INFO:tasks.workunit.client.0.smithi002.stdout:4/891: read d3/d14/d29/d2a/f37 [3803016,40448] 0 2024-09-13T22:56:29.646 INFO:tasks.workunit.client.0.smithi002.stdout:7/956: symlink d8/l11e 0 2024-09-13T22:56:29.650 INFO:tasks.workunit.client.0.smithi002.stdout:5/957: write d1/d2a/d6b/d88/d55/d56/d86/d100/f146 [442434,44066] 0 2024-09-13T22:56:29.652 INFO:tasks.workunit.client.0.smithi002.stdout:8/981: creat d3/f137 x:0 0 0 2024-09-13T22:56:29.653 INFO:tasks.workunit.client.0.smithi002.stdout:6/954: dwrite d12/d17/f4a [0,4194304] 0 2024-09-13T22:56:29.654 INFO:tasks.workunit.client.0.smithi002.stdout:7/957: chown d8/d10/d39/d60/db8/d26/d4c/cf8 65555453 1 2024-09-13T22:56:29.656 INFO:tasks.workunit.client.0.smithi002.stdout:0/930: write d1/d4/d75/d31/d32/dbb/fe2 [575889,103850] 0 2024-09-13T22:56:29.657 INFO:tasks.workunit.client.0.smithi002.stdout:4/892: mknod d3/d14/d29/d2a/da6/d9f/d10e/dfd/c120 0 2024-09-13T22:56:29.658 INFO:tasks.workunit.client.0.smithi002.stdout:6/955: write d12/d17/d28/d67/dca/dd8/de1/dff/f11b [674223,73614] 0 2024-09-13T22:56:29.660 INFO:tasks.workunit.client.0.smithi002.stdout:7/958: dread - d8/d10/d39/d60/db8/d2e/d3c/dcf/fe4 zero size 2024-09-13T22:56:29.661 INFO:tasks.workunit.client.0.smithi002.stdout:1/999: dread d1/d13/d21/d39/d70/d10c/f44 [0,4194304] 0 2024-09-13T22:56:29.664 INFO:tasks.workunit.client.0.smithi002.stdout:0/931: creat d1/d2/d81/f153 x:0 0 0 2024-09-13T22:56:29.664 INFO:tasks.workunit.client.0.smithi002.stdout:4/893: read d3/d40/f4e [1801042,33686] 0 2024-09-13T22:56:29.665 INFO:tasks.workunit.client.0.smithi002.stdout:6/956: creat d12/d17/d34/d39/d8a/de4/f134 x:0 0 0 2024-09-13T22:56:29.665 INFO:tasks.workunit.client.0.smithi002.stdout:7/959: truncate d8/d10/f23 810779 0 2024-09-13T22:56:29.666 INFO:tasks.workunit.client.0.smithi002.stdout:4/894: chown d3/d14/d29/c109 22 1 2024-09-13T22:56:29.668 INFO:tasks.workunit.client.0.smithi002.stdout:6/957: symlink d12/d17/d34/d39/d8b/dcb/l135 0 2024-09-13T22:56:29.669 INFO:tasks.workunit.client.0.smithi002.stdout:5/958: dread d1/d2a/d6b/f72 [0,4194304] 0 2024-09-13T22:56:29.670 INFO:tasks.workunit.client.0.smithi002.stdout:7/960: mkdir d8/d10/d39/d60/db8/d26/d4c/d81/db6/d11f 0 2024-09-13T22:56:29.671 INFO:tasks.workunit.client.0.smithi002.stdout:6/958: dread - d12/d17/d34/d39/ff1 zero size 2024-09-13T22:56:29.671 INFO:tasks.workunit.client.0.smithi002.stdout:7/961: chown d8/d10/d11/db9 981825 1 2024-09-13T22:56:29.672 INFO:tasks.workunit.client.0.smithi002.stdout:4/895: creat d3/d14/d29/d2a/da6/f121 x:0 0 0 2024-09-13T22:56:29.672 INFO:tasks.workunit.client.0.smithi002.stdout:6/959: fsync d12/d17/d34/f124 0 2024-09-13T22:56:29.673 INFO:tasks.workunit.client.0.smithi002.stdout:4/896: readlink d3/d14/d29/ld6 0 2024-09-13T22:56:29.673 INFO:tasks.workunit.client.0.smithi002.stdout:7/962: stat d8/d10/d39/d60/l80 0 2024-09-13T22:56:29.675 INFO:tasks.workunit.client.0.smithi002.stdout:6/960: chown d12/d17/d28/d7d/cdb 2411 1 2024-09-13T22:56:29.676 INFO:tasks.workunit.client.0.smithi002.stdout:4/897: chown d3/d14/d29/d2a/l9d 87186 1 2024-09-13T22:56:29.676 INFO:tasks.workunit.client.0.smithi002.stdout:0/932: dread d1/d4/d75/d31/fcd [0,4194304] 0 2024-09-13T22:56:29.676 INFO:tasks.workunit.client.0.smithi002.stdout:6/961: chown d12/d17/ddf/d112 286 1 2024-09-13T22:56:29.677 INFO:tasks.workunit.client.0.smithi002.stdout:5/959: rename d1/d2a/d6b/d88/d55/f116 to d1/d2a/d6b/d88/d45/d4f/da7/f154 0 2024-09-13T22:56:29.678 INFO:tasks.workunit.client.0.smithi002.stdout:7/963: rmdir d8/d10/d39/d60/db8/d2e/d3c/dcf/de0 39 2024-09-13T22:56:29.678 INFO:tasks.workunit.client.0.smithi002.stdout:4/898: rmdir d3/d14/d86/db1/dfb/d10d 39 2024-09-13T22:56:29.680 INFO:tasks.workunit.client.0.smithi002.stdout:0/933: mkdir d1/d4/d75/d31/de0/d102/d154 0 2024-09-13T22:56:29.681 INFO:tasks.workunit.client.0.smithi002.stdout:7/964: fdatasync d8/d10/d39/d60/db8/d26/d4c/d81/fd 0 2024-09-13T22:56:29.683 INFO:tasks.workunit.client.0.smithi002.stdout:7/965: stat d8/d10/l90 0 2024-09-13T22:56:29.684 INFO:tasks.workunit.client.0.smithi002.stdout:4/899: truncate d3/d14/d29/d2a/fa3 4960570 0 2024-09-13T22:56:29.684 INFO:tasks.workunit.client.0.smithi002.stdout:0/934: mkdir d1/d4/d114/d155 0 2024-09-13T22:56:29.687 INFO:tasks.workunit.client.0.smithi002.stdout:6/962: dwrite d12/d17/d28/d67/dca/f100 [0,4194304] 0 2024-09-13T22:56:29.689 INFO:tasks.workunit.client.0.smithi002.stdout:7/966: mkdir d8/d10/d39/d60/db8/d2e/d50/d85/d120 0 2024-09-13T22:56:29.691 INFO:tasks.workunit.client.0.smithi002.stdout:4/900: creat d3/d14/d29/d2a/da6/d69/d7e/f122 x:0 0 0 2024-09-13T22:56:29.692 INFO:tasks.workunit.client.0.smithi002.stdout:6/963: truncate d12/d17/fd2 2681081 0 2024-09-13T22:56:29.696 INFO:tasks.workunit.client.0.smithi002.stdout:4/901: dread d3/d14/f53 [0,4194304] 0 2024-09-13T22:56:29.699 INFO:tasks.workunit.client.0.smithi002.stdout:0/935: dwrite d1/d4/d114/f132 [0,4194304] 0 2024-09-13T22:56:29.699 INFO:tasks.workunit.client.0.smithi002.stdout:5/960: truncate d1/d2a/d69/f129 215986 0 2024-09-13T22:56:29.699 INFO:tasks.workunit.client.0.smithi002.stdout:4/902: fdatasync d3/d14/d29/df7/fc2 0 2024-09-13T22:56:29.702 INFO:tasks.workunit.client.0.smithi002.stdout:5/961: chown d1/c139 161614 1 2024-09-13T22:56:29.706 INFO:tasks.workunit.client.0.smithi002.stdout:7/967: dwrite d8/d10/d39/d60/db8/d26/d4c/d81/d51/f108 [0,4194304] 0 2024-09-13T22:56:29.709 INFO:tasks.workunit.client.0.smithi002.stdout:5/962: creat d1/d2a/d6b/d88/d45/d4f/d8f/dd5/f155 x:0 0 0 2024-09-13T22:56:29.712 INFO:tasks.workunit.client.0.smithi002.stdout:0/936: mkdir d1/d2/d14c/d156 0 2024-09-13T22:56:29.715 INFO:tasks.workunit.client.0.smithi002.stdout:5/963: creat d1/d2a/d69/f156 x:0 0 0 2024-09-13T22:56:29.715 INFO:tasks.workunit.client.0.smithi002.stdout:6/964: dwrite d12/d17/fd2 [0,4194304] 0 2024-09-13T22:56:29.715 INFO:tasks.workunit.client.0.smithi002.stdout:4/903: write d3/db3/fef [361803,74353] 0 2024-09-13T22:56:29.718 INFO:tasks.workunit.client.0.smithi002.stdout:7/968: creat d8/d10/d39/d60/db8/d2e/d3c/f121 x:0 0 0 2024-09-13T22:56:29.718 INFO:tasks.workunit.client.0.smithi002.stdout:0/937: rmdir d1/d7e/d9d/de3 39 2024-09-13T22:56:29.721 INFO:tasks.workunit.client.0.smithi002.stdout:0/938: write d1/d4/d75/dca/ff9 [1359545,100335] 0 2024-09-13T22:56:29.723 INFO:tasks.workunit.client.0.smithi002.stdout:4/904: mknod d3/d14/d29/d2a/da6/d69/d7e/c123 0 2024-09-13T22:56:29.725 INFO:tasks.workunit.client.0.smithi002.stdout:6/965: fdatasync d12/d17/d34/f38 0 2024-09-13T22:56:29.729 INFO:tasks.workunit.client.0.smithi002.stdout:4/905: mkdir d3/d62/df6/d124 0 2024-09-13T22:56:29.730 INFO:tasks.workunit.client.0.smithi002.stdout:5/964: dwrite d1/d2a/d6b/d88/d45/d4f/da7/daa/f134 [0,4194304] 0 2024-09-13T22:56:29.731 INFO:tasks.workunit.client.0.smithi002.stdout:7/969: write d8/d10/d39/d60/db8/d26/d4c/d81/f1a [11425454,101894] 0 2024-09-13T22:56:29.733 INFO:tasks.workunit.client.0.smithi002.stdout:5/965: dread d1/d2a/d6b/d88/d55/fee [0,4194304] 0 2024-09-13T22:56:29.735 INFO:tasks.workunit.client.0.smithi002.stdout:6/966: creat d12/d17/d28/d67/dca/d132/f136 x:0 0 0 2024-09-13T22:56:29.736 INFO:tasks.workunit.client.0.smithi002.stdout:4/906: symlink d3/d40/l125 0 2024-09-13T22:56:29.737 INFO:tasks.workunit.client.0.smithi002.stdout:0/939: write d1/d4/da3/d7d/f9c [914254,54337] 0 2024-09-13T22:56:29.737 INFO:tasks.workunit.client.0.smithi002.stdout:5/966: fdatasync d1/d2a/d6b/d88/d55/d56/ff6 0 2024-09-13T22:56:29.740 INFO:tasks.workunit.client.0.smithi002.stdout:5/967: chown d1/d2a/d6b/d88/d55/fee 79042254 1 2024-09-13T22:56:29.743 INFO:tasks.workunit.client.0.smithi002.stdout:4/907: symlink d3/d14/d29/d2a/l126 0 2024-09-13T22:56:29.745 INFO:tasks.workunit.client.0.smithi002.stdout:0/940: rename d1/d7e/cad to d1/d4/d114/d155/c157 0 2024-09-13T22:56:29.745 INFO:tasks.workunit.client.1.smithi047.stdout:8/971: sync 2024-09-13T22:56:29.745 INFO:tasks.workunit.client.1.smithi047.stdout:7/951: sync 2024-09-13T22:56:29.745 INFO:tasks.workunit.client.1.smithi047.stdout:5/917: sync 2024-09-13T22:56:29.746 INFO:tasks.workunit.client.0.smithi002.stdout:6/967: symlink d12/d17/d28/d67/l137 0 2024-09-13T22:56:29.747 INFO:tasks.workunit.client.1.smithi047.stdout:5/918: fdatasync d19/d23/d2e/d41/d58/dfc/d5d/fed 0 2024-09-13T22:56:29.748 INFO:tasks.workunit.client.0.smithi002.stdout:7/970: creat d8/d10/d39/d60/db8/d2e/d3c/dcf/f122 x:0 0 0 2024-09-13T22:56:29.752 INFO:tasks.workunit.client.1.smithi047.stdout:7/952: mknod d0/d7/da/d2e/d64/c142 0 2024-09-13T22:56:29.754 INFO:tasks.workunit.client.1.smithi047.stdout:5/919: chown d19/d23/d2e/dba 0 1 2024-09-13T22:56:29.760 INFO:tasks.workunit.client.0.smithi002.stdout:7/971: fsync d8/d10/d39/d60/db8/f34 0 2024-09-13T22:56:29.762 INFO:tasks.workunit.client.0.smithi002.stdout:6/968: write d12/d17/f48 [393585,9256] 0 2024-09-13T22:56:29.763 INFO:tasks.workunit.client.1.smithi047.stdout:8/972: creat d8/d77/f151 x:0 0 0 2024-09-13T22:56:29.764 INFO:tasks.workunit.client.0.smithi002.stdout:5/968: dwrite d1/d2a/d6b/d88/d45/d4f/d78/d8b/fab [4194304,4194304] 0 2024-09-13T22:56:29.765 INFO:tasks.workunit.client.1.smithi047.stdout:7/953: rename d0/d57/d5b/d8b/lf0 to d0/db/de8/l143 0 2024-09-13T22:56:29.766 INFO:tasks.workunit.client.1.smithi047.stdout:5/920: truncate d19/d83/d98/fe7 324454 0 2024-09-13T22:56:29.767 INFO:tasks.workunit.client.1.smithi047.stdout:7/954: read d0/d7/da/d2e/f4b [2335778,90414] 0 2024-09-13T22:56:29.769 INFO:tasks.workunit.client.1.smithi047.stdout:5/921: symlink d19/d23/l11e 0 2024-09-13T22:56:29.771 INFO:tasks.workunit.client.1.smithi047.stdout:5/922: write d19/d23/d2e/d41/d58/dfc/d5d/fb4 [790953,114627] 0 2024-09-13T22:56:29.771 INFO:tasks.workunit.client.1.smithi047.stdout:7/955: creat d0/d7/da/d47/d92/f144 x:0 0 0 2024-09-13T22:56:29.774 INFO:tasks.workunit.client.1.smithi047.stdout:7/956: symlink d0/d7/da/d1e/d93/l145 0 2024-09-13T22:56:29.777 INFO:tasks.workunit.client.1.smithi047.stdout:5/923: mkdir d19/d23/d32/d11f 0 2024-09-13T22:56:29.778 INFO:tasks.workunit.client.1.smithi047.stdout:5/924: chown d19/d83/d98/dd0/f10f 239 1 2024-09-13T22:56:29.779 INFO:tasks.workunit.client.1.smithi047.stdout:7/957: creat d0/d7/da/d105/d125/f146 x:0 0 0 2024-09-13T22:56:29.780 INFO:tasks.workunit.client.1.smithi047.stdout:7/958: chown d0/d7/da/le2 3627 1 2024-09-13T22:56:29.780 INFO:tasks.workunit.client.1.smithi047.stdout:5/925: truncate d19/d64/fbc 457899 0 2024-09-13T22:56:29.781 INFO:tasks.workunit.client.1.smithi047.stdout:5/926: fsync d19/d23/d32/d69/f70 0 2024-09-13T22:56:29.784 INFO:tasks.workunit.client.1.smithi047.stdout:5/927: rmdir d19/d34 39 2024-09-13T22:56:29.786 INFO:tasks.workunit.client.1.smithi047.stdout:7/959: dwrite d0/fca [4194304,4194304] 0 2024-09-13T22:56:29.794 INFO:tasks.workunit.client.1.smithi047.stdout:5/928: dwrite d19/d25/d45/f119 [0,4194304] 0 2024-09-13T22:56:29.800 INFO:tasks.workunit.client.1.smithi047.stdout:5/929: getdents d19/d23/d2e/d41/d58/dfc/d5d/d9d 0 2024-09-13T22:56:29.804 INFO:tasks.workunit.client.1.smithi047.stdout:7/960: dread d0/f1f [0,4194304] 0 2024-09-13T22:56:29.807 INFO:tasks.workunit.client.1.smithi047.stdout:5/930: dwrite d19/d23/d2e/ffb [0,4194304] 0 2024-09-13T22:56:29.812 INFO:tasks.workunit.client.1.smithi047.stdout:5/931: creat d19/d83/f120 x:0 0 0 2024-09-13T22:56:29.813 INFO:tasks.workunit.client.1.smithi047.stdout:7/961: dwrite d0/d7/da/d4e/dd1/feb [0,4194304] 0 2024-09-13T22:56:29.815 INFO:tasks.workunit.client.1.smithi047.stdout:5/932: creat d19/d23/d2e/d41/d58/dfc/f121 x:0 0 0 2024-09-13T22:56:29.817 INFO:tasks.workunit.client.1.smithi047.stdout:7/962: mkdir d0/d7/da/d1e/de7/d147 0 2024-09-13T22:56:29.821 INFO:tasks.workunit.client.1.smithi047.stdout:7/963: mknod d0/d7/da/d4e/d10d/d134/c148 0 2024-09-13T22:56:29.822 INFO:tasks.workunit.client.1.smithi047.stdout:5/933: getdents d19/d83 0 2024-09-13T22:56:29.826 INFO:tasks.workunit.client.1.smithi047.stdout:5/934: creat d19/d23/d2e/d41/d58/dfc/d5d/d80/f122 x:0 0 0 2024-09-13T22:56:29.829 INFO:tasks.workunit.client.1.smithi047.stdout:5/935: mkdir d19/d123 0 2024-09-13T22:56:29.832 INFO:tasks.workunit.client.1.smithi047.stdout:7/964: dwrite d0/db/fda [0,4194304] 0 2024-09-13T22:56:29.833 INFO:tasks.workunit.client.1.smithi047.stdout:7/965: stat d0/d7 0 2024-09-13T22:56:29.834 INFO:tasks.workunit.client.0.smithi002.stdout:0/941: mknod d1/c158 0 2024-09-13T22:56:29.834 INFO:tasks.workunit.client.1.smithi047.stdout:5/936: creat d19/d34/f124 x:0 0 0 2024-09-13T22:56:29.835 INFO:tasks.workunit.client.0.smithi002.stdout:7/972: mknod d8/d10/d39/d60/db8/d26/d4c/d81/db5/c123 0 2024-09-13T22:56:29.836 INFO:tasks.workunit.client.1.smithi047.stdout:5/937: stat d19/d23/d2e/d41/d58/dfc/d5d/dd8/cf1 0 2024-09-13T22:56:29.837 INFO:tasks.workunit.client.0.smithi002.stdout:6/969: write d12/d17/d28/d67/d6b/fb3 [2419307,75204] 0 2024-09-13T22:56:29.838 INFO:tasks.workunit.client.1.smithi047.stdout:7/966: fdatasync d0/d7/da/d1e/d93/f106 0 2024-09-13T22:56:29.839 INFO:tasks.workunit.client.0.smithi002.stdout:4/908: dwrite d3/d14/f42 [0,4194304] 0 2024-09-13T22:56:29.839 INFO:tasks.workunit.client.0.smithi002.stdout:5/969: truncate d1/d2a/d6b/d88/d55/ffe 1672313 0 2024-09-13T22:56:29.840 INFO:tasks.workunit.client.0.smithi002.stdout:4/909: chown d3/d14/d86/fd1 209 1 2024-09-13T22:56:29.842 INFO:tasks.workunit.client.1.smithi047.stdout:5/938: creat d19/d23/d2e/d41/d58/dfc/f125 x:0 0 0 2024-09-13T22:56:29.846 INFO:tasks.workunit.client.1.smithi047.stdout:7/967: symlink d0/d7/da/d2e/d64/l149 0 2024-09-13T22:56:29.852 INFO:tasks.workunit.client.1.smithi047.stdout:7/968: truncate d0/d19/f7c 2203188 0 2024-09-13T22:56:29.852 INFO:tasks.workunit.client.1.smithi047.stdout:7/969: chown d0/d7/da/d1e 15918 1 2024-09-13T22:56:29.854 INFO:tasks.workunit.client.1.smithi047.stdout:7/970: chown d0/d57/d5b/d5c/db6/df3/ff8 8 1 2024-09-13T22:56:29.856 INFO:tasks.workunit.client.1.smithi047.stdout:7/971: mkdir d0/da2/d14a 0 2024-09-13T22:56:29.860 INFO:tasks.workunit.client.1.smithi047.stdout:7/972: dread d0/d7/da/d47/fa1 [0,4194304] 0 2024-09-13T22:56:29.869 INFO:tasks.workunit.client.1.smithi047.stdout:7/973: rename d0/d7/da/d1e/cb0 to d0/d7/da/d2e/c14b 0 2024-09-13T22:56:29.870 INFO:tasks.workunit.client.1.smithi047.stdout:5/939: write d19/d23/d2e/d41/d58/dfc/f5b [3393496,21631] 0 2024-09-13T22:56:29.870 INFO:tasks.workunit.client.1.smithi047.stdout:7/974: stat d0/d7/f7a 0 2024-09-13T22:56:29.872 INFO:tasks.workunit.client.1.smithi047.stdout:7/975: write d0/d7/da/d4e/dd1/feb [3087432,35570] 0 2024-09-13T22:56:29.880 INFO:tasks.workunit.client.1.smithi047.stdout:7/976: mknod d0/d7/c14c 0 2024-09-13T22:56:29.883 INFO:tasks.workunit.client.1.smithi047.stdout:7/977: fsync d0/d57/da6/fb3 0 2024-09-13T22:56:29.887 INFO:tasks.workunit.client.1.smithi047.stdout:7/978: creat d0/d7/da/d105/d125/d10a/f14d x:0 0 0 2024-09-13T22:56:29.889 INFO:tasks.workunit.client.0.smithi002.stdout:6/970: symlink d12/d17/ddf/d112/l138 0 2024-09-13T22:56:29.890 INFO:tasks.workunit.client.0.smithi002.stdout:6/971: read d12/d17/f6e [639079,94376] 0 2024-09-13T22:56:29.891 INFO:tasks.workunit.client.0.smithi002.stdout:0/942: dread d1/d4/d75/d31/d32/f39 [0,4194304] 0 2024-09-13T22:56:29.892 INFO:tasks.workunit.client.0.smithi002.stdout:0/943: chown d1/d4/da3/d7d/cfd 54637 1 2024-09-13T22:56:29.896 INFO:tasks.workunit.client.0.smithi002.stdout:4/910: rename d3/d14/d29/d2a/da6/d9f/d10e/dfd/l101 to d3/d14/d29/d2a/da6/d69/d7e/l127 0 2024-09-13T22:56:29.897 INFO:tasks.workunit.client.0.smithi002.stdout:7/973: mkdir d8/d10/d39/d60/db8/d124 0 2024-09-13T22:56:29.897 INFO:tasks.workunit.client.1.smithi047.stdout:5/940: write d19/d23/d2e/d41/d58/dbf/fe4 [549815,19671] 0 2024-09-13T22:56:29.899 INFO:tasks.workunit.client.1.smithi047.stdout:7/979: dread d0/d7/fc6 [0,4194304] 0 2024-09-13T22:56:29.904 INFO:tasks.workunit.client.1.smithi047.stdout:5/941: rename d19/d23/d2e/d41/d58/dfc/f88 to d19/d83/f126 0 2024-09-13T22:56:29.905 INFO:tasks.workunit.client.0.smithi002.stdout:6/972: mkdir d12/d17/d34/d39/d8b/d12a/d139 0 2024-09-13T22:56:29.910 INFO:tasks.workunit.client.0.smithi002.stdout:5/970: dread d1/d2a/d6b/f71 [0,4194304] 0 2024-09-13T22:56:29.910 INFO:tasks.workunit.client.0.smithi002.stdout:5/971: readlink d1/d2a/d6b/d88/d45/d4f/db7/lcc 0 2024-09-13T22:56:29.910 INFO:tasks.workunit.client.0.smithi002.stdout:7/974: dread - d8/d10/d39/d60/db8/d26/d4c/d81/d51/fec zero size 2024-09-13T22:56:29.910 INFO:tasks.workunit.client.1.smithi047.stdout:5/942: write d19/d23/d2e/d41/d58/dfc/d5d/fb4 [554856,36238] 0 2024-09-13T22:56:29.910 INFO:tasks.workunit.client.1.smithi047.stdout:7/980: fdatasync d0/d57/da6/ffd 0 2024-09-13T22:56:29.910 INFO:tasks.workunit.client.1.smithi047.stdout:5/943: write d19/d23/d4c/fb3 [1362043,38813] 0 2024-09-13T22:56:29.910 INFO:tasks.workunit.client.1.smithi047.stdout:5/944: chown d19/d23/d2e/d41/le3 4838 1 2024-09-13T22:56:29.910 INFO:tasks.workunit.client.1.smithi047.stdout:5/945: stat d19/d23/d4c/d103/d116/cf5 0 2024-09-13T22:56:29.913 INFO:tasks.workunit.client.0.smithi002.stdout:7/975: dwrite d8/d10/d39/d60/db8/d26/d4c/d81/f1a [8388608,4194304] 0 2024-09-13T22:56:29.916 INFO:tasks.workunit.client.0.smithi002.stdout:6/973: rename d12/d17/d34/d4b to d12/d17/d34/d39/d8b/dcb/d13a 0 2024-09-13T22:56:29.921 INFO:tasks.workunit.client.0.smithi002.stdout:0/944: write d1/d2/d6c/f10f [8100,36605] 0 2024-09-13T22:56:29.921 INFO:tasks.workunit.client.0.smithi002.stdout:7/976: dwrite d8/d10/d39/d60/ff0 [0,4194304] 0 2024-09-13T22:56:29.927 INFO:tasks.workunit.client.0.smithi002.stdout:4/911: dwrite d3/d14/d29/d2a/da6/d69/d7e/fa0 [0,4194304] 0 2024-09-13T22:56:29.928 INFO:tasks.workunit.client.0.smithi002.stdout:4/912: readlink d3/d40/lf5 0 2024-09-13T22:56:29.928 INFO:tasks.workunit.client.0.smithi002.stdout:6/974: symlink d12/d17/d28/d7d/df2/l13b 0 2024-09-13T22:56:29.929 INFO:tasks.workunit.client.0.smithi002.stdout:4/913: dread - d3/d14/d29/d2a/da6/f121 zero size 2024-09-13T22:56:29.931 INFO:tasks.workunit.client.1.smithi047.stdout:7/981: dread d0/d7/da/d1e/f68 [0,4194304] 0 2024-09-13T22:56:29.931 INFO:tasks.workunit.client.0.smithi002.stdout:7/977: creat d8/d10/d39/d60/db8/d26/d4c/d81/d51/da9/f125 x:0 0 0 2024-09-13T22:56:29.932 INFO:tasks.workunit.client.1.smithi047.stdout:7/982: dread - d0/db/de8/f119 zero size 2024-09-13T22:56:29.933 INFO:tasks.workunit.client.0.smithi002.stdout:5/972: rename d1/d2a/d6b/d88/d55/d56/d81/fc9 to d1/d2a/d6b/d88/d55/d56/f157 0 2024-09-13T22:56:29.935 INFO:tasks.workunit.client.1.smithi047.stdout:5/946: write d19/d23/d2e/d41/d58/dfc/d5d/d80/fcd [965288,43665] 0 2024-09-13T22:56:29.937 INFO:tasks.workunit.client.0.smithi002.stdout:4/914: dwrite d3/f3a [0,4194304] 0 2024-09-13T22:56:29.937 INFO:tasks.workunit.client.0.smithi002.stdout:6/975: truncate fa 2192630 0 2024-09-13T22:56:29.938 INFO:tasks.workunit.client.0.smithi002.stdout:4/915: fdatasync d3/d14/d29/d2a/da6/f121 0 2024-09-13T22:56:29.938 INFO:tasks.workunit.client.1.smithi047.stdout:7/983: mkdir d0/d57/d14e 0 2024-09-13T22:56:29.941 INFO:tasks.workunit.client.1.smithi047.stdout:7/984: read d0/d57/d5b/d8b/fd0 [2500314,16762] 0 2024-09-13T22:56:29.945 INFO:tasks.workunit.client.0.smithi002.stdout:2/930: sync 2024-09-13T22:56:29.945 INFO:tasks.workunit.client.0.smithi002.stdout:0/945: rmdir d1/d4/d75/d31/de0/d102/d154 0 2024-09-13T22:56:29.947 INFO:tasks.workunit.client.0.smithi002.stdout:0/946: chown d1/d4/d75/d31/d32/dbb/de1/fe9 2 1 2024-09-13T22:56:29.949 INFO:tasks.workunit.client.0.smithi002.stdout:4/916: unlink d3/d62/fb6 0 2024-09-13T22:56:29.950 INFO:tasks.workunit.client.0.smithi002.stdout:4/917: readlink d3/d14/d29/d2a/d30/l41 0 2024-09-13T22:56:29.953 INFO:tasks.workunit.client.0.smithi002.stdout:5/973: dread d1/d2a/d6b/d88/d45/f48 [0,4194304] 0 2024-09-13T22:56:29.954 INFO:tasks.workunit.client.0.smithi002.stdout:2/931: rename d1/f5 to d1/d7/d10a/f134 0 2024-09-13T22:56:29.957 INFO:tasks.workunit.client.0.smithi002.stdout:0/947: creat d1/d4/d75/d31/df1/f159 x:0 0 0 2024-09-13T22:56:29.958 INFO:tasks.workunit.client.1.smithi047.stdout:7/985: link d0/d7/da/d2e/db5/cba d0/d7/da/d4e/dd1/d130/c14f 0 2024-09-13T22:56:29.960 INFO:tasks.workunit.client.0.smithi002.stdout:4/918: creat d3/db3/db9/f128 x:0 0 0 2024-09-13T22:56:29.961 INFO:tasks.workunit.client.0.smithi002.stdout:7/978: dwrite d8/d10/d39/d60/db8/d26/d4c/d81/db5/fd1 [0,4194304] 0 2024-09-13T22:56:29.963 INFO:tasks.workunit.client.1.smithi047.stdout:5/947: dwrite d19/f36 [0,4194304] 0 2024-09-13T22:56:29.964 INFO:tasks.workunit.client.0.smithi002.stdout:2/932: rename d1/d7/d41/d96/c9a to d1/d32/d37/c135 0 2024-09-13T22:56:29.964 INFO:tasks.workunit.client.0.smithi002.stdout:7/979: fsync d8/d10/d39/d60/db8/d2e/d50/d52/d99/f115 0 2024-09-13T22:56:29.965 INFO:tasks.workunit.client.0.smithi002.stdout:0/948: dwrite d1/d7e/d9d/de6/f12c [0,4194304] 0 2024-09-13T22:56:29.966 INFO:tasks.workunit.client.0.smithi002.stdout:6/976: creat d12/d17/d34/d39/d8a/f13c x:0 0 0 2024-09-13T22:56:29.967 INFO:tasks.workunit.client.0.smithi002.stdout:7/980: readlink d8/d10/d39/d60/db8/d2e/d50/d52/d72/l76 0 2024-09-13T22:56:29.968 INFO:tasks.workunit.client.1.smithi047.stdout:7/986: dwrite d0/d7/da/d47/d92/f144 [0,4194304] 0 2024-09-13T22:56:29.970 INFO:tasks.workunit.client.1.smithi047.stdout:8/973: sync 2024-09-13T22:56:29.974 INFO:tasks.workunit.client.0.smithi002.stdout:5/974: fdatasync d1/d10/f75 0 2024-09-13T22:56:29.974 INFO:tasks.workunit.client.1.smithi047.stdout:7/987: read d0/d19/fc0 [209001,66281] 0 2024-09-13T22:56:29.979 INFO:tasks.workunit.client.0.smithi002.stdout:2/933: creat d1/d7/d41/d96/dba/f136 x:0 0 0 2024-09-13T22:56:29.980 INFO:tasks.workunit.client.0.smithi002.stdout:2/934: write d1/d7/d8/d2c/da4/ffd [244459,104528] 0 2024-09-13T22:56:29.981 INFO:tasks.workunit.client.0.smithi002.stdout:0/949: mknod d1/d2/d6c/c15a 0 2024-09-13T22:56:29.986 INFO:tasks.workunit.client.1.smithi047.stdout:5/948: link d19/d25/l74 d19/d23/d2e/d41/d58/dfc/d5d/d80/l127 0 2024-09-13T22:56:29.989 INFO:tasks.workunit.client.0.smithi002.stdout:4/919: symlink d3/d14/d29/l129 0 2024-09-13T22:56:29.993 INFO:tasks.workunit.client.1.smithi047.stdout:5/949: creat d19/d23/d2e/d41/d58/dbf/f128 x:0 0 0 2024-09-13T22:56:29.996 INFO:tasks.workunit.client.1.smithi047.stdout:7/988: creat d0/d7/da/d2e/f150 x:0 0 0 2024-09-13T22:56:29.996 INFO:tasks.workunit.client.1.smithi047.stdout:5/950: truncate d19/d23/d2e/d41/d58/dfc/d5d/d80/f122 1002874 0 2024-09-13T22:56:29.997 INFO:tasks.workunit.client.1.smithi047.stdout:7/989: readlink d0/d7/da/d47/d92/l116 0 2024-09-13T22:56:29.997 INFO:tasks.workunit.client.1.smithi047.stdout:5/951: dread - d19/d34/f124 zero size 2024-09-13T22:56:30.000 INFO:tasks.workunit.client.0.smithi002.stdout:2/935: creat d1/d7/d8/d4f/df7/f137 x:0 0 0 2024-09-13T22:56:30.001 INFO:tasks.workunit.client.1.smithi047.stdout:7/990: creat d0/d7/da/d2e/db5/f151 x:0 0 0 2024-09-13T22:56:30.003 INFO:tasks.workunit.client.0.smithi002.stdout:2/936: dread d1/d7/d41/d96/fc9 [0,4194304] 0 2024-09-13T22:56:30.003 INFO:tasks.workunit.client.0.smithi002.stdout:7/981: mknod d8/d10/d39/d60/db8/d26/d4c/d81/db6/dc3/c126 0 2024-09-13T22:56:30.005 INFO:tasks.workunit.client.0.smithi002.stdout:0/950: dwrite d1/d7e/d9d/de3/f135 [0,4194304] 0 2024-09-13T22:56:30.007 INFO:tasks.workunit.client.0.smithi002.stdout:4/920: creat d3/d14/d29/d2a/da6/d9f/f12a x:0 0 0 2024-09-13T22:56:30.008 INFO:tasks.workunit.client.1.smithi047.stdout:8/974: dwrite d8/d64/ffb [0,4194304] 0 2024-09-13T22:56:30.009 INFO:tasks.workunit.client.1.smithi047.stdout:7/991: dwrite d0/d7/da/d4e/f66 [0,4194304] 0 2024-09-13T22:56:30.012 INFO:tasks.workunit.client.0.smithi002.stdout:4/921: dread d3/d14/d29/d2a/da6/fcf [0,4194304] 0 2024-09-13T22:56:30.015 INFO:tasks.workunit.client.1.smithi047.stdout:8/975: fsync d8/d6b/f99 0 2024-09-13T22:56:30.015 INFO:tasks.workunit.client.0.smithi002.stdout:5/975: dwrite d1/d2a/d5a/f6d [4194304,4194304] 0 2024-09-13T22:56:30.016 INFO:tasks.workunit.client.1.smithi047.stdout:8/976: truncate d8/d77/f13e 739691 0 2024-09-13T22:56:30.020 INFO:tasks.workunit.client.1.smithi047.stdout:5/952: rmdir d19/d23/d32/d11f 0 2024-09-13T22:56:30.024 INFO:tasks.workunit.client.1.smithi047.stdout:7/992: symlink d0/db/l152 0 2024-09-13T22:56:30.025 INFO:tasks.workunit.client.0.smithi002.stdout:6/977: getdents d12/d17/d28/d7d 0 2024-09-13T22:56:30.027 INFO:tasks.workunit.client.1.smithi047.stdout:5/953: creat d19/d83/d98/dd0/f129 x:0 0 0 2024-09-13T22:56:30.027 INFO:tasks.workunit.client.1.smithi047.stdout:7/993: dread d0/d7/da/d2e/d64/f6a [0,4194304] 0 2024-09-13T22:56:30.031 INFO:tasks.workunit.client.0.smithi002.stdout:5/976: mkdir d1/d2a/d6b/d88/d55/d56/d81/d158 0 2024-09-13T22:56:30.033 INFO:tasks.workunit.client.0.smithi002.stdout:5/977: truncate d1/d2a/d6b/d88/d55/d56/d86/d100/f146 548426 0 2024-09-13T22:56:30.037 INFO:tasks.workunit.client.0.smithi002.stdout:5/978: creat d1/d2a/d6b/d88/d45/df4/f159 x:0 0 0 2024-09-13T22:56:30.039 INFO:tasks.workunit.client.0.smithi002.stdout:7/982: getdents d8/d10/d39/d60/db8/d2e/d3c/d3e/da1 0 2024-09-13T22:56:30.041 INFO:tasks.workunit.client.0.smithi002.stdout:6/978: dwrite d12/d17/d28/d67/d9f/ddd/f109 [0,4194304] 0 2024-09-13T22:56:30.041 INFO:tasks.workunit.client.0.smithi002.stdout:5/979: getdents d1/d2a/d5a 0 2024-09-13T22:56:30.044 INFO:tasks.workunit.client.0.smithi002.stdout:6/979: read - d12/d17/d34/d39/d8b/f12e zero size 2024-09-13T22:56:30.047 INFO:tasks.workunit.client.1.smithi047.stdout:7/994: dread d0/db/f7e [0,4194304] 0 2024-09-13T22:56:30.048 INFO:tasks.workunit.client.0.smithi002.stdout:4/922: write d3/d14/d86/f95 [919524,109587] 0 2024-09-13T22:56:30.050 INFO:tasks.workunit.client.1.smithi047.stdout:7/995: mknod d0/d57/dee/c153 0 2024-09-13T22:56:30.050 INFO:tasks.workunit.client.0.smithi002.stdout:2/937: dwrite d1/d7/d35/fde [0,4194304] 0 2024-09-13T22:56:30.051 INFO:tasks.workunit.client.1.smithi047.stdout:7/996: dread - d0/d7/da/d1e/d51/f140 zero size 2024-09-13T22:56:30.052 INFO:tasks.workunit.client.1.smithi047.stdout:7/997: chown d0/d7/da/f74 1618490 1 2024-09-13T22:56:30.053 INFO:tasks.workunit.client.0.smithi002.stdout:6/980: creat d12/d17/d34/d39/d8b/dcb/d13a/d133/f13d x:0 0 0 2024-09-13T22:56:30.054 INFO:tasks.workunit.client.0.smithi002.stdout:7/983: write d8/d10/d39/f4a [5000770,95109] 0 2024-09-13T22:56:30.054 INFO:tasks.workunit.client.0.smithi002.stdout:6/981: fsync d12/d17/fd2 0 2024-09-13T22:56:30.055 INFO:tasks.workunit.client.0.smithi002.stdout:2/938: creat d1/d7/d41/d96/dba/df1/f138 x:0 0 0 2024-09-13T22:56:30.056 INFO:tasks.workunit.client.0.smithi002.stdout:2/939: chown d1/da9/dbd 210 1 2024-09-13T22:56:30.056 INFO:tasks.workunit.client.0.smithi002.stdout:6/982: fsync d12/d17/d28/f2e 0 2024-09-13T22:56:30.057 INFO:tasks.workunit.client.0.smithi002.stdout:7/984: stat d8/f5d 0 2024-09-13T22:56:30.060 INFO:tasks.workunit.client.0.smithi002.stdout:7/985: rmdir d8/d10/d39/d60 39 2024-09-13T22:56:30.060 INFO:tasks.workunit.client.0.smithi002.stdout:5/980: dread d1/d2a/d6b/d88/d55/d56/d86/f123 [0,4194304] 0 2024-09-13T22:56:30.062 INFO:tasks.workunit.client.1.smithi047.stdout:7/998: rename d0/da2/ldb to d0/d7/da/l154 0 2024-09-13T22:56:30.064 INFO:tasks.workunit.client.1.smithi047.stdout:7/999: symlink d0/d57/d5b/d5c/db6/l155 0 2024-09-13T22:56:30.065 INFO:tasks.workunit.client.0.smithi002.stdout:6/983: symlink d12/d17/d28/d67/dca/l13e 0 2024-09-13T22:56:30.066 INFO:tasks.workunit.client.0.smithi002.stdout:5/981: dread - d1/d2a/d6b/d88/d45/d4f/d78/d8b/ddb/f115 zero size 2024-09-13T22:56:30.067 INFO:tasks.workunit.client.0.smithi002.stdout:7/986: unlink d8/d10/d39/d60/db8/d26/d4c/d81/f19 0 2024-09-13T22:56:30.070 INFO:tasks.workunit.client.0.smithi002.stdout:2/940: dread d1/d7/d8/f5d [0,4194304] 0 2024-09-13T22:56:30.071 INFO:tasks.workunit.client.0.smithi002.stdout:6/984: creat d12/d17/d34/f13f x:0 0 0 2024-09-13T22:56:30.072 INFO:tasks.workunit.client.0.smithi002.stdout:4/923: dread d3/d14/d29/d2a/f44 [0,4194304] 0 2024-09-13T22:56:30.072 INFO:tasks.workunit.client.0.smithi002.stdout:5/982: mknod d1/d2a/d6b/d88/d45/d4f/db7/d112/d14e/c15a 0 2024-09-13T22:56:30.073 INFO:tasks.workunit.client.0.smithi002.stdout:4/924: chown d3/d14/d29/d2a/da6/c3f 39 1 2024-09-13T22:56:30.073 INFO:tasks.workunit.client.0.smithi002.stdout:5/983: read - d1/d2a/d6b/d88/d45/df4/f159 zero size 2024-09-13T22:56:30.074 INFO:tasks.workunit.client.0.smithi002.stdout:5/984: chown d1/d2a/d6b/d88/d45/d4f/d78/ld8 906322733 1 2024-09-13T22:56:30.075 INFO:tasks.workunit.client.0.smithi002.stdout:5/985: write d1/d2a/d6b/d88/f74 [2757749,89007] 0 2024-09-13T22:56:30.076 INFO:tasks.workunit.client.0.smithi002.stdout:2/941: creat d1/d7/d35/d78/dfc/f139 x:0 0 0 2024-09-13T22:56:30.077 INFO:tasks.workunit.client.0.smithi002.stdout:4/925: creat d3/db3/db9/d11b/f12b x:0 0 0 2024-09-13T22:56:30.078 INFO:tasks.workunit.client.0.smithi002.stdout:7/987: write d8/d10/f89 [1254280,1545] 0 2024-09-13T22:56:30.078 INFO:tasks.workunit.client.0.smithi002.stdout:8/982: sync 2024-09-13T22:56:30.081 INFO:tasks.workunit.client.0.smithi002.stdout:2/942: truncate d1/d4d/d8b/fb9 156157 0 2024-09-13T22:56:30.085 INFO:tasks.workunit.client.0.smithi002.stdout:2/943: rename d1/d7/d35/d78/l67 to d1/d7/d10a/l13a 0 2024-09-13T22:56:30.088 INFO:tasks.workunit.client.0.smithi002.stdout:2/944: rmdir d1/d7/d8/d4f/df7 39 2024-09-13T22:56:30.089 INFO:tasks.workunit.client.0.smithi002.stdout:8/983: write d3/f24 [908296,99965] 0 2024-09-13T22:56:30.090 INFO:tasks.workunit.client.0.smithi002.stdout:5/986: dread d1/d2a/d6b/d88/d45/f61 [0,4194304] 0 2024-09-13T22:56:30.091 INFO:tasks.workunit.client.0.smithi002.stdout:2/945: chown d1/d7/d35/d3e/d5e/fd7 5775 1 2024-09-13T22:56:30.091 INFO:tasks.workunit.client.0.smithi002.stdout:8/984: read d3/dc/d16/d97/f107 [99047,123913] 0 2024-09-13T22:56:30.093 INFO:tasks.workunit.client.0.smithi002.stdout:7/988: dread d8/d10/d39/d60/db8/f21 [0,4194304] 0 2024-09-13T22:56:30.094 INFO:tasks.workunit.client.0.smithi002.stdout:2/946: creat d1/d4d/f13b x:0 0 0 2024-09-13T22:56:30.095 INFO:tasks.workunit.client.0.smithi002.stdout:8/985: mkdir d3/d27/da3/d138 0 2024-09-13T22:56:30.096 INFO:tasks.workunit.client.0.smithi002.stdout:5/987: creat d1/d2a/d6b/d88/d45/d4f/da7/daa/f15b x:0 0 0 2024-09-13T22:56:30.097 INFO:tasks.workunit.client.0.smithi002.stdout:2/947: mkdir d1/d7/d41/d13c 0 2024-09-13T22:56:30.099 INFO:tasks.workunit.client.0.smithi002.stdout:7/989: fsync d8/d10/d39/d60/db8/d2e/d3c/f91 0 2024-09-13T22:56:30.104 INFO:tasks.workunit.client.0.smithi002.stdout:5/988: symlink d1/d2a/d6b/d88/d55/l15c 0 2024-09-13T22:56:30.106 INFO:tasks.workunit.client.0.smithi002.stdout:8/986: creat d3/dc/d18/f139 x:0 0 0 2024-09-13T22:56:30.108 INFO:tasks.workunit.client.0.smithi002.stdout:5/989: mkdir d1/d2a/d6b/d88/d55/d56/d81/d15d 0 2024-09-13T22:56:30.113 INFO:tasks.workunit.client.0.smithi002.stdout:2/948: write d1/d32/d37/f9c [1083944,79871] 0 2024-09-13T22:56:30.113 INFO:tasks.workunit.client.0.smithi002.stdout:7/990: write d8/d10/d39/d60/db8/d26/d4c/d81/f57 [3050189,106063] 0 2024-09-13T22:56:30.113 INFO:tasks.workunit.client.0.smithi002.stdout:2/949: creat d1/d4a/f13d x:0 0 0 2024-09-13T22:56:30.114 INFO:tasks.workunit.client.0.smithi002.stdout:5/990: rename d1/d2a/d6b/d88/d45/d4f/da7/daa to d1/d2a/d6b/d88/d55/d56/d86/d100/d15e 0 2024-09-13T22:56:30.116 INFO:tasks.workunit.client.0.smithi002.stdout:8/987: rmdir d3/dc/d16/d97/d12f 0 2024-09-13T22:56:30.117 INFO:tasks.workunit.client.0.smithi002.stdout:2/950: creat d1/d7/d35/d78/dfc/d87/f13e x:0 0 0 2024-09-13T22:56:30.119 INFO:tasks.workunit.client.0.smithi002.stdout:5/991: creat d1/d2a/d6b/d88/d55/d56/d86/d100/d15e/f15f x:0 0 0 2024-09-13T22:56:30.122 INFO:tasks.workunit.client.0.smithi002.stdout:7/991: write d8/d10/d39/d60/db8/d26/d38/fac [1886171,73938] 0 2024-09-13T22:56:30.123 INFO:tasks.workunit.client.0.smithi002.stdout:2/951: creat d1/d7/d8/d2c/d9d/f13f x:0 0 0 2024-09-13T22:56:30.126 INFO:tasks.workunit.client.0.smithi002.stdout:7/992: mknod d8/d10/d39/c127 0 2024-09-13T22:56:30.129 INFO:tasks.workunit.client.0.smithi002.stdout:5/992: getdents d1/d2a/d69/db8 0 2024-09-13T22:56:30.129 INFO:tasks.workunit.client.0.smithi002.stdout:8/988: dwrite d3/dc/f22 [0,4194304] 0 2024-09-13T22:56:30.131 INFO:tasks.workunit.client.0.smithi002.stdout:2/952: link d1/d4a/c117 d1/d7/d8/d2c/c140 0 2024-09-13T22:56:30.133 INFO:tasks.workunit.client.0.smithi002.stdout:2/953: chown d1/d7/d35/d78/dfc/d6b/d75/f91 12907111 1 2024-09-13T22:56:30.136 INFO:tasks.workunit.client.0.smithi002.stdout:5/993: dwrite d1/d10/f51 [0,4194304] 0 2024-09-13T22:56:30.136 INFO:tasks.workunit.client.0.smithi002.stdout:2/954: unlink d1/d4d/cef 0 2024-09-13T22:56:30.138 INFO:tasks.workunit.client.0.smithi002.stdout:8/989: creat d3/dc/d18/d6f/f13a x:0 0 0 2024-09-13T22:56:30.138 INFO:tasks.workunit.client.0.smithi002.stdout:2/955: dread - d1/d7/d35/d78/dfc/f139 zero size 2024-09-13T22:56:30.142 INFO:tasks.workunit.client.0.smithi002.stdout:2/956: creat d1/d32/d37/d79/f141 x:0 0 0 2024-09-13T22:56:30.143 INFO:tasks.workunit.client.0.smithi002.stdout:5/994: truncate d1/d2a/d6b/d88/d55/d56/dc7/fb1 1632270 0 2024-09-13T22:56:30.145 INFO:tasks.workunit.client.0.smithi002.stdout:2/957: creat d1/d7/d10a/f142 x:0 0 0 2024-09-13T22:56:30.146 INFO:tasks.workunit.client.0.smithi002.stdout:8/990: dwrite d3/dc/d16/d97/fb5 [0,4194304] 0 2024-09-13T22:56:30.150 INFO:tasks.workunit.client.0.smithi002.stdout:8/991: rmdir d3/d21/d57/da1/dbc 39 2024-09-13T22:56:30.151 INFO:tasks.workunit.client.0.smithi002.stdout:5/995: dwrite d1/d10/f35 [0,4194304] 0 2024-09-13T22:56:30.156 INFO:tasks.workunit.client.0.smithi002.stdout:7/993: dread d8/d10/d39/d60/db8/d26/d4c/d81/f1a [0,4194304] 0 2024-09-13T22:56:30.157 INFO:tasks.workunit.client.0.smithi002.stdout:8/992: symlink d3/dc/d16/d2f/d83/d85/dba/d124/l13b 0 2024-09-13T22:56:30.162 INFO:tasks.workunit.client.0.smithi002.stdout:7/994: truncate d8/d10/d39/d60/db8/f21 3503626 0 2024-09-13T22:56:30.163 INFO:tasks.workunit.client.0.smithi002.stdout:7/995: dread - d8/d10/d11/d3a/f10d zero size 2024-09-13T22:56:30.165 INFO:tasks.workunit.client.0.smithi002.stdout:5/996: write d1/f2f [4904373,46057] 0 2024-09-13T22:56:30.165 INFO:tasks.workunit.client.0.smithi002.stdout:8/993: write d3/dc/fe [1261995,72810] 0 2024-09-13T22:56:30.173 INFO:tasks.workunit.client.0.smithi002.stdout:5/997: write d1/d2a/d6b/d88/d55/d56/dc7/f126 [457362,40611] 0 2024-09-13T22:56:30.174 INFO:tasks.workunit.client.0.smithi002.stdout:7/996: getdents d8/d10/d39/d60/db8/d26/d4c/d81/d51/da9 0 2024-09-13T22:56:30.174 INFO:tasks.workunit.client.0.smithi002.stdout:0/951: sync 2024-09-13T22:56:30.175 INFO:tasks.workunit.client.0.smithi002.stdout:8/994: write d3/dc/d51/d99/f7e [114625,6974] 0 2024-09-13T22:56:30.177 INFO:tasks.workunit.client.0.smithi002.stdout:0/952: symlink d1/d2/d14c/l15b 0 2024-09-13T22:56:30.179 INFO:tasks.workunit.client.0.smithi002.stdout:8/995: rmdir d3/dc/d16/d2f/d83/d95/dbb 39 2024-09-13T22:56:30.180 INFO:tasks.workunit.client.0.smithi002.stdout:8/996: chown d3/d21/d57 261048281 1 2024-09-13T22:56:30.181 INFO:tasks.workunit.client.0.smithi002.stdout:8/997: truncate d3/f137 552556 0 2024-09-13T22:56:30.181 INFO:tasks.workunit.client.0.smithi002.stdout:5/998: mkdir d1/d2a/d6b/d88/d125/d160 0 2024-09-13T22:56:30.182 INFO:tasks.workunit.client.0.smithi002.stdout:8/998: write d3/dc/d8b/f113 [14659,124922] 0 2024-09-13T22:56:30.183 INFO:tasks.workunit.client.0.smithi002.stdout:8/999: chown d3/dc/d16/d4b/d72/d73 43067 1 2024-09-13T22:56:30.184 INFO:tasks.workunit.client.0.smithi002.stdout:0/953: rmdir d1/d4/d75/d76/d120 39 2024-09-13T22:56:30.184 INFO:tasks.workunit.client.0.smithi002.stdout:5/999: dread - d1/d2a/d6b/d88/d45/d4f/da7/fef zero size 2024-09-13T22:56:30.184 INFO:tasks.workunit.client.0.smithi002.stdout:0/954: dread - d1/d7e/d9d/de3/d149/f128 zero size 2024-09-13T22:56:30.187 INFO:tasks.workunit.client.0.smithi002.stdout:0/955: rmdir d1/d2/d6c/d8b 39 2024-09-13T22:56:30.188 INFO:tasks.workunit.client.0.smithi002.stdout:7/997: dread d8/d10/d39/d60/db8/d26/d4c/f64 [0,4194304] 0 2024-09-13T22:56:30.188 INFO:tasks.workunit.client.0.smithi002.stdout:0/956: rmdir d1/d4/d75/d31 39 2024-09-13T22:56:30.189 INFO:tasks.workunit.client.0.smithi002.stdout:7/998: read d8/d10/d39/d60/db8/d26/d4c/d81/f1a [7245944,115131] 0 2024-09-13T22:56:30.189 INFO:tasks.workunit.client.0.smithi002.stdout:0/957: fdatasync d1/d4/f35 0 2024-09-13T22:56:30.193 INFO:tasks.workunit.client.0.smithi002.stdout:0/958: getdents d1/d2/d14c 0 2024-09-13T22:56:30.194 INFO:tasks.workunit.client.0.smithi002.stdout:0/959: truncate d1/d4/d75/f124 307510 0 2024-09-13T22:56:30.195 INFO:tasks.workunit.client.0.smithi002.stdout:7/999: dwrite d8/d10/d39/d60/db8/d26/d38/fac [0,4194304] 0 2024-09-13T22:56:30.195 INFO:tasks.workunit.client.0.smithi002.stdout:0/960: readlink d1/d2/d6c/lee 0 2024-09-13T22:56:30.197 INFO:tasks.workunit.client.0.smithi002.stdout:0/961: write d1/d4/da3/d7d/f9c [399532,95974] 0 2024-09-13T22:56:30.199 INFO:tasks.workunit.client.0.smithi002.stdout:0/962: fdatasync d1/d4/d75/d76/d120/f12d 0 2024-09-13T22:56:30.202 INFO:tasks.workunit.client.0.smithi002.stdout:0/963: mknod d1/d7e/d9d/c15c 0 2024-09-13T22:56:30.208 INFO:tasks.workunit.client.0.smithi002.stdout:0/964: dwrite d1/d2/d81/f122 [0,4194304] 0 2024-09-13T22:56:30.209 INFO:tasks.workunit.client.0.smithi002.stdout:0/965: fsync d1/d7e/d9d/de6/f13e 0 2024-09-13T22:56:30.210 INFO:tasks.workunit.client.0.smithi002.stdout:0/966: chown d1/d4/da3/d7d/df8/f80 1560389112 1 2024-09-13T22:56:30.212 INFO:tasks.workunit.client.0.smithi002.stdout:0/967: readlink d1/d2/d6c/d8b/ldd 0 2024-09-13T22:56:30.225 INFO:tasks.workunit.client.0.smithi002.stdout:0/968: dread d1/d2/f45 [0,4194304] 0 2024-09-13T22:56:30.227 INFO:tasks.workunit.client.0.smithi002.stdout:0/969: creat d1/d2/d6c/f15d x:0 0 0 2024-09-13T22:56:30.228 INFO:tasks.workunit.client.1.smithi047.stdout:8/977: sync 2024-09-13T22:56:30.228 INFO:tasks.workunit.client.1.smithi047.stdout:8/978: chown d8/d64/d4e/d4d/d8f 12 1 2024-09-13T22:56:30.232 INFO:tasks.workunit.client.1.smithi047.stdout:8/979: unlink d8/f2b 0 2024-09-13T22:56:30.236 INFO:tasks.workunit.client.1.smithi047.stdout:8/980: mkdir d8/d64/d152 0 2024-09-13T22:56:30.236 INFO:tasks.workunit.client.0.smithi002.stdout:0/970: link d1/c2a d1/d4/d75/c15e 0 2024-09-13T22:56:30.238 INFO:tasks.workunit.client.0.smithi002.stdout:0/971: fdatasync d1/d4/d114/f143 0 2024-09-13T22:56:30.239 INFO:tasks.workunit.client.0.smithi002.stdout:0/972: fdatasync d1/d2/d81/fc7 0 2024-09-13T22:56:30.239 INFO:tasks.workunit.client.0.smithi002.stdout:0/973: readlink d1/d2/d6c/d8b/ldd 0 2024-09-13T22:56:30.243 INFO:tasks.workunit.client.0.smithi002.stdout:0/974: symlink d1/d4/d75/d31/d32/l15f 0 2024-09-13T22:56:30.245 INFO:tasks.workunit.client.0.smithi002.stdout:0/975: creat d1/d4/d75/f160 x:0 0 0 2024-09-13T22:56:30.245 INFO:tasks.workunit.client.0.smithi002.stdout:0/976: chown d1/d4/da3/d7d/df8/f137 1969454 1 2024-09-13T22:56:30.246 INFO:tasks.workunit.client.0.smithi002.stdout:0/977: write d1/d4/d75/d76/f147 [997528,119382] 0 2024-09-13T22:56:30.251 INFO:tasks.workunit.client.0.smithi002.stdout:0/978: write d1/d2/f29 [1702293,34322] 0 2024-09-13T22:56:30.252 INFO:tasks.workunit.client.0.smithi002.stdout:0/979: write d1/d2/d81/f153 [937190,29134] 0 2024-09-13T22:56:30.253 INFO:tasks.workunit.client.0.smithi002.stdout:0/980: write d1/d7e/d9d/de3/f135 [1052155,43796] 0 2024-09-13T22:56:30.254 INFO:tasks.workunit.client.0.smithi002.stdout:0/981: readlink d1/d7e/la1 0 2024-09-13T22:56:30.264 INFO:tasks.workunit.client.0.smithi002.stdout:6/985: sync 2024-09-13T22:56:30.264 INFO:tasks.workunit.client.0.smithi002.stdout:4/926: sync 2024-09-13T22:56:30.264 INFO:tasks.workunit.client.0.smithi002.stdout:0/982: dread d1/d4/f96 [0,4194304] 0 2024-09-13T22:56:30.265 INFO:tasks.workunit.client.0.smithi002.stdout:4/927: chown d3/d14/d29/l7a 1072 1 2024-09-13T22:56:30.266 INFO:tasks.workunit.client.0.smithi002.stdout:4/928: truncate d3/d14/d86/f95 1252823 0 2024-09-13T22:56:30.266 INFO:tasks.workunit.client.0.smithi002.stdout:0/983: write d1/d4/f96 [1468622,79591] 0 2024-09-13T22:56:30.267 INFO:tasks.workunit.client.0.smithi002.stdout:6/986: symlink d12/d17/d34/d39/d8b/d12a/l140 0 2024-09-13T22:56:30.269 INFO:tasks.workunit.client.0.smithi002.stdout:4/929: symlink d3/d14/d29/d2a/da6/d69/l12c 0 2024-09-13T22:56:30.272 INFO:tasks.workunit.client.0.smithi002.stdout:0/984: link d1/d2/d12a/f13a d1/d4/d75/d76/d120/f161 0 2024-09-13T22:56:30.273 INFO:tasks.workunit.client.0.smithi002.stdout:0/985: dread - d1/d4/d75/d31/de0/fec zero size 2024-09-13T22:56:30.277 INFO:tasks.workunit.client.0.smithi002.stdout:6/987: dwrite d12/d17/d28/f35 [0,4194304] 0 2024-09-13T22:56:30.279 INFO:tasks.workunit.client.0.smithi002.stdout:0/986: dread d1/d2/d81/fa6 [0,4194304] 0 2024-09-13T22:56:30.281 INFO:tasks.workunit.client.0.smithi002.stdout:6/988: rmdir d12/d17/d28/d67/d6b/daa/d125 0 2024-09-13T22:56:30.282 INFO:tasks.workunit.client.0.smithi002.stdout:4/930: dread d3/d14/d29/d2a/da6/d5e/fba [0,4194304] 0 2024-09-13T22:56:30.283 INFO:tasks.workunit.client.0.smithi002.stdout:0/987: getdents d1/d2/d14c/d156 0 2024-09-13T22:56:30.290 INFO:tasks.workunit.client.0.smithi002.stdout:0/988: write d1/d2/d81/ff0 [80234,24119] 0 2024-09-13T22:56:30.297 INFO:tasks.workunit.client.0.smithi002.stdout:6/989: dwrite d12/d17/d34/d39/f12c [0,4194304] 0 2024-09-13T22:56:30.297 INFO:tasks.workunit.client.0.smithi002.stdout:4/931: dwrite d3/db3/ff9 [0,4194304] 0 2024-09-13T22:56:30.304 INFO:tasks.workunit.client.0.smithi002.stdout:6/990: mknod d12/d17/d28/d67/dca/dd8/de1/d127/c141 0 2024-09-13T22:56:30.306 INFO:tasks.workunit.client.0.smithi002.stdout:6/991: dread d12/d17/fd1 [0,4194304] 0 2024-09-13T22:56:30.307 INFO:tasks.workunit.client.0.smithi002.stdout:4/932: link d3/d40/fdb d3/d14/d29/d2a/d30/f12d 0 2024-09-13T22:56:30.309 INFO:tasks.workunit.client.0.smithi002.stdout:6/992: mknod d12/d17/d28/d67/dca/d132/c142 0 2024-09-13T22:56:30.311 INFO:tasks.workunit.client.0.smithi002.stdout:4/933: mkdir d3/d14/d29/df7/d12e 0 2024-09-13T22:56:30.313 INFO:tasks.workunit.client.0.smithi002.stdout:6/993: unlink d12/d17/d34/f124 0 2024-09-13T22:56:30.313 INFO:tasks.workunit.client.0.smithi002.stdout:4/934: chown d3/db3/db9/d11b/f12b 141643126 1 2024-09-13T22:56:30.313 INFO:tasks.workunit.client.0.smithi002.stdout:2/958: sync 2024-09-13T22:56:30.314 INFO:tasks.workunit.client.0.smithi002.stdout:6/994: write d12/d17/ddf/d112/d126/ff7 [2055424,12631] 0 2024-09-13T22:56:30.317 INFO:tasks.workunit.client.0.smithi002.stdout:0/989: dread d1/f6f [0,4194304] 0 2024-09-13T22:56:30.317 INFO:tasks.workunit.client.0.smithi002.stdout:4/935: creat d3/d14/d29/d2a/da6/d69/f12f x:0 0 0 2024-09-13T22:56:30.317 INFO:tasks.workunit.client.0.smithi002.stdout:6/995: fsync d12/d17/d4e/f9a 0 2024-09-13T22:56:30.320 INFO:tasks.workunit.client.0.smithi002.stdout:2/959: rename d1/d7/d52/daa/l115 to d1/d7/d52/daa/l143 0 2024-09-13T22:56:30.321 INFO:tasks.workunit.client.0.smithi002.stdout:2/960: read d1/d7/d35/d78/dfc/d6b/d75/f91 [3545053,53693] 0 2024-09-13T22:56:30.325 INFO:tasks.workunit.client.0.smithi002.stdout:6/996: rename d12/d17/ce7 to d12/d17/d28/d67/dca/d132/c143 0 2024-09-13T22:56:30.329 INFO:tasks.workunit.client.0.smithi002.stdout:2/961: unlink d1/d4d/d8b/de1/dd6/d11d/f121 0 2024-09-13T22:56:30.329 INFO:tasks.workunit.client.0.smithi002.stdout:2/962: stat d1/d7/l2a 0 2024-09-13T22:56:30.331 INFO:tasks.workunit.client.0.smithi002.stdout:4/936: creat d3/d40/f130 x:0 0 0 2024-09-13T22:56:30.332 INFO:tasks.workunit.client.0.smithi002.stdout:4/937: fsync d3/d14/d86/f102 0 2024-09-13T22:56:30.333 INFO:tasks.workunit.client.0.smithi002.stdout:4/938: stat d3/d14/d29/d2a/da6/d9f/ca7 0 2024-09-13T22:56:30.333 INFO:tasks.workunit.client.0.smithi002.stdout:4/939: chown d3/d14/d29/l129 6 1 2024-09-13T22:56:30.333 INFO:tasks.workunit.client.0.smithi002.stdout:0/990: creat d1/d4/d75/d76/f162 x:0 0 0 2024-09-13T22:56:30.334 INFO:tasks.workunit.client.0.smithi002.stdout:0/991: chown d1/d4/d75/d31/de0/d102/f11d 19 1 2024-09-13T22:56:30.335 INFO:tasks.workunit.client.0.smithi002.stdout:0/992: write d1/d2/d6c/f10f [111056,80758] 0 2024-09-13T22:56:30.335 INFO:tasks.workunit.client.0.smithi002.stdout:2/963: rmdir d1/d7/d41/d96/dba 39 2024-09-13T22:56:30.336 INFO:tasks.workunit.client.0.smithi002.stdout:2/964: stat d1/d7/d35/d78/dfc/d87/d111 0 2024-09-13T22:56:30.337 INFO:tasks.workunit.client.0.smithi002.stdout:6/997: mkdir d12/d17/d28/d67/d144 0 2024-09-13T22:56:30.337 INFO:tasks.workunit.client.0.smithi002.stdout:2/965: read - d1/d4a/f13d zero size 2024-09-13T22:56:30.340 INFO:tasks.workunit.client.0.smithi002.stdout:0/993: mknod d1/d4/d75/d31/d32/dbb/c163 0 2024-09-13T22:56:30.340 INFO:tasks.workunit.client.0.smithi002.stdout:0/994: fsync d1/d7e/f131 0 2024-09-13T22:56:30.342 INFO:tasks.workunit.client.0.smithi002.stdout:6/998: rename d12/d17/d4e/f52 to d12/d17/d28/d67/dca/dd8/de1/f145 0 2024-09-13T22:56:30.342 INFO:tasks.workunit.client.0.smithi002.stdout:4/940: rmdir d3/d14/d86/db1/dfb/d10d 39 2024-09-13T22:56:30.343 INFO:tasks.workunit.client.1.smithi047.stdout:5/954: sync 2024-09-13T22:56:30.347 INFO:tasks.workunit.client.0.smithi002.stdout:6/999: rename d12/d17/d34/d39/d8b/fe8 to d12/d17/ddf/d112/f146 0 2024-09-13T22:56:30.348 INFO:tasks.workunit.client.1.smithi047.stdout:5/955: truncate d19/d23/d32/f55 731125 0 2024-09-13T22:56:30.350 INFO:tasks.workunit.client.0.smithi002.stdout:0/995: dread d1/d4/d75/d31/f8d [0,4194304] 0 2024-09-13T22:56:30.351 INFO:tasks.workunit.client.0.smithi002.stdout:2/966: truncate d1/d7/d8/d2c/f2d 1182504 0 2024-09-13T22:56:30.353 INFO:tasks.workunit.client.0.smithi002.stdout:2/967: write d1/d7/d8/d2c/da4/ffd [5063306,58395] 0 2024-09-13T22:56:30.356 INFO:tasks.workunit.client.0.smithi002.stdout:0/996: dwrite d1/d2/f29 [0,4194304] 0 2024-09-13T22:56:30.357 INFO:tasks.workunit.client.0.smithi002.stdout:2/968: truncate d1/d7/d35/d3e/f127 786294 0 2024-09-13T22:56:30.358 INFO:tasks.workunit.client.1.smithi047.stdout:5/956: truncate d19/d23/d32/f55 914316 0 2024-09-13T22:56:30.359 INFO:tasks.workunit.client.1.smithi047.stdout:5/957: dread - d19/d23/d2e/d41/d58/dfc/f125 zero size 2024-09-13T22:56:30.362 INFO:tasks.workunit.client.1.smithi047.stdout:8/981: sync 2024-09-13T22:56:30.363 INFO:tasks.workunit.client.0.smithi002.stdout:2/969: dread d1/d80/f83 [0,4194304] 0 2024-09-13T22:56:30.364 INFO:tasks.workunit.client.0.smithi002.stdout:0/997: dwrite d1/d4/fba [0,4194304] 0 2024-09-13T22:56:30.366 INFO:tasks.workunit.client.1.smithi047.stdout:5/958: getdents d19/d23/d2e/d41/d58/d77 0 2024-09-13T22:56:30.368 INFO:tasks.workunit.client.1.smithi047.stdout:8/982: symlink d8/d6b/da9/dc3/l153 0 2024-09-13T22:56:30.370 INFO:tasks.workunit.client.0.smithi002.stdout:2/970: truncate d1/d4d/fac 3785125 0 2024-09-13T22:56:30.373 INFO:tasks.workunit.client.0.smithi002.stdout:0/998: unlink d1/d4/da3/d7d/df8/f137 0 2024-09-13T22:56:30.376 INFO:tasks.workunit.client.1.smithi047.stdout:5/959: mkdir d19/d23/d2e/d41/d58/dfc/d5d/dd8/d101/d12a 0 2024-09-13T22:56:30.378 INFO:tasks.workunit.client.1.smithi047.stdout:8/983: rmdir d8/d64/d4e/d4d/d8f/d91/d40/de5/dfe 39 2024-09-13T22:56:30.379 INFO:tasks.workunit.client.1.smithi047.stdout:5/960: mkdir d19/d23/d2e/d41/d58/dfc/d5d/d12b 0 2024-09-13T22:56:30.380 INFO:tasks.workunit.client.0.smithi002.stdout:0/999: fdatasync d1/d2/f1d 0 2024-09-13T22:56:30.383 INFO:tasks.workunit.client.0.smithi002.stdout:2/971: dread d1/d7/d35/d78/dfc/d6b/d75/fc1 [0,4194304] 0 2024-09-13T22:56:30.384 INFO:tasks.workunit.client.1.smithi047.stdout:8/984: dwrite d8/d64/dc5/fe8 [0,4194304] 0 2024-09-13T22:56:30.384 INFO:tasks.workunit.client.1.smithi047.stdout:5/961: creat d19/d23/d2e/f12c x:0 0 0 2024-09-13T22:56:30.385 INFO:tasks.workunit.client.1.smithi047.stdout:8/985: readlink d8/d6b/da9/dc3/l153 0 2024-09-13T22:56:30.395 INFO:tasks.workunit.client.1.smithi047.stdout:5/962: creat d19/f12d x:0 0 0 2024-09-13T22:56:30.398 INFO:tasks.workunit.client.1.smithi047.stdout:8/986: dwrite d8/d64/d4e/d4d/dda/f14a [0,4194304] 0 2024-09-13T22:56:30.399 INFO:tasks.workunit.client.0.smithi002.stdout:2/972: write d1/d7/d8/d2c/da4/fbc [1139072,124266] 0 2024-09-13T22:56:30.399 INFO:tasks.workunit.client.1.smithi047.stdout:5/963: rename d19/d23/d2e/d41/d58/dfc/d5d/dd8 to d19/d23/d2e/d41/d58/dfc/d5d/dd8/d101/d12a/d12e 22 2024-09-13T22:56:30.401 INFO:tasks.workunit.client.1.smithi047.stdout:5/964: readlink d19/d23/d2e/d41/d58/dfc/l4b 0 2024-09-13T22:56:30.402 INFO:tasks.workunit.client.0.smithi002.stdout:2/973: creat d1/d7/d8/d2c/d9d/dab/db1/f144 x:0 0 0 2024-09-13T22:56:30.402 INFO:tasks.workunit.client.0.smithi002.stdout:2/974: chown d1/d80 501776 1 2024-09-13T22:56:30.406 INFO:tasks.workunit.client.0.smithi002.stdout:2/975: mkdir d1/d80/d145 0 2024-09-13T22:56:30.408 INFO:tasks.workunit.client.0.smithi002.stdout:2/976: read d1/f15 [4142290,75877] 0 2024-09-13T22:56:30.415 INFO:tasks.workunit.client.0.smithi002.stdout:2/977: write d1/d7/d41/f7a [5140850,18058] 0 2024-09-13T22:56:30.418 INFO:tasks.workunit.client.1.smithi047.stdout:8/987: dread d8/d64/d4e/d4d/d8f/d91/d40/f8d [4194304,4194304] 0 2024-09-13T22:56:30.419 INFO:tasks.workunit.client.1.smithi047.stdout:8/988: write d8/d3f/f122 [1045285,73670] 0 2024-09-13T22:56:30.420 INFO:tasks.workunit.client.1.smithi047.stdout:5/965: dread d19/d34/f40 [0,4194304] 0 2024-09-13T22:56:30.421 INFO:tasks.workunit.client.0.smithi002.stdout:2/978: write d1/d7/d8/d2c/f101 [989066,27120] 0 2024-09-13T22:56:30.422 INFO:tasks.workunit.client.1.smithi047.stdout:8/989: mkdir d8/d6b/dce/d154 0 2024-09-13T22:56:30.423 INFO:tasks.workunit.client.1.smithi047.stdout:5/966: creat d19/d123/f12f x:0 0 0 2024-09-13T22:56:30.423 INFO:tasks.workunit.client.1.smithi047.stdout:5/967: chown d19/d34/d8e 109553095 1 2024-09-13T22:56:30.424 INFO:tasks.workunit.client.0.smithi002.stdout:2/979: rename d1/d32/d37/d79/f84 to d1/d7/d35/d78/dfc/d87/f146 0 2024-09-13T22:56:30.425 INFO:tasks.workunit.client.1.smithi047.stdout:5/968: mkdir d19/d23/d2e/d41/d58/dfc/d5d/d80/d130 0 2024-09-13T22:56:30.427 INFO:tasks.workunit.client.1.smithi047.stdout:5/969: write d19/d23/d2e/d41/d58/fe9 [5174578,97178] 0 2024-09-13T22:56:30.431 INFO:tasks.workunit.client.1.smithi047.stdout:5/970: truncate d19/d23/d2e/d41/d58/d77/fa6 2020732 0 2024-09-13T22:56:30.436 INFO:tasks.workunit.client.0.smithi002.stdout:2/980: dwrite d1/da9/dbd/ff2 [0,4194304] 0 2024-09-13T22:56:30.438 INFO:tasks.workunit.client.1.smithi047.stdout:5/971: truncate d19/d25/f38 472189 0 2024-09-13T22:56:30.439 INFO:tasks.workunit.client.1.smithi047.stdout:5/972: chown d19/d25/d45/da3/lec 75 1 2024-09-13T22:56:30.439 INFO:tasks.workunit.client.1.smithi047.stdout:5/973: stat d19/c53 0 2024-09-13T22:56:30.439 INFO:tasks.workunit.client.0.smithi002.stdout:2/981: mknod d1/d7/c147 0 2024-09-13T22:56:30.440 INFO:tasks.workunit.client.1.smithi047.stdout:5/974: chown d19/d23/fc7 31560 1 2024-09-13T22:56:30.440 INFO:tasks.workunit.client.1.smithi047.stdout:5/975: stat d19/d23/d4c/f52 0 2024-09-13T22:56:30.441 INFO:tasks.workunit.client.1.smithi047.stdout:5/976: write d19/f36 [1806633,27956] 0 2024-09-13T22:56:30.441 INFO:tasks.workunit.client.1.smithi047.stdout:5/977: chown d19/d23 453629611 1 2024-09-13T22:56:30.442 INFO:tasks.workunit.client.0.smithi002.stdout:2/982: symlink d1/d32/d37/l148 0 2024-09-13T22:56:30.446 INFO:tasks.workunit.client.1.smithi047.stdout:5/978: dread d19/d25/f3f [0,4194304] 0 2024-09-13T22:56:30.446 INFO:tasks.workunit.client.0.smithi002.stdout:2/983: mkdir d1/d7/d41/d96/dba/d149 0 2024-09-13T22:56:30.446 INFO:tasks.workunit.client.1.smithi047.stdout:5/979: fsync d19/d123/f12f 0 2024-09-13T22:56:30.449 INFO:tasks.workunit.client.0.smithi002.stdout:2/984: chown d1/d7/d35/d78/dfc/d87/l8d 330 1 2024-09-13T22:56:30.449 INFO:tasks.workunit.client.0.smithi002.stdout:2/985: dread - d1/d32/d37/f12a zero size 2024-09-13T22:56:30.455 INFO:tasks.workunit.client.0.smithi002.stdout:2/986: dread d1/d7/d8/d2c/d9d/dab/dd4/f105 [0,4194304] 0 2024-09-13T22:56:30.456 INFO:tasks.workunit.client.0.smithi002.stdout:2/987: write d1/d7/d35/d78/f4b [913272,64398] 0 2024-09-13T22:56:30.461 INFO:tasks.workunit.client.0.smithi002.stdout:2/988: unlink d1/d7/d41/d96/dba/le4 0 2024-09-13T22:56:30.480 INFO:tasks.workunit.client.0.smithi002.stdout:2/989: dwrite d1/d7/d41/d96/fc9 [0,4194304] 0 2024-09-13T22:56:30.485 INFO:tasks.workunit.client.0.smithi002.stdout:2/990: truncate d1/d4d/f50 1119403 0 2024-09-13T22:56:30.486 INFO:tasks.workunit.client.0.smithi002.stdout:4/941: sync 2024-09-13T22:56:30.493 INFO:tasks.workunit.client.0.smithi002.stdout:4/942: dread d3/d14/d29/d2a/da6/f61 [0,4194304] 0 2024-09-13T22:56:30.494 INFO:tasks.workunit.client.0.smithi002.stdout:4/943: chown d3/d14/d29/d2a/c113 7447306 1 2024-09-13T22:56:30.501 INFO:tasks.workunit.client.0.smithi002.stdout:2/991: truncate d1/d7/d41/f7a 5062689 0 2024-09-13T22:56:30.504 INFO:tasks.workunit.client.0.smithi002.stdout:2/992: creat d1/d7/d41/d96/dba/f14a x:0 0 0 2024-09-13T22:56:30.509 INFO:tasks.workunit.client.0.smithi002.stdout:4/944: dwrite d3/d14/d29/d2a/da6/d9f/ff8 [0,4194304] 0 2024-09-13T22:56:30.515 INFO:tasks.workunit.client.0.smithi002.stdout:4/945: write d3/db3/db9/dff/f10f [310230,22280] 0 2024-09-13T22:56:30.516 INFO:tasks.workunit.client.0.smithi002.stdout:4/946: chown d3/d14/d29/d2a/l9d 396 1 2024-09-13T22:56:30.524 INFO:tasks.workunit.client.0.smithi002.stdout:2/993: dread d1/d7/d41/fc2 [0,4194304] 0 2024-09-13T22:56:30.524 INFO:tasks.workunit.client.0.smithi002.stdout:4/947: dwrite d3/d14/d29/d2a/da6/d69/d7e/f122 [0,4194304] 0 2024-09-13T22:56:30.536 INFO:tasks.workunit.client.0.smithi002.stdout:4/948: write d3/d14/d29/d2a/da6/f98 [2704219,127849] 0 2024-09-13T22:56:30.537 INFO:tasks.workunit.client.0.smithi002.stdout:2/994: write d1/d7/d8/d2c/ff3 [870186,109661] 0 2024-09-13T22:56:30.539 INFO:tasks.workunit.client.0.smithi002.stdout:2/995: mknod d1/d4a/c14b 0 2024-09-13T22:56:30.539 INFO:tasks.workunit.client.0.smithi002.stdout:2/996: chown d1/d4d/d8b 1 1 2024-09-13T22:56:30.540 INFO:tasks.workunit.client.0.smithi002.stdout:4/949: symlink d3/d62/d103/l131 0 2024-09-13T22:56:30.542 INFO:tasks.workunit.client.0.smithi002.stdout:4/950: mkdir d3/d62/df6/d124/d132 0 2024-09-13T22:56:30.544 INFO:tasks.workunit.client.0.smithi002.stdout:4/951: mknod d3/d40/c133 0 2024-09-13T22:56:30.546 INFO:tasks.workunit.client.0.smithi002.stdout:4/952: truncate d3/db3/db9/dff/f10f 425770 0 2024-09-13T22:56:30.549 INFO:tasks.workunit.client.0.smithi002.stdout:2/997: dwrite d1/d7/d8/f8a [0,4194304] 0 2024-09-13T22:56:30.549 INFO:tasks.workunit.client.0.smithi002.stdout:4/953: fdatasync d3/f73 0 2024-09-13T22:56:30.553 INFO:tasks.workunit.client.0.smithi002.stdout:4/954: dread d3/d14/fe4 [0,4194304] 0 2024-09-13T22:56:30.558 INFO:tasks.workunit.client.0.smithi002.stdout:4/955: creat d3/d14/d86/db1/dfb/d10d/f134 x:0 0 0 2024-09-13T22:56:30.561 INFO:tasks.workunit.client.1.smithi047.stdout:8/990: sync 2024-09-13T22:56:30.563 INFO:tasks.workunit.client.0.smithi002.stdout:4/956: dwrite d3/d40/f130 [0,4194304] 0 2024-09-13T22:56:30.568 INFO:tasks.workunit.client.0.smithi002.stdout:4/957: creat d3/d14/d29/d2a/da6/d69/d7e/dca/df3/f135 x:0 0 0 2024-09-13T22:56:30.570 INFO:tasks.workunit.client.0.smithi002.stdout:4/958: fsync d3/d14/d29/d2a/f44 0 2024-09-13T22:56:30.573 INFO:tasks.workunit.client.1.smithi047.stdout:8/991: dwrite d8/d6b/da9/dc3/ddc/f126 [0,4194304] 0 2024-09-13T22:56:30.573 INFO:tasks.workunit.client.0.smithi002.stdout:4/959: creat d3/d14/d29/d2a/d30/f136 x:0 0 0 2024-09-13T22:56:30.577 INFO:tasks.workunit.client.1.smithi047.stdout:8/992: fdatasync d8/d64/d4e/d4d/d8f/d91/d40/f48 0 2024-09-13T22:56:30.579 INFO:tasks.workunit.client.1.smithi047.stdout:8/993: stat d8/d64/d4e/d4d/d8f/d91/f3d 0 2024-09-13T22:56:30.583 INFO:tasks.workunit.client.0.smithi002.stdout:4/960: dread d3/d14/d29/f96 [0,4194304] 0 2024-09-13T22:56:30.585 INFO:tasks.workunit.client.1.smithi047.stdout:8/994: dwrite d8/d6b/da9/dc3/ddc/f126 [0,4194304] 0 2024-09-13T22:56:30.586 INFO:tasks.workunit.client.1.smithi047.stdout:8/995: chown d8/d77/de3/d127 826 1 2024-09-13T22:56:30.587 INFO:tasks.workunit.client.1.smithi047.stdout:8/996: chown d8/d64/d4e/d4d 1135 1 2024-09-13T22:56:30.588 INFO:tasks.workunit.client.0.smithi002.stdout:4/961: dwrite d3/f3d [0,4194304] 0 2024-09-13T22:56:30.591 INFO:tasks.workunit.client.0.smithi002.stdout:4/962: mknod d3/db3/c137 0 2024-09-13T22:56:30.594 INFO:tasks.workunit.client.0.smithi002.stdout:4/963: symlink d3/d14/d29/d2a/da6/d9f/d10e/l138 0 2024-09-13T22:56:30.595 INFO:tasks.workunit.client.1.smithi047.stdout:8/997: dwrite d8/d64/d4e/dbd/fef [0,4194304] 0 2024-09-13T22:56:30.598 INFO:tasks.workunit.client.0.smithi002.stdout:4/964: mknod d3/d14/d29/c139 0 2024-09-13T22:56:30.601 INFO:tasks.workunit.client.0.smithi002.stdout:4/965: symlink d3/db3/db9/l13a 0 2024-09-13T22:56:30.604 INFO:tasks.workunit.client.1.smithi047.stdout:5/980: sync 2024-09-13T22:56:30.605 INFO:tasks.workunit.client.0.smithi002.stdout:4/966: symlink d3/d14/d86/db1/dfb/l13b 0 2024-09-13T22:56:30.613 INFO:tasks.workunit.client.1.smithi047.stdout:8/998: dwrite d8/d6b/fbb [0,4194304] 0 2024-09-13T22:56:30.615 INFO:tasks.workunit.client.0.smithi002.stdout:4/967: write d3/d14/f75 [4483060,107104] 0 2024-09-13T22:56:30.618 INFO:tasks.workunit.client.0.smithi002.stdout:4/968: fsync d3/d40/f93 0 2024-09-13T22:56:30.623 INFO:tasks.workunit.client.0.smithi002.stdout:4/969: symlink d3/d62/l13c 0 2024-09-13T22:56:30.624 INFO:tasks.workunit.client.1.smithi047.stdout:8/999: truncate d8/d64/d4e/d4d/d8f/d91/d40/f59 1162250 0 2024-09-13T22:56:30.627 INFO:tasks.workunit.client.0.smithi002.stdout:4/970: mknod d3/d14/d29/d2a/c13d 0 2024-09-13T22:56:30.629 INFO:tasks.workunit.client.0.smithi002.stdout:4/971: fdatasync d3/d14/d86/fbd 0 2024-09-13T22:56:30.630 INFO:tasks.workunit.client.1.smithi047.stdout:5/981: dread d19/d23/d32/d69/f70 [0,4194304] 0 2024-09-13T22:56:30.633 INFO:tasks.workunit.client.1.smithi047.stdout:5/982: dread d19/d23/d2e/d41/d58/dfc/d5d/d80/f122 [0,4194304] 0 2024-09-13T22:56:30.637 INFO:tasks.workunit.client.1.smithi047.stdout:5/983: mknod d19/d34/d8e/d11d/c131 0 2024-09-13T22:56:30.642 INFO:tasks.workunit.client.0.smithi002.stdout:4/972: dwrite d3/d14/d29/d2a/d30/f57 [0,4194304] 0 2024-09-13T22:56:30.644 INFO:tasks.workunit.client.1.smithi047.stdout:5/984: dwrite d19/d83/d98/dd0/fe1 [4194304,4194304] 0 2024-09-13T22:56:30.653 INFO:tasks.workunit.client.1.smithi047.stdout:5/985: creat d19/d23/d2e/d41/d58/dfc/d105/d112/f132 x:0 0 0 2024-09-13T22:56:30.654 INFO:tasks.workunit.client.1.smithi047.stdout:5/986: chown d19/d25/c9f 22876020 1 2024-09-13T22:56:30.656 INFO:tasks.workunit.client.1.smithi047.stdout:5/987: read d19/d64/f93 [560064,94028] 0 2024-09-13T22:56:30.657 INFO:tasks.workunit.client.0.smithi002.stdout:4/973: dwrite d3/d14/d29/d2a/f43 [0,4194304] 0 2024-09-13T22:56:30.659 INFO:tasks.workunit.client.0.smithi002.stdout:4/974: readlink d3/d14/d29/d2a/l9d 0 2024-09-13T22:56:30.663 INFO:tasks.workunit.client.1.smithi047.stdout:5/988: dwrite d19/d25/d45/f4e [0,4194304] 0 2024-09-13T22:56:30.664 INFO:tasks.workunit.client.0.smithi002.stdout:4/975: dwrite f2 [4194304,4194304] 0 2024-09-13T22:56:30.665 INFO:tasks.workunit.client.0.smithi002.stdout:4/976: stat d3/d40/f130 0 2024-09-13T22:56:30.665 INFO:tasks.workunit.client.0.smithi002.stdout:2/998: sync 2024-09-13T22:56:30.667 INFO:tasks.workunit.client.0.smithi002.stdout:2/999: dread - d1/d7/d10a/f128 zero size 2024-09-13T22:56:30.667 INFO:tasks.workunit.client.1.smithi047.stdout:5/989: fsync d19/d23/d2e/d41/d58/dfc/d5d/d80/f122 0 2024-09-13T22:56:30.671 INFO:tasks.workunit.client.0.smithi002.stdout:4/977: rename d3/d14/d29/d2a/da6/d9f/ld2 to d3/d62/df6/d124/l13e 0 2024-09-13T22:56:30.673 INFO:tasks.workunit.client.1.smithi047.stdout:5/990: rmdir d19/d23/d2e/d41/d58/dfc/d5d/d80 39 2024-09-13T22:56:30.674 INFO:tasks.workunit.client.1.smithi047.stdout:5/991: write d19/d83/f120 [613424,95144] 0 2024-09-13T22:56:30.679 INFO:tasks.workunit.client.1.smithi047.stdout:5/992: readlink d19/d23/d2e/d41/d58/dfc/d5d/d80/l127 0 2024-09-13T22:56:30.682 INFO:tasks.workunit.client.1.smithi047.stdout:5/993: creat d19/d23/d2e/d41/d58/dfc/d5d/d80/d130/f133 x:0 0 0 2024-09-13T22:56:30.684 INFO:tasks.workunit.client.1.smithi047.stdout:5/994: write d19/d23/d2e/d41/d58/dfc/d5d/fb4 [868779,51421] 0 2024-09-13T22:56:30.685 INFO:tasks.workunit.client.1.smithi047.stdout:5/995: chown d19/d25/d45/da3 761 1 2024-09-13T22:56:30.689 INFO:tasks.workunit.client.1.smithi047.stdout:5/996: write d19/d23/d4c/faf [301287,106687] 0 2024-09-13T22:56:30.697 INFO:tasks.workunit.client.1.smithi047.stdout:5/997: dwrite d19/d23/d2e/d41/d58/dfc/d5d/d80/f122 [0,4194304] 0 2024-09-13T22:56:30.702 INFO:tasks.workunit.client.1.smithi047.stdout:5/998: creat d19/d23/d2e/d41/d58/dfc/d5d/dd8/d101/d12a/f134 x:0 0 0 2024-09-13T22:56:30.703 INFO:tasks.workunit.client.1.smithi047.stdout:5/999: stat d19/d83/d98/dd0/f129 0 2024-09-13T22:56:30.707 INFO:tasks.workunit.client.1.smithi047.stderr:+ rm -rf -- ./tmp.hzKCkHtREU 2024-09-13T22:56:30.885 INFO:tasks.workunit.client.0.smithi002.stdout:4/978: sync 2024-09-13T22:56:30.887 INFO:tasks.workunit.client.0.smithi002.stdout:4/979: mkdir d3/d14/d29/d2a/da6/d69/d7e/d13f 0 2024-09-13T22:56:30.892 INFO:tasks.workunit.client.0.smithi002.stdout:4/980: dread d3/d14/d29/d2a/da6/f84 [0,4194304] 0 2024-09-13T22:56:30.895 INFO:tasks.workunit.client.0.smithi002.stdout:4/981: mknod d3/db3/db9/c140 0 2024-09-13T22:56:30.897 INFO:tasks.workunit.client.0.smithi002.stdout:4/982: creat d3/db3/db9/d11b/f141 x:0 0 0 2024-09-13T22:56:30.901 INFO:tasks.workunit.client.0.smithi002.stdout:4/983: creat d3/d14/d29/d2a/f142 x:0 0 0 2024-09-13T22:56:30.901 INFO:tasks.workunit.client.0.smithi002.stdout:4/984: chown d3/d14/d29/l129 1562 1 2024-09-13T22:56:30.904 INFO:tasks.workunit.client.0.smithi002.stdout:4/985: rename d3/d14/d29/d2a/da6/d69/d7e/ffc to d3/db3/db9/dff/f143 0 2024-09-13T22:56:30.913 INFO:tasks.workunit.client.0.smithi002.stdout:4/986: rename d3/d14/f6c to d3/d14/d29/d2a/da6/d69/f144 0 2024-09-13T22:56:30.924 INFO:tasks.workunit.client.0.smithi002.stdout:4/987: dwrite d3/d14/d29/d2a/f2d [0,4194304] 0 2024-09-13T22:56:30.931 INFO:tasks.workunit.client.0.smithi002.stdout:4/988: dwrite d3/f3d [0,4194304] 0 2024-09-13T22:56:30.936 INFO:tasks.workunit.client.0.smithi002.stdout:4/989: dread d3/d14/d29/d2a/da6/f108 [0,4194304] 0 2024-09-13T22:56:30.936 INFO:tasks.workunit.client.0.smithi002.stdout:4/990: dread - d3/d14/d29/d2a/da6/d5e/f111 zero size 2024-09-13T22:56:30.937 INFO:tasks.workunit.client.0.smithi002.stdout:4/991: stat d3/d14/d86/f102 0 2024-09-13T22:56:30.941 INFO:tasks.workunit.client.0.smithi002.stdout:4/992: unlink f1 0 2024-09-13T22:56:30.946 INFO:tasks.workunit.client.0.smithi002.stdout:4/993: dwrite d3/d14/d29/df7/fc2 [0,4194304] 0 2024-09-13T22:56:30.948 INFO:tasks.workunit.client.0.smithi002.stdout:4/994: write d3/d14/d29/d2a/da6/d9f/ff8 [4682734,113295] 0 2024-09-13T22:56:30.948 INFO:tasks.workunit.client.0.smithi002.stdout:4/995: chown d3/d40 331819380 1 2024-09-13T22:56:30.952 INFO:tasks.workunit.client.0.smithi002.stdout:4/996: dread - d3/d14/d29/df7/fe2 zero size 2024-09-13T22:56:30.953 INFO:tasks.workunit.client.0.smithi002.stdout:4/997: chown d3/d14/d29/d2a/f2d 12 1 2024-09-13T22:56:30.956 INFO:tasks.workunit.client.0.smithi002.stdout:4/998: symlink d3/d14/d29/d2a/da6/d69/d7e/l145 0 2024-09-13T22:56:30.972 INFO:tasks.workunit.client.0.smithi002.stdout:4/999: dwrite d3/d14/d29/d2a/d30/f12d [0,4194304] 0 2024-09-13T22:56:30.976 INFO:tasks.workunit.client.0.smithi002.stderr:+ rm -rf -- ./tmp.aZ5cjkQ7kR 2024-09-13T22:56:30.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:30 smithi002 ceph-mon[27637]: pgmap v25: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 81 MiB/s rd, 167 MiB/s wr, 407 op/s 2024-09-13T22:56:30.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:30 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:56:31.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:30 smithi047 ceph-mon[34560]: pgmap v25: 65 pgs: 65 active+clean; 3.7 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 81 MiB/s rd, 167 MiB/s wr, 407 op/s 2024-09-13T22:56:31.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:30 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:56:32.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:31 smithi047 ceph-mon[34560]: pgmap v26: 65 pgs: 65 active+clean; 3.9 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 102 MiB/s rd, 208 MiB/s wr, 468 op/s 2024-09-13T22:56:32.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:31 smithi002 ceph-mon[27637]: pgmap v26: 65 pgs: 65 active+clean; 3.9 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 102 MiB/s rd, 208 MiB/s wr, 468 op/s 2024-09-13T22:56:34.209 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:34 smithi002 ceph-mon[27637]: pgmap v27: 65 pgs: 65 active+clean; 4.2 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 105 MiB/s rd, 222 MiB/s wr, 513 op/s 2024-09-13T22:56:34.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:34 smithi047 ceph-mon[34560]: pgmap v27: 65 pgs: 65 active+clean; 4.2 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 105 MiB/s rd, 222 MiB/s wr, 513 op/s 2024-09-13T22:56:35.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:35 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:35.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:35 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:35.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:35 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:56:35.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:35 smithi047 ceph-mon[34560]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:56:35.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:35 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:56:35.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:35 smithi047 ceph-mon[34560]: Upgrade: Need to upgrade myself (mgr.smithi047.gcymvd) 2024-09-13T22:56:35.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:35 smithi047 ceph-mon[34560]: Upgrade: Need to upgrade myself (mgr.smithi047.gcymvd) 2024-09-13T22:56:35.418 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:35 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:35.418 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:35 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:35.418 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:35 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:56:35.418 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:35 smithi002 ceph-mon[27637]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:56:35.419 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:35 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:56:35.419 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:35 smithi002 ceph-mon[27637]: Upgrade: Need to upgrade myself (mgr.smithi047.gcymvd) 2024-09-13T22:56:35.419 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:35 smithi002 ceph-mon[27637]: Upgrade: Need to upgrade myself (mgr.smithi047.gcymvd) 2024-09-13T22:56:36.525 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:36 smithi002 ceph-mon[27637]: pgmap v28: 65 pgs: 65 active+clean; 4.2 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 87 MiB/s rd, 174 MiB/s wr, 424 op/s 2024-09-13T22:56:36.525 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:36 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:36.526 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:36 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.yumtzz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:56:36.526 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:36 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.yumtzz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:56:36.526 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:36 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:56:36.526 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:36 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:56:36.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:36 smithi047 ceph-mon[34560]: pgmap v28: 65 pgs: 65 active+clean; 4.2 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 87 MiB/s rd, 174 MiB/s wr, 424 op/s 2024-09-13T22:56:36.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:36 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:36.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:36 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.yumtzz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:56:36.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:36 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.yumtzz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:56:36.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:36 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:56:36.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:36 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:56:37.640 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:37 smithi002 ceph-mon[27637]: Upgrade: Updating mgr.smithi002.yumtzz 2024-09-13T22:56:37.640 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:37 smithi002 ceph-mon[27637]: Deploying daemon mgr.smithi002.yumtzz on smithi002 2024-09-13T22:56:37.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:37 smithi047 ceph-mon[34560]: Upgrade: Updating mgr.smithi002.yumtzz 2024-09-13T22:56:37.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:37 smithi047 ceph-mon[34560]: Deploying daemon mgr.smithi002.yumtzz on smithi002 2024-09-13T22:56:38.357 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:38 smithi002 ceph-mon[27637]: pgmap v29: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 87 MiB/s rd, 175 MiB/s wr, 503 op/s 2024-09-13T22:56:38.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:38 smithi047 ceph-mon[34560]: pgmap v29: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 87 MiB/s rd, 175 MiB/s wr, 503 op/s 2024-09-13T22:56:40.437 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:40 smithi002 ceph-mon[27637]: pgmap v30: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 46 MiB/s rd, 88 MiB/s wr, 293 op/s 2024-09-13T22:56:40.437 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:40 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:40.438 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:40 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:40.438 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:40 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:56:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.635+0000 7f898c2bb700 1 -- 172.21.15.2:0/2887538770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89840ffbc0 msgr2=0x7f89840fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.635+0000 7f898c2bb700 1 --2- 172.21.15.2:0/2887538770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89840ffbc0 0x7f89840fffe0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8980009910 tx=0x7f8980009c20 comp rx=0 tx=0).stop 2024-09-13T22:56:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.635+0000 7f898c2bb700 1 -- 172.21.15.2:0/2887538770 shutdown_connections 2024-09-13T22:56:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.635+0000 7f898c2bb700 1 --2- 172.21.15.2:0/2887538770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8984100dc0 0x7f8984101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.635+0000 7f898c2bb700 1 --2- 172.21.15.2:0/2887538770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89840ffbc0 0x7f89840fffe0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.635+0000 7f898c2bb700 1 -- 172.21.15.2:0/2887538770 >> 172.21.15.2:0/2887538770 conn(0x7f89840fb160 msgr2=0x7f89840fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.635+0000 7f898c2bb700 1 -- 172.21.15.2:0/2887538770 shutdown_connections 2024-09-13T22:56:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.636+0000 7f898c2bb700 1 -- 172.21.15.2:0/2887538770 wait complete. 2024-09-13T22:56:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.636+0000 7f898c2bb700 1 Processor -- start 2024-09-13T22:56:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.636+0000 7f898c2bb700 1 -- start start 2024-09-13T22:56:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.636+0000 7f898c2bb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89840ffbc0 0x7f8984196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.637+0000 7f898c2bb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8984100dc0 0x7f8984196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.637+0000 7f898c2bb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8984197360 con 0x7f8984100dc0 2024-09-13T22:56:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.637+0000 7f898c2bb700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89841974a0 con 0x7f89840ffbc0 2024-09-13T22:56:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.637+0000 7f8989856700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8984100dc0 0x7f8984196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.637+0000 7f898a057700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89840ffbc0 0x7f8984196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.637+0000 7f8989856700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8984100dc0 0x7f8984196d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36054/0 (socket says 172.21.15.2:36054) 2024-09-13T22:56:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.637+0000 7f8989856700 1 -- 172.21.15.2:0/3509157200 learned_addr learned my addr 172.21.15.2:0/3509157200 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:56:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.637+0000 7f8989856700 1 -- 172.21.15.2:0/3509157200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89840ffbc0 msgr2=0x7f8984196800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.637+0000 7f8989856700 1 --2- 172.21.15.2:0/3509157200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89840ffbc0 0x7f8984196800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.637+0000 7f8989856700 1 -- 172.21.15.2:0/3509157200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89800095f0 con 0x7f8984100dc0 2024-09-13T22:56:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.637+0000 7f8989856700 1 --2- 172.21.15.2:0/3509157200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8984100dc0 0x7f8984196d40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f897400d900 tx=0x7f897400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.637+0000 7f897b7fe700 1 -- 172.21.15.2:0/3509157200 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89740041f0 con 0x7f8984100dc0 2024-09-13T22:56:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.638+0000 7f898c2bb700 1 -- 172.21.15.2:0/3509157200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898419bf50 con 0x7f8984100dc0 2024-09-13T22:56:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.638+0000 7f898c2bb700 1 -- 172.21.15.2:0/3509157200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898419c470 con 0x7f8984100dc0 2024-09-13T22:56:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.638+0000 7f897b7fe700 1 -- 172.21.15.2:0/3509157200 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8974004ce0 con 0x7f8984100dc0 2024-09-13T22:56:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.638+0000 7f897b7fe700 1 -- 172.21.15.2:0/3509157200 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f897400b750 con 0x7f8984100dc0 2024-09-13T22:56:40.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.639+0000 7f898c2bb700 1 -- 172.21.15.2:0/3509157200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8968005320 con 0x7f8984100dc0 2024-09-13T22:56:40.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.639+0000 7f897b7fe700 1 -- 172.21.15.2:0/3509157200 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) v1 ==== 91460+0+0 (secure 0 0 0) 0x7f897400b8b0 con 0x7f8984100dc0 2024-09-13T22:56:40.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.640+0000 7f897b7fe700 1 --2- 172.21.15.2:0/3509157200 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f897006d530 0x7f897006f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:40.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.640+0000 7f897b7fe700 1 -- 172.21.15.2:0/3509157200 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f897408cc10 con 0x7f8984100dc0 2024-09-13T22:56:40.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.640+0000 7f898a057700 1 --2- 172.21.15.2:0/3509157200 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f897006d530 0x7f897006f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:40.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.641+0000 7f898a057700 1 --2- 172.21.15.2:0/3509157200 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f897006d530 0x7f897006f9f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8980006010 tx=0x7f8980005ec0 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:40.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.649+0000 7f897b7fe700 1 -- 172.21.15.2:0/3509157200 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f8974059dc0 con 0x7f8984100dc0 2024-09-13T22:56:40.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:40 smithi047 ceph-mon[34560]: pgmap v30: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 46 MiB/s rd, 88 MiB/s wr, 293 op/s 2024-09-13T22:56:40.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:40 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:40.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:40 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:40.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:40 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:56:40.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.990+0000 7f898c2bb700 1 -- 172.21.15.2:0/3509157200 --> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8968000bf0 con 0x7f897006d530 2024-09-13T22:56:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.992+0000 7f897b7fe700 1 -- 172.21.15.2:0/3509157200 <== mgr.14590 v2:172.21.15.47:6828/1914885837 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f8968000bf0 con 0x7f897006d530 2024-09-13T22:56:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.994+0000 7f898c2bb700 1 -- 172.21.15.2:0/3509157200 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f897006d530 msgr2=0x7f897006f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.994+0000 7f898c2bb700 1 --2- 172.21.15.2:0/3509157200 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f897006d530 0x7f897006f9f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8980006010 tx=0x7f8980005ec0 comp rx=0 tx=0).stop 2024-09-13T22:56:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.994+0000 7f898c2bb700 1 -- 172.21.15.2:0/3509157200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8984100dc0 msgr2=0x7f8984196d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.994+0000 7f898c2bb700 1 --2- 172.21.15.2:0/3509157200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8984100dc0 0x7f8984196d40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f897400d900 tx=0x7f897400dc10 comp rx=0 tx=0).stop 2024-09-13T22:56:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.994+0000 7f898c2bb700 1 -- 172.21.15.2:0/3509157200 shutdown_connections 2024-09-13T22:56:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.994+0000 7f898c2bb700 1 --2- 172.21.15.2:0/3509157200 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f897006d530 0x7f897006f9f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.994+0000 7f898c2bb700 1 --2- 172.21.15.2:0/3509157200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89840ffbc0 0x7f8984196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.994+0000 7f898c2bb700 1 --2- 172.21.15.2:0/3509157200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8984100dc0 0x7f8984196d40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.994+0000 7f898c2bb700 1 -- 172.21.15.2:0/3509157200 >> 172.21.15.2:0/3509157200 conn(0x7f89840fb160 msgr2=0x7f8984068eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:40.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.994+0000 7f898c2bb700 1 -- 172.21.15.2:0/3509157200 shutdown_connections 2024-09-13T22:56:40.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:40.994+0000 7f898c2bb700 1 -- 172.21.15.2:0/3509157200 wait complete. 2024-09-13T22:56:41.006 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T22:56:41.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.114+0000 7f1d350b4700 1 -- 172.21.15.2:0/3355893945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d30101800 msgr2=0x7f1d30103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:41.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.114+0000 7f1d350b4700 1 --2- 172.21.15.2:0/3355893945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d30101800 0x7f1d30103bf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009910 tx=0x7f1d20009c20 comp rx=0 tx=0).stop 2024-09-13T22:56:41.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.114+0000 7f1d350b4700 1 -- 172.21.15.2:0/3355893945 shutdown_connections 2024-09-13T22:56:41.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.114+0000 7f1d350b4700 1 --2- 172.21.15.2:0/3355893945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d30104130 0x7f1d30106520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:41.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.114+0000 7f1d350b4700 1 --2- 172.21.15.2:0/3355893945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d30101800 0x7f1d30103bf0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:41.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.114+0000 7f1d350b4700 1 -- 172.21.15.2:0/3355893945 >> 172.21.15.2:0/3355893945 conn(0x7f1d300fb190 msgr2=0x7f1d300fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:41.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.114+0000 7f1d350b4700 1 -- 172.21.15.2:0/3355893945 shutdown_connections 2024-09-13T22:56:41.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.114+0000 7f1d350b4700 1 -- 172.21.15.2:0/3355893945 wait complete. 2024-09-13T22:56:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.115+0000 7f1d350b4700 1 Processor -- start 2024-09-13T22:56:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.115+0000 7f1d350b4700 1 -- start start 2024-09-13T22:56:41.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.115+0000 7f1d350b4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d30101800 0x7f1d30198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:41.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.115+0000 7f1d350b4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d30104130 0x7f1d30198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:41.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.115+0000 7f1d350b4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d301991c0 con 0x7f1d30104130 2024-09-13T22:56:41.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.115+0000 7f1d350b4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d30199300 con 0x7f1d30101800 2024-09-13T22:56:41.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.115+0000 7f1d2e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d30104130 0x7f1d30198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:41.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.115+0000 7f1d2e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d30104130 0x7f1d30198ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36074/0 (socket says 172.21.15.2:36074) 2024-09-13T22:56:41.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.115+0000 7f1d2e59c700 1 -- 172.21.15.2:0/3310700016 learned_addr learned my addr 172.21.15.2:0/3310700016 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:56:41.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.115+0000 7f1d2ed9d700 1 --2- 172.21.15.2:0/3310700016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d30101800 0x7f1d30198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:41.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.116+0000 7f1d2e59c700 1 -- 172.21.15.2:0/3310700016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d30101800 msgr2=0x7f1d30198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:41.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.116+0000 7f1d2e59c700 1 --2- 172.21.15.2:0/3310700016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d30101800 0x7f1d30198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:41.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.116+0000 7f1d2e59c700 1 -- 172.21.15.2:0/3310700016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d24009520 con 0x7f1d30104130 2024-09-13T22:56:41.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.116+0000 7f1d2ed9d700 1 --2- 172.21.15.2:0/3310700016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d30101800 0x7f1d30198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T22:56:41.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.116+0000 7f1d2e59c700 1 --2- 172.21.15.2:0/3310700016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d30104130 0x7f1d30198ba0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400eab0 tx=0x7f1d2400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:41.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.116+0000 7f1d17fff700 1 -- 172.21.15.2:0/3310700016 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d2400cba0 con 0x7f1d30104130 2024-09-13T22:56:41.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.116+0000 7f1d17fff700 1 -- 172.21.15.2:0/3310700016 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1d240044d0 con 0x7f1d30104130 2024-09-13T22:56:41.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.116+0000 7f1d17fff700 1 -- 172.21.15.2:0/3310700016 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d24005020 con 0x7f1d30104130 2024-09-13T22:56:41.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.116+0000 7f1d350b4700 1 -- 172.21.15.2:0/3310700016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d200095f0 con 0x7f1d30104130 2024-09-13T22:56:41.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.116+0000 7f1d350b4700 1 -- 172.21.15.2:0/3310700016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3019e170 con 0x7f1d30104130 2024-09-13T22:56:41.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.117+0000 7f1d350b4700 1 -- 172.21.15.2:0/3310700016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d30192810 con 0x7f1d30104130 2024-09-13T22:56:41.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.118+0000 7f1d17fff700 1 -- 172.21.15.2:0/3310700016 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) v1 ==== 91460+0+0 (secure 0 0 0) 0x7f1d2400cd00 con 0x7f1d30104130 2024-09-13T22:56:41.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.119+0000 7f1d17fff700 1 --2- 172.21.15.2:0/3310700016 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f1d1806d530 0x7f1d1806f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:41.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.119+0000 7f1d17fff700 1 -- 172.21.15.2:0/3310700016 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f1d24014070 con 0x7f1d30104130 2024-09-13T22:56:41.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.119+0000 7f1d2ed9d700 1 --2- 172.21.15.2:0/3310700016 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f1d1806d530 0x7f1d1806f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:41.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.120+0000 7f1d2ed9d700 1 --2- 172.21.15.2:0/3310700016 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f1d1806d530 0x7f1d1806f9f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009fd0 tx=0x7f1d20005fd0 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:41.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.124+0000 7f1d17fff700 1 -- 172.21.15.2:0/3310700016 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f1d24059d20 con 0x7f1d30104130 2024-09-13T22:56:41.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.394+0000 7f1d350b4700 1 -- 172.21.15.2:0/3310700016 --> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d300611d0 con 0x7f1d1806d530 2024-09-13T22:56:41.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.396+0000 7f1d17fff700 1 -- 172.21.15.2:0/3310700016 <== mgr.14590 v2:172.21.15.47:6828/1914885837 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f1d300611d0 con 0x7f1d1806d530 2024-09-13T22:56:41.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.398+0000 7f1d350b4700 1 -- 172.21.15.2:0/3310700016 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f1d1806d530 msgr2=0x7f1d1806f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:41.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.398+0000 7f1d350b4700 1 --2- 172.21.15.2:0/3310700016 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f1d1806d530 0x7f1d1806f9f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009fd0 tx=0x7f1d20005fd0 comp rx=0 tx=0).stop 2024-09-13T22:56:41.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.398+0000 7f1d350b4700 1 -- 172.21.15.2:0/3310700016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d30104130 msgr2=0x7f1d30198ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:41.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.398+0000 7f1d350b4700 1 --2- 172.21.15.2:0/3310700016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d30104130 0x7f1d30198ba0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400eab0 tx=0x7f1d2400edc0 comp rx=0 tx=0).stop 2024-09-13T22:56:41.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.398+0000 7f1d350b4700 1 -- 172.21.15.2:0/3310700016 shutdown_connections 2024-09-13T22:56:41.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.398+0000 7f1d350b4700 1 --2- 172.21.15.2:0/3310700016 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f1d1806d530 0x7f1d1806f9f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:41.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.398+0000 7f1d350b4700 1 --2- 172.21.15.2:0/3310700016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d30101800 0x7f1d30198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:41.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.398+0000 7f1d350b4700 1 --2- 172.21.15.2:0/3310700016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d30104130 0x7f1d30198ba0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:41.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.398+0000 7f1d350b4700 1 -- 172.21.15.2:0/3310700016 >> 172.21.15.2:0/3310700016 conn(0x7f1d300fb190 msgr2=0x7f1d300fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:41.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.398+0000 7f1d350b4700 1 -- 172.21.15.2:0/3310700016 shutdown_connections 2024-09-13T22:56:41.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.398+0000 7f1d350b4700 1 -- 172.21.15.2:0/3310700016 wait complete. 2024-09-13T22:56:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.519+0000 7fa8a300c700 1 -- 172.21.15.2:0/2819980864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa89c100ca0 msgr2=0x7fa89c1010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.519+0000 7fa8a300c700 1 --2- 172.21.15.2:0/2819980864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa89c100ca0 0x7fa89c1010c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa890009910 tx=0x7fa890009c20 comp rx=0 tx=0).stop 2024-09-13T22:56:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.519+0000 7fa8a300c700 1 -- 172.21.15.2:0/2819980864 shutdown_connections 2024-09-13T22:56:41.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.519+0000 7fa8a300c700 1 --2- 172.21.15.2:0/2819980864 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa89c101ea0 0x7fa89c102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:41.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.519+0000 7fa8a300c700 1 --2- 172.21.15.2:0/2819980864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa89c100ca0 0x7fa89c1010c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:41.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.519+0000 7fa8a300c700 1 -- 172.21.15.2:0/2819980864 >> 172.21.15.2:0/2819980864 conn(0x7fa89c0fc260 msgr2=0x7fa89c0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:41.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.519+0000 7fa8a300c700 1 -- 172.21.15.2:0/2819980864 shutdown_connections 2024-09-13T22:56:41.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.519+0000 7fa8a300c700 1 -- 172.21.15.2:0/2819980864 wait complete. 2024-09-13T22:56:41.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.520+0000 7fa8a300c700 1 Processor -- start 2024-09-13T22:56:41.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.520+0000 7fa8a300c700 1 -- start start 2024-09-13T22:56:41.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.520+0000 7fa8a300c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa89c100ca0 0x7fa89c074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:41.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.520+0000 7fa8a300c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa89c101ea0 0x7fa89c073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:41.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.520+0000 7fa8a300c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0736c0 con 0x7fa89c101ea0 2024-09-13T22:56:41.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.520+0000 7fa8a300c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c073800 con 0x7fa89c100ca0 2024-09-13T22:56:41.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.520+0000 7fa89bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa89c101ea0 0x7fa89c073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:41.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.520+0000 7fa8a0da8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa89c100ca0 0x7fa89c074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:41.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.520+0000 7fa8a0da8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa89c100ca0 0x7fa89c074b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.2:57884/0 (socket says 172.21.15.2:57884) 2024-09-13T22:56:41.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.520+0000 7fa89bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa89c101ea0 0x7fa89c073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36104/0 (socket says 172.21.15.2:36104) 2024-09-13T22:56:41.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.520+0000 7fa8a0da8700 1 -- 172.21.15.2:0/4278793192 learned_addr learned my addr 172.21.15.2:0/4278793192 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:56:41.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.521+0000 7fa8a0da8700 1 -- 172.21.15.2:0/4278793192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa89c101ea0 msgr2=0x7fa89c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:41.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.521+0000 7fa8a0da8700 1 --2- 172.21.15.2:0/4278793192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa89c101ea0 0x7fa89c073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:41.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.521+0000 7fa8a0da8700 1 -- 172.21.15.2:0/4278793192 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8900095f0 con 0x7fa89c100ca0 2024-09-13T22:56:41.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.521+0000 7fa8a0da8700 1 --2- 172.21.15.2:0/4278793192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa89c100ca0 0x7fa89c074b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa890000c00 tx=0x7fa89000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:41.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.521+0000 7fa899ffb700 1 -- 172.21.15.2:0/4278793192 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa89001d070 con 0x7fa89c100ca0 2024-09-13T22:56:41.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.521+0000 7fa8a300c700 1 -- 172.21.15.2:0/4278793192 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89c073a80 con 0x7fa89c100ca0 2024-09-13T22:56:41.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.521+0000 7fa899ffb700 1 -- 172.21.15.2:0/4278793192 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa890005dc0 con 0x7fa89c100ca0 2024-09-13T22:56:41.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.521+0000 7fa899ffb700 1 -- 172.21.15.2:0/4278793192 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa890022470 con 0x7fa89c100ca0 2024-09-13T22:56:41.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.522+0000 7fa8a300c700 1 -- 172.21.15.2:0/4278793192 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89c073f70 con 0x7fa89c100ca0 2024-09-13T22:56:41.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.523+0000 7fa8a300c700 1 -- 172.21.15.2:0/4278793192 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89c109800 con 0x7fa89c100ca0 2024-09-13T22:56:41.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.523+0000 7fa899ffb700 1 -- 172.21.15.2:0/4278793192 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 24) v1 ==== 91460+0+0 (secure 0 0 0) 0x7fa890003810 con 0x7fa89c100ca0 2024-09-13T22:56:41.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.524+0000 7fa899ffb700 1 --2- 172.21.15.2:0/4278793192 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7fa88c06d530 0x7fa88c06f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:41.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.524+0000 7fa899ffb700 1 -- 172.21.15.2:0/4278793192 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa89008e400 con 0x7fa89c100ca0 2024-09-13T22:56:41.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.524+0000 7fa89bfff700 1 --2- 172.21.15.2:0/4278793192 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7fa88c06d530 0x7fa88c06f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:41.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.525+0000 7fa89bfff700 1 --2- 172.21.15.2:0/4278793192 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7fa88c06d530 0x7fa88c06f9f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa888009c60 tx=0x7fa888009260 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:41.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.530+0000 7fa899ffb700 1 -- 172.21.15.2:0/4278793192 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7fa89005b510 con 0x7fa89c100ca0 2024-09-13T22:56:41.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.844+0000 7fa8a300c700 1 -- 172.21.15.2:0/4278793192 --> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa89c1067f0 con 0x7fa88c06d530 2024-09-13T22:56:41.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.853+0000 7fa899ffb700 1 -- 172.21.15.2:0/4278793192 <== mgr.14590 v2:172.21.15.47:6828/1914885837 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fa89c1067f0 con 0x7fa88c06d530 2024-09-13T22:56:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:56:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (7m) 48s ago 8m 26.2M - 0.25.0 c8568f914cd2 76a1576b4f53 2024-09-13T22:56:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (9m) 48s ago 9m 7629k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T22:56:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (8m) 37s ago 8m 7625k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T22:56:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (9m) 48s ago 9m 6665k - 18.2.1 5be31c24972a de910e0c5157 2024-09-13T22:56:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (8m) 37s ago 8m 6651k - 18.2.1 5be31c24972a 9f4bcfa66588 2024-09-13T22:56:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (7m) 48s ago 8m 83.8M - 9.4.7 954c08fa6188 39f4cfdc98d7 2024-09-13T22:56:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (3m) 48s ago 3m 13.1M - 18.2.1 5be31c24972a 59e9c88c31ca 2024-09-13T22:56:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (3m) 48s ago 3m 211M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T22:56:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (3m) 37s ago 3m 196M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T22:56:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (3m) 37s ago 3m 16.2M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T22:56:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 starting - - - - 2024-09-13T22:56:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (82s) 37s ago 8m 479M - 19.1.1-324-gecab7be5 0652ff2b5d78 5426cb59db1c 2024-09-13T22:56:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (10m) 48s ago 10m 49.2M 2048M 18.2.1 5be31c24972a de11be74385d 2024-09-13T22:56:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (7m) 37s ago 7m 39.6M 2048M 18.2.1 5be31c24972a 5642284a23bf 2024-09-13T22:56:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (9m) 48s ago 9m 15.5M - 1.5.0 0da6a335fe13 427e04f7ded9 2024-09-13T22:56:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (8m) 37s ago 8m 15.5M - 1.5.0 0da6a335fe13 07935c82b1d6 2024-09-13T22:56:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (7m) 48s ago 7m 88.7M 1217M 18.2.1 5be31c24972a 1e1f6936c402 2024-09-13T22:56:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (6m) 48s ago 6m 95.8M 1217M 18.2.1 5be31c24972a f0ac78c34831 2024-09-13T22:56:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (6m) 48s ago 6m 102M 1217M 18.2.1 5be31c24972a 9a2f4f6decfb 2024-09-13T22:56:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (5m) 37s ago 5m 107M 2241M 18.2.1 5be31c24972a fb455cc4c571 2024-09-13T22:56:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (5m) 37s ago 5m 100M 2241M 18.2.1 5be31c24972a f1bdc2c50535 2024-09-13T22:56:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (5m) 37s ago 5m 91.1M 2241M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T22:56:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 starting - - - - 2024-09-13T22:56:41.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.856+0000 7fa8a300c700 1 -- 172.21.15.2:0/4278793192 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7fa88c06d530 msgr2=0x7fa88c06f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:41.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.856+0000 7fa8a300c700 1 --2- 172.21.15.2:0/4278793192 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7fa88c06d530 0x7fa88c06f9f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa888009c60 tx=0x7fa888009260 comp rx=0 tx=0).stop 2024-09-13T22:56:41.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.856+0000 7fa8a300c700 1 -- 172.21.15.2:0/4278793192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa89c100ca0 msgr2=0x7fa89c074b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:41.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.856+0000 7fa8a300c700 1 --2- 172.21.15.2:0/4278793192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa89c100ca0 0x7fa89c074b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa890000c00 tx=0x7fa89000f690 comp rx=0 tx=0).stop 2024-09-13T22:56:41.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.856+0000 7fa8a300c700 1 -- 172.21.15.2:0/4278793192 shutdown_connections 2024-09-13T22:56:41.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.856+0000 7fa8a300c700 1 --2- 172.21.15.2:0/4278793192 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7fa88c06d530 0x7fa88c06f9f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:41.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.856+0000 7fa8a300c700 1 --2- 172.21.15.2:0/4278793192 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa89c100ca0 0x7fa89c074b30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:41.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.856+0000 7fa8a300c700 1 --2- 172.21.15.2:0/4278793192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa89c101ea0 0x7fa89c073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:41.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.856+0000 7fa8a300c700 1 -- 172.21.15.2:0/4278793192 >> 172.21.15.2:0/4278793192 conn(0x7fa89c0fc260 msgr2=0x7fa89c1050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:41.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.856+0000 7fa8a300c700 1 -- 172.21.15.2:0/4278793192 shutdown_connections 2024-09-13T22:56:41.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.856+0000 7fa8a300c700 1 -- 172.21.15.2:0/4278793192 wait complete. 2024-09-13T22:56:41.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.974+0000 7f69b0b34700 1 -- 172.21.15.2:0/869123489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69ac1040d0 msgr2=0x7f69ac1064c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:41.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.974+0000 7f69b0b34700 1 --2- 172.21.15.2:0/869123489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69ac1040d0 0x7f69ac1064c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009910 tx=0x7f69a0009c20 comp rx=0 tx=0).stop 2024-09-13T22:56:41.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.974+0000 7f69b0b34700 1 -- 172.21.15.2:0/869123489 shutdown_connections 2024-09-13T22:56:41.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.974+0000 7f69b0b34700 1 --2- 172.21.15.2:0/869123489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69ac1040d0 0x7f69ac1064c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:41.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.974+0000 7f69b0b34700 1 --2- 172.21.15.2:0/869123489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69ac1017a0 0x7f69ac103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:41.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.974+0000 7f69b0b34700 1 -- 172.21.15.2:0/869123489 >> 172.21.15.2:0/869123489 conn(0x7f69ac0fb190 msgr2=0x7f69ac0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:41.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.974+0000 7f69b0b34700 1 -- 172.21.15.2:0/869123489 shutdown_connections 2024-09-13T22:56:41.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.974+0000 7f69b0b34700 1 -- 172.21.15.2:0/869123489 wait complete. 2024-09-13T22:56:41.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.975+0000 7f69b0b34700 1 Processor -- start 2024-09-13T22:56:41.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.976+0000 7f69b0b34700 1 -- start start 2024-09-13T22:56:41.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.976+0000 7f69b0b34700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69ac1017a0 0x7f69ac196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:41.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.976+0000 7f69b0b34700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69ac1040d0 0x7f69ac196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:41.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.976+0000 7f69b0b34700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac196fb0 con 0x7f69ac1017a0 2024-09-13T22:56:41.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.976+0000 7f69b0b34700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac1970f0 con 0x7f69ac1040d0 2024-09-13T22:56:41.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.976+0000 7f69a9d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69ac1040d0 0x7f69ac196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:41.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.976+0000 7f69a9d9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69ac1040d0 0x7f69ac196990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.2:57892/0 (socket says 172.21.15.2:57892) 2024-09-13T22:56:41.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.976+0000 7f69a9d9b700 1 -- 172.21.15.2:0/333052824 learned_addr learned my addr 172.21.15.2:0/333052824 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:56:41.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.976+0000 7f69aa59c700 1 --2- 172.21.15.2:0/333052824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69ac1017a0 0x7f69ac196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:41.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.977+0000 7f69a9d9b700 1 -- 172.21.15.2:0/333052824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69ac1017a0 msgr2=0x7f69ac196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:41.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.977+0000 7f69a9d9b700 1 --2- 172.21.15.2:0/333052824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69ac1017a0 0x7f69ac196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:41.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.977+0000 7f69a9d9b700 1 -- 172.21.15.2:0/333052824 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a00095f0 con 0x7f69ac1040d0 2024-09-13T22:56:41.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.977+0000 7f69a9d9b700 1 --2- 172.21.15.2:0/333052824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69ac1040d0 0x7f69ac196990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f69a0000c00 tx=0x7f69a000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:41.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.980+0000 7f699b7fe700 1 -- 172.21.15.2:0/333052824 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69a001d070 con 0x7f69ac1040d0 2024-09-13T22:56:41.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.980+0000 7f699b7fe700 1 -- 172.21.15.2:0/333052824 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f69a0005dc0 con 0x7f69ac1040d0 2024-09-13T22:56:41.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.980+0000 7f699b7fe700 1 -- 172.21.15.2:0/333052824 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69a00226a0 con 0x7f69ac1040d0 2024-09-13T22:56:41.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.980+0000 7f69b0b34700 1 -- 172.21.15.2:0/333052824 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ac19bb40 con 0x7f69ac1040d0 2024-09-13T22:56:41.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.980+0000 7f69b0b34700 1 -- 172.21.15.2:0/333052824 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ac19c030 con 0x7f69ac1040d0 2024-09-13T22:56:41.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.981+0000 7f69b0b34700 1 -- 172.21.15.2:0/333052824 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69ac190610 con 0x7f69ac1040d0 2024-09-13T22:56:41.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.982+0000 7f699b7fe700 1 -- 172.21.15.2:0/333052824 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 24) v1 ==== 91460+0+0 (secure 0 0 0) 0x7f69a00038f0 con 0x7f69ac1040d0 2024-09-13T22:56:41.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.983+0000 7f699b7fe700 1 --2- 172.21.15.2:0/333052824 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f699406d530 0x7f699406f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:41.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.983+0000 7f69aa59c700 1 --2- 172.21.15.2:0/333052824 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f699406d530 0x7f699406f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:41.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.984+0000 7f699b7fe700 1 -- 172.21.15.2:0/333052824 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f69a005bd60 con 0x7f69ac1040d0 2024-09-13T22:56:41.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.984+0000 7f69aa59c700 1 --2- 172.21.15.2:0/333052824 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f699406d530 0x7f699406f9f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f699c009c60 tx=0x7f699c009260 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:41.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:41.989+0000 7f699b7fe700 1 -- 172.21.15.2:0/333052824 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f69a005b430 con 0x7f69ac1040d0 2024-09-13T22:56:42.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:41 smithi002 ceph-mon[27637]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:42.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:41 smithi002 ceph-mon[27637]: pgmap v31: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 47 MiB/s rd, 88 MiB/s wr, 348 op/s 2024-09-13T22:56:42.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:41 smithi002 ceph-mon[27637]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:42.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.363+0000 7f69b0b34700 1 -- 172.21.15.2:0/333052824 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f69ac02ce80 con 0x7f69ac1040d0 2024-09-13T22:56:42.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.364+0000 7f699b7fe700 1 -- 172.21.15.2:0/333052824 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+770 (secure 0 0 0) 0x7f69a0003680 con 0x7f69ac1040d0 2024-09-13T22:56:42.365 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:56:42.365 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T22:56:42.365 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-13T22:56:42.365 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:56:42.365 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T22:56:42.365 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-09-13T22:56:42.365 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T22:56:42.366 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:56:42.366 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T22:56:42.366 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-13T22:56:42.366 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:56:42.366 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T22:56:42.366 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-13T22:56:42.366 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:56:42.366 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T22:56:42.366 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 13, 2024-09-13T22:56:42.366 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T22:56:42.366 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T22:56:42.366 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:56:42.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.366+0000 7f69b0b34700 1 -- 172.21.15.2:0/333052824 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f699406d530 msgr2=0x7f699406f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:42.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.366+0000 7f69b0b34700 1 --2- 172.21.15.2:0/333052824 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f699406d530 0x7f699406f9f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f699c009c60 tx=0x7f699c009260 comp rx=0 tx=0).stop 2024-09-13T22:56:42.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.366+0000 7f69b0b34700 1 -- 172.21.15.2:0/333052824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69ac1040d0 msgr2=0x7f69ac196990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:42.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.366+0000 7f69b0b34700 1 --2- 172.21.15.2:0/333052824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69ac1040d0 0x7f69ac196990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f69a0000c00 tx=0x7f69a000f690 comp rx=0 tx=0).stop 2024-09-13T22:56:42.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.366+0000 7f69b0b34700 1 -- 172.21.15.2:0/333052824 shutdown_connections 2024-09-13T22:56:42.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.366+0000 7f69b0b34700 1 --2- 172.21.15.2:0/333052824 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7f699406d530 0x7f699406f9f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:42.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.366+0000 7f69b0b34700 1 --2- 172.21.15.2:0/333052824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69ac1017a0 0x7f69ac196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:42.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.366+0000 7f69b0b34700 1 --2- 172.21.15.2:0/333052824 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f69ac1040d0 0x7f69ac196990 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:42.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.366+0000 7f69b0b34700 1 -- 172.21.15.2:0/333052824 >> 172.21.15.2:0/333052824 conn(0x7f69ac0fb190 msgr2=0x7f69ac0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:42.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.366+0000 7f69b0b34700 1 -- 172.21.15.2:0/333052824 shutdown_connections 2024-09-13T22:56:42.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.366+0000 7f69b0b34700 1 -- 172.21.15.2:0/333052824 wait complete. 2024-09-13T22:56:42.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:41 smithi047 ceph-mon[34560]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:42.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:41 smithi047 ceph-mon[34560]: pgmap v31: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 47 MiB/s rd, 88 MiB/s wr, 348 op/s 2024-09-13T22:56:42.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:41 smithi047 ceph-mon[34560]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:42.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.495+0000 7fdfe62b2700 1 -- 172.21.15.2:0/2952063453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfe0104080 msgr2=0x7fdfe0106470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:42.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.495+0000 7fdfe62b2700 1 --2- 172.21.15.2:0/2952063453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfe0104080 0x7fdfe0106470 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009910 tx=0x7fdfd4009c20 comp rx=0 tx=0).stop 2024-09-13T22:56:42.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.495+0000 7fdfe62b2700 1 -- 172.21.15.2:0/2952063453 shutdown_connections 2024-09-13T22:56:42.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.495+0000 7fdfe62b2700 1 --2- 172.21.15.2:0/2952063453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfe0104080 0x7fdfe0106470 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:42.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.495+0000 7fdfe62b2700 1 --2- 172.21.15.2:0/2952063453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfe0101750 0x7fdfe0103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:42.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.495+0000 7fdfe62b2700 1 -- 172.21.15.2:0/2952063453 >> 172.21.15.2:0/2952063453 conn(0x7fdfe00fb160 msgr2=0x7fdfe00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:42.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.495+0000 7fdfe62b2700 1 -- 172.21.15.2:0/2952063453 shutdown_connections 2024-09-13T22:56:42.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.495+0000 7fdfe62b2700 1 -- 172.21.15.2:0/2952063453 wait complete. 2024-09-13T22:56:42.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.495+0000 7fdfe62b2700 1 Processor -- start 2024-09-13T22:56:42.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.496+0000 7fdfe62b2700 1 -- start start 2024-09-13T22:56:42.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.496+0000 7fdfe62b2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfe0101750 0x7fdfe01967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:42.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.496+0000 7fdfe62b2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfe0104080 0x7fdfe0196ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:42.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.496+0000 7fdfe62b2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe0197300 con 0x7fdfe0104080 2024-09-13T22:56:42.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.496+0000 7fdfe62b2700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe0197440 con 0x7fdfe0101750 2024-09-13T22:56:42.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.496+0000 7fdfdffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfe0101750 0x7fdfe01967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:42.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.496+0000 7fdfdf7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfe0104080 0x7fdfe0196ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:42.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.496+0000 7fdfdffff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfe0101750 0x7fdfe01967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.2:57922/0 (socket says 172.21.15.2:57922) 2024-09-13T22:56:42.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.496+0000 7fdfdffff700 1 -- 172.21.15.2:0/595779317 learned_addr learned my addr 172.21.15.2:0/595779317 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:56:42.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.496+0000 7fdfdffff700 1 -- 172.21.15.2:0/595779317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfe0104080 msgr2=0x7fdfe0196ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:42.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.497+0000 7fdfdffff700 1 --2- 172.21.15.2:0/595779317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfe0104080 0x7fdfe0196ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:42.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.497+0000 7fdfdffff700 1 -- 172.21.15.2:0/595779317 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd40095f0 con 0x7fdfe0101750 2024-09-13T22:56:42.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.497+0000 7fdfdffff700 1 --2- 172.21.15.2:0/595779317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfe0101750 0x7fdfe01967a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdfd000e920 tx=0x7fdfd000ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:42.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.497+0000 7fdfdd7fa700 1 -- 172.21.15.2:0/595779317 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfd000c9d0 con 0x7fdfe0101750 2024-09-13T22:56:42.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.497+0000 7fdfdd7fa700 1 -- 172.21.15.2:0/595779317 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdfd0010430 con 0x7fdfe0101750 2024-09-13T22:56:42.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.497+0000 7fdfe62b2700 1 -- 172.21.15.2:0/595779317 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe019bef0 con 0x7fdfe0101750 2024-09-13T22:56:42.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.497+0000 7fdfdd7fa700 1 -- 172.21.15.2:0/595779317 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfd0018650 con 0x7fdfe0101750 2024-09-13T22:56:42.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.497+0000 7fdfe62b2700 1 -- 172.21.15.2:0/595779317 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe019c3b0 con 0x7fdfe0101750 2024-09-13T22:56:42.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.498+0000 7fdfe62b2700 1 -- 172.21.15.2:0/595779317 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe0190630 con 0x7fdfe0101750 2024-09-13T22:56:42.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.499+0000 7fdfdd7fa700 1 -- 172.21.15.2:0/595779317 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 24) v1 ==== 91460+0+0 (secure 0 0 0) 0x7fdfd0018910 con 0x7fdfe0101750 2024-09-13T22:56:42.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.499+0000 7fdfdd7fa700 1 --2- 172.21.15.2:0/595779317 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7fdfc806d530 0x7fdfc806f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:56:42.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.500+0000 7fdfdd7fa700 1 -- 172.21.15.2:0/595779317 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fdfd0014070 con 0x7fdfe0101750 2024-09-13T22:56:42.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.500+0000 7fdfdf7fe700 1 --2- 172.21.15.2:0/595779317 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7fdfc806d530 0x7fdfc806f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:56:42.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.500+0000 7fdfdf7fe700 1 --2- 172.21.15.2:0/595779317 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7fdfc806d530 0x7fdfc806f9f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009fd0 tx=0x7fdfd4005940 comp rx=0 tx=0).ready entity=mgr.14590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:56:42.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.506+0000 7fdfdd7fa700 1 -- 172.21.15.2:0/595779317 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7fdfd00539f0 con 0x7fdfe0101750 2024-09-13T22:56:42.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.874+0000 7fdfe62b2700 1 -- 172.21.15.2:0/595779317 --> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfe00611d0 con 0x7fdfc806d530 2024-09-13T22:56:42.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.875+0000 7fdfdd7fa700 1 -- 172.21.15.2:0/595779317 <== mgr.14590 v2:172.21.15.47:6828/1914885837 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fdfe00611d0 con 0x7fdfc806d530 2024-09-13T22:56:42.876 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:56:42.876 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:56:42.876 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T22:56:42.876 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T22:56:42.877 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [], 2024-09-13T22:56:42.877 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "", 2024-09-13T22:56:42.877 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T22:56:42.877 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T22:56:42.877 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:56:42.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.878+0000 7fdfe62b2700 1 -- 172.21.15.2:0/595779317 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7fdfc806d530 msgr2=0x7fdfc806f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:42.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.878+0000 7fdfe62b2700 1 --2- 172.21.15.2:0/595779317 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7fdfc806d530 0x7fdfc806f9f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009fd0 tx=0x7fdfd4005940 comp rx=0 tx=0).stop 2024-09-13T22:56:42.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.878+0000 7fdfe62b2700 1 -- 172.21.15.2:0/595779317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfe0101750 msgr2=0x7fdfe01967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:56:42.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.878+0000 7fdfe62b2700 1 --2- 172.21.15.2:0/595779317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfe0101750 0x7fdfe01967a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdfd000e920 tx=0x7fdfd000ec30 comp rx=0 tx=0).stop 2024-09-13T22:56:42.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.878+0000 7fdfe62b2700 1 -- 172.21.15.2:0/595779317 shutdown_connections 2024-09-13T22:56:42.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.878+0000 7fdfe62b2700 1 --2- 172.21.15.2:0/595779317 >> [v2:172.21.15.47:6828/1914885837,v1:172.21.15.47:6829/1914885837] conn(0x7fdfc806d530 0x7fdfc806f9f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:42.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.878+0000 7fdfe62b2700 1 --2- 172.21.15.2:0/595779317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdfe0101750 0x7fdfe01967a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:42.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.878+0000 7fdfe62b2700 1 --2- 172.21.15.2:0/595779317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfe0104080 0x7fdfe0196ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:56:42.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.878+0000 7fdfe62b2700 1 -- 172.21.15.2:0/595779317 >> 172.21.15.2:0/595779317 conn(0x7fdfe00fb160 msgr2=0x7fdfe00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:56:42.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.878+0000 7fdfe62b2700 1 -- 172.21.15.2:0/595779317 shutdown_connections 2024-09-13T22:56:42.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:56:42.878+0000 7fdfe62b2700 1 -- 172.21.15.2:0/595779317 wait complete. 2024-09-13T22:56:43.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:42 smithi002 ceph-mon[27637]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:43.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:42 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/333052824' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:56:43.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:42 smithi047 ceph-mon[34560]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:43.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:42 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/333052824' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:56:44.201 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:43 smithi002 ceph-mon[27637]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:44.202 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:43 smithi002 ceph-mon[27637]: pgmap v32: 65 pgs: 65 active+clean; 2.5 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 26 MiB/s rd, 48 MiB/s wr, 312 op/s 2024-09-13T22:56:44.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:43 smithi047 ceph-mon[34560]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:56:44.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:43 smithi047 ceph-mon[34560]: pgmap v32: 65 pgs: 65 active+clean; 2.5 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 26 MiB/s rd, 48 MiB/s wr, 312 op/s 2024-09-13T22:56:46.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:46 smithi047 ceph-mon[34560]: pgmap v33: 65 pgs: 65 active+clean; 2.5 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 159 op/s 2024-09-13T22:56:46.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:46 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:56:46.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:46 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:46.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:46 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:46.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:46 smithi047 ceph-mon[34560]: Standby manager daemon smithi002.yumtzz restarted 2024-09-13T22:56:46.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:46 smithi047 ceph-mon[34560]: Standby manager daemon smithi002.yumtzz started 2024-09-13T22:56:46.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:46 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.yumtzz/crt"}]: dispatch 2024-09-13T22:56:46.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:46 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:56:46.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:46 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.yumtzz/key"}]: dispatch 2024-09-13T22:56:46.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:46 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:56:46.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:46 smithi002 ceph-mon[27637]: pgmap v33: 65 pgs: 65 active+clean; 2.5 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 159 op/s 2024-09-13T22:56:46.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:46 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:56:46.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:46 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:46.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:46 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:46.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:46 smithi002 ceph-mon[27637]: Standby manager daemon smithi002.yumtzz restarted 2024-09-13T22:56:46.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:46 smithi002 ceph-mon[27637]: Standby manager daemon smithi002.yumtzz started 2024-09-13T22:56:46.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:46 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.yumtzz/crt"}]: dispatch 2024-09-13T22:56:46.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:46 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:56:46.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:46 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.yumtzz/key"}]: dispatch 2024-09-13T22:56:46.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:46 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:56:47.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:47 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:47.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:47 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:47.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:47 smithi047 ceph-mon[34560]: mgrmap e25: smithi047.gcymvd(active, since 61s), standbys: smithi002.yumtzz 2024-09-13T22:56:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:47 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:47 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:47 smithi002 ceph-mon[27637]: mgrmap e25: smithi047.gcymvd(active, since 61s), standbys: smithi002.yumtzz 2024-09-13T22:56:47.693 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T22:56:47.693 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-13T22:56:48.811 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T22:56:48.812 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T22:56:48.889 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:48 smithi002 ceph-mon[27637]: pgmap v34: 65 pgs: 65 active+clean; 1.4 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 233 op/s 2024-09-13T22:56:48.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:48 smithi047 ceph-mon[34560]: pgmap v34: 65 pgs: 65 active+clean; 1.4 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 233 op/s 2024-09-13T22:56:50.710 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: pgmap v35: 65 pgs: 65 active+clean; 1.4 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 154 op/s 2024-09-13T22:56:50.710 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:50.710 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:50.710 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:56:50.710 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:56:50.710 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:50.710 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:56:50.710 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mgr fail", "who": "smithi047.gcymvd"}]: dispatch 2024-09-13T22:56:50.710 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mgr fail", "who": "smithi047.gcymvd"}]: dispatch 2024-09-13T22:56:50.710 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T22:56:50.710 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd='[{"prefix": "mgr fail", "who": "smithi047.gcymvd"}]': finished 2024-09-13T22:56:50.711 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: mgrmap e26: smithi002.yumtzz(active, starting, since 0.0062707s) 2024-09-13T22:56:50.711 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T22:56:50.711 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:56:50.711 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.gglyyr"}]: dispatch 2024-09-13T22:56:50.711 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.auedll"}]: dispatch 2024-09-13T22:56:50.711 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.gxzkha"}]: dispatch 2024-09-13T22:56:50.711 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.nqvveh"}]: dispatch 2024-09-13T22:56:50.711 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr metadata", "who": "smithi002.yumtzz", "id": "smithi002.yumtzz"}]: dispatch 2024-09-13T22:56:50.711 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:56:50.711 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:56:50.711 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:56:50.711 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:56:50.712 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:56:50.712 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:56:50.712 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:56:50.712 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:56:50.712 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:56:50.712 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:50 smithi002 ceph-mon[27637]: Manager daemon smithi002.yumtzz is now available 2024-09-13T22:56:50.758 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: pgmap v35: 65 pgs: 65 active+clean; 1.4 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 154 op/s 2024-09-13T22:56:50.758 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:50.758 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:50.759 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:56:50.759 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:56:50.759 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' 2024-09-13T22:56:50.759 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:56:50.759 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14590 172.21.15.47:0/3632733349' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mgr fail", "who": "smithi047.gcymvd"}]: dispatch 2024-09-13T22:56:50.759 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "mgr fail", "who": "smithi047.gcymvd"}]: dispatch 2024-09-13T22:56:50.759 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T22:56:50.759 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14590 ' entity='mgr.smithi047.gcymvd' cmd='[{"prefix": "mgr fail", "who": "smithi047.gcymvd"}]': finished 2024-09-13T22:56:50.759 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: mgrmap e26: smithi002.yumtzz(active, starting, since 0.0062707s) 2024-09-13T22:56:50.759 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T22:56:50.759 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T22:56:50.759 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.gglyyr"}]: dispatch 2024-09-13T22:56:50.760 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.auedll"}]: dispatch 2024-09-13T22:56:50.760 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.gxzkha"}]: dispatch 2024-09-13T22:56:50.760 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.nqvveh"}]: dispatch 2024-09-13T22:56:50.760 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr metadata", "who": "smithi002.yumtzz", "id": "smithi002.yumtzz"}]: dispatch 2024-09-13T22:56:50.760 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T22:56:50.760 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T22:56:50.760 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T22:56:50.760 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T22:56:50.760 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T22:56:50.760 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T22:56:50.760 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T22:56:50.760 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T22:56:50.760 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T22:56:50.761 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:50 smithi047 ceph-mon[34560]: Manager daemon smithi002.yumtzz is now available 2024-09-13T22:56:51.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:51 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:56:51.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:51 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:56:51.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:51 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.yumtzz/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:56:51.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:51 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.yumtzz/trash_purge_schedule"}]: dispatch 2024-09-13T22:56:51.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:51 smithi047 ceph-mon[34560]: mgrmap e27: smithi002.yumtzz(active, since 1.0091s) 2024-09-13T22:56:52.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:51 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:56:52.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:51 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:56:52.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:51 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.yumtzz/mirror_snapshot_schedule"}]: dispatch 2024-09-13T22:56:52.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:51 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.yumtzz/trash_purge_schedule"}]: dispatch 2024-09-13T22:56:52.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:51 smithi002 ceph-mon[27637]: mgrmap e27: smithi002.yumtzz(active, since 1.0091s) 2024-09-13T22:56:52.863 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:52 smithi002 ceph-mon[27637]: pgmap v3: 65 pgs: 65 active+clean; 292 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:56:52.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:52 smithi047 ceph-mon[34560]: pgmap v3: 65 pgs: 65 active+clean; 292 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:56:53.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:53 smithi047 ceph-mon[34560]: [13/Sep/2024:22:56:52] ENGINE Bus STARTING 2024-09-13T22:56:53.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:53 smithi047 ceph-mon[34560]: [13/Sep/2024:22:56:52] ENGINE Serving on https://172.21.15.2:7150 2024-09-13T22:56:53.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:53 smithi047 ceph-mon[34560]: [13/Sep/2024:22:56:52] ENGINE Error in HTTPServer.serve 2024-09-13T22:56:53.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Traceback (most recent call last): 2024-09-13T22:56:53.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:56:53.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: self._connections.run(self.expiration_interval) 2024-09-13T22:56:53.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:56:53.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: self._run(expiration_interval) 2024-09-13T22:56:53.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:56:53.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:56:53.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:56:53.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:56:53.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:56:53.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: s = self.context.wrap_socket( 2024-09-13T22:56:53.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:56:53.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: return self.sslsocket_class._create( 2024-09-13T22:56:53.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:56:53.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: self.do_handshake() 2024-09-13T22:56:53.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:56:53.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: self._sslobj.do_handshake() 2024-09-13T22:56:53.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:56:53.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:53 smithi047 ceph-mon[34560]: mgrmap e28: smithi002.yumtzz(active, since 2s) 2024-09-13T22:56:53.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:53 smithi047 ceph-mon[34560]: [13/Sep/2024:22:56:52] ENGINE Serving on http://172.21.15.2:8765 2024-09-13T22:56:53.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:53 smithi047 ceph-mon[34560]: [13/Sep/2024:22:56:52] ENGINE Bus STARTED 2024-09-13T22:56:54.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:53 smithi002 ceph-mon[27637]: [13/Sep/2024:22:56:52] ENGINE Bus STARTING 2024-09-13T22:56:54.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:53 smithi002 ceph-mon[27637]: [13/Sep/2024:22:56:52] ENGINE Serving on https://172.21.15.2:7150 2024-09-13T22:56:54.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:53 smithi002 ceph-mon[27637]: [13/Sep/2024:22:56:52] ENGINE Error in HTTPServer.serve 2024-09-13T22:56:54.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Traceback (most recent call last): 2024-09-13T22:56:54.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T22:56:54.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-13T22:56:54.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T22:56:54.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._run(expiration_interval) 2024-09-13T22:56:54.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T22:56:54.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T22:56:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T22:56:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T22:56:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T22:56:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: s = self.context.wrap_socket( 2024-09-13T22:56:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T22:56:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: return self.sslsocket_class._create( 2024-09-13T22:56:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T22:56:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self.do_handshake() 2024-09-13T22:56:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T22:56:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._sslobj.do_handshake() 2024-09-13T22:56:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T22:56:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:53 smithi002 ceph-mon[27637]: mgrmap e28: smithi002.yumtzz(active, since 2s) 2024-09-13T22:56:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:53 smithi002 ceph-mon[27637]: [13/Sep/2024:22:56:52] ENGINE Serving on http://172.21.15.2:8765 2024-09-13T22:56:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:53 smithi002 ceph-mon[27637]: [13/Sep/2024:22:56:52] ENGINE Bus STARTED 2024-09-13T22:56:55.745 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:55 smithi047 ceph-mon[34560]: pgmap v5: 65 pgs: 65 active+clean; 292 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:56:55.745 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:55 smithi047 ceph-mon[34560]: mgrmap e29: smithi002.yumtzz(active, since 4s) 2024-09-13T22:56:56.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:55 smithi002 ceph-mon[27637]: pgmap v5: 65 pgs: 65 active+clean; 292 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-13T22:56:56.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:55 smithi002 ceph-mon[27637]: mgrmap e29: smithi002.yumtzz(active, since 4s) 2024-09-13T22:56:57.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:56 smithi047 ceph-mon[34560]: pgmap v6: 65 pgs: 65 active+clean; 287 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 8 op/s 2024-09-13T22:56:57.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:56 smithi047 ceph-mon[34560]: Standby manager daemon smithi047.gcymvd started 2024-09-13T22:56:57.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:56 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/1745357131' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/crt"}]: dispatch 2024-09-13T22:56:57.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:56 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/1745357131' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:56:57.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:56 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/1745357131' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/key"}]: dispatch 2024-09-13T22:56:57.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:56 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/1745357131' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:56:57.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:56 smithi002 ceph-mon[27637]: pgmap v6: 65 pgs: 65 active+clean; 287 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 8 op/s 2024-09-13T22:56:57.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:56 smithi002 ceph-mon[27637]: Standby manager daemon smithi047.gcymvd started 2024-09-13T22:56:57.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:56 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.47:0/1745357131' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/crt"}]: dispatch 2024-09-13T22:56:57.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:56 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.47:0/1745357131' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:56:57.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:56 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.47:0/1745357131' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/key"}]: dispatch 2024-09-13T22:56:57.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:56 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.47:0/1745357131' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:56:58.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:57 smithi047 ceph-mon[34560]: mgrmap e30: smithi002.yumtzz(active, since 6s), standbys: smithi047.gcymvd 2024-09-13T22:56:58.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:57 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr metadata", "who": "smithi047.gcymvd", "id": "smithi047.gcymvd"}]: dispatch 2024-09-13T22:56:58.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:57 smithi002 ceph-mon[27637]: mgrmap e30: smithi002.yumtzz(active, since 6s), standbys: smithi047.gcymvd 2024-09-13T22:56:58.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:57 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr metadata", "who": "smithi047.gcymvd", "id": "smithi047.gcymvd"}]: dispatch 2024-09-13T22:56:59.625 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:59 smithi002 ceph-mon[27637]: pgmap v7: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1023 KiB/s wr, 85 op/s 2024-09-13T22:56:59.625 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:59 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:56:59.625 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:59 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:56:59.625 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:59 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:56:59.625 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:56:59 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:56:59.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:59 smithi047 ceph-mon[34560]: pgmap v7: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1023 KiB/s wr, 85 op/s 2024-09-13T22:56:59.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:59 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:56:59.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:59 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:56:59.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:59 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:56:59.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:56:59 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:01.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:01 smithi047 ceph-mon[34560]: pgmap v8: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 901 KiB/s rd, 796 KiB/s wr, 66 op/s 2024-09-13T22:57:01.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:01 smithi002 ceph-mon[27637]: pgmap v8: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 901 KiB/s rd, 796 KiB/s wr, 66 op/s 2024-09-13T22:57:03.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:03 smithi047 ceph-mon[34560]: pgmap v9: 65 pgs: 65 active+clean; 292 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 93 op/s 2024-09-13T22:57:03.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:03 smithi002 ceph-mon[27637]: pgmap v9: 65 pgs: 65 active+clean; 292 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 93 op/s 2024-09-13T22:57:05.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:04 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:05.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:04 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:05.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:04 smithi047 ceph-mon[34560]: pgmap v10: 65 pgs: 65 active+clean; 292 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 85 op/s 2024-09-13T22:57:05.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:04 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:05.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:04 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:05.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:04 smithi002 ceph-mon[27637]: pgmap v10: 65 pgs: 65 active+clean; 292 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 85 op/s 2024-09-13T22:57:06.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:05 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:57:06.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:05 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:57:07.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:06 smithi002 ceph-mon[27637]: pgmap v11: 65 pgs: 65 active+clean; 292 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 88 op/s 2024-09-13T22:57:07.277 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:06 smithi047 ceph-mon[34560]: pgmap v11: 65 pgs: 65 active+clean; 292 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 88 op/s 2024-09-13T22:57:09.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:09 smithi002 ceph-mon[27637]: pgmap v12: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 119 op/s 2024-09-13T22:57:09.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:09 smithi047 ceph-mon[34560]: pgmap v12: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 119 op/s 2024-09-13T22:57:11.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:10 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:10 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:10 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:10 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:10 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:57:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:10 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:57:11.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:10 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:11.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:10 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:11.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:10 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:11.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:10 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:11.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:10 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:57:11.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:10 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:57:12.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:11 smithi047 ceph-mon[34560]: pgmap v13: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 72 op/s 2024-09-13T22:57:12.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:11 smithi047 ceph-mon[34560]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-13T22:57:12.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:11 smithi047 ceph-mon[34560]: Updating smithi047:/etc/ceph/ceph.conf 2024-09-13T22:57:12.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:11 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:12.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:11 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:12.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:11 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:12.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:11 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:12.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:11 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:12.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:11 smithi002 ceph-mon[27637]: pgmap v13: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 72 op/s 2024-09-13T22:57:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:11 smithi002 ceph-mon[27637]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-13T22:57:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:11 smithi002 ceph-mon[27637]: Updating smithi047:/etc/ceph/ceph.conf 2024-09-13T22:57:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:11 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:11 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:11 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:11 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:11 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:13.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.998+0000 7fa27683c700 1 -- 172.21.15.2:0/4158226474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa270100cb0 msgr2=0x7fa2701010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:13.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.998+0000 7fa27683c700 1 --2- 172.21.15.2:0/4158226474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa270100cb0 0x7fa2701010d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa260009910 tx=0x7fa260009c20 comp rx=0 tx=0).stop 2024-09-13T22:57:13.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.998+0000 7fa27683c700 1 -- 172.21.15.2:0/4158226474 shutdown_connections 2024-09-13T22:57:13.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.998+0000 7fa27683c700 1 --2- 172.21.15.2:0/4158226474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa270101eb0 0x7fa270102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:13.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.998+0000 7fa27683c700 1 --2- 172.21.15.2:0/4158226474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa270100cb0 0x7fa2701010d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:13.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.998+0000 7fa27683c700 1 -- 172.21.15.2:0/4158226474 >> 172.21.15.2:0/4158226474 conn(0x7fa2700fc230 msgr2=0x7fa2700fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:13.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.998+0000 7fa27683c700 1 -- 172.21.15.2:0/4158226474 shutdown_connections 2024-09-13T22:57:13.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.998+0000 7fa27683c700 1 -- 172.21.15.2:0/4158226474 wait complete. 2024-09-13T22:57:13.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.998+0000 7fa27683c700 1 Processor -- start 2024-09-13T22:57:13.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.999+0000 7fa27683c700 1 -- start start 2024-09-13T22:57:13.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.999+0000 7fa27683c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa270100cb0 0x7fa2701964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.999+0000 7fa27683c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa270101eb0 0x7fa270196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.999+0000 7fa27683c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa270197020 con 0x7fa270100cb0 2024-09-13T22:57:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.999+0000 7fa27683c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa270197160 con 0x7fa270101eb0 2024-09-13T22:57:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.999+0000 7fa26ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa270100cb0 0x7fa2701964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.999+0000 7fa26ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa270100cb0 0x7fa2701964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51676/0 (socket says 172.21.15.2:51676) 2024-09-13T22:57:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.999+0000 7fa26ffff700 1 -- 172.21.15.2:0/2963250392 learned_addr learned my addr 172.21.15.2:0/2963250392 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:57:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.999+0000 7fa26f7fe700 1 --2- 172.21.15.2:0/2963250392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa270101eb0 0x7fa270196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.999+0000 7fa26ffff700 1 -- 172.21.15.2:0/2963250392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa270101eb0 msgr2=0x7fa270196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.999+0000 7fa26ffff700 1 --2- 172.21.15.2:0/2963250392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa270101eb0 0x7fa270196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:12.999+0000 7fa26ffff700 1 -- 172.21.15.2:0/2963250392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2600095f0 con 0x7fa270100cb0 2024-09-13T22:57:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.000+0000 7fa26ffff700 1 --2- 172.21.15.2:0/2963250392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa270100cb0 0x7fa2701964c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa260000c00 tx=0x7fa26000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.000+0000 7fa26d7fa700 1 -- 172.21.15.2:0/2963250392 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa26001d070 con 0x7fa270100cb0 2024-09-13T22:57:13.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.000+0000 7fa27683c700 1 -- 172.21.15.2:0/2963250392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa27019bbb0 con 0x7fa270100cb0 2024-09-13T22:57:13.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.000+0000 7fa26d7fa700 1 -- 172.21.15.2:0/2963250392 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa260005dc0 con 0x7fa270100cb0 2024-09-13T22:57:13.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.000+0000 7fa26d7fa700 1 -- 172.21.15.2:0/2963250392 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa260022470 con 0x7fa270100cb0 2024-09-13T22:57:13.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.000+0000 7fa27683c700 1 -- 172.21.15.2:0/2963250392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27019c0a0 con 0x7fa270100cb0 2024-09-13T22:57:13.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.001+0000 7fa27683c700 1 -- 172.21.15.2:0/2963250392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa270109810 con 0x7fa270100cb0 2024-09-13T22:57:13.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.001+0000 7fa26d7fa700 1 -- 172.21.15.2:0/2963250392 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 30) v1 ==== 92504+0+0 (secure 0 0 0) 0x7fa260017400 con 0x7fa270100cb0 2024-09-13T22:57:13.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.002+0000 7fa26d7fa700 1 --2- 172.21.15.2:0/2963250392 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fa25806e440 0x7fa258070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:13.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.002+0000 7fa26d7fa700 1 -- 172.21.15.2:0/2963250392 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fa26008f810 con 0x7fa270100cb0 2024-09-13T22:57:13.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.002+0000 7fa26f7fe700 1 --2- 172.21.15.2:0/2963250392 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fa25806e440 0x7fa258070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:13.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.002+0000 7fa26f7fe700 1 --2- 172.21.15.2:0/2963250392 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fa25806e440 0x7fa258070900 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa264009c60 tx=0x7fa264009260 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:13.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.007+0000 7fa26d7fa700 1 -- 172.21.15.2:0/2963250392 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7fa26005c7f0 con 0x7fa270100cb0 2024-09-13T22:57:13.077 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:12 smithi002 ceph-mon[27637]: Updating smithi002:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:57:13.077 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:12 smithi002 ceph-mon[27637]: Updating smithi047:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:57:13.077 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:12 smithi002 ceph-mon[27637]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:57:13.077 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:12 smithi002 ceph-mon[27637]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:57:13.077 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:12 smithi002 ceph-mon[27637]: Updating smithi002:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:57:13.077 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:12 smithi002 ceph-mon[27637]: Updating smithi047:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:57:13.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:12 smithi047 ceph-mon[34560]: Updating smithi002:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:57:13.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:12 smithi047 ceph-mon[34560]: Updating smithi047:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T22:57:13.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:12 smithi047 ceph-mon[34560]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:57:13.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:12 smithi047 ceph-mon[34560]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-09-13T22:57:13.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:12 smithi047 ceph-mon[34560]: Updating smithi002:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:57:13.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:12 smithi047 ceph-mon[34560]: Updating smithi047:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T22:57:13.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.256+0000 7fa27683c700 1 -- 172.21.15.2:0/2963250392 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa270106800 con 0x7fa25806e440 2024-09-13T22:57:13.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.257+0000 7fa26d7fa700 1 -- 172.21.15.2:0/2963250392 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fa270106800 con 0x7fa25806e440 2024-09-13T22:57:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.259+0000 7fa27683c700 1 -- 172.21.15.2:0/2963250392 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fa25806e440 msgr2=0x7fa258070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.259+0000 7fa27683c700 1 --2- 172.21.15.2:0/2963250392 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fa25806e440 0x7fa258070900 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa264009c60 tx=0x7fa264009260 comp rx=0 tx=0).stop 2024-09-13T22:57:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.259+0000 7fa27683c700 1 -- 172.21.15.2:0/2963250392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa270100cb0 msgr2=0x7fa2701964c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.259+0000 7fa27683c700 1 --2- 172.21.15.2:0/2963250392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa270100cb0 0x7fa2701964c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa260000c00 tx=0x7fa26000f690 comp rx=0 tx=0).stop 2024-09-13T22:57:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.259+0000 7fa27683c700 1 -- 172.21.15.2:0/2963250392 shutdown_connections 2024-09-13T22:57:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.259+0000 7fa27683c700 1 --2- 172.21.15.2:0/2963250392 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fa25806e440 0x7fa258070900 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.259+0000 7fa27683c700 1 --2- 172.21.15.2:0/2963250392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa270100cb0 0x7fa2701964c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.259+0000 7fa27683c700 1 --2- 172.21.15.2:0/2963250392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa270101eb0 0x7fa270196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.259+0000 7fa27683c700 1 -- 172.21.15.2:0/2963250392 >> 172.21.15.2:0/2963250392 conn(0x7fa2700fc230 msgr2=0x7fa2701050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.260+0000 7fa27683c700 1 -- 172.21.15.2:0/2963250392 shutdown_connections 2024-09-13T22:57:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.260+0000 7fa27683c700 1 -- 172.21.15.2:0/2963250392 wait complete. 2024-09-13T22:57:13.272 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T22:57:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.373+0000 7fe218aa1700 1 -- 172.21.15.2:0/99000806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214101eb0 msgr2=0x7fe214102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.373+0000 7fe218aa1700 1 --2- 172.21.15.2:0/99000806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214101eb0 0x7fe214102310 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc009910 tx=0x7fe1fc009c20 comp rx=0 tx=0).stop 2024-09-13T22:57:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.373+0000 7fe218aa1700 1 -- 172.21.15.2:0/99000806 shutdown_connections 2024-09-13T22:57:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.373+0000 7fe218aa1700 1 --2- 172.21.15.2:0/99000806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214101eb0 0x7fe214102310 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.373+0000 7fe218aa1700 1 --2- 172.21.15.2:0/99000806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe214100cb0 0x7fe2141010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.373+0000 7fe218aa1700 1 -- 172.21.15.2:0/99000806 >> 172.21.15.2:0/99000806 conn(0x7fe2140fc230 msgr2=0x7fe2140fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.373+0000 7fe218aa1700 1 -- 172.21.15.2:0/99000806 shutdown_connections 2024-09-13T22:57:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.373+0000 7fe218aa1700 1 -- 172.21.15.2:0/99000806 wait complete. 2024-09-13T22:57:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.374+0000 7fe218aa1700 1 Processor -- start 2024-09-13T22:57:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.374+0000 7fe218aa1700 1 -- start start 2024-09-13T22:57:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.374+0000 7fe218aa1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214100cb0 0x7fe214074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.374+0000 7fe218aa1700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe214101eb0 0x7fe214073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.374+0000 7fe218aa1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2140736c0 con 0x7fe214100cb0 2024-09-13T22:57:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.374+0000 7fe218aa1700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe214073800 con 0x7fe214101eb0 2024-09-13T22:57:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.374+0000 7fe21259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214100cb0 0x7fe214074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:13.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.374+0000 7fe21259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214100cb0 0x7fe214074b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51690/0 (socket says 172.21.15.2:51690) 2024-09-13T22:57:13.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.374+0000 7fe21259c700 1 -- 172.21.15.2:0/294573283 learned_addr learned my addr 172.21.15.2:0/294573283 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:57:13.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.374+0000 7fe209d9b700 1 --2- 172.21.15.2:0/294573283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe214101eb0 0x7fe214073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:13.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.375+0000 7fe21259c700 1 -- 172.21.15.2:0/294573283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe214101eb0 msgr2=0x7fe214073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:13.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.375+0000 7fe21259c700 1 --2- 172.21.15.2:0/294573283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe214101eb0 0x7fe214073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:13.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.375+0000 7fe21259c700 1 -- 172.21.15.2:0/294573283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc0095f0 con 0x7fe214100cb0 2024-09-13T22:57:13.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.375+0000 7fe21259c700 1 --2- 172.21.15.2:0/294573283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214100cb0 0x7fe214074b30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe20400e8f0 tx=0x7fe20400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:13.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.375+0000 7fe20bfff700 1 -- 172.21.15.2:0/294573283 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe204009790 con 0x7fe214100cb0 2024-09-13T22:57:13.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.375+0000 7fe20bfff700 1 -- 172.21.15.2:0/294573283 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe20400c810 con 0x7fe214100cb0 2024-09-13T22:57:13.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.375+0000 7fe218aa1700 1 -- 172.21.15.2:0/294573283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe214073ae0 con 0x7fe214100cb0 2024-09-13T22:57:13.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.375+0000 7fe20bfff700 1 -- 172.21.15.2:0/294573283 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe204003d20 con 0x7fe214100cb0 2024-09-13T22:57:13.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.375+0000 7fe218aa1700 1 -- 172.21.15.2:0/294573283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe21419e540 con 0x7fe214100cb0 2024-09-13T22:57:13.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.376+0000 7fe218aa1700 1 -- 172.21.15.2:0/294573283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe214109810 con 0x7fe214100cb0 2024-09-13T22:57:13.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.377+0000 7fe20bfff700 1 -- 172.21.15.2:0/294573283 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 30) v1 ==== 92504+0+0 (secure 0 0 0) 0x7fe2040041f0 con 0x7fe214100cb0 2024-09-13T22:57:13.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.377+0000 7fe20bfff700 1 --2- 172.21.15.2:0/294573283 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe20006e440 0x7fe200070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:13.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.377+0000 7fe20bfff700 1 -- 172.21.15.2:0/294573283 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fe204014070 con 0x7fe214100cb0 2024-09-13T22:57:13.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.377+0000 7fe209d9b700 1 --2- 172.21.15.2:0/294573283 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe20006e440 0x7fe200070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:13.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.378+0000 7fe209d9b700 1 --2- 172.21.15.2:0/294573283 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe20006e440 0x7fe200070900 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc009fd0 tx=0x7fe1fc005940 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.382+0000 7fe20bfff700 1 -- 172.21.15.2:0/294573283 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7fe20405b680 con 0x7fe214100cb0 2024-09-13T22:57:13.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.660+0000 7fe218aa1700 1 -- 172.21.15.2:0/294573283 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe214106800 con 0x7fe20006e440 2024-09-13T22:57:13.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.661+0000 7fe20bfff700 1 -- 172.21.15.2:0/294573283 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fe214106800 con 0x7fe20006e440 2024-09-13T22:57:13.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.663+0000 7fe218aa1700 1 -- 172.21.15.2:0/294573283 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe20006e440 msgr2=0x7fe200070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:13.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.663+0000 7fe218aa1700 1 --2- 172.21.15.2:0/294573283 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe20006e440 0x7fe200070900 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc009fd0 tx=0x7fe1fc005940 comp rx=0 tx=0).stop 2024-09-13T22:57:13.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.663+0000 7fe218aa1700 1 -- 172.21.15.2:0/294573283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214100cb0 msgr2=0x7fe214074b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.663+0000 7fe218aa1700 1 --2- 172.21.15.2:0/294573283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214100cb0 0x7fe214074b30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe20400e8f0 tx=0x7fe20400ec00 comp rx=0 tx=0).stop 2024-09-13T22:57:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.663+0000 7fe218aa1700 1 -- 172.21.15.2:0/294573283 shutdown_connections 2024-09-13T22:57:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.663+0000 7fe218aa1700 1 --2- 172.21.15.2:0/294573283 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe20006e440 0x7fe200070900 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.663+0000 7fe218aa1700 1 --2- 172.21.15.2:0/294573283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe214100cb0 0x7fe214074b30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.663+0000 7fe218aa1700 1 --2- 172.21.15.2:0/294573283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe214101eb0 0x7fe214073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.663+0000 7fe218aa1700 1 -- 172.21.15.2:0/294573283 >> 172.21.15.2:0/294573283 conn(0x7fe2140fc230 msgr2=0x7fe2141050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.664+0000 7fe218aa1700 1 -- 172.21.15.2:0/294573283 shutdown_connections 2024-09-13T22:57:13.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.664+0000 7fe218aa1700 1 -- 172.21.15.2:0/294573283 wait complete. 2024-09-13T22:57:13.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.774+0000 7fe479c22700 1 -- 172.21.15.2:0/1736929695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474100e10 msgr2=0x7fe474101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.774+0000 7fe479c22700 1 --2- 172.21.15.2:0/1736929695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474100e10 0x7fe474101270 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe45c009910 tx=0x7fe45c009c20 comp rx=0 tx=0).stop 2024-09-13T22:57:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.774+0000 7fe479c22700 1 -- 172.21.15.2:0/1736929695 shutdown_connections 2024-09-13T22:57:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.774+0000 7fe479c22700 1 --2- 172.21.15.2:0/1736929695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474100e10 0x7fe474101270 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.774+0000 7fe479c22700 1 --2- 172.21.15.2:0/1736929695 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4740ffc10 0x7fe474100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.774+0000 7fe479c22700 1 -- 172.21.15.2:0/1736929695 >> 172.21.15.2:0/1736929695 conn(0x7fe4740fb190 msgr2=0x7fe4740fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.774+0000 7fe479c22700 1 -- 172.21.15.2:0/1736929695 shutdown_connections 2024-09-13T22:57:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.774+0000 7fe479c22700 1 -- 172.21.15.2:0/1736929695 wait complete. 2024-09-13T22:57:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.775+0000 7fe479c22700 1 Processor -- start 2024-09-13T22:57:13.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.775+0000 7fe479c22700 1 -- start start 2024-09-13T22:57:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.775+0000 7fe479c22700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4740ffc10 0x7fe474196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.775+0000 7fe479c22700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474100e10 0x7fe4741969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.775+0000 7fe479c22700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe474196fe0 con 0x7fe474100e10 2024-09-13T22:57:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.775+0000 7fe479c22700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe474197120 con 0x7fe4740ffc10 2024-09-13T22:57:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.775+0000 7fe46affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474100e10 0x7fe4741969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.775+0000 7fe4737fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4740ffc10 0x7fe474196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.775+0000 7fe46affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474100e10 0x7fe4741969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51706/0 (socket says 172.21.15.2:51706) 2024-09-13T22:57:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.775+0000 7fe46affd700 1 -- 172.21.15.2:0/3336716772 learned_addr learned my addr 172.21.15.2:0/3336716772 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:57:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.776+0000 7fe46affd700 1 -- 172.21.15.2:0/3336716772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4740ffc10 msgr2=0x7fe474196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.776+0000 7fe46affd700 1 --2- 172.21.15.2:0/3336716772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4740ffc10 0x7fe474196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.776+0000 7fe46affd700 1 -- 172.21.15.2:0/3336716772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c0095f0 con 0x7fe474100e10 2024-09-13T22:57:13.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.776+0000 7fe46affd700 1 --2- 172.21.15.2:0/3336716772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474100e10 0x7fe4741969c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00bd70 tx=0x7fe45c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:13.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.776+0000 7fe4717fa700 1 -- 172.21.15.2:0/3336716772 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe45c01d070 con 0x7fe474100e10 2024-09-13T22:57:13.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.776+0000 7fe4717fa700 1 -- 172.21.15.2:0/3336716772 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe45c005dc0 con 0x7fe474100e10 2024-09-13T22:57:13.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.776+0000 7fe479c22700 1 -- 172.21.15.2:0/3336716772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe47419bb70 con 0x7fe474100e10 2024-09-13T22:57:13.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.776+0000 7fe4717fa700 1 -- 172.21.15.2:0/3336716772 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe45c021410 con 0x7fe474100e10 2024-09-13T22:57:13.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.776+0000 7fe479c22700 1 -- 172.21.15.2:0/3336716772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47419c060 con 0x7fe474100e10 2024-09-13T22:57:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.777+0000 7fe479c22700 1 -- 172.21.15.2:0/3336716772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe474108700 con 0x7fe474100e10 2024-09-13T22:57:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.778+0000 7fe4717fa700 1 -- 172.21.15.2:0/3336716772 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 30) v1 ==== 92504+0+0 (secure 0 0 0) 0x7fe45c00f7d0 con 0x7fe474100e10 2024-09-13T22:57:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.778+0000 7fe4717fa700 1 --2- 172.21.15.2:0/3336716772 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe46006e440 0x7fe460070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.778+0000 7fe4717fa700 1 -- 172.21.15.2:0/3336716772 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fe45c08f580 con 0x7fe474100e10 2024-09-13T22:57:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.778+0000 7fe4737fe700 1 --2- 172.21.15.2:0/3336716772 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe46006e440 0x7fe460070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.779+0000 7fe4737fe700 1 --2- 172.21.15.2:0/3336716772 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe46006e440 0x7fe460070900 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe474100c70 tx=0x7fe464007400 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:13.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:13.783+0000 7fe4717fa700 1 -- 172.21.15.2:0/3336716772 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7fe45c05c560 con 0x7fe474100e10 2024-09-13T22:57:13.980 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:13 smithi002 ceph-mon[27637]: Reconfiguring prometheus.smithi002 (dependencies changed)... 2024-09-13T22:57:13.980 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:13 smithi002 ceph-mon[27637]: Reconfiguring daemon prometheus.smithi002 on smithi002 2024-09-13T22:57:13.980 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:13 smithi002 ceph-mon[27637]: pgmap v14: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 126 op/s 2024-09-13T22:57:14.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.020+0000 7fe479c22700 1 -- 172.21.15.2:0/3336716772 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe474068c90 con 0x7fe46006e440 2024-09-13T22:57:14.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.031+0000 7fe4717fa700 1 -- 172.21.15.2:0/3336716772 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fe474068c90 con 0x7fe46006e440 2024-09-13T22:57:14.032 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:57:14.032 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (8m) 15s ago 9m 26.2M - 0.25.0 c8568f914cd2 76a1576b4f53 2024-09-13T22:57:14.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (9m) 15s ago 9m 7713k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T22:57:14.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (8m) 4s ago 8m 7704k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T22:57:14.032 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (9m) 15s ago 9m 6665k - 18.2.1 5be31c24972a de910e0c5157 2024-09-13T22:57:14.032 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (8m) 4s ago 8m 6651k - 18.2.1 5be31c24972a 9f4bcfa66588 2024-09-13T22:57:14.032 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (7m) 15s ago 9m 84.0M - 9.4.7 954c08fa6188 39f4cfdc98d7 2024-09-13T22:57:14.032 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (4m) 15s ago 4m 13.7M - 18.2.1 5be31c24972a 59e9c88c31ca 2024-09-13T22:57:14.033 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (3m) 15s ago 3m 278M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T22:57:14.033 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (4m) 4s ago 4m 256M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T22:57:14.033 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (3m) 4s ago 3m 16.8M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T22:57:14.033 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 running (34s) 15s ago 10m 475M - 19.1.1-324-gecab7be5 0652ff2b5d78 7a8aa9de37e4 2024-09-13T22:57:14.033 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (114s) 4s ago 8m 100M - 19.1.1-324-gecab7be5 0652ff2b5d78 5426cb59db1c 2024-09-13T22:57:14.033 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (10m) 15s ago 11m 50.9M 2048M 18.2.1 5be31c24972a de11be74385d 2024-09-13T22:57:14.033 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (8m) 4s ago 8m 40.1M 2048M 18.2.1 5be31c24972a 5642284a23bf 2024-09-13T22:57:14.033 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (9m) 15s ago 9m 15.5M - 1.5.0 0da6a335fe13 427e04f7ded9 2024-09-13T22:57:14.033 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (8m) 4s ago 8m 15.4M - 1.5.0 0da6a335fe13 07935c82b1d6 2024-09-13T22:57:14.033 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (7m) 15s ago 7m 174M 1217M 18.2.1 5be31c24972a 1e1f6936c402 2024-09-13T22:57:14.033 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (7m) 15s ago 7m 183M 1217M 18.2.1 5be31c24972a f0ac78c34831 2024-09-13T22:57:14.033 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (6m) 15s ago 6m 152M 1217M 18.2.1 5be31c24972a 9a2f4f6decfb 2024-09-13T22:57:14.033 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (6m) 4s ago 6m 213M 2241M 18.2.1 5be31c24972a fb455cc4c571 2024-09-13T22:57:14.034 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (5m) 4s ago 5m 185M 2241M 18.2.1 5be31c24972a f1bdc2c50535 2024-09-13T22:57:14.034 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (5m) 4s ago 5m 165M 2241M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T22:57:14.034 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (40s) 15s ago 9m 44.6M - 2.43.0 a07b618ecd1d abfb72907e8a 2024-09-13T22:57:14.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.033+0000 7fe479c22700 1 -- 172.21.15.2:0/3336716772 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe46006e440 msgr2=0x7fe460070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:14.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.033+0000 7fe479c22700 1 --2- 172.21.15.2:0/3336716772 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe46006e440 0x7fe460070900 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe474100c70 tx=0x7fe464007400 comp rx=0 tx=0).stop 2024-09-13T22:57:14.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.033+0000 7fe479c22700 1 -- 172.21.15.2:0/3336716772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474100e10 msgr2=0x7fe4741969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:14.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.033+0000 7fe479c22700 1 --2- 172.21.15.2:0/3336716772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474100e10 0x7fe4741969c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00bd70 tx=0x7fe45c00bda0 comp rx=0 tx=0).stop 2024-09-13T22:57:14.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.033+0000 7fe479c22700 1 -- 172.21.15.2:0/3336716772 shutdown_connections 2024-09-13T22:57:14.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.033+0000 7fe479c22700 1 --2- 172.21.15.2:0/3336716772 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe46006e440 0x7fe460070900 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:14.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.033+0000 7fe479c22700 1 --2- 172.21.15.2:0/3336716772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4740ffc10 0x7fe474196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:14.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.033+0000 7fe479c22700 1 --2- 172.21.15.2:0/3336716772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe474100e10 0x7fe4741969c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:14.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.033+0000 7fe479c22700 1 -- 172.21.15.2:0/3336716772 >> 172.21.15.2:0/3336716772 conn(0x7fe4740fb190 msgr2=0x7fe474068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:14.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.033+0000 7fe479c22700 1 -- 172.21.15.2:0/3336716772 shutdown_connections 2024-09-13T22:57:14.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.033+0000 7fe479c22700 1 -- 172.21.15.2:0/3336716772 wait complete. 2024-09-13T22:57:14.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.146+0000 7fc667315700 1 -- 172.21.15.2:0/4023583863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc660101800 msgr2=0x7fc660103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:14.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.146+0000 7fc667315700 1 --2- 172.21.15.2:0/4023583863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc660101800 0x7fc660103bf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc65c009910 tx=0x7fc65c009c20 comp rx=0 tx=0).stop 2024-09-13T22:57:14.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.146+0000 7fc667315700 1 -- 172.21.15.2:0/4023583863 shutdown_connections 2024-09-13T22:57:14.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.146+0000 7fc667315700 1 --2- 172.21.15.2:0/4023583863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc660104130 0x7fc660106520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:14.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.146+0000 7fc667315700 1 --2- 172.21.15.2:0/4023583863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc660101800 0x7fc660103bf0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:14.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.146+0000 7fc667315700 1 -- 172.21.15.2:0/4023583863 >> 172.21.15.2:0/4023583863 conn(0x7fc6600fb190 msgr2=0x7fc6600fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:14.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.146+0000 7fc667315700 1 -- 172.21.15.2:0/4023583863 shutdown_connections 2024-09-13T22:57:14.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.146+0000 7fc667315700 1 -- 172.21.15.2:0/4023583863 wait complete. 2024-09-13T22:57:14.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.147+0000 7fc667315700 1 Processor -- start 2024-09-13T22:57:14.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.147+0000 7fc667315700 1 -- start start 2024-09-13T22:57:14.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.147+0000 7fc667315700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc660101800 0x7fc660196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:14.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.147+0000 7fc667315700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc660104130 0x7fc6601969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:14.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.147+0000 7fc667315700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc660196fe0 con 0x7fc660104130 2024-09-13T22:57:14.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.147+0000 7fc667315700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc660197120 con 0x7fc660101800 2024-09-13T22:57:14.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.147+0000 7fc6648b0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc660104130 0x7fc6601969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:14.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.147+0000 7fc6650b1700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc660101800 0x7fc660196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:14.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.147+0000 7fc6648b0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc660104130 0x7fc6601969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51720/0 (socket says 172.21.15.2:51720) 2024-09-13T22:57:14.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.147+0000 7fc6648b0700 1 -- 172.21.15.2:0/1914726874 learned_addr learned my addr 172.21.15.2:0/1914726874 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:57:14.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.148+0000 7fc6648b0700 1 -- 172.21.15.2:0/1914726874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc660101800 msgr2=0x7fc660196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:14.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.148+0000 7fc6648b0700 1 --2- 172.21.15.2:0/1914726874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc660101800 0x7fc660196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:14.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.148+0000 7fc6648b0700 1 -- 172.21.15.2:0/1914726874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65c0095f0 con 0x7fc660104130 2024-09-13T22:57:14.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.148+0000 7fc6650b1700 1 --2- 172.21.15.2:0/1914726874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc660101800 0x7fc660196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T22:57:14.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.148+0000 7fc6648b0700 1 --2- 172.21.15.2:0/1914726874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc660104130 0x7fc6601969c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc65000e920 tx=0x7fc65000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:14.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.148+0000 7fc6567fc700 1 -- 172.21.15.2:0/1914726874 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc65000c9d0 con 0x7fc660104130 2024-09-13T22:57:14.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.148+0000 7fc667315700 1 -- 172.21.15.2:0/1914726874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66019bbd0 con 0x7fc660104130 2024-09-13T22:57:14.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.148+0000 7fc6567fc700 1 -- 172.21.15.2:0/1914726874 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc650010430 con 0x7fc660104130 2024-09-13T22:57:14.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.148+0000 7fc6567fc700 1 -- 172.21.15.2:0/1914726874 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc650018650 con 0x7fc660104130 2024-09-13T22:57:14.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.148+0000 7fc667315700 1 -- 172.21.15.2:0/1914726874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66019c120 con 0x7fc660104130 2024-09-13T22:57:14.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.149+0000 7fc667315700 1 -- 172.21.15.2:0/1914726874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc660190610 con 0x7fc660104130 2024-09-13T22:57:14.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.150+0000 7fc6567fc700 1 -- 172.21.15.2:0/1914726874 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 30) v1 ==== 92504+0+0 (secure 0 0 0) 0x7fc6500105a0 con 0x7fc660104130 2024-09-13T22:57:14.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.150+0000 7fc6567fc700 1 --2- 172.21.15.2:0/1914726874 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fc64c06e440 0x7fc64c070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:14.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.151+0000 7fc6567fc700 1 -- 172.21.15.2:0/1914726874 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fc650014070 con 0x7fc660104130 2024-09-13T22:57:14.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.151+0000 7fc6650b1700 1 --2- 172.21.15.2:0/1914726874 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fc64c06e440 0x7fc64c070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:14.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.151+0000 7fc6650b1700 1 --2- 172.21.15.2:0/1914726874 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fc64c06e440 0x7fc64c070900 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc65c009fd0 tx=0x7fc65c005940 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:14.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.155+0000 7fc6567fc700 1 -- 172.21.15.2:0/1914726874 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7fc6500539f0 con 0x7fc660104130 2024-09-13T22:57:14.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:13 smithi047 ceph-mon[34560]: Reconfiguring prometheus.smithi002 (dependencies changed)... 2024-09-13T22:57:14.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:13 smithi047 ceph-mon[34560]: Reconfiguring daemon prometheus.smithi002 on smithi002 2024-09-13T22:57:14.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:13 smithi047 ceph-mon[34560]: pgmap v14: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 126 op/s 2024-09-13T22:57:14.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.483+0000 7fc667315700 1 -- 172.21.15.2:0/1914726874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc66002cc70 con 0x7fc660104130 2024-09-13T22:57:14.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.484+0000 7fc6567fc700 1 -- 172.21.15.2:0/1914726874 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7fc65005b610 con 0x7fc660104130 2024-09-13T22:57:14.485 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:57:14.485 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T22:57:14.485 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-13T22:57:14.485 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:57:14.485 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T22:57:14.485 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:57:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:57:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T22:57:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-13T22:57:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:57:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T22:57:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-13T22:57:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:57:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T22:57:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-09-13T22:57:14.486 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:57:14.487 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T22:57:14.487 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:57:14.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.486+0000 7fc667315700 1 -- 172.21.15.2:0/1914726874 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fc64c06e440 msgr2=0x7fc64c070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:14.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.486+0000 7fc667315700 1 --2- 172.21.15.2:0/1914726874 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fc64c06e440 0x7fc64c070900 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc65c009fd0 tx=0x7fc65c005940 comp rx=0 tx=0).stop 2024-09-13T22:57:14.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.486+0000 7fc667315700 1 -- 172.21.15.2:0/1914726874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc660104130 msgr2=0x7fc6601969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:14.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.486+0000 7fc667315700 1 --2- 172.21.15.2:0/1914726874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc660104130 0x7fc6601969c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc65000e920 tx=0x7fc65000ec30 comp rx=0 tx=0).stop 2024-09-13T22:57:14.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.486+0000 7fc667315700 1 -- 172.21.15.2:0/1914726874 shutdown_connections 2024-09-13T22:57:14.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.486+0000 7fc667315700 1 --2- 172.21.15.2:0/1914726874 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fc64c06e440 0x7fc64c070900 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:14.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.486+0000 7fc667315700 1 --2- 172.21.15.2:0/1914726874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc660101800 0x7fc660196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:14.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.486+0000 7fc667315700 1 --2- 172.21.15.2:0/1914726874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc660104130 0x7fc6601969c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:14.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.486+0000 7fc667315700 1 -- 172.21.15.2:0/1914726874 >> 172.21.15.2:0/1914726874 conn(0x7fc6600fb190 msgr2=0x7fc6600fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:14.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.486+0000 7fc667315700 1 -- 172.21.15.2:0/1914726874 shutdown_connections 2024-09-13T22:57:14.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.486+0000 7fc667315700 1 -- 172.21.15.2:0/1914726874 wait complete. 2024-09-13T22:57:14.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.598+0000 7fa45a72b700 1 -- 172.21.15.2:0/2524099223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4540ffba0 msgr2=0x7fa4540fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.598+0000 7fa45a72b700 1 --2- 172.21.15.2:0/2524099223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4540ffba0 0x7fa4540fffc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa444009910 tx=0x7fa444009c20 comp rx=0 tx=0).stop 2024-09-13T22:57:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.598+0000 7fa45a72b700 1 -- 172.21.15.2:0/2524099223 shutdown_connections 2024-09-13T22:57:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.598+0000 7fa45a72b700 1 --2- 172.21.15.2:0/2524099223 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa454100da0 0x7fa454101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.598+0000 7fa45a72b700 1 --2- 172.21.15.2:0/2524099223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4540ffba0 0x7fa4540fffc0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.598+0000 7fa45a72b700 1 -- 172.21.15.2:0/2524099223 >> 172.21.15.2:0/2524099223 conn(0x7fa4540fb120 msgr2=0x7fa4540fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.599+0000 7fa45a72b700 1 -- 172.21.15.2:0/2524099223 shutdown_connections 2024-09-13T22:57:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.599+0000 7fa45a72b700 1 -- 172.21.15.2:0/2524099223 wait complete. 2024-09-13T22:57:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.599+0000 7fa45a72b700 1 Processor -- start 2024-09-13T22:57:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.599+0000 7fa45a72b700 1 -- start start 2024-09-13T22:57:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.600+0000 7fa45a72b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4540ffba0 0x7fa4541986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.600+0000 7fa45a72b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa454100da0 0x7fa454198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:14.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.600+0000 7fa45a72b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa454199220 con 0x7fa454100da0 2024-09-13T22:57:14.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.600+0000 7fa45a72b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa454199360 con 0x7fa4540ffba0 2024-09-13T22:57:14.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.600+0000 7fa4537fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa454100da0 0x7fa454198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:14.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.600+0000 7fa4537fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa454100da0 0x7fa454198c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51750/0 (socket says 172.21.15.2:51750) 2024-09-13T22:57:14.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.600+0000 7fa4537fe700 1 -- 172.21.15.2:0/2964240527 learned_addr learned my addr 172.21.15.2:0/2964240527 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:57:14.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.600+0000 7fa453fff700 1 --2- 172.21.15.2:0/2964240527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4540ffba0 0x7fa4541986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:14.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.600+0000 7fa4537fe700 1 -- 172.21.15.2:0/2964240527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4540ffba0 msgr2=0x7fa4541986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:14.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.600+0000 7fa4537fe700 1 --2- 172.21.15.2:0/2964240527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4540ffba0 0x7fa4541986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:14.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.600+0000 7fa4537fe700 1 -- 172.21.15.2:0/2964240527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4440095f0 con 0x7fa454100da0 2024-09-13T22:57:14.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.600+0000 7fa4537fe700 1 --2- 172.21.15.2:0/2964240527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa454100da0 0x7fa454198c00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa44800e920 tx=0x7fa44800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:14.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.600+0000 7fa4517fa700 1 -- 172.21.15.2:0/2964240527 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa44800c9d0 con 0x7fa454100da0 2024-09-13T22:57:14.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.601+0000 7fa45a72b700 1 -- 172.21.15.2:0/2964240527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa45419de10 con 0x7fa454100da0 2024-09-13T22:57:14.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.601+0000 7fa4517fa700 1 -- 172.21.15.2:0/2964240527 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa448010430 con 0x7fa454100da0 2024-09-13T22:57:14.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.601+0000 7fa4517fa700 1 -- 172.21.15.2:0/2964240527 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa448018650 con 0x7fa454100da0 2024-09-13T22:57:14.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.601+0000 7fa45a72b700 1 -- 172.21.15.2:0/2964240527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45419e330 con 0x7fa454100da0 2024-09-13T22:57:14.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.602+0000 7fa45a72b700 1 -- 172.21.15.2:0/2964240527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa454108700 con 0x7fa454100da0 2024-09-13T22:57:14.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.602+0000 7fa4517fa700 1 -- 172.21.15.2:0/2964240527 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 30) v1 ==== 92504+0+0 (secure 0 0 0) 0x7fa44800cb30 con 0x7fa454100da0 2024-09-13T22:57:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.603+0000 7fa4517fa700 1 --2- 172.21.15.2:0/2964240527 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fa43c06e430 0x7fa43c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.603+0000 7fa4517fa700 1 -- 172.21.15.2:0/2964240527 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fa448014070 con 0x7fa454100da0 2024-09-13T22:57:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.603+0000 7fa453fff700 1 --2- 172.21.15.2:0/2964240527 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fa43c06e430 0x7fa43c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.604+0000 7fa453fff700 1 --2- 172.21.15.2:0/2964240527 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fa43c06e430 0x7fa43c0708f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa444009fd0 tx=0x7fa444005a90 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:14.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.608+0000 7fa4517fa700 1 -- 172.21.15.2:0/2964240527 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7fa4480539f0 con 0x7fa454100da0 2024-09-13T22:57:14.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.917+0000 7fa45a72b700 1 -- 172.21.15.2:0/2964240527 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa45419e9d0 con 0x7fa43c06e430 2024-09-13T22:57:14.918 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:14 smithi002 ceph-mon[27637]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:14.918 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:14 smithi002 ceph-mon[27637]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:14.918 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:14 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/1914726874' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:57:14.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.918+0000 7fa4517fa700 1 -- 172.21.15.2:0/2964240527 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fa45419e9d0 con 0x7fa43c06e430 2024-09-13T22:57:14.919 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:57:14.919 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:57:14.919 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T22:57:14.919 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T22:57:14.919 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-13T22:57:14.919 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr" 2024-09-13T22:57:14.919 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-13T22:57:14.920 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T22:57:14.920 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "", 2024-09-13T22:57:14.920 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T22:57:14.920 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:57:14.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.920+0000 7fa45a72b700 1 -- 172.21.15.2:0/2964240527 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fa43c06e430 msgr2=0x7fa43c0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.920+0000 7fa45a72b700 1 --2- 172.21.15.2:0/2964240527 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fa43c06e430 0x7fa43c0708f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa444009fd0 tx=0x7fa444005a90 comp rx=0 tx=0).stop 2024-09-13T22:57:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.920+0000 7fa45a72b700 1 -- 172.21.15.2:0/2964240527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa454100da0 msgr2=0x7fa454198c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.920+0000 7fa45a72b700 1 --2- 172.21.15.2:0/2964240527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa454100da0 0x7fa454198c00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa44800e920 tx=0x7fa44800ec30 comp rx=0 tx=0).stop 2024-09-13T22:57:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.920+0000 7fa45a72b700 1 -- 172.21.15.2:0/2964240527 shutdown_connections 2024-09-13T22:57:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.920+0000 7fa45a72b700 1 --2- 172.21.15.2:0/2964240527 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fa43c06e430 0x7fa43c0708f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.920+0000 7fa45a72b700 1 --2- 172.21.15.2:0/2964240527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4540ffba0 0x7fa4541986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.920+0000 7fa45a72b700 1 --2- 172.21.15.2:0/2964240527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa454100da0 0x7fa454198c00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.920+0000 7fa45a72b700 1 -- 172.21.15.2:0/2964240527 >> 172.21.15.2:0/2964240527 conn(0x7fa4540fb120 msgr2=0x7fa454068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.921+0000 7fa45a72b700 1 -- 172.21.15.2:0/2964240527 shutdown_connections 2024-09-13T22:57:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:14.921+0000 7fa45a72b700 1 -- 172.21.15.2:0/2964240527 wait complete. 2024-09-13T22:57:15.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:14 smithi047 ceph-mon[34560]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:15.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:14 smithi047 ceph-mon[34560]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:15.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:14 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/1914726874' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:57:15.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:15 smithi047 ceph-mon[34560]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:15.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:15 smithi047 ceph-mon[34560]: pgmap v15: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 90 op/s 2024-09-13T22:57:15.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:15 smithi002 ceph-mon[27637]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:16.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:15 smithi002 ceph-mon[27637]: pgmap v15: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 90 op/s 2024-09-13T22:57:16.973 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:16 smithi002 ceph-mon[27637]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:17.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:16 smithi047 ceph-mon[34560]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:17.802 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:17 smithi047 ceph-mon[34560]: pgmap v16: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 95 op/s 2024-09-13T22:57:18.134 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:17 smithi002 ceph-mon[27637]: pgmap v16: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 95 op/s 2024-09-13T22:57:18.134 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:17 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:18.134 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:17 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:18.134 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:17 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:57:18.134 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:17 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:57:18.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:17 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:18.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:17 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:18.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:17 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:57:18.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:17 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:57:18.929 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:18 smithi002 ceph-mon[27637]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:57:19.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:18 smithi047 ceph-mon[34560]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:57:19.977 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:19 smithi047 ceph-mon[34560]: pgmap v17: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 129 op/s 2024-09-13T22:57:19.978 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:19 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.gcymvd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:57:19.978 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:19 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:57:19.978 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:19 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:57:20.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:19 smithi002 ceph-mon[27637]: pgmap v17: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 129 op/s 2024-09-13T22:57:20.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:19 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.gcymvd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T22:57:20.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:19 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T22:57:20.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:19 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:57:21.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:20 smithi047 ceph-mon[34560]: Upgrade: Updating mgr.smithi047.gcymvd 2024-09-13T22:57:21.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:20 smithi047 ceph-mon[34560]: Deploying daemon mgr.smithi047.gcymvd on smithi047 2024-09-13T22:57:21.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:20 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:57:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:20 smithi002 ceph-mon[27637]: Upgrade: Updating mgr.smithi047.gcymvd 2024-09-13T22:57:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:20 smithi002 ceph-mon[27637]: Deploying daemon mgr.smithi047.gcymvd on smithi047 2024-09-13T22:57:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:20 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:57:22.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:21 smithi047 ceph-mon[34560]: pgmap v18: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 94 op/s 2024-09-13T22:57:22.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:21 smithi002 ceph-mon[27637]: pgmap v18: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 94 op/s 2024-09-13T22:57:24.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:23 smithi047 ceph-mon[34560]: pgmap v19: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 151 op/s 2024-09-13T22:57:24.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:23 smithi002 ceph-mon[27637]: pgmap v19: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 151 op/s 2024-09-13T22:57:25.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:25 smithi047 ceph-mon[34560]: pgmap v20: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 97 op/s 2024-09-13T22:57:26.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:25 smithi002 ceph-mon[27637]: pgmap v20: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 97 op/s 2024-09-13T22:57:27.072 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:26 smithi047 ceph-mon[34560]: pgmap v21: 65 pgs: 65 active+clean; 302 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 101 op/s 2024-09-13T22:57:27.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:26 smithi002 ceph-mon[27637]: pgmap v21: 65 pgs: 65 active+clean; 302 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 101 op/s 2024-09-13T22:57:28.391 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:28 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:28.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:28 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:28.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:28 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:57:28.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:28 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:28.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:28 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:28.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:28 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:28.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:28 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:28.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:28 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:57:28.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:28 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:28.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:28 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:29.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:29 smithi047 ceph-mon[34560]: pgmap v22: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 136 op/s 2024-09-13T22:57:29.462 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:29 smithi002 ceph-mon[27637]: pgmap v22: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 136 op/s 2024-09-13T22:57:31.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:31 smithi047 ceph-mon[34560]: pgmap v23: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 99 op/s 2024-09-13T22:57:31.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:31 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:31.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:31 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:31.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:31 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:31.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:31 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:31.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:31 smithi002 ceph-mon[27637]: pgmap v23: 65 pgs: 65 active+clean; 304 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 99 op/s 2024-09-13T22:57:31.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:31 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:31.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:31 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:31.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:31 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:31.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:31 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:33.584 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:33 smithi002 ceph-mon[27637]: pgmap v24: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 306 op/s 2024-09-13T22:57:33.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:33 smithi047 ceph-mon[34560]: pgmap v24: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 306 op/s 2024-09-13T22:57:34.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:34 smithi047 ceph-mon[34560]: Standby manager daemon smithi047.gcymvd restarted 2024-09-13T22:57:34.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:34 smithi047 ceph-mon[34560]: Standby manager daemon smithi047.gcymvd started 2024-09-13T22:57:34.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:34 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/2386474256' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/crt"}]: dispatch 2024-09-13T22:57:34.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:34 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/2386474256' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:57:34.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:34 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/2386474256' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/key"}]: dispatch 2024-09-13T22:57:34.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:34 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/2386474256' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:57:34.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:34 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:34.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:34 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:34.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:34 smithi002 ceph-mon[27637]: Standby manager daemon smithi047.gcymvd restarted 2024-09-13T22:57:34.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:34 smithi002 ceph-mon[27637]: Standby manager daemon smithi047.gcymvd started 2024-09-13T22:57:34.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:34 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.47:0/2386474256' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/crt"}]: dispatch 2024-09-13T22:57:34.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:34 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.47:0/2386474256' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T22:57:34.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:34 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.47:0/2386474256' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/key"}]: dispatch 2024-09-13T22:57:34.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:34 smithi002 ceph-mon[27637]: from='mgr.? 172.21.15.47:0/2386474256' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T22:57:34.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:34 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:34.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:34 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:35.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:35 smithi047 ceph-mon[34560]: pgmap v25: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 250 op/s 2024-09-13T22:57:35.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:35 smithi047 ceph-mon[34560]: mgrmap e31: smithi002.yumtzz(active, since 44s), standbys: smithi047.gcymvd 2024-09-13T22:57:35.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:35 smithi002 ceph-mon[27637]: pgmap v25: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 250 op/s 2024-09-13T22:57:35.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:35 smithi002 ceph-mon[27637]: mgrmap e31: smithi002.yumtzz(active, since 44s), standbys: smithi047.gcymvd 2024-09-13T22:57:36.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:36 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:57:36.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:36 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:57:37.651 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:37 smithi002 ceph-mon[27637]: pgmap v26: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 273 op/s 2024-09-13T22:57:37.651 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:37 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:37.651 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:37 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:37.651 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:37 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:57:37.651 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:37 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:57:37.651 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:37 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:37.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:37 smithi047 ceph-mon[34560]: pgmap v26: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 273 op/s 2024-09-13T22:57:37.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:37 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:37.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:37 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:37.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:37 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:57:37.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:37 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:57:37.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:37 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:38.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:57:38.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:57:38.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: Upgrade: Setting container_image for all mgr 2024-09-13T22:57:38.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:38.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi002.yumtzz"}]: dispatch 2024-09-13T22:57:38.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi002.yumtzz"}]': finished 2024-09-13T22:57:38.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi047.gcymvd"}]: dispatch 2024-09-13T22:57:38.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi047.gcymvd"}]': finished 2024-09-13T22:57:38.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:57:38.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: Upgrade: Setting container_image for all rgw 2024-09-13T22:57:38.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:38.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:57:38.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T22:57:38.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:38.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:57:38.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-13T22:57:38.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:38.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:57:38.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: Upgrade: Setting container_image for all iscsi 2024-09-13T22:57:38.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:38.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:57:38.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: Upgrade: Setting container_image for all nfs 2024-09-13T22:57:38.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:38.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:57:38.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: Upgrade: Setting container_image for all nvmeof 2024-09-13T22:57:38.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:38.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:57:38.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:57:38.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: Upgrade: Setting container_image for all mgr 2024-09-13T22:57:38.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:38.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi002.yumtzz"}]: dispatch 2024-09-13T22:57:38.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi002.yumtzz"}]': finished 2024-09-13T22:57:38.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi047.gcymvd"}]: dispatch 2024-09-13T22:57:38.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi047.gcymvd"}]': finished 2024-09-13T22:57:38.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:57:38.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: Upgrade: Setting container_image for all rgw 2024-09-13T22:57:38.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:38.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:57:38.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T22:57:38.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:38.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:57:38.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-13T22:57:38.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:38.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:57:38.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: Upgrade: Setting container_image for all iscsi 2024-09-13T22:57:38.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:38.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:57:38.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: Upgrade: Setting container_image for all nfs 2024-09-13T22:57:38.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:38.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:57:38.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: Upgrade: Setting container_image for all nvmeof 2024-09-13T22:57:38.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:39.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:39 smithi002 ceph-mon[27637]: pgmap v27: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 415 op/s 2024-09-13T22:57:39.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:39 smithi047 ceph-mon[34560]: pgmap v27: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 415 op/s 2024-09-13T22:57:40.569 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:40 smithi002 ceph-mon[27637]: Upgrade: Updating node-exporter.smithi002 (1/2) 2024-09-13T22:57:40.569 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:40 smithi002 ceph-mon[27637]: Deploying daemon node-exporter.smithi002 on smithi002 2024-09-13T22:57:40.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:40 smithi047 ceph-mon[34560]: Upgrade: Updating node-exporter.smithi002 (1/2) 2024-09-13T22:57:40.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:40 smithi047 ceph-mon[34560]: Deploying daemon node-exporter.smithi002 on smithi002 2024-09-13T22:57:41.826 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:41 smithi002 ceph-mon[27637]: pgmap v28: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 377 op/s 2024-09-13T22:57:41.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:41 smithi047 ceph-mon[34560]: pgmap v28: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 377 op/s 2024-09-13T22:57:43.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:43 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:43.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:43 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:43.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:43 smithi047 ceph-mon[34560]: pgmap v29: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 489 op/s 2024-09-13T22:57:43.389 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:43 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:43.389 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:43 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:43.389 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:43 smithi002 ceph-mon[27637]: pgmap v29: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 489 op/s 2024-09-13T22:57:45.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.044+0000 7f70751e3700 1 -- 172.21.15.2:0/2362585942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70700ffc10 msgr2=0x7f7070100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:45.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.044+0000 7f70751e3700 1 --2- 172.21.15.2:0/2362585942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70700ffc10 0x7f7070100030 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7060009910 tx=0x7f7060009c20 comp rx=0 tx=0).stop 2024-09-13T22:57:45.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.045+0000 7f70751e3700 1 -- 172.21.15.2:0/2362585942 shutdown_connections 2024-09-13T22:57:45.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.045+0000 7f70751e3700 1 --2- 172.21.15.2:0/2362585942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7070100e10 0x7f7070101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.045+0000 7f70751e3700 1 --2- 172.21.15.2:0/2362585942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70700ffc10 0x7f7070100030 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.045+0000 7f70751e3700 1 -- 172.21.15.2:0/2362585942 >> 172.21.15.2:0/2362585942 conn(0x7f70700fb190 msgr2=0x7f70700fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:45.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.045+0000 7f70751e3700 1 -- 172.21.15.2:0/2362585942 shutdown_connections 2024-09-13T22:57:45.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.045+0000 7f70751e3700 1 -- 172.21.15.2:0/2362585942 wait complete. 2024-09-13T22:57:45.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.045+0000 7f70751e3700 1 Processor -- start 2024-09-13T22:57:45.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.046+0000 7f70751e3700 1 -- start start 2024-09-13T22:57:45.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.046+0000 7f70751e3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70700ffc10 0x7f70701964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:45.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.046+0000 7f70751e3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7070100e10 0x7f7070196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:45.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.046+0000 7f70751e3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7070197030 con 0x7f70700ffc10 2024-09-13T22:57:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.046+0000 7f70751e3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7070197170 con 0x7f7070100e10 2024-09-13T22:57:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.046+0000 7f706ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70700ffc10 0x7f70701964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.046+0000 7f706ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70700ffc10 0x7f70701964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40670/0 (socket says 172.21.15.2:40670) 2024-09-13T22:57:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.046+0000 7f706ed9d700 1 -- 172.21.15.2:0/3021843308 learned_addr learned my addr 172.21.15.2:0/3021843308 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:57:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.046+0000 7f706e59c700 1 --2- 172.21.15.2:0/3021843308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7070100e10 0x7f7070196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.047+0000 7f706ed9d700 1 -- 172.21.15.2:0/3021843308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7070100e10 msgr2=0x7f7070196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.047+0000 7f706ed9d700 1 --2- 172.21.15.2:0/3021843308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7070100e10 0x7f7070196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.047+0000 7f706ed9d700 1 -- 172.21.15.2:0/3021843308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70600095f0 con 0x7f70700ffc10 2024-09-13T22:57:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.047+0000 7f706ed9d700 1 --2- 172.21.15.2:0/3021843308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70700ffc10 0x7f70701964d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7060000c00 tx=0x7f706000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.047+0000 7f7057fff700 1 -- 172.21.15.2:0/3021843308 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f706001d070 con 0x7f70700ffc10 2024-09-13T22:57:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.047+0000 7f7057fff700 1 -- 172.21.15.2:0/3021843308 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7060005dc0 con 0x7f70700ffc10 2024-09-13T22:57:45.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.047+0000 7f7057fff700 1 -- 172.21.15.2:0/3021843308 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7060022470 con 0x7f70700ffc10 2024-09-13T22:57:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.047+0000 7f70751e3700 1 -- 172.21.15.2:0/3021843308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707019bbc0 con 0x7f70700ffc10 2024-09-13T22:57:45.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.048+0000 7f70751e3700 1 -- 172.21.15.2:0/3021843308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707019c0b0 con 0x7f70700ffc10 2024-09-13T22:57:45.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.049+0000 7f70751e3700 1 -- 172.21.15.2:0/3021843308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7070108700 con 0x7f70700ffc10 2024-09-13T22:57:45.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.050+0000 7f7057fff700 1 -- 172.21.15.2:0/3021843308 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92504+0+0 (secure 0 0 0) 0x7f7060003810 con 0x7f70700ffc10 2024-09-13T22:57:45.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.050+0000 7f7057fff700 1 --2- 172.21.15.2:0/3021843308 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f705806e440 0x7f7058070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:45.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.051+0000 7f7057fff700 1 -- 172.21.15.2:0/3021843308 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f706008f780 con 0x7f70700ffc10 2024-09-13T22:57:45.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.051+0000 7f706e59c700 1 --2- 172.21.15.2:0/3021843308 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f705806e440 0x7f7058070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:45.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.051+0000 7f706e59c700 1 --2- 172.21.15.2:0/3021843308 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f705806e440 0x7f7058070900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7064009c60 tx=0x7f7064009260 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:45.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.056+0000 7f7057fff700 1 -- 172.21.15.2:0/3021843308 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f706005c7e0 con 0x7f70700ffc10 2024-09-13T22:57:45.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.302+0000 7f70751e3700 1 -- 172.21.15.2:0/3021843308 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7070068c90 con 0x7f705806e440 2024-09-13T22:57:45.303 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:45 smithi002 ceph-mon[27637]: pgmap v30: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 282 op/s 2024-09-13T22:57:45.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.303+0000 7f7057fff700 1 -- 172.21.15.2:0/3021843308 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f7070068c90 con 0x7f705806e440 2024-09-13T22:57:45.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.306+0000 7f70751e3700 1 -- 172.21.15.2:0/3021843308 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f705806e440 msgr2=0x7f7058070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:45.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.306+0000 7f70751e3700 1 --2- 172.21.15.2:0/3021843308 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f705806e440 0x7f7058070900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7064009c60 tx=0x7f7064009260 comp rx=0 tx=0).stop 2024-09-13T22:57:45.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.306+0000 7f70751e3700 1 -- 172.21.15.2:0/3021843308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70700ffc10 msgr2=0x7f70701964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:45.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.306+0000 7f70751e3700 1 --2- 172.21.15.2:0/3021843308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70700ffc10 0x7f70701964d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7060000c00 tx=0x7f706000f690 comp rx=0 tx=0).stop 2024-09-13T22:57:45.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.306+0000 7f70751e3700 1 -- 172.21.15.2:0/3021843308 shutdown_connections 2024-09-13T22:57:45.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.306+0000 7f70751e3700 1 --2- 172.21.15.2:0/3021843308 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f705806e440 0x7f7058070900 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.306+0000 7f70751e3700 1 --2- 172.21.15.2:0/3021843308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70700ffc10 0x7f70701964d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.306+0000 7f70751e3700 1 --2- 172.21.15.2:0/3021843308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7070100e10 0x7f7070196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.306+0000 7f70751e3700 1 -- 172.21.15.2:0/3021843308 >> 172.21.15.2:0/3021843308 conn(0x7f70700fb190 msgr2=0x7f7070068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:45.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.306+0000 7f70751e3700 1 -- 172.21.15.2:0/3021843308 shutdown_connections 2024-09-13T22:57:45.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.306+0000 7f70751e3700 1 -- 172.21.15.2:0/3021843308 wait complete. 2024-09-13T22:57:45.318 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T22:57:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.422+0000 7fe0f9e82700 1 -- 172.21.15.2:0/2307166271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0f41040d0 msgr2=0x7fe0f41064c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.422+0000 7fe0f9e82700 1 --2- 172.21.15.2:0/2307166271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0f41040d0 0x7fe0f41064c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009910 tx=0x7fe0e8009c20 comp rx=0 tx=0).stop 2024-09-13T22:57:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.422+0000 7fe0f9e82700 1 -- 172.21.15.2:0/2307166271 shutdown_connections 2024-09-13T22:57:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.422+0000 7fe0f9e82700 1 --2- 172.21.15.2:0/2307166271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0f41040d0 0x7fe0f41064c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.422+0000 7fe0f9e82700 1 --2- 172.21.15.2:0/2307166271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0f41017a0 0x7fe0f4103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.422+0000 7fe0f9e82700 1 -- 172.21.15.2:0/2307166271 >> 172.21.15.2:0/2307166271 conn(0x7fe0f40fb190 msgr2=0x7fe0f40fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.422+0000 7fe0f9e82700 1 -- 172.21.15.2:0/2307166271 shutdown_connections 2024-09-13T22:57:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.423+0000 7fe0f9e82700 1 -- 172.21.15.2:0/2307166271 wait complete. 2024-09-13T22:57:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.423+0000 7fe0f9e82700 1 Processor -- start 2024-09-13T22:57:45.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.423+0000 7fe0f9e82700 1 -- start start 2024-09-13T22:57:45.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.424+0000 7fe0f9e82700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0f41017a0 0x7fe0f4196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:45.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.424+0000 7fe0f9e82700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0f41040d0 0x7fe0f4196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:45.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.424+0000 7fe0f9e82700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4196fb0 con 0x7fe0f41017a0 2024-09-13T22:57:45.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.424+0000 7fe0f9e82700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f41970f0 con 0x7fe0f41040d0 2024-09-13T22:57:45.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.424+0000 7fe0f37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0f41017a0 0x7fe0f4196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:45.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.424+0000 7fe0f37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0f41017a0 0x7fe0f4196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40688/0 (socket says 172.21.15.2:40688) 2024-09-13T22:57:45.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.424+0000 7fe0f37fe700 1 -- 172.21.15.2:0/2244673830 learned_addr learned my addr 172.21.15.2:0/2244673830 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:57:45.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.424+0000 7fe0f2ffd700 1 --2- 172.21.15.2:0/2244673830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0f41040d0 0x7fe0f4196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:45.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.424+0000 7fe0f37fe700 1 -- 172.21.15.2:0/2244673830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0f41040d0 msgr2=0x7fe0f4196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:45.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.424+0000 7fe0f37fe700 1 --2- 172.21.15.2:0/2244673830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0f41040d0 0x7fe0f4196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.424+0000 7fe0f37fe700 1 -- 172.21.15.2:0/2244673830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e80095f0 con 0x7fe0f41017a0 2024-09-13T22:57:45.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.424+0000 7fe0f37fe700 1 --2- 172.21.15.2:0/2244673830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0f41017a0 0x7fe0f4196450 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400d900 tx=0x7fe0e400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:45.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.424+0000 7fe0f0ff9700 1 -- 172.21.15.2:0/2244673830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0e40041f0 con 0x7fe0f41017a0 2024-09-13T22:57:45.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.424+0000 7fe0f9e82700 1 -- 172.21.15.2:0/2244673830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f419bba0 con 0x7fe0f41017a0 2024-09-13T22:57:45.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.425+0000 7fe0f0ff9700 1 -- 172.21.15.2:0/2244673830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe0e4004ce0 con 0x7fe0f41017a0 2024-09-13T22:57:45.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.425+0000 7fe0f0ff9700 1 -- 172.21.15.2:0/2244673830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0e400b750 con 0x7fe0f41017a0 2024-09-13T22:57:45.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.425+0000 7fe0f9e82700 1 -- 172.21.15.2:0/2244673830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f419c0f0 con 0x7fe0f41017a0 2024-09-13T22:57:45.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.426+0000 7fe0f9e82700 1 -- 172.21.15.2:0/2244673830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f4190610 con 0x7fe0f41017a0 2024-09-13T22:57:45.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.426+0000 7fe0f0ff9700 1 -- 172.21.15.2:0/2244673830 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92504+0+0 (secure 0 0 0) 0x7fe0e4004e50 con 0x7fe0f41017a0 2024-09-13T22:57:45.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.427+0000 7fe0f0ff9700 1 --2- 172.21.15.2:0/2244673830 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe0dc06e440 0x7fe0dc070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:45.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.427+0000 7fe0f0ff9700 1 -- 172.21.15.2:0/2244673830 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fe0e408e0f0 con 0x7fe0f41017a0 2024-09-13T22:57:45.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.427+0000 7fe0f2ffd700 1 --2- 172.21.15.2:0/2244673830 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe0dc06e440 0x7fe0dc070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:45.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.427+0000 7fe0f2ffd700 1 --2- 172.21.15.2:0/2244673830 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe0dc06e440 0x7fe0dc070900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe0e800b5c0 tx=0x7fe0e8005ee0 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:45.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.432+0000 7fe0f0ff9700 1 -- 172.21.15.2:0/2244673830 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7fe0e405b150 con 0x7fe0f41017a0 2024-09-13T22:57:45.635 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:45 smithi047 ceph-mon[34560]: pgmap v30: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 282 op/s 2024-09-13T22:57:45.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.684+0000 7fe0f9e82700 1 -- 172.21.15.2:0/2244673830 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0f40611d0 con 0x7fe0dc06e440 2024-09-13T22:57:45.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.685+0000 7fe0f0ff9700 1 -- 172.21.15.2:0/2244673830 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fe0f40611d0 con 0x7fe0dc06e440 2024-09-13T22:57:45.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.687+0000 7fe0f9e82700 1 -- 172.21.15.2:0/2244673830 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe0dc06e440 msgr2=0x7fe0dc070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:45.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.687+0000 7fe0f9e82700 1 --2- 172.21.15.2:0/2244673830 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe0dc06e440 0x7fe0dc070900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe0e800b5c0 tx=0x7fe0e8005ee0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.687+0000 7fe0f9e82700 1 -- 172.21.15.2:0/2244673830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0f41017a0 msgr2=0x7fe0f4196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:45.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.687+0000 7fe0f9e82700 1 --2- 172.21.15.2:0/2244673830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0f41017a0 0x7fe0f4196450 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400d900 tx=0x7fe0e400dc10 comp rx=0 tx=0).stop 2024-09-13T22:57:45.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.687+0000 7fe0f9e82700 1 -- 172.21.15.2:0/2244673830 shutdown_connections 2024-09-13T22:57:45.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.687+0000 7fe0f9e82700 1 --2- 172.21.15.2:0/2244673830 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe0dc06e440 0x7fe0dc070900 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.687+0000 7fe0f9e82700 1 --2- 172.21.15.2:0/2244673830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0f41017a0 0x7fe0f4196450 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.687+0000 7fe0f9e82700 1 --2- 172.21.15.2:0/2244673830 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0f41040d0 0x7fe0f4196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.687+0000 7fe0f9e82700 1 -- 172.21.15.2:0/2244673830 >> 172.21.15.2:0/2244673830 conn(0x7fe0f40fb190 msgr2=0x7fe0f40fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:45.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.687+0000 7fe0f9e82700 1 -- 172.21.15.2:0/2244673830 shutdown_connections 2024-09-13T22:57:45.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.687+0000 7fe0f9e82700 1 -- 172.21.15.2:0/2244673830 wait complete. 2024-09-13T22:57:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.800+0000 7f8e93344700 1 -- 172.21.15.2:0/114654282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e8c0ffbc0 msgr2=0x7f8e8c0fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.800+0000 7f8e93344700 1 --2- 172.21.15.2:0/114654282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e8c0ffbc0 0x7f8e8c0fffe0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009910 tx=0x7f8e88009c20 comp rx=0 tx=0).stop 2024-09-13T22:57:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.801+0000 7f8e93344700 1 -- 172.21.15.2:0/114654282 shutdown_connections 2024-09-13T22:57:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.801+0000 7f8e93344700 1 --2- 172.21.15.2:0/114654282 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e8c100dc0 0x7f8e8c101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.801+0000 7f8e93344700 1 --2- 172.21.15.2:0/114654282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e8c0ffbc0 0x7f8e8c0fffe0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.801+0000 7f8e93344700 1 -- 172.21.15.2:0/114654282 >> 172.21.15.2:0/114654282 conn(0x7f8e8c0fb160 msgr2=0x7f8e8c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.801+0000 7f8e93344700 1 -- 172.21.15.2:0/114654282 shutdown_connections 2024-09-13T22:57:45.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.801+0000 7f8e93344700 1 -- 172.21.15.2:0/114654282 wait complete. 2024-09-13T22:57:45.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.801+0000 7f8e93344700 1 Processor -- start 2024-09-13T22:57:45.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.801+0000 7f8e93344700 1 -- start start 2024-09-13T22:57:45.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.802+0000 7f8e93344700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e8c0ffbc0 0x7f8e8c103b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:45.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.802+0000 7f8e93344700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e8c100dc0 0x7f8e8c1021a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:45.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.802+0000 7f8e93344700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c1026e0 con 0x7f8e8c100dc0 2024-09-13T22:57:45.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.802+0000 7f8e93344700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c102820 con 0x7f8e8c0ffbc0 2024-09-13T22:57:45.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.802+0000 7f8e908df700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e8c100dc0 0x7f8e8c1021a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:45.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.802+0000 7f8e908df700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e8c100dc0 0x7f8e8c1021a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40710/0 (socket says 172.21.15.2:40710) 2024-09-13T22:57:45.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.802+0000 7f8e908df700 1 -- 172.21.15.2:0/291192291 learned_addr learned my addr 172.21.15.2:0/291192291 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:57:45.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.802+0000 7f8e910e0700 1 --2- 172.21.15.2:0/291192291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e8c0ffbc0 0x7f8e8c103b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:45.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.802+0000 7f8e908df700 1 -- 172.21.15.2:0/291192291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e8c0ffbc0 msgr2=0x7f8e8c103b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:45.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.802+0000 7f8e908df700 1 --2- 172.21.15.2:0/291192291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e8c0ffbc0 0x7f8e8c103b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:45.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.802+0000 7f8e908df700 1 -- 172.21.15.2:0/291192291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e880095f0 con 0x7f8e8c100dc0 2024-09-13T22:57:45.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.802+0000 7f8e908df700 1 --2- 172.21.15.2:0/291192291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e8c100dc0 0x7f8e8c1021a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00e920 tx=0x7f8e7c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:45.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.803+0000 7f8e827fc700 1 -- 172.21.15.2:0/291192291 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e7c00c9d0 con 0x7f8e8c100dc0 2024-09-13T22:57:45.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.803+0000 7f8e827fc700 1 -- 172.21.15.2:0/291192291 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8e7c010430 con 0x7f8e8c100dc0 2024-09-13T22:57:45.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.803+0000 7f8e93344700 1 -- 172.21.15.2:0/291192291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8c102b00 con 0x7f8e8c100dc0 2024-09-13T22:57:45.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.803+0000 7f8e827fc700 1 -- 172.21.15.2:0/291192291 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e7c018650 con 0x7f8e8c100dc0 2024-09-13T22:57:45.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.803+0000 7f8e93344700 1 -- 172.21.15.2:0/291192291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8c19e850 con 0x7f8e8c100dc0 2024-09-13T22:57:45.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.804+0000 7f8e93344700 1 -- 172.21.15.2:0/291192291 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8c068af0 con 0x7f8e8c100dc0 2024-09-13T22:57:45.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.805+0000 7f8e827fc700 1 -- 172.21.15.2:0/291192291 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92504+0+0 (secure 0 0 0) 0x7f8e7c0105a0 con 0x7f8e8c100dc0 2024-09-13T22:57:45.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.805+0000 7f8e827fc700 1 --2- 172.21.15.2:0/291192291 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f8e7806e430 0x7f8e780708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:45.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.805+0000 7f8e827fc700 1 -- 172.21.15.2:0/291192291 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f8e7c014070 con 0x7f8e8c100dc0 2024-09-13T22:57:45.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.806+0000 7f8e910e0700 1 --2- 172.21.15.2:0/291192291 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f8e7806e430 0x7f8e780708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:45.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.806+0000 7f8e910e0700 1 --2- 172.21.15.2:0/291192291 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f8e7806e430 0x7f8e780708f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009fd0 tx=0x7f8e88005a90 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:45.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:45.810+0000 7f8e827fc700 1 -- 172.21.15.2:0/291192291 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f8e7c0539f0 con 0x7f8e8c100dc0 2024-09-13T22:57:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.123+0000 7f8e93344700 1 -- 172.21.15.2:0/291192291 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e8c0695e0 con 0x7f8e7806e430 2024-09-13T22:57:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.142+0000 7f8e827fc700 1 -- 172.21.15.2:0/291192291 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f8e8c0695e0 con 0x7f8e7806e430 2024-09-13T22:57:46.143 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:57:46.143 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (8m) 11s ago 9m 26.2M - 0.25.0 c8568f914cd2 76a1576b4f53 2024-09-13T22:57:46.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (10m) 11s ago 10m 7759k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T22:57:46.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (9m) 15s ago 9m 7750k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T22:57:46.144 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (10m) 11s ago 10m 6665k - 18.2.1 5be31c24972a de910e0c5157 2024-09-13T22:57:46.144 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (9m) 15s ago 9m 6651k - 18.2.1 5be31c24972a 9f4bcfa66588 2024-09-13T22:57:46.144 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (8m) 11s ago 9m 84.1M - 9.4.7 954c08fa6188 39f4cfdc98d7 2024-09-13T22:57:46.144 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (4m) 11s ago 4m 14.1M - 18.2.1 5be31c24972a 59e9c88c31ca 2024-09-13T22:57:46.144 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (4m) 11s ago 4m 260M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T22:57:46.144 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (4m) 15s ago 4m 238M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T22:57:46.144 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (4m) 15s ago 4m 17.2M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T22:57:46.144 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 running (66s) 11s ago 11m 490M - 19.1.1-324-gecab7be5 0652ff2b5d78 7a8aa9de37e4 2024-09-13T22:57:46.144 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (19s) 15s ago 9m 66.4M - 19.1.1-324-gecab7be5 0652ff2b5d78 13fa6f3b5a8a 2024-09-13T22:57:46.144 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (11m) 11s ago 11m 51.0M 2048M 18.2.1 5be31c24972a de11be74385d 2024-09-13T22:57:46.144 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (9m) 15s ago 9m 41.0M 2048M 18.2.1 5be31c24972a 5642284a23bf 2024-09-13T22:57:46.144 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 starting - - - - 2024-09-13T22:57:46.144 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (9m) 15s ago 9m 15.7M - 1.5.0 0da6a335fe13 07935c82b1d6 2024-09-13T22:57:46.145 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (8m) 11s ago 8m 183M 1217M 18.2.1 5be31c24972a 1e1f6936c402 2024-09-13T22:57:46.145 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (7m) 11s ago 7m 198M 1217M 18.2.1 5be31c24972a f0ac78c34831 2024-09-13T22:57:46.145 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (7m) 11s ago 7m 166M 1217M 18.2.1 5be31c24972a 9a2f4f6decfb 2024-09-13T22:57:46.145 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (6m) 15s ago 6m 234M 2241M 18.2.1 5be31c24972a fb455cc4c571 2024-09-13T22:57:46.145 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (6m) 15s ago 6m 200M 2241M 18.2.1 5be31c24972a f1bdc2c50535 2024-09-13T22:57:46.145 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (6m) 15s ago 6m 178M 2241M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T22:57:46.145 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (29s) 11s ago 9m 44.1M - 2.43.0 a07b618ecd1d d9642d0fd818 2024-09-13T22:57:46.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.144+0000 7f8e93344700 1 -- 172.21.15.2:0/291192291 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f8e7806e430 msgr2=0x7f8e780708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:46.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.144+0000 7f8e93344700 1 --2- 172.21.15.2:0/291192291 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f8e7806e430 0x7f8e780708f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009fd0 tx=0x7f8e88005a90 comp rx=0 tx=0).stop 2024-09-13T22:57:46.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.144+0000 7f8e93344700 1 -- 172.21.15.2:0/291192291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e8c100dc0 msgr2=0x7f8e8c1021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:46.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.144+0000 7f8e93344700 1 --2- 172.21.15.2:0/291192291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e8c100dc0 0x7f8e8c1021a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00e920 tx=0x7f8e7c00ec30 comp rx=0 tx=0).stop 2024-09-13T22:57:46.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.144+0000 7f8e93344700 1 -- 172.21.15.2:0/291192291 shutdown_connections 2024-09-13T22:57:46.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.144+0000 7f8e93344700 1 --2- 172.21.15.2:0/291192291 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f8e7806e430 0x7f8e780708f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.144+0000 7f8e93344700 1 --2- 172.21.15.2:0/291192291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e8c0ffbc0 0x7f8e8c103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.145+0000 7f8e93344700 1 --2- 172.21.15.2:0/291192291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e8c100dc0 0x7f8e8c1021a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.145+0000 7f8e93344700 1 -- 172.21.15.2:0/291192291 >> 172.21.15.2:0/291192291 conn(0x7f8e8c0fb160 msgr2=0x7f8e8c068e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.145+0000 7f8e93344700 1 -- 172.21.15.2:0/291192291 shutdown_connections 2024-09-13T22:57:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.145+0000 7f8e93344700 1 -- 172.21.15.2:0/291192291 wait complete. 2024-09-13T22:57:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.263+0000 7f4709581700 1 -- 172.21.15.2:0/55728672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4704100ca0 msgr2=0x7f47041010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.263+0000 7f4709581700 1 --2- 172.21.15.2:0/55728672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4704100ca0 0x7f47041010c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009910 tx=0x7f46f4009c20 comp rx=0 tx=0).stop 2024-09-13T22:57:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.263+0000 7f4709581700 1 -- 172.21.15.2:0/55728672 shutdown_connections 2024-09-13T22:57:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.263+0000 7f4709581700 1 --2- 172.21.15.2:0/55728672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4704101ea0 0x7f4704102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.263+0000 7f4709581700 1 --2- 172.21.15.2:0/55728672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4704100ca0 0x7f47041010c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.263+0000 7f4709581700 1 -- 172.21.15.2:0/55728672 >> 172.21.15.2:0/55728672 conn(0x7f47040fc260 msgr2=0x7f47040fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.263+0000 7f4709581700 1 -- 172.21.15.2:0/55728672 shutdown_connections 2024-09-13T22:57:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.263+0000 7f4709581700 1 -- 172.21.15.2:0/55728672 wait complete. 2024-09-13T22:57:46.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.264+0000 7f4709581700 1 Processor -- start 2024-09-13T22:57:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.264+0000 7f4709581700 1 -- start start 2024-09-13T22:57:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.264+0000 7f4709581700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4704100ca0 0x7f4704074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.265+0000 7f4709581700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4704101ea0 0x7f4704073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.265+0000 7f4709581700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47040736c0 con 0x7f4704101ea0 2024-09-13T22:57:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.265+0000 7f4709581700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4704073800 con 0x7f4704100ca0 2024-09-13T22:57:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.265+0000 7f47027fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4704101ea0 0x7f4704073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.265+0000 7f4702ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4704100ca0 0x7f4704074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.265+0000 7f47027fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4704101ea0 0x7f4704073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40724/0 (socket says 172.21.15.2:40724) 2024-09-13T22:57:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.265+0000 7f4702ffd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4704100ca0 0x7f4704074b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.2:41828/0 (socket says 172.21.15.2:41828) 2024-09-13T22:57:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.265+0000 7f47027fc700 1 -- 172.21.15.2:0/3400726802 learned_addr learned my addr 172.21.15.2:0/3400726802 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:57:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.265+0000 7f47027fc700 1 -- 172.21.15.2:0/3400726802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4704100ca0 msgr2=0x7f4704074b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.265+0000 7f47027fc700 1 --2- 172.21.15.2:0/3400726802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4704100ca0 0x7f4704074b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.265+0000 7f47027fc700 1 -- 172.21.15.2:0/3400726802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f40095f0 con 0x7f4704101ea0 2024-09-13T22:57:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.265+0000 7f47027fc700 1 --2- 172.21.15.2:0/3400726802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4704101ea0 0x7f4704073180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f46f800e920 tx=0x7f46f800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.265+0000 7f46ebfff700 1 -- 172.21.15.2:0/3400726802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46f800c9d0 con 0x7f4704101ea0 2024-09-13T22:57:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.265+0000 7f46ebfff700 1 -- 172.21.15.2:0/3400726802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f46f8010430 con 0x7f4704101ea0 2024-09-13T22:57:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.265+0000 7f4709581700 1 -- 172.21.15.2:0/3400726802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4704073ae0 con 0x7f4704101ea0 2024-09-13T22:57:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.265+0000 7f46ebfff700 1 -- 172.21.15.2:0/3400726802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46f8018650 con 0x7f4704101ea0 2024-09-13T22:57:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.266+0000 7f4709581700 1 -- 172.21.15.2:0/3400726802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470419e530 con 0x7f4704101ea0 2024-09-13T22:57:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.266+0000 7f4709581700 1 -- 172.21.15.2:0/3400726802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4704109800 con 0x7f4704101ea0 2024-09-13T22:57:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.267+0000 7f46ebfff700 1 -- 172.21.15.2:0/3400726802 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92504+0+0 (secure 0 0 0) 0x7f46f80105a0 con 0x7f4704101ea0 2024-09-13T22:57:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.267+0000 7f46ebfff700 1 --2- 172.21.15.2:0/3400726802 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f46ec06e440 0x7f46ec070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.268+0000 7f46ebfff700 1 -- 172.21.15.2:0/3400726802 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f46f8014070 con 0x7f4704101ea0 2024-09-13T22:57:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.268+0000 7f4702ffd700 1 --2- 172.21.15.2:0/3400726802 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f46ec06e440 0x7f46ec070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.268+0000 7f4702ffd700 1 --2- 172.21.15.2:0/3400726802 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f46ec06e440 0x7f46ec070900 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f46f400b6f0 tx=0x7f46f4005940 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.273+0000 7f46ebfff700 1 -- 172.21.15.2:0/3400726802 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f46f80539f0 con 0x7f4704101ea0 2024-09-13T22:57:46.281 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:46 smithi047 ceph-mon[34560]: Upgrade: Updating node-exporter.smithi047 (2/2) 2024-09-13T22:57:46.281 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:46 smithi047 ceph-mon[34560]: Deploying daemon node-exporter.smithi047 on smithi047 2024-09-13T22:57:46.281 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:46 smithi047 ceph-mon[34560]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:46.281 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:46 smithi047 ceph-mon[34560]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:46.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:46 smithi002 ceph-mon[27637]: Upgrade: Updating node-exporter.smithi047 (2/2) 2024-09-13T22:57:46.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:46 smithi002 ceph-mon[27637]: Deploying daemon node-exporter.smithi047 on smithi047 2024-09-13T22:57:46.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:46 smithi002 ceph-mon[27637]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:46.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:46 smithi002 ceph-mon[27637]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.586+0000 7f4709581700 1 -- 172.21.15.2:0/3400726802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f47041099f0 con 0x7f4704101ea0 2024-09-13T22:57:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.587+0000 7f46ebfff700 1 -- 172.21.15.2:0/3400726802 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f46f805b610 con 0x7f4704101ea0 2024-09-13T22:57:46.588 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:57:46.588 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T22:57:46.588 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-13T22:57:46.588 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:57:46.588 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T22:57:46.588 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:57:46.588 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:57:46.588 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T22:57:46.589 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-13T22:57:46.589 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:57:46.589 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T22:57:46.589 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-13T22:57:46.589 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:57:46.589 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T22:57:46.589 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-09-13T22:57:46.589 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:57:46.589 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T22:57:46.589 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:57:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.589+0000 7f4709581700 1 -- 172.21.15.2:0/3400726802 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f46ec06e440 msgr2=0x7f46ec070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.589+0000 7f4709581700 1 --2- 172.21.15.2:0/3400726802 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f46ec06e440 0x7f46ec070900 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f46f400b6f0 tx=0x7f46f4005940 comp rx=0 tx=0).stop 2024-09-13T22:57:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.589+0000 7f4709581700 1 -- 172.21.15.2:0/3400726802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4704101ea0 msgr2=0x7f4704073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:46.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.589+0000 7f4709581700 1 --2- 172.21.15.2:0/3400726802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4704101ea0 0x7f4704073180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f46f800e920 tx=0x7f46f800ec30 comp rx=0 tx=0).stop 2024-09-13T22:57:46.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.589+0000 7f4709581700 1 -- 172.21.15.2:0/3400726802 shutdown_connections 2024-09-13T22:57:46.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.589+0000 7f4709581700 1 --2- 172.21.15.2:0/3400726802 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f46ec06e440 0x7f46ec070900 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:46.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.589+0000 7f4709581700 1 --2- 172.21.15.2:0/3400726802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4704100ca0 0x7f4704074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:46.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.589+0000 7f4709581700 1 --2- 172.21.15.2:0/3400726802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4704101ea0 0x7f4704073180 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:46.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.589+0000 7f4709581700 1 -- 172.21.15.2:0/3400726802 >> 172.21.15.2:0/3400726802 conn(0x7f47040fc260 msgr2=0x7f47041050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:46.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.590+0000 7f4709581700 1 -- 172.21.15.2:0/3400726802 shutdown_connections 2024-09-13T22:57:46.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.590+0000 7f4709581700 1 -- 172.21.15.2:0/3400726802 wait complete. 2024-09-13T22:57:46.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.707+0000 7f27d0f6c700 1 -- 172.21.15.2:0/3082942234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27cc104070 msgr2=0x7f27cc106460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:46.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.707+0000 7f27d0f6c700 1 --2- 172.21.15.2:0/3082942234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27cc104070 0x7f27cc106460 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009910 tx=0x7f27b4009c20 comp rx=0 tx=0).stop 2024-09-13T22:57:46.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.707+0000 7f27d0f6c700 1 -- 172.21.15.2:0/3082942234 shutdown_connections 2024-09-13T22:57:46.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.707+0000 7f27d0f6c700 1 --2- 172.21.15.2:0/3082942234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27cc104070 0x7f27cc106460 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:46.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.707+0000 7f27d0f6c700 1 --2- 172.21.15.2:0/3082942234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27cc101740 0x7f27cc103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:46.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.707+0000 7f27d0f6c700 1 -- 172.21.15.2:0/3082942234 >> 172.21.15.2:0/3082942234 conn(0x7f27cc0fb150 msgr2=0x7f27cc0fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:46.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.707+0000 7f27d0f6c700 1 -- 172.21.15.2:0/3082942234 shutdown_connections 2024-09-13T22:57:46.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.707+0000 7f27d0f6c700 1 -- 172.21.15.2:0/3082942234 wait complete. 2024-09-13T22:57:46.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.708+0000 7f27d0f6c700 1 Processor -- start 2024-09-13T22:57:46.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.708+0000 7f27d0f6c700 1 -- start start 2024-09-13T22:57:46.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.708+0000 7f27d0f6c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27cc101740 0x7f27cc196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.708+0000 7f27d0f6c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27cc104070 0x7f27cc1969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.708+0000 7f27d0f6c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc196fc0 con 0x7f27cc104070 2024-09-13T22:57:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.708+0000 7f27d0f6c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc197100 con 0x7f27cc101740 2024-09-13T22:57:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.708+0000 7f27c9d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27cc104070 0x7f27cc1969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.708+0000 7f27c9d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27cc104070 0x7f27cc1969a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40748/0 (socket says 172.21.15.2:40748) 2024-09-13T22:57:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.708+0000 7f27c9d9b700 1 -- 172.21.15.2:0/1543153784 learned_addr learned my addr 172.21.15.2:0/1543153784 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:57:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.708+0000 7f27ca59c700 1 --2- 172.21.15.2:0/1543153784 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27cc101740 0x7f27cc196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.708+0000 7f27c9d9b700 1 -- 172.21.15.2:0/1543153784 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27cc101740 msgr2=0x7f27cc196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.708+0000 7f27c9d9b700 1 --2- 172.21.15.2:0/1543153784 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27cc101740 0x7f27cc196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:46.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.708+0000 7f27c9d9b700 1 -- 172.21.15.2:0/1543153784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b40095f0 con 0x7f27cc104070 2024-09-13T22:57:46.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.709+0000 7f27c9d9b700 1 --2- 172.21.15.2:0/1543153784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27cc104070 0x7f27cc1969a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f27b4000c00 tx=0x7f27b400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:46.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.709+0000 7f27c37fe700 1 -- 172.21.15.2:0/1543153784 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27b401d070 con 0x7f27cc104070 2024-09-13T22:57:46.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.709+0000 7f27c37fe700 1 -- 172.21.15.2:0/1543153784 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f27b4005dc0 con 0x7f27cc104070 2024-09-13T22:57:46.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.709+0000 7f27d0f6c700 1 -- 172.21.15.2:0/1543153784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27cc19bb50 con 0x7f27cc104070 2024-09-13T22:57:46.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.709+0000 7f27c37fe700 1 -- 172.21.15.2:0/1543153784 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27b40226a0 con 0x7f27cc104070 2024-09-13T22:57:46.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.709+0000 7f27d0f6c700 1 -- 172.21.15.2:0/1543153784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27cc19c040 con 0x7f27cc104070 2024-09-13T22:57:46.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.710+0000 7f27d0f6c700 1 -- 172.21.15.2:0/1543153784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27cc190620 con 0x7f27cc104070 2024-09-13T22:57:46.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.711+0000 7f27c37fe700 1 -- 172.21.15.2:0/1543153784 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92504+0+0 (secure 0 0 0) 0x7f27b40038f0 con 0x7f27cc104070 2024-09-13T22:57:46.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.711+0000 7f27c37fe700 1 --2- 172.21.15.2:0/1543153784 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f27b806e440 0x7f27b8070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:57:46.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.711+0000 7f27c37fe700 1 -- 172.21.15.2:0/1543153784 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f27b408f7f0 con 0x7f27cc104070 2024-09-13T22:57:46.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.711+0000 7f27ca59c700 1 --2- 172.21.15.2:0/1543153784 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f27b806e440 0x7f27b8070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:57:46.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.712+0000 7f27ca59c700 1 --2- 172.21.15.2:0/1543153784 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f27b806e440 0x7f27b8070900 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f27bc009c60 tx=0x7f27bc009260 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:57:46.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:46.716+0000 7f27c37fe700 1 -- 172.21.15.2:0/1543153784 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f27b405c7d0 con 0x7f27cc104070 2024-09-13T22:57:47.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:47.009+0000 7f27d0f6c700 1 -- 172.21.15.2:0/1543153784 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f27cc0611d0 con 0x7f27b806e440 2024-09-13T22:57:47.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:47.010+0000 7f27c37fe700 1 -- 172.21.15.2:0/1543153784 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f27cc0611d0 con 0x7f27b806e440 2024-09-13T22:57:47.012 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:57:47.013 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:57:47.013 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T22:57:47.013 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T22:57:47.013 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-13T22:57:47.013 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr" 2024-09-13T22:57:47.013 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-13T22:57:47.013 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T22:57:47.013 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-13T22:57:47.013 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T22:57:47.013 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:57:47.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:47.012+0000 7f27d0f6c700 1 -- 172.21.15.2:0/1543153784 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f27b806e440 msgr2=0x7f27b8070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:47.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:47.012+0000 7f27d0f6c700 1 --2- 172.21.15.2:0/1543153784 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f27b806e440 0x7f27b8070900 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f27bc009c60 tx=0x7f27bc009260 comp rx=0 tx=0).stop 2024-09-13T22:57:47.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:47.012+0000 7f27d0f6c700 1 -- 172.21.15.2:0/1543153784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27cc104070 msgr2=0x7f27cc1969a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:57:47.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:47.012+0000 7f27d0f6c700 1 --2- 172.21.15.2:0/1543153784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27cc104070 0x7f27cc1969a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f27b4000c00 tx=0x7f27b400f690 comp rx=0 tx=0).stop 2024-09-13T22:57:47.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:47.013+0000 7f27d0f6c700 1 -- 172.21.15.2:0/1543153784 shutdown_connections 2024-09-13T22:57:47.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:47.013+0000 7f27d0f6c700 1 --2- 172.21.15.2:0/1543153784 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f27b806e440 0x7f27b8070900 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:47.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:47.013+0000 7f27d0f6c700 1 --2- 172.21.15.2:0/1543153784 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27cc101740 0x7f27cc196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:47.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:47.013+0000 7f27d0f6c700 1 --2- 172.21.15.2:0/1543153784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27cc104070 0x7f27cc1969a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:57:47.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:47.013+0000 7f27d0f6c700 1 -- 172.21.15.2:0/1543153784 >> 172.21.15.2:0/1543153784 conn(0x7f27cc0fb150 msgr2=0x7f27cc0fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:57:47.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:47.013+0000 7f27d0f6c700 1 -- 172.21.15.2:0/1543153784 shutdown_connections 2024-09-13T22:57:47.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:57:47.013+0000 7f27d0f6c700 1 -- 172.21.15.2:0/1543153784 wait complete. 2024-09-13T22:57:47.349 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:47 smithi047 ceph-mon[34560]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:47.349 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:47 smithi047 ceph-mon[34560]: pgmap v31: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 287 op/s 2024-09-13T22:57:47.349 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:47 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/3400726802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:57:47.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:47 smithi002 ceph-mon[27637]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:47 smithi002 ceph-mon[27637]: pgmap v31: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 287 op/s 2024-09-13T22:57:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:47 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/3400726802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:57:49.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:48 smithi047 ceph-mon[34560]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:49.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:48 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:49.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:48 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:49.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:48 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:57:49.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:48 smithi002 ceph-mon[27637]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:57:49.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:48 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:49.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:48 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:49.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:48 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:57:50.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:49 smithi002 ceph-mon[27637]: pgmap v32: 65 pgs: 65 active+clean; 297 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 324 op/s 2024-09-13T22:57:50.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:49 smithi047 ceph-mon[34560]: pgmap v32: 65 pgs: 65 active+clean; 297 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 324 op/s 2024-09-13T22:57:50.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:50 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:57:51.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:50 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:57:52.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:51 smithi047 ceph-mon[34560]: pgmap v33: 65 pgs: 65 active+clean; 297 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-09-13T22:57:52.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:51 smithi002 ceph-mon[27637]: pgmap v33: 65 pgs: 65 active+clean; 297 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-09-13T22:57:54.146 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:53 smithi002 ceph-mon[27637]: pgmap v34: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 259 op/s 2024-09-13T22:57:54.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:53 smithi047 ceph-mon[34560]: pgmap v34: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 259 op/s 2024-09-13T22:57:55.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:55 smithi002 ceph-mon[27637]: pgmap v35: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 147 op/s 2024-09-13T22:57:56.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:55 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:56.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:55 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:56.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:55 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:56.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:55 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:56.042 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:55 smithi047 ceph-mon[34560]: pgmap v35: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 147 op/s 2024-09-13T22:57:56.042 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:55 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:56.042 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:55 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:56.042 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:55 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:56.042 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:55 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:57.587 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:57 smithi002 ceph-mon[27637]: pgmap v36: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 159 op/s 2024-09-13T22:57:57.587 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:57 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:57.587 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:57 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:57.587 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:57 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:57.587 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:57 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:57.637 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:57 smithi047 ceph-mon[34560]: pgmap v36: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 159 op/s 2024-09-13T22:57:57.637 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:57 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:57.637 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:57 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:57.637 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:57 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:57.637 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:57 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:59.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:59 smithi002 ceph-mon[27637]: pgmap v37: 65 pgs: 65 active+clean; 277 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 236 op/s 2024-09-13T22:57:59.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:59 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:59.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:57:59 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:59.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:59 smithi047 ceph-mon[34560]: pgmap v37: 65 pgs: 65 active+clean; 277 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 236 op/s 2024-09-13T22:57:59.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:59 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:57:59.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:57:59 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:01.324 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-13T22:58:01.324 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-13T22:58:01.570 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:01 smithi047 ceph-mon[34560]: pgmap v38: 65 pgs: 65 active+clean; 277 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 177 op/s 2024-09-13T22:58:01.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:01 smithi002 ceph-mon[27637]: pgmap v38: 65 pgs: 65 active+clean; 277 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 177 op/s 2024-09-13T22:58:01.770 DEBUG:teuthology.parallel:result is None 2024-09-13T22:58:03.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:03 smithi047 ceph-mon[34560]: pgmap v39: 65 pgs: 65 active+clean; 273 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 270 op/s 2024-09-13T22:58:03.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:03 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:03.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:03 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:03.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:03 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:58:03.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:03 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:58:03.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:03 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:03.595 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:03 smithi002 ceph-mon[27637]: pgmap v39: 65 pgs: 65 active+clean; 273 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 270 op/s 2024-09-13T22:58:03.595 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:03 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:03.596 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:03 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:03.596 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:03 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:58:03.596 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:03 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:58:03.596 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:03 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:03.688 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-13T22:58:03.688 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T22:58:04.099 DEBUG:teuthology.parallel:result is None 2024-09-13T22:58:04.100 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T22:58:04.134 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T22:58:04.134 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T22:58:04.168 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T22:58:04.169 DEBUG:teuthology.parallel:result is None 2024-09-13T22:58:04.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:04 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:58:04.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:04 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:04.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:04 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:04.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:04 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:04.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:04 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:04.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:04 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:04.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:04 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:04.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:04 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:04.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:04 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:04.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:04 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:58:04.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:04 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:04.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:04 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:04.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:04 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:04.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:04 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:04.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:04 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:04.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:04 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:04.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:04 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:04.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:04 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:05.551 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:05 smithi002 ceph-mon[27637]: pgmap v40: 65 pgs: 65 active+clean; 273 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 972 KiB/s rd, 1.1 MiB/s wr, 188 op/s 2024-09-13T22:58:05.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:05 smithi047 ceph-mon[34560]: pgmap v40: 65 pgs: 65 active+clean; 273 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 972 KiB/s rd, 1.1 MiB/s wr, 188 op/s 2024-09-13T22:58:06.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:06 smithi047 ceph-mon[34560]: Upgrade: Updating prometheus.smithi002 2024-09-13T22:58:06.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:06 smithi047 ceph-mon[34560]: Deploying daemon prometheus.smithi002 on smithi002 2024-09-13T22:58:06.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:06 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:58:06.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:06 smithi002 ceph-mon[27637]: Upgrade: Updating prometheus.smithi002 2024-09-13T22:58:06.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:06 smithi002 ceph-mon[27637]: Deploying daemon prometheus.smithi002 on smithi002 2024-09-13T22:58:06.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:06 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:58:07.384 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:07 smithi002 ceph-mon[27637]: pgmap v41: 65 pgs: 65 active+clean; 268 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 209 op/s 2024-09-13T22:58:07.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:07 smithi047 ceph-mon[34560]: pgmap v41: 65 pgs: 65 active+clean; 268 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 209 op/s 2024-09-13T22:58:09.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:09 smithi002 ceph-mon[27637]: pgmap v42: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 238 op/s 2024-09-13T22:58:09.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:09 smithi047 ceph-mon[34560]: pgmap v42: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 238 op/s 2024-09-13T22:58:11.869 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:11 smithi047 ceph-mon[34560]: pgmap v43: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 KiB/s rd, 840 KiB/s wr, 156 op/s 2024-09-13T22:58:11.869 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:11 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:11.869 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:11 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:11.869 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:11 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:58:11.972 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:11 smithi002 ceph-mon[27637]: pgmap v43: 65 pgs: 65 active+clean; 257 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 KiB/s rd, 840 KiB/s wr, 156 op/s 2024-09-13T22:58:11.972 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:11 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:11.972 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:11 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:11.972 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:11 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:58:13.769 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:13 smithi002 ceph-mon[27637]: pgmap v44: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 889 KiB/s rd, 876 KiB/s wr, 158 op/s 2024-09-13T22:58:13.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:13 smithi047 ceph-mon[34560]: pgmap v44: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 889 KiB/s rd, 876 KiB/s wr, 158 op/s 2024-09-13T22:58:15.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:15 smithi047 ceph-mon[34560]: pgmap v45: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 445 KiB/s rd, 321 KiB/s wr, 65 op/s 2024-09-13T22:58:15.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:15 smithi002 ceph-mon[27637]: pgmap v45: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 445 KiB/s rd, 321 KiB/s wr, 65 op/s 2024-09-13T22:58:16.990 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:16 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:16.990 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:16 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:16.990 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:16 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:16.990 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:16 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:17.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.125+0000 7f98fc9d0700 1 -- 172.21.15.2:0/2541567593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f80fef60 msgr2=0x7f98f80ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:17.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.125+0000 7f98fc9d0700 1 --2- 172.21.15.2:0/2541567593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f80fef60 0x7f98f80ff380 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009910 tx=0x7f98e8009c20 comp rx=0 tx=0).stop 2024-09-13T22:58:17.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.125+0000 7f98fc9d0700 1 -- 172.21.15.2:0/2541567593 shutdown_connections 2024-09-13T22:58:17.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.125+0000 7f98fc9d0700 1 --2- 172.21.15.2:0/2541567593 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98f8101f40 0x7f98f81023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:17.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.125+0000 7f98fc9d0700 1 --2- 172.21.15.2:0/2541567593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f80fef60 0x7f98f80ff380 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:17.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.125+0000 7f98fc9d0700 1 -- 172.21.15.2:0/2541567593 >> 172.21.15.2:0/2541567593 conn(0x7f98f80fa8c0 msgr2=0x7f98f80fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:17.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.125+0000 7f98fc9d0700 1 -- 172.21.15.2:0/2541567593 shutdown_connections 2024-09-13T22:58:17.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.125+0000 7f98fc9d0700 1 -- 172.21.15.2:0/2541567593 wait complete. 2024-09-13T22:58:17.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.126+0000 7f98fc9d0700 1 Processor -- start 2024-09-13T22:58:17.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.126+0000 7f98fc9d0700 1 -- start start 2024-09-13T22:58:17.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.126+0000 7f98fc9d0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f80fef60 0x7f98f8198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:17.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.126+0000 7f98fc9d0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98f8101f40 0x7f98f8198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:17.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.126+0000 7f98fc9d0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f81992c0 con 0x7f98f80fef60 2024-09-13T22:58:17.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.126+0000 7f98fc9d0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f8199400 con 0x7f98f8101f40 2024-09-13T22:58:17.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.126+0000 7f98f659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f80fef60 0x7f98f8198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:17.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.126+0000 7f98f659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f80fef60 0x7f98f8198760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60876/0 (socket says 172.21.15.2:60876) 2024-09-13T22:58:17.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.126+0000 7f98f659c700 1 -- 172.21.15.2:0/488333302 learned_addr learned my addr 172.21.15.2:0/488333302 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:58:17.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.127+0000 7f98f5d9b700 1 --2- 172.21.15.2:0/488333302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98f8101f40 0x7f98f8198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:17.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.127+0000 7f98f659c700 1 -- 172.21.15.2:0/488333302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98f8101f40 msgr2=0x7f98f8198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:17.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.127+0000 7f98f659c700 1 --2- 172.21.15.2:0/488333302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98f8101f40 0x7f98f8198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:17.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.127+0000 7f98f659c700 1 -- 172.21.15.2:0/488333302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e80095f0 con 0x7f98f80fef60 2024-09-13T22:58:17.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.127+0000 7f98f5d9b700 1 --2- 172.21.15.2:0/488333302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98f8101f40 0x7f98f8198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:58:17.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.127+0000 7f98f659c700 1 --2- 172.21.15.2:0/488333302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f80fef60 0x7f98f8198760 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f98e800bda0 tx=0x7f98e800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:17.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.127+0000 7f98e77fe700 1 -- 172.21.15.2:0/488333302 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98e801d070 con 0x7f98f80fef60 2024-09-13T22:58:17.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.127+0000 7f98fc9d0700 1 -- 172.21.15.2:0/488333302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f819de50 con 0x7f98f80fef60 2024-09-13T22:58:17.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.127+0000 7f98e77fe700 1 -- 172.21.15.2:0/488333302 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f98e8004c50 con 0x7f98f80fef60 2024-09-13T22:58:17.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.127+0000 7f98e77fe700 1 -- 172.21.15.2:0/488333302 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98e800f690 con 0x7f98f80fef60 2024-09-13T22:58:17.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.127+0000 7f98fc9d0700 1 -- 172.21.15.2:0/488333302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f819e2c0 con 0x7f98f80fef60 2024-09-13T22:58:17.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.128+0000 7f98fc9d0700 1 -- 172.21.15.2:0/488333302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f8106020 con 0x7f98f80fef60 2024-09-13T22:58:17.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.129+0000 7f98e77fe700 1 -- 172.21.15.2:0/488333302 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92504+0+0 (secure 0 0 0) 0x7f98e80229b0 con 0x7f98f80fef60 2024-09-13T22:58:17.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.129+0000 7f98e77fe700 1 --2- 172.21.15.2:0/488333302 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f98e006e440 0x7f98e0070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:17.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.129+0000 7f98e77fe700 1 -- 172.21.15.2:0/488333302 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f98e808faa0 con 0x7f98f80fef60 2024-09-13T22:58:17.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.129+0000 7f98f5d9b700 1 --2- 172.21.15.2:0/488333302 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f98e006e440 0x7f98e0070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:17.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.130+0000 7f98f5d9b700 1 --2- 172.21.15.2:0/488333302 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f98e006e440 0x7f98e0070900 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f98ec0099d0 tx=0x7f98ec008040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:17.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.134+0000 7f98e77fe700 1 -- 172.21.15.2:0/488333302 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f98e805cb00 con 0x7f98f80fef60 2024-09-13T22:58:17.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:16 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:17.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:16 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:17.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:16 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:17.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:16 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:17.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.364+0000 7f98fc9d0700 1 -- 172.21.15.2:0/488333302 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98f80611d0 con 0x7f98e006e440 2024-09-13T22:58:17.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.365+0000 7f98e77fe700 1 -- 172.21.15.2:0/488333302 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f98f80611d0 con 0x7f98e006e440 2024-09-13T22:58:17.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.367+0000 7f98fc9d0700 1 -- 172.21.15.2:0/488333302 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f98e006e440 msgr2=0x7f98e0070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:17.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.367+0000 7f98fc9d0700 1 --2- 172.21.15.2:0/488333302 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f98e006e440 0x7f98e0070900 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f98ec0099d0 tx=0x7f98ec008040 comp rx=0 tx=0).stop 2024-09-13T22:58:17.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.367+0000 7f98fc9d0700 1 -- 172.21.15.2:0/488333302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f80fef60 msgr2=0x7f98f8198760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.367+0000 7f98fc9d0700 1 --2- 172.21.15.2:0/488333302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f80fef60 0x7f98f8198760 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f98e800bda0 tx=0x7f98e800be80 comp rx=0 tx=0).stop 2024-09-13T22:58:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.367+0000 7f98fc9d0700 1 -- 172.21.15.2:0/488333302 shutdown_connections 2024-09-13T22:58:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.367+0000 7f98fc9d0700 1 --2- 172.21.15.2:0/488333302 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f98e006e440 0x7f98e0070900 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.367+0000 7f98fc9d0700 1 --2- 172.21.15.2:0/488333302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f80fef60 0x7f98f8198760 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.367+0000 7f98fc9d0700 1 --2- 172.21.15.2:0/488333302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98f8101f40 0x7f98f8198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.367+0000 7f98fc9d0700 1 -- 172.21.15.2:0/488333302 >> 172.21.15.2:0/488333302 conn(0x7f98f80fa8c0 msgr2=0x7f98f8103160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.368+0000 7f98fc9d0700 1 -- 172.21.15.2:0/488333302 shutdown_connections 2024-09-13T22:58:17.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.368+0000 7f98fc9d0700 1 -- 172.21.15.2:0/488333302 wait complete. 2024-09-13T22:58:17.379 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T22:58:17.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.477+0000 7f0279d06700 1 -- 172.21.15.2:0/1793925853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02740ffe30 msgr2=0x7f0274100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.477+0000 7f0279d06700 1 --2- 172.21.15.2:0/1793925853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02740ffe30 0x7f0274100290 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0268009910 tx=0x7f0268009c20 comp rx=0 tx=0).stop 2024-09-13T22:58:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.477+0000 7f0279d06700 1 -- 172.21.15.2:0/1793925853 shutdown_connections 2024-09-13T22:58:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.477+0000 7f0279d06700 1 --2- 172.21.15.2:0/1793925853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02740ffe30 0x7f0274100290 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.477+0000 7f0279d06700 1 --2- 172.21.15.2:0/1793925853 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0274101180 0x7f02741015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.477+0000 7f0279d06700 1 -- 172.21.15.2:0/1793925853 >> 172.21.15.2:0/1793925853 conn(0x7f02740fa8c0 msgr2=0x7f02740fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.477+0000 7f0279d06700 1 -- 172.21.15.2:0/1793925853 shutdown_connections 2024-09-13T22:58:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.477+0000 7f0279d06700 1 -- 172.21.15.2:0/1793925853 wait complete. 2024-09-13T22:58:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.477+0000 7f0279d06700 1 Processor -- start 2024-09-13T22:58:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.478+0000 7f0279d06700 1 -- start start 2024-09-13T22:58:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.478+0000 7f0279d06700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02740ffe30 0x7f02741964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.478+0000 7f0279d06700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0274101180 0x7f0274196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.478+0000 7f0279d06700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0274197020 con 0x7f0274101180 2024-09-13T22:58:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.478+0000 7f0279d06700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0274197160 con 0x7f02740ffe30 2024-09-13T22:58:17.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.478+0000 7f0272ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0274101180 0x7f0274196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:17.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.478+0000 7f0272ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0274101180 0x7f0274196a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60896/0 (socket says 172.21.15.2:60896) 2024-09-13T22:58:17.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.478+0000 7f0272ffd700 1 -- 172.21.15.2:0/3423113839 learned_addr learned my addr 172.21.15.2:0/3423113839 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:58:17.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.478+0000 7f02737fe700 1 --2- 172.21.15.2:0/3423113839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02740ffe30 0x7f02741964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:17.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.478+0000 7f0272ffd700 1 -- 172.21.15.2:0/3423113839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02740ffe30 msgr2=0x7f02741964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:17.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.478+0000 7f0272ffd700 1 --2- 172.21.15.2:0/3423113839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02740ffe30 0x7f02741964c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:17.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.478+0000 7f0272ffd700 1 -- 172.21.15.2:0/3423113839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02680095f0 con 0x7f0274101180 2024-09-13T22:58:17.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.478+0000 7f0272ffd700 1 --2- 172.21.15.2:0/3423113839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0274101180 0x7f0274196a00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f026800b5c0 tx=0x7f026800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:17.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.479+0000 7f0270ff9700 1 -- 172.21.15.2:0/3423113839 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f026801d070 con 0x7f0274101180 2024-09-13T22:58:17.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.479+0000 7f0270ff9700 1 -- 172.21.15.2:0/3423113839 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f026800f460 con 0x7f0274101180 2024-09-13T22:58:17.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.479+0000 7f0279d06700 1 -- 172.21.15.2:0/3423113839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027419bbb0 con 0x7f0274101180 2024-09-13T22:58:17.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.479+0000 7f0270ff9700 1 -- 172.21.15.2:0/3423113839 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0268021640 con 0x7f0274101180 2024-09-13T22:58:17.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.479+0000 7f0279d06700 1 -- 172.21.15.2:0/3423113839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027419c0a0 con 0x7f0274101180 2024-09-13T22:58:17.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.480+0000 7f0279d06700 1 -- 172.21.15.2:0/3423113839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0274108700 con 0x7f0274101180 2024-09-13T22:58:17.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.480+0000 7f0270ff9700 1 -- 172.21.15.2:0/3423113839 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92504+0+0 (secure 0 0 0) 0x7f026800fa60 con 0x7f0274101180 2024-09-13T22:58:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.481+0000 7f0270ff9700 1 --2- 172.21.15.2:0/3423113839 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f025c06e430 0x7f025c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.481+0000 7f0270ff9700 1 -- 172.21.15.2:0/3423113839 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f026808f4a0 con 0x7f0274101180 2024-09-13T22:58:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.481+0000 7f02737fe700 1 --2- 172.21.15.2:0/3423113839 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f025c06e430 0x7f025c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.481+0000 7f02737fe700 1 --2- 172.21.15.2:0/3423113839 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f025c06e430 0x7f025c0708f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0274068bd0 tx=0x7f026400b410 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:17.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.486+0000 7f0270ff9700 1 -- 172.21.15.2:0/3423113839 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f026805c500 con 0x7f0274101180 2024-09-13T22:58:17.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.715+0000 7f0279d06700 1 -- 172.21.15.2:0/3423113839 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02740ff430 con 0x7f025c06e430 2024-09-13T22:58:17.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.716+0000 7f0270ff9700 1 -- 172.21.15.2:0/3423113839 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f02740ff430 con 0x7f025c06e430 2024-09-13T22:58:17.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.718+0000 7f0279d06700 1 -- 172.21.15.2:0/3423113839 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f025c06e430 msgr2=0x7f025c0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:17.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.718+0000 7f0279d06700 1 --2- 172.21.15.2:0/3423113839 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f025c06e430 0x7f025c0708f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0274068bd0 tx=0x7f026400b410 comp rx=0 tx=0).stop 2024-09-13T22:58:17.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.718+0000 7f0279d06700 1 -- 172.21.15.2:0/3423113839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0274101180 msgr2=0x7f0274196a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:17.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.718+0000 7f0279d06700 1 --2- 172.21.15.2:0/3423113839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0274101180 0x7f0274196a00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f026800b5c0 tx=0x7f026800bd70 comp rx=0 tx=0).stop 2024-09-13T22:58:17.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.718+0000 7f0279d06700 1 -- 172.21.15.2:0/3423113839 shutdown_connections 2024-09-13T22:58:17.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.718+0000 7f0279d06700 1 --2- 172.21.15.2:0/3423113839 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f025c06e430 0x7f025c0708f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:17.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.718+0000 7f0279d06700 1 --2- 172.21.15.2:0/3423113839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02740ffe30 0x7f02741964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:17.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.718+0000 7f0279d06700 1 --2- 172.21.15.2:0/3423113839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0274101180 0x7f0274196a00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:17.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.718+0000 7f0279d06700 1 -- 172.21.15.2:0/3423113839 >> 172.21.15.2:0/3423113839 conn(0x7f02740fa8c0 msgr2=0x7f02740fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:17.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.718+0000 7f0279d06700 1 -- 172.21.15.2:0/3423113839 shutdown_connections 2024-09-13T22:58:17.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.719+0000 7f0279d06700 1 -- 172.21.15.2:0/3423113839 wait complete. 2024-09-13T22:58:17.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.828+0000 7f18c029e700 1 -- 172.21.15.2:0/3614610503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b8100cb0 msgr2=0x7f18b81010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:17.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.828+0000 7f18c029e700 1 --2- 172.21.15.2:0/3614610503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b8100cb0 0x7f18b81010d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f18b4009910 tx=0x7f18b4009c20 comp rx=0 tx=0).stop 2024-09-13T22:58:17.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.828+0000 7f18c029e700 1 -- 172.21.15.2:0/3614610503 shutdown_connections 2024-09-13T22:58:17.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.828+0000 7f18c029e700 1 --2- 172.21.15.2:0/3614610503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18b8101eb0 0x7f18b8102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:17.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.828+0000 7f18c029e700 1 --2- 172.21.15.2:0/3614610503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b8100cb0 0x7f18b81010d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:17.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.828+0000 7f18c029e700 1 -- 172.21.15.2:0/3614610503 >> 172.21.15.2:0/3614610503 conn(0x7f18b80fc230 msgr2=0x7f18b80fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:17.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.828+0000 7f18c029e700 1 -- 172.21.15.2:0/3614610503 shutdown_connections 2024-09-13T22:58:17.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.828+0000 7f18c029e700 1 -- 172.21.15.2:0/3614610503 wait complete. 2024-09-13T22:58:17.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.828+0000 7f18c029e700 1 Processor -- start 2024-09-13T22:58:17.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.829+0000 7f18c029e700 1 -- start start 2024-09-13T22:58:17.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.829+0000 7f18c029e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b8100cb0 0x7f18b81964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:17.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.829+0000 7f18c029e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18b8101eb0 0x7f18b8196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:17.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.829+0000 7f18c029e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b8197020 con 0x7f18b8100cb0 2024-09-13T22:58:17.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.829+0000 7f18c029e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b8197160 con 0x7f18b8101eb0 2024-09-13T22:58:17.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.829+0000 7f18be03a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b8100cb0 0x7f18b81964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:17.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.829+0000 7f18be03a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b8100cb0 0x7f18b81964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60914/0 (socket says 172.21.15.2:60914) 2024-09-13T22:58:17.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.829+0000 7f18be03a700 1 -- 172.21.15.2:0/472147969 learned_addr learned my addr 172.21.15.2:0/472147969 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:58:17.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.829+0000 7f18bd839700 1 --2- 172.21.15.2:0/472147969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18b8101eb0 0x7f18b8196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:17.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.829+0000 7f18be03a700 1 -- 172.21.15.2:0/472147969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18b8101eb0 msgr2=0x7f18b8196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:17.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.829+0000 7f18be03a700 1 --2- 172.21.15.2:0/472147969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18b8101eb0 0x7f18b8196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:17.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.829+0000 7f18be03a700 1 -- 172.21.15.2:0/472147969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b40095f0 con 0x7f18b8100cb0 2024-09-13T22:58:17.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.829+0000 7f18be03a700 1 --2- 172.21.15.2:0/472147969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b8100cb0 0x7f18b81964c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f18b4000c00 tx=0x7f18b400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:17.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.830+0000 7f18af7fe700 1 -- 172.21.15.2:0/472147969 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18b401d070 con 0x7f18b8100cb0 2024-09-13T22:58:17.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.830+0000 7f18af7fe700 1 -- 172.21.15.2:0/472147969 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f18b4005dc0 con 0x7f18b8100cb0 2024-09-13T22:58:17.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.830+0000 7f18c029e700 1 -- 172.21.15.2:0/472147969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b819bbb0 con 0x7f18b8100cb0 2024-09-13T22:58:17.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.830+0000 7f18af7fe700 1 -- 172.21.15.2:0/472147969 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18b40226a0 con 0x7f18b8100cb0 2024-09-13T22:58:17.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.830+0000 7f18c029e700 1 -- 172.21.15.2:0/472147969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b819c0a0 con 0x7f18b8100cb0 2024-09-13T22:58:17.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.831+0000 7f18c029e700 1 -- 172.21.15.2:0/472147969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b8109810 con 0x7f18b8100cb0 2024-09-13T22:58:17.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.831+0000 7f18af7fe700 1 -- 172.21.15.2:0/472147969 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92504+0+0 (secure 0 0 0) 0x7f18b4003910 con 0x7f18b8100cb0 2024-09-13T22:58:17.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.832+0000 7f18af7fe700 1 --2- 172.21.15.2:0/472147969 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f18a406e440 0x7f18a4070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:17.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.832+0000 7f18af7fe700 1 -- 172.21.15.2:0/472147969 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f18b408f930 con 0x7f18b8100cb0 2024-09-13T22:58:17.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.832+0000 7f18bd839700 1 --2- 172.21.15.2:0/472147969 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f18a406e440 0x7f18a4070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:17.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.832+0000 7f18bd839700 1 --2- 172.21.15.2:0/472147969 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f18a406e440 0x7f18a4070900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009bf0 tx=0x7f18a8009260 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:17.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:17.837+0000 7f18af7fe700 1 -- 172.21.15.2:0/472147969 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f18b405c910 con 0x7f18b8100cb0 2024-09-13T22:58:18.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:17 smithi002 ceph-mon[27637]: pgmap v46: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 445 KiB/s rd, 321 KiB/s wr, 65 op/s 2024-09-13T22:58:18.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.058+0000 7f18c029e700 1 -- 172.21.15.2:0/472147969 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f18b8106800 con 0x7f18a406e440 2024-09-13T22:58:18.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.067+0000 7f18af7fe700 1 -- 172.21.15.2:0/472147969 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f18b8106800 con 0x7f18a406e440 2024-09-13T22:58:18.068 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:58:18.068 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (9m) 2s ago 10m 26.2M - 0.25.0 c8568f914cd2 76a1576b4f53 2024-09-13T22:58:18.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (10m) 2s ago 10m 7818k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T22:58:18.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (9m) 21s ago 9m 7784k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T22:58:18.069 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (10m) 2s ago 10m 6669k - 18.2.1 5be31c24972a de910e0c5157 2024-09-13T22:58:18.069 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (9m) 21s ago 9m 6651k - 18.2.1 5be31c24972a 9f4bcfa66588 2024-09-13T22:58:18.069 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (8m) 2s ago 10m 83.5M - 9.4.7 954c08fa6188 39f4cfdc98d7 2024-09-13T22:58:18.069 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (5m) 2s ago 5m 14.4M - 18.2.1 5be31c24972a 59e9c88c31ca 2024-09-13T22:58:18.069 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (5m) 2s ago 5m 102M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T22:58:18.069 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (5m) 21s ago 5m 204M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T22:58:18.069 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (4m) 21s ago 4m 17.3M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T22:58:18.069 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 running (98s) 2s ago 12m 495M - 19.1.1-324-gecab7be5 0652ff2b5d78 7a8aa9de37e4 2024-09-13T22:58:18.069 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (51s) 21s ago 9m 439M - 19.1.1-324-gecab7be5 0652ff2b5d78 13fa6f3b5a8a 2024-09-13T22:58:18.070 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (12m) 2s ago 12m 52.7M 2048M 18.2.1 5be31c24972a de11be74385d 2024-09-13T22:58:18.070 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (9m) 21s ago 9m 42.0M 2048M 18.2.1 5be31c24972a 5642284a23bf 2024-09-13T22:58:18.070 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (36s) 2s ago 10m 7852k - 1.5.0 0da6a335fe13 f3eae5f90ab8 2024-09-13T22:58:18.070 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (30s) 21s ago 9m 3623k - 1.5.0 0da6a335fe13 a5c7d7f1eaa5 2024-09-13T22:58:18.070 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (8m) 2s ago 8m 207M 1217M 18.2.1 5be31c24972a 1e1f6936c402 2024-09-13T22:58:18.070 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (8m) 2s ago 8m 224M 1217M 18.2.1 5be31c24972a f0ac78c34831 2024-09-13T22:58:18.070 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (7m) 2s ago 7m 186M 1217M 18.2.1 5be31c24972a 9a2f4f6decfb 2024-09-13T22:58:18.070 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (7m) 21s ago 7m 251M 2241M 18.2.1 5be31c24972a fb455cc4c571 2024-09-13T22:58:18.070 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (7m) 21s ago 7m 216M 2241M 18.2.1 5be31c24972a f1bdc2c50535 2024-09-13T22:58:18.070 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (6m) 21s ago 6m 191M 2241M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T22:58:18.070 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (7s) 2s ago 10m 44.1M - 2.43.0 a07b618ecd1d aa241d1048de 2024-09-13T22:58:18.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.069+0000 7f18c029e700 1 -- 172.21.15.2:0/472147969 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f18a406e440 msgr2=0x7f18a4070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:18.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.069+0000 7f18c029e700 1 --2- 172.21.15.2:0/472147969 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f18a406e440 0x7f18a4070900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009bf0 tx=0x7f18a8009260 comp rx=0 tx=0).stop 2024-09-13T22:58:18.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.069+0000 7f18c029e700 1 -- 172.21.15.2:0/472147969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b8100cb0 msgr2=0x7f18b81964c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:18.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.069+0000 7f18c029e700 1 --2- 172.21.15.2:0/472147969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b8100cb0 0x7f18b81964c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f18b4000c00 tx=0x7f18b400f740 comp rx=0 tx=0).stop 2024-09-13T22:58:18.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.070+0000 7f18c029e700 1 -- 172.21.15.2:0/472147969 shutdown_connections 2024-09-13T22:58:18.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.070+0000 7f18c029e700 1 --2- 172.21.15.2:0/472147969 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f18a406e440 0x7f18a4070900 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:18.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.070+0000 7f18c029e700 1 --2- 172.21.15.2:0/472147969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18b8100cb0 0x7f18b81964c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:18.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.070+0000 7f18c029e700 1 --2- 172.21.15.2:0/472147969 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18b8101eb0 0x7f18b8196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:18.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.070+0000 7f18c029e700 1 -- 172.21.15.2:0/472147969 >> 172.21.15.2:0/472147969 conn(0x7f18b80fc230 msgr2=0x7f18b81050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:18.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.070+0000 7f18c029e700 1 -- 172.21.15.2:0/472147969 shutdown_connections 2024-09-13T22:58:18.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.070+0000 7f18c029e700 1 -- 172.21.15.2:0/472147969 wait complete. 2024-09-13T22:58:18.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:17 smithi047 ceph-mon[34560]: pgmap v46: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 445 KiB/s rd, 321 KiB/s wr, 65 op/s 2024-09-13T22:58:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.178+0000 7ff7397dd700 1 -- 172.21.15.2:0/2999164933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff734100cb0 msgr2=0x7ff7341010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.178+0000 7ff7397dd700 1 --2- 172.21.15.2:0/2999164933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff734100cb0 0x7ff7341010d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff724009910 tx=0x7ff724009c20 comp rx=0 tx=0).stop 2024-09-13T22:58:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.178+0000 7ff7397dd700 1 -- 172.21.15.2:0/2999164933 shutdown_connections 2024-09-13T22:58:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.178+0000 7ff7397dd700 1 --2- 172.21.15.2:0/2999164933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff734101eb0 0x7ff734102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.178+0000 7ff7397dd700 1 --2- 172.21.15.2:0/2999164933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff734100cb0 0x7ff7341010d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.178+0000 7ff7397dd700 1 -- 172.21.15.2:0/2999164933 >> 172.21.15.2:0/2999164933 conn(0x7ff7340fc230 msgr2=0x7ff7340fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.178+0000 7ff7397dd700 1 -- 172.21.15.2:0/2999164933 shutdown_connections 2024-09-13T22:58:18.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.178+0000 7ff7397dd700 1 -- 172.21.15.2:0/2999164933 wait complete. 2024-09-13T22:58:18.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.179+0000 7ff7397dd700 1 Processor -- start 2024-09-13T22:58:18.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.179+0000 7ff7397dd700 1 -- start start 2024-09-13T22:58:18.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.179+0000 7ff7397dd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff734100cb0 0x7ff7341986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:18.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.179+0000 7ff7397dd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff734101eb0 0x7ff734198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:18.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.179+0000 7ff7397dd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff734199230 con 0x7ff734100cb0 2024-09-13T22:58:18.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.179+0000 7ff7397dd700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff734199370 con 0x7ff734101eb0 2024-09-13T22:58:18.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.179+0000 7ff732ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff734100cb0 0x7ff7341986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:18.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.179+0000 7ff732ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff734100cb0 0x7ff7341986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60946/0 (socket says 172.21.15.2:60946) 2024-09-13T22:58:18.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.179+0000 7ff732ffd700 1 -- 172.21.15.2:0/2060418270 learned_addr learned my addr 172.21.15.2:0/2060418270 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:58:18.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.179+0000 7ff72bfff700 1 --2- 172.21.15.2:0/2060418270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff734101eb0 0x7ff734198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:18.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.180+0000 7ff732ffd700 1 -- 172.21.15.2:0/2060418270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff734101eb0 msgr2=0x7ff734198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:18.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.180+0000 7ff732ffd700 1 --2- 172.21.15.2:0/2060418270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff734101eb0 0x7ff734198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:18.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.180+0000 7ff732ffd700 1 -- 172.21.15.2:0/2060418270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7240095f0 con 0x7ff734100cb0 2024-09-13T22:58:18.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.180+0000 7ff72bfff700 1 --2- 172.21.15.2:0/2060418270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff734101eb0 0x7ff734198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:58:18.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.180+0000 7ff732ffd700 1 --2- 172.21.15.2:0/2060418270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff734100cb0 0x7ff7341986d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff72400bda0 tx=0x7ff72400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:18.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.180+0000 7ff730ff9700 1 -- 172.21.15.2:0/2060418270 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff72401d070 con 0x7ff734100cb0 2024-09-13T22:58:18.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.180+0000 7ff730ff9700 1 -- 172.21.15.2:0/2060418270 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff72400f460 con 0x7ff734100cb0 2024-09-13T22:58:18.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.180+0000 7ff7397dd700 1 -- 172.21.15.2:0/2060418270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff73419ddc0 con 0x7ff734100cb0 2024-09-13T22:58:18.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.180+0000 7ff730ff9700 1 -- 172.21.15.2:0/2060418270 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff724021640 con 0x7ff734100cb0 2024-09-13T22:58:18.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.180+0000 7ff7397dd700 1 -- 172.21.15.2:0/2060418270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73419e250 con 0x7ff734100cb0 2024-09-13T22:58:18.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.181+0000 7ff7397dd700 1 -- 172.21.15.2:0/2060418270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff734105f90 con 0x7ff734100cb0 2024-09-13T22:58:18.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.182+0000 7ff730ff9700 1 -- 172.21.15.2:0/2060418270 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92504+0+0 (secure 0 0 0) 0x7ff72400f5d0 con 0x7ff734100cb0 2024-09-13T22:58:18.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.182+0000 7ff730ff9700 1 --2- 172.21.15.2:0/2060418270 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ff72006e440 0x7ff720070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:18.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.182+0000 7ff730ff9700 1 -- 172.21.15.2:0/2060418270 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7ff72408f5b0 con 0x7ff734100cb0 2024-09-13T22:58:18.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.182+0000 7ff72bfff700 1 --2- 172.21.15.2:0/2060418270 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ff72006e440 0x7ff720070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:18.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.183+0000 7ff72bfff700 1 --2- 172.21.15.2:0/2060418270 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ff72006e440 0x7ff720070900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff71c005950 tx=0x7ff71c0058e0 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.187+0000 7ff730ff9700 1 -- 172.21.15.2:0/2060418270 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7ff72405c590 con 0x7ff734100cb0 2024-09-13T22:58:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.485+0000 7ff7397dd700 1 -- 172.21.15.2:0/2060418270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff73402cee0 con 0x7ff734100cb0 2024-09-13T22:58:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.485+0000 7ff730ff9700 1 -- 172.21.15.2:0/2060418270 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7ff72405c120 con 0x7ff734100cb0 2024-09-13T22:58:18.486 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:58:18.487 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T22:58:18.487 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-13T22:58:18.487 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:58:18.487 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T22:58:18.487 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:58:18.487 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:58:18.487 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T22:58:18.487 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-13T22:58:18.487 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:58:18.487 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T22:58:18.487 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-13T22:58:18.487 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:58:18.487 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T22:58:18.488 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-09-13T22:58:18.488 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:58:18.488 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T22:58:18.488 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:58:18.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.487+0000 7ff7397dd700 1 -- 172.21.15.2:0/2060418270 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ff72006e440 msgr2=0x7ff720070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:18.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.487+0000 7ff7397dd700 1 --2- 172.21.15.2:0/2060418270 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ff72006e440 0x7ff720070900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff71c005950 tx=0x7ff71c0058e0 comp rx=0 tx=0).stop 2024-09-13T22:58:18.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.487+0000 7ff7397dd700 1 -- 172.21.15.2:0/2060418270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff734100cb0 msgr2=0x7ff7341986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:18.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.487+0000 7ff7397dd700 1 --2- 172.21.15.2:0/2060418270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff734100cb0 0x7ff7341986d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff72400bda0 tx=0x7ff72400be80 comp rx=0 tx=0).stop 2024-09-13T22:58:18.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.487+0000 7ff7397dd700 1 -- 172.21.15.2:0/2060418270 shutdown_connections 2024-09-13T22:58:18.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.487+0000 7ff7397dd700 1 --2- 172.21.15.2:0/2060418270 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ff72006e440 0x7ff720070900 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:18.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.487+0000 7ff7397dd700 1 --2- 172.21.15.2:0/2060418270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff734100cb0 0x7ff7341986d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:18.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.487+0000 7ff7397dd700 1 --2- 172.21.15.2:0/2060418270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff734101eb0 0x7ff734198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:18.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.488+0000 7ff7397dd700 1 -- 172.21.15.2:0/2060418270 >> 172.21.15.2:0/2060418270 conn(0x7ff7340fc230 msgr2=0x7ff7341030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:18.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.488+0000 7ff7397dd700 1 -- 172.21.15.2:0/2060418270 shutdown_connections 2024-09-13T22:58:18.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.488+0000 7ff7397dd700 1 -- 172.21.15.2:0/2060418270 wait complete. 2024-09-13T22:58:18.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.599+0000 7fb9e6128700 1 -- 172.21.15.2:0/2195950693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9e0101ea0 msgr2=0x7fb9e0102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:18.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.599+0000 7fb9e6128700 1 --2- 172.21.15.2:0/2195950693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9e0101ea0 0x7fb9e0102300 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009910 tx=0x7fb9d4009c20 comp rx=0 tx=0).stop 2024-09-13T22:58:18.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.599+0000 7fb9e6128700 1 -- 172.21.15.2:0/2195950693 shutdown_connections 2024-09-13T22:58:18.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.599+0000 7fb9e6128700 1 --2- 172.21.15.2:0/2195950693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9e0101ea0 0x7fb9e0102300 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:18.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.599+0000 7fb9e6128700 1 --2- 172.21.15.2:0/2195950693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e0100ca0 0x7fb9e01010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:18.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.599+0000 7fb9e6128700 1 -- 172.21.15.2:0/2195950693 >> 172.21.15.2:0/2195950693 conn(0x7fb9e00fc260 msgr2=0x7fb9e00fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:18.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.599+0000 7fb9e6128700 1 -- 172.21.15.2:0/2195950693 shutdown_connections 2024-09-13T22:58:18.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.599+0000 7fb9e6128700 1 -- 172.21.15.2:0/2195950693 wait complete. 2024-09-13T22:58:18.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.599+0000 7fb9e6128700 1 Processor -- start 2024-09-13T22:58:18.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.600+0000 7fb9e6128700 1 -- start start 2024-09-13T22:58:18.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.600+0000 7fb9e6128700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e0100ca0 0x7fb9e0196500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:18.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.600+0000 7fb9e6128700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9e0101ea0 0x7fb9e0196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:18.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.600+0000 7fb9e6128700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e0197060 con 0x7fb9e0101ea0 2024-09-13T22:58:18.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.600+0000 7fb9e6128700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e01971a0 con 0x7fb9e0100ca0 2024-09-13T22:58:18.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.600+0000 7fb9deffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9e0101ea0 0x7fb9e0196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:18.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.600+0000 7fb9deffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9e0101ea0 0x7fb9e0196a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60956/0 (socket says 172.21.15.2:60956) 2024-09-13T22:58:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.600+0000 7fb9deffd700 1 -- 172.21.15.2:0/2856576289 learned_addr learned my addr 172.21.15.2:0/2856576289 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:58:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.600+0000 7fb9df7fe700 1 --2- 172.21.15.2:0/2856576289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e0100ca0 0x7fb9e0196500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.600+0000 7fb9deffd700 1 -- 172.21.15.2:0/2856576289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e0100ca0 msgr2=0x7fb9e0196500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.600+0000 7fb9deffd700 1 --2- 172.21.15.2:0/2856576289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e0100ca0 0x7fb9e0196500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.600+0000 7fb9deffd700 1 -- 172.21.15.2:0/2856576289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d40095f0 con 0x7fb9e0101ea0 2024-09-13T22:58:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.601+0000 7fb9deffd700 1 --2- 172.21.15.2:0/2856576289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9e0101ea0 0x7fb9e0196a40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4006010 tx=0x7fb9d400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.601+0000 7fb9dcff9700 1 -- 172.21.15.2:0/2856576289 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9d401d070 con 0x7fb9e0101ea0 2024-09-13T22:58:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.601+0000 7fb9dcff9700 1 -- 172.21.15.2:0/2856576289 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb9d400f460 con 0x7fb9e0101ea0 2024-09-13T22:58:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.601+0000 7fb9dcff9700 1 -- 172.21.15.2:0/2856576289 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9d4021640 con 0x7fb9e0101ea0 2024-09-13T22:58:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.601+0000 7fb9e6128700 1 -- 172.21.15.2:0/2856576289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e019bbf0 con 0x7fb9e0101ea0 2024-09-13T22:58:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.601+0000 7fb9e6128700 1 -- 172.21.15.2:0/2856576289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e019c090 con 0x7fb9e0101ea0 2024-09-13T22:58:18.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.602+0000 7fb9e6128700 1 -- 172.21.15.2:0/2856576289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e0109820 con 0x7fb9e0101ea0 2024-09-13T22:58:18.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.603+0000 7fb9dcff9700 1 -- 172.21.15.2:0/2856576289 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92504+0+0 (secure 0 0 0) 0x7fb9d400fab0 con 0x7fb9e0101ea0 2024-09-13T22:58:18.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.603+0000 7fb9dcff9700 1 --2- 172.21.15.2:0/2856576289 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fb9c806e440 0x7fb9c8070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:18.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.604+0000 7fb9dcff9700 1 -- 172.21.15.2:0/2856576289 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fb9d408f5a0 con 0x7fb9e0101ea0 2024-09-13T22:58:18.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.604+0000 7fb9df7fe700 1 --2- 172.21.15.2:0/2856576289 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fb9c806e440 0x7fb9c8070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:18.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.604+0000 7fb9df7fe700 1 --2- 172.21.15.2:0/2856576289 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fb9c806e440 0x7fb9c8070900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0101d00 tx=0x7fb9d000b410 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:18.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.608+0000 7fb9dcff9700 1 -- 172.21.15.2:0/2856576289 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7fb9d405c580 con 0x7fb9e0101ea0 2024-09-13T22:58:18.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.845+0000 7fb9e6128700 1 -- 172.21.15.2:0/2856576289 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9e01067f0 con 0x7fb9c806e440 2024-09-13T22:58:18.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.846+0000 7fb9dcff9700 1 -- 172.21.15.2:0/2856576289 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7fb9e01067f0 con 0x7fb9c806e440 2024-09-13T22:58:18.847 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:58:18.847 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:58:18.847 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T22:58:18.847 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T22:58:18.847 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-13T22:58:18.848 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr" 2024-09-13T22:58:18.848 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-13T22:58:18.848 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T22:58:18.848 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-13T22:58:18.848 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T22:58:18.848 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:58:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.848+0000 7fb9e6128700 1 -- 172.21.15.2:0/2856576289 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fb9c806e440 msgr2=0x7fb9c8070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.848+0000 7fb9e6128700 1 --2- 172.21.15.2:0/2856576289 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fb9c806e440 0x7fb9c8070900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0101d00 tx=0x7fb9d000b410 comp rx=0 tx=0).stop 2024-09-13T22:58:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.848+0000 7fb9e6128700 1 -- 172.21.15.2:0/2856576289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9e0101ea0 msgr2=0x7fb9e0196a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.848+0000 7fb9e6128700 1 --2- 172.21.15.2:0/2856576289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9e0101ea0 0x7fb9e0196a40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4006010 tx=0x7fb9d400bd70 comp rx=0 tx=0).stop 2024-09-13T22:58:18.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.848+0000 7fb9e6128700 1 -- 172.21.15.2:0/2856576289 shutdown_connections 2024-09-13T22:58:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.848+0000 7fb9e6128700 1 --2- 172.21.15.2:0/2856576289 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fb9c806e440 0x7fb9c8070900 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.848+0000 7fb9e6128700 1 --2- 172.21.15.2:0/2856576289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9e0100ca0 0x7fb9e0196500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.848+0000 7fb9e6128700 1 --2- 172.21.15.2:0/2856576289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9e0101ea0 0x7fb9e0196a40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.848+0000 7fb9e6128700 1 -- 172.21.15.2:0/2856576289 >> 172.21.15.2:0/2856576289 conn(0x7fb9e00fc260 msgr2=0x7fb9e01050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.849+0000 7fb9e6128700 1 -- 172.21.15.2:0/2856576289 shutdown_connections 2024-09-13T22:58:18.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:18.849+0000 7fb9e6128700 1 -- 172.21.15.2:0/2856576289 wait complete. 2024-09-13T22:58:19.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:18 smithi002 ceph-mon[27637]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:19.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:18 smithi002 ceph-mon[27637]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:19.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:18 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2060418270' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:19.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:18 smithi047 ceph-mon[34560]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:19.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:18 smithi047 ceph-mon[34560]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:19.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:18 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/2060418270' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:20.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:19 smithi002 ceph-mon[27637]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:20.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:19 smithi002 ceph-mon[27637]: pgmap v47: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 286 KiB/s rd, 158 KiB/s wr, 44 op/s 2024-09-13T22:58:20.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:19 smithi047 ceph-mon[34560]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:20.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:19 smithi047 ceph-mon[34560]: pgmap v47: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 286 KiB/s rd, 158 KiB/s wr, 44 op/s 2024-09-13T22:58:20.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:20 smithi002 ceph-mon[27637]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:21.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:20 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:58:21.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:20 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:21.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:20 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:21.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:20 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:58:21.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:20 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:58:21.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:20 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:21.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:20 smithi047 ceph-mon[34560]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:21.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:20 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:58:21.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:20 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:21.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:20 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:21.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:20 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:58:21.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:20 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:58:21.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:20 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:21 smithi002 ceph-mon[27637]: pgmap v48: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 36 KiB/s wr, 3 op/s 2024-09-13T22:58:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:21 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:58:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:21 smithi002 ceph-mon[27637]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:58:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:21 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:58:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:21 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:21 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:21 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:21 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:21 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:21 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:21 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:21.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:21 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:21.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:21 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:22.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:21 smithi047 ceph-mon[34560]: pgmap v48: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 36 KiB/s wr, 3 op/s 2024-09-13T22:58:22.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:21 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:58:22.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:21 smithi047 ceph-mon[34560]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T22:58:22.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:21 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:58:22.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:21 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:22.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:21 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:22.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:21 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:22.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:21 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:22.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:21 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:22.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:21 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:22.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:21 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:22.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:21 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:22.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:21 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:23.803 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:23 smithi002 ceph-mon[27637]: pgmap v49: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 37 KiB/s wr, 4 op/s 2024-09-13T22:58:23.803 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:23 smithi002 ceph-mon[27637]: Upgrade: Updating alertmanager.smithi002 2024-09-13T22:58:23.803 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:23 smithi002 ceph-mon[27637]: Deploying daemon alertmanager.smithi002 on smithi002 2024-09-13T22:58:23.803 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:23 smithi002 ceph-mon[27637]: mgrmap e32: smithi002.yumtzz(active, since 92s), standbys: smithi047.gcymvd 2024-09-13T22:58:24.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:23 smithi047 ceph-mon[34560]: pgmap v49: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 37 KiB/s wr, 4 op/s 2024-09-13T22:58:24.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:23 smithi047 ceph-mon[34560]: Upgrade: Updating alertmanager.smithi002 2024-09-13T22:58:24.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:23 smithi047 ceph-mon[34560]: Deploying daemon alertmanager.smithi002 on smithi002 2024-09-13T22:58:24.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:23 smithi047 ceph-mon[34560]: mgrmap e32: smithi002.yumtzz(active, since 92s), standbys: smithi047.gcymvd 2024-09-13T22:58:25.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:25 smithi002 ceph-mon[27637]: pgmap v50: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-13T22:58:26.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:25 smithi047 ceph-mon[34560]: pgmap v50: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-13T22:58:27.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:27 smithi002 ceph-mon[27637]: pgmap v51: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-13T22:58:27.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:27 smithi047 ceph-mon[34560]: pgmap v51: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-13T22:58:30.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:29 smithi002 ceph-mon[27637]: pgmap v52: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T22:58:30.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:29 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:30.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:29 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:30.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:29 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:58:30.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:29 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:30.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:29 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:30.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:29 smithi047 ceph-mon[34560]: pgmap v52: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T22:58:30.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:29 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:30.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:29 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:30.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:29 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:58:30.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:29 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:30.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:29 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:32.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:31 smithi002 ceph-mon[27637]: pgmap v53: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-13T22:58:32.086 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:31 smithi047 ceph-mon[34560]: pgmap v53: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-13T22:58:33.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:33 smithi002 ceph-mon[27637]: pgmap v54: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T22:58:33.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:33 smithi047 ceph-mon[34560]: pgmap v54: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-13T22:58:35.076 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:34 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:35.077 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:34 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:35.077 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:34 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:35.077 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:34 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:35.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:34 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:35.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:34 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:35.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:34 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:35.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:34 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:36.132 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:35 smithi002 ceph-mon[27637]: pgmap v55: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2024-09-13T22:58:36.132 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:35 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:58:36.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:35 smithi047 ceph-mon[34560]: pgmap v55: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2024-09-13T22:58:36.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:35 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:58:37.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:37 smithi047 ceph-mon[34560]: pgmap v56: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 2 op/s 2024-09-13T22:58:37.462 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:37 smithi002 ceph-mon[27637]: pgmap v56: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 2 op/s 2024-09-13T22:58:38.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:38.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:38.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:58:38.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:58:38.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:38.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T22:58:38.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:38 smithi002 ceph-mon[27637]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T22:58:38.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:58:38.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:38.954 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:38.954 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:38.954 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:38.954 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:38.954 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:38.954 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:38.954 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:38.954 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:38.954 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:38 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:38.954 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:38 smithi002 ceph-mon[27637]: pgmap v57: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:58:39.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:39.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:39.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:58:39.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:58:39.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:39.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T22:58:39.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:38 smithi047 ceph-mon[34560]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T22:58:39.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:58:39.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:39.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:39.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:39.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:39.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:39.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:39.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:39.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:39.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:39.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:38 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:39.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:38 smithi047 ceph-mon[34560]: pgmap v57: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:58:40.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:39 smithi047 ceph-mon[34560]: Upgrade: Updating grafana.smithi002 2024-09-13T22:58:40.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:39 smithi047 ceph-mon[34560]: Deploying daemon grafana.smithi002 on smithi002 2024-09-13T22:58:40.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:39 smithi002 ceph-mon[27637]: Upgrade: Updating grafana.smithi002 2024-09-13T22:58:40.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:39 smithi002 ceph-mon[27637]: Deploying daemon grafana.smithi002 on smithi002 2024-09-13T22:58:41.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:40 smithi047 ceph-mon[34560]: pgmap v58: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:58:41.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:40 smithi002 ceph-mon[27637]: pgmap v58: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:58:43.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:43 smithi002 ceph-mon[27637]: pgmap v59: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:58:43.615 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:43 smithi047 ceph-mon[34560]: pgmap v59: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:58:45.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:45 smithi002 ceph-mon[27637]: pgmap v60: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:58:45.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:45 smithi047 ceph-mon[34560]: pgmap v60: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:58:47.385 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:47 smithi002 ceph-mon[27637]: pgmap v61: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T22:58:47.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:47 smithi047 ceph-mon[34560]: pgmap v61: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T22:58:48.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.965+0000 7f71cae10700 1 -- 172.21.15.2:0/3600737455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c4100cb0 msgr2=0x7f71c41010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:48.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.965+0000 7f71cae10700 1 --2- 172.21.15.2:0/3600737455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c4100cb0 0x7f71c41010d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009910 tx=0x7f71b8009c20 comp rx=0 tx=0).stop 2024-09-13T22:58:48.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.965+0000 7f71cae10700 1 -- 172.21.15.2:0/3600737455 shutdown_connections 2024-09-13T22:58:48.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.965+0000 7f71cae10700 1 --2- 172.21.15.2:0/3600737455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71c4101eb0 0x7f71c4102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:48.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.965+0000 7f71cae10700 1 --2- 172.21.15.2:0/3600737455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c4100cb0 0x7f71c41010d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.965+0000 7f71cae10700 1 -- 172.21.15.2:0/3600737455 >> 172.21.15.2:0/3600737455 conn(0x7f71c40fc230 msgr2=0x7f71c40fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.965+0000 7f71cae10700 1 -- 172.21.15.2:0/3600737455 shutdown_connections 2024-09-13T22:58:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.965+0000 7f71cae10700 1 -- 172.21.15.2:0/3600737455 wait complete. 2024-09-13T22:58:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.965+0000 7f71cae10700 1 Processor -- start 2024-09-13T22:58:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.966+0000 7f71cae10700 1 -- start start 2024-09-13T22:58:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.966+0000 7f71cae10700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c4100cb0 0x7f71c4074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.966+0000 7f71cae10700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71c4101eb0 0x7f71c4073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.966+0000 7f71cae10700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40736c0 con 0x7f71c4100cb0 2024-09-13T22:58:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.966+0000 7f71cae10700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4073800 con 0x7f71c4101eb0 2024-09-13T22:58:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.966+0000 7f71c8bac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c4100cb0 0x7f71c4074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.966+0000 7f71c8bac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c4100cb0 0x7f71c4074b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60346/0 (socket says 172.21.15.2:60346) 2024-09-13T22:58:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.966+0000 7f71c8bac700 1 -- 172.21.15.2:0/3298023141 learned_addr learned my addr 172.21.15.2:0/3298023141 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:58:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.966+0000 7f71c3fff700 1 --2- 172.21.15.2:0/3298023141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71c4101eb0 0x7f71c4073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.966+0000 7f71c8bac700 1 -- 172.21.15.2:0/3298023141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71c4101eb0 msgr2=0x7f71c4073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.966+0000 7f71c8bac700 1 --2- 172.21.15.2:0/3298023141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71c4101eb0 0x7f71c4073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.966+0000 7f71c8bac700 1 -- 172.21.15.2:0/3298023141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b80095f0 con 0x7f71c4100cb0 2024-09-13T22:58:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.966+0000 7f71c8bac700 1 --2- 172.21.15.2:0/3298023141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c4100cb0 0x7f71c4074b30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f71b800bda0 tx=0x7f71b800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.967+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3298023141 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71b801d070 con 0x7f71c4100cb0 2024-09-13T22:58:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.967+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3298023141 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f71b800f460 con 0x7f71c4100cb0 2024-09-13T22:58:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.967+0000 7f71cae10700 1 -- 172.21.15.2:0/3298023141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c4073a80 con 0x7f71c4100cb0 2024-09-13T22:58:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.967+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3298023141 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71b8021640 con 0x7f71c4100cb0 2024-09-13T22:58:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.967+0000 7f71cae10700 1 -- 172.21.15.2:0/3298023141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c4073f70 con 0x7f71c4100cb0 2024-09-13T22:58:48.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.968+0000 7f71cae10700 1 -- 172.21.15.2:0/3298023141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c4109810 con 0x7f71c4100cb0 2024-09-13T22:58:48.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.968+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3298023141 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7f71b800f5d0 con 0x7f71c4100cb0 2024-09-13T22:58:48.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.969+0000 7f71c1ffb700 1 --2- 172.21.15.2:0/3298023141 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f71b406e300 0x7f71b40707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:48.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.969+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3298023141 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f71b808f330 con 0x7f71c4100cb0 2024-09-13T22:58:48.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.969+0000 7f71c3fff700 1 --2- 172.21.15.2:0/3298023141 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f71b406e300 0x7f71b40707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:48.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.969+0000 7f71c3fff700 1 --2- 172.21.15.2:0/3298023141 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f71b406e300 0x7f71b40707c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f71b0005950 tx=0x7f71b00058e0 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:48.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:48.974+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3298023141 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f71b805c530 con 0x7f71c4100cb0 2024-09-13T22:58:49.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.221+0000 7f71cae10700 1 -- 172.21.15.2:0/3298023141 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f71c419ea00 con 0x7f71b406e300 2024-09-13T22:58:49.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.222+0000 7f71c1ffb700 1 -- 172.21.15.2:0/3298023141 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f71c419ea00 con 0x7f71b406e300 2024-09-13T22:58:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.225+0000 7f71cae10700 1 -- 172.21.15.2:0/3298023141 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f71b406e300 msgr2=0x7f71b40707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.225+0000 7f71cae10700 1 --2- 172.21.15.2:0/3298023141 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f71b406e300 0x7f71b40707c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f71b0005950 tx=0x7f71b00058e0 comp rx=0 tx=0).stop 2024-09-13T22:58:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.225+0000 7f71cae10700 1 -- 172.21.15.2:0/3298023141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c4100cb0 msgr2=0x7f71c4074b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.225+0000 7f71cae10700 1 --2- 172.21.15.2:0/3298023141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c4100cb0 0x7f71c4074b30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f71b800bda0 tx=0x7f71b800be80 comp rx=0 tx=0).stop 2024-09-13T22:58:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.225+0000 7f71cae10700 1 -- 172.21.15.2:0/3298023141 shutdown_connections 2024-09-13T22:58:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.225+0000 7f71cae10700 1 --2- 172.21.15.2:0/3298023141 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f71b406e300 0x7f71b40707c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.225+0000 7f71cae10700 1 --2- 172.21.15.2:0/3298023141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c4100cb0 0x7f71c4074b30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.225+0000 7f71cae10700 1 --2- 172.21.15.2:0/3298023141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71c4101eb0 0x7f71c4073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.225+0000 7f71cae10700 1 -- 172.21.15.2:0/3298023141 >> 172.21.15.2:0/3298023141 conn(0x7f71c40fc230 msgr2=0x7f71c41050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:49.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.225+0000 7f71cae10700 1 -- 172.21.15.2:0/3298023141 shutdown_connections 2024-09-13T22:58:49.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.225+0000 7f71cae10700 1 -- 172.21.15.2:0/3298023141 wait complete. 2024-09-13T22:58:49.237 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T22:58:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.335+0000 7ff3a5f47700 1 -- 172.21.15.2:0/1612798497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3a0101750 msgr2=0x7ff3a0103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.335+0000 7ff3a5f47700 1 --2- 172.21.15.2:0/1612798497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3a0101750 0x7ff3a0103b40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff390009910 tx=0x7ff390009c20 comp rx=0 tx=0).stop 2024-09-13T22:58:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.335+0000 7ff3a5f47700 1 -- 172.21.15.2:0/1612798497 shutdown_connections 2024-09-13T22:58:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.335+0000 7ff3a5f47700 1 --2- 172.21.15.2:0/1612798497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3a0104080 0x7ff3a0106470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.336+0000 7ff3a5f47700 1 --2- 172.21.15.2:0/1612798497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3a0101750 0x7ff3a0103b40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.336+0000 7ff3a5f47700 1 -- 172.21.15.2:0/1612798497 >> 172.21.15.2:0/1612798497 conn(0x7ff3a00fb160 msgr2=0x7ff3a00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.336+0000 7ff3a5f47700 1 -- 172.21.15.2:0/1612798497 shutdown_connections 2024-09-13T22:58:49.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.336+0000 7ff3a5f47700 1 -- 172.21.15.2:0/1612798497 wait complete. 2024-09-13T22:58:49.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.336+0000 7ff3a5f47700 1 Processor -- start 2024-09-13T22:58:49.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.336+0000 7ff3a5f47700 1 -- start start 2024-09-13T22:58:49.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.336+0000 7ff3a5f47700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3a0101750 0x7ff3a01967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:49.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.337+0000 7ff3a5f47700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3a0104080 0x7ff3a0196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.337+0000 7ff3a5f47700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a0197340 con 0x7ff3a0101750 2024-09-13T22:58:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.337+0000 7ff3a5f47700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a0197480 con 0x7ff3a0104080 2024-09-13T22:58:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.337+0000 7ff39f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3a0101750 0x7ff3a01967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.337+0000 7ff39f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3a0101750 0x7ff3a01967e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60362/0 (socket says 172.21.15.2:60362) 2024-09-13T22:58:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.337+0000 7ff39f7fe700 1 -- 172.21.15.2:0/1395202498 learned_addr learned my addr 172.21.15.2:0/1395202498 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:58:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.337+0000 7ff39effd700 1 --2- 172.21.15.2:0/1395202498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3a0104080 0x7ff3a0196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.337+0000 7ff39f7fe700 1 -- 172.21.15.2:0/1395202498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3a0104080 msgr2=0x7ff3a0196d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.337+0000 7ff39f7fe700 1 --2- 172.21.15.2:0/1395202498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3a0104080 0x7ff3a0196d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.337+0000 7ff39f7fe700 1 -- 172.21.15.2:0/1395202498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3900095f0 con 0x7ff3a0101750 2024-09-13T22:58:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.337+0000 7ff39effd700 1 --2- 172.21.15.2:0/1395202498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3a0104080 0x7ff3a0196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:58:49.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.337+0000 7ff39f7fe700 1 --2- 172.21.15.2:0/1395202498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3a0101750 0x7ff3a01967e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff390006010 tx=0x7ff39000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.337+0000 7ff39cff9700 1 -- 172.21.15.2:0/1395202498 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff39001d070 con 0x7ff3a0101750 2024-09-13T22:58:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.337+0000 7ff3a5f47700 1 -- 172.21.15.2:0/1395202498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a019bed0 con 0x7ff3a0101750 2024-09-13T22:58:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.337+0000 7ff39cff9700 1 -- 172.21.15.2:0/1395202498 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff39000f460 con 0x7ff3a0101750 2024-09-13T22:58:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.337+0000 7ff39cff9700 1 -- 172.21.15.2:0/1395202498 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff390021640 con 0x7ff3a0101750 2024-09-13T22:58:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.338+0000 7ff3a5f47700 1 -- 172.21.15.2:0/1395202498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a019c340 con 0x7ff3a0101750 2024-09-13T22:58:49.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.339+0000 7ff3a5f47700 1 -- 172.21.15.2:0/1395202498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a0190630 con 0x7ff3a0101750 2024-09-13T22:58:49.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.339+0000 7ff39cff9700 1 -- 172.21.15.2:0/1395202498 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7ff39000fab0 con 0x7ff3a0101750 2024-09-13T22:58:49.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.340+0000 7ff39cff9700 1 --2- 172.21.15.2:0/1395202498 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ff38806e300 0x7ff3880707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:49.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.340+0000 7ff39cff9700 1 -- 172.21.15.2:0/1395202498 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7ff39008f510 con 0x7ff3a0101750 2024-09-13T22:58:49.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.340+0000 7ff39effd700 1 --2- 172.21.15.2:0/1395202498 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ff38806e300 0x7ff3880707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:49.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.340+0000 7ff39effd700 1 --2- 172.21.15.2:0/1395202498 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ff38806e300 0x7ff3880707c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff394005fd0 tx=0x7ff394005dc0 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:49.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.344+0000 7ff39cff9700 1 -- 172.21.15.2:0/1395202498 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7ff39005c710 con 0x7ff3a0101750 2024-09-13T22:58:49.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:49 smithi002 ceph-mon[27637]: pgmap v62: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:58:49.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.592+0000 7ff3a5f47700 1 -- 172.21.15.2:0/1395202498 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3a002d070 con 0x7ff38806e300 2024-09-13T22:58:49.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.593+0000 7ff39cff9700 1 -- 172.21.15.2:0/1395202498 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7ff3a002d070 con 0x7ff38806e300 2024-09-13T22:58:49.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.596+0000 7ff3a5f47700 1 -- 172.21.15.2:0/1395202498 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ff38806e300 msgr2=0x7ff3880707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:49.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.596+0000 7ff3a5f47700 1 --2- 172.21.15.2:0/1395202498 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ff38806e300 0x7ff3880707c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff394005fd0 tx=0x7ff394005dc0 comp rx=0 tx=0).stop 2024-09-13T22:58:49.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.596+0000 7ff3a5f47700 1 -- 172.21.15.2:0/1395202498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3a0101750 msgr2=0x7ff3a01967e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:49.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.596+0000 7ff3a5f47700 1 --2- 172.21.15.2:0/1395202498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3a0101750 0x7ff3a01967e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff390006010 tx=0x7ff39000be20 comp rx=0 tx=0).stop 2024-09-13T22:58:49.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.596+0000 7ff3a5f47700 1 -- 172.21.15.2:0/1395202498 shutdown_connections 2024-09-13T22:58:49.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.596+0000 7ff3a5f47700 1 --2- 172.21.15.2:0/1395202498 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ff38806e300 0x7ff3880707c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:49.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.596+0000 7ff3a5f47700 1 --2- 172.21.15.2:0/1395202498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3a0101750 0x7ff3a01967e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:49.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.596+0000 7ff3a5f47700 1 --2- 172.21.15.2:0/1395202498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3a0104080 0x7ff3a0196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:49.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.596+0000 7ff3a5f47700 1 -- 172.21.15.2:0/1395202498 >> 172.21.15.2:0/1395202498 conn(0x7ff3a00fb160 msgr2=0x7ff3a00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:49.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.596+0000 7ff3a5f47700 1 -- 172.21.15.2:0/1395202498 shutdown_connections 2024-09-13T22:58:49.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.596+0000 7ff3a5f47700 1 -- 172.21.15.2:0/1395202498 wait complete. 2024-09-13T22:58:49.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:49 smithi047 ceph-mon[34560]: pgmap v62: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:58:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.705+0000 7f7255bfa700 1 -- 172.21.15.2:0/3534082568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7250101f50 msgr2=0x7f72501023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.705+0000 7f7255bfa700 1 --2- 172.21.15.2:0/3534082568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7250101f50 0x7f72501023b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7244009910 tx=0x7f7244009c20 comp rx=0 tx=0).stop 2024-09-13T22:58:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.705+0000 7f7255bfa700 1 -- 172.21.15.2:0/3534082568 shutdown_connections 2024-09-13T22:58:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.705+0000 7f7255bfa700 1 --2- 172.21.15.2:0/3534082568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7250101f50 0x7f72501023b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.705+0000 7f7255bfa700 1 --2- 172.21.15.2:0/3534082568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72500fef70 0x7f72500ff390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.705+0000 7f7255bfa700 1 -- 172.21.15.2:0/3534082568 >> 172.21.15.2:0/3534082568 conn(0x7f72500fa8b0 msgr2=0x7f72500fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.705+0000 7f7255bfa700 1 -- 172.21.15.2:0/3534082568 shutdown_connections 2024-09-13T22:58:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.705+0000 7f7255bfa700 1 -- 172.21.15.2:0/3534082568 wait complete. 2024-09-13T22:58:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.706+0000 7f7255bfa700 1 Processor -- start 2024-09-13T22:58:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.706+0000 7f7255bfa700 1 -- start start 2024-09-13T22:58:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.706+0000 7f7255bfa700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72500fef70 0x7f72501018b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.706+0000 7f7255bfa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7250101f50 0x7f72500fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.706+0000 7f7255bfa700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7250100440 con 0x7f7250101f50 2024-09-13T22:58:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.706+0000 7f7255bfa700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7250100580 con 0x7f72500fef70 2024-09-13T22:58:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.707+0000 7f724effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7250101f50 0x7f72500fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.707+0000 7f724effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7250101f50 0x7f72500fff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60382/0 (socket says 172.21.15.2:60382) 2024-09-13T22:58:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.707+0000 7f724effd700 1 -- 172.21.15.2:0/3033638157 learned_addr learned my addr 172.21.15.2:0/3033638157 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:58:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.707+0000 7f724f7fe700 1 --2- 172.21.15.2:0/3033638157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72500fef70 0x7f72501018b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.707+0000 7f724effd700 1 -- 172.21.15.2:0/3033638157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72500fef70 msgr2=0x7f72501018b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.707+0000 7f724effd700 1 --2- 172.21.15.2:0/3033638157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72500fef70 0x7f72501018b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.707+0000 7f724effd700 1 -- 172.21.15.2:0/3033638157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72440095f0 con 0x7f7250101f50 2024-09-13T22:58:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.707+0000 7f724f7fe700 1 --2- 172.21.15.2:0/3033638157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72500fef70 0x7f72501018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:58:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.707+0000 7f724effd700 1 --2- 172.21.15.2:0/3033638157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7250101f50 0x7f72500fff00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7244006010 tx=0x7f724400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.707+0000 7f724cff9700 1 -- 172.21.15.2:0/3033638157 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f724401d070 con 0x7f7250101f50 2024-09-13T22:58:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.707+0000 7f724cff9700 1 -- 172.21.15.2:0/3033638157 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f724400f460 con 0x7f7250101f50 2024-09-13T22:58:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.707+0000 7f7255bfa700 1 -- 172.21.15.2:0/3033638157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7250100800 con 0x7f7250101f50 2024-09-13T22:58:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.707+0000 7f724cff9700 1 -- 172.21.15.2:0/3033638157 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7244017630 con 0x7f7250101f50 2024-09-13T22:58:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.707+0000 7f7255bfa700 1 -- 172.21.15.2:0/3033638157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7250100ca0 con 0x7f7250101f50 2024-09-13T22:58:49.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.708+0000 7f7255bfa700 1 -- 172.21.15.2:0/3033638157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7250109810 con 0x7f7250101f50 2024-09-13T22:58:49.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.709+0000 7f724cff9700 1 -- 172.21.15.2:0/3033638157 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7f724400f5d0 con 0x7f7250101f50 2024-09-13T22:58:49.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.709+0000 7f724cff9700 1 --2- 172.21.15.2:0/3033638157 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f723806e300 0x7f72380707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:49.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.710+0000 7f724cff9700 1 -- 172.21.15.2:0/3033638157 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f724408f570 con 0x7f7250101f50 2024-09-13T22:58:49.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.710+0000 7f724f7fe700 1 --2- 172.21.15.2:0/3033638157 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f723806e300 0x7f72380707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:49.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.710+0000 7f724f7fe700 1 --2- 172.21.15.2:0/3033638157 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f723806e300 0x7f72380707c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7240005950 tx=0x7f72400058e0 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:49.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.714+0000 7f724cff9700 1 -- 172.21.15.2:0/3033638157 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f724405c770 con 0x7f7250101f50 2024-09-13T22:58:49.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.935+0000 7f7255bfa700 1 -- 172.21.15.2:0/3033638157 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f725019e930 con 0x7f723806e300 2024-09-13T22:58:49.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.951+0000 7f724cff9700 1 -- 172.21.15.2:0/3033638157 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f725019e930 con 0x7f723806e300 2024-09-13T22:58:49.953 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:58:49.953 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (21s) 16s ago 11m 16.4M - 0.25.0 c8568f914cd2 f570a73274bc 2024-09-13T22:58:49.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (11m) 16s ago 11m 7847k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T22:58:49.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (10m) 53s ago 10m 7784k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T22:58:49.953 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (11m) 16s ago 11m 6669k - 18.2.1 5be31c24972a de910e0c5157 2024-09-13T22:58:49.953 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (10m) 53s ago 10m 6651k - 18.2.1 5be31c24972a 9f4bcfa66588 2024-09-13T22:58:49.953 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (9m) 16s ago 10m 84.3M - 9.4.7 954c08fa6188 39f4cfdc98d7 2024-09-13T22:58:49.953 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (5m) 16s ago 5m 14.5M - 18.2.1 5be31c24972a 59e9c88c31ca 2024-09-13T22:58:49.954 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (5m) 16s ago 5m 91.0M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T22:58:49.954 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (5m) 53s ago 5m 204M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T22:58:49.954 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (5m) 53s ago 5m 17.3M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T22:58:49.954 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 running (2m) 16s ago 12m 496M - 19.1.1-324-gecab7be5 0652ff2b5d78 7a8aa9de37e4 2024-09-13T22:58:49.954 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (83s) 53s ago 10m 439M - 19.1.1-324-gecab7be5 0652ff2b5d78 13fa6f3b5a8a 2024-09-13T22:58:49.955 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (12m) 16s ago 12m 53.2M 2048M 18.2.1 5be31c24972a de11be74385d 2024-09-13T22:58:49.955 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (10m) 53s ago 10m 42.0M 2048M 18.2.1 5be31c24972a 5642284a23bf 2024-09-13T22:58:49.955 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (68s) 16s ago 11m 8196k - 1.5.0 0da6a335fe13 f3eae5f90ab8 2024-09-13T22:58:49.955 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (62s) 53s ago 10m 3623k - 1.5.0 0da6a335fe13 a5c7d7f1eaa5 2024-09-13T22:58:49.955 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (9m) 16s ago 9m 208M 1217M 18.2.1 5be31c24972a 1e1f6936c402 2024-09-13T22:58:49.956 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (8m) 16s ago 8m 225M 1217M 18.2.1 5be31c24972a f0ac78c34831 2024-09-13T22:58:49.956 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (8m) 16s ago 8m 186M 1217M 18.2.1 5be31c24972a 9a2f4f6decfb 2024-09-13T22:58:49.956 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (8m) 53s ago 8m 251M 2241M 18.2.1 5be31c24972a fb455cc4c571 2024-09-13T22:58:49.956 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (7m) 53s ago 7m 216M 2241M 18.2.1 5be31c24972a f1bdc2c50535 2024-09-13T22:58:49.956 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (7m) 53s ago 7m 191M 2241M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T22:58:49.956 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (39s) 16s ago 10m 50.7M - 2.43.0 a07b618ecd1d aa241d1048de 2024-09-13T22:58:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.954+0000 7f7255bfa700 1 -- 172.21.15.2:0/3033638157 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f723806e300 msgr2=0x7f72380707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:49.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.954+0000 7f7255bfa700 1 --2- 172.21.15.2:0/3033638157 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f723806e300 0x7f72380707c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7240005950 tx=0x7f72400058e0 comp rx=0 tx=0).stop 2024-09-13T22:58:49.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.954+0000 7f7255bfa700 1 -- 172.21.15.2:0/3033638157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7250101f50 msgr2=0x7f72500fff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:49.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.954+0000 7f7255bfa700 1 --2- 172.21.15.2:0/3033638157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7250101f50 0x7f72500fff00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7244006010 tx=0x7f724400be20 comp rx=0 tx=0).stop 2024-09-13T22:58:49.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.955+0000 7f7255bfa700 1 -- 172.21.15.2:0/3033638157 shutdown_connections 2024-09-13T22:58:49.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.955+0000 7f7255bfa700 1 --2- 172.21.15.2:0/3033638157 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f723806e300 0x7f72380707c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:49.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.955+0000 7f7255bfa700 1 --2- 172.21.15.2:0/3033638157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f72500fef70 0x7f72501018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:49.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.955+0000 7f7255bfa700 1 --2- 172.21.15.2:0/3033638157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7250101f50 0x7f72500fff00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:49.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.955+0000 7f7255bfa700 1 -- 172.21.15.2:0/3033638157 >> 172.21.15.2:0/3033638157 conn(0x7f72500fa8b0 msgr2=0x7f7250105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:49.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.955+0000 7f7255bfa700 1 -- 172.21.15.2:0/3033638157 shutdown_connections 2024-09-13T22:58:49.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:49.955+0000 7f7255bfa700 1 -- 172.21.15.2:0/3033638157 wait complete. 2024-09-13T22:58:50.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.076+0000 7fdd9921b700 1 -- 172.21.15.2:0/4101487293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd940737f0 msgr2=0x7fdd94073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:50.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.076+0000 7fdd9921b700 1 --2- 172.21.15.2:0/4101487293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd940737f0 0x7fdd94073c70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdd88009910 tx=0x7fdd88009c20 comp rx=0 tx=0).stop 2024-09-13T22:58:50.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.076+0000 7fdd9921b700 1 -- 172.21.15.2:0/4101487293 shutdown_connections 2024-09-13T22:58:50.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.076+0000 7fdd9921b700 1 --2- 172.21.15.2:0/4101487293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd940737f0 0x7fdd94073c70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:50.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.076+0000 7fdd9921b700 1 --2- 172.21.15.2:0/4101487293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd94074dc0 0x7fdd94073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:50.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.076+0000 7fdd9921b700 1 -- 172.21.15.2:0/4101487293 >> 172.21.15.2:0/4101487293 conn(0x7fdd940fc230 msgr2=0x7fdd940fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:50.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.076+0000 7fdd9921b700 1 -- 172.21.15.2:0/4101487293 shutdown_connections 2024-09-13T22:58:50.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.076+0000 7fdd9921b700 1 -- 172.21.15.2:0/4101487293 wait complete. 2024-09-13T22:58:50.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.077+0000 7fdd9921b700 1 Processor -- start 2024-09-13T22:58:50.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.077+0000 7fdd9921b700 1 -- start start 2024-09-13T22:58:50.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.077+0000 7fdd9921b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd940737f0 0x7fdd94198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.077+0000 7fdd9921b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd94074dc0 0x7fdd94198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.077+0000 7fdd9921b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd94199270 con 0x7fdd94074dc0 2024-09-13T22:58:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.077+0000 7fdd9921b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd941993b0 con 0x7fdd940737f0 2024-09-13T22:58:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.077+0000 7fdd9259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd94074dc0 0x7fdd94198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.077+0000 7fdd9259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd94074dc0 0x7fdd94198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60402/0 (socket says 172.21.15.2:60402) 2024-09-13T22:58:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.077+0000 7fdd9259c700 1 -- 172.21.15.2:0/2661341457 learned_addr learned my addr 172.21.15.2:0/2661341457 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:58:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.077+0000 7fdd92d9d700 1 --2- 172.21.15.2:0/2661341457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd940737f0 0x7fdd94198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.077+0000 7fdd9259c700 1 -- 172.21.15.2:0/2661341457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd940737f0 msgr2=0x7fdd94198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.078+0000 7fdd9259c700 1 --2- 172.21.15.2:0/2661341457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd940737f0 0x7fdd94198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:50.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.078+0000 7fdd9259c700 1 -- 172.21.15.2:0/2661341457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd880095f0 con 0x7fdd94074dc0 2024-09-13T22:58:50.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.078+0000 7fdd9259c700 1 --2- 172.21.15.2:0/2661341457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd94074dc0 0x7fdd94198c50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdd88000c00 tx=0x7fdd8800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:50.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.078+0000 7fdd7bfff700 1 -- 172.21.15.2:0/2661341457 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd8801d070 con 0x7fdd94074dc0 2024-09-13T22:58:50.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.078+0000 7fdd7bfff700 1 -- 172.21.15.2:0/2661341457 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdd88005dc0 con 0x7fdd94074dc0 2024-09-13T22:58:50.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.078+0000 7fdd7bfff700 1 -- 172.21.15.2:0/2661341457 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd88022470 con 0x7fdd94074dc0 2024-09-13T22:58:50.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.078+0000 7fdd9921b700 1 -- 172.21.15.2:0/2661341457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9419de00 con 0x7fdd94074dc0 2024-09-13T22:58:50.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.078+0000 7fdd9921b700 1 -- 172.21.15.2:0/2661341457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9419e2c0 con 0x7fdd94074dc0 2024-09-13T22:58:50.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.079+0000 7fdd9921b700 1 -- 172.21.15.2:0/2661341457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9410ba40 con 0x7fdd94074dc0 2024-09-13T22:58:50.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.080+0000 7fdd7bfff700 1 -- 172.21.15.2:0/2661341457 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7fdd88003810 con 0x7fdd94074dc0 2024-09-13T22:58:50.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.080+0000 7fdd7bfff700 1 --2- 172.21.15.2:0/2661341457 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fdd7c06e300 0x7fdd7c0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:50.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.080+0000 7fdd7bfff700 1 -- 172.21.15.2:0/2661341457 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fdd8808f4f0 con 0x7fdd94074dc0 2024-09-13T22:58:50.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.080+0000 7fdd92d9d700 1 --2- 172.21.15.2:0/2661341457 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fdd7c06e300 0x7fdd7c0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:50.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.081+0000 7fdd92d9d700 1 --2- 172.21.15.2:0/2661341457 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fdd7c06e300 0x7fdd7c0707c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdd940751a0 tx=0x7fdd84009260 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:50.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.085+0000 7fdd7bfff700 1 -- 172.21.15.2:0/2661341457 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7fdd8805c770 con 0x7fdd94074dc0 2024-09-13T22:58:50.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.398+0000 7fdd9921b700 1 -- 172.21.15.2:0/2661341457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdd9410bc30 con 0x7fdd94074dc0 2024-09-13T22:58:50.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.399+0000 7fdd7bfff700 1 -- 172.21.15.2:0/2661341457 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7fdd8805c300 con 0x7fdd94074dc0 2024-09-13T22:58:50.401 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:58:50.401 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T22:58:50.401 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-13T22:58:50.402 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:58:50.402 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T22:58:50.402 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:58:50.402 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:58:50.402 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T22:58:50.402 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-13T22:58:50.402 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:58:50.403 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T22:58:50.403 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-13T22:58:50.403 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:58:50.403 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T22:58:50.403 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-09-13T22:58:50.403 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:58:50.404 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T22:58:50.404 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:58:50.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.401+0000 7fdd9921b700 1 -- 172.21.15.2:0/2661341457 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fdd7c06e300 msgr2=0x7fdd7c0707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:50.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.401+0000 7fdd9921b700 1 --2- 172.21.15.2:0/2661341457 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fdd7c06e300 0x7fdd7c0707c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdd940751a0 tx=0x7fdd84009260 comp rx=0 tx=0).stop 2024-09-13T22:58:50.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.401+0000 7fdd9921b700 1 -- 172.21.15.2:0/2661341457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd94074dc0 msgr2=0x7fdd94198c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:50.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.401+0000 7fdd9921b700 1 --2- 172.21.15.2:0/2661341457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd94074dc0 0x7fdd94198c50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdd88000c00 tx=0x7fdd8800f690 comp rx=0 tx=0).stop 2024-09-13T22:58:50.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.401+0000 7fdd9921b700 1 -- 172.21.15.2:0/2661341457 shutdown_connections 2024-09-13T22:58:50.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.401+0000 7fdd9921b700 1 --2- 172.21.15.2:0/2661341457 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fdd7c06e300 0x7fdd7c0707c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:50.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.401+0000 7fdd9921b700 1 --2- 172.21.15.2:0/2661341457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd940737f0 0x7fdd94198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:50.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.401+0000 7fdd9921b700 1 --2- 172.21.15.2:0/2661341457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd94074dc0 0x7fdd94198c50 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:50.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.401+0000 7fdd9921b700 1 -- 172.21.15.2:0/2661341457 >> 172.21.15.2:0/2661341457 conn(0x7fdd940fc230 msgr2=0x7fdd94106a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:50.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.401+0000 7fdd9921b700 1 -- 172.21.15.2:0/2661341457 shutdown_connections 2024-09-13T22:58:50.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.401+0000 7fdd9921b700 1 -- 172.21.15.2:0/2661341457 wait complete. 2024-09-13T22:58:50.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:50 smithi002 ceph-mon[27637]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:50.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:50 smithi002 ceph-mon[27637]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:50.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.512+0000 7f0eeaed6700 1 -- 172.21.15.2:0/3599031303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4100e10 msgr2=0x7f0ee4101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:50.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.512+0000 7f0eeaed6700 1 --2- 172.21.15.2:0/3599031303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4100e10 0x7f0ee4101270 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009910 tx=0x7f0ed0009c20 comp rx=0 tx=0).stop 2024-09-13T22:58:50.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.512+0000 7f0eeaed6700 1 -- 172.21.15.2:0/3599031303 shutdown_connections 2024-09-13T22:58:50.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.512+0000 7f0eeaed6700 1 --2- 172.21.15.2:0/3599031303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee4100e10 0x7f0ee4101270 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:50.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.512+0000 7f0eeaed6700 1 --2- 172.21.15.2:0/3599031303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ee40ffc10 0x7f0ee4100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:50.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.512+0000 7f0eeaed6700 1 -- 172.21.15.2:0/3599031303 >> 172.21.15.2:0/3599031303 conn(0x7f0ee40fb190 msgr2=0x7f0ee40fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:50.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.512+0000 7f0eeaed6700 1 -- 172.21.15.2:0/3599031303 shutdown_connections 2024-09-13T22:58:50.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.512+0000 7f0eeaed6700 1 -- 172.21.15.2:0/3599031303 wait complete. 2024-09-13T22:58:50.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.513+0000 7f0eeaed6700 1 Processor -- start 2024-09-13T22:58:50.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.513+0000 7f0eeaed6700 1 -- start start 2024-09-13T22:58:50.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.513+0000 7f0eeaed6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee40ffc10 0x7f0ee40690e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:50.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.513+0000 7f0eeaed6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ee4100e10 0x7f0ee419b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:50.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.513+0000 7f0eeaed6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee419b870 con 0x7f0ee40ffc10 2024-09-13T22:58:50.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.513+0000 7f0eeaed6700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee419b9b0 con 0x7f0ee4100e10 2024-09-13T22:58:50.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.513+0000 7f0ee8c72700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee40ffc10 0x7f0ee40690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:50.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.513+0000 7f0ee8c72700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee40ffc10 0x7f0ee40690e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34492/0 (socket says 172.21.15.2:34492) 2024-09-13T22:58:50.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.513+0000 7f0ee8c72700 1 -- 172.21.15.2:0/8778920 learned_addr learned my addr 172.21.15.2:0/8778920 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:58:50.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.514+0000 7f0ee8c72700 1 -- 172.21.15.2:0/8778920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ee4100e10 msgr2=0x7f0ee419b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:50.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.514+0000 7f0ee3fff700 1 --2- 172.21.15.2:0/8778920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ee4100e10 0x7f0ee419b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:50.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.514+0000 7f0ee8c72700 1 --2- 172.21.15.2:0/8778920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ee4100e10 0x7f0ee419b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:50.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.514+0000 7f0ee8c72700 1 -- 172.21.15.2:0/8778920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed00095f0 con 0x7f0ee40ffc10 2024-09-13T22:58:50.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.514+0000 7f0ee3fff700 1 --2- 172.21.15.2:0/8778920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ee4100e10 0x7f0ee419b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:58:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.514+0000 7f0ee8c72700 1 --2- 172.21.15.2:0/8778920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee40ffc10 0x7f0ee40690e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800b480 tx=0x7f0ed800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.514+0000 7f0ee1ffb700 1 -- 172.21.15.2:0/8778920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ed80118c0 con 0x7f0ee40ffc10 2024-09-13T22:58:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.514+0000 7f0ee1ffb700 1 -- 172.21.15.2:0/8778920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0ed8010380 con 0x7f0ee40ffc10 2024-09-13T22:58:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.515+0000 7f0ee1ffb700 1 -- 172.21.15.2:0/8778920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ed800f4f0 con 0x7f0ee40ffc10 2024-09-13T22:58:50.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.515+0000 7f0eeaed6700 1 -- 172.21.15.2:0/8778920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee419bc90 con 0x7f0ee40ffc10 2024-09-13T22:58:50.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.515+0000 7f0eeaed6700 1 -- 172.21.15.2:0/8778920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee419c180 con 0x7f0ee40ffc10 2024-09-13T22:58:50.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.517+0000 7f0eeaed6700 1 -- 172.21.15.2:0/8778920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee41087a0 con 0x7f0ee40ffc10 2024-09-13T22:58:50.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.517+0000 7f0ee1ffb700 1 -- 172.21.15.2:0/8778920 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7f0ed800f760 con 0x7f0ee40ffc10 2024-09-13T22:58:50.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.517+0000 7f0ee1ffb700 1 --2- 172.21.15.2:0/8778920 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f0ed406e300 0x7f0ed40707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:58:50.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.518+0000 7f0ee1ffb700 1 -- 172.21.15.2:0/8778920 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f0ed808dc70 con 0x7f0ee40ffc10 2024-09-13T22:58:50.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.518+0000 7f0ee3fff700 1 --2- 172.21.15.2:0/8778920 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f0ed406e300 0x7f0ed40707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:58:50.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.518+0000 7f0ee3fff700 1 --2- 172.21.15.2:0/8778920 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f0ed406e300 0x7f0ed40707c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0006010 tx=0x7f0ed0005960 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:58:50.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.524+0000 7f0ee1ffb700 1 -- 172.21.15.2:0/8778920 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f0ed805af60 con 0x7f0ee40ffc10 2024-09-13T22:58:50.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:50 smithi047 ceph-mon[34560]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:50.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:50 smithi047 ceph-mon[34560]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.758+0000 7f0eeaed6700 1 -- 172.21.15.2:0/8778920 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ee4105760 con 0x7f0ed406e300 2024-09-13T22:58:50.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.759+0000 7f0ee1ffb700 1 -- 172.21.15.2:0/8778920 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f0ee4105760 con 0x7f0ed406e300 2024-09-13T22:58:50.761 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:58:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:58:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T22:58:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-13T22:58:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-13T22:58:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr" 2024-09-13T22:58:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-13T22:58:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "2/2 daemons upgraded", 2024-09-13T22:58:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading grafana daemons", 2024-09-13T22:58:50.761 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T22:58:50.761 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:58:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.762+0000 7f0eeaed6700 1 -- 172.21.15.2:0/8778920 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f0ed406e300 msgr2=0x7f0ed40707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.762+0000 7f0eeaed6700 1 --2- 172.21.15.2:0/8778920 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f0ed406e300 0x7f0ed40707c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0006010 tx=0x7f0ed0005960 comp rx=0 tx=0).stop 2024-09-13T22:58:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.762+0000 7f0eeaed6700 1 -- 172.21.15.2:0/8778920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee40ffc10 msgr2=0x7f0ee40690e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:58:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.762+0000 7f0eeaed6700 1 --2- 172.21.15.2:0/8778920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee40ffc10 0x7f0ee40690e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800b480 tx=0x7f0ed800b840 comp rx=0 tx=0).stop 2024-09-13T22:58:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.762+0000 7f0eeaed6700 1 -- 172.21.15.2:0/8778920 shutdown_connections 2024-09-13T22:58:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.762+0000 7f0eeaed6700 1 --2- 172.21.15.2:0/8778920 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f0ed406e300 0x7f0ed40707c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.762+0000 7f0eeaed6700 1 --2- 172.21.15.2:0/8778920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ee40ffc10 0x7f0ee40690e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.762+0000 7f0eeaed6700 1 --2- 172.21.15.2:0/8778920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ee4100e10 0x7f0ee419b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:58:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.762+0000 7f0eeaed6700 1 -- 172.21.15.2:0/8778920 >> 172.21.15.2:0/8778920 conn(0x7f0ee40fb190 msgr2=0x7f0ee4104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:58:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.762+0000 7f0eeaed6700 1 -- 172.21.15.2:0/8778920 shutdown_connections 2024-09-13T22:58:50.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:58:50.762+0000 7f0eeaed6700 1 -- 172.21.15.2:0/8778920 wait complete. 2024-09-13T22:58:51.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:51 smithi002 ceph-mon[27637]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:51.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:51 smithi002 ceph-mon[27637]: pgmap v63: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:58:51.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:51 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2661341457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:51.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:51 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:58:51.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:51 smithi002 ceph-mon[27637]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:51.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:51 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:51.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:51 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:51.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:51 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:58:51.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:51 smithi047 ceph-mon[34560]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:51.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:51 smithi047 ceph-mon[34560]: pgmap v63: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:58:51.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:51 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/2661341457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:58:51.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:51 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:58:51.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:51 smithi047 ceph-mon[34560]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:58:51.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:51 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:51.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:51 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:51.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:51 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:58:53.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:53 smithi002 ceph-mon[27637]: pgmap v64: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:58:53.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:53 smithi047 ceph-mon[34560]: pgmap v64: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:58:55.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:55 smithi002 ceph-mon[27637]: pgmap v65: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:58:55.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:55 smithi047 ceph-mon[34560]: pgmap v65: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:58:57.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:57 smithi047 ceph-mon[34560]: pgmap v66: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:58:57.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:57 smithi002 ceph-mon[27637]: pgmap v66: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:58:58.635 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:58 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:58.635 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:58 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:58.635 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:58 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:58.635 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:58 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:58.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:58 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:58.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:58 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:58.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:58 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:58.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:58 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:58:59.617 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:58:59 smithi002 ceph-mon[27637]: pgmap v67: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:58:59.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:58:59 smithi047 ceph-mon[34560]: pgmap v67: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:01.384 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:01 smithi002 ceph-mon[27637]: pgmap v68: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:01.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:01 smithi047 ceph-mon[34560]: pgmap v68: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:02.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:02.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:02.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:02.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:59:02.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:02.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T22:59:02.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T22:59:02.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:59:02.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: Upgrade: Finalizing container_image settings 2024-09-13T22:59:02.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:02.753 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T22:59:02.753 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T22:59:02.753 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:59:02.753 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T22:59:02.753 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T22:59:02.753 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T22:59:02.753 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T22:59:02.753 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T22:59:02.753 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T22:59:02.753 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T22:59:02.753 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T22:59:02.753 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:59:02.753 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T22:59:02.754 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T22:59:02.754 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T22:59:02.754 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T22:59:02.754 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T22:59:02.754 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T22:59:02.754 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T22:59:02.754 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:59:02.754 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:59:02.754 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:59:02.754 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:59:02.754 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:59:02.754 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:59:02.754 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: Upgrade: Complete! 2024-09-13T22:59:02.755 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T22:59:02.755 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T22:59:02.755 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:59:02.755 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:02.755 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:59:02.755 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:02.755 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:59:02.755 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:02.755 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:59:02.755 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:02 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:02.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:02.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:02.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:02.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:59:02.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:02.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T22:59:02.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T22:59:02.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:59:02.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:02.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: Upgrade: Finalizing container_image settings 2024-09-13T22:59:02.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:02.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T22:59:02.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T22:59:02.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:59:02.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T22:59:02.916 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T22:59:02.916 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T22:59:02.916 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T22:59:02.916 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T22:59:02.916 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T22:59:02.916 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T22:59:02.916 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T22:59:02.916 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:59:02.916 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T22:59:02.916 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T22:59:02.916 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T22:59:02.916 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T22:59:02.916 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T22:59:02.916 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T22:59:02.917 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T22:59:02.917 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:59:02.917 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:59:02.917 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:59:02.917 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:59:02.917 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:59:02.917 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T22:59:02.917 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: Upgrade: Complete! 2024-09-13T22:59:02.917 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T22:59:02.917 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T22:59:02.917 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:59:02.917 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:02.918 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:59:02.918 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:02.918 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:59:02.918 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:02.918 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:59:02.918 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:03.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:03 smithi002 ceph-mon[27637]: pgmap v69: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:03.816 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:03 smithi047 ceph-mon[34560]: pgmap v69: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:05.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:05 smithi002 ceph-mon[27637]: pgmap v70: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:05.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:05 smithi047 ceph-mon[34560]: pgmap v70: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:06.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:06 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:59:06.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:06 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:06.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:06 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:59:06.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:06 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:07.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:07 smithi002 ceph-mon[27637]: pgmap v71: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:07.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:07 smithi047 ceph-mon[34560]: pgmap v71: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:09.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:09 smithi002 ceph-mon[27637]: pgmap v72: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:09.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:09 smithi047 ceph-mon[34560]: pgmap v72: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:11.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:11 smithi002 ceph-mon[27637]: pgmap v73: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:11.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:11 smithi047 ceph-mon[34560]: pgmap v73: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:13.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:13 smithi002 ceph-mon[27637]: pgmap v74: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:13.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:13 smithi047 ceph-mon[34560]: pgmap v74: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:15.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:15 smithi002 ceph-mon[27637]: pgmap v75: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:15.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:15 smithi047 ceph-mon[34560]: pgmap v75: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:17.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:17 smithi047 ceph-mon[34560]: pgmap v76: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:17.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:17 smithi002 ceph-mon[27637]: pgmap v76: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:19.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:19 smithi002 ceph-mon[27637]: pgmap v77: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:19.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:19 smithi047 ceph-mon[34560]: pgmap v77: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:20.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.885+0000 7f914f574700 1 -- 172.21.15.2:0/1619023908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9148101eb0 msgr2=0x7f9148102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:20.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.885+0000 7f914f574700 1 --2- 172.21.15.2:0/1619023908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9148101eb0 0x7f9148102310 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9138009910 tx=0x7f9138009c20 comp rx=0 tx=0).stop 2024-09-13T22:59:20.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.885+0000 7f914f574700 1 -- 172.21.15.2:0/1619023908 shutdown_connections 2024-09-13T22:59:20.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.885+0000 7f914f574700 1 --2- 172.21.15.2:0/1619023908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9148101eb0 0x7f9148102310 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:20.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.885+0000 7f914f574700 1 --2- 172.21.15.2:0/1619023908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9148100cb0 0x7f91481010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:20.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.885+0000 7f914f574700 1 -- 172.21.15.2:0/1619023908 >> 172.21.15.2:0/1619023908 conn(0x7f91480fc230 msgr2=0x7f91480fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:20.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.885+0000 7f914f574700 1 -- 172.21.15.2:0/1619023908 shutdown_connections 2024-09-13T22:59:20.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.885+0000 7f914f574700 1 -- 172.21.15.2:0/1619023908 wait complete. 2024-09-13T22:59:20.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.886+0000 7f914f574700 1 Processor -- start 2024-09-13T22:59:20.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.886+0000 7f914f574700 1 -- start start 2024-09-13T22:59:20.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.886+0000 7f914f574700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9148100cb0 0x7f9148074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:20.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.886+0000 7f914f574700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9148101eb0 0x7f9148073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:20.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.886+0000 7f914f574700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91480736c0 con 0x7f9148100cb0 2024-09-13T22:59:20.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.886+0000 7f914f574700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9148073800 con 0x7f9148101eb0 2024-09-13T22:59:20.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.886+0000 7f914d310700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9148100cb0 0x7f9148074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:20.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.886+0000 7f914d310700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9148100cb0 0x7f9148074b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50440/0 (socket says 172.21.15.2:50440) 2024-09-13T22:59:20.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.886+0000 7f914d310700 1 -- 172.21.15.2:0/1911682465 learned_addr learned my addr 172.21.15.2:0/1911682465 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:59:20.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.886+0000 7f914cb0f700 1 --2- 172.21.15.2:0/1911682465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9148101eb0 0x7f9148073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:20.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.887+0000 7f914d310700 1 -- 172.21.15.2:0/1911682465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9148101eb0 msgr2=0x7f9148073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:20.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.887+0000 7f914d310700 1 --2- 172.21.15.2:0/1911682465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9148101eb0 0x7f9148073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:20.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.887+0000 7f914d310700 1 -- 172.21.15.2:0/1911682465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91380095f0 con 0x7f9148100cb0 2024-09-13T22:59:20.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.887+0000 7f914d310700 1 --2- 172.21.15.2:0/1911682465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9148100cb0 0x7f9148074b30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f914400d900 tx=0x7f914400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:20.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.887+0000 7f913e7fc700 1 -- 172.21.15.2:0/1911682465 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f914400b920 con 0x7f9148100cb0 2024-09-13T22:59:20.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.887+0000 7f913e7fc700 1 -- 172.21.15.2:0/1911682465 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9144010460 con 0x7f9148100cb0 2024-09-13T22:59:20.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.887+0000 7f914f574700 1 -- 172.21.15.2:0/1911682465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9148073ae0 con 0x7f9148100cb0 2024-09-13T22:59:20.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.887+0000 7f913e7fc700 1 -- 172.21.15.2:0/1911682465 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f914400f590 con 0x7f9148100cb0 2024-09-13T22:59:20.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.887+0000 7f914f574700 1 -- 172.21.15.2:0/1911682465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914819e510 con 0x7f9148100cb0 2024-09-13T22:59:20.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.888+0000 7f914f574700 1 -- 172.21.15.2:0/1911682465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9148109810 con 0x7f9148100cb0 2024-09-13T22:59:20.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.889+0000 7f913e7fc700 1 -- 172.21.15.2:0/1911682465 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7f91440105d0 con 0x7f9148100cb0 2024-09-13T22:59:20.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.889+0000 7f913e7fc700 1 --2- 172.21.15.2:0/1911682465 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f913406e300 0x7f91340707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:20.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.889+0000 7f913e7fc700 1 -- 172.21.15.2:0/1911682465 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f914408dcd0 con 0x7f9148100cb0 2024-09-13T22:59:20.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.889+0000 7f914cb0f700 1 --2- 172.21.15.2:0/1911682465 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f913406e300 0x7f91340707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:20.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.890+0000 7f914cb0f700 1 --2- 172.21.15.2:0/1911682465 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f913406e300 0x7f91340707c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f913800b5c0 tx=0x7f9138005260 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:20.894+0000 7f913e7fc700 1 -- 172.21.15.2:0/1911682465 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f914405aed0 con 0x7f9148100cb0 2024-09-13T22:59:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:21.124+0000 7f914f574700 1 -- 172.21.15.2:0/1911682465 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9148106800 con 0x7f913406e300 2024-09-13T22:59:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:21.125+0000 7f913e7fc700 1 -- 172.21.15.2:0/1911682465 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f9148106800 con 0x7f913406e300 2024-09-13T22:59:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:21.127+0000 7f914f574700 1 -- 172.21.15.2:0/1911682465 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f913406e300 msgr2=0x7f91340707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:21.127+0000 7f914f574700 1 --2- 172.21.15.2:0/1911682465 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f913406e300 0x7f91340707c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f913800b5c0 tx=0x7f9138005260 comp rx=0 tx=0).stop 2024-09-13T22:59:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:21.127+0000 7f914f574700 1 -- 172.21.15.2:0/1911682465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9148100cb0 msgr2=0x7f9148074b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:21.127+0000 7f914f574700 1 --2- 172.21.15.2:0/1911682465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9148100cb0 0x7f9148074b30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f914400d900 tx=0x7f914400dc10 comp rx=0 tx=0).stop 2024-09-13T22:59:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:21.127+0000 7f914f574700 1 -- 172.21.15.2:0/1911682465 shutdown_connections 2024-09-13T22:59:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:21.127+0000 7f914f574700 1 --2- 172.21.15.2:0/1911682465 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f913406e300 0x7f91340707c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:21.127+0000 7f914f574700 1 --2- 172.21.15.2:0/1911682465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9148100cb0 0x7f9148074b30 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:21.127+0000 7f914f574700 1 --2- 172.21.15.2:0/1911682465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9148101eb0 0x7f9148073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:21.127+0000 7f914f574700 1 -- 172.21.15.2:0/1911682465 >> 172.21.15.2:0/1911682465 conn(0x7f91480fc230 msgr2=0x7f91481050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:21.127+0000 7f914f574700 1 -- 172.21.15.2:0/1911682465 shutdown_connections 2024-09-13T22:59:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:21.127+0000 7f914f574700 1 -- 172.21.15.2:0/1911682465 wait complete. 2024-09-13T22:59:21.411 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:21 smithi002 ceph-mon[27637]: pgmap v78: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:21.411 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:21 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:59:21.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:21 smithi047 ceph-mon[34560]: pgmap v78: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:21.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:21 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:59:21.717 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-13T22:59:21.929 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:59:22.323 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:22 smithi002 ceph-mon[27637]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:22.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:22 smithi047 ceph-mon[34560]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:23.472 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:23 smithi002 ceph-mon[27637]: pgmap v79: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:23.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.579+0000 7fcbf5768700 1 -- 172.21.15.2:0/2958428899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbf00ffa10 msgr2=0x7fcbf00ffe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.579+0000 7fcbf5768700 1 --2- 172.21.15.2:0/2958428899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbf00ffa10 0x7fcbf00ffe90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4009910 tx=0x7fcbe4009c20 comp rx=0 tx=0).stop 2024-09-13T22:59:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.579+0000 7fcbf5768700 1 -- 172.21.15.2:0/2958428899 shutdown_connections 2024-09-13T22:59:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.579+0000 7fcbf5768700 1 --2- 172.21.15.2:0/2958428899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbf00ffa10 0x7fcbf00ffe90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.579+0000 7fcbf5768700 1 --2- 172.21.15.2:0/2958428899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbf0105a10 0x7fcbf0105df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.579+0000 7fcbf5768700 1 -- 172.21.15.2:0/2958428899 >> 172.21.15.2:0/2958428899 conn(0x7fcbf00fb500 msgr2=0x7fcbf00fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.579+0000 7fcbf5768700 1 -- 172.21.15.2:0/2958428899 shutdown_connections 2024-09-13T22:59:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.579+0000 7fcbf5768700 1 -- 172.21.15.2:0/2958428899 wait complete. 2024-09-13T22:59:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.580+0000 7fcbf5768700 1 Processor -- start 2024-09-13T22:59:23.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.580+0000 7fcbf5768700 1 -- start start 2024-09-13T22:59:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.580+0000 7fcbf5768700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbf00ffa10 0x7fcbf01966d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.580+0000 7fcbf5768700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbf0105a10 0x7fcbf0196c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.580+0000 7fcbf5768700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf01972a0 con 0x7fcbf0105a10 2024-09-13T22:59:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.580+0000 7fcbf5768700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf0199fd0 con 0x7fcbf00ffa10 2024-09-13T22:59:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.580+0000 7fcbee7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbf0105a10 0x7fcbf0196c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.580+0000 7fcbee7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbf0105a10 0x7fcbf0196c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50472/0 (socket says 172.21.15.2:50472) 2024-09-13T22:59:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.580+0000 7fcbee7fc700 1 -- 172.21.15.2:0/328943922 learned_addr learned my addr 172.21.15.2:0/328943922 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:59:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.580+0000 7fcbee7fc700 1 -- 172.21.15.2:0/328943922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbf00ffa10 msgr2=0x7fcbf01966d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.580+0000 7fcbeeffd700 1 --2- 172.21.15.2:0/328943922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbf00ffa10 0x7fcbf01966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.580+0000 7fcbee7fc700 1 --2- 172.21.15.2:0/328943922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbf00ffa10 0x7fcbf01966d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.581+0000 7fcbee7fc700 1 -- 172.21.15.2:0/328943922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe40095f0 con 0x7fcbf0105a10 2024-09-13T22:59:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.581+0000 7fcbeeffd700 1 --2- 172.21.15.2:0/328943922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbf00ffa10 0x7fcbf01966d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:59:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.581+0000 7fcbee7fc700 1 --2- 172.21.15.2:0/328943922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbf0105a10 0x7fcbf0196c10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4006010 tx=0x7fcbe400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.581+0000 7fcbd7fff700 1 -- 172.21.15.2:0/328943922 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbe401d070 con 0x7fcbf0105a10 2024-09-13T22:59:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.581+0000 7fcbf5768700 1 -- 172.21.15.2:0/328943922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf019a250 con 0x7fcbf0105a10 2024-09-13T22:59:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.581+0000 7fcbd7fff700 1 -- 172.21.15.2:0/328943922 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcbe400f460 con 0x7fcbf0105a10 2024-09-13T22:59:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.581+0000 7fcbd7fff700 1 -- 172.21.15.2:0/328943922 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbe4017630 con 0x7fcbf0105a10 2024-09-13T22:59:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.581+0000 7fcbf5768700 1 -- 172.21.15.2:0/328943922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf019a740 con 0x7fcbf0105a10 2024-09-13T22:59:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.582+0000 7fcbf5768700 1 -- 172.21.15.2:0/328943922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf0108fb0 con 0x7fcbf0105a10 2024-09-13T22:59:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.583+0000 7fcbd7fff700 1 -- 172.21.15.2:0/328943922 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7fcbe400f5d0 con 0x7fcbf0105a10 2024-09-13T22:59:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.583+0000 7fcbd7fff700 1 --2- 172.21.15.2:0/328943922 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fcbd806e300 0x7fcbd80707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.583+0000 7fcbd7fff700 1 -- 172.21.15.2:0/328943922 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fcbe408f540 con 0x7fcbf0105a10 2024-09-13T22:59:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.583+0000 7fcbeeffd700 1 --2- 172.21.15.2:0/328943922 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fcbd806e300 0x7fcbd80707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.584+0000 7fcbeeffd700 1 --2- 172.21.15.2:0/328943922 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fcbd806e300 0x7fcbd80707c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00094f0 tx=0x7fcbe0009040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:23.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.588+0000 7fcbd7fff700 1 -- 172.21.15.2:0/328943922 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7fcbe4058c10 con 0x7fcbf0105a10 2024-09-13T22:59:23.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:23 smithi047 ceph-mon[34560]: pgmap v79: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:23.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.884+0000 7fcbf5768700 1 -- 172.21.15.2:0/328943922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcbf004f2e0 con 0x7fcbf0105a10 2024-09-13T22:59:23.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.884+0000 7fcbd7fff700 1 -- 172.21.15.2:0/328943922 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7fcbe405c2d0 con 0x7fcbf0105a10 2024-09-13T22:59:23.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.886+0000 7fcbf5768700 1 -- 172.21.15.2:0/328943922 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fcbd806e300 msgr2=0x7fcbd80707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:23.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.886+0000 7fcbf5768700 1 --2- 172.21.15.2:0/328943922 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fcbd806e300 0x7fcbd80707c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00094f0 tx=0x7fcbe0009040 comp rx=0 tx=0).stop 2024-09-13T22:59:23.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.886+0000 7fcbf5768700 1 -- 172.21.15.2:0/328943922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbf0105a10 msgr2=0x7fcbf0196c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:23.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.886+0000 7fcbf5768700 1 --2- 172.21.15.2:0/328943922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbf0105a10 0x7fcbf0196c10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4006010 tx=0x7fcbe400be20 comp rx=0 tx=0).stop 2024-09-13T22:59:23.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.886+0000 7fcbf5768700 1 -- 172.21.15.2:0/328943922 shutdown_connections 2024-09-13T22:59:23.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.886+0000 7fcbf5768700 1 --2- 172.21.15.2:0/328943922 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fcbd806e300 0x7fcbd80707c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:23.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.886+0000 7fcbf5768700 1 --2- 172.21.15.2:0/328943922 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcbf00ffa10 0x7fcbf01966d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:23.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.886+0000 7fcbf5768700 1 --2- 172.21.15.2:0/328943922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcbf0105a10 0x7fcbf0196c10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:23.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.886+0000 7fcbf5768700 1 -- 172.21.15.2:0/328943922 >> 172.21.15.2:0/328943922 conn(0x7fcbf00fb500 msgr2=0x7fcbf00690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:23.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.887+0000 7fcbf5768700 1 -- 172.21.15.2:0/328943922 shutdown_connections 2024-09-13T22:59:23.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:23.887+0000 7fcbf5768700 1 -- 172.21.15.2:0/328943922 wait complete. 2024-09-13T22:59:23.898 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T22:59:24.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:24 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/328943922' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:24.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:24 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/328943922' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:24.583 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-13T22:59:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:59:25.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:25 smithi002 ceph-mon[27637]: pgmap v80: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:25.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:25 smithi047 ceph-mon[34560]: pgmap v80: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:26.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.407+0000 7f0d02eed700 1 -- 172.21.15.2:0/4248358848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc0ffda0 msgr2=0x7f0cfc100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:26.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.407+0000 7f0d02eed700 1 --2- 172.21.15.2:0/4248358848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc0ffda0 0x7f0cfc100180 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009990 tx=0x7f0cec009ca0 comp rx=0 tx=0).stop 2024-09-13T22:59:26.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.407+0000 7f0d02eed700 1 -- 172.21.15.2:0/4248358848 shutdown_connections 2024-09-13T22:59:26.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.407+0000 7f0d02eed700 1 --2- 172.21.15.2:0/4248358848 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cfc100750 0x7f0cfc1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.407+0000 7f0d02eed700 1 --2- 172.21.15.2:0/4248358848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc0ffda0 0x7f0cfc100180 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.407+0000 7f0d02eed700 1 -- 172.21.15.2:0/4248358848 >> 172.21.15.2:0/4248358848 conn(0x7f0cfc0fb650 msgr2=0x7f0cfc0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.407+0000 7f0d02eed700 1 -- 172.21.15.2:0/4248358848 shutdown_connections 2024-09-13T22:59:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.407+0000 7f0d02eed700 1 -- 172.21.15.2:0/4248358848 wait complete. 2024-09-13T22:59:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.408+0000 7f0d02eed700 1 Processor -- start 2024-09-13T22:59:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.408+0000 7f0d02eed700 1 -- start start 2024-09-13T22:59:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.408+0000 7f0d02eed700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cfc0ffda0 0x7f0cfc194680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.408+0000 7f0d02eed700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc100750 0x7f0cfc194bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.408+0000 7f0d02eed700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc195250 con 0x7f0cfc100750 2024-09-13T22:59:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.408+0000 7f0d02eed700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc197f80 con 0x7f0cfc0ffda0 2024-09-13T22:59:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.408+0000 7f0cfbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc100750 0x7f0cfc194bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.408+0000 7f0cfbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc100750 0x7f0cfc194bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50496/0 (socket says 172.21.15.2:50496) 2024-09-13T22:59:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.408+0000 7f0cfbfff700 1 -- 172.21.15.2:0/1737486851 learned_addr learned my addr 172.21.15.2:0/1737486851 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:59:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.409+0000 7f0d00c89700 1 --2- 172.21.15.2:0/1737486851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cfc0ffda0 0x7f0cfc194680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.409+0000 7f0cfbfff700 1 -- 172.21.15.2:0/1737486851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cfc0ffda0 msgr2=0x7f0cfc194680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.409+0000 7f0cfbfff700 1 --2- 172.21.15.2:0/1737486851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cfc0ffda0 0x7f0cfc194680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.409+0000 7f0cfbfff700 1 -- 172.21.15.2:0/1737486851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec0095f0 con 0x7f0cfc100750 2024-09-13T22:59:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.409+0000 7f0cfbfff700 1 --2- 172.21.15.2:0/1737486851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc100750 0x7f0cfc194bc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000d900 tx=0x7f0cf000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.409+0000 7f0cf9ffb700 1 -- 172.21.15.2:0/1737486851 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cf0009900 con 0x7f0cfc100750 2024-09-13T22:59:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.409+0000 7f0d02eed700 1 -- 172.21.15.2:0/1737486851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cfc198260 con 0x7f0cfc100750 2024-09-13T22:59:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.409+0000 7f0cf9ffb700 1 -- 172.21.15.2:0/1737486851 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0cf0010460 con 0x7f0cfc100750 2024-09-13T22:59:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.409+0000 7f0cf9ffb700 1 -- 172.21.15.2:0/1737486851 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cf000f5f0 con 0x7f0cfc100750 2024-09-13T22:59:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.409+0000 7f0d02eed700 1 -- 172.21.15.2:0/1737486851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cfc1987b0 con 0x7f0cfc100750 2024-09-13T22:59:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.411+0000 7f0d02eed700 1 -- 172.21.15.2:0/1737486851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cfc108140 con 0x7f0cfc100750 2024-09-13T22:59:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.411+0000 7f0cf9ffb700 1 -- 172.21.15.2:0/1737486851 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7f0cf00105d0 con 0x7f0cfc100750 2024-09-13T22:59:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.411+0000 7f0cf9ffb700 1 --2- 172.21.15.2:0/1737486851 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f0ce406e300 0x7f0ce40707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.412+0000 7f0cf9ffb700 1 -- 172.21.15.2:0/1737486851 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f0cf008dc80 con 0x7f0cfc100750 2024-09-13T22:59:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.412+0000 7f0d00c89700 1 --2- 172.21.15.2:0/1737486851 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f0ce406e300 0x7f0ce40707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.412+0000 7f0d00c89700 1 --2- 172.21.15.2:0/1737486851 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f0ce406e300 0x7f0ce40707c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0cec006010 tx=0x7f0cec005730 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:26.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.416+0000 7f0cf9ffb700 1 -- 172.21.15.2:0/1737486851 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f0cf0057350 con 0x7f0cfc100750 2024-09-13T22:59:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.709+0000 7f0d02eed700 1 -- 172.21.15.2:0/1737486851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0cfc04f2e0 con 0x7f0cfc100750 2024-09-13T22:59:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.709+0000 7f0cf9ffb700 1 -- 172.21.15.2:0/1737486851 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f0cf005aa10 con 0x7f0cfc100750 2024-09-13T22:59:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.711+0000 7f0d02eed700 1 -- 172.21.15.2:0/1737486851 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f0ce406e300 msgr2=0x7f0ce40707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.711+0000 7f0d02eed700 1 --2- 172.21.15.2:0/1737486851 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f0ce406e300 0x7f0ce40707c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0cec006010 tx=0x7f0cec005730 comp rx=0 tx=0).stop 2024-09-13T22:59:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.711+0000 7f0d02eed700 1 -- 172.21.15.2:0/1737486851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc100750 msgr2=0x7f0cfc194bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.711+0000 7f0d02eed700 1 --2- 172.21.15.2:0/1737486851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc100750 0x7f0cfc194bc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000d900 tx=0x7f0cf000dc10 comp rx=0 tx=0).stop 2024-09-13T22:59:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.711+0000 7f0d02eed700 1 -- 172.21.15.2:0/1737486851 shutdown_connections 2024-09-13T22:59:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.711+0000 7f0d02eed700 1 --2- 172.21.15.2:0/1737486851 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f0ce406e300 0x7f0ce40707c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.711+0000 7f0d02eed700 1 --2- 172.21.15.2:0/1737486851 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0cfc0ffda0 0x7f0cfc194680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.711+0000 7f0d02eed700 1 --2- 172.21.15.2:0/1737486851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc100750 0x7f0cfc194bc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.711+0000 7f0d02eed700 1 -- 172.21.15.2:0/1737486851 >> 172.21.15.2:0/1737486851 conn(0x7f0cfc0fb650 msgr2=0x7f0cfc0fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.712+0000 7f0d02eed700 1 -- 172.21.15.2:0/1737486851 shutdown_connections 2024-09-13T22:59:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:26.712+0000 7f0d02eed700 1 -- 172.21.15.2:0/1737486851 wait complete. 2024-09-13T22:59:26.723 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)" 2024-09-13T22:59:27.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:27 smithi047 ceph-mon[34560]: pgmap v81: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:27.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:27 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/1737486851' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:27.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:27 smithi002 ceph-mon[27637]: pgmap v81: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:27.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:27 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/1737486851' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:27.528 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-13T22:59:27.745 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:59:29.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:29 smithi047 ceph-mon[34560]: pgmap v82: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:29.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.455+0000 7fd7bdcd9700 1 -- 172.21.15.2:0/4190781876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7b8100ea0 msgr2=0x7fd7b8101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:29.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.455+0000 7fd7bdcd9700 1 --2- 172.21.15.2:0/4190781876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7b8100ea0 0x7fd7b8101280 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009910 tx=0x7fd7a0009c20 comp rx=0 tx=0).stop 2024-09-13T22:59:29.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.455+0000 7fd7bdcd9700 1 -- 172.21.15.2:0/4190781876 shutdown_connections 2024-09-13T22:59:29.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.455+0000 7fd7bdcd9700 1 --2- 172.21.15.2:0/4190781876 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b8101850 0x7fd7b81058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:29.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.455+0000 7fd7bdcd9700 1 --2- 172.21.15.2:0/4190781876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7b8100ea0 0x7fd7b8101280 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:29.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.455+0000 7fd7bdcd9700 1 -- 172.21.15.2:0/4190781876 >> 172.21.15.2:0/4190781876 conn(0x7fd7b80fc750 msgr2=0x7fd7b80feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:29.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.455+0000 7fd7bdcd9700 1 -- 172.21.15.2:0/4190781876 shutdown_connections 2024-09-13T22:59:29.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.455+0000 7fd7bdcd9700 1 -- 172.21.15.2:0/4190781876 wait complete. 2024-09-13T22:59:29.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.456+0000 7fd7bdcd9700 1 Processor -- start 2024-09-13T22:59:29.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.456+0000 7fd7bdcd9700 1 -- start start 2024-09-13T22:59:29.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.456+0000 7fd7bdcd9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7b8100ea0 0x7fd7b8196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:29.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.456+0000 7fd7bdcd9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b8101850 0x7fd7b8196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:29.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.456+0000 7fd7bdcd9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b8197560 con 0x7fd7b8100ea0 2024-09-13T22:59:29.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.456+0000 7fd7bdcd9700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b819b370 con 0x7fd7b8101850 2024-09-13T22:59:29.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.457+0000 7fd7b77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7b8100ea0 0x7fd7b8196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:29.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.457+0000 7fd7b77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7b8100ea0 0x7fd7b8196990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50512/0 (socket says 172.21.15.2:50512) 2024-09-13T22:59:29.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.457+0000 7fd7b77fe700 1 -- 172.21.15.2:0/804981091 learned_addr learned my addr 172.21.15.2:0/804981091 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:59:29.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.457+0000 7fd7b6ffd700 1 --2- 172.21.15.2:0/804981091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b8101850 0x7fd7b8196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:29.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.457+0000 7fd7b77fe700 1 -- 172.21.15.2:0/804981091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b8101850 msgr2=0x7fd7b8196ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:29.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.457+0000 7fd7b77fe700 1 --2- 172.21.15.2:0/804981091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b8101850 0x7fd7b8196ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:29.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.457+0000 7fd7b77fe700 1 -- 172.21.15.2:0/804981091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a00095f0 con 0x7fd7b8100ea0 2024-09-13T22:59:29.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.457+0000 7fd7b6ffd700 1 --2- 172.21.15.2:0/804981091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b8101850 0x7fd7b8196ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:59:29.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.457+0000 7fd7b77fe700 1 --2- 172.21.15.2:0/804981091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7b8100ea0 0x7fd7b8196990 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0006010 tx=0x7fd7a000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:29.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.457+0000 7fd7b4ff9700 1 -- 172.21.15.2:0/804981091 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7a001d070 con 0x7fd7b8100ea0 2024-09-13T22:59:29.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.457+0000 7fd7b4ff9700 1 -- 172.21.15.2:0/804981091 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7a0004fb0 con 0x7fd7b8100ea0 2024-09-13T22:59:29.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.457+0000 7fd7bdcd9700 1 -- 172.21.15.2:0/804981091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b819b5f0 con 0x7fd7b8100ea0 2024-09-13T22:59:29.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.457+0000 7fd7b4ff9700 1 -- 172.21.15.2:0/804981091 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7a0022ea0 con 0x7fd7b8100ea0 2024-09-13T22:59:29.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.457+0000 7fd7bdcd9700 1 -- 172.21.15.2:0/804981091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b819bae0 con 0x7fd7b8100ea0 2024-09-13T22:59:29.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.458+0000 7fd7bdcd9700 1 -- 172.21.15.2:0/804981091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b8109240 con 0x7fd7b8100ea0 2024-09-13T22:59:29.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.459+0000 7fd7b4ff9700 1 -- 172.21.15.2:0/804981091 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7fd7a0022470 con 0x7fd7b8100ea0 2024-09-13T22:59:29.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.459+0000 7fd7b4ff9700 1 --2- 172.21.15.2:0/804981091 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fd7a406e300 0x7fd7a40707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:29.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.459+0000 7fd7b4ff9700 1 -- 172.21.15.2:0/804981091 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fd7a008f6d0 con 0x7fd7b8100ea0 2024-09-13T22:59:29.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.460+0000 7fd7b6ffd700 1 --2- 172.21.15.2:0/804981091 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fd7a406e300 0x7fd7a40707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:29.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.460+0000 7fd7b6ffd700 1 --2- 172.21.15.2:0/804981091 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fd7a406e300 0x7fd7a40707c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8197fb0 tx=0x7fd7a8008040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:29.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.464+0000 7fd7b4ff9700 1 -- 172.21.15.2:0/804981091 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7fd7a005c8e0 con 0x7fd7b8100ea0 2024-09-13T22:59:29.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:29 smithi002 ceph-mon[27637]: pgmap v82: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:29.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.765+0000 7fd7bdcd9700 1 -- 172.21.15.2:0/804981091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd7b804f2e0 con 0x7fd7b8100ea0 2024-09-13T22:59:29.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.766+0000 7fd7b4ff9700 1 -- 172.21.15.2:0/804981091 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7fd7a0022720 con 0x7fd7b8100ea0 2024-09-13T22:59:29.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.768+0000 7fd7bdcd9700 1 -- 172.21.15.2:0/804981091 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fd7a406e300 msgr2=0x7fd7a40707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:29.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.768+0000 7fd7bdcd9700 1 --2- 172.21.15.2:0/804981091 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fd7a406e300 0x7fd7a40707c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8197fb0 tx=0x7fd7a8008040 comp rx=0 tx=0).stop 2024-09-13T22:59:29.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.768+0000 7fd7bdcd9700 1 -- 172.21.15.2:0/804981091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7b8100ea0 msgr2=0x7fd7b8196990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:29.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.768+0000 7fd7bdcd9700 1 --2- 172.21.15.2:0/804981091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7b8100ea0 0x7fd7b8196990 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0006010 tx=0x7fd7a000be20 comp rx=0 tx=0).stop 2024-09-13T22:59:29.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.768+0000 7fd7bdcd9700 1 -- 172.21.15.2:0/804981091 shutdown_connections 2024-09-13T22:59:29.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.768+0000 7fd7bdcd9700 1 --2- 172.21.15.2:0/804981091 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fd7a406e300 0x7fd7a40707c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:29.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.768+0000 7fd7bdcd9700 1 --2- 172.21.15.2:0/804981091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7b8100ea0 0x7fd7b8196990 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:29.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.768+0000 7fd7bdcd9700 1 --2- 172.21.15.2:0/804981091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd7b8101850 0x7fd7b8196ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:29.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.768+0000 7fd7bdcd9700 1 -- 172.21.15.2:0/804981091 >> 172.21.15.2:0/804981091 conn(0x7fd7b80fc750 msgr2=0x7fd7b80fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:29.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.768+0000 7fd7bdcd9700 1 -- 172.21.15.2:0/804981091 shutdown_connections 2024-09-13T22:59:29.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:29.768+0000 7fd7bdcd9700 1 -- 172.21.15.2:0/804981091 wait complete. 2024-09-13T22:59:29.780 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T22:59:30.489 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:30 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/804981091' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:30.513 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-13T22:59:30.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:30 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/804981091' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:30.721 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:59:31.488 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:31 smithi002 ceph-mon[27637]: pgmap v83: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:31.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:31 smithi047 ceph-mon[34560]: pgmap v83: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:32.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.283+0000 7fc2bed64700 1 -- 172.21.15.2:0/2258711494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b8100330 msgr2=0x7fc2b810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:32.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.283+0000 7fc2bed64700 1 --2- 172.21.15.2:0/2258711494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b8100330 0x7fc2b810d080 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009910 tx=0x7fc2a4009c20 comp rx=0 tx=0).stop 2024-09-13T22:59:32.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.283+0000 7fc2bed64700 1 -- 172.21.15.2:0/2258711494 shutdown_connections 2024-09-13T22:59:32.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.283+0000 7fc2bed64700 1 --2- 172.21.15.2:0/2258711494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b8100330 0x7fc2b810d080 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:32.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.283+0000 7fc2bed64700 1 --2- 172.21.15.2:0/2258711494 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b80ffa10 0x7fc2b80ffdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:32.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.283+0000 7fc2bed64700 1 -- 172.21.15.2:0/2258711494 >> 172.21.15.2:0/2258711494 conn(0x7fc2b80fb650 msgr2=0x7fc2b80fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:32.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.283+0000 7fc2bed64700 1 -- 172.21.15.2:0/2258711494 shutdown_connections 2024-09-13T22:59:32.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.283+0000 7fc2bed64700 1 -- 172.21.15.2:0/2258711494 wait complete. 2024-09-13T22:59:32.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.284+0000 7fc2bed64700 1 Processor -- start 2024-09-13T22:59:32.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.284+0000 7fc2bed64700 1 -- start start 2024-09-13T22:59:32.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.284+0000 7fc2bed64700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b80ffa10 0x7fc2b819e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:32.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.284+0000 7fc2bed64700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b8100330 0x7fc2b819edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:32.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.284+0000 7fc2bed64700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b819f450 con 0x7fc2b80ffa10 2024-09-13T22:59:32.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.284+0000 7fc2bed64700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b8198900 con 0x7fc2b8100330 2024-09-13T22:59:32.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.284+0000 7fc2bcb00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b80ffa10 0x7fc2b819e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:32.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.284+0000 7fc2bcb00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b80ffa10 0x7fc2b819e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60152/0 (socket says 172.21.15.2:60152) 2024-09-13T22:59:32.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.284+0000 7fc2bcb00700 1 -- 172.21.15.2:0/3464839544 learned_addr learned my addr 172.21.15.2:0/3464839544 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:59:32.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.284+0000 7fc2b7fff700 1 --2- 172.21.15.2:0/3464839544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b8100330 0x7fc2b819edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:32.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.285+0000 7fc2bcb00700 1 -- 172.21.15.2:0/3464839544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b8100330 msgr2=0x7fc2b819edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:32.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.285+0000 7fc2bcb00700 1 --2- 172.21.15.2:0/3464839544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b8100330 0x7fc2b819edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:32.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.285+0000 7fc2bcb00700 1 -- 172.21.15.2:0/3464839544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a40095f0 con 0x7fc2b80ffa10 2024-09-13T22:59:32.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.285+0000 7fc2bcb00700 1 --2- 172.21.15.2:0/3464839544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b80ffa10 0x7fc2b819e880 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00d8d0 tx=0x7fc2ac00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:32.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.285+0000 7fc2b5ffb700 1 -- 172.21.15.2:0/3464839544 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2ac0098a0 con 0x7fc2b80ffa10 2024-09-13T22:59:32.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.285+0000 7fc2b5ffb700 1 -- 172.21.15.2:0/3464839544 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2ac010460 con 0x7fc2b80ffa10 2024-09-13T22:59:32.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.285+0000 7fc2bed64700 1 -- 172.21.15.2:0/3464839544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b8198be0 con 0x7fc2b80ffa10 2024-09-13T22:59:32.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.285+0000 7fc2b5ffb700 1 -- 172.21.15.2:0/3464839544 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2ac00f5f0 con 0x7fc2b80ffa10 2024-09-13T22:59:32.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.285+0000 7fc2bed64700 1 -- 172.21.15.2:0/3464839544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b8199100 con 0x7fc2b80ffa10 2024-09-13T22:59:32.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.286+0000 7fc2bed64700 1 -- 172.21.15.2:0/3464839544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b810a7f0 con 0x7fc2b80ffa10 2024-09-13T22:59:32.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.287+0000 7fc2b5ffb700 1 -- 172.21.15.2:0/3464839544 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7fc2ac009a00 con 0x7fc2b80ffa10 2024-09-13T22:59:32.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.287+0000 7fc2b5ffb700 1 --2- 172.21.15.2:0/3464839544 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fc2a806e300 0x7fc2a80707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:32.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.287+0000 7fc2b5ffb700 1 -- 172.21.15.2:0/3464839544 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fc2ac08df90 con 0x7fc2b80ffa10 2024-09-13T22:59:32.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.287+0000 7fc2b7fff700 1 --2- 172.21.15.2:0/3464839544 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fc2a806e300 0x7fc2a80707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:32.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.288+0000 7fc2b7fff700 1 --2- 172.21.15.2:0/3464839544 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fc2a806e300 0x7fc2a80707c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4006010 tx=0x7fc2a4005a90 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:32.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.292+0000 7fc2b5ffb700 1 -- 172.21.15.2:0/3464839544 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7fc2ac05b190 con 0x7fc2b80ffa10 2024-09-13T22:59:32.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:32.519+0000 7fc2bed64700 1 -- 172.21.15.2:0/3464839544 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2b8199320 con 0x7fc2a806e300 2024-09-13T22:59:33.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:33 smithi002 ceph-mon[27637]: pgmap v84: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:33.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:33 smithi002 ceph-mon[27637]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:33.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:33 smithi047 ceph-mon[34560]: pgmap v84: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:33.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:33 smithi047 ceph-mon[34560]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:34.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:34.432+0000 7fc2b5ffb700 1 -- 172.21.15.2:0/3464839544 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5393 (secure 0 0 0) 0x7fc2b8199320 con 0x7fc2a806e300 2024-09-13T22:59:34.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:34.434+0000 7fc2bed64700 1 -- 172.21.15.2:0/3464839544 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fc2a806e300 msgr2=0x7fc2a80707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:34.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:34.435+0000 7fc2bed64700 1 --2- 172.21.15.2:0/3464839544 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fc2a806e300 0x7fc2a80707c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4006010 tx=0x7fc2a4005a90 comp rx=0 tx=0).stop 2024-09-13T22:59:34.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:34.435+0000 7fc2bed64700 1 -- 172.21.15.2:0/3464839544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b80ffa10 msgr2=0x7fc2b819e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:34.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:34.435+0000 7fc2bed64700 1 --2- 172.21.15.2:0/3464839544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b80ffa10 0x7fc2b819e880 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00d8d0 tx=0x7fc2ac00dbe0 comp rx=0 tx=0).stop 2024-09-13T22:59:34.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:34.435+0000 7fc2bed64700 1 -- 172.21.15.2:0/3464839544 shutdown_connections 2024-09-13T22:59:34.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:34.435+0000 7fc2bed64700 1 --2- 172.21.15.2:0/3464839544 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fc2a806e300 0x7fc2a80707c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:34.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:34.435+0000 7fc2bed64700 1 --2- 172.21.15.2:0/3464839544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b80ffa10 0x7fc2b819e880 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:34.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:34.435+0000 7fc2bed64700 1 --2- 172.21.15.2:0/3464839544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2b8100330 0x7fc2b819edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:34.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:34.435+0000 7fc2bed64700 1 -- 172.21.15.2:0/3464839544 >> 172.21.15.2:0/3464839544 conn(0x7fc2b80fb650 msgr2=0x7fc2b80fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:34.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:34.435+0000 7fc2bed64700 1 -- 172.21.15.2:0/3464839544 shutdown_connections 2024-09-13T22:59:34.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:34.435+0000 7fc2bed64700 1 -- 172.21.15.2:0/3464839544 wait complete. 2024-09-13T22:59:34.447 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T22:59:35.053 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch ps' 2024-09-13T22:59:35.263 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:59:35.383 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:35 smithi002 ceph-mon[27637]: pgmap v85: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:35.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:35 smithi047 ceph-mon[34560]: pgmap v85: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:36.355 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:36 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:59:36.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:36 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:59:36.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.901+0000 7f08b6f19700 1 -- 172.21.15.2:0/591602315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b0101e00 msgr2=0x7f08b01021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:36.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.901+0000 7f08b6f19700 1 --2- 172.21.15.2:0/591602315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b0101e00 0x7f08b01021e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f08a0009910 tx=0x7f08a0009c20 comp rx=0 tx=0).stop 2024-09-13T22:59:36.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.901+0000 7f08b6f19700 1 -- 172.21.15.2:0/591602315 shutdown_connections 2024-09-13T22:59:36.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.901+0000 7f08b6f19700 1 --2- 172.21.15.2:0/591602315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b0102720 0x7f08b010ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:36.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.901+0000 7f08b6f19700 1 --2- 172.21.15.2:0/591602315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b0101e00 0x7f08b01021e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:36.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.901+0000 7f08b6f19700 1 -- 172.21.15.2:0/591602315 >> 172.21.15.2:0/591602315 conn(0x7f08b00fb650 msgr2=0x7f08b00fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:36.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.901+0000 7f08b6f19700 1 -- 172.21.15.2:0/591602315 shutdown_connections 2024-09-13T22:59:36.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.901+0000 7f08b6f19700 1 -- 172.21.15.2:0/591602315 wait complete. 2024-09-13T22:59:36.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.902+0000 7f08b6f19700 1 Processor -- start 2024-09-13T22:59:36.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.902+0000 7f08b6f19700 1 -- start start 2024-09-13T22:59:36.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.902+0000 7f08b6f19700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b0101e00 0x7f08b01969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:36.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.902+0000 7f08b6f19700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b0102720 0x7f08b0196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:36.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.902+0000 7f08b6f19700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b01975b0 con 0x7f08b0102720 2024-09-13T22:59:36.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.902+0000 7f08b6f19700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b019b370 con 0x7f08b0101e00 2024-09-13T22:59:36.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.902+0000 7f08affff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b0102720 0x7f08b0196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:36.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.902+0000 7f08affff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b0102720 0x7f08b0196f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60176/0 (socket says 172.21.15.2:60176) 2024-09-13T22:59:36.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.902+0000 7f08affff700 1 -- 172.21.15.2:0/2702453621 learned_addr learned my addr 172.21.15.2:0/2702453621 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:59:36.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.903+0000 7f08affff700 1 -- 172.21.15.2:0/2702453621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b0101e00 msgr2=0x7f08b01969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:36.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.903+0000 7f08affff700 1 --2- 172.21.15.2:0/2702453621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b0101e00 0x7f08b01969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:36.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.903+0000 7f08affff700 1 -- 172.21.15.2:0/2702453621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a00095f0 con 0x7f08b0102720 2024-09-13T22:59:36.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.903+0000 7f08affff700 1 --2- 172.21.15.2:0/2702453621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b0102720 0x7f08b0196f20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f08a400b4d0 tx=0x7f08a400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:36.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.903+0000 7f08adffb700 1 -- 172.21.15.2:0/2702453621 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08a4011800 con 0x7f08b0102720 2024-09-13T22:59:36.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.903+0000 7f08adffb700 1 -- 172.21.15.2:0/2702453621 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f08a4011e20 con 0x7f08b0102720 2024-09-13T22:59:36.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.903+0000 7f08adffb700 1 -- 172.21.15.2:0/2702453621 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08a400f2e0 con 0x7f08b0102720 2024-09-13T22:59:36.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.903+0000 7f08b6f19700 1 -- 172.21.15.2:0/2702453621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b019b650 con 0x7f08b0102720 2024-09-13T22:59:36.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.903+0000 7f08b6f19700 1 -- 172.21.15.2:0/2702453621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b019bba0 con 0x7f08b0102720 2024-09-13T22:59:36.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.904+0000 7f08b6f19700 1 -- 172.21.15.2:0/2702453621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b0108310 con 0x7f08b0102720 2024-09-13T22:59:36.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.905+0000 7f08adffb700 1 -- 172.21.15.2:0/2702453621 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7f08a4010380 con 0x7f08b0102720 2024-09-13T22:59:36.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.905+0000 7f08adffb700 1 --2- 172.21.15.2:0/2702453621 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f089806e300 0x7f08980707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:36.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.905+0000 7f08adffb700 1 -- 172.21.15.2:0/2702453621 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f08a408db90 con 0x7f08b0102720 2024-09-13T22:59:36.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.905+0000 7f08b4cb5700 1 --2- 172.21.15.2:0/2702453621 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f089806e300 0x7f08980707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:36.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.906+0000 7f08b4cb5700 1 --2- 172.21.15.2:0/2702453621 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f089806e300 0x7f08980707c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f08a0009fd0 tx=0x7f08a0005fb0 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:36.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:36.910+0000 7f08adffb700 1 -- 172.21.15.2:0/2702453621 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f08a405ae10 con 0x7f08b0102720 2024-09-13T22:59:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:37.129+0000 7f08b6f19700 1 -- 172.21.15.2:0/2702453621 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f08b019be70 con 0x7f089806e300 2024-09-13T22:59:37.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:37.138+0000 7f08adffb700 1 -- 172.21.15.2:0/2702453621 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f08b019be70 con 0x7f089806e300 2024-09-13T22:59:37.139 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:59:37.139 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (69s) 39s ago 11m 16.4M - 0.25.0 c8568f914cd2 f570a73274bc 2024-09-13T22:59:37.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (12m) 39s ago 12m 7872k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T22:59:37.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (11m) 100s ago 11m 7784k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T22:59:37.140 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (12m) 39s ago 12m 6669k - 18.2.1 5be31c24972a de910e0c5157 2024-09-13T22:59:37.140 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (11m) 100s ago 11m 6651k - 18.2.1 5be31c24972a 9f4bcfa66588 2024-09-13T22:59:37.140 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (46s) 39s ago 11m 45.9M - 9.4.12 2bacad6d85d8 650673516b69 2024-09-13T22:59:37.140 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (6m) 39s ago 6m 14.7M - 18.2.1 5be31c24972a 59e9c88c31ca 2024-09-13T22:59:37.140 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (6m) 39s ago 6m 90.6M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T22:59:37.140 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (6m) 100s ago 6m 204M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T22:59:37.140 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (6m) 100s ago 6m 17.3M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T22:59:37.140 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 running (2m) 39s ago 13m 503M - 19.1.1-324-gecab7be5 0652ff2b5d78 7a8aa9de37e4 2024-09-13T22:59:37.140 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (2m) 100s ago 10m 439M - 19.1.1-324-gecab7be5 0652ff2b5d78 13fa6f3b5a8a 2024-09-13T22:59:37.140 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (13m) 39s ago 13m 53.9M 2048M 18.2.1 5be31c24972a de11be74385d 2024-09-13T22:59:37.140 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (10m) 100s ago 10m 42.0M 2048M 18.2.1 5be31c24972a 5642284a23bf 2024-09-13T22:59:37.140 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (115s) 39s ago 12m 8212k - 1.5.0 0da6a335fe13 f3eae5f90ab8 2024-09-13T22:59:37.140 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (109s) 100s ago 11m 3623k - 1.5.0 0da6a335fe13 a5c7d7f1eaa5 2024-09-13T22:59:37.140 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (10m) 39s ago 10m 208M 1217M 18.2.1 5be31c24972a 1e1f6936c402 2024-09-13T22:59:37.141 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (9m) 39s ago 9m 225M 1217M 18.2.1 5be31c24972a f0ac78c34831 2024-09-13T22:59:37.141 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (9m) 39s ago 9m 186M 1217M 18.2.1 5be31c24972a 9a2f4f6decfb 2024-09-13T22:59:37.141 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (8m) 100s ago 8m 251M 2241M 18.2.1 5be31c24972a fb455cc4c571 2024-09-13T22:59:37.141 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (8m) 100s ago 8m 216M 2241M 18.2.1 5be31c24972a f1bdc2c50535 2024-09-13T22:59:37.141 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (7m) 100s ago 7m 191M 2241M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T22:59:37.141 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (87s) 39s ago 11m 55.8M - 2.43.0 a07b618ecd1d aa241d1048de 2024-09-13T22:59:37.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:37.141+0000 7f08b6f19700 1 -- 172.21.15.2:0/2702453621 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f089806e300 msgr2=0x7f08980707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:37.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:37.141+0000 7f08b6f19700 1 --2- 172.21.15.2:0/2702453621 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f089806e300 0x7f08980707c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f08a0009fd0 tx=0x7f08a0005fb0 comp rx=0 tx=0).stop 2024-09-13T22:59:37.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:37.141+0000 7f08b6f19700 1 -- 172.21.15.2:0/2702453621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b0102720 msgr2=0x7f08b0196f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:37.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:37.141+0000 7f08b6f19700 1 --2- 172.21.15.2:0/2702453621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b0102720 0x7f08b0196f20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f08a400b4d0 tx=0x7f08a400b890 comp rx=0 tx=0).stop 2024-09-13T22:59:37.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:37.141+0000 7f08b6f19700 1 -- 172.21.15.2:0/2702453621 shutdown_connections 2024-09-13T22:59:37.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:37.141+0000 7f08b6f19700 1 --2- 172.21.15.2:0/2702453621 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f089806e300 0x7f08980707c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:37.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:37.141+0000 7f08b6f19700 1 --2- 172.21.15.2:0/2702453621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b0101e00 0x7f08b01969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:37.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:37.141+0000 7f08b6f19700 1 --2- 172.21.15.2:0/2702453621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b0102720 0x7f08b0196f20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:37.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:37.141+0000 7f08b6f19700 1 -- 172.21.15.2:0/2702453621 >> 172.21.15.2:0/2702453621 conn(0x7f08b00fb650 msgr2=0x7f08b0105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:37.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:37.141+0000 7f08b6f19700 1 -- 172.21.15.2:0/2702453621 shutdown_connections 2024-09-13T22:59:37.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:37.141+0000 7f08b6f19700 1 -- 172.21.15.2:0/2702453621 wait complete. 2024-09-13T22:59:37.454 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:37 smithi002 ceph-mon[27637]: pgmap v86: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:37.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:37 smithi047 ceph-mon[34560]: pgmap v86: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:37.768 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T22:59:37.769 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-13T22:59:37.769 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-13T22:59:37.979 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:59:38.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:38 smithi002 ceph-mon[27637]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:38.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:38 smithi047 ceph-mon[34560]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:39.319 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:39 smithi002 ceph-mon[27637]: pgmap v87: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:39.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.541+0000 7f8be558c700 1 -- 172.21.15.2:0/3527680927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8be0100ea0 msgr2=0x7f8be0101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:39.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.541+0000 7f8be558c700 1 --2- 172.21.15.2:0/3527680927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8be0100ea0 0x7f8be0101280 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0009910 tx=0x7f8bd0009c20 comp rx=0 tx=0).stop 2024-09-13T22:59:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.541+0000 7f8be558c700 1 -- 172.21.15.2:0/3527680927 shutdown_connections 2024-09-13T22:59:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.541+0000 7f8be558c700 1 --2- 172.21.15.2:0/3527680927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8be0101850 0x7f8be01058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.541+0000 7f8be558c700 1 --2- 172.21.15.2:0/3527680927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8be0100ea0 0x7f8be0101280 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.541+0000 7f8be558c700 1 -- 172.21.15.2:0/3527680927 >> 172.21.15.2:0/3527680927 conn(0x7f8be00fc750 msgr2=0x7f8be00feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.541+0000 7f8be558c700 1 -- 172.21.15.2:0/3527680927 shutdown_connections 2024-09-13T22:59:39.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.541+0000 7f8be558c700 1 -- 172.21.15.2:0/3527680927 wait complete. 2024-09-13T22:59:39.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.542+0000 7f8be558c700 1 Processor -- start 2024-09-13T22:59:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.542+0000 7f8be558c700 1 -- start start 2024-09-13T22:59:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.542+0000 7f8be558c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8be0100ea0 0x7f8be0073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.542+0000 7f8be558c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8be0101850 0x7f8be00735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.542+0000 7f8be558c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be0073b10 con 0x7f8be0101850 2024-09-13T22:59:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.542+0000 7f8be558c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be0073c50 con 0x7f8be0100ea0 2024-09-13T22:59:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.542+0000 7f8bd7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8be0101850 0x7f8be00735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.542+0000 7f8bd7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8be0101850 0x7f8be00735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60188/0 (socket says 172.21.15.2:60188) 2024-09-13T22:59:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.542+0000 7f8bd7fff700 1 -- 172.21.15.2:0/2901440437 learned_addr learned my addr 172.21.15.2:0/2901440437 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:59:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.543+0000 7f8bdeffd700 1 --2- 172.21.15.2:0/2901440437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8be0100ea0 0x7f8be0073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.543+0000 7f8bd7fff700 1 -- 172.21.15.2:0/2901440437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8be0100ea0 msgr2=0x7f8be0073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.543+0000 7f8bd7fff700 1 --2- 172.21.15.2:0/2901440437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8be0100ea0 0x7f8be0073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:39.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.543+0000 7f8bd7fff700 1 -- 172.21.15.2:0/2901440437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd00095f0 con 0x7f8be0101850 2024-09-13T22:59:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.543+0000 7f8bd7fff700 1 --2- 172.21.15.2:0/2901440437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8be0101850 0x7f8be00735d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8bc800c8f0 tx=0x7f8bc800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.543+0000 7f8bdcff9700 1 -- 172.21.15.2:0/2901440437 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bc80078a0 con 0x7f8be0101850 2024-09-13T22:59:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.543+0000 7f8bdcff9700 1 -- 172.21.15.2:0/2901440437 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8bc800f450 con 0x7f8be0101850 2024-09-13T22:59:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.543+0000 7f8be558c700 1 -- 172.21.15.2:0/2901440437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be01a2af0 con 0x7f8be0101850 2024-09-13T22:59:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.543+0000 7f8bdcff9700 1 -- 172.21.15.2:0/2901440437 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bc8018610 con 0x7f8be0101850 2024-09-13T22:59:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.543+0000 7f8be558c700 1 -- 172.21.15.2:0/2901440437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be01a2f00 con 0x7f8be0101850 2024-09-13T22:59:39.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.544+0000 7f8be558c700 1 -- 172.21.15.2:0/2901440437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be0109240 con 0x7f8be0101850 2024-09-13T22:59:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.545+0000 7f8bdcff9700 1 -- 172.21.15.2:0/2901440437 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7f8bc800f5c0 con 0x7f8be0101850 2024-09-13T22:59:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.545+0000 7f8bdcff9700 1 --2- 172.21.15.2:0/2901440437 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f8bcc06e300 0x7f8bcc0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.545+0000 7f8bdcff9700 1 -- 172.21.15.2:0/2901440437 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f8bc808e000 con 0x7f8be0101850 2024-09-13T22:59:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.545+0000 7f8bdeffd700 1 --2- 172.21.15.2:0/2901440437 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f8bcc06e300 0x7f8bcc0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.546+0000 7f8bdeffd700 1 --2- 172.21.15.2:0/2901440437 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f8bcc06e300 0x7f8bcc0707c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0006010 tx=0x7f8bd001a040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:39.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.550+0000 7f8bdcff9700 1 -- 172.21.15.2:0/2901440437 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f8bc80576d0 con 0x7f8be0101850 2024-09-13T22:59:39.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:39 smithi047 ceph-mon[34560]: pgmap v87: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:39.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.766+0000 7f8be558c700 1 -- 172.21.15.2:0/2901440437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f8be004f2e0 con 0x7f8be0101850 2024-09-13T22:59:39.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.770+0000 7f8bdcff9700 1 -- 172.21.15.2:0/2901440437 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v45)=0 v45) v1 ==== 125+0+0 (secure 0 0 0) 0x7f8bc805ad90 con 0x7f8be0101850 2024-09-13T22:59:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.773+0000 7f8be558c700 1 -- 172.21.15.2:0/2901440437 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f8bcc06e300 msgr2=0x7f8bcc0707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.773+0000 7f8be558c700 1 --2- 172.21.15.2:0/2901440437 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f8bcc06e300 0x7f8bcc0707c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0006010 tx=0x7f8bd001a040 comp rx=0 tx=0).stop 2024-09-13T22:59:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.773+0000 7f8be558c700 1 -- 172.21.15.2:0/2901440437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8be0101850 msgr2=0x7f8be00735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.773+0000 7f8be558c700 1 --2- 172.21.15.2:0/2901440437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8be0101850 0x7f8be00735d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8bc800c8f0 tx=0x7f8bc800cc00 comp rx=0 tx=0).stop 2024-09-13T22:59:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.773+0000 7f8be558c700 1 -- 172.21.15.2:0/2901440437 shutdown_connections 2024-09-13T22:59:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.773+0000 7f8be558c700 1 --2- 172.21.15.2:0/2901440437 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f8bcc06e300 0x7f8bcc0707c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.773+0000 7f8be558c700 1 --2- 172.21.15.2:0/2901440437 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8be0100ea0 0x7f8be0073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.773+0000 7f8be558c700 1 --2- 172.21.15.2:0/2901440437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8be0101850 0x7f8be00735d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.773+0000 7f8be558c700 1 -- 172.21.15.2:0/2901440437 >> 172.21.15.2:0/2901440437 conn(0x7f8be00fc750 msgr2=0x7f8be00fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.773+0000 7f8be558c700 1 -- 172.21.15.2:0/2901440437 shutdown_connections 2024-09-13T22:59:39.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:39.773+0000 7f8be558c700 1 -- 172.21.15.2:0/2901440437 wait complete. 2024-09-13T22:59:40.516 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T22:59:40.517 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-13T22:59:40.517 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-13T22:59:40.725 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:59:41.105 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:40 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2901440437' entity='client.admin' 2024-09-13T22:59:41.106 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:40 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:59:41.106 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:40 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:41.106 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:40 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:59:41.106 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:40 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:41.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:40 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/2901440437' entity='client.admin' 2024-09-13T22:59:41.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:40 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:59:41.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:40 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:41.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:40 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:59:41.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:40 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:41.827 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:41 smithi002 ceph-mon[27637]: pgmap v88: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:42.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:41 smithi047 ceph-mon[34560]: pgmap v88: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:42.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.383+0000 7f875b64b700 1 -- 172.21.15.2:0/3476943034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8754101e00 msgr2=0x7f87541021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:42.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.383+0000 7f875b64b700 1 --2- 172.21.15.2:0/3476943034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8754101e00 0x7f87541021e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8750009910 tx=0x7f8750009c20 comp rx=0 tx=0).stop 2024-09-13T22:59:42.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.383+0000 7f875b64b700 1 -- 172.21.15.2:0/3476943034 shutdown_connections 2024-09-13T22:59:42.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.383+0000 7f875b64b700 1 --2- 172.21.15.2:0/3476943034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8754102720 0x7f875410ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:42.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.383+0000 7f875b64b700 1 --2- 172.21.15.2:0/3476943034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8754101e00 0x7f87541021e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:42.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.383+0000 7f875b64b700 1 -- 172.21.15.2:0/3476943034 >> 172.21.15.2:0/3476943034 conn(0x7f87540fb650 msgr2=0x7f87540fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:42.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.383+0000 7f875b64b700 1 -- 172.21.15.2:0/3476943034 shutdown_connections 2024-09-13T22:59:42.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.383+0000 7f875b64b700 1 -- 172.21.15.2:0/3476943034 wait complete. 2024-09-13T22:59:42.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.384+0000 7f875b64b700 1 Processor -- start 2024-09-13T22:59:42.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.384+0000 7f875b64b700 1 -- start start 2024-09-13T22:59:42.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.384+0000 7f875b64b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8754101e00 0x7f87540ffa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:42.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.384+0000 7f875b64b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8754102720 0x7f87540fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:42.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.384+0000 7f875b64b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87541004e0 con 0x7f8754102720 2024-09-13T22:59:42.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.384+0000 7f875b64b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8754100620 con 0x7f8754101e00 2024-09-13T22:59:42.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.384+0000 7f8758be6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8754102720 0x7f87540fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:42.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.384+0000 7f8758be6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8754102720 0x7f87540fffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60900/0 (socket says 172.21.15.2:60900) 2024-09-13T22:59:42.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.384+0000 7f8758be6700 1 -- 172.21.15.2:0/269007844 learned_addr learned my addr 172.21.15.2:0/269007844 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:59:42.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.384+0000 7f87593e7700 1 --2- 172.21.15.2:0/269007844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8754101e00 0x7f87540ffa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:42.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.384+0000 7f8758be6700 1 -- 172.21.15.2:0/269007844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8754101e00 msgr2=0x7f87540ffa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:42.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.384+0000 7f8758be6700 1 --2- 172.21.15.2:0/269007844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8754101e00 0x7f87540ffa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:42.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.384+0000 7f8758be6700 1 -- 172.21.15.2:0/269007844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87500095f0 con 0x7f8754102720 2024-09-13T22:59:42.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.384+0000 7f87593e7700 1 --2- 172.21.15.2:0/269007844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8754101e00 0x7f87540ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:59:42.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.385+0000 7f8758be6700 1 --2- 172.21.15.2:0/269007844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8754102720 0x7f87540fffa0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f874400b4d0 tx=0x7f874400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:42.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.385+0000 7f874a7fc700 1 -- 172.21.15.2:0/269007844 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8744011800 con 0x7f8754102720 2024-09-13T22:59:42.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.385+0000 7f874a7fc700 1 -- 172.21.15.2:0/269007844 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8744011e20 con 0x7f8754102720 2024-09-13T22:59:42.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.385+0000 7f875b64b700 1 -- 172.21.15.2:0/269007844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87541a2bb0 con 0x7f8754102720 2024-09-13T22:59:42.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.385+0000 7f874a7fc700 1 -- 172.21.15.2:0/269007844 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f874400f2e0 con 0x7f8754102720 2024-09-13T22:59:42.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.385+0000 7f875b64b700 1 -- 172.21.15.2:0/269007844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87541a2f60 con 0x7f8754102720 2024-09-13T22:59:42.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.386+0000 7f875b64b700 1 -- 172.21.15.2:0/269007844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8754108310 con 0x7f8754102720 2024-09-13T22:59:42.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.386+0000 7f874a7fc700 1 -- 172.21.15.2:0/269007844 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7f8744010380 con 0x7f8754102720 2024-09-13T22:59:42.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.387+0000 7f874a7fc700 1 --2- 172.21.15.2:0/269007844 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f874006e300 0x7f87400707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:42.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.387+0000 7f874a7fc700 1 -- 172.21.15.2:0/269007844 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f874408dc80 con 0x7f8754102720 2024-09-13T22:59:42.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.387+0000 7f87593e7700 1 --2- 172.21.15.2:0/269007844 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f874006e300 0x7f87400707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:42.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.387+0000 7f87593e7700 1 --2- 172.21.15.2:0/269007844 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f874006e300 0x7f87400707c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8750006010 tx=0x7f87500058e0 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:42.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.392+0000 7f874a7fc700 1 -- 172.21.15.2:0/269007844 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f87440572b0 con 0x7f8754102720 2024-09-13T22:59:42.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.597+0000 7f875b64b700 1 -- 172.21.15.2:0/269007844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f87541007e0 con 0x7f8754102720 2024-09-13T22:59:42.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.598+0000 7f874a7fc700 1 -- 172.21.15.2:0/269007844 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v45)=0 v45) v1 ==== 155+0+0 (secure 0 0 0) 0x7f874405a970 con 0x7f8754102720 2024-09-13T22:59:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.600+0000 7f875b64b700 1 -- 172.21.15.2:0/269007844 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f874006e300 msgr2=0x7f87400707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.600+0000 7f875b64b700 1 --2- 172.21.15.2:0/269007844 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f874006e300 0x7f87400707c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8750006010 tx=0x7f87500058e0 comp rx=0 tx=0).stop 2024-09-13T22:59:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.600+0000 7f875b64b700 1 -- 172.21.15.2:0/269007844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8754102720 msgr2=0x7f87540fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.600+0000 7f875b64b700 1 --2- 172.21.15.2:0/269007844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8754102720 0x7f87540fffa0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f874400b4d0 tx=0x7f874400b890 comp rx=0 tx=0).stop 2024-09-13T22:59:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.600+0000 7f875b64b700 1 -- 172.21.15.2:0/269007844 shutdown_connections 2024-09-13T22:59:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.600+0000 7f875b64b700 1 --2- 172.21.15.2:0/269007844 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f874006e300 0x7f87400707c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.600+0000 7f875b64b700 1 --2- 172.21.15.2:0/269007844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8754101e00 0x7f87540ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.600+0000 7f875b64b700 1 --2- 172.21.15.2:0/269007844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8754102720 0x7f87540fffa0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.600+0000 7f875b64b700 1 -- 172.21.15.2:0/269007844 >> 172.21.15.2:0/269007844 conn(0x7f87540fb650 msgr2=0x7f8754105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.600+0000 7f875b64b700 1 -- 172.21.15.2:0/269007844 shutdown_connections 2024-09-13T22:59:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:42.600+0000 7f875b64b700 1 -- 172.21.15.2:0/269007844 wait complete. 2024-09-13T22:59:43.224 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-13T22:59:43.435 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:59:44.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:43 smithi047 ceph-mon[34560]: pgmap v89: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:44.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:43 smithi002 ceph-mon[27637]: pgmap v89: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:45.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.165+0000 7fc27bc9e700 1 -- 172.21.15.2:0/1803448357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc274068580 msgr2=0x7fc274068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:45.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.165+0000 7fc27bc9e700 1 --2- 172.21.15.2:0/1803448357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc274068580 0x7fc274068960 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc270009910 tx=0x7fc270009c20 comp rx=0 tx=0).stop 2024-09-13T22:59:45.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.165+0000 7fc27bc9e700 1 -- 172.21.15.2:0/1803448357 shutdown_connections 2024-09-13T22:59:45.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.165+0000 7fc27bc9e700 1 --2- 172.21.15.2:0/1803448357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc274068ea0 0x7fc27410d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:45.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.165+0000 7fc27bc9e700 1 --2- 172.21.15.2:0/1803448357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc274068580 0x7fc274068960 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:45.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.165+0000 7fc27bc9e700 1 -- 172.21.15.2:0/1803448357 >> 172.21.15.2:0/1803448357 conn(0x7fc274075670 msgr2=0x7fc274075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:45.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.165+0000 7fc27bc9e700 1 -- 172.21.15.2:0/1803448357 shutdown_connections 2024-09-13T22:59:45.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.165+0000 7fc27bc9e700 1 -- 172.21.15.2:0/1803448357 wait complete. 2024-09-13T22:59:45.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.166+0000 7fc27bc9e700 1 Processor -- start 2024-09-13T22:59:45.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.166+0000 7fc27bc9e700 1 -- start start 2024-09-13T22:59:45.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.166+0000 7fc27bc9e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc274068580 0x7fc27419e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:45.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.166+0000 7fc27bc9e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc274068ea0 0x7fc27419eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:45.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.166+0000 7fc27bc9e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27419f430 con 0x7fc274068580 2024-09-13T22:59:45.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.166+0000 7fc27bc9e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2741988e0 con 0x7fc274068ea0 2024-09-13T22:59:45.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.166+0000 7fc279a3a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc274068580 0x7fc27419e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:45.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.166+0000 7fc279a3a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc274068580 0x7fc27419e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60916/0 (socket says 172.21.15.2:60916) 2024-09-13T22:59:45.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.166+0000 7fc279a3a700 1 -- 172.21.15.2:0/589728651 learned_addr learned my addr 172.21.15.2:0/589728651 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:59:45.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.167+0000 7fc279239700 1 --2- 172.21.15.2:0/589728651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc274068ea0 0x7fc27419eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:45.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.167+0000 7fc279a3a700 1 -- 172.21.15.2:0/589728651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc274068ea0 msgr2=0x7fc27419eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:45.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.167+0000 7fc279a3a700 1 --2- 172.21.15.2:0/589728651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc274068ea0 0x7fc27419eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:45.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.167+0000 7fc279a3a700 1 -- 172.21.15.2:0/589728651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2700095f0 con 0x7fc274068580 2024-09-13T22:59:45.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.167+0000 7fc279a3a700 1 --2- 172.21.15.2:0/589728651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc274068580 0x7fc27419e860 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc270006010 tx=0x7fc27000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:45.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.167+0000 7fc26affd700 1 -- 172.21.15.2:0/589728651 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc27001d070 con 0x7fc274068580 2024-09-13T22:59:45.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.167+0000 7fc26affd700 1 -- 172.21.15.2:0/589728651 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc27000f460 con 0x7fc274068580 2024-09-13T22:59:45.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.167+0000 7fc27bc9e700 1 -- 172.21.15.2:0/589728651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc274198b60 con 0x7fc274068580 2024-09-13T22:59:45.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.167+0000 7fc26affd700 1 -- 172.21.15.2:0/589728651 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc270017630 con 0x7fc274068580 2024-09-13T22:59:45.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.167+0000 7fc27bc9e700 1 -- 172.21.15.2:0/589728651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc274199050 con 0x7fc274068580 2024-09-13T22:59:45.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.168+0000 7fc27bc9e700 1 -- 172.21.15.2:0/589728651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27410aa00 con 0x7fc274068580 2024-09-13T22:59:45.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.169+0000 7fc26affd700 1 -- 172.21.15.2:0/589728651 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7fc27000f5d0 con 0x7fc274068580 2024-09-13T22:59:45.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.169+0000 7fc26affd700 1 --2- 172.21.15.2:0/589728651 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fc26006e300 0x7fc2600707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:45.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.169+0000 7fc26affd700 1 -- 172.21.15.2:0/589728651 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fc27008f4c0 con 0x7fc274068580 2024-09-13T22:59:45.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.169+0000 7fc279239700 1 --2- 172.21.15.2:0/589728651 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fc26006e300 0x7fc2600707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:45.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.170+0000 7fc279239700 1 --2- 172.21.15.2:0/589728651 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fc26006e300 0x7fc2600707c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc264005950 tx=0x7fc2640058e0 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:45.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.174+0000 7fc26affd700 1 -- 172.21.15.2:0/589728651 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7fc27005c740 con 0x7fc274068580 2024-09-13T22:59:45.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.380+0000 7fc27bc9e700 1 -- 172.21.15.2:0/589728651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fc27410a3e0 con 0x7fc274068580 2024-09-13T22:59:45.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.380+0000 7fc26affd700 1 -- 172.21.15.2:0/589728651 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v45)=0 v45) v1 ==== 163+0+0 (secure 0 0 0) 0x7fc27005c2d0 con 0x7fc274068580 2024-09-13T22:59:45.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.382+0000 7fc27bc9e700 1 -- 172.21.15.2:0/589728651 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fc26006e300 msgr2=0x7fc2600707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:45.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.382+0000 7fc27bc9e700 1 --2- 172.21.15.2:0/589728651 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fc26006e300 0x7fc2600707c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc264005950 tx=0x7fc2640058e0 comp rx=0 tx=0).stop 2024-09-13T22:59:45.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.382+0000 7fc27bc9e700 1 -- 172.21.15.2:0/589728651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc274068580 msgr2=0x7fc27419e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:45.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.382+0000 7fc27bc9e700 1 --2- 172.21.15.2:0/589728651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc274068580 0x7fc27419e860 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc270006010 tx=0x7fc27000be20 comp rx=0 tx=0).stop 2024-09-13T22:59:45.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.383+0000 7fc27bc9e700 1 -- 172.21.15.2:0/589728651 shutdown_connections 2024-09-13T22:59:45.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.383+0000 7fc27bc9e700 1 --2- 172.21.15.2:0/589728651 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fc26006e300 0x7fc2600707c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:45.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.383+0000 7fc27bc9e700 1 --2- 172.21.15.2:0/589728651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc274068580 0x7fc27419e860 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:45.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.383+0000 7fc27bc9e700 1 --2- 172.21.15.2:0/589728651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc274068ea0 0x7fc27419eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:45.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.383+0000 7fc27bc9e700 1 -- 172.21.15.2:0/589728651 >> 172.21.15.2:0/589728651 conn(0x7fc274075670 msgr2=0x7fc2740fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:45.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.383+0000 7fc27bc9e700 1 -- 172.21.15.2:0/589728651 shutdown_connections 2024-09-13T22:59:45.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:45.383+0000 7fc27bc9e700 1 -- 172.21.15.2:0/589728651 wait complete. 2024-09-13T22:59:45.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:45 smithi002 ceph-mon[27637]: pgmap v90: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:46.062 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-13T22:59:46.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:45 smithi047 ceph-mon[34560]: pgmap v90: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:59:47.388 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:47 smithi002 ceph-mon[27637]: pgmap v91: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:47.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:47 smithi047 ceph-mon[34560]: pgmap v91: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:47.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.901+0000 7fb4f2bbb700 1 -- 172.21.15.2:0/1068407375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4ec101850 msgr2=0x7fb4ec1058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:47.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.901+0000 7fb4f2bbb700 1 --2- 172.21.15.2:0/1068407375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4ec101850 0x7fb4ec1058a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0009910 tx=0x7fb4e0009c20 comp rx=0 tx=0).stop 2024-09-13T22:59:47.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.901+0000 7fb4f2bbb700 1 -- 172.21.15.2:0/1068407375 shutdown_connections 2024-09-13T22:59:47.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.901+0000 7fb4f2bbb700 1 --2- 172.21.15.2:0/1068407375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4ec101850 0x7fb4ec1058a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:47.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.901+0000 7fb4f2bbb700 1 --2- 172.21.15.2:0/1068407375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4ec100ea0 0x7fb4ec101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:47.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.901+0000 7fb4f2bbb700 1 -- 172.21.15.2:0/1068407375 >> 172.21.15.2:0/1068407375 conn(0x7fb4ec0fc750 msgr2=0x7fb4ec0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:47.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.901+0000 7fb4f2bbb700 1 -- 172.21.15.2:0/1068407375 shutdown_connections 2024-09-13T22:59:47.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.901+0000 7fb4f2bbb700 1 -- 172.21.15.2:0/1068407375 wait complete. 2024-09-13T22:59:47.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.901+0000 7fb4f2bbb700 1 Processor -- start 2024-09-13T22:59:47.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.902+0000 7fb4f2bbb700 1 -- start start 2024-09-13T22:59:47.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.902+0000 7fb4f2bbb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4ec100ea0 0x7fb4ec19c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:47.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.902+0000 7fb4f2bbb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4ec101850 0x7fb4ec19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:47.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.902+0000 7fb4f2bbb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec19d2d0 con 0x7fb4ec101850 2024-09-13T22:59:47.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.902+0000 7fb4f2bbb700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec196780 con 0x7fb4ec100ea0 2024-09-13T22:59:47.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.902+0000 7fb4ebfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4ec101850 0x7fb4ec19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:47.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.902+0000 7fb4ebfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4ec101850 0x7fb4ec19cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60932/0 (socket says 172.21.15.2:60932) 2024-09-13T22:59:47.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.902+0000 7fb4ebfff700 1 -- 172.21.15.2:0/2815810720 learned_addr learned my addr 172.21.15.2:0/2815810720 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:59:47.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.902+0000 7fb4f0957700 1 --2- 172.21.15.2:0/2815810720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4ec100ea0 0x7fb4ec19c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:47.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.902+0000 7fb4ebfff700 1 -- 172.21.15.2:0/2815810720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4ec100ea0 msgr2=0x7fb4ec19c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:47.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.902+0000 7fb4ebfff700 1 --2- 172.21.15.2:0/2815810720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4ec100ea0 0x7fb4ec19c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:47.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.902+0000 7fb4ebfff700 1 -- 172.21.15.2:0/2815810720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e00095f0 con 0x7fb4ec101850 2024-09-13T22:59:47.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.902+0000 7fb4ebfff700 1 --2- 172.21.15.2:0/2815810720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4ec101850 0x7fb4ec19cc40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb4e00092e0 tx=0x7fb4e000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:47.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.903+0000 7fb4e9ffb700 1 -- 172.21.15.2:0/2815810720 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4e001d070 con 0x7fb4ec101850 2024-09-13T22:59:47.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.903+0000 7fb4e9ffb700 1 -- 172.21.15.2:0/2815810720 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb4e0005dc0 con 0x7fb4ec101850 2024-09-13T22:59:47.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.903+0000 7fb4f2bbb700 1 -- 172.21.15.2:0/2815810720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ec196a00 con 0x7fb4ec101850 2024-09-13T22:59:47.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.903+0000 7fb4e9ffb700 1 -- 172.21.15.2:0/2815810720 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4e0017400 con 0x7fb4ec101850 2024-09-13T22:59:47.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.903+0000 7fb4f2bbb700 1 -- 172.21.15.2:0/2815810720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ec196ef0 con 0x7fb4ec101850 2024-09-13T22:59:47.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.904+0000 7fb4f2bbb700 1 -- 172.21.15.2:0/2815810720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ec1092a0 con 0x7fb4ec101850 2024-09-13T22:59:47.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.904+0000 7fb4e9ffb700 1 -- 172.21.15.2:0/2815810720 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7fb4e000f6f0 con 0x7fb4ec101850 2024-09-13T22:59:47.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.905+0000 7fb4e9ffb700 1 --2- 172.21.15.2:0/2815810720 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fb4d406e300 0x7fb4d40707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:47.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.905+0000 7fb4e9ffb700 1 -- 172.21.15.2:0/2815810720 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fb4e008f490 con 0x7fb4ec101850 2024-09-13T22:59:47.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.905+0000 7fb4f0957700 1 --2- 172.21.15.2:0/2815810720 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fb4d406e300 0x7fb4d40707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:47.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.905+0000 7fb4f0957700 1 --2- 172.21.15.2:0/2815810720 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fb4d406e300 0x7fb4d40707c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc005950 tx=0x7fb4dc00b410 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:47.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:47.910+0000 7fb4e9ffb700 1 -- 172.21.15.2:0/2815810720 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7fb4e005c690 con 0x7fb4ec101850 2024-09-13T22:59:48.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:48.116+0000 7fb4f2bbb700 1 -- 172.21.15.2:0/2815810720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fb4ec04f2e0 con 0x7fb4ec101850 2024-09-13T22:59:48.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:48.116+0000 7fb4e9ffb700 1 -- 172.21.15.2:0/2815810720 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v45)=0 v45) v1 ==== 135+0+0 (secure 0 0 0) 0x7fb4e005c220 con 0x7fb4ec101850 2024-09-13T22:59:48.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:48.118+0000 7fb4f2bbb700 1 -- 172.21.15.2:0/2815810720 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fb4d406e300 msgr2=0x7fb4d40707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:48.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:48.118+0000 7fb4f2bbb700 1 --2- 172.21.15.2:0/2815810720 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fb4d406e300 0x7fb4d40707c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc005950 tx=0x7fb4dc00b410 comp rx=0 tx=0).stop 2024-09-13T22:59:48.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:48.118+0000 7fb4f2bbb700 1 -- 172.21.15.2:0/2815810720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4ec101850 msgr2=0x7fb4ec19cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:48.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:48.118+0000 7fb4f2bbb700 1 --2- 172.21.15.2:0/2815810720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4ec101850 0x7fb4ec19cc40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb4e00092e0 tx=0x7fb4e000bd70 comp rx=0 tx=0).stop 2024-09-13T22:59:48.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:48.118+0000 7fb4f2bbb700 1 -- 172.21.15.2:0/2815810720 shutdown_connections 2024-09-13T22:59:48.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:48.118+0000 7fb4f2bbb700 1 --2- 172.21.15.2:0/2815810720 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fb4d406e300 0x7fb4d40707c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:48.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:48.118+0000 7fb4f2bbb700 1 --2- 172.21.15.2:0/2815810720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4ec100ea0 0x7fb4ec19c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:48.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:48.118+0000 7fb4f2bbb700 1 --2- 172.21.15.2:0/2815810720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4ec101850 0x7fb4ec19cc40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:48.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:48.118+0000 7fb4f2bbb700 1 -- 172.21.15.2:0/2815810720 >> 172.21.15.2:0/2815810720 conn(0x7fb4ec0fc750 msgr2=0x7fb4ec0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:48.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:48.118+0000 7fb4f2bbb700 1 -- 172.21.15.2:0/2815810720 shutdown_connections 2024-09-13T22:59:48.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:48.119+0000 7fb4f2bbb700 1 -- 172.21.15.2:0/2815810720 wait complete. 2024-09-13T22:59:48.788 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-13T22:59:48.999 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:59:49.441 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:49 smithi002 ceph-mon[27637]: pgmap v92: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:49.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:49 smithi047 ceph-mon[34560]: pgmap v92: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:50.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.590+0000 7f7e1948e700 1 -- 172.21.15.2:0/621561691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e14101e40 msgr2=0x7f7e14102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.590+0000 7f7e1948e700 1 --2- 172.21.15.2:0/621561691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e14101e40 0x7f7e14102220 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009940 tx=0x7f7e04009c50 comp rx=0 tx=0).stop 2024-09-13T22:59:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.591+0000 7f7e1948e700 1 -- 172.21.15.2:0/621561691 shutdown_connections 2024-09-13T22:59:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.591+0000 7f7e1948e700 1 --2- 172.21.15.2:0/621561691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e14102760 0x7f7e1410ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.591+0000 7f7e1948e700 1 --2- 172.21.15.2:0/621561691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e14101e40 0x7f7e14102220 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.591+0000 7f7e1948e700 1 -- 172.21.15.2:0/621561691 >> 172.21.15.2:0/621561691 conn(0x7f7e140fb650 msgr2=0x7f7e140fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.591+0000 7f7e1948e700 1 -- 172.21.15.2:0/621561691 shutdown_connections 2024-09-13T22:59:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.591+0000 7f7e1948e700 1 -- 172.21.15.2:0/621561691 wait complete. 2024-09-13T22:59:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.591+0000 7f7e1948e700 1 Processor -- start 2024-09-13T22:59:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.591+0000 7f7e1948e700 1 -- start start 2024-09-13T22:59:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.592+0000 7f7e1948e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e14101e40 0x7f7e141969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.592+0000 7f7e1948e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e14102760 0x7f7e14196f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:50.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.592+0000 7f7e1948e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e141975c0 con 0x7f7e14102760 2024-09-13T22:59:50.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.592+0000 7f7e1948e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1419b380 con 0x7f7e14101e40 2024-09-13T22:59:50.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.592+0000 7f7e127fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e14102760 0x7f7e14196f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:50.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.592+0000 7f7e127fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e14102760 0x7f7e14196f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33974/0 (socket says 172.21.15.2:33974) 2024-09-13T22:59:50.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.592+0000 7f7e127fc700 1 -- 172.21.15.2:0/78467696 learned_addr learned my addr 172.21.15.2:0/78467696 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:59:50.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.592+0000 7f7e127fc700 1 -- 172.21.15.2:0/78467696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e14101e40 msgr2=0x7f7e141969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:50.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.592+0000 7f7e127fc700 1 --2- 172.21.15.2:0/78467696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e14101e40 0x7f7e141969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:50.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.592+0000 7f7e127fc700 1 -- 172.21.15.2:0/78467696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e040095f0 con 0x7f7e14102760 2024-09-13T22:59:50.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.592+0000 7f7e127fc700 1 --2- 172.21.15.2:0/78467696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e14102760 0x7f7e14196f30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800b480 tx=0x7f7e0800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:50.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.592+0000 7f7dfbfff700 1 -- 172.21.15.2:0/78467696 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e080118c0 con 0x7f7e14102760 2024-09-13T22:59:50.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.592+0000 7f7dfbfff700 1 -- 172.21.15.2:0/78467696 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e08010380 con 0x7f7e14102760 2024-09-13T22:59:50.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.592+0000 7f7e1948e700 1 -- 172.21.15.2:0/78467696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1419b660 con 0x7f7e14102760 2024-09-13T22:59:50.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.592+0000 7f7dfbfff700 1 -- 172.21.15.2:0/78467696 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e0800f4f0 con 0x7f7e14102760 2024-09-13T22:59:50.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.592+0000 7f7e1948e700 1 -- 172.21.15.2:0/78467696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1419bbb0 con 0x7f7e14102760 2024-09-13T22:59:50.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.593+0000 7f7e1948e700 1 -- 172.21.15.2:0/78467696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e14108350 con 0x7f7e14102760 2024-09-13T22:59:50.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.594+0000 7f7dfbfff700 1 -- 172.21.15.2:0/78467696 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7f7e080104f0 con 0x7f7e14102760 2024-09-13T22:59:50.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.594+0000 7f7dfbfff700 1 --2- 172.21.15.2:0/78467696 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f7dfc06e300 0x7f7dfc0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:50.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.595+0000 7f7dfbfff700 1 -- 172.21.15.2:0/78467696 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f7e0808dd00 con 0x7f7e14102760 2024-09-13T22:59:50.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.595+0000 7f7e12ffd700 1 --2- 172.21.15.2:0/78467696 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f7dfc06e300 0x7f7dfc0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:50.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.595+0000 7f7e12ffd700 1 --2- 172.21.15.2:0/78467696 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f7dfc06e300 0x7f7dfc0707c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7e04006010 tx=0x7f7e04000bc0 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:50.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.599+0000 7f7dfbfff700 1 -- 172.21.15.2:0/78467696 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f7e08091030 con 0x7f7e14102760 2024-09-13T22:59:50.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.833+0000 7f7e1948e700 1 -- 172.21.15.2:0/78467696 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e1419be30 con 0x7f7dfc06e300 2024-09-13T22:59:50.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.838+0000 7f7dfbfff700 1 -- 172.21.15.2:0/78467696 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f7e1419be30 con 0x7f7dfc06e300 2024-09-13T22:59:50.839 INFO:teuthology.orchestra.run.smithi002.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:59:50.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.840+0000 7f7e1948e700 1 -- 172.21.15.2:0/78467696 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f7dfc06e300 msgr2=0x7f7dfc0707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:50.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.840+0000 7f7e1948e700 1 --2- 172.21.15.2:0/78467696 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f7dfc06e300 0x7f7dfc0707c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7e04006010 tx=0x7f7e04000bc0 comp rx=0 tx=0).stop 2024-09-13T22:59:50.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.840+0000 7f7e1948e700 1 -- 172.21.15.2:0/78467696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e14102760 msgr2=0x7f7e14196f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:50.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.840+0000 7f7e1948e700 1 --2- 172.21.15.2:0/78467696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e14102760 0x7f7e14196f30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800b480 tx=0x7f7e0800b840 comp rx=0 tx=0).stop 2024-09-13T22:59:50.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.841+0000 7f7e1948e700 1 -- 172.21.15.2:0/78467696 shutdown_connections 2024-09-13T22:59:50.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.841+0000 7f7e1948e700 1 --2- 172.21.15.2:0/78467696 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f7dfc06e300 0x7f7dfc0707c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:50.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.841+0000 7f7e1948e700 1 --2- 172.21.15.2:0/78467696 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e14101e40 0x7f7e141969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:50.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.841+0000 7f7e1948e700 1 --2- 172.21.15.2:0/78467696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e14102760 0x7f7e14196f30 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:50.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.841+0000 7f7e1948e700 1 -- 172.21.15.2:0/78467696 >> 172.21.15.2:0/78467696 conn(0x7f7e140fb650 msgr2=0x7f7e14105490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:50.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.841+0000 7f7e1948e700 1 -- 172.21.15.2:0/78467696 shutdown_connections 2024-09-13T22:59:50.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:50.841+0000 7f7e1948e700 1 -- 172.21.15.2:0/78467696 wait complete. 2024-09-13T22:59:51.469 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:51 smithi002 ceph-mon[27637]: pgmap v93: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:51.469 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:51 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:59:51.469 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:51 smithi002 ceph-mon[27637]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:51.469 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:51 smithi002 ceph-mon[27637]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:59:51.470 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:51 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:51.470 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:51 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:59:51.470 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:51 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:51.470 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:51 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:59:51.470 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:51 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:51.489 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T22:59:51.490 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-13T22:59:51.490 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-13T22:59:51.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:51 smithi047 ceph-mon[34560]: pgmap v93: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:51.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:51 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T22:59:51.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:51 smithi047 ceph-mon[34560]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:51.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:51 smithi047 ceph-mon[34560]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:59:51.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:51 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:51.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:51 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:59:51.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:51 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:51.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:51 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T22:59:51.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:51 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:51.718 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T22:59:52.401 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:52 smithi002 ceph-mon[27637]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:59:52.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:52 smithi047 ceph-mon[34560]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T22:59:53.456 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:53 smithi002 ceph-mon[27637]: pgmap v94: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:53.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:53 smithi047 ceph-mon[34560]: pgmap v94: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:54.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.944+0000 7f6faaa86700 1 -- 172.21.15.2:0/966099578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa40ffda0 msgr2=0x7f6fa4100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:54.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.944+0000 7f6faaa86700 1 --2- 172.21.15.2:0/966099578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa40ffda0 0x7f6fa4100180 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c009910 tx=0x7f6f9c009c20 comp rx=0 tx=0).stop 2024-09-13T22:59:54.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.945+0000 7f6faaa86700 1 -- 172.21.15.2:0/966099578 shutdown_connections 2024-09-13T22:59:54.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.945+0000 7f6faaa86700 1 --2- 172.21.15.2:0/966099578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fa4100750 0x7f6fa41047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:54.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.945+0000 7f6faaa86700 1 --2- 172.21.15.2:0/966099578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa40ffda0 0x7f6fa4100180 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:54.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.945+0000 7f6faaa86700 1 -- 172.21.15.2:0/966099578 >> 172.21.15.2:0/966099578 conn(0x7f6fa40fb650 msgr2=0x7f6fa40fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:54.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.945+0000 7f6faaa86700 1 -- 172.21.15.2:0/966099578 shutdown_connections 2024-09-13T22:59:54.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.945+0000 7f6faaa86700 1 -- 172.21.15.2:0/966099578 wait complete. 2024-09-13T22:59:54.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.945+0000 7f6faaa86700 1 Processor -- start 2024-09-13T22:59:54.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.945+0000 7f6faaa86700 1 -- start start 2024-09-13T22:59:54.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.946+0000 7f6faaa86700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa40ffda0 0x7f6fa4101840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:54.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.946+0000 7f6faaa86700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fa4100750 0x7f6fa4101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:54.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.946+0000 7f6faaa86700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa4102350 con 0x7f6fa40ffda0 2024-09-13T22:59:54.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.946+0000 7f6faaa86700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa41024c0 con 0x7f6fa4100750 2024-09-13T22:59:54.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.946+0000 7f6fa8822700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa40ffda0 0x7f6fa4101840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:54.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.946+0000 7f6fa8822700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa40ffda0 0x7f6fa4101840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33986/0 (socket says 172.21.15.2:33986) 2024-09-13T22:59:54.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.946+0000 7f6fa8822700 1 -- 172.21.15.2:0/705880301 learned_addr learned my addr 172.21.15.2:0/705880301 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:59:54.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.946+0000 7f6fa3fff700 1 --2- 172.21.15.2:0/705880301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fa4100750 0x7f6fa4101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:54.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.946+0000 7f6fa8822700 1 -- 172.21.15.2:0/705880301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fa4100750 msgr2=0x7f6fa4101d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:54.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.946+0000 7f6fa8822700 1 --2- 172.21.15.2:0/705880301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fa4100750 0x7f6fa4101d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:54.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.946+0000 7f6fa8822700 1 -- 172.21.15.2:0/705880301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c0095f0 con 0x7f6fa40ffda0 2024-09-13T22:59:54.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.946+0000 7f6fa8822700 1 --2- 172.21.15.2:0/705880301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa40ffda0 0x7f6fa4101840 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c006010 tx=0x7f6f9c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:54.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.946+0000 7f6fa1ffb700 1 -- 172.21.15.2:0/705880301 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f9c01d070 con 0x7f6fa40ffda0 2024-09-13T22:59:54.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.947+0000 7f6faaa86700 1 -- 172.21.15.2:0/705880301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa41a2c00 con 0x7f6fa40ffda0 2024-09-13T22:59:54.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.947+0000 7f6fa1ffb700 1 -- 172.21.15.2:0/705880301 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f9c004fb0 con 0x7f6fa40ffda0 2024-09-13T22:59:54.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.947+0000 7f6fa1ffb700 1 -- 172.21.15.2:0/705880301 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f9c022ea0 con 0x7f6fa40ffda0 2024-09-13T22:59:54.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.947+0000 7f6faaa86700 1 -- 172.21.15.2:0/705880301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa41a2fb0 con 0x7f6fa40ffda0 2024-09-13T22:59:54.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.948+0000 7f6faaa86700 1 -- 172.21.15.2:0/705880301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa404f2e0 con 0x7f6fa40ffda0 2024-09-13T22:59:54.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.949+0000 7f6fa1ffb700 1 -- 172.21.15.2:0/705880301 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7f6f9c022470 con 0x7f6fa40ffda0 2024-09-13T22:59:54.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.949+0000 7f6fa1ffb700 1 --2- 172.21.15.2:0/705880301 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f6f9006e300 0x7f6f900707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:54.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.949+0000 7f6fa1ffb700 1 -- 172.21.15.2:0/705880301 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f6f9c08f530 con 0x7f6fa40ffda0 2024-09-13T22:59:54.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.949+0000 7f6fa3fff700 1 --2- 172.21.15.2:0/705880301 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f6f9006e300 0x7f6f900707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:54.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.950+0000 7f6fa3fff700 1 --2- 172.21.15.2:0/705880301 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f6f9006e300 0x7f6f900707c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4103030 tx=0x7f6f940094f0 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:54.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:54.954+0000 7f6fa1ffb700 1 -- 172.21.15.2:0/705880301 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f6f9c058e50 con 0x7f6fa40ffda0 2024-09-13T22:59:55.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.187+0000 7f6faaa86700 1 -- 172.21.15.2:0/705880301 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fa4068e50 con 0x7f6f9006e300 2024-09-13T22:59:55.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.188+0000 7f6fa1ffb700 1 -- 172.21.15.2:0/705880301 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f6fa4068e50 con 0x7f6f9006e300 2024-09-13T22:59:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.190+0000 7f6faaa86700 1 -- 172.21.15.2:0/705880301 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f6f9006e300 msgr2=0x7f6f900707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.190+0000 7f6faaa86700 1 --2- 172.21.15.2:0/705880301 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f6f9006e300 0x7f6f900707c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4103030 tx=0x7f6f940094f0 comp rx=0 tx=0).stop 2024-09-13T22:59:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.190+0000 7f6faaa86700 1 -- 172.21.15.2:0/705880301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa40ffda0 msgr2=0x7f6fa4101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.190+0000 7f6faaa86700 1 --2- 172.21.15.2:0/705880301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa40ffda0 0x7f6fa4101840 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c006010 tx=0x7f6f9c00be20 comp rx=0 tx=0).stop 2024-09-13T22:59:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.190+0000 7f6faaa86700 1 -- 172.21.15.2:0/705880301 shutdown_connections 2024-09-13T22:59:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.190+0000 7f6faaa86700 1 --2- 172.21.15.2:0/705880301 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f6f9006e300 0x7f6f900707c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.190+0000 7f6faaa86700 1 --2- 172.21.15.2:0/705880301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fa40ffda0 0x7f6fa4101840 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.190+0000 7f6faaa86700 1 --2- 172.21.15.2:0/705880301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6fa4100750 0x7f6fa4101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:55.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.190+0000 7f6faaa86700 1 -- 172.21.15.2:0/705880301 >> 172.21.15.2:0/705880301 conn(0x7f6fa40fb650 msgr2=0x7f6fa4104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:55.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.190+0000 7f6faaa86700 1 -- 172.21.15.2:0/705880301 shutdown_connections 2024-09-13T22:59:55.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.190+0000 7f6faaa86700 1 -- 172.21.15.2:0/705880301 wait complete. 2024-09-13T22:59:55.201 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T22:59:55.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.302+0000 7ffb1514b700 1 -- 172.21.15.2:0/1788157974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb100ffda0 msgr2=0x7ffb10100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:55.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.302+0000 7ffb1514b700 1 --2- 172.21.15.2:0/1788157974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb100ffda0 0x7ffb10100180 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000b0a0 tx=0x7ffb0000b3b0 comp rx=0 tx=0).stop 2024-09-13T22:59:55.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.302+0000 7ffb1514b700 1 -- 172.21.15.2:0/1788157974 shutdown_connections 2024-09-13T22:59:55.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.302+0000 7ffb1514b700 1 --2- 172.21.15.2:0/1788157974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb10100750 0x7ffb101047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:55.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.302+0000 7ffb1514b700 1 --2- 172.21.15.2:0/1788157974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb100ffda0 0x7ffb10100180 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:55.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.302+0000 7ffb1514b700 1 -- 172.21.15.2:0/1788157974 >> 172.21.15.2:0/1788157974 conn(0x7ffb100fb650 msgr2=0x7ffb100fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:55.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.302+0000 7ffb1514b700 1 -- 172.21.15.2:0/1788157974 shutdown_connections 2024-09-13T22:59:55.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.302+0000 7ffb1514b700 1 -- 172.21.15.2:0/1788157974 wait complete. 2024-09-13T22:59:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.303+0000 7ffb1514b700 1 Processor -- start 2024-09-13T22:59:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.303+0000 7ffb1514b700 1 -- start start 2024-09-13T22:59:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.303+0000 7ffb1514b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb100ffda0 0x7ffb101976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.303+0000 7ffb1514b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb10100750 0x7ffb10197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.303+0000 7ffb1514b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb10198250 con 0x7ffb10100750 2024-09-13T22:59:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.303+0000 7ffb1514b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb10198390 con 0x7ffb100ffda0 2024-09-13T22:59:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.304+0000 7ffb0e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb10100750 0x7ffb10197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.304+0000 7ffb0e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb10100750 0x7ffb10197c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34012/0 (socket says 172.21.15.2:34012) 2024-09-13T22:59:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.304+0000 7ffb0e59c700 1 -- 172.21.15.2:0/696391436 learned_addr learned my addr 172.21.15.2:0/696391436 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.304+0000 7ffb0ed9d700 1 --2- 172.21.15.2:0/696391436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb100ffda0 0x7ffb101976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.304+0000 7ffb0e59c700 1 -- 172.21.15.2:0/696391436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb100ffda0 msgr2=0x7ffb101976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.304+0000 7ffb0e59c700 1 --2- 172.21.15.2:0/696391436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb100ffda0 0x7ffb101976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.304+0000 7ffb0e59c700 1 -- 172.21.15.2:0/696391436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb00009d00 con 0x7ffb10100750 2024-09-13T22:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.304+0000 7ffb0ed9d700 1 --2- 172.21.15.2:0/696391436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb100ffda0 0x7ffb101976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.304+0000 7ffb0e59c700 1 --2- 172.21.15.2:0/696391436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb10100750 0x7ffb10197c30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400d900 tx=0x7ffb0400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.304+0000 7ffaf7fff700 1 -- 172.21.15.2:0/696391436 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb04009900 con 0x7ffb10100750 2024-09-13T22:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.304+0000 7ffb1514b700 1 -- 172.21.15.2:0/696391436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb101a0760 con 0x7ffb10100750 2024-09-13T22:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.304+0000 7ffaf7fff700 1 -- 172.21.15.2:0/696391436 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffb04010460 con 0x7ffb10100750 2024-09-13T22:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.304+0000 7ffaf7fff700 1 -- 172.21.15.2:0/696391436 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb0400f5f0 con 0x7ffb10100750 2024-09-13T22:59:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.304+0000 7ffb1514b700 1 -- 172.21.15.2:0/696391436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb101a0c20 con 0x7ffb10100750 2024-09-13T22:59:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.306+0000 7ffb1514b700 1 -- 172.21.15.2:0/696391436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb10108140 con 0x7ffb10100750 2024-09-13T22:59:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.306+0000 7ffaf7fff700 1 -- 172.21.15.2:0/696391436 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7ffb040105d0 con 0x7ffb10100750 2024-09-13T22:59:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.306+0000 7ffaf7fff700 1 --2- 172.21.15.2:0/696391436 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ffaf806e300 0x7ffaf80707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.307+0000 7ffaf7fff700 1 -- 172.21.15.2:0/696391436 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7ffb0408df40 con 0x7ffb10100750 2024-09-13T22:59:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.307+0000 7ffb0ed9d700 1 --2- 172.21.15.2:0/696391436 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ffaf806e300 0x7ffaf80707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.307+0000 7ffb0ed9d700 1 --2- 172.21.15.2:0/696391436 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ffaf806e300 0x7ffaf80707c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb000062a0 tx=0x7ffb00006210 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.311+0000 7ffaf7fff700 1 -- 172.21.15.2:0/696391436 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7ffb040c29f0 con 0x7ffb10100750 2024-09-13T22:59:55.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:55 smithi002 ceph-mon[27637]: pgmap v95: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:55.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:55 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:55.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:55 smithi002 ceph-mon[27637]: Upgrade: Target is version 19.1.1-324-gecab7be5 (squid) 2024-09-13T22:59:55.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:55 smithi002 ceph-mon[27637]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, digests ['quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808'] 2024-09-13T22:59:55.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:55 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:59:55.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:55 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:55.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:55 smithi002 ceph-mon[27637]: Upgrade: Setting container_image for all mgr 2024-09-13T22:59:55.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:55 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:55.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:55 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T22:59:55.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.545+0000 7ffb1514b700 1 -- 172.21.15.2:0/696391436 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb100611d0 con 0x7ffaf806e300 2024-09-13T22:59:55.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.546+0000 7ffaf7fff700 1 -- 172.21.15.2:0/696391436 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7ffb100611d0 con 0x7ffaf806e300 2024-09-13T22:59:55.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.548+0000 7ffb1514b700 1 -- 172.21.15.2:0/696391436 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ffaf806e300 msgr2=0x7ffaf80707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:55.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.548+0000 7ffb1514b700 1 --2- 172.21.15.2:0/696391436 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ffaf806e300 0x7ffaf80707c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb000062a0 tx=0x7ffb00006210 comp rx=0 tx=0).stop 2024-09-13T22:59:55.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.548+0000 7ffb1514b700 1 -- 172.21.15.2:0/696391436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb10100750 msgr2=0x7ffb10197c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:55.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.548+0000 7ffb1514b700 1 --2- 172.21.15.2:0/696391436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb10100750 0x7ffb10197c30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400d900 tx=0x7ffb0400dcc0 comp rx=0 tx=0).stop 2024-09-13T22:59:55.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.548+0000 7ffb1514b700 1 -- 172.21.15.2:0/696391436 shutdown_connections 2024-09-13T22:59:55.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.548+0000 7ffb1514b700 1 --2- 172.21.15.2:0/696391436 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ffaf806e300 0x7ffaf80707c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:55.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.548+0000 7ffb1514b700 1 --2- 172.21.15.2:0/696391436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb100ffda0 0x7ffb101976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:55.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.548+0000 7ffb1514b700 1 --2- 172.21.15.2:0/696391436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb10100750 0x7ffb10197c30 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:55.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.548+0000 7ffb1514b700 1 -- 172.21.15.2:0/696391436 >> 172.21.15.2:0/696391436 conn(0x7ffb100fb650 msgr2=0x7ffb100fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:55.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.548+0000 7ffb1514b700 1 -- 172.21.15.2:0/696391436 shutdown_connections 2024-09-13T22:59:55.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.548+0000 7ffb1514b700 1 -- 172.21.15.2:0/696391436 wait complete. 2024-09-13T22:59:55.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.657+0000 7fadc8052700 1 -- 172.21.15.2:0/2148227930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc0101ec0 msgr2=0x7fadc01022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:55.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.657+0000 7fadc8052700 1 --2- 172.21.15.2:0/2148227930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc0101ec0 0x7fadc01022a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009940 tx=0x7fadbc009c50 comp rx=0 tx=0).stop 2024-09-13T22:59:55.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.657+0000 7fadc8052700 1 -- 172.21.15.2:0/2148227930 shutdown_connections 2024-09-13T22:59:55.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.657+0000 7fadc8052700 1 --2- 172.21.15.2:0/2148227930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadc01027e0 0x7fadc010acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:55.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.657+0000 7fadc8052700 1 --2- 172.21.15.2:0/2148227930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc0101ec0 0x7fadc01022a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:55.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.657+0000 7fadc8052700 1 -- 172.21.15.2:0/2148227930 >> 172.21.15.2:0/2148227930 conn(0x7fadc00fb650 msgr2=0x7fadc00fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:55.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.657+0000 7fadc8052700 1 -- 172.21.15.2:0/2148227930 shutdown_connections 2024-09-13T22:59:55.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.657+0000 7fadc8052700 1 -- 172.21.15.2:0/2148227930 wait complete. 2024-09-13T22:59:55.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.658+0000 7fadc8052700 1 Processor -- start 2024-09-13T22:59:55.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.658+0000 7fadc8052700 1 -- start start 2024-09-13T22:59:55.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.658+0000 7fadc8052700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc0101ec0 0x7fadc019c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:55.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.658+0000 7fadc8052700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadc01027e0 0x7fadc019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:55.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.658+0000 7fadc8052700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc019d360 con 0x7fadc0101ec0 2024-09-13T22:59:55.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.658+0000 7fadc8052700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc0196810 con 0x7fadc01027e0 2024-09-13T22:59:55.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.658+0000 7fadc5dee700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc0101ec0 0x7fadc019c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:55.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.658+0000 7fadc5dee700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc0101ec0 0x7fadc019c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34022/0 (socket says 172.21.15.2:34022) 2024-09-13T22:59:55.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.658+0000 7fadc5dee700 1 -- 172.21.15.2:0/1899150234 learned_addr learned my addr 172.21.15.2:0/1899150234 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:59:55.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.658+0000 7fadc5dee700 1 -- 172.21.15.2:0/1899150234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadc01027e0 msgr2=0x7fadc019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:55.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.658+0000 7fadc55ed700 1 --2- 172.21.15.2:0/1899150234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadc01027e0 0x7fadc019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:55.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.658+0000 7fadc5dee700 1 --2- 172.21.15.2:0/1899150234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadc01027e0 0x7fadc019ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:55.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.658+0000 7fadc5dee700 1 -- 172.21.15.2:0/1899150234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc0095f0 con 0x7fadc0101ec0 2024-09-13T22:59:55.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.658+0000 7fadc55ed700 1 --2- 172.21.15.2:0/1899150234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadc01027e0 0x7fadc019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T22:59:55.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.659+0000 7fadc5dee700 1 --2- 172.21.15.2:0/1899150234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc0101ec0 0x7fadc019c790 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0055f0 tx=0x7fadbc0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:55.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.659+0000 7fadb6ffd700 1 -- 172.21.15.2:0/1899150234 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadbc01d070 con 0x7fadc0101ec0 2024-09-13T22:59:55.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.659+0000 7fadb6ffd700 1 -- 172.21.15.2:0/1899150234 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fadbc00f460 con 0x7fadc0101ec0 2024-09-13T22:59:55.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.659+0000 7fadc8052700 1 -- 172.21.15.2:0/1899150234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc0196a90 con 0x7fadc0101ec0 2024-09-13T22:59:55.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.659+0000 7fadb6ffd700 1 -- 172.21.15.2:0/1899150234 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadbc021620 con 0x7fadc0101ec0 2024-09-13T22:59:55.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.659+0000 7fadc8052700 1 -- 172.21.15.2:0/1899150234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc0196f80 con 0x7fadc0101ec0 2024-09-13T22:59:55.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.660+0000 7fadc8052700 1 -- 172.21.15.2:0/1899150234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc01083a0 con 0x7fadc0101ec0 2024-09-13T22:59:55.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.660+0000 7fadb6ffd700 1 -- 172.21.15.2:0/1899150234 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7fadbc00fa60 con 0x7fadc0101ec0 2024-09-13T22:59:55.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.661+0000 7fadb6ffd700 1 --2- 172.21.15.2:0/1899150234 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fadac06e300 0x7fadac0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:55.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.661+0000 7fadb6ffd700 1 -- 172.21.15.2:0/1899150234 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fadbc08f410 con 0x7fadc0101ec0 2024-09-13T22:59:55.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.661+0000 7fadc55ed700 1 --2- 172.21.15.2:0/1899150234 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fadac06e300 0x7fadac0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:55.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.662+0000 7fadc55ed700 1 --2- 172.21.15.2:0/1899150234 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fadac06e300 0x7fadac0707c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fadc00fcdc0 tx=0x7fadb0008040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:55.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.666+0000 7fadb6ffd700 1 -- 172.21.15.2:0/1899150234 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7fadbc05c610 con 0x7fadc0101ec0 2024-09-13T22:59:55.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.885+0000 7fadc8052700 1 -- 172.21.15.2:0/1899150234 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fadc0197e10 con 0x7fadac06e300 2024-09-13T22:59:55.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.895+0000 7fadb6ffd700 1 -- 172.21.15.2:0/1899150234 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fadc0197e10 con 0x7fadac06e300 2024-09-13T22:59:55.896 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T22:59:55.896 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (87s) 58s ago 12m 16.4M - 0.25.0 c8568f914cd2 f570a73274bc 2024-09-13T22:59:55.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (12m) 58s ago 12m 7872k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T22:59:55.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (11m) 119s ago 11m 7784k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T22:59:55.897 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (12m) 58s ago 12m 6669k - 18.2.1 5be31c24972a de910e0c5157 2024-09-13T22:59:55.897 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (11m) 119s ago 11m 6651k - 18.2.1 5be31c24972a 9f4bcfa66588 2024-09-13T22:59:55.897 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (65s) 58s ago 11m 45.9M - 9.4.12 2bacad6d85d8 650673516b69 2024-09-13T22:59:55.897 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (6m) 58s ago 6m 14.7M - 18.2.1 5be31c24972a 59e9c88c31ca 2024-09-13T22:59:55.897 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (6m) 58s ago 6m 90.6M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T22:59:55.897 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (6m) 119s ago 6m 204M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T22:59:55.897 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (6m) 119s ago 6m 17.3M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T22:59:55.897 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 running (3m) 58s ago 13m 503M - 19.1.1-324-gecab7be5 0652ff2b5d78 7a8aa9de37e4 2024-09-13T22:59:55.897 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (2m) 119s ago 11m 439M - 19.1.1-324-gecab7be5 0652ff2b5d78 13fa6f3b5a8a 2024-09-13T22:59:55.897 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (13m) 58s ago 13m 53.9M 2048M 18.2.1 5be31c24972a de11be74385d 2024-09-13T22:59:55.897 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (11m) 119s ago 11m 42.0M 2048M 18.2.1 5be31c24972a 5642284a23bf 2024-09-13T22:59:55.897 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (2m) 58s ago 12m 8212k - 1.5.0 0da6a335fe13 f3eae5f90ab8 2024-09-13T22:59:55.898 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (2m) 119s ago 11m 3623k - 1.5.0 0da6a335fe13 a5c7d7f1eaa5 2024-09-13T22:59:55.898 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (10m) 58s ago 10m 208M 1217M 18.2.1 5be31c24972a 1e1f6936c402 2024-09-13T22:59:55.898 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (9m) 58s ago 9m 225M 1217M 18.2.1 5be31c24972a f0ac78c34831 2024-09-13T22:59:55.898 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (9m) 58s ago 9m 186M 1217M 18.2.1 5be31c24972a 9a2f4f6decfb 2024-09-13T22:59:55.898 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (9m) 119s ago 9m 251M 2241M 18.2.1 5be31c24972a fb455cc4c571 2024-09-13T22:59:55.898 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (8m) 119s ago 8m 216M 2241M 18.2.1 5be31c24972a f1bdc2c50535 2024-09-13T22:59:55.898 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (8m) 119s ago 8m 191M 2241M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T22:59:55.898 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (105s) 58s ago 11m 55.8M - 2.43.0 a07b618ecd1d aa241d1048de 2024-09-13T22:59:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.898+0000 7fadc8052700 1 -- 172.21.15.2:0/1899150234 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fadac06e300 msgr2=0x7fadac0707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.898+0000 7fadc8052700 1 --2- 172.21.15.2:0/1899150234 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fadac06e300 0x7fadac0707c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fadc00fcdc0 tx=0x7fadb0008040 comp rx=0 tx=0).stop 2024-09-13T22:59:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.898+0000 7fadc8052700 1 -- 172.21.15.2:0/1899150234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc0101ec0 msgr2=0x7fadc019c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.898+0000 7fadc8052700 1 --2- 172.21.15.2:0/1899150234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc0101ec0 0x7fadc019c790 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0055f0 tx=0x7fadbc0056d0 comp rx=0 tx=0).stop 2024-09-13T22:59:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.898+0000 7fadc8052700 1 -- 172.21.15.2:0/1899150234 shutdown_connections 2024-09-13T22:59:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.898+0000 7fadc8052700 1 --2- 172.21.15.2:0/1899150234 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fadac06e300 0x7fadac0707c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.898+0000 7fadc8052700 1 --2- 172.21.15.2:0/1899150234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadc0101ec0 0x7fadc019c790 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.898+0000 7fadc8052700 1 --2- 172.21.15.2:0/1899150234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadc01027e0 0x7fadc019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:55.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.898+0000 7fadc8052700 1 -- 172.21.15.2:0/1899150234 >> 172.21.15.2:0/1899150234 conn(0x7fadc00fb650 msgr2=0x7fadc01054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:55.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.898+0000 7fadc8052700 1 -- 172.21.15.2:0/1899150234 shutdown_connections 2024-09-13T22:59:55.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:55.898+0000 7fadc8052700 1 -- 172.21.15.2:0/1899150234 wait complete. 2024-09-13T22:59:55.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:55 smithi047 ceph-mon[34560]: pgmap v95: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T22:59:55.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:55 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:55.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:55 smithi047 ceph-mon[34560]: Upgrade: Target is version 19.1.1-324-gecab7be5 (squid) 2024-09-13T22:59:55.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:55 smithi047 ceph-mon[34560]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, digests ['quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808'] 2024-09-13T22:59:55.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:55 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T22:59:55.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:55 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:55.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:55 smithi047 ceph-mon[34560]: Upgrade: Setting container_image for all mgr 2024-09-13T22:59:55.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:55 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:55.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:55 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T22:59:56.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.006+0000 7f6072d66700 1 -- 172.21.15.2:0/266755450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f606c101e60 msgr2=0x7f606c102240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:56.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.006+0000 7f6072d66700 1 --2- 172.21.15.2:0/266755450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f606c101e60 0x7f606c102240 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6060009910 tx=0x7f6060009c20 comp rx=0 tx=0).stop 2024-09-13T22:59:56.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.006+0000 7f6072d66700 1 -- 172.21.15.2:0/266755450 shutdown_connections 2024-09-13T22:59:56.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.006+0000 7f6072d66700 1 --2- 172.21.15.2:0/266755450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f606c102780 0x7f606c10ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.006+0000 7f6072d66700 1 --2- 172.21.15.2:0/266755450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f606c101e60 0x7f606c102240 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.006+0000 7f6072d66700 1 -- 172.21.15.2:0/266755450 >> 172.21.15.2:0/266755450 conn(0x7f606c0fb650 msgr2=0x7f606c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:56.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.006+0000 7f6072d66700 1 -- 172.21.15.2:0/266755450 shutdown_connections 2024-09-13T22:59:56.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.006+0000 7f6072d66700 1 -- 172.21.15.2:0/266755450 wait complete. 2024-09-13T22:59:56.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.007+0000 7f6072d66700 1 Processor -- start 2024-09-13T22:59:56.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.007+0000 7f6072d66700 1 -- start start 2024-09-13T22:59:56.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.007+0000 7f6072d66700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f606c101e60 0x7f606c19c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:56.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.007+0000 7f6072d66700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f606c102780 0x7f606c19cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:56.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.007+0000 7f6072d66700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606c19d220 con 0x7f606c101e60 2024-09-13T22:59:56.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.007+0000 7f6072d66700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606c196720 con 0x7f606c102780 2024-09-13T22:59:56.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.007+0000 7f6070b02700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f606c101e60 0x7f606c19c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:56.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.007+0000 7f6070b02700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f606c101e60 0x7f606c19c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34042/0 (socket says 172.21.15.2:34042) 2024-09-13T22:59:56.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.007+0000 7f6070b02700 1 -- 172.21.15.2:0/2600386115 learned_addr learned my addr 172.21.15.2:0/2600386115 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:59:56.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.008+0000 7f606bfff700 1 --2- 172.21.15.2:0/2600386115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f606c102780 0x7f606c19cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:56.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.008+0000 7f6070b02700 1 -- 172.21.15.2:0/2600386115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f606c102780 msgr2=0x7f606c19cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.008+0000 7f6070b02700 1 --2- 172.21.15.2:0/2600386115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f606c102780 0x7f606c19cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.008+0000 7f6070b02700 1 -- 172.21.15.2:0/2600386115 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60600095f0 con 0x7f606c101e60 2024-09-13T22:59:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.008+0000 7f6070b02700 1 --2- 172.21.15.2:0/2600386115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f606c101e60 0x7f606c19c650 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6060006010 tx=0x7f606000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.008+0000 7f6069ffb700 1 -- 172.21.15.2:0/2600386115 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f606001d070 con 0x7f606c101e60 2024-09-13T22:59:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.008+0000 7f6069ffb700 1 -- 172.21.15.2:0/2600386115 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f606000f460 con 0x7f606c101e60 2024-09-13T22:59:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.008+0000 7f6072d66700 1 -- 172.21.15.2:0/2600386115 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606c1969a0 con 0x7f606c101e60 2024-09-13T22:59:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.008+0000 7f6069ffb700 1 -- 172.21.15.2:0/2600386115 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6060017630 con 0x7f606c101e60 2024-09-13T22:59:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.008+0000 7f6072d66700 1 -- 172.21.15.2:0/2600386115 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606c196e90 con 0x7f606c101e60 2024-09-13T22:59:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.009+0000 7f6072d66700 1 -- 172.21.15.2:0/2600386115 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606c108310 con 0x7f606c101e60 2024-09-13T22:59:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.010+0000 7f6069ffb700 1 -- 172.21.15.2:0/2600386115 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7f606000f5d0 con 0x7f606c101e60 2024-09-13T22:59:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.010+0000 7f6069ffb700 1 --2- 172.21.15.2:0/2600386115 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f605c06e300 0x7f605c0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.010+0000 7f6069ffb700 1 -- 172.21.15.2:0/2600386115 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f606008f560 con 0x7f606c101e60 2024-09-13T22:59:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.010+0000 7f606bfff700 1 --2- 172.21.15.2:0/2600386115 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f605c06e300 0x7f605c0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.011+0000 7f606bfff700 1 --2- 172.21.15.2:0/2600386115 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f605c06e300 0x7f605c0707c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6058005950 tx=0x7f60580058e0 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:56.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.015+0000 7f6069ffb700 1 -- 172.21.15.2:0/2600386115 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f606005c760 con 0x7f606c101e60 2024-09-13T22:59:56.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.324+0000 7f6072d66700 1 -- 172.21.15.2:0/2600386115 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f606c197c80 con 0x7f606c101e60 2024-09-13T22:59:56.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.325+0000 7f6069ffb700 1 -- 172.21.15.2:0/2600386115 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f606005c2f0 con 0x7f606c101e60 2024-09-13T22:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T22:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-09-13T22:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T22:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T22:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-13T22:59:56.326 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T22:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-13T22:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T22:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T22:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-09-13T22:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T22:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T22:59:56.327 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:59:56.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.327+0000 7f6072d66700 1 -- 172.21.15.2:0/2600386115 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f605c06e300 msgr2=0x7f605c0707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:56.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.327+0000 7f6072d66700 1 --2- 172.21.15.2:0/2600386115 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f605c06e300 0x7f605c0707c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6058005950 tx=0x7f60580058e0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.327+0000 7f6072d66700 1 -- 172.21.15.2:0/2600386115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f606c101e60 msgr2=0x7f606c19c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:56.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.327+0000 7f6072d66700 1 --2- 172.21.15.2:0/2600386115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f606c101e60 0x7f606c19c650 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6060006010 tx=0x7f606000be20 comp rx=0 tx=0).stop 2024-09-13T22:59:56.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.327+0000 7f6072d66700 1 -- 172.21.15.2:0/2600386115 shutdown_connections 2024-09-13T22:59:56.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.327+0000 7f6072d66700 1 --2- 172.21.15.2:0/2600386115 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f605c06e300 0x7f605c0707c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.327+0000 7f6072d66700 1 --2- 172.21.15.2:0/2600386115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f606c101e60 0x7f606c19c650 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.327+0000 7f6072d66700 1 --2- 172.21.15.2:0/2600386115 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f606c102780 0x7f606c19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.327+0000 7f6072d66700 1 -- 172.21.15.2:0/2600386115 >> 172.21.15.2:0/2600386115 conn(0x7f606c0fb650 msgr2=0x7f606c105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:56.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.327+0000 7f6072d66700 1 -- 172.21.15.2:0/2600386115 shutdown_connections 2024-09-13T22:59:56.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.327+0000 7f6072d66700 1 -- 172.21.15.2:0/2600386115 wait complete. 2024-09-13T22:59:56.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.452+0000 7fe5309ba700 1 -- 172.21.15.2:0/4103729516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe52c102720 msgr2=0x7fe52c10ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:56.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.452+0000 7fe5309ba700 1 --2- 172.21.15.2:0/4103729516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe52c102720 0x7fe52c10ac10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe520009910 tx=0x7fe520009c20 comp rx=0 tx=0).stop 2024-09-13T22:59:56.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.452+0000 7fe5309ba700 1 -- 172.21.15.2:0/4103729516 shutdown_connections 2024-09-13T22:59:56.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.452+0000 7fe5309ba700 1 --2- 172.21.15.2:0/4103729516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe52c102720 0x7fe52c10ac10 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.452+0000 7fe5309ba700 1 --2- 172.21.15.2:0/4103729516 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe52c101e00 0x7fe52c1021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.452+0000 7fe5309ba700 1 -- 172.21.15.2:0/4103729516 >> 172.21.15.2:0/4103729516 conn(0x7fe52c0fb650 msgr2=0x7fe52c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:56.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.452+0000 7fe5309ba700 1 -- 172.21.15.2:0/4103729516 shutdown_connections 2024-09-13T22:59:56.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.452+0000 7fe5309ba700 1 -- 172.21.15.2:0/4103729516 wait complete. 2024-09-13T22:59:56.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.453+0000 7fe5309ba700 1 Processor -- start 2024-09-13T22:59:56.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.453+0000 7fe5309ba700 1 -- start start 2024-09-13T22:59:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.454+0000 7fe5309ba700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe52c101e00 0x7fe52c0ffa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.454+0000 7fe5309ba700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe52c102720 0x7fe52c0fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.454+0000 7fe5309ba700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c1004e0 con 0x7fe52c102720 2024-09-13T22:59:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.454+0000 7fe5309ba700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c100620 con 0x7fe52c101e00 2024-09-13T22:59:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.454+0000 7fe529d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe52c102720 0x7fe52c0fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.454+0000 7fe529d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe52c102720 0x7fe52c0fffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34058/0 (socket says 172.21.15.2:34058) 2024-09-13T22:59:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.454+0000 7fe529d9b700 1 -- 172.21.15.2:0/2348499263 learned_addr learned my addr 172.21.15.2:0/2348499263 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:59:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.454+0000 7fe52a59c700 1 --2- 172.21.15.2:0/2348499263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe52c101e00 0x7fe52c0ffa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.454+0000 7fe529d9b700 1 -- 172.21.15.2:0/2348499263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe52c101e00 msgr2=0x7fe52c0ffa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.454+0000 7fe529d9b700 1 --2- 172.21.15.2:0/2348499263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe52c101e00 0x7fe52c0ffa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.454+0000 7fe529d9b700 1 -- 172.21.15.2:0/2348499263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5200095f0 con 0x7fe52c102720 2024-09-13T22:59:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.454+0000 7fe52a59c700 1 --2- 172.21.15.2:0/2348499263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe52c101e00 0x7fe52c0ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T22:59:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.454+0000 7fe529d9b700 1 --2- 172.21.15.2:0/2348499263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe52c102720 0x7fe52c0fffa0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe52000bd70 tx=0x7fe52000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.454+0000 7fe51b7fe700 1 -- 172.21.15.2:0/2348499263 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe52001d070 con 0x7fe52c102720 2024-09-13T22:59:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.454+0000 7fe51b7fe700 1 -- 172.21.15.2:0/2348499263 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe520005dc0 con 0x7fe52c102720 2024-09-13T22:59:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.454+0000 7fe5309ba700 1 -- 172.21.15.2:0/2348499263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52c1008a0 con 0x7fe52c102720 2024-09-13T22:59:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.454+0000 7fe51b7fe700 1 -- 172.21.15.2:0/2348499263 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe520017400 con 0x7fe52c102720 2024-09-13T22:59:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.454+0000 7fe5309ba700 1 -- 172.21.15.2:0/2348499263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52c1a2dc0 con 0x7fe52c102720 2024-09-13T22:59:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.455+0000 7fe5309ba700 1 -- 172.21.15.2:0/2348499263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52c108310 con 0x7fe52c102720 2024-09-13T22:59:56.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.456+0000 7fe51b7fe700 1 -- 172.21.15.2:0/2348499263 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7fe52000f7b0 con 0x7fe52c102720 2024-09-13T22:59:56.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.456+0000 7fe51b7fe700 1 --2- 172.21.15.2:0/2348499263 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe51406e300 0x7fe5140707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:56.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.457+0000 7fe51b7fe700 1 -- 172.21.15.2:0/2348499263 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fe52008f510 con 0x7fe52c102720 2024-09-13T22:59:56.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.457+0000 7fe52a59c700 1 --2- 172.21.15.2:0/2348499263 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe51406e300 0x7fe5140707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:56.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.457+0000 7fe52a59c700 1 --2- 172.21.15.2:0/2348499263 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe51406e300 0x7fe5140707c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe51c005950 tx=0x7fe51c0058e0 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:56.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.461+0000 7fe51b7fe700 1 -- 172.21.15.2:0/2348499263 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7fe520058bc0 con 0x7fe52c102720 2024-09-13T22:59:56.642 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:56 smithi002 ceph-mon[27637]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:56.642 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:56 smithi002 ceph-mon[27637]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:56.642 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:56 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:56.642 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:56 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:59:56.642 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:56 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:59:56.642 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:56 smithi002 ceph-mon[27637]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:56.642 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:56 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2600386115' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:56.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.719+0000 7fe5309ba700 1 -- 172.21.15.2:0/2348499263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe52c100f90 con 0x7fe52c102720 2024-09-13T22:59:56.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.720+0000 7fe51b7fe700 1 -- 172.21.15.2:0/2348499263 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1847 (secure 0 0 0) 0x7fe520061e60 con 0x7fe52c102720 2024-09-13T22:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:e16 2024-09-13T22:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-13T22:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-13T22:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-13T22:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 16 2024-09-13T22:59:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T22:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-13T22:53:05.963265+0000 2024-09-13T22:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-13T22:53:25.072026+0000 2024-09-13T22:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-13T22:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-13T22:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-13T22:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-13T22:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-13T22:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-13T22:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-13T22:59:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 47 2024-09-13T22:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 1 2024-09-13T22:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:in 0 2024-09-13T22:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24267} 2024-09-13T22:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-13T22:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-13T22:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-13T22:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-13T22:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-13T22:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-13T22:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-13T22:59:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-13T22:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-13T22:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.gxzkha{0:24267} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.gglyyr{0:14488} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.2:6828/2123560657,v1:172.21.15.2:6829/2123560657] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-13T22:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T22:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.auedll{-1:14500} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/1577962179,v1:172.21.15.2:6827/1577962179] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:59:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.nqvveh{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:59:56.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.722+0000 7fe5309ba700 1 -- 172.21.15.2:0/2348499263 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe51406e300 msgr2=0x7fe5140707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:56.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.722+0000 7fe5309ba700 1 --2- 172.21.15.2:0/2348499263 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe51406e300 0x7fe5140707c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe51c005950 tx=0x7fe51c0058e0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.722+0000 7fe5309ba700 1 -- 172.21.15.2:0/2348499263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe52c102720 msgr2=0x7fe52c0fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:56.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.722+0000 7fe5309ba700 1 --2- 172.21.15.2:0/2348499263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe52c102720 0x7fe52c0fffa0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe52000bd70 tx=0x7fe52000be50 comp rx=0 tx=0).stop 2024-09-13T22:59:56.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.722+0000 7fe5309ba700 1 -- 172.21.15.2:0/2348499263 shutdown_connections 2024-09-13T22:59:56.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.722+0000 7fe5309ba700 1 --2- 172.21.15.2:0/2348499263 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7fe51406e300 0x7fe5140707c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.722+0000 7fe5309ba700 1 --2- 172.21.15.2:0/2348499263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe52c101e00 0x7fe52c0ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.722+0000 7fe5309ba700 1 --2- 172.21.15.2:0/2348499263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe52c102720 0x7fe52c0fffa0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.722+0000 7fe5309ba700 1 -- 172.21.15.2:0/2348499263 >> 172.21.15.2:0/2348499263 conn(0x7fe52c0fb650 msgr2=0x7fe52c105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:56.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.722+0000 7fe5309ba700 1 -- 172.21.15.2:0/2348499263 shutdown_connections 2024-09-13T22:59:56.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.722+0000 7fe5309ba700 1 -- 172.21.15.2:0/2348499263 wait complete. 2024-09-13T22:59:56.727 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2024-09-13T22:59:56.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.834+0000 7f903b6a4700 1 -- 172.21.15.2:0/2127370737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9034100ea0 msgr2=0x7f9034101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:56.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.834+0000 7f903b6a4700 1 --2- 172.21.15.2:0/2127370737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9034100ea0 0x7f9034101280 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9030009910 tx=0x7f9030009c20 comp rx=0 tx=0).stop 2024-09-13T22:59:56.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.834+0000 7f903b6a4700 1 -- 172.21.15.2:0/2127370737 shutdown_connections 2024-09-13T22:59:56.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.834+0000 7f903b6a4700 1 --2- 172.21.15.2:0/2127370737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9034101850 0x7f90341058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.834+0000 7f903b6a4700 1 --2- 172.21.15.2:0/2127370737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9034100ea0 0x7f9034101280 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.834+0000 7f903b6a4700 1 -- 172.21.15.2:0/2127370737 >> 172.21.15.2:0/2127370737 conn(0x7f90340fc750 msgr2=0x7f90340feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:56.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.834+0000 7f903b6a4700 1 -- 172.21.15.2:0/2127370737 shutdown_connections 2024-09-13T22:59:56.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.834+0000 7f903b6a4700 1 -- 172.21.15.2:0/2127370737 wait complete. 2024-09-13T22:59:56.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.834+0000 7f903b6a4700 1 Processor -- start 2024-09-13T22:59:56.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.834+0000 7f903b6a4700 1 -- start start 2024-09-13T22:59:56.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.835+0000 7f903b6a4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9034100ea0 0x7f9034073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:56.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.835+0000 7f903b6a4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9034101850 0x7f90340735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:56.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.835+0000 7f903b6a4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9034073b10 con 0x7f9034101850 2024-09-13T22:59:56.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.835+0000 7f903b6a4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9034073c50 con 0x7f9034100ea0 2024-09-13T22:59:56.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.835+0000 7f9038c3f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9034101850 0x7f90340735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:56.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.835+0000 7f9038c3f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9034101850 0x7f90340735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34074/0 (socket says 172.21.15.2:34074) 2024-09-13T22:59:56.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.835+0000 7f9038c3f700 1 -- 172.21.15.2:0/3538966407 learned_addr learned my addr 172.21.15.2:0/3538966407 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:59:56.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.835+0000 7f9039440700 1 --2- 172.21.15.2:0/3538966407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9034100ea0 0x7f9034073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:56.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.835+0000 7f9038c3f700 1 -- 172.21.15.2:0/3538966407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9034100ea0 msgr2=0x7f9034073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:56.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.835+0000 7f9038c3f700 1 --2- 172.21.15.2:0/3538966407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9034100ea0 0x7f9034073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:56.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.835+0000 7f9038c3f700 1 -- 172.21.15.2:0/3538966407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90300095f0 con 0x7f9034101850 2024-09-13T22:59:56.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.835+0000 7f9038c3f700 1 --2- 172.21.15.2:0/3538966407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9034101850 0x7f90340735d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f902400c8f0 tx=0x7f902400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:56.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.836+0000 7f902a7fc700 1 -- 172.21.15.2:0/3538966407 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9024007a50 con 0x7f9034101850 2024-09-13T22:59:56.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.836+0000 7f903b6a4700 1 -- 172.21.15.2:0/3538966407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90341a2af0 con 0x7f9034101850 2024-09-13T22:59:56.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.836+0000 7f902a7fc700 1 -- 172.21.15.2:0/3538966407 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9024007bb0 con 0x7f9034101850 2024-09-13T22:59:56.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.836+0000 7f902a7fc700 1 -- 172.21.15.2:0/3538966407 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9024018630 con 0x7f9034101850 2024-09-13T22:59:56.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.836+0000 7f903b6a4700 1 -- 172.21.15.2:0/3538966407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90341a2f00 con 0x7f9034101850 2024-09-13T22:59:56.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.837+0000 7f903b6a4700 1 -- 172.21.15.2:0/3538966407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9034109240 con 0x7f9034101850 2024-09-13T22:59:56.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.837+0000 7f902a7fc700 1 -- 172.21.15.2:0/3538966407 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7f9024007d20 con 0x7f9034101850 2024-09-13T22:59:56.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.838+0000 7f902a7fc700 1 --2- 172.21.15.2:0/3538966407 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f902006e300 0x7f90200707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:56.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.838+0000 7f902a7fc700 1 -- 172.21.15.2:0/3538966407 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f902408e090 con 0x7f9034101850 2024-09-13T22:59:56.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.838+0000 7f9039440700 1 --2- 172.21.15.2:0/3538966407 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f902006e300 0x7f90200707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:56.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.838+0000 7f9039440700 1 --2- 172.21.15.2:0/3538966407 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f902006e300 0x7f90200707c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9030006010 tx=0x7f903001a040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:56.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:56.842+0000 7f902a7fc700 1 -- 172.21.15.2:0/3538966407 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7f9024057760 con 0x7f9034101850 2024-09-13T22:59:56.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:56 smithi047 ceph-mon[34560]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:56.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:56 smithi047 ceph-mon[34560]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:56.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:56 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' 2024-09-13T22:59:56.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:56 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T22:59:56.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:56 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T22:59:56.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:56 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T22:59:56.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:56 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/2600386115' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T22:59:57.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.073+0000 7f903b6a4700 1 -- 172.21.15.2:0/3538966407 --> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f90340746b0 con 0x7f902006e300 2024-09-13T22:59:57.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.074+0000 7f902a7fc700 1 -- 172.21.15.2:0/3538966407 <== mgr.14658 v2:172.21.15.2:6800/967175774 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f90340746b0 con 0x7f902006e300 2024-09-13T22:59:57.075 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T22:59:57.075 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T22:59:57.075 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T22:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T22:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-13T22:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr" 2024-09-13T22:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-13T22:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "2/23 daemons upgraded", 2024-09-13T22:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading mon daemons", 2024-09-13T22:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T22:59:57.076 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T22:59:57.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.077+0000 7f903b6a4700 1 -- 172.21.15.2:0/3538966407 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f902006e300 msgr2=0x7f90200707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:57.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.077+0000 7f903b6a4700 1 --2- 172.21.15.2:0/3538966407 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f902006e300 0x7f90200707c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9030006010 tx=0x7f903001a040 comp rx=0 tx=0).stop 2024-09-13T22:59:57.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.077+0000 7f903b6a4700 1 -- 172.21.15.2:0/3538966407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9034101850 msgr2=0x7f90340735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:57.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.077+0000 7f903b6a4700 1 --2- 172.21.15.2:0/3538966407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9034101850 0x7f90340735d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f902400c8f0 tx=0x7f902400ccb0 comp rx=0 tx=0).stop 2024-09-13T22:59:57.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.077+0000 7f903b6a4700 1 -- 172.21.15.2:0/3538966407 shutdown_connections 2024-09-13T22:59:57.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.077+0000 7f903b6a4700 1 --2- 172.21.15.2:0/3538966407 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7f902006e300 0x7f90200707c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:57.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.077+0000 7f903b6a4700 1 --2- 172.21.15.2:0/3538966407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9034100ea0 0x7f9034073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:57.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.077+0000 7f903b6a4700 1 --2- 172.21.15.2:0/3538966407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9034101850 0x7f90340735d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:57.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.077+0000 7f903b6a4700 1 -- 172.21.15.2:0/3538966407 >> 172.21.15.2:0/3538966407 conn(0x7f90340fc750 msgr2=0x7f90340fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:57.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.077+0000 7f903b6a4700 1 -- 172.21.15.2:0/3538966407 shutdown_connections 2024-09-13T22:59:57.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.077+0000 7f903b6a4700 1 -- 172.21.15.2:0/3538966407 wait complete. 2024-09-13T22:59:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.185+0000 7ff6b2e82700 1 -- 172.21.15.2:0/1020851465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6ac100750 msgr2=0x7ff6ac1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.185+0000 7ff6b2e82700 1 --2- 172.21.15.2:0/1020851465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6ac100750 0x7ff6ac1047a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff698009910 tx=0x7ff698009c20 comp rx=0 tx=0).stop 2024-09-13T22:59:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.186+0000 7ff6b2e82700 1 -- 172.21.15.2:0/1020851465 shutdown_connections 2024-09-13T22:59:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.186+0000 7ff6b2e82700 1 --2- 172.21.15.2:0/1020851465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6ac100750 0x7ff6ac1047a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.186+0000 7ff6b2e82700 1 --2- 172.21.15.2:0/1020851465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6ac0ffda0 0x7ff6ac100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.186+0000 7ff6b2e82700 1 -- 172.21.15.2:0/1020851465 >> 172.21.15.2:0/1020851465 conn(0x7ff6ac0fb650 msgr2=0x7ff6ac0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.186+0000 7ff6b2e82700 1 -- 172.21.15.2:0/1020851465 shutdown_connections 2024-09-13T22:59:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.186+0000 7ff6b2e82700 1 -- 172.21.15.2:0/1020851465 wait complete. 2024-09-13T22:59:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.186+0000 7ff6b2e82700 1 Processor -- start 2024-09-13T22:59:57.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.186+0000 7ff6b2e82700 1 -- start start 2024-09-13T22:59:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.186+0000 7ff6b2e82700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6ac0ffda0 0x7ff6ac197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.186+0000 7ff6b2e82700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6ac100750 0x7ff6ac197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.187+0000 7ff6b2e82700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac1983b0 con 0x7ff6ac100750 2024-09-13T22:59:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.187+0000 7ff6b2e82700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac1984f0 con 0x7ff6ac0ffda0 2024-09-13T22:59:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.187+0000 7ff6abfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6ac100750 0x7ff6ac197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.187+0000 7ff6abfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6ac100750 0x7ff6ac197d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34096/0 (socket says 172.21.15.2:34096) 2024-09-13T22:59:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.187+0000 7ff6abfff700 1 -- 172.21.15.2:0/3368421441 learned_addr learned my addr 172.21.15.2:0/3368421441 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T22:59:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.187+0000 7ff6b0c1e700 1 --2- 172.21.15.2:0/3368421441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6ac0ffda0 0x7ff6ac197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:57.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.187+0000 7ff6abfff700 1 -- 172.21.15.2:0/3368421441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6ac0ffda0 msgr2=0x7ff6ac197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:57.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.187+0000 7ff6abfff700 1 --2- 172.21.15.2:0/3368421441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6ac0ffda0 0x7ff6ac197850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:57.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.187+0000 7ff6abfff700 1 -- 172.21.15.2:0/3368421441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6980095f0 con 0x7ff6ac100750 2024-09-13T22:59:57.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.187+0000 7ff6abfff700 1 --2- 172.21.15.2:0/3368421441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6ac100750 0x7ff6ac197d90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff69800bda0 tx=0x7ff69800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:57.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.187+0000 7ff6a9ffb700 1 -- 172.21.15.2:0/3368421441 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff69801d070 con 0x7ff6ac100750 2024-09-13T22:59:57.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.187+0000 7ff6b2e82700 1 -- 172.21.15.2:0/3368421441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ac1a08c0 con 0x7ff6ac100750 2024-09-13T22:59:57.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.187+0000 7ff6a9ffb700 1 -- 172.21.15.2:0/3368421441 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff69800f460 con 0x7ff6ac100750 2024-09-13T22:59:57.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.187+0000 7ff6a9ffb700 1 -- 172.21.15.2:0/3368421441 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff698017630 con 0x7ff6ac100750 2024-09-13T22:59:57.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.188+0000 7ff6b2e82700 1 -- 172.21.15.2:0/3368421441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ac1a0cd0 con 0x7ff6ac100750 2024-09-13T22:59:57.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.189+0000 7ff6b2e82700 1 -- 172.21.15.2:0/3368421441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6ac1080f0 con 0x7ff6ac100750 2024-09-13T22:59:57.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.189+0000 7ff6a9ffb700 1 -- 172.21.15.2:0/3368421441 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92402+0+0 (secure 0 0 0) 0x7ff69800fab0 con 0x7ff6ac100750 2024-09-13T22:59:57.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.190+0000 7ff6a9ffb700 1 --2- 172.21.15.2:0/3368421441 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ff69c06e300 0x7ff69c0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T22:59:57.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.190+0000 7ff6a9ffb700 1 -- 172.21.15.2:0/3368421441 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7ff69808f5a0 con 0x7ff6ac100750 2024-09-13T22:59:57.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.190+0000 7ff6b0c1e700 1 --2- 172.21.15.2:0/3368421441 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ff69c06e300 0x7ff69c0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T22:59:57.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.190+0000 7ff6b0c1e700 1 --2- 172.21.15.2:0/3368421441 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ff69c06e300 0x7ff69c0707c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0009a10 tx=0x7ff6a0009190 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T22:59:57.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.194+0000 7ff6a9ffb700 1 -- 172.21.15.2:0/3368421441 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186835 (secure 0 0 0) 0x7ff698058d30 con 0x7ff6ac100750 2024-09-13T22:59:57.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.500+0000 7ff6b2e82700 1 -- 172.21.15.2:0/3368421441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff6ac0694f0 con 0x7ff6ac100750 2024-09-13T22:59:57.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.500+0000 7ff6a9ffb700 1 -- 172.21.15.2:0/3368421441 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7ff69805c3f0 con 0x7ff6ac100750 2024-09-13T22:59:57.501 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T22:59:57.501 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T22:59:57.501 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T22:59:57.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.502+0000 7ff6b2e82700 1 -- 172.21.15.2:0/3368421441 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ff69c06e300 msgr2=0x7ff69c0707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:57.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.502+0000 7ff6b2e82700 1 --2- 172.21.15.2:0/3368421441 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ff69c06e300 0x7ff69c0707c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0009a10 tx=0x7ff6a0009190 comp rx=0 tx=0).stop 2024-09-13T22:59:57.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.502+0000 7ff6b2e82700 1 -- 172.21.15.2:0/3368421441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6ac100750 msgr2=0x7ff6ac197d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T22:59:57.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.502+0000 7ff6b2e82700 1 --2- 172.21.15.2:0/3368421441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6ac100750 0x7ff6ac197d90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff69800bda0 tx=0x7ff69800bdd0 comp rx=0 tx=0).stop 2024-09-13T22:59:57.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.502+0000 7ff6b2e82700 1 -- 172.21.15.2:0/3368421441 shutdown_connections 2024-09-13T22:59:57.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.502+0000 7ff6b2e82700 1 --2- 172.21.15.2:0/3368421441 >> [v2:172.21.15.2:6800/967175774,v1:172.21.15.2:6801/967175774] conn(0x7ff69c06e300 0x7ff69c0707c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:57.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.502+0000 7ff6b2e82700 1 --2- 172.21.15.2:0/3368421441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6ac0ffda0 0x7ff6ac197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:57.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.502+0000 7ff6b2e82700 1 --2- 172.21.15.2:0/3368421441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6ac100750 0x7ff6ac197d90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T22:59:57.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.502+0000 7ff6b2e82700 1 -- 172.21.15.2:0/3368421441 >> 172.21.15.2:0/3368421441 conn(0x7ff6ac0fb650 msgr2=0x7ff6ac0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T22:59:57.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.502+0000 7ff6b2e82700 1 -- 172.21.15.2:0/3368421441 shutdown_connections 2024-09-13T22:59:57.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T22:59:57.502+0000 7ff6b2e82700 1 -- 172.21.15.2:0/3368421441 wait complete. 2024-09-13T22:59:57.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:57 smithi002 ceph-mon[27637]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:57.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:57 smithi002 ceph-mon[27637]: Upgrade: Updating mon.smithi002 2024-09-13T22:59:57.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:57 smithi002 ceph-mon[27637]: Deploying daemon mon.smithi002 on smithi002 2024-09-13T22:59:57.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:57 smithi002 ceph-mon[27637]: pgmap v96: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:57.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:57 smithi002 ceph-mon[27637]: from='client.? 172.21.15.2:0/2348499263' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:59:57.814 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:57 smithi047 ceph-mon[34560]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T22:59:57.814 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:57 smithi047 ceph-mon[34560]: Upgrade: Updating mon.smithi002 2024-09-13T22:59:57.814 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:57 smithi047 ceph-mon[34560]: Deploying daemon mon.smithi002 on smithi002 2024-09-13T22:59:57.814 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:57 smithi047 ceph-mon[34560]: pgmap v96: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T22:59:57.814 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 22:59:57 smithi047 ceph-mon[34560]: from='client.? 172.21.15.2:0/2348499263' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T22:59:58.105 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:57 smithi002 systemd[1]: Stopping Ceph mon.smithi002 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T22:59:58.105 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:58 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002[27633]: 2024-09-13T22:59:58.092+0000 7fc7afe96700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi002 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T22:59:58.105 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:58 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002[27633]: 2024-09-13T22:59:58.092+0000 7fc7afe96700 -1 mon.smithi002@0(leader) e2 *** Got Signal Terminated *** 2024-09-13T22:59:58.390 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:58 smithi002 podman[111120]: 2024-09-13 22:59:58.1441057 +0000 UTC m=+0.147439112 container died de11be74385db02f075a56ef2443b4c331430dd8abf1279c6753b4a22746eefa (image=quay.io/ceph/ceph:v18.2.1, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.1, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.29.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=HEAD, org.label-schema.schema-version=1.0) 2024-09-13T22:59:58.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:58 smithi002 podman[111120]: 2024-09-13 22:59:58.526162903 +0000 UTC m=+0.529496302 container cleanup de11be74385db02f075a56ef2443b4c331430dd8abf1279c6753b4a22746eefa (image=quay.io/ceph/ceph:v18.2.1, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.1, ceph=True) 2024-09-13T22:59:58.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:58 smithi002 bash[111120]: ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002 2024-09-13T22:59:59.200 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:58 smithi002 podman[111134]: 2024-09-13 22:59:58.844442307 +0000 UTC m=+0.690560392 container remove de11be74385db02f075a56ef2443b4c331430dd8abf1279c6753b4a22746eefa (image=quay.io/ceph/ceph:v18.2.1, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, ceph=True) 2024-09-13T22:59:59.200 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:58 smithi002 systemd[1]: ceph-e41042f8-7221-11ef-bceb-c7b262605968@mon.smithi002.service: Deactivated successfully. 2024-09-13T22:59:59.200 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:58 smithi002 systemd[1]: Stopped Ceph mon.smithi002 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T22:59:59.200 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:58 smithi002 systemd[1]: ceph-e41042f8-7221-11ef-bceb-c7b262605968@mon.smithi002.service: Consumed 15.042s CPU time. 2024-09-13T22:59:59.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 systemd[1]: Starting Ceph mon.smithi002 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T22:59:59.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 podman[111275]: 2024-09-13 22:59:59.31215364 +0000 UTC m=+0.016559501 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T22:59:59.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 podman[111275]: 2024-09-13 22:59:59.412290246 +0000 UTC m=+0.116696110 container create db0ef6c509cf7f9dadd69f2fd8123c47001fb40d3bed81b475f426dd5370da24 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-13T22:59:59.790 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 podman[111275]: 2024-09-13 22:59:59.623052921 +0000 UTC m=+0.327458782 container init db0ef6c509cf7f9dadd69f2fd8123c47001fb40d3bed81b475f426dd5370da24 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T22:59:59.790 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 podman[111275]: 2024-09-13 22:59:59.626384307 +0000 UTC m=+0.330790177 container start db0ef6c509cf7f9dadd69f2fd8123c47001fb40d3bed81b475f426dd5370da24 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T22:59:59.790 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T22:59:59.791 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable), process ceph-mon, pid 2 2024-09-13T22:59:59.791 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: pidfile_write: ignore empty --pid-file 2024-09-13T22:59:59.791 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: load: jerasure load: lrc 2024-09-13T22:59:59.791 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: RocksDB version: 7.9.2 2024-09-13T22:59:59.791 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Git sha 0 2024-09-13T22:59:59.791 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Compile date 2024-09-13 16:59:10 2024-09-13T22:59:59.791 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: DB SUMMARY 2024-09-13T22:59:59.791 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: DB Session ID: ORRXOODGNA0VIB7V5N29 2024-09-13T22:59:59.791 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: CURRENT file: CURRENT 2024-09-13T22:59:59.791 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T22:59:59.791 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1509 Bytes 2024-09-13T22:59:59.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi002/store.db dir, Total Num: 1, files: 000032.sst 2024-09-13T22:59:59.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi002/store.db: 000030.log size: 3596824 ; 2024-09-13T22:59:59.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.error_if_exists: 0 2024-09-13T22:59:59.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.create_if_missing: 0 2024-09-13T22:59:59.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.paranoid_checks: 1 2024-09-13T22:59:59.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T22:59:59.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T22:59:59.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T22:59:59.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.env: 0x55976ce7b940 2024-09-13T22:59:59.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T22:59:59.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.info_log: 0x55976eae38c0 2024-09-13T22:59:59.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T22:59:59.794 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.statistics: (nil) 2024-09-13T22:59:59.794 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.use_fsync: 0 2024-09-13T22:59:59.794 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_log_file_size: 0 2024-09-13T22:59:59.794 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T22:59:59.794 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T22:59:59.794 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T22:59:59.794 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T22:59:59.795 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.allow_fallocate: 1 2024-09-13T22:59:59.795 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T22:59:59.795 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T22:59:59.795 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.use_direct_reads: 0 2024-09-13T22:59:59.795 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T22:59:59.795 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T22:59:59.795 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.db_log_dir: 2024-09-13T22:59:59.795 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.wal_dir: 2024-09-13T22:59:59.795 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T22:59:59.795 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T22:59:59.795 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T22:59:59.795 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T22:59:59.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T22:59:59.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T22:59:59.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T22:59:59.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T22:59:59.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.write_buffer_manager: 0x55976eaf2dc0 2024-09-13T22:59:59.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T22:59:59.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T22:59:59.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T22:59:59.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T22:59:59.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T22:59:59.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T22:59:59.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T22:59:59.797 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T22:59:59.797 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.unordered_write: 0 2024-09-13T22:59:59.797 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T22:59:59.797 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T22:59:59.797 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T22:59:59.797 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T22:59:59.797 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.row_cache: None 2024-09-13T22:59:59.797 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.wal_filter: None 2024-09-13T22:59:59.797 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T22:59:59.797 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T22:59:59.797 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.two_write_queues: 0 2024-09-13T22:59:59.797 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T22:59:59.797 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.wal_compression: 0 2024-09-13T22:59:59.797 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.atomic_flush: 0 2024-09-13T22:59:59.798 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T22:59:59.798 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T22:59:59.798 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T22:59:59.798 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.log_readahead_size: 0 2024-09-13T22:59:59.798 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T22:59:59.798 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T22:59:59.798 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T22:59:59.798 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T22:59:59.798 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T22:59:59.798 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T22:59:59.798 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T22:59:59.798 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_background_jobs: 2 2024-09-13T22:59:59.798 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_background_compactions: -1 2024-09-13T22:59:59.799 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_subcompactions: 1 2024-09-13T22:59:59.799 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T22:59:59.799 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T22:59:59.799 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T22:59:59.799 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T22:59:59.799 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T22:59:59.799 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T22:59:59.799 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T22:59:59.799 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T22:59:59.799 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_open_files: -1 2024-09-13T22:59:59.799 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T22:59:59.799 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T22:59:59.799 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T22:59:59.799 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T22:59:59.800 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_background_flushes: -1 2024-09-13T22:59:59.800 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Compression algorithms supported: 2024-09-13T22:59:59.800 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: kZSTD supported: 0 2024-09-13T22:59:59.800 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: kXpressCompression supported: 0 2024-09-13T22:59:59.800 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: kBZip2Compression supported: 0 2024-09-13T22:59:59.800 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T22:59:59.800 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: kLZ4Compression supported: 1 2024-09-13T22:59:59.800 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: kZlibCompression supported: 1 2024-09-13T22:59:59.800 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T22:59:59.800 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: kSnappyCompression supported: 1 2024-09-13T22:59:59.800 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T22:59:59.800 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T22:59:59.800 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi002/store.db/MANIFEST-000015 2024-09-13T22:59:59.801 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T22:59:59.801 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T22:59:59.801 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.merge_operator: 2024-09-13T22:59:59.801 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compaction_filter: None 2024-09-13T22:59:59.801 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T22:59:59.801 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T22:59:59.801 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T22:59:59.801 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T22:59:59.801 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55976eae3520) 2024-09-13T22:59:59.801 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: cache_index_and_filter_blocks: 1 2024-09-13T22:59:59.801 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T22:59:59.801 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T22:59:59.801 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: pin_top_level_index_and_filter: 1 2024-09-13T22:59:59.802 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: index_type: 0 2024-09-13T22:59:59.802 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: data_block_index_type: 0 2024-09-13T22:59:59.802 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: index_shortening: 1 2024-09-13T22:59:59.802 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T22:59:59.802 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: checksum: 4 2024-09-13T22:59:59.802 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: no_block_cache: 0 2024-09-13T22:59:59.802 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache: 0x55976ead71f0 2024-09-13T22:59:59.802 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache_name: BinnedLRUCache 2024-09-13T22:59:59.802 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache_options: 2024-09-13T22:59:59.802 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: capacity : 536870912 2024-09-13T22:59:59.802 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: num_shard_bits : 4 2024-09-13T22:59:59.802 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: strict_capacity_limit : 0 2024-09-13T22:59:59.803 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: high_pri_pool_ratio: 0.000 2024-09-13T22:59:59.803 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache_compressed: (nil) 2024-09-13T22:59:59.803 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: persistent_cache: (nil) 2024-09-13T22:59:59.803 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_size: 4096 2024-09-13T22:59:59.803 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_size_deviation: 10 2024-09-13T22:59:59.803 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_restart_interval: 16 2024-09-13T22:59:59.803 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: index_block_restart_interval: 1 2024-09-13T22:59:59.803 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: metadata_block_size: 4096 2024-09-13T22:59:59.803 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: partition_filters: 0 2024-09-13T22:59:59.803 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: use_delta_encoding: 1 2024-09-13T22:59:59.803 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: filter_policy: bloomfilter 2024-09-13T22:59:59.803 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: whole_key_filtering: 1 2024-09-13T22:59:59.803 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: verify_compression: 0 2024-09-13T22:59:59.804 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: read_amp_bytes_per_bit: 0 2024-09-13T22:59:59.804 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: format_version: 5 2024-09-13T22:59:59.804 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: enable_index_compression: 1 2024-09-13T22:59:59.804 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_align: 0 2024-09-13T22:59:59.804 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: max_auto_readahead_size: 262144 2024-09-13T22:59:59.804 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: prepopulate_block_cache: 0 2024-09-13T22:59:59.804 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: initial_auto_readahead_size: 8192 2024-09-13T22:59:59.804 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T22:59:59.804 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T22:59:59.804 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T22:59:59.804 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compression: NoCompression 2024-09-13T22:59:59.804 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T22:59:59.804 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T22:59:59.805 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T22:59:59.805 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.num_levels: 7 2024-09-13T22:59:59.805 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T22:59:59.805 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T22:59:59.805 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T22:59:59.805 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T22:59:59.805 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T22:59:59.805 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T22:59:59.805 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T22:59:59.805 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:59:59.805 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T22:59:59.805 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T22:59:59.805 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T22:59:59.806 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T22:59:59.806 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T22:59:59.806 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T22:59:59.806 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T22:59:59.806 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T22:59:59.806 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T22:59:59.806 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T22:59:59.806 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T22:59:59.806 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T22:59:59.806 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T22:59:59.806 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T22:59:59.806 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T22:59:59.806 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T22:59:59.806 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T22:59:59.807 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T22:59:59.807 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T22:59:59.807 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T22:59:59.807 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T22:59:59.807 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T22:59:59.807 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T22:59:59.807 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T22:59:59.807 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T22:59:59.807 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T22:59:59.807 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T22:59:59.807 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T22:59:59.807 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T22:59:59.808 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T22:59:59.808 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T22:59:59.808 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T22:59:59.808 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T22:59:59.808 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T22:59:59.808 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T22:59:59.808 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T22:59:59.808 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T22:59:59.808 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T22:59:59.808 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T22:59:59.808 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T22:59:59.809 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T22:59:59.809 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T22:59:59.809 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T22:59:59.809 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T22:59:59.809 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T22:59:59.809 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T22:59:59.809 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.inplace_update_support: 0 2024-09-13T22:59:59.809 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T22:59:59.809 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T22:59:59.809 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T22:59:59.809 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T22:59:59.809 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.bloom_locality: 0 2024-09-13T22:59:59.809 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.max_successive_merges: 0 2024-09-13T22:59:59.809 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T22:59:59.810 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T22:59:59.810 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T22:59:59.810 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T22:59:59.810 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.ttl: 2592000 2024-09-13T22:59:59.810 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T22:59:59.810 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T22:59:59.810 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T22:59:59.810 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.enable_blob_files: false 2024-09-13T22:59:59.810 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.min_blob_size: 0 2024-09-13T22:59:59.810 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T22:59:59.810 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T22:59:59.810 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T22:59:59.810 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T22:59:59.811 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T22:59:59.811 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T22:59:59.811 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T22:59:59.811 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T22:59:59.811 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T22:59:59.811 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi002/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12115, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-13T22:59:59.811 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-13T22:59:59.811 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8cbae438-a7e6-48c3-b229-6db650471b0b 2024-09-13T22:59:59.811 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726268399653682, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-13T22:59:59.811 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-13T22:59:59.811 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726268399665340, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 3110359, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12116, "largest_seqno": 15158, "table_properties": {"data_size": 3098723, "index_size": 7133, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3461, "raw_key_size": 30033, "raw_average_key_size": 21, "raw_value_size": 3072071, "raw_average_value_size": 2244, "num_data_blocks": 325, "num_entries": 1369, "num_filter_entries": 1369, "num_deletions": 259, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726268399, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8cbae438-a7e6-48c3-b229-6db650471b0b", "db_session_id": "ORRXOODGNA0VIB7V5N29", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-13T22:59:59.811 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726268399665469, "job": 1, "event": "recovery_finished"} 2024-09-13T22:59:59.811 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-13T22:59:59.812 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T22:59:59.812 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi002/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T22:59:59.812 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55976eb04e00 2024-09-13T22:59:59.812 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: DB pointer 0x55976ec00000 2024-09-13T22:59:59.812 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T22:59:59.812 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T22:59:59.812 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** DB Stats ** 2024-09-13T22:59:59.812 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:59:59.812 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T22:59:59.812 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:59:59.812 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:59:59.812 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T22:59:59.812 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T22:59:59.813 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T22:59:59.813 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-13T22:59:59.813 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-13T22:59:59.813 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:59:59.813 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T22:59:59.813 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: L0 1/0 2.97 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 537.2 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-09-13T22:59:59.813 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: L6 1/0 5.83 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T22:59:59.813 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Sum 2/0 8.80 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 537.2 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-09-13T22:59:59.813 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 537.2 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-09-13T22:59:59.813 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-13T22:59:59.813 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-13T22:59:59.813 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T22:59:59.814 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T22:59:59.814 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 537.2 0.01 0.00 1 0.006 0 0 0.0 0.0 2024-09-13T22:59:59.814 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-13T22:59:59.814 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T22:59:59.814 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-13T22:59:59.814 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T22:59:59.814 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-13T22:59:59.814 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T22:59:59.814 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T22:59:59.814 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T22:59:59.814 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T22:59:59.814 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative compaction: 0.00 GB write, 207.74 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:59:59.815 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval compaction: 0.00 GB write, 207.74 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T22:59:59.815 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T22:59:59.815 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Block cache BinnedLRUCache@0x55976ead71f0#2 capacity: 512.00 MB usage: 12.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-13T22:59:59.815 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,8.08 KB,0.00154078%) Misc(1,0.00 KB,0%) 2024-09-13T22:59:59.815 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-13T22:59:59.815 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T22:59:59.815 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: starting mon.smithi002 rank 0 at public addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] at bind addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi002 fsid e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T22:59:59.815 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: mon.smithi002@-1(???) e2 preinit fsid e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T22:59:59.815 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: mon.smithi002@-1(???).mds e16 new map 2024-09-13T22:59:59.815 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: mon.smithi002@-1(???).mds e16 print_map 2024-09-13T22:59:59.815 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: e16 2024-09-13T22:59:59.815 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-13T22:59:59.815 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T22:59:59.816 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:59:59.816 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: legacy client fscid: 1 2024-09-13T22:59:59.816 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-13T22:59:59.816 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Filesystem 'cephfs' (1) 2024-09-13T22:59:59.816 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: fs_name cephfs 2024-09-13T22:59:59.816 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: epoch 16 2024-09-13T22:59:59.816 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T22:59:59.816 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: created 2024-09-13T22:53:05.963265+0000 2024-09-13T22:59:59.816 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: modified 2024-09-13T22:53:25.072026+0000 2024-09-13T22:59:59.816 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: tableserver 0 2024-09-13T22:59:59.816 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: root 0 2024-09-13T22:59:59.816 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: session_timeout 60 2024-09-13T22:59:59.816 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: session_autoclose 300 2024-09-13T22:59:59.817 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: max_file_size 1099511627776 2024-09-13T22:59:59.817 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: max_xattr_size 65536 2024-09-13T22:59:59.817 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: required_client_features {} 2024-09-13T22:59:59.817 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: last_failure 0 2024-09-13T22:59:59.817 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: last_failure_osd_epoch 47 2024-09-13T22:59:59.817 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T22:59:59.817 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: max_mds 1 2024-09-13T22:59:59.817 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: in 0 2024-09-13T22:59:59.817 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: up {0=24267} 2024-09-13T22:59:59.817 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: failed 2024-09-13T22:59:59.817 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: damaged 2024-09-13T22:59:59.817 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: stopped 2024-09-13T22:59:59.817 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: data_pools [3] 2024-09-13T22:59:59.817 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: metadata_pool 2 2024-09-13T22:59:59.818 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: inline_data enabled 2024-09-13T22:59:59.818 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: balancer 2024-09-13T22:59:59.818 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: bal_rank_mask -1 2024-09-13T22:59:59.818 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: standby_count_wanted 1 2024-09-13T22:59:59.818 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: qdb_cluster leader: 0 members: 2024-09-13T22:59:59.818 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: [mds.cephfs.smithi047.gxzkha{0:24267} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:59:59.818 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: [mds.cephfs.smithi002.gglyyr{0:14488} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.2:6828/2123560657,v1:172.21.15.2:6829/2123560657] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:59:59.818 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-13T22:59:59.818 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-13T22:59:59.818 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Standby daemons: 2024-09-13T22:59:59.818 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-13T22:59:59.818 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: [mds.cephfs.smithi002.auedll{-1:14500} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/1577962179,v1:172.21.15.2:6827/1577962179] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:59:59.818 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: [mds.cephfs.smithi047.nqvveh{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T22:59:59.818 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: mon.smithi002@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T22:59:59.819 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: mon.smithi002@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T22:59:59.819 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: mon.smithi002@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T22:59:59.819 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: mon.smithi002@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T22:59:59.819 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 ceph-mon[111294]: mon.smithi002@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-13T22:59:59.819 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 bash[111275]: db0ef6c509cf7f9dadd69f2fd8123c47001fb40d3bed81b475f426dd5370da24 2024-09-13T22:59:59.819 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 22:59:59 smithi002 systemd[1]: Started Ceph mon.smithi002 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T23:00:03.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T23:00:03.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T23:00:03.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: pgmap v97: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:00:03.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: pgmap v98: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:00:03.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: mon.smithi002 calling monitor election 2024-09-13T23:00:03.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: mon.smithi002 is new leader, mons smithi002,smithi047 in quorum (ranks 0,1) 2024-09-13T23:00:03.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: monmap epoch 2 2024-09-13T23:00:03.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: fsid e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T23:00:03.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: last_changed 2024-09-13T22:48:44.161311+0000 2024-09-13T23:00:03.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: created 2024-09-13T22:46:07.590380+0000 2024-09-13T23:00:03.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: min_mon_release 18 (reef) 2024-09-13T23:00:03.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: election_strategy: 1 2024-09-13T23:00:03.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.smithi002 2024-09-13T23:00:03.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: 1: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.smithi047 2024-09-13T23:00:03.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T23:00:03.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T23:00:03.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: mgrmap e32: smithi002.yumtzz(active, since 3m), standbys: smithi047.gcymvd 2024-09-13T23:00:03.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T23:00:03.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T23:00:03.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T23:00:03.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: from='mgr.14658 ' entity='' 2024-09-13T23:00:03.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:02 smithi002 ceph-mon[111294]: mgrmap e33: smithi002.yumtzz(active, since 3m), standbys: smithi047.gcymvd 2024-09-13T23:00:03.070 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T23:00:03.071 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: from='mgr.14658 172.21.15.2:0/3243639955' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T23:00:03.071 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: pgmap v97: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:00:03.071 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: pgmap v98: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:00:03.071 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: mon.smithi002 calling monitor election 2024-09-13T23:00:03.071 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: mon.smithi002 is new leader, mons smithi002,smithi047 in quorum (ranks 0,1) 2024-09-13T23:00:03.071 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: monmap epoch 2 2024-09-13T23:00:03.071 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: fsid e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T23:00:03.071 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: last_changed 2024-09-13T22:48:44.161311+0000 2024-09-13T23:00:03.071 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: created 2024-09-13T22:46:07.590380+0000 2024-09-13T23:00:03.072 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: min_mon_release 18 (reef) 2024-09-13T23:00:03.072 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: election_strategy: 1 2024-09-13T23:00:03.072 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.smithi002 2024-09-13T23:00:03.072 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: 1: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.smithi047 2024-09-13T23:00:03.072 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T23:00:03.072 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T23:00:03.072 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: mgrmap e32: smithi002.yumtzz(active, since 3m), standbys: smithi047.gcymvd 2024-09-13T23:00:03.072 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T23:00:03.072 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T23:00:03.072 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T23:00:03.073 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: from='mgr.14658 ' entity='' 2024-09-13T23:00:03.073 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:02 smithi047 ceph-mon[34560]: mgrmap e33: smithi002.yumtzz(active, since 3m), standbys: smithi047.gcymvd 2024-09-13T23:00:08.041 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:07 smithi002 ceph-mon[111294]: Standby manager daemon smithi047.gcymvd restarted 2024-09-13T23:00:08.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:07 smithi002 ceph-mon[111294]: Standby manager daemon smithi047.gcymvd started 2024-09-13T23:00:08.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:07 smithi002 ceph-mon[111294]: from='mgr.? 172.21.15.47:0/3645270898' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/crt"}]: dispatch 2024-09-13T23:00:08.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:07 smithi002 ceph-mon[111294]: from='mgr.? 172.21.15.47:0/3645270898' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T23:00:08.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:07 smithi002 ceph-mon[111294]: from='mgr.? 172.21.15.47:0/3645270898' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/key"}]: dispatch 2024-09-13T23:00:08.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:07 smithi002 ceph-mon[111294]: from='mgr.? 172.21.15.47:0/3645270898' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T23:00:08.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:07 smithi047 ceph-mon[34560]: Standby manager daemon smithi047.gcymvd restarted 2024-09-13T23:00:08.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:07 smithi047 ceph-mon[34560]: Standby manager daemon smithi047.gcymvd started 2024-09-13T23:00:08.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:07 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/3645270898' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/crt"}]: dispatch 2024-09-13T23:00:08.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:07 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/3645270898' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T23:00:08.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:07 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/3645270898' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi047.gcymvd/key"}]: dispatch 2024-09-13T23:00:08.076 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:07 smithi047 ceph-mon[34560]: from='mgr.? 172.21.15.47:0/3645270898' entity='mgr.smithi047.gcymvd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T23:00:09.102 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: mgrmap e34: smithi002.yumtzz(active, since 3m), standbys: smithi047.gcymvd 2024-09-13T23:00:09.102 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: Active manager daemon smithi002.yumtzz restarted 2024-09-13T23:00:09.103 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: Activating manager daemon smithi002.yumtzz 2024-09-13T23:00:09.103 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: osdmap e50: 6 total, 6 up, 6 in 2024-09-13T23:00:09.103 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: mgrmap e35: smithi002.yumtzz(active, starting, since 0.00566599s), standbys: smithi047.gcymvd 2024-09-13T23:00:09.103 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T23:00:09.103 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T23:00:09.103 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.gglyyr"}]: dispatch 2024-09-13T23:00:09.103 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.auedll"}]: dispatch 2024-09-13T23:00:09.103 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.gxzkha"}]: dispatch 2024-09-13T23:00:09.103 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.nqvveh"}]: dispatch 2024-09-13T23:00:09.103 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr metadata", "who": "smithi002.yumtzz", "id": "smithi002.yumtzz"}]: dispatch 2024-09-13T23:00:09.103 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr metadata", "who": "smithi047.gcymvd", "id": "smithi047.gcymvd"}]: dispatch 2024-09-13T23:00:09.103 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:00:09.104 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:00:09.104 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:00:09.104 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:00:09.104 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:00:09.104 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:00:09.104 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T23:00:09.105 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T23:00:09.105 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T23:00:09.105 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: Manager daemon smithi002.yumtzz is now available 2024-09-13T23:00:09.105 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:00:09.105 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:00:09.105 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.yumtzz/mirror_snapshot_schedule"}]: dispatch 2024-09-13T23:00:09.106 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.yumtzz/trash_purge_schedule"}]: dispatch 2024-09-13T23:00:09.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: mgrmap e34: smithi002.yumtzz(active, since 3m), standbys: smithi047.gcymvd 2024-09-13T23:00:09.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: Active manager daemon smithi002.yumtzz restarted 2024-09-13T23:00:09.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: Activating manager daemon smithi002.yumtzz 2024-09-13T23:00:09.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: osdmap e50: 6 total, 6 up, 6 in 2024-09-13T23:00:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: mgrmap e35: smithi002.yumtzz(active, starting, since 0.00566599s), standbys: smithi047.gcymvd 2024-09-13T23:00:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T23:00:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T23:00:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.gglyyr"}]: dispatch 2024-09-13T23:00:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.auedll"}]: dispatch 2024-09-13T23:00:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.gxzkha"}]: dispatch 2024-09-13T23:00:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.nqvveh"}]: dispatch 2024-09-13T23:00:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr metadata", "who": "smithi002.yumtzz", "id": "smithi002.yumtzz"}]: dispatch 2024-09-13T23:00:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr metadata", "who": "smithi047.gcymvd", "id": "smithi047.gcymvd"}]: dispatch 2024-09-13T23:00:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:00:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:00:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:00:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:00:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:00:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:00:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T23:00:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T23:00:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T23:00:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: Manager daemon smithi002.yumtzz is now available 2024-09-13T23:00:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:00:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:00:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.yumtzz/mirror_snapshot_schedule"}]: dispatch 2024-09-13T23:00:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:08 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.yumtzz/trash_purge_schedule"}]: dispatch 2024-09-13T23:00:09.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:09 smithi002 ceph-mon[111294]: mgrmap e36: smithi002.yumtzz(active, since 1.00957s), standbys: smithi047.gcymvd 2024-09-13T23:00:10.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:09 smithi002 ceph-mon[111294]: pgmap v3: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:00:10.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:09 smithi047 ceph-mon[34560]: mgrmap e36: smithi002.yumtzz(active, since 1.00957s), standbys: smithi047.gcymvd 2024-09-13T23:00:10.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:09 smithi047 ceph-mon[34560]: pgmap v3: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:00:11.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:10 smithi047 ceph-mon[34560]: mgrmap e37: smithi002.yumtzz(active, since 2s), standbys: smithi047.gcymvd 2024-09-13T23:00:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:10 smithi047 ceph-mon[34560]: [13/Sep/2024:23:00:10] ENGINE Bus STARTING 2024-09-13T23:00:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:10 smithi047 ceph-mon[34560]: [13/Sep/2024:23:00:10] ENGINE Serving on https://172.21.15.2:7150 2024-09-13T23:00:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:10 smithi047 ceph-mon[34560]: [13/Sep/2024:23:00:10] ENGINE Error in HTTPServer.serve 2024-09-13T23:00:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Traceback (most recent call last): 2024-09-13T23:00:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T23:00:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: self._connections.run(self.expiration_interval) 2024-09-13T23:00:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T23:00:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: self._run(expiration_interval) 2024-09-13T23:00:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T23:00:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T23:00:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T23:00:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T23:00:11.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T23:00:11.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: s = self.context.wrap_socket( 2024-09-13T23:00:11.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T23:00:11.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: return self.sslsocket_class._create( 2024-09-13T23:00:11.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T23:00:11.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: self.do_handshake() 2024-09-13T23:00:11.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T23:00:11.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: self._sslobj.do_handshake() 2024-09-13T23:00:11.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T23:00:11.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:10 smithi047 ceph-mon[34560]: [13/Sep/2024:23:00:10] ENGINE Serving on http://172.21.15.2:8765 2024-09-13T23:00:11.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:10 smithi047 ceph-mon[34560]: [13/Sep/2024:23:00:10] ENGINE Bus STARTED 2024-09-13T23:00:11.171 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:10 smithi002 ceph-mon[111294]: mgrmap e37: smithi002.yumtzz(active, since 2s), standbys: smithi047.gcymvd 2024-09-13T23:00:11.171 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:10 smithi002 ceph-mon[111294]: [13/Sep/2024:23:00:10] ENGINE Bus STARTING 2024-09-13T23:00:11.171 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:10 smithi002 ceph-mon[111294]: [13/Sep/2024:23:00:10] ENGINE Serving on https://172.21.15.2:7150 2024-09-13T23:00:11.171 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:10 smithi002 ceph-mon[111294]: [13/Sep/2024:23:00:10] ENGINE Error in HTTPServer.serve 2024-09-13T23:00:11.171 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Traceback (most recent call last): 2024-09-13T23:00:11.171 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T23:00:11.171 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-13T23:00:11.172 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T23:00:11.172 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._run(expiration_interval) 2024-09-13T23:00:11.172 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T23:00:11.172 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T23:00:11.172 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T23:00:11.172 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T23:00:11.172 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T23:00:11.172 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: s = self.context.wrap_socket( 2024-09-13T23:00:11.172 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T23:00:11.172 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: return self.sslsocket_class._create( 2024-09-13T23:00:11.172 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T23:00:11.172 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self.do_handshake() 2024-09-13T23:00:11.173 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T23:00:11.173 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._sslobj.do_handshake() 2024-09-13T23:00:11.173 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T23:00:11.173 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:10 smithi002 ceph-mon[111294]: [13/Sep/2024:23:00:10] ENGINE Serving on http://172.21.15.2:8765 2024-09-13T23:00:11.173 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:10 smithi002 ceph-mon[111294]: [13/Sep/2024:23:00:10] ENGINE Bus STARTED 2024-09-13T23:00:12.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:12.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:12.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:12.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:12.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:12 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:12.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:12 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:12.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:12 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:12.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:12 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:14.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:13 smithi002 ceph-mon[111294]: pgmap v5: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:00:14.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:13 smithi002 ceph-mon[111294]: mgrmap e38: smithi002.yumtzz(active, since 4s), standbys: smithi047.gcymvd 2024-09-13T23:00:14.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:13 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:14.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:13 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:14.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:13 smithi047 ceph-mon[34560]: pgmap v5: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:00:14.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:13 smithi047 ceph-mon[34560]: mgrmap e38: smithi002.yumtzz(active, since 4s), standbys: smithi047.gcymvd 2024-09-13T23:00:14.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:13 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:14.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:13 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:15.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:14 smithi047 ceph-mon[34560]: pgmap v6: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:00:15.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:14 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:15.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:14 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:15.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:14 smithi002 ceph-mon[111294]: pgmap v6: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:00:15.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:14 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:15.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:14 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:16.978 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:16 smithi002 ceph-mon[111294]: pgmap v7: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-13T23:00:17.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:16 smithi047 ceph-mon[34560]: pgmap v7: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-13T23:00:18.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:18 smithi002 ceph-mon[111294]: Detected new or changed devices on smithi002 2024-09-13T23:00:18.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:18 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:18.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:18 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:18.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:18 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:18.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:18 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:00:18.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:18 smithi002 ceph-mon[111294]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-13T23:00:18.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:18 smithi002 ceph-mon[111294]: Updating smithi047:/etc/ceph/ceph.conf 2024-09-13T23:00:18.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:18 smithi002 ceph-mon[111294]: Updating smithi002:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T23:00:18.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:18 smithi002 ceph-mon[111294]: Updating smithi047:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T23:00:18.393 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:18 smithi002 ceph-mon[111294]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-13T23:00:18.393 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:18 smithi002 ceph-mon[111294]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-09-13T23:00:18.393 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:18 smithi002 ceph-mon[111294]: Updating smithi002:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T23:00:18.393 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:18 smithi002 ceph-mon[111294]: Updating smithi047:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T23:00:18.393 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:18 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:18.393 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:18 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:18.393 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:18 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:18.393 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:18 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:18.393 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:18 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:18.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:18 smithi047 ceph-mon[34560]: Detected new or changed devices on smithi002 2024-09-13T23:00:18.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:18 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:18.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:18 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:18.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:18 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:18.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:18 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:00:18.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:18 smithi047 ceph-mon[34560]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-13T23:00:18.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:18 smithi047 ceph-mon[34560]: Updating smithi047:/etc/ceph/ceph.conf 2024-09-13T23:00:18.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:18 smithi047 ceph-mon[34560]: Updating smithi002:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T23:00:18.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:18 smithi047 ceph-mon[34560]: Updating smithi047:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T23:00:18.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:18 smithi047 ceph-mon[34560]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-13T23:00:18.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:18 smithi047 ceph-mon[34560]: Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-09-13T23:00:18.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:18 smithi047 ceph-mon[34560]: Updating smithi002:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T23:00:18.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:18 smithi047 ceph-mon[34560]: Updating smithi047:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T23:00:18.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:18 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:18.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:18 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:18.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:18 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:18.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:18 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:18.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:18 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:19.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:19 smithi047 ceph-mon[34560]: pgmap v8: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-13T23:00:19.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:19 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:00:19.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:19 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:00:19.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:19 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T23:00:19.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:19 smithi002 ceph-mon[111294]: pgmap v8: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-13T23:00:19.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:19 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:00:19.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:19 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:00:19.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:19 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T23:00:21.109 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:20 smithi047 ceph-mon[34560]: pgmap v9: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T23:00:21.109 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:20 smithi047 ceph-mon[34560]: Upgrade: Updating mon.smithi047 2024-09-13T23:00:21.109 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:20 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:21.109 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:20 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T23:00:21.109 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:20 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T23:00:21.109 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:20 smithi047 ceph-mon[34560]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:21.109 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:20 smithi047 ceph-mon[34560]: Deploying daemon mon.smithi047 on smithi047 2024-09-13T23:00:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:20 smithi002 ceph-mon[111294]: pgmap v9: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T23:00:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:20 smithi002 ceph-mon[111294]: Upgrade: Updating mon.smithi047 2024-09-13T23:00:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:20 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:20 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T23:00:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:20 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T23:00:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:20 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:20 smithi002 ceph-mon[111294]: Deploying daemon mon.smithi047 on smithi047 2024-09-13T23:00:21.711 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:21 smithi047 systemd[1]: Stopping Ceph mon.smithi047 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:00:21.712 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:21 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi047[34555]: 2024-09-13T23:00:21.679+0000 7f139b9a9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi047 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:00:21.712 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:21 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi047[34555]: 2024-09-13T23:00:21.679+0000 7f139b9a9700 -1 mon.smithi047@1(peon) e2 *** Got Signal Terminated *** 2024-09-13T23:00:21.972 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:21 smithi047 podman[81085]: 2024-09-13 23:00:21.711475998 +0000 UTC m=+0.128687195 container died 5642284a23bf6826eb1b272c2f77c29bd6edd65dccedc58f05f10fbfb423bb36 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi047, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.1, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20240222, ceph=True, io.buildah.version=1.29.1, org.label-schema.license=GPLv2) 2024-09-13T23:00:22.332 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:22 smithi047 podman[81085]: 2024-09-13 23:00:22.071113556 +0000 UTC m=+0.488324762 container cleanup 5642284a23bf6826eb1b272c2f77c29bd6edd65dccedc58f05f10fbfb423bb36 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi047, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, GIT_CLEAN=True, ceph=True, RELEASE=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-09-13T23:00:22.332 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:22 smithi047 bash[81085]: ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi047 2024-09-13T23:00:22.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:22 smithi047 podman[81097]: 2024-09-13 23:00:22.33088446 +0000 UTC m=+0.622971927 container remove 5642284a23bf6826eb1b272c2f77c29bd6edd65dccedc58f05f10fbfb423bb36 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi047, ceph=True, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.1, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=HEAD, org.label-schema.schema-version=1.0) 2024-09-13T23:00:22.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:22 smithi047 systemd[1]: ceph-e41042f8-7221-11ef-bceb-c7b262605968@mon.smithi047.service: Deactivated successfully. 2024-09-13T23:00:22.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:22 smithi047 systemd[1]: Stopped Ceph mon.smithi047 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T23:00:22.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:22 smithi047 systemd[1]: ceph-e41042f8-7221-11ef-bceb-c7b262605968@mon.smithi047.service: Consumed 8.249s CPU time. 2024-09-13T23:00:23.038 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:22 smithi047 systemd[1]: Starting Ceph mon.smithi047 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:00:23.039 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:22 smithi047 podman[81224]: 2024-09-13 23:00:22.827014659 +0000 UTC m=+0.016734038 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:00:23.039 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:22 smithi047 podman[81224]: 2024-09-13 23:00:22.931698947 +0000 UTC m=+0.121418360 container create ea0c2a2e0e1af966b91baa287bfa5a8e50c6525b48626dcdb5d6c71c98031ea4 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi047, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-13T23:00:23.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 podman[81224]: 2024-09-13 23:00:23.160646476 +0000 UTC m=+0.350365841 container init ea0c2a2e0e1af966b91baa287bfa5a8e50c6525b48626dcdb5d6c71c98031ea4 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi047, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:00:23.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 podman[81224]: 2024-09-13 23:00:23.164308937 +0000 UTC m=+0.354028310 container start ea0c2a2e0e1af966b91baa287bfa5a8e50c6525b48626dcdb5d6c71c98031ea4 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi047, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-13T23:00:23.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T23:00:23.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable), process ceph-mon, pid 2 2024-09-13T23:00:23.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: pidfile_write: ignore empty --pid-file 2024-09-13T23:00:23.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: load: jerasure load: lrc 2024-09-13T23:00:23.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: RocksDB version: 7.9.2 2024-09-13T23:00:23.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Git sha 0 2024-09-13T23:00:23.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Compile date 2024-09-13 16:59:10 2024-09-13T23:00:23.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: DB SUMMARY 2024-09-13T23:00:23.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: DB Session ID: X8621R5JMLZQMP6L2UI4 2024-09-13T23:00:23.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: CURRENT file: CURRENT 2024-09-13T23:00:23.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T23:00:23.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1403 Bytes 2024-09-13T23:00:23.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi047/store.db dir, Total Num: 1, files: 000027.sst 2024-09-13T23:00:23.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi047/store.db: 000025.log size: 8307373 ; 2024-09-13T23:00:23.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.error_if_exists: 0 2024-09-13T23:00:23.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.create_if_missing: 0 2024-09-13T23:00:23.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.paranoid_checks: 1 2024-09-13T23:00:23.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T23:00:23.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T23:00:23.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T23:00:23.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.env: 0x56438ff92940 2024-09-13T23:00:23.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T23:00:23.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.info_log: 0x564391afd8c0 2024-09-13T23:00:23.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T23:00:23.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.statistics: (nil) 2024-09-13T23:00:23.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.use_fsync: 0 2024-09-13T23:00:23.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_log_file_size: 0 2024-09-13T23:00:23.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T23:00:23.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T23:00:23.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T23:00:23.416 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T23:00:23.416 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.allow_fallocate: 1 2024-09-13T23:00:23.416 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T23:00:23.416 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T23:00:23.416 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.use_direct_reads: 0 2024-09-13T23:00:23.416 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T23:00:23.416 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T23:00:23.416 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.db_log_dir: 2024-09-13T23:00:23.416 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.wal_dir: 2024-09-13T23:00:23.416 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T23:00:23.416 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T23:00:23.416 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T23:00:23.416 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T23:00:23.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T23:00:23.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T23:00:23.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T23:00:23.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T23:00:23.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.write_buffer_manager: 0x564391b0cdc0 2024-09-13T23:00:23.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T23:00:23.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T23:00:23.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T23:00:23.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T23:00:23.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T23:00:23.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T23:00:23.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T23:00:23.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T23:00:23.417 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.unordered_write: 0 2024-09-13T23:00:23.418 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T23:00:23.418 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T23:00:23.418 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T23:00:23.418 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T23:00:23.418 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.row_cache: None 2024-09-13T23:00:23.418 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.wal_filter: None 2024-09-13T23:00:23.419 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T23:00:23.419 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T23:00:23.419 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.two_write_queues: 0 2024-09-13T23:00:23.419 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T23:00:23.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.wal_compression: 0 2024-09-13T23:00:23.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.atomic_flush: 0 2024-09-13T23:00:23.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T23:00:23.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T23:00:23.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T23:00:23.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.log_readahead_size: 0 2024-09-13T23:00:23.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T23:00:23.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T23:00:23.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T23:00:23.420 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T23:00:23.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T23:00:23.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T23:00:23.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T23:00:23.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_background_jobs: 2 2024-09-13T23:00:23.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_background_compactions: -1 2024-09-13T23:00:23.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_subcompactions: 1 2024-09-13T23:00:23.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T23:00:23.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T23:00:23.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T23:00:23.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T23:00:23.421 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T23:00:23.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T23:00:23.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T23:00:23.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T23:00:23.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_open_files: -1 2024-09-13T23:00:23.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T23:00:23.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T23:00:23.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T23:00:23.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T23:00:23.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_background_flushes: -1 2024-09-13T23:00:23.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Compression algorithms supported: 2024-09-13T23:00:23.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: kZSTD supported: 0 2024-09-13T23:00:23.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: kXpressCompression supported: 0 2024-09-13T23:00:23.422 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: kBZip2Compression supported: 0 2024-09-13T23:00:23.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T23:00:23.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: kLZ4Compression supported: 1 2024-09-13T23:00:23.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: kZlibCompression supported: 1 2024-09-13T23:00:23.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T23:00:23.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: kSnappyCompression supported: 1 2024-09-13T23:00:23.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T23:00:23.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T23:00:23.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi047/store.db/MANIFEST-000010 2024-09-13T23:00:23.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T23:00:23.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T23:00:23.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.merge_operator: 2024-09-13T23:00:23.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compaction_filter: None 2024-09-13T23:00:23.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T23:00:23.423 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T23:00:23.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T23:00:23.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T23:00:23.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564391afd520) 2024-09-13T23:00:23.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: cache_index_and_filter_blocks: 1 2024-09-13T23:00:23.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T23:00:23.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T23:00:23.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: pin_top_level_index_and_filter: 1 2024-09-13T23:00:23.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: index_type: 0 2024-09-13T23:00:23.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: data_block_index_type: 0 2024-09-13T23:00:23.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: index_shortening: 1 2024-09-13T23:00:23.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T23:00:23.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: checksum: 4 2024-09-13T23:00:23.424 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: no_block_cache: 0 2024-09-13T23:00:23.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_cache: 0x564391af11f0 2024-09-13T23:00:23.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_cache_name: BinnedLRUCache 2024-09-13T23:00:23.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_cache_options: 2024-09-13T23:00:23.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: capacity : 536870912 2024-09-13T23:00:23.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: num_shard_bits : 4 2024-09-13T23:00:23.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: strict_capacity_limit : 0 2024-09-13T23:00:23.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: high_pri_pool_ratio: 0.000 2024-09-13T23:00:23.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_cache_compressed: (nil) 2024-09-13T23:00:23.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: persistent_cache: (nil) 2024-09-13T23:00:23.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_size: 4096 2024-09-13T23:00:23.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_size_deviation: 10 2024-09-13T23:00:23.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_restart_interval: 16 2024-09-13T23:00:23.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: index_block_restart_interval: 1 2024-09-13T23:00:23.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: metadata_block_size: 4096 2024-09-13T23:00:23.425 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: partition_filters: 0 2024-09-13T23:00:23.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: use_delta_encoding: 1 2024-09-13T23:00:23.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: filter_policy: bloomfilter 2024-09-13T23:00:23.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: whole_key_filtering: 1 2024-09-13T23:00:23.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: verify_compression: 0 2024-09-13T23:00:23.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: read_amp_bytes_per_bit: 0 2024-09-13T23:00:23.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: format_version: 5 2024-09-13T23:00:23.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: enable_index_compression: 1 2024-09-13T23:00:23.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: block_align: 0 2024-09-13T23:00:23.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: max_auto_readahead_size: 262144 2024-09-13T23:00:23.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: prepopulate_block_cache: 0 2024-09-13T23:00:23.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: initial_auto_readahead_size: 8192 2024-09-13T23:00:23.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T23:00:23.426 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T23:00:23.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T23:00:23.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compression: NoCompression 2024-09-13T23:00:23.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T23:00:23.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T23:00:23.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T23:00:23.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.num_levels: 7 2024-09-13T23:00:23.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T23:00:23.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T23:00:23.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T23:00:23.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T23:00:23.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T23:00:23.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T23:00:23.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T23:00:23.427 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T23:00:23.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T23:00:23.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T23:00:23.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T23:00:23.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T23:00:23.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T23:00:23.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T23:00:23.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T23:00:23.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T23:00:23.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T23:00:23.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T23:00:23.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T23:00:23.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T23:00:23.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T23:00:23.428 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T23:00:23.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T23:00:23.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T23:00:23.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T23:00:23.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T23:00:23.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T23:00:23.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T23:00:23.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T23:00:23.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T23:00:23.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T23:00:23.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T23:00:23.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T23:00:23.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T23:00:23.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T23:00:23.429 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T23:00:23.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T23:00:23.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T23:00:23.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T23:00:23.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T23:00:23.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T23:00:23.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T23:00:23.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T23:00:23.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T23:00:23.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T23:00:23.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T23:00:23.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T23:00:23.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T23:00:23.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T23:00:23.430 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T23:00:23.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T23:00:23.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T23:00:23.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T23:00:23.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T23:00:23.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.inplace_update_support: 0 2024-09-13T23:00:23.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T23:00:23.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T23:00:23.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T23:00:23.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T23:00:23.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.bloom_locality: 0 2024-09-13T23:00:23.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.max_successive_merges: 0 2024-09-13T23:00:23.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T23:00:23.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T23:00:23.431 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T23:00:23.432 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T23:00:23.432 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.ttl: 2592000 2024-09-13T23:00:23.432 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T23:00:23.432 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T23:00:23.432 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T23:00:23.432 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.enable_blob_files: false 2024-09-13T23:00:23.432 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.min_blob_size: 0 2024-09-13T23:00:23.432 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T23:00:23.432 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T23:00:23.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T23:00:23.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T23:00:23.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T23:00:23.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T23:00:23.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T23:00:23.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T23:00:23.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T23:00:23.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi047/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12197, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-13T23:00:23.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-13T23:00:23.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fc653135-93c2-4f85-b24e-bf9b42994ae0 2024-09-13T23:00:23.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726268423191698, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-13T23:00:23.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-13T23:00:23.433 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726268423211262, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 4941166, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12203, "largest_seqno": 16041, "table_properties": {"data_size": 4927566, "index_size": 8585, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3973, "raw_key_size": 34874, "raw_average_key_size": 22, "raw_value_size": 4896607, "raw_average_value_size": 3110, "num_data_blocks": 388, "num_entries": 1574, "num_filter_entries": 1574, "num_deletions": 259, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726268423, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fc653135-93c2-4f85-b24e-bf9b42994ae0", "db_session_id": "X8621R5JMLZQMP6L2UI4", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-13T23:00:23.434 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726268423211390, "job": 1, "event": "recovery_finished"} 2024-09-13T23:00:23.434 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-13T23:00:23.434 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T23:00:23.434 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi047/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T23:00:23.434 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564391b1ee00 2024-09-13T23:00:23.434 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: DB pointer 0x564391c1a000 2024-09-13T23:00:23.434 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T23:00:23.434 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T23:00:23.434 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ** DB Stats ** 2024-09-13T23:00:23.434 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T23:00:23.435 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T23:00:23.435 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T23:00:23.435 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T23:00:23.435 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T23:00:23.435 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T23:00:23.435 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T23:00:23.435 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-09-13T23:00:23.435 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ** Compaction Stats [default] ** 2024-09-13T23:00:23.435 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T23:00:23.435 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T23:00:23.435 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: L0 1/0 4.71 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 648.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T23:00:23.435 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: L6 1/0 5.83 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T23:00:23.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Sum 2/0 10.55 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 648.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T23:00:23.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 648.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T23:00:23.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-09-13T23:00:23.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ** Compaction Stats [default] ** 2024-09-13T23:00:23.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T23:00:23.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T23:00:23.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 648.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T23:00:23.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-09-13T23:00:23.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T23:00:23.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-09-13T23:00:23.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T23:00:23.436 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Flush(GB): cumulative 0.005, interval 0.005 2024-09-13T23:00:23.437 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T23:00:23.437 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T23:00:23.437 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T23:00:23.437 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T23:00:23.437 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Cumulative compaction: 0.00 GB write, 210.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T23:00:23.437 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Interval compaction: 0.00 GB write, 210.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T23:00:23.437 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T23:00:23.437 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Block cache BinnedLRUCache@0x564391af11f0#2 capacity: 512.00 MB usage: 13.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-13T23:00:23.437 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,9.08 KB,0.00173151%) Misc(1,0.00 KB,0%) 2024-09-13T23:00:23.437 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-09-13T23:00:23.437 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T23:00:23.437 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: starting mon.smithi047 rank 1 at public addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] at bind addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi047 fsid e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T23:00:23.437 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: mon.smithi047@-1(???) e2 preinit fsid e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T23:00:23.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: mon.smithi047@-1(???).mds e16 new map 2024-09-13T23:00:23.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: mon.smithi047@-1(???).mds e16 print_map 2024-09-13T23:00:23.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: e16 2024-09-13T23:00:23.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-13T23:00:23.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:00:23.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:00:23.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: legacy client fscid: 1 2024-09-13T23:00:23.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-09-13T23:00:23.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Filesystem 'cephfs' (1) 2024-09-13T23:00:23.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: fs_name cephfs 2024-09-13T23:00:23.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: epoch 16 2024-09-13T23:00:23.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:00:23.438 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: created 2024-09-13T22:53:05.963265+0000 2024-09-13T23:00:23.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: modified 2024-09-13T22:53:25.072026+0000 2024-09-13T23:00:23.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: tableserver 0 2024-09-13T23:00:23.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: root 0 2024-09-13T23:00:23.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: session_timeout 60 2024-09-13T23:00:23.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: session_autoclose 300 2024-09-13T23:00:23.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: max_file_size 1099511627776 2024-09-13T23:00:23.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: max_xattr_size 65536 2024-09-13T23:00:23.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: required_client_features {} 2024-09-13T23:00:23.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: last_failure 0 2024-09-13T23:00:23.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: last_failure_osd_epoch 47 2024-09-13T23:00:23.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:00:23.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: max_mds 1 2024-09-13T23:00:23.439 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: in 0 2024-09-13T23:00:23.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: up {0=24267} 2024-09-13T23:00:23.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: failed 2024-09-13T23:00:23.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: damaged 2024-09-13T23:00:23.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: stopped 2024-09-13T23:00:23.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: data_pools [3] 2024-09-13T23:00:23.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: metadata_pool 2 2024-09-13T23:00:23.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: inline_data enabled 2024-09-13T23:00:23.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: balancer 2024-09-13T23:00:23.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: bal_rank_mask -1 2024-09-13T23:00:23.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: standby_count_wanted 1 2024-09-13T23:00:23.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: qdb_cluster leader: 0 members: 2024-09-13T23:00:23.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: [mds.cephfs.smithi047.gxzkha{0:24267} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:00:23.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: [mds.cephfs.smithi002.gglyyr{0:14488} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.2:6828/2123560657,v1:172.21.15.2:6829/2123560657] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:00:23.440 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-09-13T23:00:23.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-09-13T23:00:23.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: Standby daemons: 2024-09-13T23:00:23.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: 2024-09-13T23:00:23.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: [mds.cephfs.smithi002.auedll{-1:14500} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/1577962179,v1:172.21.15.2:6827/1577962179] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:00:23.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout: [mds.cephfs.smithi047.nqvveh{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:00:23.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: mon.smithi047@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T23:00:23.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: mon.smithi047@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T23:00:23.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: mon.smithi047@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T23:00:23.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: mon.smithi047@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T23:00:23.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 ceph-mon[81243]: mon.smithi047@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-13T23:00:23.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 bash[81224]: ea0c2a2e0e1af966b91baa287bfa5a8e50c6525b48626dcdb5d6c71c98031ea4 2024-09-13T23:00:23.441 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:23 smithi047 systemd[1]: Started Ceph mon.smithi047 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T23:00:25.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: pgmap v11: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-13T23:00:25.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: 1: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.smithi047 2024-09-13T23:00:25.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T23:00:25.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: osdmap e50: 6 total, 6 up, 6 in 2024-09-13T23:00:25.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: mgrmap e38: smithi002.yumtzz(active, since 16s), standbys: smithi047.gcymvd 2024-09-13T23:00:25.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T23:00:25.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T23:00:25.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T23:00:25.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: mon.smithi047 calling monitor election 2024-09-13T23:00:25.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: mon.smithi002 calling monitor election 2024-09-13T23:00:25.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T23:00:25.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: mon.smithi002 is new leader, mons smithi002,smithi047 in quorum (ranks 0,1) 2024-09-13T23:00:25.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T23:00:25.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: monmap epoch 3 2024-09-13T23:00:25.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: fsid e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T23:00:25.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: last_changed 2024-09-13T23:00:24.699441+0000 2024-09-13T23:00:25.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: created 2024-09-13T22:46:07.590380+0000 2024-09-13T23:00:25.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: min_mon_release 19 (squid) 2024-09-13T23:00:25.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: election_strategy: 1 2024-09-13T23:00:25.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.smithi002 2024-09-13T23:00:25.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: 1: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.smithi047 2024-09-13T23:00:25.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T23:00:25.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: osdmap e50: 6 total, 6 up, 6 in 2024-09-13T23:00:25.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: mgrmap e38: smithi002.yumtzz(active, since 16s), standbys: smithi047.gcymvd 2024-09-13T23:00:25.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T23:00:25.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T23:00:25.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T23:00:25.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:25.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:25.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:25 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:00:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: pgmap v11: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-13T23:00:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: 1: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.smithi047 2024-09-13T23:00:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T23:00:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: osdmap e50: 6 total, 6 up, 6 in 2024-09-13T23:00:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: mgrmap e38: smithi002.yumtzz(active, since 16s), standbys: smithi047.gcymvd 2024-09-13T23:00:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T23:00:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T23:00:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T23:00:26.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: mon.smithi047 calling monitor election 2024-09-13T23:00:26.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: mon.smithi002 calling monitor election 2024-09-13T23:00:26.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-13T23:00:26.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: mon.smithi002 is new leader, mons smithi002,smithi047 in quorum (ranks 0,1) 2024-09-13T23:00:26.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mon metadata", "id": "smithi047"}]: dispatch 2024-09-13T23:00:26.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: monmap epoch 3 2024-09-13T23:00:26.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: fsid e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T23:00:26.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: last_changed 2024-09-13T23:00:24.699441+0000 2024-09-13T23:00:26.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: created 2024-09-13T22:46:07.590380+0000 2024-09-13T23:00:26.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: min_mon_release 19 (squid) 2024-09-13T23:00:26.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: election_strategy: 1 2024-09-13T23:00:26.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.smithi002 2024-09-13T23:00:26.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: 1: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.smithi047 2024-09-13T23:00:26.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T23:00:26.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: osdmap e50: 6 total, 6 up, 6 in 2024-09-13T23:00:26.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: mgrmap e38: smithi002.yumtzz(active, since 16s), standbys: smithi047.gcymvd 2024-09-13T23:00:26.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T23:00:26.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T23:00:26.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T23:00:26.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:26.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:26.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:25 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:00:27.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.627+0000 7f309488c700 1 -- 172.21.15.2:0/1858235680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30900ffc20 msgr2=0x7f3090100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:27.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.627+0000 7f309488c700 1 --2- 172.21.15.2:0/1858235680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30900ffc20 0x7f3090100080 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3084009910 tx=0x7f3084009c20 comp rx=0 tx=0).stop 2024-09-13T23:00:27.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.627+0000 7f309488c700 1 -- 172.21.15.2:0/1858235680 shutdown_connections 2024-09-13T23:00:27.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.627+0000 7f309488c700 1 --2- 172.21.15.2:0/1858235680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30900ffc20 0x7f3090100080 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:27.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.627+0000 7f309488c700 1 --2- 172.21.15.2:0/1858235680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090105bd0 0x7f3090105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:27.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.627+0000 7f309488c700 1 -- 172.21.15.2:0/1858235680 >> 172.21.15.2:0/1858235680 conn(0x7f3090075670 msgr2=0x7f3090075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:00:27.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.627+0000 7f309488c700 1 -- 172.21.15.2:0/1858235680 shutdown_connections 2024-09-13T23:00:27.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.627+0000 7f309488c700 1 -- 172.21.15.2:0/1858235680 wait complete. 2024-09-13T23:00:27.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.628+0000 7f309488c700 1 Processor -- start 2024-09-13T23:00:27.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.628+0000 7f309488c700 1 -- start start 2024-09-13T23:00:27.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.628+0000 7f309488c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30900ffc20 0x7f3090101840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:27.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.628+0000 7f309488c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090105bd0 0x7f3090101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:27.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.628+0000 7f309488c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30901022c0 con 0x7f30900ffc20 2024-09-13T23:00:27.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.628+0000 7f309488c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3090102400 con 0x7f3090105bd0 2024-09-13T23:00:27.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.628+0000 7f308e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30900ffc20 0x7f3090101840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:27.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.628+0000 7f308e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30900ffc20 0x7f3090101840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42580/0 (socket says 172.21.15.2:42580) 2024-09-13T23:00:27.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.628+0000 7f308e59c700 1 -- 172.21.15.2:0/2982958128 learned_addr learned my addr 172.21.15.2:0/2982958128 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:00:27.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.628+0000 7f308dd9b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090105bd0 0x7f3090101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:27.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.629+0000 7f308dd9b700 1 -- 172.21.15.2:0/2982958128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090105bd0 msgr2=0x7f3090101d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T23:00:27.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.629+0000 7f308dd9b700 1 -- 172.21.15.2:0/2982958128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090105bd0 msgr2=0x7f3090101d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T23:00:27.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.629+0000 7f308dd9b700 1 --2- 172.21.15.2:0/2982958128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090105bd0 0x7f3090101d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T23:00:27.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.629+0000 7f308dd9b700 1 --2- 172.21.15.2:0/2982958128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090105bd0 0x7f3090101d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T23:00:27.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.629+0000 7f308e59c700 1 -- 172.21.15.2:0/2982958128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090105bd0 msgr2=0x7f3090101d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T23:00:27.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.629+0000 7f308e59c700 1 --2- 172.21.15.2:0/2982958128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090105bd0 0x7f3090101d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:27.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.629+0000 7f308e59c700 1 -- 172.21.15.2:0/2982958128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30840095f0 con 0x7f30900ffc20 2024-09-13T23:00:27.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.629+0000 7f308e59c700 1 --2- 172.21.15.2:0/2982958128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30900ffc20 0x7f3090101840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f308000d8d0 tx=0x7f308000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:00:27.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.629+0000 7f307f7fe700 1 -- 172.21.15.2:0/2982958128 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3080004a00 con 0x7f30900ffc20 2024-09-13T23:00:27.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.629+0000 7f307f7fe700 1 -- 172.21.15.2:0/2982958128 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f30800054e0 con 0x7f30900ffc20 2024-09-13T23:00:27.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.629+0000 7f309488c700 1 -- 172.21.15.2:0/2982958128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30901a2a40 con 0x7f30900ffc20 2024-09-13T23:00:27.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.629+0000 7f307f7fe700 1 -- 172.21.15.2:0/2982958128 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3080009d60 con 0x7f30900ffc20 2024-09-13T23:00:27.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.629+0000 7f309488c700 1 -- 172.21.15.2:0/2982958128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30901a2e50 con 0x7f30900ffc20 2024-09-13T23:00:27.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.630+0000 7f309488c700 1 -- 172.21.15.2:0/2982958128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309004f2e0 con 0x7f30900ffc20 2024-09-13T23:00:27.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.631+0000 7f307f7fe700 1 -- 172.21.15.2:0/2982958128 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f3080005020 con 0x7f30900ffc20 2024-09-13T23:00:27.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.631+0000 7f307f7fe700 1 --2- 172.21.15.2:0/2982958128 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f307806e7c0 0x7f3078070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:27.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.632+0000 7f307f7fe700 1 -- 172.21.15.2:0/2982958128 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f308008e420 con 0x7f30900ffc20 2024-09-13T23:00:27.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.632+0000 7f308dd9b700 1 --2- 172.21.15.2:0/2982958128 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f307806e7c0 0x7f3078070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:27.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.632+0000 7f308dd9b700 1 --2- 172.21.15.2:0/2982958128 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f307806e7c0 0x7f3078070c80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3084005b40 tx=0x7f308401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:00:27.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.636+0000 7f307f7fe700 1 -- 172.21.15.2:0/2982958128 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3080057430 con 0x7f30900ffc20 2024-09-13T23:00:27.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.869+0000 7f309488c700 1 -- 172.21.15.2:0/2982958128 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3090068db0 con 0x7f307806e7c0 2024-09-13T23:00:27.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.870+0000 7f307f7fe700 1 -- 172.21.15.2:0/2982958128 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f3090068db0 con 0x7f307806e7c0 2024-09-13T23:00:27.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.872+0000 7f309488c700 1 -- 172.21.15.2:0/2982958128 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f307806e7c0 msgr2=0x7f3078070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:27.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.872+0000 7f309488c700 1 --2- 172.21.15.2:0/2982958128 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f307806e7c0 0x7f3078070c80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3084005b40 tx=0x7f308401a040 comp rx=0 tx=0).stop 2024-09-13T23:00:27.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.872+0000 7f309488c700 1 -- 172.21.15.2:0/2982958128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30900ffc20 msgr2=0x7f3090101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:27.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.872+0000 7f309488c700 1 --2- 172.21.15.2:0/2982958128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30900ffc20 0x7f3090101840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f308000d8d0 tx=0x7f308000dc90 comp rx=0 tx=0).stop 2024-09-13T23:00:27.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.872+0000 7f309488c700 1 -- 172.21.15.2:0/2982958128 shutdown_connections 2024-09-13T23:00:27.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.872+0000 7f309488c700 1 --2- 172.21.15.2:0/2982958128 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f307806e7c0 0x7f3078070c80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:27.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.872+0000 7f309488c700 1 --2- 172.21.15.2:0/2982958128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30900ffc20 0x7f3090101840 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:27.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.872+0000 7f309488c700 1 --2- 172.21.15.2:0/2982958128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3090105bd0 0x7f3090101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:27.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.872+0000 7f309488c700 1 -- 172.21.15.2:0/2982958128 >> 172.21.15.2:0/2982958128 conn(0x7f3090075670 msgr2=0x7f30900686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:00:27.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.872+0000 7f309488c700 1 -- 172.21.15.2:0/2982958128 shutdown_connections 2024-09-13T23:00:27.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.872+0000 7f309488c700 1 -- 172.21.15.2:0/2982958128 wait complete. 2024-09-13T23:00:27.884 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T23:00:27.884 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:27 smithi002 ceph-mon[111294]: pgmap v12: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T23:00:27.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.981+0000 7ff9d58e8700 1 -- 172.21.15.2:0/3620527655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d0101850 msgr2=0x7ff9d01058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:27.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.981+0000 7ff9d58e8700 1 --2- 172.21.15.2:0/3620527655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d0101850 0x7ff9d01058a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009910 tx=0x7ff9b8009c20 comp rx=0 tx=0).stop 2024-09-13T23:00:27.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.981+0000 7ff9d58e8700 1 -- 172.21.15.2:0/3620527655 shutdown_connections 2024-09-13T23:00:27.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.981+0000 7ff9d58e8700 1 --2- 172.21.15.2:0/3620527655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d0101850 0x7ff9d01058a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:27.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.981+0000 7ff9d58e8700 1 --2- 172.21.15.2:0/3620527655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9d0100ea0 0x7ff9d0101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:27.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.981+0000 7ff9d58e8700 1 -- 172.21.15.2:0/3620527655 >> 172.21.15.2:0/3620527655 conn(0x7ff9d00fc750 msgr2=0x7ff9d00feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:00:27.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.981+0000 7ff9d58e8700 1 -- 172.21.15.2:0/3620527655 shutdown_connections 2024-09-13T23:00:27.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.981+0000 7ff9d58e8700 1 -- 172.21.15.2:0/3620527655 wait complete. 2024-09-13T23:00:27.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.982+0000 7ff9d58e8700 1 Processor -- start 2024-09-13T23:00:27.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.982+0000 7ff9d58e8700 1 -- start start 2024-09-13T23:00:27.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.982+0000 7ff9d58e8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9d0100ea0 0x7ff9d019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:27.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.982+0000 7ff9d58e8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d0101850 0x7ff9d019cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.982+0000 7ff9d58e8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d019d200 con 0x7ff9d0101850 2024-09-13T23:00:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.982+0000 7ff9d58e8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d01966b0 con 0x7ff9d0100ea0 2024-09-13T23:00:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.982+0000 7ff9ce7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d0101850 0x7ff9d019cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.982+0000 7ff9ce7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d0101850 0x7ff9d019cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42608/0 (socket says 172.21.15.2:42608) 2024-09-13T23:00:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.982+0000 7ff9ce7fc700 1 -- 172.21.15.2:0/488467772 learned_addr learned my addr 172.21.15.2:0/488467772 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:00:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.982+0000 7ff9ceffd700 1 --2- 172.21.15.2:0/488467772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9d0100ea0 0x7ff9d019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.983+0000 7ff9ceffd700 1 -- 172.21.15.2:0/488467772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9d0100ea0 msgr2=0x7ff9d019c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-13T23:00:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.983+0000 7ff9ceffd700 1 -- 172.21.15.2:0/488467772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9d0100ea0 msgr2=0x7ff9d019c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T23:00:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.983+0000 7ff9ceffd700 1 --2- 172.21.15.2:0/488467772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9d0100ea0 0x7ff9d019c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T23:00:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.983+0000 7ff9ceffd700 1 --2- 172.21.15.2:0/488467772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9d0100ea0 0x7ff9d019c630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T23:00:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.983+0000 7ff9ce7fc700 1 -- 172.21.15.2:0/488467772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9d0100ea0 msgr2=0x7ff9d019c630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T23:00:27.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.983+0000 7ff9ce7fc700 1 --2- 172.21.15.2:0/488467772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9d0100ea0 0x7ff9d019c630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.983+0000 7ff9ce7fc700 1 -- 172.21.15.2:0/488467772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b80095f0 con 0x7ff9d0101850 2024-09-13T23:00:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.983+0000 7ff9ce7fc700 1 --2- 172.21.15.2:0/488467772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d0101850 0x7ff9d019cb70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80092e0 tx=0x7ff9b800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:00:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.983+0000 7ff9d48e6700 1 -- 172.21.15.2:0/488467772 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9b801d070 con 0x7ff9d0101850 2024-09-13T23:00:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.983+0000 7ff9d48e6700 1 -- 172.21.15.2:0/488467772 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff9b8005dc0 con 0x7ff9d0101850 2024-09-13T23:00:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.983+0000 7ff9d58e8700 1 -- 172.21.15.2:0/488467772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d0196930 con 0x7ff9d0101850 2024-09-13T23:00:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.983+0000 7ff9d48e6700 1 -- 172.21.15.2:0/488467772 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9b8017400 con 0x7ff9d0101850 2024-09-13T23:00:27.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.983+0000 7ff9d58e8700 1 -- 172.21.15.2:0/488467772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d0196e20 con 0x7ff9d0101850 2024-09-13T23:00:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.984+0000 7ff9d58e8700 1 -- 172.21.15.2:0/488467772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d01091b0 con 0x7ff9d0101850 2024-09-13T23:00:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.985+0000 7ff9d48e6700 1 -- 172.21.15.2:0/488467772 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7ff9b800f460 con 0x7ff9d0101850 2024-09-13T23:00:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.985+0000 7ff9d48e6700 1 --2- 172.21.15.2:0/488467772 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff9bc06e7c0 0x7ff9bc070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.985+0000 7ff9d48e6700 1 -- 172.21.15.2:0/488467772 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff9b808fd40 con 0x7ff9d0101850 2024-09-13T23:00:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.985+0000 7ff9ceffd700 1 --2- 172.21.15.2:0/488467772 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff9bc06e7c0 0x7ff9bc070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:27.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.986+0000 7ff9ceffd700 1 --2- 172.21.15.2:0/488467772 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff9bc06e7c0 0x7ff9bc070c80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00097e0 tx=0x7ff9c0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:00:27.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:27.990+0000 7ff9d48e6700 1 -- 172.21.15.2:0/488467772 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff9b805c8a0 con 0x7ff9d0101850 2024-09-13T23:00:28.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:27 smithi047 ceph-mon[81243]: pgmap v12: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T23:00:28.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.220+0000 7ff9d58e8700 1 -- 172.21.15.2:0/488467772 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9d0197cb0 con 0x7ff9bc06e7c0 2024-09-13T23:00:28.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.221+0000 7ff9d48e6700 1 -- 172.21.15.2:0/488467772 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7ff9d0197cb0 con 0x7ff9bc06e7c0 2024-09-13T23:00:28.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.223+0000 7ff9d58e8700 1 -- 172.21.15.2:0/488467772 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff9bc06e7c0 msgr2=0x7ff9bc070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:28.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.223+0000 7ff9d58e8700 1 --2- 172.21.15.2:0/488467772 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff9bc06e7c0 0x7ff9bc070c80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00097e0 tx=0x7ff9c0009040 comp rx=0 tx=0).stop 2024-09-13T23:00:28.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.223+0000 7ff9d58e8700 1 -- 172.21.15.2:0/488467772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d0101850 msgr2=0x7ff9d019cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:28.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.223+0000 7ff9d58e8700 1 --2- 172.21.15.2:0/488467772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d0101850 0x7ff9d019cb70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80092e0 tx=0x7ff9b800be20 comp rx=0 tx=0).stop 2024-09-13T23:00:28.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.223+0000 7ff9d58e8700 1 -- 172.21.15.2:0/488467772 shutdown_connections 2024-09-13T23:00:28.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.223+0000 7ff9d58e8700 1 --2- 172.21.15.2:0/488467772 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff9bc06e7c0 0x7ff9bc070c80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:28.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.223+0000 7ff9d58e8700 1 --2- 172.21.15.2:0/488467772 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9d0100ea0 0x7ff9d019c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:28.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.223+0000 7ff9d58e8700 1 --2- 172.21.15.2:0/488467772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9d0101850 0x7ff9d019cb70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:28.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.223+0000 7ff9d58e8700 1 -- 172.21.15.2:0/488467772 >> 172.21.15.2:0/488467772 conn(0x7ff9d00fc750 msgr2=0x7ff9d0105110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:00:28.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.223+0000 7ff9d58e8700 1 -- 172.21.15.2:0/488467772 shutdown_connections 2024-09-13T23:00:28.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.223+0000 7ff9d58e8700 1 -- 172.21.15.2:0/488467772 wait complete. 2024-09-13T23:00:28.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.331+0000 7fe346ca5700 1 -- 172.21.15.2:0/717006056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3400ffc20 msgr2=0x7fe340100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:28.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.331+0000 7fe346ca5700 1 --2- 172.21.15.2:0/717006056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3400ffc20 0x7fe340100080 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe334009910 tx=0x7fe334009c20 comp rx=0 tx=0).stop 2024-09-13T23:00:28.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.331+0000 7fe346ca5700 1 -- 172.21.15.2:0/717006056 shutdown_connections 2024-09-13T23:00:28.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.331+0000 7fe346ca5700 1 --2- 172.21.15.2:0/717006056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3400ffc20 0x7fe340100080 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:28.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.331+0000 7fe346ca5700 1 --2- 172.21.15.2:0/717006056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe340105bd0 0x7fe340105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:28.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.331+0000 7fe346ca5700 1 -- 172.21.15.2:0/717006056 >> 172.21.15.2:0/717006056 conn(0x7fe340075670 msgr2=0x7fe340075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:00:28.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.331+0000 7fe346ca5700 1 -- 172.21.15.2:0/717006056 shutdown_connections 2024-09-13T23:00:28.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.331+0000 7fe346ca5700 1 -- 172.21.15.2:0/717006056 wait complete. 2024-09-13T23:00:28.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.332+0000 7fe346ca5700 1 Processor -- start 2024-09-13T23:00:28.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.332+0000 7fe346ca5700 1 -- start start 2024-09-13T23:00:28.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.332+0000 7fe346ca5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3400ffc20 0x7fe34019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:28.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.332+0000 7fe346ca5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe340105bd0 0x7fe34019cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:28.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.332+0000 7fe346ca5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34019d200 con 0x7fe3400ffc20 2024-09-13T23:00:28.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.332+0000 7fe346ca5700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3401966b0 con 0x7fe340105bd0 2024-09-13T23:00:28.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.332+0000 7fe344a41700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3400ffc20 0x7fe34019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:28.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.332+0000 7fe344a41700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3400ffc20 0x7fe34019c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42630/0 (socket says 172.21.15.2:42630) 2024-09-13T23:00:28.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.332+0000 7fe344a41700 1 -- 172.21.15.2:0/3014244160 learned_addr learned my addr 172.21.15.2:0/3014244160 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:00:28.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.332+0000 7fe33ffff700 1 --2- 172.21.15.2:0/3014244160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe340105bd0 0x7fe34019cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:28.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.332+0000 7fe344a41700 1 -- 172.21.15.2:0/3014244160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe340105bd0 msgr2=0x7fe34019cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:28.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.332+0000 7fe344a41700 1 --2- 172.21.15.2:0/3014244160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe340105bd0 0x7fe34019cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:28.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.332+0000 7fe344a41700 1 -- 172.21.15.2:0/3014244160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3340095f0 con 0x7fe3400ffc20 2024-09-13T23:00:28.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.333+0000 7fe344a41700 1 --2- 172.21.15.2:0/3014244160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3400ffc20 0x7fe34019c630 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe33000e920 tx=0x7fe33000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:00:28.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.333+0000 7fe33dffb700 1 -- 172.21.15.2:0/3014244160 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe33000c9d0 con 0x7fe3400ffc20 2024-09-13T23:00:28.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.333+0000 7fe33dffb700 1 -- 172.21.15.2:0/3014244160 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe330010430 con 0x7fe3400ffc20 2024-09-13T23:00:28.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.333+0000 7fe346ca5700 1 -- 172.21.15.2:0/3014244160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe340196990 con 0x7fe3400ffc20 2024-09-13T23:00:28.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.333+0000 7fe33dffb700 1 -- 172.21.15.2:0/3014244160 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe330018630 con 0x7fe3400ffc20 2024-09-13T23:00:28.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.333+0000 7fe346ca5700 1 -- 172.21.15.2:0/3014244160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe340196ee0 con 0x7fe3400ffc20 2024-09-13T23:00:28.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.334+0000 7fe346ca5700 1 -- 172.21.15.2:0/3014244160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe34004f2e0 con 0x7fe3400ffc20 2024-09-13T23:00:28.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.335+0000 7fe33dffb700 1 -- 172.21.15.2:0/3014244160 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7fe3300105a0 con 0x7fe3400ffc20 2024-09-13T23:00:28.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.335+0000 7fe33dffb700 1 --2- 172.21.15.2:0/3014244160 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fe32806e7c0 0x7fe328070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:28.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.335+0000 7fe33dffb700 1 -- 172.21.15.2:0/3014244160 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe330014070 con 0x7fe3400ffc20 2024-09-13T23:00:28.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.335+0000 7fe33ffff700 1 --2- 172.21.15.2:0/3014244160 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fe32806e7c0 0x7fe328070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:28.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.336+0000 7fe33ffff700 1 --2- 172.21.15.2:0/3014244160 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fe32806e7c0 0x7fe328070c80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe3400ffa60 tx=0x7fe334005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:00:28.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.339+0000 7fe33dffb700 1 -- 172.21.15.2:0/3014244160 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe3300541b0 con 0x7fe3400ffc20 2024-09-13T23:00:28.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.564+0000 7fe346ca5700 1 -- 172.21.15.2:0/3014244160 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3401971f0 con 0x7fe32806e7c0 2024-09-13T23:00:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.573+0000 7fe33dffb700 1 -- 172.21.15.2:0/3014244160 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fe3401971f0 con 0x7fe32806e7c0 2024-09-13T23:00:28.574 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:00:28.575 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (2m) 15s ago 12m 16.5M - 0.25.0 c8568f914cd2 f570a73274bc 2024-09-13T23:00:28.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (13m) 15s ago 13m 7982k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T23:00:28.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (12m) 0s ago 12m 7990k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T23:00:28.575 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (12m) 15s ago 12m 6669k - 18.2.1 5be31c24972a de910e0c5157 2024-09-13T23:00:28.575 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (11m) 0s ago 11m 6656k - 18.2.1 5be31c24972a 9f4bcfa66588 2024-09-13T23:00:28.575 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (98s) 15s ago 12m 76.4M - 9.4.12 2bacad6d85d8 650673516b69 2024-09-13T23:00:28.575 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (7m) 15s ago 7m 15.8M - 18.2.1 5be31c24972a 59e9c88c31ca 2024-09-13T23:00:28.575 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (7m) 15s ago 7m 90.9M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T23:00:28.575 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (7m) 0s ago 7m 150M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T23:00:28.575 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (7m) 0s ago 7m 18.6M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T23:00:28.575 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 running (3m) 15s ago 14m 473M - 19.1.1-324-gecab7be5 0652ff2b5d78 7a8aa9de37e4 2024-09-13T23:00:28.575 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (3m) 0s ago 11m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 13fa6f3b5a8a 2024-09-13T23:00:28.575 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (29s) 15s ago 14m 30.0M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 db0ef6c509cf 2024-09-13T23:00:28.576 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (5s) 0s ago 11m 25.9M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 ea0c2a2e0e1a 2024-09-13T23:00:28.576 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (2m) 15s ago 12m 14.9M - 1.5.0 0da6a335fe13 f3eae5f90ab8 2024-09-13T23:00:28.576 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (2m) 0s ago 11m 15.8M - 1.5.0 0da6a335fe13 a5c7d7f1eaa5 2024-09-13T23:00:28.576 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (10m) 15s ago 10m 209M 1217M 18.2.1 5be31c24972a 1e1f6936c402 2024-09-13T23:00:28.576 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (10m) 15s ago 10m 227M 1217M 18.2.1 5be31c24972a f0ac78c34831 2024-09-13T23:00:28.576 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (10m) 15s ago 10m 188M 1217M 18.2.1 5be31c24972a 9a2f4f6decfb 2024-09-13T23:00:28.576 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (9m) 0s ago 9m 260M 2241M 18.2.1 5be31c24972a fb455cc4c571 2024-09-13T23:00:28.576 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (9m) 0s ago 9m 222M 2241M 18.2.1 5be31c24972a f1bdc2c50535 2024-09-13T23:00:28.576 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (8m) 0s ago 8m 198M 2241M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T23:00:28.576 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (2m) 15s ago 12m 70.3M - 2.43.0 a07b618ecd1d aa241d1048de 2024-09-13T23:00:28.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.576+0000 7fe346ca5700 1 -- 172.21.15.2:0/3014244160 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fe32806e7c0 msgr2=0x7fe328070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:28.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.576+0000 7fe346ca5700 1 --2- 172.21.15.2:0/3014244160 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fe32806e7c0 0x7fe328070c80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe3400ffa60 tx=0x7fe334005940 comp rx=0 tx=0).stop 2024-09-13T23:00:28.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.576+0000 7fe346ca5700 1 -- 172.21.15.2:0/3014244160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3400ffc20 msgr2=0x7fe34019c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:28.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.576+0000 7fe346ca5700 1 --2- 172.21.15.2:0/3014244160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3400ffc20 0x7fe34019c630 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe33000e920 tx=0x7fe33000ec30 comp rx=0 tx=0).stop 2024-09-13T23:00:28.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.576+0000 7fe346ca5700 1 -- 172.21.15.2:0/3014244160 shutdown_connections 2024-09-13T23:00:28.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.576+0000 7fe346ca5700 1 --2- 172.21.15.2:0/3014244160 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fe32806e7c0 0x7fe328070c80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:28.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.576+0000 7fe346ca5700 1 --2- 172.21.15.2:0/3014244160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3400ffc20 0x7fe34019c630 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:28.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.576+0000 7fe346ca5700 1 --2- 172.21.15.2:0/3014244160 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe340105bd0 0x7fe34019cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:28.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.576+0000 7fe346ca5700 1 -- 172.21.15.2:0/3014244160 >> 172.21.15.2:0/3014244160 conn(0x7fe340075670 msgr2=0x7fe340068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:00:28.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.576+0000 7fe346ca5700 1 -- 172.21.15.2:0/3014244160 shutdown_connections 2024-09-13T23:00:28.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.576+0000 7fe346ca5700 1 -- 172.21.15.2:0/3014244160 wait complete. 2024-09-13T23:00:28.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.683+0000 7fd6bbfff700 1 -- 172.21.15.2:0/804004641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6bc100e20 msgr2=0x7fd6bc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:28.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.683+0000 7fd6bbfff700 1 --2- 172.21.15.2:0/804004641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6bc100e20 0x7fd6bc101200 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac009910 tx=0x7fd6ac009c20 comp rx=0 tx=0).stop 2024-09-13T23:00:28.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.683+0000 7fd6bbfff700 1 -- 172.21.15.2:0/804004641 shutdown_connections 2024-09-13T23:00:28.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.683+0000 7fd6bbfff700 1 --2- 172.21.15.2:0/804004641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6bc102570 0x7fd6bc1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:28.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.683+0000 7fd6bbfff700 1 --2- 172.21.15.2:0/804004641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6bc100e20 0x7fd6bc101200 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:28.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.683+0000 7fd6bbfff700 1 -- 172.21.15.2:0/804004641 >> 172.21.15.2:0/804004641 conn(0x7fd6bc0fc5a0 msgr2=0x7fd6bc0fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:00:28.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.683+0000 7fd6bbfff700 1 -- 172.21.15.2:0/804004641 shutdown_connections 2024-09-13T23:00:28.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.683+0000 7fd6bbfff700 1 -- 172.21.15.2:0/804004641 wait complete. 2024-09-13T23:00:28.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.684+0000 7fd6bbfff700 1 Processor -- start 2024-09-13T23:00:28.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.685+0000 7fd6bbfff700 1 -- start start 2024-09-13T23:00:28.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.685+0000 7fd6bbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6bc100e20 0x7fd6bc19c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:28.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.685+0000 7fd6bbfff700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6bc102570 0x7fd6bc19c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.685+0000 7fd6bbfff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc19d050 con 0x7fd6bc100e20 2024-09-13T23:00:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.685+0000 7fd6bbfff700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc196560 con 0x7fd6bc102570 2024-09-13T23:00:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.685+0000 7fd6baffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6bc100e20 0x7fd6bc19c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.685+0000 7fd6baffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6bc100e20 0x7fd6bc19c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42654/0 (socket says 172.21.15.2:42654) 2024-09-13T23:00:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.685+0000 7fd6baffd700 1 -- 172.21.15.2:0/495279560 learned_addr learned my addr 172.21.15.2:0/495279560 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:00:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.685+0000 7fd6ba7fc700 1 --2- 172.21.15.2:0/495279560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6bc102570 0x7fd6bc19c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.686+0000 7fd6baffd700 1 -- 172.21.15.2:0/495279560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6bc102570 msgr2=0x7fd6bc19c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.686+0000 7fd6baffd700 1 --2- 172.21.15.2:0/495279560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6bc102570 0x7fd6bc19c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.686+0000 7fd6baffd700 1 -- 172.21.15.2:0/495279560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac0095f0 con 0x7fd6bc100e20 2024-09-13T23:00:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.686+0000 7fd6baffd700 1 --2- 172.21.15.2:0/495279560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6bc100e20 0x7fd6bc19c430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac006010 tx=0x7fd6ac00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:00:28.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.686+0000 7fd6c09ff700 1 -- 172.21.15.2:0/495279560 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6ac01d070 con 0x7fd6bc100e20 2024-09-13T23:00:28.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.686+0000 7fd6c09ff700 1 -- 172.21.15.2:0/495279560 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6ac005dc0 con 0x7fd6bc100e20 2024-09-13T23:00:28.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.686+0000 7fd6bbfff700 1 -- 172.21.15.2:0/495279560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6bc1967e0 con 0x7fd6bc100e20 2024-09-13T23:00:28.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.686+0000 7fd6c09ff700 1 -- 172.21.15.2:0/495279560 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6ac017400 con 0x7fd6bc100e20 2024-09-13T23:00:28.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.686+0000 7fd6bbfff700 1 -- 172.21.15.2:0/495279560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6bc196d50 con 0x7fd6bc100e20 2024-09-13T23:00:28.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.687+0000 7fd6bbfff700 1 -- 172.21.15.2:0/495279560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6bc109120 con 0x7fd6bc100e20 2024-09-13T23:00:28.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.688+0000 7fd6c09ff700 1 -- 172.21.15.2:0/495279560 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7fd6ac003a60 con 0x7fd6bc100e20 2024-09-13T23:00:28.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.688+0000 7fd6c09ff700 1 --2- 172.21.15.2:0/495279560 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fd6a406e7c0 0x7fd6a4070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:28.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.688+0000 7fd6c09ff700 1 -- 172.21.15.2:0/495279560 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd6ac08fcb0 con 0x7fd6bc100e20 2024-09-13T23:00:28.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.688+0000 7fd6ba7fc700 1 --2- 172.21.15.2:0/495279560 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fd6a406e7c0 0x7fd6a4070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:28.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.689+0000 7fd6ba7fc700 1 --2- 172.21.15.2:0/495279560 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fd6a406e7c0 0x7fd6a4070c80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc197d00 tx=0x7fd6b000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:00:28.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.692+0000 7fd6c09ff700 1 -- 172.21.15.2:0/495279560 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd6ac05c810 con 0x7fd6bc100e20 2024-09-13T23:00:28.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.994+0000 7fd6bbfff700 1 -- 172.21.15.2:0/495279560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd6bc196f70 con 0x7fd6bc100e20 2024-09-13T23:00:28.995 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:28 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:28.996 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:28 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:28.996 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:28 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:28.996 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:28 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:28.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.995+0000 7fd6c09ff700 1 -- 172.21.15.2:0/495279560 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+694 (secure 0 0 0) 0x7fd6ac05c3a0 con 0x7fd6bc100e20 2024-09-13T23:00:28.996 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:00:28.996 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T23:00:28.996 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:00:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:00:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T23:00:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:00:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:00:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T23:00:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-13T23:00:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:00:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T23:00:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-13T23:00:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:00:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T23:00:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 10, 2024-09-13T23:00:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T23:00:28.997 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T23:00:28.998 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:00:28.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.997+0000 7fd6bbfff700 1 -- 172.21.15.2:0/495279560 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fd6a406e7c0 msgr2=0x7fd6a4070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:28.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.997+0000 7fd6bbfff700 1 --2- 172.21.15.2:0/495279560 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fd6a406e7c0 0x7fd6a4070c80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc197d00 tx=0x7fd6b000b410 comp rx=0 tx=0).stop 2024-09-13T23:00:28.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.997+0000 7fd6bbfff700 1 -- 172.21.15.2:0/495279560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6bc100e20 msgr2=0x7fd6bc19c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.997+0000 7fd6bbfff700 1 --2- 172.21.15.2:0/495279560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6bc100e20 0x7fd6bc19c430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac006010 tx=0x7fd6ac00bd70 comp rx=0 tx=0).stop 2024-09-13T23:00:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.997+0000 7fd6bbfff700 1 -- 172.21.15.2:0/495279560 shutdown_connections 2024-09-13T23:00:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.997+0000 7fd6bbfff700 1 --2- 172.21.15.2:0/495279560 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fd6a406e7c0 0x7fd6a4070c80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.997+0000 7fd6bbfff700 1 --2- 172.21.15.2:0/495279560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6bc100e20 0x7fd6bc19c430 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.997+0000 7fd6bbfff700 1 --2- 172.21.15.2:0/495279560 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6bc102570 0x7fd6bc19c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.997+0000 7fd6bbfff700 1 -- 172.21.15.2:0/495279560 >> 172.21.15.2:0/495279560 conn(0x7fd6bc0fc5a0 msgr2=0x7fd6bc0fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:00:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.997+0000 7fd6bbfff700 1 -- 172.21.15.2:0/495279560 shutdown_connections 2024-09-13T23:00:28.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:28.997+0000 7fd6bbfff700 1 -- 172.21.15.2:0/495279560 wait complete. 2024-09-13T23:00:29.032 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:28 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:29.032 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:28 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:29.032 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:28 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:29.032 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:28 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:29.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.105+0000 7f87f9f2c700 1 -- 172.21.15.2:0/1848386827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f4100ea0 msgr2=0x7f87f4101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:29.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.105+0000 7f87f9f2c700 1 --2- 172.21.15.2:0/1848386827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f4100ea0 0x7f87f4101280 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f87e4009910 tx=0x7f87e4009c20 comp rx=0 tx=0).stop 2024-09-13T23:00:29.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.105+0000 7f87f9f2c700 1 -- 172.21.15.2:0/1848386827 shutdown_connections 2024-09-13T23:00:29.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.105+0000 7f87f9f2c700 1 --2- 172.21.15.2:0/1848386827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f4101850 0x7f87f41058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:29.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.105+0000 7f87f9f2c700 1 --2- 172.21.15.2:0/1848386827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f4100ea0 0x7f87f4101280 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:29.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.105+0000 7f87f9f2c700 1 -- 172.21.15.2:0/1848386827 >> 172.21.15.2:0/1848386827 conn(0x7f87f40fc750 msgr2=0x7f87f40feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:00:29.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.105+0000 7f87f9f2c700 1 -- 172.21.15.2:0/1848386827 shutdown_connections 2024-09-13T23:00:29.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.105+0000 7f87f9f2c700 1 -- 172.21.15.2:0/1848386827 wait complete. 2024-09-13T23:00:29.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.106+0000 7f87f9f2c700 1 Processor -- start 2024-09-13T23:00:29.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.106+0000 7f87f9f2c700 1 -- start start 2024-09-13T23:00:29.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.106+0000 7f87f9f2c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f4100ea0 0x7f87f419c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:29.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.106+0000 7f87f9f2c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f4101850 0x7f87f419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:29.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.106+0000 7f87f9f2c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f419d2c0 con 0x7f87f4100ea0 2024-09-13T23:00:29.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.106+0000 7f87f9f2c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f4196770 con 0x7f87f4101850 2024-09-13T23:00:29.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.106+0000 7f87f37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f4100ea0 0x7f87f419c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:29.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.106+0000 7f87f37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f4100ea0 0x7f87f419c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42670/0 (socket says 172.21.15.2:42670) 2024-09-13T23:00:29.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.106+0000 7f87f37fe700 1 -- 172.21.15.2:0/859717004 learned_addr learned my addr 172.21.15.2:0/859717004 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:00:29.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.106+0000 7f87f2ffd700 1 --2- 172.21.15.2:0/859717004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f4101850 0x7f87f419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:29.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.107+0000 7f87f37fe700 1 -- 172.21.15.2:0/859717004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f4101850 msgr2=0x7f87f419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:29.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.107+0000 7f87f37fe700 1 --2- 172.21.15.2:0/859717004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f4101850 0x7f87f419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:29.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.107+0000 7f87f37fe700 1 -- 172.21.15.2:0/859717004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e40095f0 con 0x7f87f4100ea0 2024-09-13T23:00:29.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.107+0000 7f87f37fe700 1 --2- 172.21.15.2:0/859717004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f4100ea0 0x7f87f419c6f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f87e4006010 tx=0x7f87e400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:00:29.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.107+0000 7f87f0ff9700 1 -- 172.21.15.2:0/859717004 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87e401d070 con 0x7f87f4100ea0 2024-09-13T23:00:29.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.107+0000 7f87f9f2c700 1 -- 172.21.15.2:0/859717004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f41969f0 con 0x7f87f4100ea0 2024-09-13T23:00:29.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.107+0000 7f87f0ff9700 1 -- 172.21.15.2:0/859717004 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f87e4005dc0 con 0x7f87f4100ea0 2024-09-13T23:00:29.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.107+0000 7f87f0ff9700 1 -- 172.21.15.2:0/859717004 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87e4017400 con 0x7f87f4100ea0 2024-09-13T23:00:29.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.107+0000 7f87f9f2c700 1 -- 172.21.15.2:0/859717004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f4196ee0 con 0x7f87f4100ea0 2024-09-13T23:00:29.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.108+0000 7f87f9f2c700 1 -- 172.21.15.2:0/859717004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f4109240 con 0x7f87f4100ea0 2024-09-13T23:00:29.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.109+0000 7f87f0ff9700 1 -- 172.21.15.2:0/859717004 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f87e4003a60 con 0x7f87f4100ea0 2024-09-13T23:00:29.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.109+0000 7f87f0ff9700 1 --2- 172.21.15.2:0/859717004 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f87dc06e7c0 0x7f87dc070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:29.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.109+0000 7f87f0ff9700 1 -- 172.21.15.2:0/859717004 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f87e408fcb0 con 0x7f87f4100ea0 2024-09-13T23:00:29.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.109+0000 7f87f2ffd700 1 --2- 172.21.15.2:0/859717004 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f87dc06e7c0 0x7f87dc070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:29.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.110+0000 7f87f2ffd700 1 --2- 172.21.15.2:0/859717004 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f87dc06e7c0 0x7f87dc070c80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f87f4197be0 tx=0x7f87e80073d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:00:29.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.114+0000 7f87f0ff9700 1 -- 172.21.15.2:0/859717004 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f87e405c810 con 0x7f87f4100ea0 2024-09-13T23:00:29.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.366+0000 7f87f9f2c700 1 -- 172.21.15.2:0/859717004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f87f4197cd0 con 0x7f87f4100ea0 2024-09-13T23:00:29.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.367+0000 7f87f0ff9700 1 -- 172.21.15.2:0/859717004 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1938 (secure 0 0 0) 0x7f87e405c3a0 con 0x7f87f4100ea0 2024-09-13T23:00:29.368 INFO:teuthology.orchestra.run.smithi002.stdout:e16 2024-09-13T23:00:29.368 INFO:teuthology.orchestra.run.smithi002.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T23:00:29.368 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:00:29.368 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:00:29.368 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-13T23:00:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:00:29.369 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:00:29.369 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-13T23:00:29.369 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 16 2024-09-13T23:00:29.369 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:00:29.369 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-13T22:53:05.963265+0000 2024-09-13T23:00:29.369 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-13T22:53:25.072026+0000 2024-09-13T23:00:29.369 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-13T23:00:29.369 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-13T23:00:29.369 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-13T23:00:29.369 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-13T23:00:29.369 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-13T23:00:29.369 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-13T23:00:29.370 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-13T23:00:29.370 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-13T23:00:29.370 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 47 2024-09-13T23:00:29.370 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:00:29.370 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 1 2024-09-13T23:00:29.370 INFO:teuthology.orchestra.run.smithi002.stdout:in 0 2024-09-13T23:00:29.370 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24267} 2024-09-13T23:00:29.370 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-13T23:00:29.370 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-13T23:00:29.370 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-13T23:00:29.370 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-13T23:00:29.370 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-13T23:00:29.370 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-13T23:00:29.370 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-13T23:00:29.371 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-13T23:00:29.371 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-13T23:00:29.371 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 0 members: 2024-09-13T23:00:29.371 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.gxzkha{0:24267} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:00:29.371 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.gglyyr{0:14488} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.2:6828/2123560657,v1:172.21.15.2:6829/2123560657] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:00:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:00:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:00:29.371 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-13T23:00:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:00:29.371 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.auedll{-1:14500} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/1577962179,v1:172.21.15.2:6827/1577962179] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:00:29.371 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.nqvveh{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:00:29.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.369+0000 7f87f9f2c700 1 -- 172.21.15.2:0/859717004 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f87dc06e7c0 msgr2=0x7f87dc070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:29.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.369+0000 7f87f9f2c700 1 --2- 172.21.15.2:0/859717004 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f87dc06e7c0 0x7f87dc070c80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f87f4197be0 tx=0x7f87e80073d0 comp rx=0 tx=0).stop 2024-09-13T23:00:29.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.369+0000 7f87f9f2c700 1 -- 172.21.15.2:0/859717004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f4100ea0 msgr2=0x7f87f419c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:29.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.369+0000 7f87f9f2c700 1 --2- 172.21.15.2:0/859717004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f4100ea0 0x7f87f419c6f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f87e4006010 tx=0x7f87e400bd70 comp rx=0 tx=0).stop 2024-09-13T23:00:29.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.369+0000 7f87f9f2c700 1 -- 172.21.15.2:0/859717004 shutdown_connections 2024-09-13T23:00:29.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.369+0000 7f87f9f2c700 1 --2- 172.21.15.2:0/859717004 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f87dc06e7c0 0x7f87dc070c80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:29.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.369+0000 7f87f9f2c700 1 --2- 172.21.15.2:0/859717004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87f4100ea0 0x7f87f419c6f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:29.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.369+0000 7f87f9f2c700 1 --2- 172.21.15.2:0/859717004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f4101850 0x7f87f419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:29.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.369+0000 7f87f9f2c700 1 -- 172.21.15.2:0/859717004 >> 172.21.15.2:0/859717004 conn(0x7f87f40fc750 msgr2=0x7f87f40fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:00:29.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.370+0000 7f87f9f2c700 1 -- 172.21.15.2:0/859717004 shutdown_connections 2024-09-13T23:00:29.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.370+0000 7f87f9f2c700 1 -- 172.21.15.2:0/859717004 wait complete. 2024-09-13T23:00:29.373 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2024-09-13T23:00:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.478+0000 7fface5d5700 1 -- 172.21.15.2:0/3561309521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac80ffda0 msgr2=0x7ffac8100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.478+0000 7fface5d5700 1 --2- 172.21.15.2:0/3561309521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac80ffda0 0x7ffac8100180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009910 tx=0x7ffab8009c20 comp rx=0 tx=0).stop 2024-09-13T23:00:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.478+0000 7fface5d5700 1 -- 172.21.15.2:0/3561309521 shutdown_connections 2024-09-13T23:00:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.478+0000 7fface5d5700 1 --2- 172.21.15.2:0/3561309521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffac8100750 0x7ffac81047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:29.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.478+0000 7fface5d5700 1 --2- 172.21.15.2:0/3561309521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac80ffda0 0x7ffac8100180 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.478+0000 7fface5d5700 1 -- 172.21.15.2:0/3561309521 >> 172.21.15.2:0/3561309521 conn(0x7ffac80fb650 msgr2=0x7ffac80fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:00:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.479+0000 7fface5d5700 1 -- 172.21.15.2:0/3561309521 shutdown_connections 2024-09-13T23:00:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.479+0000 7fface5d5700 1 -- 172.21.15.2:0/3561309521 wait complete. 2024-09-13T23:00:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.479+0000 7fface5d5700 1 Processor -- start 2024-09-13T23:00:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.479+0000 7fface5d5700 1 -- start start 2024-09-13T23:00:29.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.480+0000 7fface5d5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffac80ffda0 0x7ffac819b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:29.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.480+0000 7fface5d5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac8100750 0x7ffac819ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:29.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.480+0000 7fface5d5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac819c120 con 0x7ffac8100750 2024-09-13T23:00:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.480+0000 7fface5d5700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac81955d0 con 0x7ffac80ffda0 2024-09-13T23:00:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.480+0000 7ffac77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac8100750 0x7ffac819ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.480+0000 7ffac77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac8100750 0x7ffac819ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42686/0 (socket says 172.21.15.2:42686) 2024-09-13T23:00:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.480+0000 7ffac77fe700 1 -- 172.21.15.2:0/3163178874 learned_addr learned my addr 172.21.15.2:0/3163178874 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:00:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.480+0000 7ffac7fff700 1 --2- 172.21.15.2:0/3163178874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffac80ffda0 0x7ffac819b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.480+0000 7ffac77fe700 1 -- 172.21.15.2:0/3163178874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffac80ffda0 msgr2=0x7ffac819b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.480+0000 7ffac77fe700 1 --2- 172.21.15.2:0/3163178874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffac80ffda0 0x7ffac819b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.480+0000 7ffac77fe700 1 -- 172.21.15.2:0/3163178874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab80095f0 con 0x7ffac8100750 2024-09-13T23:00:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.480+0000 7ffac77fe700 1 --2- 172.21.15.2:0/3163178874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac8100750 0x7ffac819ba90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00c8f0 tx=0x7ffabc00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:00:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.480+0000 7ffac57fa700 1 -- 172.21.15.2:0/3163178874 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffabc0078a0 con 0x7ffac8100750 2024-09-13T23:00:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.481+0000 7ffac57fa700 1 -- 172.21.15.2:0/3163178874 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffabc00f450 con 0x7ffac8100750 2024-09-13T23:00:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.481+0000 7fface5d5700 1 -- 172.21.15.2:0/3163178874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac8195850 con 0x7ffac8100750 2024-09-13T23:00:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.481+0000 7ffac57fa700 1 -- 172.21.15.2:0/3163178874 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffabc018610 con 0x7ffac8100750 2024-09-13T23:00:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.481+0000 7fface5d5700 1 -- 172.21.15.2:0/3163178874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac8195da0 con 0x7ffac8100750 2024-09-13T23:00:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.482+0000 7fface5d5700 1 -- 172.21.15.2:0/3163178874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac804f2e0 con 0x7ffac8100750 2024-09-13T23:00:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.482+0000 7ffac57fa700 1 -- 172.21.15.2:0/3163178874 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7ffabc00f5c0 con 0x7ffac8100750 2024-09-13T23:00:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.482+0000 7ffac57fa700 1 --2- 172.21.15.2:0/3163178874 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ffab006e7b0 0x7ffab0070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:29.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.483+0000 7ffac57fa700 1 -- 172.21.15.2:0/3163178874 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ffabc08e7f0 con 0x7ffac8100750 2024-09-13T23:00:29.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.483+0000 7ffac7fff700 1 --2- 172.21.15.2:0/3163178874 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ffab006e7b0 0x7ffab0070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:29.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.483+0000 7ffac7fff700 1 --2- 172.21.15.2:0/3163178874 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ffab006e7b0 0x7ffab0070c70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffab8005f50 tx=0x7ffab801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:00:29.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.487+0000 7ffac57fa700 1 -- 172.21.15.2:0/3163178874 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ffabc05b350 con 0x7ffac8100750 2024-09-13T23:00:29.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.715+0000 7fface5d5700 1 -- 172.21.15.2:0/3163178874 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffac81960b0 con 0x7ffab006e7b0 2024-09-13T23:00:29.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.716+0000 7ffac57fa700 1 -- 172.21.15.2:0/3163178874 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7ffac81960b0 con 0x7ffab006e7b0 2024-09-13T23:00:29.717 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:00:29.717 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:00:29.717 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T23:00:29.717 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:00:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-13T23:00:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-13T23:00:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2024-09-13T23:00:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-13T23:00:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "4/23 daemons upgraded", 2024-09-13T23:00:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading mon daemons", 2024-09-13T23:00:29.718 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T23:00:29.718 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:00:29.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.718+0000 7fface5d5700 1 -- 172.21.15.2:0/3163178874 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ffab006e7b0 msgr2=0x7ffab0070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:29.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.718+0000 7fface5d5700 1 --2- 172.21.15.2:0/3163178874 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ffab006e7b0 0x7ffab0070c70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffab8005f50 tx=0x7ffab801a040 comp rx=0 tx=0).stop 2024-09-13T23:00:29.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.718+0000 7fface5d5700 1 -- 172.21.15.2:0/3163178874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac8100750 msgr2=0x7ffac819ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:29.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.718+0000 7fface5d5700 1 --2- 172.21.15.2:0/3163178874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac8100750 0x7ffac819ba90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00c8f0 tx=0x7ffabc00cc00 comp rx=0 tx=0).stop 2024-09-13T23:00:29.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.719+0000 7fface5d5700 1 -- 172.21.15.2:0/3163178874 shutdown_connections 2024-09-13T23:00:29.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.719+0000 7fface5d5700 1 --2- 172.21.15.2:0/3163178874 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ffab006e7b0 0x7ffab0070c70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:29.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.719+0000 7fface5d5700 1 --2- 172.21.15.2:0/3163178874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffac80ffda0 0x7ffac819b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:29.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.719+0000 7fface5d5700 1 --2- 172.21.15.2:0/3163178874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac8100750 0x7ffac819ba90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:29.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.719+0000 7fface5d5700 1 -- 172.21.15.2:0/3163178874 >> 172.21.15.2:0/3163178874 conn(0x7ffac80fb650 msgr2=0x7ffac80fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:00:29.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.719+0000 7fface5d5700 1 -- 172.21.15.2:0/3163178874 shutdown_connections 2024-09-13T23:00:29.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.719+0000 7fface5d5700 1 -- 172.21.15.2:0/3163178874 wait complete. 2024-09-13T23:00:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.827+0000 7f6a52c15700 1 -- 172.21.15.2:0/2978388683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a4c105bd0 msgr2=0x7f6a4c105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.827+0000 7f6a52c15700 1 --2- 172.21.15.2:0/2978388683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a4c105bd0 0x7f6a4c105fb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009910 tx=0x7f6a34009c20 comp rx=0 tx=0).stop 2024-09-13T23:00:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.827+0000 7f6a52c15700 1 -- 172.21.15.2:0/2978388683 shutdown_connections 2024-09-13T23:00:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.827+0000 7f6a52c15700 1 --2- 172.21.15.2:0/2978388683 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a4c0ffc20 0x7f6a4c100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.827+0000 7f6a52c15700 1 --2- 172.21.15.2:0/2978388683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a4c105bd0 0x7f6a4c105fb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.827+0000 7f6a52c15700 1 -- 172.21.15.2:0/2978388683 >> 172.21.15.2:0/2978388683 conn(0x7f6a4c075670 msgr2=0x7f6a4c075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:00:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.827+0000 7f6a52c15700 1 -- 172.21.15.2:0/2978388683 shutdown_connections 2024-09-13T23:00:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.827+0000 7f6a52c15700 1 -- 172.21.15.2:0/2978388683 wait complete. 2024-09-13T23:00:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.828+0000 7f6a52c15700 1 Processor -- start 2024-09-13T23:00:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.828+0000 7f6a52c15700 1 -- start start 2024-09-13T23:00:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.828+0000 7f6a52c15700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a4c0ffc20 0x7f6a4c101840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.828+0000 7f6a52c15700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a4c105bd0 0x7f6a4c101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.828+0000 7f6a52c15700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c1022c0 con 0x7f6a4c105bd0 2024-09-13T23:00:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.828+0000 7f6a52c15700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c102400 con 0x7f6a4c0ffc20 2024-09-13T23:00:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.828+0000 7f6a4bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a4c105bd0 0x7f6a4c101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.828+0000 7f6a4bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a4c105bd0 0x7f6a4c101d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42708/0 (socket says 172.21.15.2:42708) 2024-09-13T23:00:29.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.828+0000 7f6a4bfff700 1 -- 172.21.15.2:0/545260368 learned_addr learned my addr 172.21.15.2:0/545260368 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:00:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.828+0000 7f6a509b1700 1 --2- 172.21.15.2:0/545260368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a4c0ffc20 0x7f6a4c101840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.828+0000 7f6a4bfff700 1 -- 172.21.15.2:0/545260368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a4c0ffc20 msgr2=0x7f6a4c101840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.828+0000 7f6a4bfff700 1 --2- 172.21.15.2:0/545260368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a4c0ffc20 0x7f6a4c101840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.828+0000 7f6a4bfff700 1 -- 172.21.15.2:0/545260368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a340095f0 con 0x7f6a4c105bd0 2024-09-13T23:00:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.829+0000 7f6a4bfff700 1 --2- 172.21.15.2:0/545260368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a4c105bd0 0x7f6a4c101d80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00ef10 tx=0x7f6a3c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:00:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.829+0000 7f6a49ffb700 1 -- 172.21.15.2:0/545260368 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a3c00ca50 con 0x7f6a4c105bd0 2024-09-13T23:00:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.829+0000 7f6a49ffb700 1 -- 172.21.15.2:0/545260368 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a3c00f040 con 0x7f6a4c105bd0 2024-09-13T23:00:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.829+0000 7f6a52c15700 1 -- 172.21.15.2:0/545260368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4c102680 con 0x7f6a4c105bd0 2024-09-13T23:00:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.829+0000 7f6a49ffb700 1 -- 172.21.15.2:0/545260368 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a3c0146b0 con 0x7f6a4c105bd0 2024-09-13T23:00:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.829+0000 7f6a52c15700 1 -- 172.21.15.2:0/545260368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4c1a2db0 con 0x7f6a4c105bd0 2024-09-13T23:00:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.830+0000 7f6a52c15700 1 -- 172.21.15.2:0/545260368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4c04f2e0 con 0x7f6a4c105bd0 2024-09-13T23:00:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.830+0000 7f6a49ffb700 1 -- 172.21.15.2:0/545260368 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f6a3c00cbb0 con 0x7f6a4c105bd0 2024-09-13T23:00:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.831+0000 7f6a49ffb700 1 --2- 172.21.15.2:0/545260368 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f6a3806e7c0 0x7f6a38070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:00:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.831+0000 7f6a49ffb700 1 -- 172.21.15.2:0/545260368 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f6a3c08eb80 con 0x7f6a4c105bd0 2024-09-13T23:00:29.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.831+0000 7f6a509b1700 1 --2- 172.21.15.2:0/545260368 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f6a3806e7c0 0x7f6a38070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:00:29.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.831+0000 7f6a509b1700 1 --2- 172.21.15.2:0/545260368 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f6a3806e7c0 0x7f6a38070c80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009910 tx=0x7f6a34009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:00:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:29.835+0000 7f6a49ffb700 1 -- 172.21.15.2:0/545260368 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6a3c057c30 con 0x7f6a4c105bd0 2024-09-13T23:00:29.938 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:29 smithi047 ceph-mon[81243]: pgmap v13: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:00:29.938 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:29 smithi047 ceph-mon[81243]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:29.939 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:29 smithi047 ceph-mon[81243]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:29.939 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:29 smithi047 ceph-mon[81243]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:29.939 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:29 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/495279560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:00:29.939 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:29 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/859717004' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:00:29.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:29 smithi002 ceph-mon[111294]: pgmap v13: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:00:30.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:29 smithi002 ceph-mon[111294]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:30.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:29 smithi002 ceph-mon[111294]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:30.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:29 smithi002 ceph-mon[111294]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:30.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:29 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/495279560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:00:30.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:29 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/859717004' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:00:30.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:30.139+0000 7f6a52c15700 1 -- 172.21.15.2:0/545260368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6a4c1a30c0 con 0x7f6a4c105bd0 2024-09-13T23:00:30.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:30.140+0000 7f6a49ffb700 1 -- 172.21.15.2:0/545260368 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f6a3c05b2f0 con 0x7f6a4c105bd0 2024-09-13T23:00:30.141 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T23:00:30.141 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T23:00:30.141 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T23:00:30.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:30.142+0000 7f6a52c15700 1 -- 172.21.15.2:0/545260368 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f6a3806e7c0 msgr2=0x7f6a38070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:30.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:30.142+0000 7f6a52c15700 1 --2- 172.21.15.2:0/545260368 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f6a3806e7c0 0x7f6a38070c80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009910 tx=0x7f6a34009f70 comp rx=0 tx=0).stop 2024-09-13T23:00:30.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:30.142+0000 7f6a52c15700 1 -- 172.21.15.2:0/545260368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a4c105bd0 msgr2=0x7f6a4c101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:00:30.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:30.142+0000 7f6a52c15700 1 --2- 172.21.15.2:0/545260368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a4c105bd0 0x7f6a4c101d80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00ef10 tx=0x7f6a3c00c3a0 comp rx=0 tx=0).stop 2024-09-13T23:00:30.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:30.142+0000 7f6a52c15700 1 -- 172.21.15.2:0/545260368 shutdown_connections 2024-09-13T23:00:30.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:30.142+0000 7f6a52c15700 1 --2- 172.21.15.2:0/545260368 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f6a3806e7c0 0x7f6a38070c80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:30.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:30.142+0000 7f6a52c15700 1 --2- 172.21.15.2:0/545260368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a4c0ffc20 0x7f6a4c101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:30.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:30.142+0000 7f6a52c15700 1 --2- 172.21.15.2:0/545260368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a4c105bd0 0x7f6a4c101d80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:00:30.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:30.142+0000 7f6a52c15700 1 -- 172.21.15.2:0/545260368 >> 172.21.15.2:0/545260368 conn(0x7f6a4c075670 msgr2=0x7f6a4c0686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:00:30.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:30.142+0000 7f6a52c15700 1 -- 172.21.15.2:0/545260368 shutdown_connections 2024-09-13T23:00:30.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:00:30.142+0000 7f6a52c15700 1 -- 172.21.15.2:0/545260368 wait complete. 2024-09-13T23:00:30.993 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:30 smithi047 ceph-mon[81243]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:30.993 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:30 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/545260368' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:00:30.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:30 smithi002 ceph-mon[111294]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:00:30.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:30 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/545260368' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:00:31.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:31 smithi047 ceph-mon[81243]: pgmap v14: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:00:31.916 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:31 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:31.916 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:31 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:31.916 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:31 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:31.917 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:31 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:00:31.917 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:31 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:31.917 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:31 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T23:00:31.917 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:31 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T23:00:31.917 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:31 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:31.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:31 smithi002 ceph-mon[111294]: pgmap v14: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:00:32.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:31 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:32.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:31 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:32.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:31 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:32.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:31 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:00:32.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:31 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:32.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:31 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T23:00:32.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:31 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T23:00:32.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:31 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:32.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:32 smithi002 ceph-mon[111294]: Detected new or changed devices on smithi047 2024-09-13T23:00:33.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:32 smithi002 ceph-mon[111294]: Reconfiguring mon.smithi002 (monmap changed)... 2024-09-13T23:00:33.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:32 smithi002 ceph-mon[111294]: Reconfiguring daemon mon.smithi002 on smithi002 2024-09-13T23:00:33.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:32 smithi047 ceph-mon[81243]: Detected new or changed devices on smithi047 2024-09-13T23:00:33.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:32 smithi047 ceph-mon[81243]: Reconfiguring mon.smithi002 (monmap changed)... 2024-09-13T23:00:33.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:32 smithi047 ceph-mon[81243]: Reconfiguring daemon mon.smithi002 on smithi002 2024-09-13T23:00:33.782 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:33 smithi002 ceph-mon[111294]: pgmap v15: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:00:33.782 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:33 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:33.782 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:33 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:33.782 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:33 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.yumtzz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T23:00:33.782 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:33 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T23:00:33.782 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:33 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:34.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:33 smithi047 ceph-mon[81243]: pgmap v15: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:00:34.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:33 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:34.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:33 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:34.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:33 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.yumtzz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T23:00:34.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:33 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T23:00:34.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:33 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:35.052 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:34 smithi002 ceph-mon[111294]: Reconfiguring mgr.smithi002.yumtzz (monmap changed)... 2024-09-13T23:00:35.052 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:34 smithi002 ceph-mon[111294]: Reconfiguring daemon mgr.smithi002.yumtzz on smithi002 2024-09-13T23:00:35.052 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:34 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:35.052 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:34 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:35.052 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:34 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi002", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T23:00:35.052 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:34 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi002", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T23:00:35.053 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:34 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi002", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T23:00:35.053 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:34 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi002"}]: dispatch 2024-09-13T23:00:35.053 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:34 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:35.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:34 smithi047 ceph-mon[81243]: Reconfiguring mgr.smithi002.yumtzz (monmap changed)... 2024-09-13T23:00:35.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:34 smithi047 ceph-mon[81243]: Reconfiguring daemon mgr.smithi002.yumtzz on smithi002 2024-09-13T23:00:35.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:34 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:35.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:34 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:35.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:34 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi002", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T23:00:35.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:34 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi002", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T23:00:35.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:34 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi002", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T23:00:35.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:34 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi002"}]: dispatch 2024-09-13T23:00:35.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:34 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:36.027 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:35 smithi002 ceph-mon[111294]: pgmap v16: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:00:36.027 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:35 smithi002 ceph-mon[111294]: Reconfiguring ceph-exporter.smithi002 (monmap changed)... 2024-09-13T23:00:36.027 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:35 smithi002 ceph-mon[111294]: Unable to update caps for client.ceph-exporter.smithi002 2024-09-13T23:00:36.027 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:35 smithi002 ceph-mon[111294]: Reconfiguring daemon ceph-exporter.smithi002 on smithi002 2024-09-13T23:00:36.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:35 smithi047 ceph-mon[81243]: pgmap v16: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:00:36.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:35 smithi047 ceph-mon[81243]: Reconfiguring ceph-exporter.smithi002 (monmap changed)... 2024-09-13T23:00:36.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:35 smithi047 ceph-mon[81243]: Unable to update caps for client.ceph-exporter.smithi002 2024-09-13T23:00:36.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:35 smithi047 ceph-mon[81243]: Reconfiguring daemon ceph-exporter.smithi002 on smithi002 2024-09-13T23:00:37.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:37 smithi002 ceph-mon[111294]: pgmap v17: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:00:37.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:37 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:37.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:37 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:37.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:37 smithi002 ceph-mon[111294]: Reconfiguring crash.smithi002 (monmap changed)... 2024-09-13T23:00:37.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:37 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T23:00:37.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:37 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:37.392 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:37 smithi002 ceph-mon[111294]: Reconfiguring daemon crash.smithi002 on smithi002 2024-09-13T23:00:37.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:37 smithi047 ceph-mon[81243]: pgmap v17: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:00:37.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:37 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:37.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:37 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:37.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:37 smithi047 ceph-mon[81243]: Reconfiguring crash.smithi002 (monmap changed)... 2024-09-13T23:00:37.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:37 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T23:00:37.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:37 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:37.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:37 smithi047 ceph-mon[81243]: Reconfiguring daemon crash.smithi002 on smithi002 2024-09-13T23:00:38.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:38.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:38.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:38 smithi002 ceph-mon[111294]: Reconfiguring osd.0 (monmap changed)... 2024-09-13T23:00:38.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T23:00:38.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:38.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:38 smithi002 ceph-mon[111294]: Reconfiguring daemon osd.0 on smithi002 2024-09-13T23:00:38.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:00:38.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:38.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:38.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:38 smithi047 ceph-mon[81243]: Reconfiguring osd.0 (monmap changed)... 2024-09-13T23:00:38.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T23:00:38.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:38.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:38 smithi047 ceph-mon[81243]: Reconfiguring daemon osd.0 on smithi002 2024-09-13T23:00:38.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:00:39.612 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:39 smithi002 ceph-mon[111294]: pgmap v18: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:00:39.612 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:39 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:39.612 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:39 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:39.612 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:39 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T23:00:39.612 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:39 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:39.775 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:39 smithi047 ceph-mon[81243]: pgmap v18: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:00:39.775 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:39 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:39.775 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:39 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:39.775 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:39 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T23:00:39.775 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:39 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:40.747 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:40 smithi002 ceph-mon[111294]: Reconfiguring osd.1 (monmap changed)... 2024-09-13T23:00:40.747 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:40 smithi002 ceph-mon[111294]: Reconfiguring daemon osd.1 on smithi002 2024-09-13T23:00:40.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:40 smithi047 ceph-mon[81243]: Reconfiguring osd.1 (monmap changed)... 2024-09-13T23:00:40.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:40 smithi047 ceph-mon[81243]: Reconfiguring daemon osd.1 on smithi002 2024-09-13T23:00:41.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:41 smithi002 ceph-mon[111294]: pgmap v19: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:00:41.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:41.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:41.753 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:41 smithi002 ceph-mon[111294]: Reconfiguring osd.2 (monmap changed)... 2024-09-13T23:00:41.753 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T23:00:41.753 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:41.753 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:41 smithi002 ceph-mon[111294]: Reconfiguring daemon osd.2 on smithi002 2024-09-13T23:00:41.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:41 smithi047 ceph-mon[81243]: pgmap v19: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:00:41.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:41.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:41.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:41 smithi047 ceph-mon[81243]: Reconfiguring osd.2 (monmap changed)... 2024-09-13T23:00:41.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T23:00:41.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:41.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:41 smithi047 ceph-mon[81243]: Reconfiguring daemon osd.2 on smithi002 2024-09-13T23:00:43.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:42 smithi002 ceph-mon[111294]: pgmap v20: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:00:43.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:42 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:43.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:42 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:43.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:42 smithi002 ceph-mon[111294]: Reconfiguring mds.cephfs.smithi002.auedll (monmap changed)... 2024-09-13T23:00:43.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:42 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.auedll", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:00:43.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:42 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:43.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:42 smithi002 ceph-mon[111294]: Reconfiguring daemon mds.cephfs.smithi002.auedll on smithi002 2024-09-13T23:00:43.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:42 smithi047 ceph-mon[81243]: pgmap v20: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:00:43.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:42 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:43.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:42 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:43.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:42 smithi047 ceph-mon[81243]: Reconfiguring mds.cephfs.smithi002.auedll (monmap changed)... 2024-09-13T23:00:43.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:42 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.auedll", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:00:43.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:42 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:43.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:42 smithi047 ceph-mon[81243]: Reconfiguring daemon mds.cephfs.smithi002.auedll on smithi002 2024-09-13T23:00:44.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:44 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:44.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:44 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:44.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:44 smithi002 ceph-mon[111294]: Reconfiguring mds.cephfs.smithi002.gglyyr (monmap changed)... 2024-09-13T23:00:44.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:44 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.gglyyr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:00:44.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:44 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:44.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:44 smithi002 ceph-mon[111294]: Reconfiguring daemon mds.cephfs.smithi002.gglyyr on smithi002 2024-09-13T23:00:44.824 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:44 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:44.824 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:44 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:44.824 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:44 smithi047 ceph-mon[81243]: Reconfiguring mds.cephfs.smithi002.gglyyr (monmap changed)... 2024-09-13T23:00:44.824 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:44 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.gglyyr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:00:44.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:44 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:44.825 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:44 smithi047 ceph-mon[81243]: Reconfiguring daemon mds.cephfs.smithi002.gglyyr on smithi002 2024-09-13T23:00:45.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:45 smithi047 ceph-mon[81243]: pgmap v21: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:00:45.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:45.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:45.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi047", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T23:00:45.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi047", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T23:00:45.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi047", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T23:00:45.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi047"}]: dispatch 2024-09-13T23:00:45.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:46.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:45 smithi002 ceph-mon[111294]: pgmap v21: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:00:46.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:46.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:46.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi047", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T23:00:46.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi047", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T23:00:46.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi047", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T23:00:46.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi047"}]: dispatch 2024-09-13T23:00:46.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:46.787 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:46 smithi047 ceph-mon[81243]: Reconfiguring ceph-exporter.smithi047 (monmap changed)... 2024-09-13T23:00:46.788 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:46 smithi047 ceph-mon[81243]: Unable to update caps for client.ceph-exporter.smithi047 2024-09-13T23:00:46.788 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:46 smithi047 ceph-mon[81243]: Reconfiguring daemon ceph-exporter.smithi047 on smithi047 2024-09-13T23:00:46.788 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:46 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:46.788 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:46 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:46.788 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:46 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi047", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T23:00:46.788 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:46 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:47.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:46 smithi002 ceph-mon[111294]: Reconfiguring ceph-exporter.smithi047 (monmap changed)... 2024-09-13T23:00:47.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:46 smithi002 ceph-mon[111294]: Unable to update caps for client.ceph-exporter.smithi047 2024-09-13T23:00:47.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:46 smithi002 ceph-mon[111294]: Reconfiguring daemon ceph-exporter.smithi047 on smithi047 2024-09-13T23:00:47.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:46 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:47.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:46 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:47.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:46 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi047", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T23:00:47.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:46 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:47.908 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:47 smithi047 ceph-mon[81243]: pgmap v22: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:00:47.908 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:47 smithi047 ceph-mon[81243]: Reconfiguring crash.smithi047 (monmap changed)... 2024-09-13T23:00:47.909 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:47 smithi047 ceph-mon[81243]: Reconfiguring daemon crash.smithi047 on smithi047 2024-09-13T23:00:48.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:47 smithi002 ceph-mon[111294]: pgmap v22: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:00:48.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:47 smithi002 ceph-mon[111294]: Reconfiguring crash.smithi047 (monmap changed)... 2024-09-13T23:00:48.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:47 smithi002 ceph-mon[111294]: Reconfiguring daemon crash.smithi047 on smithi047 2024-09-13T23:00:48.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:48 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:48.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:48 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:48.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:48 smithi002 ceph-mon[111294]: Reconfiguring mgr.smithi047.gcymvd (monmap changed)... 2024-09-13T23:00:48.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:48 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.gcymvd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T23:00:48.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:48 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T23:00:48.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:48 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:48.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:48 smithi002 ceph-mon[111294]: Reconfiguring daemon mgr.smithi047.gcymvd on smithi047 2024-09-13T23:00:48.824 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:48 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:48.824 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:48 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:48.824 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:48 smithi047 ceph-mon[81243]: Reconfiguring mgr.smithi047.gcymvd (monmap changed)... 2024-09-13T23:00:48.824 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:48 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi047.gcymvd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T23:00:48.824 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:48 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T23:00:48.824 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:48 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:48.824 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:48 smithi047 ceph-mon[81243]: Reconfiguring daemon mgr.smithi047.gcymvd on smithi047 2024-09-13T23:00:49.876 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:49 smithi047 ceph-mon[81243]: pgmap v23: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:00:49.876 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:49 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:49.876 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:49 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:49.876 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:49 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T23:00:49.876 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:49 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T23:00:49.876 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:49 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:49.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:49 smithi002 ceph-mon[111294]: pgmap v23: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:00:50.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:49 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:50.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:49 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:50.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:49 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T23:00:50.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:49 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T23:00:50.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:49 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:50.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:50 smithi002 ceph-mon[111294]: Reconfiguring mon.smithi047 (monmap changed)... 2024-09-13T23:00:50.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:50 smithi002 ceph-mon[111294]: Reconfiguring daemon mon.smithi047 on smithi047 2024-09-13T23:00:50.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:50 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:50.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:50 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:50.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:50 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T23:00:50.752 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:50 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:50.797 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:50 smithi047 ceph-mon[81243]: Reconfiguring mon.smithi047 (monmap changed)... 2024-09-13T23:00:50.797 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:50 smithi047 ceph-mon[81243]: Reconfiguring daemon mon.smithi047 on smithi047 2024-09-13T23:00:50.797 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:50 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:50.797 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:50 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:50.797 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:50 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T23:00:50.797 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:50 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:51.797 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:51 smithi047 ceph-mon[81243]: pgmap v24: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:00:51.798 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:51 smithi047 ceph-mon[81243]: Reconfiguring osd.3 (monmap changed)... 2024-09-13T23:00:51.798 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:51 smithi047 ceph-mon[81243]: Reconfiguring daemon osd.3 on smithi047 2024-09-13T23:00:51.837 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:51 smithi002 ceph-mon[111294]: pgmap v24: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:00:51.837 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:51 smithi002 ceph-mon[111294]: Reconfiguring osd.3 (monmap changed)... 2024-09-13T23:00:51.837 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:51 smithi002 ceph-mon[111294]: Reconfiguring daemon osd.3 on smithi047 2024-09-13T23:00:53.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:52 smithi047 ceph-mon[81243]: pgmap v25: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-13T23:00:53.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:52 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:53.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:52 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:53.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:52 smithi047 ceph-mon[81243]: Reconfiguring osd.4 (monmap changed)... 2024-09-13T23:00:53.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:52 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T23:00:53.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:52 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:53.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:52 smithi047 ceph-mon[81243]: Reconfiguring daemon osd.4 on smithi047 2024-09-13T23:00:53.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:52 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:00:53.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:52 smithi002 ceph-mon[111294]: pgmap v25: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-13T23:00:53.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:52 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:53.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:52 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:53.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:52 smithi002 ceph-mon[111294]: Reconfiguring osd.4 (monmap changed)... 2024-09-13T23:00:53.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:52 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T23:00:53.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:52 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:53.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:52 smithi002 ceph-mon[111294]: Reconfiguring daemon osd.4 on smithi047 2024-09-13T23:00:53.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:52 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:00:54.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:54 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:54.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:54 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:54.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:54 smithi002 ceph-mon[111294]: Reconfiguring osd.5 (monmap changed)... 2024-09-13T23:00:54.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:54 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T23:00:54.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:54 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:54.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:54 smithi002 ceph-mon[111294]: Reconfiguring daemon osd.5 on smithi047 2024-09-13T23:00:54.574 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:54 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:54.574 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:54 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:54.574 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:54 smithi047 ceph-mon[81243]: Reconfiguring osd.5 (monmap changed)... 2024-09-13T23:00:54.574 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:54 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T23:00:54.574 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:54 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:54.575 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:54 smithi047 ceph-mon[81243]: Reconfiguring daemon osd.5 on smithi047 2024-09-13T23:00:55.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:55 smithi047 ceph-mon[81243]: pgmap v26: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:00:55.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:55 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:55.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:55 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:55.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:55 smithi047 ceph-mon[81243]: Reconfiguring mds.cephfs.smithi047.gxzkha (monmap changed)... 2024-09-13T23:00:55.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:55 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.gxzkha", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:00:55.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:55 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:55.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:55 smithi047 ceph-mon[81243]: Reconfiguring daemon mds.cephfs.smithi047.gxzkha on smithi047 2024-09-13T23:00:55.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:55 smithi002 ceph-mon[111294]: pgmap v26: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:00:55.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:55 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:55.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:55 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:55.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:55 smithi002 ceph-mon[111294]: Reconfiguring mds.cephfs.smithi047.gxzkha (monmap changed)... 2024-09-13T23:00:55.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:55 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.gxzkha", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:00:55.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:55 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:55.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:55 smithi002 ceph-mon[111294]: Reconfiguring daemon mds.cephfs.smithi047.gxzkha on smithi047 2024-09-13T23:00:57.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:57 smithi047 ceph-mon[81243]: pgmap v27: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-09-13T23:00:57.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:57 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:57.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:57 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:57.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:57 smithi047 ceph-mon[81243]: Reconfiguring mds.cephfs.smithi047.nqvveh (monmap changed)... 2024-09-13T23:00:57.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:57 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.nqvveh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:00:57.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:57 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:57.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:57 smithi047 ceph-mon[81243]: Reconfiguring daemon mds.cephfs.smithi047.nqvveh on smithi047 2024-09-13T23:00:57.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:57 smithi002 ceph-mon[111294]: pgmap v27: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-09-13T23:00:57.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:57 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:57.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:57 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:57.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:57 smithi002 ceph-mon[111294]: Reconfiguring mds.cephfs.smithi047.nqvveh (monmap changed)... 2024-09-13T23:00:57.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:57 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.nqvveh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:00:57.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:57 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:57.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:57 smithi002 ceph-mon[111294]: Reconfiguring daemon mds.cephfs.smithi047.nqvveh on smithi047 2024-09-13T23:00:58.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:58 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:58.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:58 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:58.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:58 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:00:58.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:58 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:00:58.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:58 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:00:58.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:58 smithi047 ceph-mon[81243]: Upgrade: Setting container_image for all mon 2024-09-13T23:00:58.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:58 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:58.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:58 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi002"}]: dispatch 2024-09-13T23:00:58.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:58 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi002"}]': finished 2024-09-13T23:00:58.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:58 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi047"}]: dispatch 2024-09-13T23:00:58.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:58 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi047"}]': finished 2024-09-13T23:00:58.721 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:58 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:58.721 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:58 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:58.721 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:58 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:00:58.721 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:58 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:00:58.721 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:58 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:00:58.721 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:58 smithi002 ceph-mon[111294]: Upgrade: Setting container_image for all mon 2024-09-13T23:00:58.721 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:58 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:58.721 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:58 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi002"}]: dispatch 2024-09-13T23:00:58.721 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:58 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi002"}]': finished 2024-09-13T23:00:58.722 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:58 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi047"}]: dispatch 2024-09-13T23:00:58.722 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:58 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi047"}]': finished 2024-09-13T23:00:59.968 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:59 smithi047 ceph-mon[81243]: pgmap v28: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-13T23:00:59.968 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:59 smithi047 ceph-mon[81243]: Upgrade: Updating crash.smithi002 (1/2) 2024-09-13T23:00:59.968 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:59 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:00:59.969 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:59 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T23:00:59.969 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:59 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:00:59.969 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:00:59 smithi047 ceph-mon[81243]: Deploying daemon crash.smithi002 on smithi002 2024-09-13T23:01:00.110 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:59 smithi002 ceph-mon[111294]: pgmap v28: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-13T23:01:00.110 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:59 smithi002 ceph-mon[111294]: Upgrade: Updating crash.smithi002 (1/2) 2024-09-13T23:01:00.111 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:59 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:00.111 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:59 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T23:01:00.111 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:59 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:00.111 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:00:59 smithi002 ceph-mon[111294]: Deploying daemon crash.smithi002 on smithi002 2024-09-13T23:01:00.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.271+0000 7f3280e23700 1 -- 172.21.15.2:0/3229133669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f327c0ffc20 msgr2=0x7f327c100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:00.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.272+0000 7f3280e23700 1 --2- 172.21.15.2:0/3229133669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f327c0ffc20 0x7f327c100080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3264009910 tx=0x7f3264009c20 comp rx=0 tx=0).stop 2024-09-13T23:01:00.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.272+0000 7f3280e23700 1 -- 172.21.15.2:0/3229133669 shutdown_connections 2024-09-13T23:01:00.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.272+0000 7f3280e23700 1 --2- 172.21.15.2:0/3229133669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f327c0ffc20 0x7f327c100080 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:00.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.272+0000 7f3280e23700 1 --2- 172.21.15.2:0/3229133669 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f327c105bd0 0x7f327c105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:00.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.272+0000 7f3280e23700 1 -- 172.21.15.2:0/3229133669 >> 172.21.15.2:0/3229133669 conn(0x7f327c075670 msgr2=0x7f327c075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:00.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.272+0000 7f3280e23700 1 -- 172.21.15.2:0/3229133669 shutdown_connections 2024-09-13T23:01:00.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.272+0000 7f3280e23700 1 -- 172.21.15.2:0/3229133669 wait complete. 2024-09-13T23:01:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.273+0000 7f3280e23700 1 Processor -- start 2024-09-13T23:01:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.273+0000 7f3280e23700 1 -- start start 2024-09-13T23:01:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.273+0000 7f3280e23700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f327c0ffc20 0x7f327c197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.273+0000 7f3280e23700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f327c105bd0 0x7f327c197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.273+0000 7f3280e23700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c198360 con 0x7f327c0ffc20 2024-09-13T23:01:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.273+0000 7f3280e23700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c1984d0 con 0x7f327c105bd0 2024-09-13T23:01:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.273+0000 7f327a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f327c0ffc20 0x7f327c197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.273+0000 7f327a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f327c0ffc20 0x7f327c197740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46736/0 (socket says 172.21.15.2:46736) 2024-09-13T23:01:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.273+0000 7f327a59c700 1 -- 172.21.15.2:0/2332892072 learned_addr learned my addr 172.21.15.2:0/2332892072 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:01:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.274+0000 7f3279d9b700 1 --2- 172.21.15.2:0/2332892072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f327c105bd0 0x7f327c197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.274+0000 7f327a59c700 1 -- 172.21.15.2:0/2332892072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f327c105bd0 msgr2=0x7f327c197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.274+0000 7f327a59c700 1 --2- 172.21.15.2:0/2332892072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f327c105bd0 0x7f327c197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.274+0000 7f327a59c700 1 -- 172.21.15.2:0/2332892072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32640095f0 con 0x7f327c0ffc20 2024-09-13T23:01:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.274+0000 7f3279d9b700 1 --2- 172.21.15.2:0/2332892072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f327c105bd0 0x7f327c197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:01:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.274+0000 7f327a59c700 1 --2- 172.21.15.2:0/2332892072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f327c0ffc20 0x7f327c197740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f326c00ada0 tx=0x7f326c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:00.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.274+0000 7f32737fe700 1 -- 172.21.15.2:0/2332892072 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f326c00f070 con 0x7f327c0ffc20 2024-09-13T23:01:00.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.274+0000 7f3280e23700 1 -- 172.21.15.2:0/2332892072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f327c1a07b0 con 0x7f327c0ffc20 2024-09-13T23:01:00.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.274+0000 7f3280e23700 1 -- 172.21.15.2:0/2332892072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f327c1a0d00 con 0x7f327c0ffc20 2024-09-13T23:01:00.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.274+0000 7f32737fe700 1 -- 172.21.15.2:0/2332892072 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f326c007bf0 con 0x7f327c0ffc20 2024-09-13T23:01:00.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.274+0000 7f32737fe700 1 -- 172.21.15.2:0/2332892072 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f326c005690 con 0x7f327c0ffc20 2024-09-13T23:01:00.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.275+0000 7f3280e23700 1 -- 172.21.15.2:0/2332892072 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f327c1080d0 con 0x7f327c0ffc20 2024-09-13T23:01:00.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.276+0000 7f32737fe700 1 -- 172.21.15.2:0/2332892072 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f326c005920 con 0x7f327c0ffc20 2024-09-13T23:01:00.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.277+0000 7f32737fe700 1 --2- 172.21.15.2:0/2332892072 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f326806e7c0 0x7f3268070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:00.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.277+0000 7f32737fe700 1 -- 172.21.15.2:0/2332892072 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f326c08e270 con 0x7f327c0ffc20 2024-09-13T23:01:00.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.277+0000 7f3279d9b700 1 --2- 172.21.15.2:0/2332892072 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f326806e7c0 0x7f3268070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:00.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.277+0000 7f3279d9b700 1 --2- 172.21.15.2:0/2332892072 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f326806e7c0 0x7f3268070c80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f326400b5c0 tx=0x7f3264005480 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:00.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.286+0000 7f32737fe700 1 -- 172.21.15.2:0/2332892072 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f326c0572a0 con 0x7f327c0ffc20 2024-09-13T23:01:00.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.536+0000 7f3280e23700 1 -- 172.21.15.2:0/2332892072 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f327c068cf0 con 0x7f326806e7c0 2024-09-13T23:01:00.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.538+0000 7f32737fe700 1 -- 172.21.15.2:0/2332892072 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f327c068cf0 con 0x7f326806e7c0 2024-09-13T23:01:00.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.540+0000 7f3280e23700 1 -- 172.21.15.2:0/2332892072 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f326806e7c0 msgr2=0x7f3268070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:00.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.540+0000 7f3280e23700 1 --2- 172.21.15.2:0/2332892072 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f326806e7c0 0x7f3268070c80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f326400b5c0 tx=0x7f3264005480 comp rx=0 tx=0).stop 2024-09-13T23:01:00.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.540+0000 7f3280e23700 1 -- 172.21.15.2:0/2332892072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f327c0ffc20 msgr2=0x7f327c197740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:00.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.540+0000 7f3280e23700 1 --2- 172.21.15.2:0/2332892072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f327c0ffc20 0x7f327c197740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f326c00ada0 tx=0x7f326c00c330 comp rx=0 tx=0).stop 2024-09-13T23:01:00.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.540+0000 7f3280e23700 1 -- 172.21.15.2:0/2332892072 shutdown_connections 2024-09-13T23:01:00.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.540+0000 7f3280e23700 1 --2- 172.21.15.2:0/2332892072 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f326806e7c0 0x7f3268070c80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:00.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.540+0000 7f3280e23700 1 --2- 172.21.15.2:0/2332892072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f327c0ffc20 0x7f327c197740 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:00.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.540+0000 7f3280e23700 1 --2- 172.21.15.2:0/2332892072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f327c105bd0 0x7f327c197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:00.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.540+0000 7f3280e23700 1 -- 172.21.15.2:0/2332892072 >> 172.21.15.2:0/2332892072 conn(0x7f327c075670 msgr2=0x7f327c0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:00.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.540+0000 7f3280e23700 1 -- 172.21.15.2:0/2332892072 shutdown_connections 2024-09-13T23:01:00.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.540+0000 7f3280e23700 1 -- 172.21.15.2:0/2332892072 wait complete. 2024-09-13T23:01:00.556 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T23:01:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.665+0000 7f567e1c4700 1 -- 172.21.15.2:0/3659372936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5678101de0 msgr2=0x7f56781021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.665+0000 7f567e1c4700 1 --2- 172.21.15.2:0/3659372936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5678101de0 0x7f56781021c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5668009910 tx=0x7f5668009c20 comp rx=0 tx=0).stop 2024-09-13T23:01:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.665+0000 7f567e1c4700 1 -- 172.21.15.2:0/3659372936 shutdown_connections 2024-09-13T23:01:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.665+0000 7f567e1c4700 1 --2- 172.21.15.2:0/3659372936 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5678102700 0x7f567810abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.665+0000 7f567e1c4700 1 --2- 172.21.15.2:0/3659372936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5678101de0 0x7f56781021c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.665+0000 7f567e1c4700 1 -- 172.21.15.2:0/3659372936 >> 172.21.15.2:0/3659372936 conn(0x7f56780fb650 msgr2=0x7f56780fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.665+0000 7f567e1c4700 1 -- 172.21.15.2:0/3659372936 shutdown_connections 2024-09-13T23:01:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.665+0000 7f567e1c4700 1 -- 172.21.15.2:0/3659372936 wait complete. 2024-09-13T23:01:00.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.666+0000 7f567e1c4700 1 Processor -- start 2024-09-13T23:01:00.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.666+0000 7f567e1c4700 1 -- start start 2024-09-13T23:01:00.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.667+0000 7f567e1c4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5678101de0 0x7f567819c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:00.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.667+0000 7f567e1c4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5678102700 0x7f567819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:00.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.667+0000 7f567e1c4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567819d1e0 con 0x7f5678101de0 2024-09-13T23:01:00.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.667+0000 7f567e1c4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5678196720 con 0x7f5678102700 2024-09-13T23:01:00.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.667+0000 7f56777fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5678101de0 0x7f567819c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:00.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.667+0000 7f56777fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5678101de0 0x7f567819c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46752/0 (socket says 172.21.15.2:46752) 2024-09-13T23:01:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.667+0000 7f56777fe700 1 -- 172.21.15.2:0/2300489159 learned_addr learned my addr 172.21.15.2:0/2300489159 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:01:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.667+0000 7f566effd700 1 --2- 172.21.15.2:0/2300489159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5678102700 0x7f567819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.667+0000 7f56777fe700 1 -- 172.21.15.2:0/2300489159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5678102700 msgr2=0x7f567819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.667+0000 7f56777fe700 1 --2- 172.21.15.2:0/2300489159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5678102700 0x7f567819cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.667+0000 7f56777fe700 1 -- 172.21.15.2:0/2300489159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56680095f0 con 0x7f5678101de0 2024-09-13T23:01:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.667+0000 7f56777fe700 1 --2- 172.21.15.2:0/2300489159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5678101de0 0x7f567819c6a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5668006010 tx=0x7f566800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.668+0000 7f56757fa700 1 -- 172.21.15.2:0/2300489159 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f566801d070 con 0x7f5678101de0 2024-09-13T23:01:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.668+0000 7f56757fa700 1 -- 172.21.15.2:0/2300489159 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f566800f460 con 0x7f5678101de0 2024-09-13T23:01:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.668+0000 7f56757fa700 1 -- 172.21.15.2:0/2300489159 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5668017630 con 0x7f5678101de0 2024-09-13T23:01:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.668+0000 7f567e1c4700 1 -- 172.21.15.2:0/2300489159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56781969a0 con 0x7f5678101de0 2024-09-13T23:01:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.668+0000 7f567e1c4700 1 -- 172.21.15.2:0/2300489159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5678196e90 con 0x7f5678101de0 2024-09-13T23:01:00.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.669+0000 7f567e1c4700 1 -- 172.21.15.2:0/2300489159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56781082f0 con 0x7f5678101de0 2024-09-13T23:01:00.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.669+0000 7f56757fa700 1 -- 172.21.15.2:0/2300489159 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f566800f5d0 con 0x7f5678101de0 2024-09-13T23:01:00.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.670+0000 7f56757fa700 1 --2- 172.21.15.2:0/2300489159 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f566406e7c0 0x7f5664070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:00.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.670+0000 7f56757fa700 1 -- 172.21.15.2:0/2300489159 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f566808fc80 con 0x7f5678101de0 2024-09-13T23:01:00.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.670+0000 7f566effd700 1 --2- 172.21.15.2:0/2300489159 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f566406e7c0 0x7f5664070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:00.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.670+0000 7f566effd700 1 --2- 172.21.15.2:0/2300489159 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f566406e7c0 0x7f5664070c80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5678197b90 tx=0x7f566000a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:00.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.674+0000 7f56757fa700 1 -- 172.21.15.2:0/2300489159 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f566805c860 con 0x7f5678101de0 2024-09-13T23:01:00.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.912+0000 7f567e1c4700 1 -- 172.21.15.2:0/2300489159 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5678197d40 con 0x7f566406e7c0 2024-09-13T23:01:00.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.913+0000 7f56757fa700 1 -- 172.21.15.2:0/2300489159 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f5678197d40 con 0x7f566406e7c0 2024-09-13T23:01:00.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.915+0000 7f567e1c4700 1 -- 172.21.15.2:0/2300489159 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f566406e7c0 msgr2=0x7f5664070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.915+0000 7f567e1c4700 1 --2- 172.21.15.2:0/2300489159 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f566406e7c0 0x7f5664070c80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5678197b90 tx=0x7f566000a2d0 comp rx=0 tx=0).stop 2024-09-13T23:01:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.915+0000 7f567e1c4700 1 -- 172.21.15.2:0/2300489159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5678101de0 msgr2=0x7f567819c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.915+0000 7f567e1c4700 1 --2- 172.21.15.2:0/2300489159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5678101de0 0x7f567819c6a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5668006010 tx=0x7f566800bd70 comp rx=0 tx=0).stop 2024-09-13T23:01:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.916+0000 7f567e1c4700 1 -- 172.21.15.2:0/2300489159 shutdown_connections 2024-09-13T23:01:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.916+0000 7f567e1c4700 1 --2- 172.21.15.2:0/2300489159 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f566406e7c0 0x7f5664070c80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.916+0000 7f567e1c4700 1 --2- 172.21.15.2:0/2300489159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5678101de0 0x7f567819c6a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.916+0000 7f567e1c4700 1 --2- 172.21.15.2:0/2300489159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5678102700 0x7f567819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.916+0000 7f567e1c4700 1 -- 172.21.15.2:0/2300489159 >> 172.21.15.2:0/2300489159 conn(0x7f56780fb650 msgr2=0x7f5678105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:00.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.916+0000 7f567e1c4700 1 -- 172.21.15.2:0/2300489159 shutdown_connections 2024-09-13T23:01:00.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:00.916+0000 7f567e1c4700 1 -- 172.21.15.2:0/2300489159 wait complete. 2024-09-13T23:01:01.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.025+0000 7f48e7258700 1 -- 172.21.15.2:0/984776837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e01006b0 msgr2=0x7f48e0100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:01.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.025+0000 7f48e7258700 1 --2- 172.21.15.2:0/984776837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e01006b0 0x7f48e0100a90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009910 tx=0x7f48d4009c20 comp rx=0 tx=0).stop 2024-09-13T23:01:01.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.025+0000 7f48e7258700 1 -- 172.21.15.2:0/984776837 shutdown_connections 2024-09-13T23:01:01.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.025+0000 7f48e7258700 1 --2- 172.21.15.2:0/984776837 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e0101060 0x7f48e01047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:01.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.025+0000 7f48e7258700 1 --2- 172.21.15.2:0/984776837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e01006b0 0x7f48e0100a90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:01.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.025+0000 7f48e7258700 1 -- 172.21.15.2:0/984776837 >> 172.21.15.2:0/984776837 conn(0x7f48e0074e30 msgr2=0x7f48e0075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:01.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.026+0000 7f48e7258700 1 -- 172.21.15.2:0/984776837 shutdown_connections 2024-09-13T23:01:01.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.026+0000 7f48e7258700 1 -- 172.21.15.2:0/984776837 wait complete. 2024-09-13T23:01:01.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.026+0000 7f48e7258700 1 Processor -- start 2024-09-13T23:01:01.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.026+0000 7f48e7258700 1 -- start start 2024-09-13T23:01:01.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.026+0000 7f48e7258700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e01006b0 0x7f48e0101850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:01.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.026+0000 7f48e7258700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e0101060 0x7f48e0101d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:01.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.027+0000 7f48e7258700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e01022d0 con 0x7f48e01006b0 2024-09-13T23:01:01.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.027+0000 7f48e7258700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0102410 con 0x7f48e0101060 2024-09-13T23:01:01.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.027+0000 7f48e4ff4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e01006b0 0x7f48e0101850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:01.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.027+0000 7f48e4ff4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e01006b0 0x7f48e0101850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46758/0 (socket says 172.21.15.2:46758) 2024-09-13T23:01:01.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.027+0000 7f48e4ff4700 1 -- 172.21.15.2:0/3507090362 learned_addr learned my addr 172.21.15.2:0/3507090362 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:01:01.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.027+0000 7f48dffff700 1 --2- 172.21.15.2:0/3507090362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e0101060 0x7f48e0101d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:01.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.027+0000 7f48e4ff4700 1 -- 172.21.15.2:0/3507090362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e0101060 msgr2=0x7f48e0101d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:01.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.027+0000 7f48e4ff4700 1 --2- 172.21.15.2:0/3507090362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e0101060 0x7f48e0101d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:01.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.027+0000 7f48e4ff4700 1 -- 172.21.15.2:0/3507090362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d40095f0 con 0x7f48e01006b0 2024-09-13T23:01:01.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.027+0000 7f48dffff700 1 --2- 172.21.15.2:0/3507090362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e0101060 0x7f48e0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:01:01.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.027+0000 7f48e4ff4700 1 --2- 172.21.15.2:0/3507090362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e01006b0 0x7f48e0101850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48d4005f50 tx=0x7f48d400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:01.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.027+0000 7f48ddffb700 1 -- 172.21.15.2:0/3507090362 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48d401d070 con 0x7f48e01006b0 2024-09-13T23:01:01.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.027+0000 7f48ddffb700 1 -- 172.21.15.2:0/3507090362 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f48d400b610 con 0x7f48e01006b0 2024-09-13T23:01:01.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.027+0000 7f48e7258700 1 -- 172.21.15.2:0/3507090362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e0102690 con 0x7f48e01006b0 2024-09-13T23:01:01.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.027+0000 7f48ddffb700 1 -- 172.21.15.2:0/3507090362 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48d4022470 con 0x7f48e01006b0 2024-09-13T23:01:01.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.028+0000 7f48e7258700 1 -- 172.21.15.2:0/3507090362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e01a2d50 con 0x7f48e01006b0 2024-09-13T23:01:01.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.028+0000 7f48e7258700 1 -- 172.21.15.2:0/3507090362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e0109130 con 0x7f48e01006b0 2024-09-13T23:01:01.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.029+0000 7f48ddffb700 1 -- 172.21.15.2:0/3507090362 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f48d400fca0 con 0x7f48e01006b0 2024-09-13T23:01:01.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.029+0000 7f48ddffb700 1 --2- 172.21.15.2:0/3507090362 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f48d006e7c0 0x7f48d0070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:01.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.030+0000 7f48ddffb700 1 -- 172.21.15.2:0/3507090362 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f48d408fcb0 con 0x7f48e01006b0 2024-09-13T23:01:01.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.030+0000 7f48dffff700 1 --2- 172.21.15.2:0/3507090362 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f48d006e7c0 0x7f48d0070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:01.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.030+0000 7f48dffff700 1 --2- 172.21.15.2:0/3507090362 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f48d006e7c0 0x7f48d0070c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f48e0103040 tx=0x7f48cc009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:01.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.034+0000 7f48ddffb700 1 -- 172.21.15.2:0/3507090362 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f48d4058cc0 con 0x7f48e01006b0 2024-09-13T23:01:01.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.256+0000 7f48e7258700 1 -- 172.21.15.2:0/3507090362 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f48e00611d0 con 0x7f48d006e7c0 2024-09-13T23:01:01.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.266+0000 7f48ddffb700 1 -- 172.21.15.2:0/3507090362 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f48e00611d0 con 0x7f48d006e7c0 2024-09-13T23:01:01.267 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:01:01.267 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (2m) 48s ago 13m 16.5M - 0.25.0 c8568f914cd2 f570a73274bc 2024-09-13T23:01:01.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (13m) 48s ago 13m 7982k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T23:01:01.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (12m) 33s ago 12m 7990k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T23:01:01.267 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (13m) 48s ago 13m 6669k - 18.2.1 5be31c24972a de910e0c5157 2024-09-13T23:01:01.267 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (12m) 33s ago 12m 6656k - 18.2.1 5be31c24972a 9f4bcfa66588 2024-09-13T23:01:01.267 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (2m) 48s ago 13m 76.4M - 9.4.12 2bacad6d85d8 650673516b69 2024-09-13T23:01:01.268 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (7m) 48s ago 7m 15.8M - 18.2.1 5be31c24972a 59e9c88c31ca 2024-09-13T23:01:01.268 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (7m) 48s ago 7m 90.9M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T23:01:01.268 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (7m) 33s ago 7m 150M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T23:01:01.268 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (7m) 33s ago 7m 18.6M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T23:01:01.268 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 running (4m) 48s ago 14m 473M - 19.1.1-324-gecab7be5 0652ff2b5d78 7a8aa9de37e4 2024-09-13T23:01:01.268 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (3m) 33s ago 12m 438M - 19.1.1-324-gecab7be5 0652ff2b5d78 13fa6f3b5a8a 2024-09-13T23:01:01.268 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (61s) 48s ago 14m 30.0M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 db0ef6c509cf 2024-09-13T23:01:01.268 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (38s) 33s ago 12m 25.9M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 ea0c2a2e0e1a 2024-09-13T23:01:01.268 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (3m) 48s ago 13m 14.9M - 1.5.0 0da6a335fe13 f3eae5f90ab8 2024-09-13T23:01:01.268 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (3m) 33s ago 12m 15.8M - 1.5.0 0da6a335fe13 a5c7d7f1eaa5 2024-09-13T23:01:01.268 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (11m) 48s ago 11m 209M 1217M 18.2.1 5be31c24972a 1e1f6936c402 2024-09-13T23:01:01.268 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (11m) 48s ago 11m 227M 1217M 18.2.1 5be31c24972a f0ac78c34831 2024-09-13T23:01:01.268 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (10m) 48s ago 10m 188M 1217M 18.2.1 5be31c24972a 9a2f4f6decfb 2024-09-13T23:01:01.269 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (10m) 33s ago 10m 260M 2241M 18.2.1 5be31c24972a fb455cc4c571 2024-09-13T23:01:01.269 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (9m) 33s ago 9m 222M 2241M 18.2.1 5be31c24972a f1bdc2c50535 2024-09-13T23:01:01.269 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (9m) 33s ago 9m 198M 2241M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T23:01:01.269 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (2m) 48s ago 12m 70.3M - 2.43.0 a07b618ecd1d aa241d1048de 2024-09-13T23:01:01.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.268+0000 7f48e7258700 1 -- 172.21.15.2:0/3507090362 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f48d006e7c0 msgr2=0x7f48d0070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:01.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.268+0000 7f48e7258700 1 --2- 172.21.15.2:0/3507090362 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f48d006e7c0 0x7f48d0070c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f48e0103040 tx=0x7f48cc009260 comp rx=0 tx=0).stop 2024-09-13T23:01:01.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.268+0000 7f48e7258700 1 -- 172.21.15.2:0/3507090362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e01006b0 msgr2=0x7f48e0101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:01.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.268+0000 7f48e7258700 1 --2- 172.21.15.2:0/3507090362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e01006b0 0x7f48e0101850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48d4005f50 tx=0x7f48d400f740 comp rx=0 tx=0).stop 2024-09-13T23:01:01.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.268+0000 7f48e7258700 1 -- 172.21.15.2:0/3507090362 shutdown_connections 2024-09-13T23:01:01.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.268+0000 7f48e7258700 1 --2- 172.21.15.2:0/3507090362 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f48d006e7c0 0x7f48d0070c80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:01.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.268+0000 7f48e7258700 1 --2- 172.21.15.2:0/3507090362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e01006b0 0x7f48e0101850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:01.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.268+0000 7f48e7258700 1 --2- 172.21.15.2:0/3507090362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48e0101060 0x7f48e0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:01.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.268+0000 7f48e7258700 1 -- 172.21.15.2:0/3507090362 >> 172.21.15.2:0/3507090362 conn(0x7f48e0074e30 msgr2=0x7f48e0103c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:01.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.268+0000 7f48e7258700 1 -- 172.21.15.2:0/3507090362 shutdown_connections 2024-09-13T23:01:01.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.268+0000 7f48e7258700 1 -- 172.21.15.2:0/3507090362 wait complete. 2024-09-13T23:01:01.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.382+0000 7f7e4eb94700 1 -- 172.21.15.2:0/3000452754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e48068580 msgr2=0x7f7e480689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:01.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.382+0000 7f7e4eb94700 1 --2- 172.21.15.2:0/3000452754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e48068580 0x7f7e480689e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009910 tx=0x7f7e34009c20 comp rx=0 tx=0).stop 2024-09-13T23:01:01.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.382+0000 7f7e4eb94700 1 -- 172.21.15.2:0/3000452754 shutdown_connections 2024-09-13T23:01:01.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.382+0000 7f7e4eb94700 1 --2- 172.21.15.2:0/3000452754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e48068580 0x7f7e480689e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:01.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.382+0000 7f7e4eb94700 1 --2- 172.21.15.2:0/3000452754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e48106cd0 0x7f7e481070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:01.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.382+0000 7f7e4eb94700 1 -- 172.21.15.2:0/3000452754 >> 172.21.15.2:0/3000452754 conn(0x7f7e48075670 msgr2=0x7f7e48075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:01.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.382+0000 7f7e4eb94700 1 -- 172.21.15.2:0/3000452754 shutdown_connections 2024-09-13T23:01:01.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.382+0000 7f7e4eb94700 1 -- 172.21.15.2:0/3000452754 wait complete. 2024-09-13T23:01:01.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.382+0000 7f7e4eb94700 1 Processor -- start 2024-09-13T23:01:01.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.382+0000 7f7e4eb94700 1 -- start start 2024-09-13T23:01:01.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.383+0000 7f7e4eb94700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e48068580 0x7f7e4819c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:01.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.383+0000 7f7e4eb94700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e48106cd0 0x7f7e4819cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:01.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.383+0000 7f7e4eb94700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4819d200 con 0x7f7e48068580 2024-09-13T23:01:01.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.383+0000 7f7e4eb94700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e481966b0 con 0x7f7e48106cd0 2024-09-13T23:01:01.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.383+0000 7f7e4c930700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e48068580 0x7f7e4819c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:01.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.383+0000 7f7e4c930700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e48068580 0x7f7e4819c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46772/0 (socket says 172.21.15.2:46772) 2024-09-13T23:01:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.383+0000 7f7e4c930700 1 -- 172.21.15.2:0/1396570481 learned_addr learned my addr 172.21.15.2:0/1396570481 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:01:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.383+0000 7f7e47fff700 1 --2- 172.21.15.2:0/1396570481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e48106cd0 0x7f7e4819cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.383+0000 7f7e4c930700 1 -- 172.21.15.2:0/1396570481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e48106cd0 msgr2=0x7f7e4819cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.383+0000 7f7e4c930700 1 --2- 172.21.15.2:0/1396570481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e48106cd0 0x7f7e4819cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.383+0000 7f7e4c930700 1 -- 172.21.15.2:0/1396570481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e340095f0 con 0x7f7e48068580 2024-09-13T23:01:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.383+0000 7f7e4c930700 1 --2- 172.21.15.2:0/1396570481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e48068580 0x7f7e4819c630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00d8d0 tx=0x7f7e3c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.383+0000 7f7e45ffb700 1 -- 172.21.15.2:0/1396570481 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e3c0098a0 con 0x7f7e48068580 2024-09-13T23:01:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.384+0000 7f7e45ffb700 1 -- 172.21.15.2:0/1396570481 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e3c010460 con 0x7f7e48068580 2024-09-13T23:01:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.384+0000 7f7e45ffb700 1 -- 172.21.15.2:0/1396570481 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e3c00f5f0 con 0x7f7e48068580 2024-09-13T23:01:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.384+0000 7f7e4eb94700 1 -- 172.21.15.2:0/1396570481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e48196990 con 0x7f7e48068580 2024-09-13T23:01:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.384+0000 7f7e4eb94700 1 -- 172.21.15.2:0/1396570481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e48196ee0 con 0x7f7e48068580 2024-09-13T23:01:01.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.385+0000 7f7e45ffb700 1 -- 172.21.15.2:0/1396570481 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f7e3c009a00 con 0x7f7e48068580 2024-09-13T23:01:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.385+0000 7f7e4eb94700 1 -- 172.21.15.2:0/1396570481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e481091d0 con 0x7f7e48068580 2024-09-13T23:01:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.386+0000 7f7e45ffb700 1 --2- 172.21.15.2:0/1396570481 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f7e3806e7b0 0x7f7e38070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.386+0000 7f7e45ffb700 1 -- 172.21.15.2:0/1396570481 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7e3c08e620 con 0x7f7e48068580 2024-09-13T23:01:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.386+0000 7f7e47fff700 1 --2- 172.21.15.2:0/1396570481 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f7e3806e7b0 0x7f7e38070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:01.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.386+0000 7f7e47fff700 1 --2- 172.21.15.2:0/1396570481 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f7e3806e7b0 0x7f7e38070c70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7e480fe200 tx=0x7f7e3401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.390+0000 7f7e45ffb700 1 -- 172.21.15.2:0/1396570481 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7e3c05b200 con 0x7f7e48068580 2024-09-13T23:01:01.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.700+0000 7f7e4eb94700 1 -- 172.21.15.2:0/1396570481 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7e4804f2e0 con 0x7f7e48068580 2024-09-13T23:01:01.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.701+0000 7f7e45ffb700 1 -- 172.21.15.2:0/1396570481 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+694 (secure 0 0 0) 0x7f7e3c05ad90 con 0x7f7e48068580 2024-09-13T23:01:01.702 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:01:01.702 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T23:01:01.702 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:01:01.702 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:01:01.703 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T23:01:01.703 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:01:01.703 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:01:01.703 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T23:01:01.703 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-09-13T23:01:01.703 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:01:01.703 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T23:01:01.703 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-13T23:01:01.703 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:01:01.703 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T23:01:01.703 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 10, 2024-09-13T23:01:01.703 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T23:01:01.703 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T23:01:01.704 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:01:01.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.703+0000 7f7e4eb94700 1 -- 172.21.15.2:0/1396570481 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f7e3806e7b0 msgr2=0x7f7e38070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:01.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.703+0000 7f7e4eb94700 1 --2- 172.21.15.2:0/1396570481 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f7e3806e7b0 0x7f7e38070c70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7e480fe200 tx=0x7f7e3401a040 comp rx=0 tx=0).stop 2024-09-13T23:01:01.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.703+0000 7f7e4eb94700 1 -- 172.21.15.2:0/1396570481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e48068580 msgr2=0x7f7e4819c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:01.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.703+0000 7f7e4eb94700 1 --2- 172.21.15.2:0/1396570481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e48068580 0x7f7e4819c630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00d8d0 tx=0x7f7e3c00dbe0 comp rx=0 tx=0).stop 2024-09-13T23:01:01.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.703+0000 7f7e4eb94700 1 -- 172.21.15.2:0/1396570481 shutdown_connections 2024-09-13T23:01:01.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.703+0000 7f7e4eb94700 1 --2- 172.21.15.2:0/1396570481 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f7e3806e7b0 0x7f7e38070c70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:01.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.703+0000 7f7e4eb94700 1 --2- 172.21.15.2:0/1396570481 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e48068580 0x7f7e4819c630 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:01.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.703+0000 7f7e4eb94700 1 --2- 172.21.15.2:0/1396570481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e48106cd0 0x7f7e4819cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:01.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.703+0000 7f7e4eb94700 1 -- 172.21.15.2:0/1396570481 >> 172.21.15.2:0/1396570481 conn(0x7f7e48075670 msgr2=0x7f7e480feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:01.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.704+0000 7f7e4eb94700 1 -- 172.21.15.2:0/1396570481 shutdown_connections 2024-09-13T23:01:01.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.704+0000 7f7e4eb94700 1 -- 172.21.15.2:0/1396570481 wait complete. 2024-09-13T23:01:01.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.831+0000 7f2847305700 1 -- 172.21.15.2:0/3726084031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2840105bf0 msgr2=0x7f2840105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:01.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.831+0000 7f2847305700 1 --2- 172.21.15.2:0/3726084031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2840105bf0 0x7f2840105fd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f283c009910 tx=0x7f283c009c20 comp rx=0 tx=0).stop 2024-09-13T23:01:01.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.831+0000 7f2847305700 1 -- 172.21.15.2:0/3726084031 shutdown_connections 2024-09-13T23:01:01.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.831+0000 7f2847305700 1 --2- 172.21.15.2:0/3726084031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28400ffb40 0x7f28400fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:01.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.831+0000 7f2847305700 1 --2- 172.21.15.2:0/3726084031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2840105bf0 0x7f2840105fd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:01.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.831+0000 7f2847305700 1 -- 172.21.15.2:0/3726084031 >> 172.21.15.2:0/3726084031 conn(0x7f28400fb610 msgr2=0x7f28400fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:01.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.831+0000 7f2847305700 1 -- 172.21.15.2:0/3726084031 shutdown_connections 2024-09-13T23:01:01.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.831+0000 7f2847305700 1 -- 172.21.15.2:0/3726084031 wait complete. 2024-09-13T23:01:01.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.832+0000 7f2847305700 1 Processor -- start 2024-09-13T23:01:01.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.832+0000 7f2847305700 1 -- start start 2024-09-13T23:01:01.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.832+0000 7f2847305700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28400ffb40 0x7f284019b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:01.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.832+0000 7f2847305700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2840105bf0 0x7f284019ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:01.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.832+0000 7f2847305700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284019c0f0 con 0x7f2840105bf0 2024-09-13T23:01:01.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.832+0000 7f2847305700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28401955a0 con 0x7f28400ffb40 2024-09-13T23:01:01.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.832+0000 7f28448a0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2840105bf0 0x7f284019ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:01.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.832+0000 7f28448a0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2840105bf0 0x7f284019ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46798/0 (socket says 172.21.15.2:46798) 2024-09-13T23:01:01.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.832+0000 7f28448a0700 1 -- 172.21.15.2:0/3607424682 learned_addr learned my addr 172.21.15.2:0/3607424682 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:01:01.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.833+0000 7f28450a1700 1 --2- 172.21.15.2:0/3607424682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28400ffb40 0x7f284019b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:01.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.833+0000 7f28448a0700 1 -- 172.21.15.2:0/3607424682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28400ffb40 msgr2=0x7f284019b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:01.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.833+0000 7f28448a0700 1 --2- 172.21.15.2:0/3607424682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28400ffb40 0x7f284019b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:01.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.833+0000 7f28448a0700 1 -- 172.21.15.2:0/3607424682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c0095f0 con 0x7f2840105bf0 2024-09-13T23:01:01.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.833+0000 7f28448a0700 1 --2- 172.21.15.2:0/3607424682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2840105bf0 0x7f284019ba60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f283000d900 tx=0x7f283000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:01.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.833+0000 7f28367fc700 1 -- 172.21.15.2:0/3607424682 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28300041f0 con 0x7f2840105bf0 2024-09-13T23:01:01.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.833+0000 7f28367fc700 1 -- 172.21.15.2:0/3607424682 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2830004cf0 con 0x7f2840105bf0 2024-09-13T23:01:01.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.833+0000 7f2847305700 1 -- 172.21.15.2:0/3607424682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2840195880 con 0x7f2840105bf0 2024-09-13T23:01:01.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.833+0000 7f2847305700 1 -- 172.21.15.2:0/3607424682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2840195dd0 con 0x7f2840105bf0 2024-09-13T23:01:01.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.833+0000 7f28367fc700 1 -- 172.21.15.2:0/3607424682 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f283000b750 con 0x7f2840105bf0 2024-09-13T23:01:01.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.835+0000 7f2847305700 1 -- 172.21.15.2:0/3607424682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2824005320 con 0x7f2840105bf0 2024-09-13T23:01:01.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.835+0000 7f28367fc700 1 -- 172.21.15.2:0/3607424682 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f2830004350 con 0x7f2840105bf0 2024-09-13T23:01:01.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.836+0000 7f28367fc700 1 --2- 172.21.15.2:0/3607424682 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f282c0709c0 0x7f282c072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:01.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.836+0000 7f28450a1700 1 --2- 172.21.15.2:0/3607424682 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f282c0709c0 0x7f282c072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:01.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.836+0000 7f28367fc700 1 -- 172.21.15.2:0/3607424682 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f283008e500 con 0x7f2840105bf0 2024-09-13T23:01:01.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.836+0000 7f28450a1700 1 --2- 172.21.15.2:0/3607424682 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f282c0709c0 0x7f282c072e80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f283c006010 tx=0x7f283c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:01.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:01.840+0000 7f28367fc700 1 -- 172.21.15.2:0/3607424682 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f283005b0e0 con 0x7f2840105bf0 2024-09-13T23:01:01.928 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:01 smithi002 ceph-mon[111294]: pgmap v29: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:01:01.928 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:01 smithi002 ceph-mon[111294]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:01.928 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:01 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/1396570481' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:01:02.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.101+0000 7f2847305700 1 -- 172.21.15.2:0/3607424682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2824005cc0 con 0x7f2840105bf0 2024-09-13T23:01:02.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.101+0000 7f28367fc700 1 -- 172.21.15.2:0/3607424682 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1938 (secure 0 0 0) 0x7f28300167b0 con 0x7f2840105bf0 2024-09-13T23:01:02.102 INFO:teuthology.orchestra.run.smithi002.stdout:e16 2024-09-13T23:01:02.102 INFO:teuthology.orchestra.run.smithi002.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T23:01:02.102 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:01:02.103 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:01:02.103 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-13T23:01:02.103 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:01:02.103 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:01:02.103 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-13T23:01:02.103 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 16 2024-09-13T23:01:02.103 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:01:02.103 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-13T22:53:05.963265+0000 2024-09-13T23:01:02.103 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-13T22:53:25.072026+0000 2024-09-13T23:01:02.103 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-13T23:01:02.103 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-13T23:01:02.103 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-13T23:01:02.103 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-13T23:01:02.103 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-13T23:01:02.104 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-13T23:01:02.104 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-13T23:01:02.104 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-13T23:01:02.104 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 47 2024-09-13T23:01:02.104 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:01:02.104 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 1 2024-09-13T23:01:02.104 INFO:teuthology.orchestra.run.smithi002.stdout:in 0 2024-09-13T23:01:02.104 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24267} 2024-09-13T23:01:02.104 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-13T23:01:02.104 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-13T23:01:02.104 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-13T23:01:02.104 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-13T23:01:02.105 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-13T23:01:02.105 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-13T23:01:02.105 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-13T23:01:02.105 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-13T23:01:02.105 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-13T23:01:02.105 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 0 members: 2024-09-13T23:01:02.105 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.gxzkha{0:24267} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:01:02.105 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.gglyyr{0:14488} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.2:6828/2123560657,v1:172.21.15.2:6829/2123560657] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:01:02.105 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:01:02.105 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:01:02.105 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-13T23:01:02.105 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:01:02.105 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.auedll{-1:14500} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/1577962179,v1:172.21.15.2:6827/1577962179] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:01:02.105 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.nqvveh{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:01:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.103+0000 7f2847305700 1 -- 172.21.15.2:0/3607424682 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f282c0709c0 msgr2=0x7f282c072e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.103+0000 7f2847305700 1 --2- 172.21.15.2:0/3607424682 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f282c0709c0 0x7f282c072e80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f283c006010 tx=0x7f283c01a040 comp rx=0 tx=0).stop 2024-09-13T23:01:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.103+0000 7f2847305700 1 -- 172.21.15.2:0/3607424682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2840105bf0 msgr2=0x7f284019ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.103+0000 7f2847305700 1 --2- 172.21.15.2:0/3607424682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2840105bf0 0x7f284019ba60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f283000d900 tx=0x7f283000dc10 comp rx=0 tx=0).stop 2024-09-13T23:01:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.103+0000 7f2847305700 1 -- 172.21.15.2:0/3607424682 shutdown_connections 2024-09-13T23:01:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.103+0000 7f2847305700 1 --2- 172.21.15.2:0/3607424682 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f282c0709c0 0x7f282c072e80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.103+0000 7f2847305700 1 --2- 172.21.15.2:0/3607424682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28400ffb40 0x7f284019b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.103+0000 7f2847305700 1 --2- 172.21.15.2:0/3607424682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2840105bf0 0x7f284019ba60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.103+0000 7f2847305700 1 -- 172.21.15.2:0/3607424682 >> 172.21.15.2:0/3607424682 conn(0x7f28400fb610 msgr2=0x7f28400fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.103+0000 7f2847305700 1 -- 172.21.15.2:0/3607424682 shutdown_connections 2024-09-13T23:01:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.103+0000 7f2847305700 1 -- 172.21.15.2:0/3607424682 wait complete. 2024-09-13T23:01:02.107 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2024-09-13T23:01:02.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:01 smithi047 ceph-mon[81243]: pgmap v29: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:01:02.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:01 smithi047 ceph-mon[81243]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:02.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:01 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/1396570481' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:01:02.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.213+0000 7f413f526700 1 -- 172.21.15.2:0/2683382023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4138102780 msgr2=0x7f413810ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:02.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.213+0000 7f413f526700 1 --2- 172.21.15.2:0/2683382023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4138102780 0x7f413810ac70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4128009910 tx=0x7f4128009c20 comp rx=0 tx=0).stop 2024-09-13T23:01:02.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.213+0000 7f413f526700 1 -- 172.21.15.2:0/2683382023 shutdown_connections 2024-09-13T23:01:02.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.213+0000 7f413f526700 1 --2- 172.21.15.2:0/2683382023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4138102780 0x7f413810ac70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:02.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.213+0000 7f413f526700 1 --2- 172.21.15.2:0/2683382023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4138101e60 0x7f4138102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:02.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.213+0000 7f413f526700 1 -- 172.21.15.2:0/2683382023 >> 172.21.15.2:0/2683382023 conn(0x7f41380fb650 msgr2=0x7f41380fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:02.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.213+0000 7f413f526700 1 -- 172.21.15.2:0/2683382023 shutdown_connections 2024-09-13T23:01:02.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.213+0000 7f413f526700 1 -- 172.21.15.2:0/2683382023 wait complete. 2024-09-13T23:01:02.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.214+0000 7f413f526700 1 Processor -- start 2024-09-13T23:01:02.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.214+0000 7f413f526700 1 -- start start 2024-09-13T23:01:02.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.214+0000 7f413f526700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4138101e60 0x7f413819c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:02.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.214+0000 7f413f526700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4138102780 0x7f413819cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:02.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.214+0000 7f413f526700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413819d0a0 con 0x7f4138102780 2024-09-13T23:01:02.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.214+0000 7f413f526700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41381966c0 con 0x7f4138101e60 2024-09-13T23:01:02.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.215+0000 7f413cac1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4138102780 0x7f413819cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:02.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.215+0000 7f413cac1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4138102780 0x7f413819cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46812/0 (socket says 172.21.15.2:46812) 2024-09-13T23:01:02.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.215+0000 7f413cac1700 1 -- 172.21.15.2:0/2086473446 learned_addr learned my addr 172.21.15.2:0/2086473446 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:01:02.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.215+0000 7f413d2c2700 1 --2- 172.21.15.2:0/2086473446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4138101e60 0x7f413819c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:02.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.215+0000 7f413cac1700 1 -- 172.21.15.2:0/2086473446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4138101e60 msgr2=0x7f413819c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:02.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.215+0000 7f413cac1700 1 --2- 172.21.15.2:0/2086473446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4138101e60 0x7f413819c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:02.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.215+0000 7f413cac1700 1 -- 172.21.15.2:0/2086473446 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41280095f0 con 0x7f4138102780 2024-09-13T23:01:02.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.215+0000 7f413cac1700 1 --2- 172.21.15.2:0/2086473446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4138102780 0x7f413819cb10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f412800bda0 tx=0x7f412800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:02.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.215+0000 7f412e7fc700 1 -- 172.21.15.2:0/2086473446 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f412801d070 con 0x7f4138102780 2024-09-13T23:01:02.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.215+0000 7f412e7fc700 1 -- 172.21.15.2:0/2086473446 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4128004fb0 con 0x7f4138102780 2024-09-13T23:01:02.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.215+0000 7f412e7fc700 1 -- 172.21.15.2:0/2086473446 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f412800f480 con 0x7f4138102780 2024-09-13T23:01:02.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.215+0000 7f413f526700 1 -- 172.21.15.2:0/2086473446 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4138196940 con 0x7f4138102780 2024-09-13T23:01:02.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.215+0000 7f413f526700 1 -- 172.21.15.2:0/2086473446 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4138196e30 con 0x7f4138102780 2024-09-13T23:01:02.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.216+0000 7f413f526700 1 -- 172.21.15.2:0/2086473446 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4138108300 con 0x7f4138102780 2024-09-13T23:01:02.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.217+0000 7f412e7fc700 1 -- 172.21.15.2:0/2086473446 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f4128022870 con 0x7f4138102780 2024-09-13T23:01:02.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.217+0000 7f412e7fc700 1 --2- 172.21.15.2:0/2086473446 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f412406e7c0 0x7f4124070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:02.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.217+0000 7f412e7fc700 1 -- 172.21.15.2:0/2086473446 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f412808fda0 con 0x7f4138102780 2024-09-13T23:01:02.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.217+0000 7f413d2c2700 1 --2- 172.21.15.2:0/2086473446 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f412406e7c0 0x7f4124070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:02.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.218+0000 7f413d2c2700 1 --2- 172.21.15.2:0/2086473446 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f412406e7c0 0x7f4124070c80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4134005fd0 tx=0x7f4134005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:02.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.222+0000 7f412e7fc700 1 -- 172.21.15.2:0/2086473446 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f412805c9b0 con 0x7f4138102780 2024-09-13T23:01:02.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.477+0000 7f413f526700 1 -- 172.21.15.2:0/2086473446 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4138197c40 con 0x7f412406e7c0 2024-09-13T23:01:02.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.478+0000 7f412e7fc700 1 -- 172.21.15.2:0/2086473446 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f4138197c40 con 0x7f412406e7c0 2024-09-13T23:01:02.479 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:01:02.480 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:01:02.480 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T23:01:02.480 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:01:02.480 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-13T23:01:02.480 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-13T23:01:02.480 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2024-09-13T23:01:02.480 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-13T23:01:02.480 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "4/23 daemons upgraded", 2024-09-13T23:01:02.480 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading crash daemons", 2024-09-13T23:01:02.480 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T23:01:02.480 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:01:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.480+0000 7f413f526700 1 -- 172.21.15.2:0/2086473446 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f412406e7c0 msgr2=0x7f4124070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.480+0000 7f413f526700 1 --2- 172.21.15.2:0/2086473446 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f412406e7c0 0x7f4124070c80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4134005fd0 tx=0x7f4134005e30 comp rx=0 tx=0).stop 2024-09-13T23:01:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.480+0000 7f413f526700 1 -- 172.21.15.2:0/2086473446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4138102780 msgr2=0x7f413819cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.480+0000 7f413f526700 1 --2- 172.21.15.2:0/2086473446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4138102780 0x7f413819cb10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f412800bda0 tx=0x7f412800be80 comp rx=0 tx=0).stop 2024-09-13T23:01:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.480+0000 7f413f526700 1 -- 172.21.15.2:0/2086473446 shutdown_connections 2024-09-13T23:01:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.480+0000 7f413f526700 1 --2- 172.21.15.2:0/2086473446 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f412406e7c0 0x7f4124070c80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.480+0000 7f413f526700 1 --2- 172.21.15.2:0/2086473446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4138101e60 0x7f413819c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.480+0000 7f413f526700 1 --2- 172.21.15.2:0/2086473446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4138102780 0x7f413819cb10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.480+0000 7f413f526700 1 -- 172.21.15.2:0/2086473446 >> 172.21.15.2:0/2086473446 conn(0x7f41380fb650 msgr2=0x7f4138105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.481+0000 7f413f526700 1 -- 172.21.15.2:0/2086473446 shutdown_connections 2024-09-13T23:01:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.481+0000 7f413f526700 1 -- 172.21.15.2:0/2086473446 wait complete. 2024-09-13T23:01:02.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.589+0000 7f1cbaacd700 1 -- 172.21.15.2:0/1949119573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cb4068580 msgr2=0x7f1cb40689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.589+0000 7f1cbaacd700 1 --2- 172.21.15.2:0/1949119573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cb4068580 0x7f1cb40689e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4009910 tx=0x7f1ca4009c20 comp rx=0 tx=0).stop 2024-09-13T23:01:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.589+0000 7f1cbaacd700 1 -- 172.21.15.2:0/1949119573 shutdown_connections 2024-09-13T23:01:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.589+0000 7f1cbaacd700 1 --2- 172.21.15.2:0/1949119573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cb4068580 0x7f1cb40689e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.589+0000 7f1cbaacd700 1 --2- 172.21.15.2:0/1949119573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cb4106cd0 0x7f1cb41070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.589+0000 7f1cbaacd700 1 -- 172.21.15.2:0/1949119573 >> 172.21.15.2:0/1949119573 conn(0x7f1cb4075670 msgr2=0x7f1cb4075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.589+0000 7f1cbaacd700 1 -- 172.21.15.2:0/1949119573 shutdown_connections 2024-09-13T23:01:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.589+0000 7f1cbaacd700 1 -- 172.21.15.2:0/1949119573 wait complete. 2024-09-13T23:01:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.590+0000 7f1cbaacd700 1 Processor -- start 2024-09-13T23:01:02.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.590+0000 7f1cbaacd700 1 -- start start 2024-09-13T23:01:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.590+0000 7f1cbaacd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cb4068580 0x7f1cb419c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.590+0000 7f1cbaacd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cb4106cd0 0x7f1cb419cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.590+0000 7f1cbaacd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb419d200 con 0x7f1cb4106cd0 2024-09-13T23:01:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.590+0000 7f1cbaacd700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb41966b0 con 0x7f1cb4068580 2024-09-13T23:01:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.590+0000 7f1cb3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cb4106cd0 0x7f1cb419cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.590+0000 7f1cb3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cb4106cd0 0x7f1cb419cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46824/0 (socket says 172.21.15.2:46824) 2024-09-13T23:01:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.590+0000 7f1cb3fff700 1 -- 172.21.15.2:0/1210807627 learned_addr learned my addr 172.21.15.2:0/1210807627 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:01:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.590+0000 7f1cb8869700 1 --2- 172.21.15.2:0/1210807627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cb4068580 0x7f1cb419c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.591+0000 7f1cb3fff700 1 -- 172.21.15.2:0/1210807627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cb4068580 msgr2=0x7f1cb419c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.591+0000 7f1cb3fff700 1 --2- 172.21.15.2:0/1210807627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cb4068580 0x7f1cb419c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.591+0000 7f1cb3fff700 1 -- 172.21.15.2:0/1210807627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca40095f0 con 0x7f1cb4106cd0 2024-09-13T23:01:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.591+0000 7f1cb3fff700 1 --2- 172.21.15.2:0/1210807627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cb4106cd0 0x7f1cb419cb70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4005f50 tx=0x7f1ca400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.591+0000 7f1cb1ffb700 1 -- 172.21.15.2:0/1210807627 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ca401d070 con 0x7f1cb4106cd0 2024-09-13T23:01:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.591+0000 7f1cb1ffb700 1 -- 172.21.15.2:0/1210807627 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ca400b610 con 0x7f1cb4106cd0 2024-09-13T23:01:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.591+0000 7f1cbaacd700 1 -- 172.21.15.2:0/1210807627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb4196930 con 0x7f1cb4106cd0 2024-09-13T23:01:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.591+0000 7f1cb1ffb700 1 -- 172.21.15.2:0/1210807627 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ca4022470 con 0x7f1cb4106cd0 2024-09-13T23:01:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.591+0000 7f1cbaacd700 1 -- 172.21.15.2:0/1210807627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb4196e20 con 0x7f1cb4106cd0 2024-09-13T23:01:02.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.592+0000 7f1cbaacd700 1 -- 172.21.15.2:0/1210807627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb41091d0 con 0x7f1cb4106cd0 2024-09-13T23:01:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.593+0000 7f1cb1ffb700 1 -- 172.21.15.2:0/1210807627 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f1ca4003780 con 0x7f1cb4106cd0 2024-09-13T23:01:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.593+0000 7f1cb1ffb700 1 --2- 172.21.15.2:0/1210807627 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1ca006e7c0 0x7f1ca0070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.593+0000 7f1cb1ffb700 1 -- 172.21.15.2:0/1210807627 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1ca408fb00 con 0x7f1cb4106cd0 2024-09-13T23:01:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.593+0000 7f1cb8869700 1 --2- 172.21.15.2:0/1210807627 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1ca006e7c0 0x7f1ca0070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:02.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.594+0000 7f1cb8869700 1 --2- 172.21.15.2:0/1210807627 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1ca006e7c0 0x7f1ca0070c80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c009c60 tx=0x7f1c9c009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:02.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.598+0000 7f1cb1ffb700 1 -- 172.21.15.2:0/1210807627 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1ca405c6e0 con 0x7f1cb4106cd0 2024-09-13T23:01:02.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.894+0000 7f1cbaacd700 1 -- 172.21.15.2:0/1210807627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1cb404f2e0 con 0x7f1cb4106cd0 2024-09-13T23:01:02.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.894+0000 7f1cb1ffb700 1 -- 172.21.15.2:0/1210807627 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f1ca405c270 con 0x7f1cb4106cd0 2024-09-13T23:01:02.895 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T23:01:02.895 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T23:01:02.896 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T23:01:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.897+0000 7f1cbaacd700 1 -- 172.21.15.2:0/1210807627 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1ca006e7c0 msgr2=0x7f1ca0070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.897+0000 7f1cbaacd700 1 --2- 172.21.15.2:0/1210807627 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1ca006e7c0 0x7f1ca0070c80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c009c60 tx=0x7f1c9c009260 comp rx=0 tx=0).stop 2024-09-13T23:01:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.897+0000 7f1cbaacd700 1 -- 172.21.15.2:0/1210807627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cb4106cd0 msgr2=0x7f1cb419cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.897+0000 7f1cbaacd700 1 --2- 172.21.15.2:0/1210807627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cb4106cd0 0x7f1cb419cb70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4005f50 tx=0x7f1ca400f690 comp rx=0 tx=0).stop 2024-09-13T23:01:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.897+0000 7f1cbaacd700 1 -- 172.21.15.2:0/1210807627 shutdown_connections 2024-09-13T23:01:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.897+0000 7f1cbaacd700 1 --2- 172.21.15.2:0/1210807627 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1ca006e7c0 0x7f1ca0070c80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.897+0000 7f1cbaacd700 1 --2- 172.21.15.2:0/1210807627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cb4068580 0x7f1cb419c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.897+0000 7f1cbaacd700 1 --2- 172.21.15.2:0/1210807627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cb4106cd0 0x7f1cb419cb70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.897+0000 7f1cbaacd700 1 -- 172.21.15.2:0/1210807627 >> 172.21.15.2:0/1210807627 conn(0x7f1cb4075670 msgr2=0x7f1cb40feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.897+0000 7f1cbaacd700 1 -- 172.21.15.2:0/1210807627 shutdown_connections 2024-09-13T23:01:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:02.897+0000 7f1cbaacd700 1 -- 172.21.15.2:0/1210807627 wait complete. 2024-09-13T23:01:03.014 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:02 smithi047 ceph-mon[81243]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:03.015 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:02 smithi047 ceph-mon[81243]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:03.015 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:02 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/3607424682' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:01:03.016 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:02 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:03.016 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:02 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:02 smithi002 ceph-mon[111294]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:02 smithi002 ceph-mon[111294]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:02 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/3607424682' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:02 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:02 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:04.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:03 smithi002 ceph-mon[111294]: pgmap v30: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-13T23:01:04.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:03 smithi002 ceph-mon[111294]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:04.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:03 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/1210807627' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:01:04.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:04.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi047", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T23:01:04.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:04.115 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:03 smithi047 ceph-mon[81243]: pgmap v30: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-09-13T23:01:04.115 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:03 smithi047 ceph-mon[81243]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:04.115 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:03 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/1210807627' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:01:04.116 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:04.116 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi047", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T23:01:04.116 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:05.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:04 smithi002 ceph-mon[111294]: Upgrade: Updating crash.smithi047 (2/2) 2024-09-13T23:01:05.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:04 smithi002 ceph-mon[111294]: Deploying daemon crash.smithi047 on smithi047 2024-09-13T23:01:05.037 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:04 smithi047 ceph-mon[81243]: Upgrade: Updating crash.smithi047 (2/2) 2024-09-13T23:01:05.037 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:04 smithi047 ceph-mon[81243]: Deploying daemon crash.smithi047 on smithi047 2024-09-13T23:01:05.792 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:05 smithi047 ceph-mon[81243]: pgmap v31: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:01:06.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:05 smithi002 ceph-mon[111294]: pgmap v31: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:01:07.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:07 smithi002 ceph-mon[111294]: pgmap v32: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:01:07.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:07.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:07.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:08.127 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:07 smithi047 ceph-mon[81243]: pgmap v32: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:01:08.127 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:08.127 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:08.127 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:09.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:01:09.031 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:01:10.059 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:09 smithi002 ceph-mon[111294]: pgmap v33: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:01:10.069 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:09 smithi047 ceph-mon[81243]: pgmap v33: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:01:11.051 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:10 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:11.052 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:10 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:11.052 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:10 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:11.052 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:10 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:11.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:10 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:11.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:10 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:11.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:10 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:11.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:10 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:12.041 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:11 smithi047 ceph-mon[81243]: pgmap v34: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:01:12.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:11 smithi002 ceph-mon[111294]: pgmap v34: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:01:13.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:12 smithi002 ceph-mon[111294]: pgmap v35: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:01:13.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:13.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:13.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:13.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:13.354 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:12 smithi047 ceph-mon[81243]: pgmap v35: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:01:13.354 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:13.354 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:13.354 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:13.355 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:15.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:14 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:15.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:14 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:15.118 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:14 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:15.118 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:14 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:15.808 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:15 smithi002 ceph-mon[111294]: pgmap v36: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:01:16.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:15 smithi047 ceph-mon[81243]: pgmap v36: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:01:16.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:16 smithi002 ceph-mon[111294]: pgmap v37: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:01:16.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:16 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:16.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:16 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:16.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:16 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:16.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:16 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:01:16.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:16 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:16.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:16 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:16.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:16 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:01:17.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:16 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:01:17.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:16 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:01:17.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:16 smithi002 ceph-mon[111294]: Upgrade: Setting container_image for all crash 2024-09-13T23:01:17.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:16 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:17.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:16 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi002"}]: dispatch 2024-09-13T23:01:17.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:16 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi002"}]': finished 2024-09-13T23:01:17.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:16 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi047"}]: dispatch 2024-09-13T23:01:17.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:16 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi047"}]': finished 2024-09-13T23:01:17.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:16 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T23:01:17.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:16 smithi002 ceph-mon[111294]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T23:01:17.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:16 smithi002 ceph-mon[111294]: Upgrade: osd.0 is safe to restart 2024-09-13T23:01:17.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:16 smithi047 ceph-mon[81243]: pgmap v37: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:01:17.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:16 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:17.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:16 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:17.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:16 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:17.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:16 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:01:17.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:16 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:17.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:16 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:17.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:16 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:01:17.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:16 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:01:17.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:16 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:01:17.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:16 smithi047 ceph-mon[81243]: Upgrade: Setting container_image for all crash 2024-09-13T23:01:17.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:16 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:17.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:16 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi002"}]: dispatch 2024-09-13T23:01:17.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:16 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi002"}]': finished 2024-09-13T23:01:17.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:16 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi047"}]: dispatch 2024-09-13T23:01:17.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:16 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi047"}]': finished 2024-09-13T23:01:17.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:16 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T23:01:17.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:16 smithi047 ceph-mon[81243]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T23:01:17.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:16 smithi047 ceph-mon[81243]: Upgrade: osd.0 is safe to restart 2024-09-13T23:01:18.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:18 smithi047 ceph-mon[81243]: Upgrade: Updating osd.0 2024-09-13T23:01:18.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:18 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:18.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:18 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T23:01:18.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:18 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:18.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:18 smithi047 ceph-mon[81243]: Deploying daemon osd.0 on smithi002 2024-09-13T23:01:18.695 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:18 smithi002 ceph-mon[111294]: Upgrade: Updating osd.0 2024-09-13T23:01:18.695 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:18 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:18.696 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:18 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T23:01:18.696 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:18 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:18.696 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:18 smithi002 ceph-mon[111294]: Deploying daemon osd.0 on smithi002 2024-09-13T23:01:19.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:19 smithi047 ceph-mon[81243]: pgmap v38: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:01:19.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:19 smithi002 ceph-mon[111294]: pgmap v38: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:01:20.500 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:20 smithi002 systemd[1]: Stopping Ceph osd.0 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:01:21.000 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:20 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0[46175]: 2024-09-13T23:01:20.575+0000 7fb0684f2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:01:21.000 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:20 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0[46175]: 2024-09-13T23:01:20.575+0000 7fb0684f2700 -1 osd.0 50 *** Got signal Terminated *** 2024-09-13T23:01:21.000 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:20 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0[46175]: 2024-09-13T23:01:20.575+0000 7fb0684f2700 -1 osd.0 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:01:21.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:21 smithi047 ceph-mon[81243]: pgmap v39: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:01:21.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:21 smithi047 ceph-mon[81243]: osd.0 marked itself down and dead 2024-09-13T23:01:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:21 smithi002 ceph-mon[111294]: pgmap v39: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:01:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:21 smithi002 ceph-mon[111294]: osd.0 marked itself down and dead 2024-09-13T23:01:22.102 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:21 smithi002 podman[121985]: 2024-09-13 23:01:21.79385665 +0000 UTC m=+1.332099579 container died 1e1f6936c4028cefa6a7f7be1faf27f3b75828b8bc3eb6caf7f6316eab37304e (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-13T23:01:22.444 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:22 smithi002 ceph-mon[111294]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:01:22.444 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:22 smithi002 ceph-mon[111294]: osdmap e51: 6 total, 5 up, 6 in 2024-09-13T23:01:22.445 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:22 smithi002 podman[121985]: 2024-09-13 23:01:22.200600872 +0000 UTC m=+1.738843784 container cleanup 1e1f6936c4028cefa6a7f7be1faf27f3b75828b8bc3eb6caf7f6316eab37304e (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0, io.buildah.version=1.29.1, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-13T23:01:22.445 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:22 smithi002 bash[121985]: ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0 2024-09-13T23:01:22.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:22 smithi047 ceph-mon[81243]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:01:22.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:22 smithi047 ceph-mon[81243]: osdmap e51: 6 total, 5 up, 6 in 2024-09-13T23:01:22.749 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:22 smithi002 podman[122003]: 2024-09-13 23:01:22.443801171 +0000 UTC m=+0.650937508 container remove 1e1f6936c4028cefa6a7f7be1faf27f3b75828b8bc3eb6caf7f6316eab37304e (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, RELEASE=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=-18.2.1, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-13T23:01:23.206 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:22 smithi002 podman[122091]: 2024-09-13 23:01:22.784568123 +0000 UTC m=+0.016467634 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:01:23.206 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:22 smithi002 podman[122091]: 2024-09-13 23:01:22.88653601 +0000 UTC m=+0.118435506 container create 5460147c8f28108aed82a204dc57ce33645b516b115f9821d23b5032f3d00314 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-13T23:01:23.206 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:23 smithi002 podman[122091]: 2024-09-13 23:01:23.122314398 +0000 UTC m=+0.354213895 container init 5460147c8f28108aed82a204dc57ce33645b516b115f9821d23b5032f3d00314 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T23:01:23.206 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:23 smithi002 podman[122091]: 2024-09-13 23:01:23.126030629 +0000 UTC m=+0.357930125 container start 5460147c8f28108aed82a204dc57ce33645b516b115f9821d23b5032f3d00314 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:01:23.206 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:23 smithi002 podman[122091]: 2024-09-13 23:01:23.205713817 +0000 UTC m=+0.437613316 container attach 5460147c8f28108aed82a204dc57ce33645b516b115f9821d23b5032f3d00314 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:01:23.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:23 smithi002 ceph-mon[111294]: pgmap v41: 65 pgs: 9 stale+active+clean, 56 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T23:01:23.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:23 smithi002 ceph-mon[111294]: osdmap e52: 6 total, 5 up, 6 in 2024-09-13T23:01:23.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:23 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:23.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:23 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:01:23.501 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:23 smithi002 podman[122091]: 2024-09-13 23:01:23.323781281 +0000 UTC m=+0.555680787 container died 5460147c8f28108aed82a204dc57ce33645b516b115f9821d23b5032f3d00314 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-13T23:01:23.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:23 smithi047 ceph-mon[81243]: pgmap v41: 65 pgs: 9 stale+active+clean, 56 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T23:01:23.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:23 smithi047 ceph-mon[81243]: osdmap e52: 6 total, 5 up, 6 in 2024-09-13T23:01:23.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:23 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:23.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:23 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:01:24.160 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:23 smithi002 podman[122113]: 2024-09-13 23:01:23.909559675 +0000 UTC m=+0.576965085 container remove 5460147c8f28108aed82a204dc57ce33645b516b115f9821d23b5032f3d00314 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-13T23:01:24.160 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:23 smithi002 systemd[1]: ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-13T23:01:24.160 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:23 smithi002 systemd[1]: Stopped Ceph osd.0 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T23:01:24.160 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:23 smithi002 systemd[1]: ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.0.service: Consumed 54.534s CPU time. 2024-09-13T23:01:24.161 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:24 smithi002 systemd[1]: Starting Ceph osd.0 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:01:24.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:24 smithi047 ceph-mon[81243]: Health check failed: Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded (PG_DEGRADED) 2024-09-13T23:01:24.663 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:24 smithi002 ceph-mon[111294]: Health check failed: Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded (PG_DEGRADED) 2024-09-13T23:01:24.663 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:24 smithi002 podman[122213]: 2024-09-13 23:01:24.275219981 +0000 UTC m=+0.016605549 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:01:24.663 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:24 smithi002 podman[122213]: 2024-09-13 23:01:24.418935312 +0000 UTC m=+0.160320921 container create 93011e6606481d5414fcf895ab8273fad253075abcd4d14fb2a6d04fc6be5bf9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T23:01:24.663 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:24 smithi002 podman[122213]: 2024-09-13 23:01:24.663321509 +0000 UTC m=+0.404707079 container init 93011e6606481d5414fcf895ab8273fad253075abcd4d14fb2a6d04fc6be5bf9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-13T23:01:25.000 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:24 smithi002 podman[122213]: 2024-09-13 23:01:24.667124314 +0000 UTC m=+0.408509885 container start 93011e6606481d5414fcf895ab8273fad253075abcd4d14fb2a6d04fc6be5bf9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-activate, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-13T23:01:25.000 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:24 smithi002 podman[122213]: 2024-09-13 23:01:24.763403436 +0000 UTC m=+0.504789011 container attach 93011e6606481d5414fcf895ab8273fad253075abcd4d14fb2a6d04fc6be5bf9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-activate, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=) 2024-09-13T23:01:25.000 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:24 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-activate[122228]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:01:25.000 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:24 smithi002 bash[122213]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:01:25.001 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:24 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-activate[122228]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:01:25.001 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:24 smithi002 bash[122213]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:01:25.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:25 smithi002 ceph-mon[111294]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-13T23:01:25.657 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:25 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-activate[122228]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T23:01:25.658 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:25 smithi002 bash[122213]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T23:01:25.658 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:25 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-activate[122228]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T23:01:25.658 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:25 smithi002 bash[122213]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T23:01:25.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:25 smithi047 ceph-mon[81243]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-13T23:01:26.000 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:25 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-activate[122228]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T23:01:26.000 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:25 smithi002 bash[122213]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T23:01:26.000 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:25 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-activate[122228]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T23:01:26.000 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:25 smithi002 bash[122213]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T23:01:26.000 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:25 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-activate[122228]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T23:01:26.000 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:25 smithi002 bash[122213]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T23:01:26.001 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:25 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-activate[122228]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T23:01:26.001 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:25 smithi002 bash[122213]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T23:01:26.001 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:25 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-activate[122228]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T23:01:26.001 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:25 smithi002 bash[122213]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T23:01:26.001 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:25 smithi002 podman[122213]: 2024-09-13 23:01:25.862438019 +0000 UTC m=+1.603823586 container died 93011e6606481d5414fcf895ab8273fad253075abcd4d14fb2a6d04fc6be5bf9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-13T23:01:26.750 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:26 smithi002 podman[122362]: 2024-09-13 23:01:26.450663302 +0000 UTC m=+0.582430887 container remove 93011e6606481d5414fcf895ab8273fad253075abcd4d14fb2a6d04fc6be5bf9 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T23:01:26.751 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:26 smithi002 podman[122425]: 2024-09-13 23:01:26.570051713 +0000 UTC m=+0.017454932 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:01:26.751 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:26 smithi002 podman[122425]: 2024-09-13 23:01:26.676419105 +0000 UTC m=+0.123822327 container create 0ca6dd66fa683b340037e21bacf8378d6379034c42cbf5cfe3cdf187a458d545 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:01:27.250 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:26 smithi002 podman[122425]: 2024-09-13 23:01:26.879127669 +0000 UTC m=+0.326530889 container init 0ca6dd66fa683b340037e21bacf8378d6379034c42cbf5cfe3cdf187a458d545 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-13T23:01:27.250 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:26 smithi002 podman[122425]: 2024-09-13 23:01:26.882453829 +0000 UTC m=+0.329857057 container start 0ca6dd66fa683b340037e21bacf8378d6379034c42cbf5cfe3cdf187a458d545 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:01:27.250 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:26 smithi002 ceph-osd[122443]: -- 172.21.15.2:0/3652252697 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b5fcad01e0 con 0x55b5fca66000 2024-09-13T23:01:27.250 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:26 smithi002 bash[122425]: 0ca6dd66fa683b340037e21bacf8378d6379034c42cbf5cfe3cdf187a458d545 2024-09-13T23:01:27.250 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:26 smithi002 systemd[1]: Started Ceph osd.0 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T23:01:27.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:27 smithi047 ceph-mon[81243]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-13T23:01:27.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:27 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:27.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:27 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:27.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:27 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:27.704 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:27 smithi002 ceph-mon[111294]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-13T23:01:27.705 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:27 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:27.705 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:27 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:27.705 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:27 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:29.131 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:28 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0[122439]: 2024-09-13T23:01:28.751+0000 7fae6a37a640 -1 Falling back to public interface 2024-09-13T23:01:29.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:29 smithi047 ceph-mon[81243]: pgmap v45: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-13T23:01:29.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:29 smithi002 ceph-mon[111294]: pgmap v45: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-13T23:01:31.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:31 smithi002 ceph-mon[111294]: pgmap v46: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-13T23:01:31.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:31 smithi047 ceph-mon[81243]: pgmap v46: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-13T23:01:33.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.011+0000 7fea94164700 1 -- 172.21.15.2:0/1657562641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c100ea0 msgr2=0x7fea8c101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:33.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.011+0000 7fea94164700 1 --2- 172.21.15.2:0/1657562641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c100ea0 0x7fea8c101280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fea7c00b0a0 tx=0x7fea7c00b3b0 comp rx=0 tx=0).stop 2024-09-13T23:01:33.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.011+0000 7fea94164700 1 -- 172.21.15.2:0/1657562641 shutdown_connections 2024-09-13T23:01:33.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.011+0000 7fea94164700 1 --2- 172.21.15.2:0/1657562641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea8c101850 0x7fea8c1058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:33.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.011+0000 7fea94164700 1 --2- 172.21.15.2:0/1657562641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c100ea0 0x7fea8c101280 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:33.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.011+0000 7fea94164700 1 -- 172.21.15.2:0/1657562641 >> 172.21.15.2:0/1657562641 conn(0x7fea8c0fc750 msgr2=0x7fea8c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:33.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.011+0000 7fea94164700 1 -- 172.21.15.2:0/1657562641 shutdown_connections 2024-09-13T23:01:33.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.011+0000 7fea94164700 1 -- 172.21.15.2:0/1657562641 wait complete. 2024-09-13T23:01:33.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.012+0000 7fea94164700 1 Processor -- start 2024-09-13T23:01:33.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.012+0000 7fea94164700 1 -- start start 2024-09-13T23:01:33.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.012+0000 7fea94164700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c100ea0 0x7fea8c196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:33.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.012+0000 7fea94164700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea8c101850 0x7fea8c196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:33.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.012+0000 7fea94164700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c197550 con 0x7fea8c100ea0 2024-09-13T23:01:33.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.012+0000 7fea94164700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c19b360 con 0x7fea8c101850 2024-09-13T23:01:33.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.013+0000 7fea91f00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c100ea0 0x7fea8c196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.013+0000 7fea91f00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c100ea0 0x7fea8c196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53876/0 (socket says 172.21.15.2:53876) 2024-09-13T23:01:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.013+0000 7fea91f00700 1 -- 172.21.15.2:0/310180878 learned_addr learned my addr 172.21.15.2:0/310180878 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:01:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.013+0000 7fea916ff700 1 --2- 172.21.15.2:0/310180878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea8c101850 0x7fea8c196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.013+0000 7fea91f00700 1 -- 172.21.15.2:0/310180878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea8c101850 msgr2=0x7fea8c196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.013+0000 7fea91f00700 1 --2- 172.21.15.2:0/310180878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea8c101850 0x7fea8c196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.013+0000 7fea91f00700 1 -- 172.21.15.2:0/310180878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7c009d00 con 0x7fea8c100ea0 2024-09-13T23:01:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.013+0000 7fea916ff700 1 --2- 172.21.15.2:0/310180878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea8c101850 0x7fea8c196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:01:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.013+0000 7fea91f00700 1 --2- 172.21.15.2:0/310180878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c100ea0 0x7fea8c196980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fea7c00b070 tx=0x7fea7c00cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.013+0000 7fea8affd700 1 -- 172.21.15.2:0/310180878 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea7c00e040 con 0x7fea8c100ea0 2024-09-13T23:01:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.013+0000 7fea8affd700 1 -- 172.21.15.2:0/310180878 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea7c003de0 con 0x7fea8c100ea0 2024-09-13T23:01:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.013+0000 7fea8affd700 1 -- 172.21.15.2:0/310180878 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea7c01d8e0 con 0x7fea8c100ea0 2024-09-13T23:01:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.014+0000 7fea94164700 1 -- 172.21.15.2:0/310180878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8c19b5e0 con 0x7fea8c100ea0 2024-09-13T23:01:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.014+0000 7fea94164700 1 -- 172.21.15.2:0/310180878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8c19bad0 con 0x7fea8c100ea0 2024-09-13T23:01:33.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.014+0000 7fea94164700 1 -- 172.21.15.2:0/310180878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea8c109240 con 0x7fea8c100ea0 2024-09-13T23:01:33.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.015+0000 7fea8affd700 1 -- 172.21.15.2:0/310180878 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7fea7c004040 con 0x7fea8c100ea0 2024-09-13T23:01:33.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.015+0000 7fea8affd700 1 --2- 172.21.15.2:0/310180878 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fea7406e7b0 0x7fea74070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:33.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.016+0000 7fea8affd700 1 -- 172.21.15.2:0/310180878 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fea7c08ffb0 con 0x7fea8c100ea0 2024-09-13T23:01:33.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.016+0000 7fea916ff700 1 --2- 172.21.15.2:0/310180878 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fea7406e7b0 0x7fea74070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:33.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.016+0000 7fea916ff700 1 --2- 172.21.15.2:0/310180878 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fea7406e7b0 0x7fea74070c70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fea80005950 tx=0x7fea800058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:33.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.020+0000 7fea8affd700 1 -- 172.21.15.2:0/310180878 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fea7c05cb90 con 0x7fea8c100ea0 2024-09-13T23:01:33.192 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:32 smithi002 ceph-mon[111294]: pgmap v47: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-13T23:01:33.192 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:32 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:33.192 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:32 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:33.193 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:32 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:33.193 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:32 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:33.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.258+0000 7fea94164700 1 -- 172.21.15.2:0/310180878 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fea8c197da0 con 0x7fea7406e7b0 2024-09-13T23:01:33.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.259+0000 7fea8affd700 1 -- 172.21.15.2:0/310180878 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fea8c197da0 con 0x7fea7406e7b0 2024-09-13T23:01:33.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.262+0000 7fea94164700 1 -- 172.21.15.2:0/310180878 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fea7406e7b0 msgr2=0x7fea74070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:33.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.262+0000 7fea94164700 1 --2- 172.21.15.2:0/310180878 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fea7406e7b0 0x7fea74070c70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fea80005950 tx=0x7fea800058e0 comp rx=0 tx=0).stop 2024-09-13T23:01:33.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.262+0000 7fea94164700 1 -- 172.21.15.2:0/310180878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c100ea0 msgr2=0x7fea8c196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:33.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.262+0000 7fea94164700 1 --2- 172.21.15.2:0/310180878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c100ea0 0x7fea8c196980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fea7c00b070 tx=0x7fea7c00cdd0 comp rx=0 tx=0).stop 2024-09-13T23:01:33.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.262+0000 7fea94164700 1 -- 172.21.15.2:0/310180878 shutdown_connections 2024-09-13T23:01:33.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.262+0000 7fea94164700 1 --2- 172.21.15.2:0/310180878 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fea7406e7b0 0x7fea74070c70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:33.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.262+0000 7fea94164700 1 --2- 172.21.15.2:0/310180878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c100ea0 0x7fea8c196980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:33.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.262+0000 7fea94164700 1 --2- 172.21.15.2:0/310180878 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea8c101850 0x7fea8c196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:33.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.262+0000 7fea94164700 1 -- 172.21.15.2:0/310180878 >> 172.21.15.2:0/310180878 conn(0x7fea8c0fc750 msgr2=0x7fea8c0fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:33.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.262+0000 7fea94164700 1 -- 172.21.15.2:0/310180878 shutdown_connections 2024-09-13T23:01:33.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.262+0000 7fea94164700 1 -- 172.21.15.2:0/310180878 wait complete. 2024-09-13T23:01:33.273 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T23:01:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.375+0000 7f674b694700 1 -- 172.21.15.2:0/1362386246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6744101850 msgr2=0x7f67441058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.375+0000 7f674b694700 1 --2- 172.21.15.2:0/1362386246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6744101850 0x7f67441058a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6734009910 tx=0x7f6734009c20 comp rx=0 tx=0).stop 2024-09-13T23:01:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.375+0000 7f674b694700 1 -- 172.21.15.2:0/1362386246 shutdown_connections 2024-09-13T23:01:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.375+0000 7f674b694700 1 --2- 172.21.15.2:0/1362386246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6744101850 0x7f67441058a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.375+0000 7f674b694700 1 --2- 172.21.15.2:0/1362386246 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6744100ea0 0x7f6744101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.375+0000 7f674b694700 1 -- 172.21.15.2:0/1362386246 >> 172.21.15.2:0/1362386246 conn(0x7f67440fc750 msgr2=0x7f67440feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.375+0000 7f674b694700 1 -- 172.21.15.2:0/1362386246 shutdown_connections 2024-09-13T23:01:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.375+0000 7f674b694700 1 -- 172.21.15.2:0/1362386246 wait complete. 2024-09-13T23:01:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.376+0000 7f674b694700 1 Processor -- start 2024-09-13T23:01:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.376+0000 7f674b694700 1 -- start start 2024-09-13T23:01:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.376+0000 7f674b694700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6744100ea0 0x7f674419e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.376+0000 7f674b694700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6744101850 0x7f674419eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.376+0000 7f674b694700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674419f430 con 0x7f6744101850 2024-09-13T23:01:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.376+0000 7f674b694700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67441988e0 con 0x7f6744100ea0 2024-09-13T23:01:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.376+0000 7f6748c2f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6744101850 0x7f674419eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.376+0000 7f6748c2f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6744101850 0x7f674419eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53890/0 (socket says 172.21.15.2:53890) 2024-09-13T23:01:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.376+0000 7f6748c2f700 1 -- 172.21.15.2:0/1684566253 learned_addr learned my addr 172.21.15.2:0/1684566253 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:01:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.376+0000 7f6749430700 1 --2- 172.21.15.2:0/1684566253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6744100ea0 0x7f674419e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.377+0000 7f6748c2f700 1 -- 172.21.15.2:0/1684566253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6744100ea0 msgr2=0x7f674419e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.377+0000 7f6748c2f700 1 --2- 172.21.15.2:0/1684566253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6744100ea0 0x7f674419e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.377+0000 7f6748c2f700 1 -- 172.21.15.2:0/1684566253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67340095f0 con 0x7f6744101850 2024-09-13T23:01:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.377+0000 7f6748c2f700 1 --2- 172.21.15.2:0/1684566253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6744101850 0x7f674419eda0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6734009fd0 tx=0x7f673400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.377+0000 7f673a7fc700 1 -- 172.21.15.2:0/1684566253 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f673401d070 con 0x7f6744101850 2024-09-13T23:01:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.377+0000 7f673a7fc700 1 -- 172.21.15.2:0/1684566253 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6734022470 con 0x7f6744101850 2024-09-13T23:01:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.377+0000 7f673a7fc700 1 -- 172.21.15.2:0/1684566253 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6734017650 con 0x7f6744101850 2024-09-13T23:01:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.377+0000 7f674b694700 1 -- 172.21.15.2:0/1684566253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6744198b60 con 0x7f6744101850 2024-09-13T23:01:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.377+0000 7f674b694700 1 -- 172.21.15.2:0/1684566253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6744198ff0 con 0x7f6744101850 2024-09-13T23:01:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.378+0000 7f674b694700 1 -- 172.21.15.2:0/1684566253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6744105020 con 0x7f6744101850 2024-09-13T23:01:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.379+0000 7f673a7fc700 1 -- 172.21.15.2:0/1684566253 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f67340225e0 con 0x7f6744101850 2024-09-13T23:01:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.379+0000 7f673a7fc700 1 --2- 172.21.15.2:0/1684566253 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f673006e800 0x7f6730070cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.379+0000 7f673a7fc700 1 -- 172.21.15.2:0/1684566253 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f673408fe30 con 0x7f6744101850 2024-09-13T23:01:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.379+0000 7f6749430700 1 --2- 172.21.15.2:0/1684566253 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f673006e800 0x7f6730070cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.380+0000 7f6749430700 1 --2- 172.21.15.2:0/1684566253 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f673006e800 0x7f6730070cc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6740009c60 tx=0x7f6740009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:33.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.384+0000 7f673a7fc700 1 -- 172.21.15.2:0/1684566253 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6734093030 con 0x7f6744101850 2024-09-13T23:01:33.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:32 smithi047 ceph-mon[81243]: pgmap v47: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-13T23:01:33.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:32 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:33.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:32 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:33.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:32 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:33.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:32 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:33.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.618+0000 7f674b694700 1 -- 172.21.15.2:0/1684566253 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f67441992d0 con 0x7f673006e800 2024-09-13T23:01:33.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.620+0000 7f673a7fc700 1 -- 172.21.15.2:0/1684566253 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f67441992d0 con 0x7f673006e800 2024-09-13T23:01:33.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.622+0000 7f674b694700 1 -- 172.21.15.2:0/1684566253 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f673006e800 msgr2=0x7f6730070cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:33.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.622+0000 7f674b694700 1 --2- 172.21.15.2:0/1684566253 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f673006e800 0x7f6730070cc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6740009c60 tx=0x7f6740009260 comp rx=0 tx=0).stop 2024-09-13T23:01:33.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.622+0000 7f674b694700 1 -- 172.21.15.2:0/1684566253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6744101850 msgr2=0x7f674419eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:33.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.622+0000 7f674b694700 1 --2- 172.21.15.2:0/1684566253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6744101850 0x7f674419eda0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6734009fd0 tx=0x7f673400f690 comp rx=0 tx=0).stop 2024-09-13T23:01:33.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.622+0000 7f674b694700 1 -- 172.21.15.2:0/1684566253 shutdown_connections 2024-09-13T23:01:33.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.622+0000 7f674b694700 1 --2- 172.21.15.2:0/1684566253 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f673006e800 0x7f6730070cc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:33.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.622+0000 7f674b694700 1 --2- 172.21.15.2:0/1684566253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6744100ea0 0x7f674419e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:33.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.622+0000 7f674b694700 1 --2- 172.21.15.2:0/1684566253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6744101850 0x7f674419eda0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:33.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.622+0000 7f674b694700 1 -- 172.21.15.2:0/1684566253 >> 172.21.15.2:0/1684566253 conn(0x7f67440fc750 msgr2=0x7f67440fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:33.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.622+0000 7f674b694700 1 -- 172.21.15.2:0/1684566253 shutdown_connections 2024-09-13T23:01:33.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.622+0000 7f674b694700 1 -- 172.21.15.2:0/1684566253 wait complete. 2024-09-13T23:01:33.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.736+0000 7f1cec65f700 1 -- 172.21.15.2:0/1138595238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ce4100ea0 msgr2=0x7f1ce4101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:33.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.736+0000 7f1cec65f700 1 --2- 172.21.15.2:0/1138595238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ce4100ea0 0x7f1ce4101280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009910 tx=0x7f1ce0009c20 comp rx=0 tx=0).stop 2024-09-13T23:01:33.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.736+0000 7f1cec65f700 1 -- 172.21.15.2:0/1138595238 shutdown_connections 2024-09-13T23:01:33.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.736+0000 7f1cec65f700 1 --2- 172.21.15.2:0/1138595238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ce4101850 0x7f1ce41058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:33.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.736+0000 7f1cec65f700 1 --2- 172.21.15.2:0/1138595238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ce4100ea0 0x7f1ce4101280 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:33.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.736+0000 7f1cec65f700 1 -- 172.21.15.2:0/1138595238 >> 172.21.15.2:0/1138595238 conn(0x7f1ce40fc750 msgr2=0x7f1ce40feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:33.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.737+0000 7f1cec65f700 1 -- 172.21.15.2:0/1138595238 shutdown_connections 2024-09-13T23:01:33.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.737+0000 7f1cec65f700 1 -- 172.21.15.2:0/1138595238 wait complete. 2024-09-13T23:01:33.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.737+0000 7f1cec65f700 1 Processor -- start 2024-09-13T23:01:33.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.737+0000 7f1cec65f700 1 -- start start 2024-09-13T23:01:33.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.737+0000 7f1cec65f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ce4100ea0 0x7f1ce419c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:33.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.737+0000 7f1cec65f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ce4101850 0x7f1ce419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.737+0000 7f1cec65f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce419d2e0 con 0x7f1ce4101850 2024-09-13T23:01:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.737+0000 7f1cec65f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce4196790 con 0x7f1ce4100ea0 2024-09-13T23:01:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.738+0000 7f1ce9bfa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ce4101850 0x7f1ce419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.738+0000 7f1ce9bfa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ce4101850 0x7f1ce419cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53898/0 (socket says 172.21.15.2:53898) 2024-09-13T23:01:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.738+0000 7f1ce9bfa700 1 -- 172.21.15.2:0/2416109399 learned_addr learned my addr 172.21.15.2:0/2416109399 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:01:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.738+0000 7f1cea3fb700 1 --2- 172.21.15.2:0/2416109399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ce4100ea0 0x7f1ce419c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.738+0000 7f1ce9bfa700 1 -- 172.21.15.2:0/2416109399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ce4100ea0 msgr2=0x7f1ce419c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.738+0000 7f1ce9bfa700 1 --2- 172.21.15.2:0/2416109399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ce4100ea0 0x7f1ce419c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.738+0000 7f1ce9bfa700 1 -- 172.21.15.2:0/2416109399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce00095f0 con 0x7f1ce4101850 2024-09-13T23:01:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.738+0000 7f1ce9bfa700 1 --2- 172.21.15.2:0/2416109399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ce4101850 0x7f1ce419cc50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400d900 tx=0x7f1cd400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.738+0000 7f1cdb7fe700 1 -- 172.21.15.2:0/2416109399 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cd4009900 con 0x7f1ce4101850 2024-09-13T23:01:33.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.738+0000 7f1cdb7fe700 1 -- 172.21.15.2:0/2416109399 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1cd4010460 con 0x7f1ce4101850 2024-09-13T23:01:33.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.738+0000 7f1cdb7fe700 1 -- 172.21.15.2:0/2416109399 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cd400f5f0 con 0x7f1ce4101850 2024-09-13T23:01:33.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.739+0000 7f1cec65f700 1 -- 172.21.15.2:0/2416109399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce4196a70 con 0x7f1ce4101850 2024-09-13T23:01:33.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.739+0000 7f1cec65f700 1 -- 172.21.15.2:0/2416109399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce4196fc0 con 0x7f1ce4101850 2024-09-13T23:01:33.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.740+0000 7f1cec65f700 1 -- 172.21.15.2:0/2416109399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce4109240 con 0x7f1ce4101850 2024-09-13T23:01:33.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.740+0000 7f1cdb7fe700 1 -- 172.21.15.2:0/2416109399 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f1cd40105d0 con 0x7f1ce4101850 2024-09-13T23:01:33.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.741+0000 7f1cdb7fe700 1 --2- 172.21.15.2:0/2416109399 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1cd006e7c0 0x7f1cd0070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:33.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.741+0000 7f1cdb7fe700 1 -- 172.21.15.2:0/2416109399 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1cd408e2f0 con 0x7f1ce4101850 2024-09-13T23:01:33.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.741+0000 7f1cea3fb700 1 --2- 172.21.15.2:0/2416109399 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1cd006e7c0 0x7f1cd0070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:33.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.741+0000 7f1cea3fb700 1 --2- 172.21.15.2:0/2416109399 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1cd006e7c0 0x7f1cd0070c80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0006010 tx=0x7f1ce001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:33.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.745+0000 7f1cdb7fe700 1 -- 172.21.15.2:0/2416109399 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1cd405aed0 con 0x7f1ce4101850 2024-09-13T23:01:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.987+0000 7f1cec65f700 1 -- 172.21.15.2:0/2416109399 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ce4197db0 con 0x7f1cd006e7c0 2024-09-13T23:01:33.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.997+0000 7f1cdb7fe700 1 -- 172.21.15.2:0/2416109399 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f1ce4197db0 con 0x7f1cd006e7c0 2024-09-13T23:01:33.998 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:01:33.998 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (3m) 2s ago 13m 26.9M - 0.25.0 c8568f914cd2 f570a73274bc 2024-09-13T23:01:33.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (14m) 2s ago 14m 8086k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T23:01:33.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (13m) 24s ago 13m 8044k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T23:01:33.998 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (32s) 2s ago 14m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 427cd38a7d88 2024-09-13T23:01:33.998 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (27s) 24s ago 13m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 ce5a1df96005 2024-09-13T23:01:33.998 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (2m) 2s ago 13m 75.9M - 9.4.12 2bacad6d85d8 650673516b69 2024-09-13T23:01:33.998 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (8m) 2s ago 8m 16.8M - 18.2.1 5be31c24972a 59e9c88c31ca 2024-09-13T23:01:33.998 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (8m) 2s ago 8m 91.0M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T23:01:33.998 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (8m) 24s ago 8m 150M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T23:01:33.999 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (8m) 24s ago 8m 18.9M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T23:01:33.999 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 running (4m) 2s ago 15m 495M - 19.1.1-324-gecab7be5 0652ff2b5d78 7a8aa9de37e4 2024-09-13T23:01:33.999 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (4m) 24s ago 12m 439M - 19.1.1-324-gecab7be5 0652ff2b5d78 13fa6f3b5a8a 2024-09-13T23:01:33.999 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (94s) 2s ago 15m 45.3M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 db0ef6c509cf 2024-09-13T23:01:33.999 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (71s) 24s ago 12m 35.3M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 ea0c2a2e0e1a 2024-09-13T23:01:33.999 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (3m) 2s ago 13m 14.8M - 1.5.0 0da6a335fe13 f3eae5f90ab8 2024-09-13T23:01:33.999 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (3m) 24s ago 12m 16.0M - 1.5.0 0da6a335fe13 a5c7d7f1eaa5 2024-09-13T23:01:33.999 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (7s) 2s ago 12m 11.5M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 0ca6dd66fa68 2024-09-13T23:01:33.999 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (11m) 2s ago 11m 227M 1217M 18.2.1 5be31c24972a f0ac78c34831 2024-09-13T23:01:33.999 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (11m) 2s ago 11m 189M 1217M 18.2.1 5be31c24972a 9a2f4f6decfb 2024-09-13T23:01:33.999 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (10m) 24s ago 10m 259M 2241M 18.2.1 5be31c24972a fb455cc4c571 2024-09-13T23:01:33.999 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (10m) 24s ago 10m 223M 2241M 18.2.1 5be31c24972a f1bdc2c50535 2024-09-13T23:01:33.999 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (9m) 24s ago 9m 199M 2241M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T23:01:33.999 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (3m) 2s ago 13m 72.4M - 2.43.0 a07b618ecd1d aa241d1048de 2024-09-13T23:01:34.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.999+0000 7f1cec65f700 1 -- 172.21.15.2:0/2416109399 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1cd006e7c0 msgr2=0x7f1cd0070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:34.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.999+0000 7f1cec65f700 1 --2- 172.21.15.2:0/2416109399 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1cd006e7c0 0x7f1cd0070c80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0006010 tx=0x7f1ce001a040 comp rx=0 tx=0).stop 2024-09-13T23:01:34.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.999+0000 7f1cec65f700 1 -- 172.21.15.2:0/2416109399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ce4101850 msgr2=0x7f1ce419cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:34.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.999+0000 7f1cec65f700 1 --2- 172.21.15.2:0/2416109399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ce4101850 0x7f1ce419cc50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400d900 tx=0x7f1cd400dc10 comp rx=0 tx=0).stop 2024-09-13T23:01:34.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.999+0000 7f1cec65f700 1 -- 172.21.15.2:0/2416109399 shutdown_connections 2024-09-13T23:01:34.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.999+0000 7f1cec65f700 1 --2- 172.21.15.2:0/2416109399 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1cd006e7c0 0x7f1cd0070c80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:34.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.999+0000 7f1cec65f700 1 --2- 172.21.15.2:0/2416109399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ce4100ea0 0x7f1ce419c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:34.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.999+0000 7f1cec65f700 1 --2- 172.21.15.2:0/2416109399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ce4101850 0x7f1ce419cc50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:34.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.999+0000 7f1cec65f700 1 -- 172.21.15.2:0/2416109399 >> 172.21.15.2:0/2416109399 conn(0x7f1ce40fc750 msgr2=0x7f1ce40fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:34.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.999+0000 7f1cec65f700 1 -- 172.21.15.2:0/2416109399 shutdown_connections 2024-09-13T23:01:34.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:33.999+0000 7f1cec65f700 1 -- 172.21.15.2:0/2416109399 wait complete. 2024-09-13T23:01:34.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.127+0000 7fdbf1a23700 1 -- 172.21.15.2:0/3699824958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec0ffc20 msgr2=0x7fdbec100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:34.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.127+0000 7fdbf1a23700 1 --2- 172.21.15.2:0/3699824958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec0ffc20 0x7fdbec100080 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009910 tx=0x7fdbe0009c20 comp rx=0 tx=0).stop 2024-09-13T23:01:34.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.127+0000 7fdbf1a23700 1 -- 172.21.15.2:0/3699824958 shutdown_connections 2024-09-13T23:01:34.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.127+0000 7fdbf1a23700 1 --2- 172.21.15.2:0/3699824958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec0ffc20 0x7fdbec100080 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:34.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.127+0000 7fdbf1a23700 1 --2- 172.21.15.2:0/3699824958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbec105bd0 0x7fdbec105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:34.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.127+0000 7fdbf1a23700 1 -- 172.21.15.2:0/3699824958 >> 172.21.15.2:0/3699824958 conn(0x7fdbec075670 msgr2=0x7fdbec075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:34.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.127+0000 7fdbf1a23700 1 -- 172.21.15.2:0/3699824958 shutdown_connections 2024-09-13T23:01:34.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.127+0000 7fdbf1a23700 1 -- 172.21.15.2:0/3699824958 wait complete. 2024-09-13T23:01:34.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.128+0000 7fdbf1a23700 1 Processor -- start 2024-09-13T23:01:34.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.128+0000 7fdbf1a23700 1 -- start start 2024-09-13T23:01:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.129+0000 7fdbf1a23700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec0ffc20 0x7fdbec197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.129+0000 7fdbf1a23700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbec105bd0 0x7fdbec197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.129+0000 7fdbf1a23700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec198380 con 0x7fdbec0ffc20 2024-09-13T23:01:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.129+0000 7fdbf1a23700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec1984f0 con 0x7fdbec105bd0 2024-09-13T23:01:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.129+0000 7fdbeaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec0ffc20 0x7fdbec197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.129+0000 7fdbeaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec0ffc20 0x7fdbec197760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53922/0 (socket says 172.21.15.2:53922) 2024-09-13T23:01:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.129+0000 7fdbeaffd700 1 -- 172.21.15.2:0/2503059748 learned_addr learned my addr 172.21.15.2:0/2503059748 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:01:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.129+0000 7fdbea7fc700 1 --2- 172.21.15.2:0/2503059748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbec105bd0 0x7fdbec197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.129+0000 7fdbeaffd700 1 -- 172.21.15.2:0/2503059748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbec105bd0 msgr2=0x7fdbec197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.129+0000 7fdbeaffd700 1 --2- 172.21.15.2:0/2503059748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbec105bd0 0x7fdbec197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.129+0000 7fdbeaffd700 1 -- 172.21.15.2:0/2503059748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe00095f0 con 0x7fdbec0ffc20 2024-09-13T23:01:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.129+0000 7fdbeaffd700 1 --2- 172.21.15.2:0/2503059748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec0ffc20 0x7fdbec197760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc00d8d0 tx=0x7fdbdc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:34.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.130+0000 7fdbf0a21700 1 -- 172.21.15.2:0/2503059748 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbdc0098a0 con 0x7fdbec0ffc20 2024-09-13T23:01:34.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.130+0000 7fdbf0a21700 1 -- 172.21.15.2:0/2503059748 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdbdc010460 con 0x7fdbec0ffc20 2024-09-13T23:01:34.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.130+0000 7fdbf1a23700 1 -- 172.21.15.2:0/2503059748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbec1a07d0 con 0x7fdbec0ffc20 2024-09-13T23:01:34.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.130+0000 7fdbf0a21700 1 -- 172.21.15.2:0/2503059748 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbdc00f5f0 con 0x7fdbec0ffc20 2024-09-13T23:01:34.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.130+0000 7fdbf1a23700 1 -- 172.21.15.2:0/2503059748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbec195550 con 0x7fdbec0ffc20 2024-09-13T23:01:34.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.131+0000 7fdbf1a23700 1 -- 172.21.15.2:0/2503059748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbec1080d0 con 0x7fdbec0ffc20 2024-09-13T23:01:34.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.132+0000 7fdbf0a21700 1 -- 172.21.15.2:0/2503059748 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7fdbdc00f820 con 0x7fdbec0ffc20 2024-09-13T23:01:34.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.132+0000 7fdbf0a21700 1 --2- 172.21.15.2:0/2503059748 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fdbd4072bd0 0x7fdbd4075090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:34.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.132+0000 7fdbf0a21700 1 -- 172.21.15.2:0/2503059748 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fdbdc08e7a0 con 0x7fdbec0ffc20 2024-09-13T23:01:34.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.132+0000 7fdbea7fc700 1 --2- 172.21.15.2:0/2503059748 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fdbd4072bd0 0x7fdbd4075090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:34.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.133+0000 7fdbea7fc700 1 --2- 172.21.15.2:0/2503059748 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fdbd4072bd0 0x7fdbd4075090 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdbec068e30 tx=0x7fdbe001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:34.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.137+0000 7fdbf0a21700 1 -- 172.21.15.2:0/2503059748 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdbdc057840 con 0x7fdbec0ffc20 2024-09-13T23:01:34.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:33 smithi002 ceph-mon[111294]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:34.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:33 smithi002 ceph-mon[111294]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:34.236 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:34 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0[122439]: 2024-09-13T23:01:34.027+0000 7fae6a37a640 -1 osd.0 0 read_superblock omap replica is missing. 2024-09-13T23:01:34.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:33 smithi047 ceph-mon[81243]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:34.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:33 smithi047 ceph-mon[81243]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:34.499 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:34 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0[122439]: 2024-09-13T23:01:34.353+0000 7fae6a37a640 -1 osd.0 50 log_to_monitors true 2024-09-13T23:01:34.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.503+0000 7fdbf1a23700 1 -- 172.21.15.2:0/2503059748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdbec04f2e0 con 0x7fdbec0ffc20 2024-09-13T23:01:34.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.503+0000 7fdbf0a21700 1 -- 172.21.15.2:0/2503059748 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+693 (secure 0 0 0) 0x7fdbdc05af00 con 0x7fdbec0ffc20 2024-09-13T23:01:34.505 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:01:34.505 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T23:01:34.505 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:01:34.505 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:01:34.505 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T23:01:34.506 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:01:34.506 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:01:34.506 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T23:01:34.506 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 5 2024-09-13T23:01:34.506 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:01:34.506 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T23:01:34.506 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-13T23:01:34.506 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:01:34.506 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T23:01:34.506 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 9, 2024-09-13T23:01:34.506 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T23:01:34.506 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T23:01:34.506 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:01:34.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.505+0000 7fdbf1a23700 1 -- 172.21.15.2:0/2503059748 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fdbd4072bd0 msgr2=0x7fdbd4075090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.505+0000 7fdbf1a23700 1 --2- 172.21.15.2:0/2503059748 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fdbd4072bd0 0x7fdbd4075090 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdbec068e30 tx=0x7fdbe001a040 comp rx=0 tx=0).stop 2024-09-13T23:01:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.505+0000 7fdbf1a23700 1 -- 172.21.15.2:0/2503059748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec0ffc20 msgr2=0x7fdbec197760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.505+0000 7fdbf1a23700 1 --2- 172.21.15.2:0/2503059748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec0ffc20 0x7fdbec197760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc00d8d0 tx=0x7fdbdc00dbe0 comp rx=0 tx=0).stop 2024-09-13T23:01:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.506+0000 7fdbf1a23700 1 -- 172.21.15.2:0/2503059748 shutdown_connections 2024-09-13T23:01:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.506+0000 7fdbf1a23700 1 --2- 172.21.15.2:0/2503059748 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fdbd4072bd0 0x7fdbd4075090 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.506+0000 7fdbf1a23700 1 --2- 172.21.15.2:0/2503059748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec0ffc20 0x7fdbec197760 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.506+0000 7fdbf1a23700 1 --2- 172.21.15.2:0/2503059748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbec105bd0 0x7fdbec197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.506+0000 7fdbf1a23700 1 -- 172.21.15.2:0/2503059748 >> 172.21.15.2:0/2503059748 conn(0x7fdbec075670 msgr2=0x7fdbec0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.506+0000 7fdbf1a23700 1 -- 172.21.15.2:0/2503059748 shutdown_connections 2024-09-13T23:01:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.506+0000 7fdbf1a23700 1 -- 172.21.15.2:0/2503059748 wait complete. 2024-09-13T23:01:34.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.617+0000 7efdce0da700 1 -- 172.21.15.2:0/4034145817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc8100ea0 msgr2=0x7efdc8101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:34.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.617+0000 7efdce0da700 1 --2- 172.21.15.2:0/4034145817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc8100ea0 0x7efdc8101280 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efdb8009910 tx=0x7efdb8009c20 comp rx=0 tx=0).stop 2024-09-13T23:01:34.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.617+0000 7efdce0da700 1 -- 172.21.15.2:0/4034145817 shutdown_connections 2024-09-13T23:01:34.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.617+0000 7efdce0da700 1 --2- 172.21.15.2:0/4034145817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdc8101850 0x7efdc81058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:34.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.617+0000 7efdce0da700 1 --2- 172.21.15.2:0/4034145817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc8100ea0 0x7efdc8101280 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:34.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.617+0000 7efdce0da700 1 -- 172.21.15.2:0/4034145817 >> 172.21.15.2:0/4034145817 conn(0x7efdc80fc750 msgr2=0x7efdc80feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:34.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.617+0000 7efdce0da700 1 -- 172.21.15.2:0/4034145817 shutdown_connections 2024-09-13T23:01:34.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.617+0000 7efdce0da700 1 -- 172.21.15.2:0/4034145817 wait complete. 2024-09-13T23:01:34.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.617+0000 7efdce0da700 1 Processor -- start 2024-09-13T23:01:34.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.618+0000 7efdce0da700 1 -- start start 2024-09-13T23:01:34.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.618+0000 7efdce0da700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc8100ea0 0x7efdc819c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:34.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.618+0000 7efdce0da700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdc8101850 0x7efdc819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:34.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.618+0000 7efdce0da700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc819d2c0 con 0x7efdc8100ea0 2024-09-13T23:01:34.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.618+0000 7efdce0da700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc8196770 con 0x7efdc8101850 2024-09-13T23:01:34.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.618+0000 7efdc77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc8100ea0 0x7efdc819c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:34.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.618+0000 7efdc77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc8100ea0 0x7efdc819c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53944/0 (socket says 172.21.15.2:53944) 2024-09-13T23:01:34.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.618+0000 7efdc77fe700 1 -- 172.21.15.2:0/826195519 learned_addr learned my addr 172.21.15.2:0/826195519 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:01:34.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.618+0000 7efdbeffd700 1 --2- 172.21.15.2:0/826195519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdc8101850 0x7efdc819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:34.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.618+0000 7efdc77fe700 1 -- 172.21.15.2:0/826195519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdc8101850 msgr2=0x7efdc819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:34.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.618+0000 7efdc77fe700 1 --2- 172.21.15.2:0/826195519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdc8101850 0x7efdc819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:34.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.618+0000 7efdc77fe700 1 -- 172.21.15.2:0/826195519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb80095f0 con 0x7efdc8100ea0 2024-09-13T23:01:34.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.619+0000 7efdc77fe700 1 --2- 172.21.15.2:0/826195519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc8100ea0 0x7efdc819c6f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efdb8005f50 tx=0x7efdb800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:34.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.619+0000 7efdc57fa700 1 -- 172.21.15.2:0/826195519 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb801d070 con 0x7efdc8100ea0 2024-09-13T23:01:34.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.619+0000 7efdce0da700 1 -- 172.21.15.2:0/826195519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc81969f0 con 0x7efdc8100ea0 2024-09-13T23:01:34.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.619+0000 7efdc57fa700 1 -- 172.21.15.2:0/826195519 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efdb800b610 con 0x7efdc8100ea0 2024-09-13T23:01:34.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.619+0000 7efdc57fa700 1 -- 172.21.15.2:0/826195519 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb8022470 con 0x7efdc8100ea0 2024-09-13T23:01:34.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.619+0000 7efdce0da700 1 -- 172.21.15.2:0/826195519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc8196ee0 con 0x7efdc8100ea0 2024-09-13T23:01:34.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.620+0000 7efdce0da700 1 -- 172.21.15.2:0/826195519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc8109240 con 0x7efdc8100ea0 2024-09-13T23:01:34.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.620+0000 7efdc57fa700 1 -- 172.21.15.2:0/826195519 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7efdb8003780 con 0x7efdc8100ea0 2024-09-13T23:01:34.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.621+0000 7efdc57fa700 1 --2- 172.21.15.2:0/826195519 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7efdb406e7c0 0x7efdb4070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:34.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.621+0000 7efdc57fa700 1 -- 172.21.15.2:0/826195519 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6156+0+0 (secure 0 0 0) 0x7efdb808fb50 con 0x7efdc8100ea0 2024-09-13T23:01:34.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.621+0000 7efdbeffd700 1 --2- 172.21.15.2:0/826195519 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7efdb406e7c0 0x7efdb4070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:34.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.622+0000 7efdbeffd700 1 --2- 172.21.15.2:0/826195519 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7efdb406e7c0 0x7efdb4070c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efdc8197be0 tx=0x7efdb0009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:34.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.626+0000 7efdc57fa700 1 -- 172.21.15.2:0/826195519 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efdb805c730 con 0x7efdc8100ea0 2024-09-13T23:01:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.885+0000 7efdce0da700 1 -- 172.21.15.2:0/826195519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efdc804f2e0 con 0x7efdc8100ea0 2024-09-13T23:01:34.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.885+0000 7efdc57fa700 1 -- 172.21.15.2:0/826195519 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1938 (secure 0 0 0) 0x7efdb805c2c0 con 0x7efdc8100ea0 2024-09-13T23:01:34.888 INFO:teuthology.orchestra.run.smithi002.stdout:e16 2024-09-13T23:01:34.888 INFO:teuthology.orchestra.run.smithi002.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T23:01:34.888 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:01:34.888 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:01:34.888 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-13T23:01:34.888 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:01:34.888 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:01:34.888 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-13T23:01:34.888 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 16 2024-09-13T23:01:34.889 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:01:34.889 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-13T22:53:05.963265+0000 2024-09-13T23:01:34.889 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-13T22:53:25.072026+0000 2024-09-13T23:01:34.889 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-13T23:01:34.889 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-13T23:01:34.889 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-13T23:01:34.889 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-13T23:01:34.889 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-13T23:01:34.889 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-13T23:01:34.889 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-13T23:01:34.889 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-13T23:01:34.889 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 47 2024-09-13T23:01:34.890 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:01:34.890 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 1 2024-09-13T23:01:34.890 INFO:teuthology.orchestra.run.smithi002.stdout:in 0 2024-09-13T23:01:34.890 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24267} 2024-09-13T23:01:34.890 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-13T23:01:34.890 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-13T23:01:34.890 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-13T23:01:34.890 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-13T23:01:34.890 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-13T23:01:34.890 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-13T23:01:34.890 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-13T23:01:34.891 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-13T23:01:34.891 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-13T23:01:34.891 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 0 members: 2024-09-13T23:01:34.891 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.gxzkha{0:24267} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:01:34.891 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.gglyyr{0:14488} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.2:6828/2123560657,v1:172.21.15.2:6829/2123560657] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:01:34.891 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:01:34.891 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:01:34.891 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-13T23:01:34.891 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:01:34.891 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.auedll{-1:14500} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/1577962179,v1:172.21.15.2:6827/1577962179] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:01:34.891 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.nqvveh{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:01:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.888+0000 7efdce0da700 1 -- 172.21.15.2:0/826195519 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7efdb406e7c0 msgr2=0x7efdb4070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.888+0000 7efdce0da700 1 --2- 172.21.15.2:0/826195519 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7efdb406e7c0 0x7efdb4070c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efdc8197be0 tx=0x7efdb0009260 comp rx=0 tx=0).stop 2024-09-13T23:01:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.888+0000 7efdce0da700 1 -- 172.21.15.2:0/826195519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc8100ea0 msgr2=0x7efdc819c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.888+0000 7efdce0da700 1 --2- 172.21.15.2:0/826195519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc8100ea0 0x7efdc819c6f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efdb8005f50 tx=0x7efdb800f690 comp rx=0 tx=0).stop 2024-09-13T23:01:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.888+0000 7efdce0da700 1 -- 172.21.15.2:0/826195519 shutdown_connections 2024-09-13T23:01:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.888+0000 7efdce0da700 1 --2- 172.21.15.2:0/826195519 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7efdb406e7c0 0x7efdb4070c80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.888+0000 7efdce0da700 1 --2- 172.21.15.2:0/826195519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdc8100ea0 0x7efdc819c6f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.888+0000 7efdce0da700 1 --2- 172.21.15.2:0/826195519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdc8101850 0x7efdc819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.888+0000 7efdce0da700 1 -- 172.21.15.2:0/826195519 >> 172.21.15.2:0/826195519 conn(0x7efdc80fc750 msgr2=0x7efdc80fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.889+0000 7efdce0da700 1 -- 172.21.15.2:0/826195519 shutdown_connections 2024-09-13T23:01:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:34.889+0000 7efdce0da700 1 -- 172.21.15.2:0/826195519 wait complete. 2024-09-13T23:01:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2024-09-13T23:01:35.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.009+0000 7f91f9c26700 1 -- 172.21.15.2:0/266484908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91f40fff50 msgr2=0x7f91f4105840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:35.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.009+0000 7f91f9c26700 1 --2- 172.21.15.2:0/266484908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91f40fff50 0x7f91f4105840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f91dc009910 tx=0x7f91dc009c20 comp rx=0 tx=0).stop 2024-09-13T23:01:35.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.010+0000 7f91f9c26700 1 -- 172.21.15.2:0/266484908 shutdown_connections 2024-09-13T23:01:35.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.010+0000 7f91f9c26700 1 --2- 172.21.15.2:0/266484908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91f40fff50 0x7f91f4105840 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:35.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.010+0000 7f91f9c26700 1 --2- 172.21.15.2:0/266484908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91f40ff5a0 0x7f91f40ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:35.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.010+0000 7f91f9c26700 1 -- 172.21.15.2:0/266484908 >> 172.21.15.2:0/266484908 conn(0x7f91f4074e30 msgr2=0x7f91f4075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.010+0000 7f91f9c26700 1 -- 172.21.15.2:0/266484908 shutdown_connections 2024-09-13T23:01:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.010+0000 7f91f9c26700 1 -- 172.21.15.2:0/266484908 wait complete. 2024-09-13T23:01:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.010+0000 7f91f9c26700 1 Processor -- start 2024-09-13T23:01:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.010+0000 7f91f9c26700 1 -- start start 2024-09-13T23:01:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.011+0000 7f91f9c26700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91f40ff5a0 0x7f91f419c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.011+0000 7f91f9c26700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91f40fff50 0x7f91f419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.011+0000 7f91f9c26700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f419d180 con 0x7f91f40fff50 2024-09-13T23:01:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.011+0000 7f91f9c26700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f41966c0 con 0x7f91f40ff5a0 2024-09-13T23:01:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.011+0000 7f91eaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91f40fff50 0x7f91f419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.011+0000 7f91eaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91f40fff50 0x7f91f419cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53968/0 (socket says 172.21.15.2:53968) 2024-09-13T23:01:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.011+0000 7f91eaffd700 1 -- 172.21.15.2:0/2177223002 learned_addr learned my addr 172.21.15.2:0/2177223002 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:01:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.011+0000 7f91f37fe700 1 --2- 172.21.15.2:0/2177223002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91f40ff5a0 0x7f91f419c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.011+0000 7f91eaffd700 1 -- 172.21.15.2:0/2177223002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91f40ff5a0 msgr2=0x7f91f419c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.011+0000 7f91eaffd700 1 --2- 172.21.15.2:0/2177223002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91f40ff5a0 0x7f91f419c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.011+0000 7f91eaffd700 1 -- 172.21.15.2:0/2177223002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc0095f0 con 0x7f91f40fff50 2024-09-13T23:01:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.011+0000 7f91f37fe700 1 --2- 172.21.15.2:0/2177223002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91f40ff5a0 0x7f91f419c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:01:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.011+0000 7f91eaffd700 1 --2- 172.21.15.2:0/2177223002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91f40fff50 0x7f91f419cb80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00bda0 tx=0x7f91dc00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.012+0000 7f91f17fa700 1 -- 172.21.15.2:0/2177223002 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91dc01d070 con 0x7f91f40fff50 2024-09-13T23:01:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.012+0000 7f91f17fa700 1 -- 172.21.15.2:0/2177223002 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f91dc004fb0 con 0x7f91f40fff50 2024-09-13T23:01:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.012+0000 7f91f9c26700 1 -- 172.21.15.2:0/2177223002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f4196940 con 0x7f91f40fff50 2024-09-13T23:01:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.012+0000 7f91f17fa700 1 -- 172.21.15.2:0/2177223002 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91dc00f480 con 0x7f91f40fff50 2024-09-13T23:01:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.012+0000 7f91f9c26700 1 -- 172.21.15.2:0/2177223002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f4196e30 con 0x7f91f40fff50 2024-09-13T23:01:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.013+0000 7f91f9c26700 1 -- 172.21.15.2:0/2177223002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f4109200 con 0x7f91f40fff50 2024-09-13T23:01:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.013+0000 7f91f17fa700 1 -- 172.21.15.2:0/2177223002 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f91dc022870 con 0x7f91f40fff50 2024-09-13T23:01:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.014+0000 7f91f17fa700 1 --2- 172.21.15.2:0/2177223002 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f91e006e7c0 0x7f91e0070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.014+0000 7f91f17fa700 1 -- 172.21.15.2:0/2177223002 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f91dc08fcb0 con 0x7f91f40fff50 2024-09-13T23:01:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.014+0000 7f91f37fe700 1 --2- 172.21.15.2:0/2177223002 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f91e006e7c0 0x7f91e0070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.014+0000 7f91f37fe700 1 --2- 172.21.15.2:0/2177223002 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f91e006e7c0 0x7f91e0070c80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f91e4005fd0 tx=0x7f91e4005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:35.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.018+0000 7f91f17fa700 1 -- 172.21.15.2:0/2177223002 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f91dc05c940 con 0x7f91f40fff50 2024-09-13T23:01:35.250 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:01:34 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0[122439]: 2024-09-13T23:01:34.952+0000 7fae62114640 -1 osd.0 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:01:35.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:34 smithi002 ceph-mon[111294]: pgmap v48: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-13T23:01:35.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:34 smithi002 ceph-mon[111294]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:35.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:34 smithi002 ceph-mon[111294]: from='osd.0 [v2:172.21.15.2:6802/1690284817,v1:172.21.15.2:6803/1690284817]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T23:01:35.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:34 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/2503059748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:01:35.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:34 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/826195519' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:01:35.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.255+0000 7f91f9c26700 1 -- 172.21.15.2:0/2177223002 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91f41970a0 con 0x7f91e006e7c0 2024-09-13T23:01:35.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.257+0000 7f91f17fa700 1 -- 172.21.15.2:0/2177223002 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f91f41970a0 con 0x7f91e006e7c0 2024-09-13T23:01:35.258 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:01:35.259 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:01:35.259 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T23:01:35.259 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:01:35.259 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-13T23:01:35.259 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-13T23:01:35.259 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-13T23:01:35.259 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2024-09-13T23:01:35.259 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-13T23:01:35.259 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "7/23 daemons upgraded", 2024-09-13T23:01:35.259 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T23:01:35.259 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T23:01:35.259 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:01:35.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.260+0000 7f91f9c26700 1 -- 172.21.15.2:0/2177223002 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f91e006e7c0 msgr2=0x7f91e0070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:35.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.260+0000 7f91f9c26700 1 --2- 172.21.15.2:0/2177223002 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f91e006e7c0 0x7f91e0070c80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f91e4005fd0 tx=0x7f91e4005e30 comp rx=0 tx=0).stop 2024-09-13T23:01:35.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.260+0000 7f91f9c26700 1 -- 172.21.15.2:0/2177223002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91f40fff50 msgr2=0x7f91f419cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:35.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.260+0000 7f91f9c26700 1 --2- 172.21.15.2:0/2177223002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91f40fff50 0x7f91f419cb80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00bda0 tx=0x7f91dc00be80 comp rx=0 tx=0).stop 2024-09-13T23:01:35.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.260+0000 7f91f9c26700 1 -- 172.21.15.2:0/2177223002 shutdown_connections 2024-09-13T23:01:35.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.260+0000 7f91f9c26700 1 --2- 172.21.15.2:0/2177223002 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f91e006e7c0 0x7f91e0070c80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:35.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.260+0000 7f91f9c26700 1 --2- 172.21.15.2:0/2177223002 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91f40ff5a0 0x7f91f419c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:35.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.260+0000 7f91f9c26700 1 --2- 172.21.15.2:0/2177223002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91f40fff50 0x7f91f419cb80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:35.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.260+0000 7f91f9c26700 1 -- 172.21.15.2:0/2177223002 >> 172.21.15.2:0/2177223002 conn(0x7f91f4074e30 msgr2=0x7f91f40fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:35.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.260+0000 7f91f9c26700 1 -- 172.21.15.2:0/2177223002 shutdown_connections 2024-09-13T23:01:35.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.260+0000 7f91f9c26700 1 -- 172.21.15.2:0/2177223002 wait complete. 2024-09-13T23:01:35.321 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:34 smithi047 ceph-mon[81243]: pgmap v48: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-09-13T23:01:35.321 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:34 smithi047 ceph-mon[81243]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:35.321 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:34 smithi047 ceph-mon[81243]: from='osd.0 [v2:172.21.15.2:6802/1690284817,v1:172.21.15.2:6803/1690284817]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T23:01:35.321 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:34 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/2503059748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:01:35.321 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:34 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/826195519' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:01:35.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.374+0000 7fc5ddf1e700 1 -- 172.21.15.2:0/1869421221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d8105bf0 msgr2=0x7fc5d8105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:35.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.374+0000 7fc5ddf1e700 1 --2- 172.21.15.2:0/1869421221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d8105bf0 0x7fc5d8105fd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009910 tx=0x7fc5c8009c20 comp rx=0 tx=0).stop 2024-09-13T23:01:35.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.374+0000 7fc5ddf1e700 1 -- 172.21.15.2:0/1869421221 shutdown_connections 2024-09-13T23:01:35.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.374+0000 7fc5ddf1e700 1 --2- 172.21.15.2:0/1869421221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5d80ffb40 0x7fc5d80fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:35.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.374+0000 7fc5ddf1e700 1 --2- 172.21.15.2:0/1869421221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d8105bf0 0x7fc5d8105fd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:35.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.374+0000 7fc5ddf1e700 1 -- 172.21.15.2:0/1869421221 >> 172.21.15.2:0/1869421221 conn(0x7fc5d80fb610 msgr2=0x7fc5d80fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:35.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.375+0000 7fc5ddf1e700 1 -- 172.21.15.2:0/1869421221 shutdown_connections 2024-09-13T23:01:35.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.375+0000 7fc5ddf1e700 1 -- 172.21.15.2:0/1869421221 wait complete. 2024-09-13T23:01:35.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.376+0000 7fc5ddf1e700 1 Processor -- start 2024-09-13T23:01:35.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.376+0000 7fc5ddf1e700 1 -- start start 2024-09-13T23:01:35.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.377+0000 7fc5ddf1e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5d80ffb40 0x7fc5d8199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:35.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.377+0000 7fc5ddf1e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d8105bf0 0x7fc5d81998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:35.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.377+0000 7fc5ddf1e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d8194400 con 0x7fc5d8105bf0 2024-09-13T23:01:35.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.377+0000 7fc5ddf1e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d8194570 con 0x7fc5d80ffb40 2024-09-13T23:01:35.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.377+0000 7fc5d77fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5d80ffb40 0x7fc5d8199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:35.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.377+0000 7fc5d6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d8105bf0 0x7fc5d81998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:35.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.377+0000 7fc5d77fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5d80ffb40 0x7fc5d8199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.2:52348/0 (socket says 172.21.15.2:52348) 2024-09-13T23:01:35.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.377+0000 7fc5d77fe700 1 -- 172.21.15.2:0/2697952641 learned_addr learned my addr 172.21.15.2:0/2697952641 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:01:35.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.378+0000 7fc5d77fe700 1 -- 172.21.15.2:0/2697952641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d8105bf0 msgr2=0x7fc5d81998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:35.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.378+0000 7fc5d77fe700 1 --2- 172.21.15.2:0/2697952641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d8105bf0 0x7fc5d81998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:35.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.378+0000 7fc5d77fe700 1 -- 172.21.15.2:0/2697952641 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c80095f0 con 0x7fc5d80ffb40 2024-09-13T23:01:35.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.378+0000 7fc5d77fe700 1 --2- 172.21.15.2:0/2697952641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5d80ffb40 0x7fc5d8199350 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8006010 tx=0x7fc5c800bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:35.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.378+0000 7fc5d4ff9700 1 -- 172.21.15.2:0/2697952641 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5c801d070 con 0x7fc5d80ffb40 2024-09-13T23:01:35.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.378+0000 7fc5ddf1e700 1 -- 172.21.15.2:0/2697952641 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d81947f0 con 0x7fc5d80ffb40 2024-09-13T23:01:35.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.378+0000 7fc5d4ff9700 1 -- 172.21.15.2:0/2697952641 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5c800f460 con 0x7fc5d80ffb40 2024-09-13T23:01:35.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.378+0000 7fc5d4ff9700 1 -- 172.21.15.2:0/2697952641 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5c8017630 con 0x7fc5d80ffb40 2024-09-13T23:01:35.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.378+0000 7fc5ddf1e700 1 -- 172.21.15.2:0/2697952641 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d8194ce0 con 0x7fc5d80ffb40 2024-09-13T23:01:35.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.379+0000 7fc5ddf1e700 1 -- 172.21.15.2:0/2697952641 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d80679c0 con 0x7fc5d80ffb40 2024-09-13T23:01:35.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.380+0000 7fc5d4ff9700 1 -- 172.21.15.2:0/2697952641 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7fc5c800f5d0 con 0x7fc5d80ffb40 2024-09-13T23:01:35.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.380+0000 7fc5d4ff9700 1 --2- 172.21.15.2:0/2697952641 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc5c406e7c0 0x7fc5c4070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:01:35.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.381+0000 7fc5d4ff9700 1 -- 172.21.15.2:0/2697952641 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc5c808fdf0 con 0x7fc5d80ffb40 2024-09-13T23:01:35.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.381+0000 7fc5d6ffd700 1 --2- 172.21.15.2:0/2697952641 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc5c406e7c0 0x7fc5c4070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:01:35.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.381+0000 7fc5d6ffd700 1 --2- 172.21.15.2:0/2697952641 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc5c406e7c0 0x7fc5c4070c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8195bf0 tx=0x7fc5c000a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:01:35.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.386+0000 7fc5d4ff9700 1 -- 172.21.15.2:0/2697952641 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc5c8058dc0 con 0x7fc5d80ffb40 2024-09-13T23:01:35.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.688+0000 7fc5ddf1e700 1 -- 172.21.15.2:0/2697952641 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc5d8194f50 con 0x7fc5d80ffb40 2024-09-13T23:01:35.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.689+0000 7fc5d4ff9700 1 -- 172.21.15.2:0/2697952641 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1517 (secure 0 0 0) 0x7fc5c805c480 con 0x7fc5d80ffb40 2024-09-13T23:01:35.691 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded 2024-09-13T23:01:35.691 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T23:01:35.691 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T23:01:35.691 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T23:01:35.691 INFO:teuthology.orchestra.run.smithi002.stdout: osd.0 (root=default,host=smithi002) is down 2024-09-13T23:01:35.691 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded 2024-09-13T23:01:35.691 INFO:teuthology.orchestra.run.smithi002.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-13T23:01:35.691 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-13T23:01:35.692 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-13T23:01:35.692 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-13T23:01:35.692 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-13T23:01:35.692 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-13T23:01:35.692 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-13T23:01:35.692 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-13T23:01:35.692 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-13T23:01:35.692 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-13T23:01:35.692 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-13T23:01:35.692 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-13T23:01:35.692 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-13T23:01:35.692 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-13T23:01:35.692 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-13T23:01:35.693 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-13T23:01:35.693 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-13T23:01:35.693 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-13T23:01:35.693 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-13T23:01:35.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.692+0000 7fc5ddf1e700 1 -- 172.21.15.2:0/2697952641 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc5c406e7c0 msgr2=0x7fc5c4070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.692+0000 7fc5ddf1e700 1 --2- 172.21.15.2:0/2697952641 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc5c406e7c0 0x7fc5c4070c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8195bf0 tx=0x7fc5c000a380 comp rx=0 tx=0).stop 2024-09-13T23:01:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.692+0000 7fc5ddf1e700 1 -- 172.21.15.2:0/2697952641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5d80ffb40 msgr2=0x7fc5d8199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:01:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.692+0000 7fc5ddf1e700 1 --2- 172.21.15.2:0/2697952641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5d80ffb40 0x7fc5d8199350 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8006010 tx=0x7fc5c800bd70 comp rx=0 tx=0).stop 2024-09-13T23:01:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.692+0000 7fc5ddf1e700 1 -- 172.21.15.2:0/2697952641 shutdown_connections 2024-09-13T23:01:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.692+0000 7fc5ddf1e700 1 --2- 172.21.15.2:0/2697952641 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc5c406e7c0 0x7fc5c4070c80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.692+0000 7fc5ddf1e700 1 --2- 172.21.15.2:0/2697952641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5d80ffb40 0x7fc5d8199350 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.692+0000 7fc5ddf1e700 1 --2- 172.21.15.2:0/2697952641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d8105bf0 0x7fc5d81998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:01:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.692+0000 7fc5ddf1e700 1 -- 172.21.15.2:0/2697952641 >> 172.21.15.2:0/2697952641 conn(0x7fc5d80fb610 msgr2=0x7fc5d8068eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:01:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.692+0000 7fc5ddf1e700 1 -- 172.21.15.2:0/2697952641 shutdown_connections 2024-09-13T23:01:35.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:01:35.692+0000 7fc5ddf1e700 1 -- 172.21.15.2:0/2697952641 wait complete. 2024-09-13T23:01:36.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:35 smithi002 ceph-mon[111294]: from='osd.0 [v2:172.21.15.2:6802/1690284817,v1:172.21.15.2:6803/1690284817]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T23:01:36.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:35 smithi002 ceph-mon[111294]: osdmap e53: 6 total, 5 up, 6 in 2024-09-13T23:01:36.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:35 smithi002 ceph-mon[111294]: from='osd.0 [v2:172.21.15.2:6802/1690284817,v1:172.21.15.2:6803/1690284817]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-13T23:01:36.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:35 smithi002 ceph-mon[111294]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:36.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:35 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/2697952641' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:01:36.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:35 smithi047 ceph-mon[81243]: from='osd.0 [v2:172.21.15.2:6802/1690284817,v1:172.21.15.2:6803/1690284817]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T23:01:36.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:35 smithi047 ceph-mon[81243]: osdmap e53: 6 total, 5 up, 6 in 2024-09-13T23:01:36.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:35 smithi047 ceph-mon[81243]: from='osd.0 [v2:172.21.15.2:6802/1690284817,v1:172.21.15.2:6803/1690284817]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-13T23:01:36.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:35 smithi047 ceph-mon[81243]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:01:36.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:35 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/2697952641' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:01:37.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:36 smithi002 ceph-mon[111294]: pgmap v50: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 50/264 objects degraded (18.939%) 2024-09-13T23:01:37.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:36 smithi002 ceph-mon[111294]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:01:37.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:36 smithi002 ceph-mon[111294]: osd.0 [v2:172.21.15.2:6802/1690284817,v1:172.21.15.2:6803/1690284817] boot 2024-09-13T23:01:37.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:36 smithi002 ceph-mon[111294]: osdmap e54: 6 total, 6 up, 6 in 2024-09-13T23:01:37.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:36 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:01:37.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:36 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:37.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:36 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:37.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:36 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:37.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:36 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:01:37.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:36 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:37.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:36 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:37.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:36 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:01:37.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:36 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:01:37.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:36 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:01:37.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:36 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T23:01:37.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:36 smithi002 ceph-mon[111294]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T23:01:37.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:36 smithi002 ceph-mon[111294]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-13T23:01:37.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:36 smithi047 ceph-mon[81243]: pgmap v50: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 50/264 objects degraded (18.939%) 2024-09-13T23:01:37.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:36 smithi047 ceph-mon[81243]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:01:37.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:36 smithi047 ceph-mon[81243]: osd.0 [v2:172.21.15.2:6802/1690284817,v1:172.21.15.2:6803/1690284817] boot 2024-09-13T23:01:37.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:36 smithi047 ceph-mon[81243]: osdmap e54: 6 total, 6 up, 6 in 2024-09-13T23:01:37.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:36 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T23:01:37.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:36 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:37.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:36 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:37.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:36 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:37.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:36 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:01:37.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:36 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:37.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:36 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:01:37.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:36 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:01:37.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:36 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:01:37.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:36 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:01:37.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:36 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T23:01:37.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:36 smithi047 ceph-mon[81243]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T23:01:37.415 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:36 smithi047 ceph-mon[81243]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-13T23:01:38.238 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:37 smithi047 ceph-mon[81243]: osdmap e55: 6 total, 6 up, 6 in 2024-09-13T23:01:38.238 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:37 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:38.238 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:37 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:01:38.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:37 smithi002 ceph-mon[111294]: osdmap e55: 6 total, 6 up, 6 in 2024-09-13T23:01:38.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:37 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:38.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:37 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:01:39.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:38 smithi047 ceph-mon[81243]: pgmap v53: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 50/264 objects degraded (18.939%) 2024-09-13T23:01:39.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:38 smithi002 ceph-mon[111294]: pgmap v53: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 50/264 objects degraded (18.939%) 2024-09-13T23:01:40.372 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:40 smithi047 ceph-mon[81243]: Health check update: Degraded data redundancy: 7/264 objects degraded (2.652%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T23:01:40.372 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:40 smithi047 ceph-mon[81243]: mgrmap e39: smithi002.yumtzz(active, since 92s), standbys: smithi047.gcymvd 2024-09-13T23:01:40.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:40 smithi002 ceph-mon[111294]: Health check update: Degraded data redundancy: 7/264 objects degraded (2.652%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T23:01:40.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:40 smithi002 ceph-mon[111294]: mgrmap e39: smithi002.yumtzz(active, since 92s), standbys: smithi047.gcymvd 2024-09-13T23:01:41.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:41 smithi002 ceph-mon[111294]: pgmap v54: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 170 B/s wr, 0 op/s; 7/264 objects degraded (2.652%) 2024-09-13T23:01:41.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:41 smithi047 ceph-mon[81243]: pgmap v54: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 170 B/s wr, 0 op/s; 7/264 objects degraded (2.652%) 2024-09-13T23:01:42.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:42 smithi047 ceph-mon[81243]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/264 objects degraded (2.652%), 3 pgs degraded) 2024-09-13T23:01:42.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:42 smithi002 ceph-mon[111294]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/264 objects degraded (2.652%), 3 pgs degraded) 2024-09-13T23:01:43.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:43 smithi047 ceph-mon[81243]: pgmap v55: 65 pgs: 65 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 446 B/s wr, 0 op/s 2024-09-13T23:01:43.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:43 smithi002 ceph-mon[111294]: pgmap v55: 65 pgs: 65 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 446 B/s wr, 0 op/s 2024-09-13T23:01:45.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:45 smithi047 ceph-mon[81243]: pgmap v56: 65 pgs: 65 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 383 B/s wr, 0 op/s 2024-09-13T23:01:45.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:45 smithi002 ceph-mon[111294]: pgmap v56: 65 pgs: 65 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 383 B/s wr, 0 op/s 2024-09-13T23:01:47.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:47 smithi047 ceph-mon[81243]: pgmap v57: 65 pgs: 65 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 310 B/s wr, 0 op/s 2024-09-13T23:01:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:47 smithi002 ceph-mon[111294]: pgmap v57: 65 pgs: 65 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 310 B/s wr, 0 op/s 2024-09-13T23:01:49.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:48 smithi047 ceph-mon[81243]: pgmap v58: 65 pgs: 65 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 941 B/s rd, 282 B/s wr, 0 op/s 2024-09-13T23:01:49.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:48 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:49.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:48 smithi002 ceph-mon[111294]: pgmap v58: 65 pgs: 65 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 941 B/s rd, 282 B/s wr, 0 op/s 2024-09-13T23:01:49.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:48 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:51.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:50 smithi047 ceph-mon[81243]: pgmap v59: 65 pgs: 65 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-13T23:01:51.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:50 smithi002 ceph-mon[111294]: pgmap v59: 65 pgs: 65 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-13T23:01:52.022 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:51 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T23:01:52.023 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:51 smithi002 ceph-mon[111294]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T23:01:52.023 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:51 smithi002 ceph-mon[111294]: Upgrade: osd.1 is safe to restart 2024-09-13T23:01:52.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:51 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T23:01:52.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:51 smithi047 ceph-mon[81243]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T23:01:52.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:51 smithi047 ceph-mon[81243]: Upgrade: osd.1 is safe to restart 2024-09-13T23:01:53.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:52 smithi047 ceph-mon[81243]: pgmap v60: 65 pgs: 65 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-13T23:01:53.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:52 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:53.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:52 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T23:01:53.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:52 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:53.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:52 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:53.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:52 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:01:53.213 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:52 smithi002 ceph-mon[111294]: pgmap v60: 65 pgs: 65 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-09-13T23:01:53.214 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:52 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:53.214 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:52 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T23:01:53.214 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:52 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:01:53.214 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:52 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:01:53.214 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:52 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:01:54.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:53 smithi047 ceph-mon[81243]: Upgrade: Updating osd.1 2024-09-13T23:01:54.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:53 smithi047 ceph-mon[81243]: Deploying daemon osd.1 on smithi002 2024-09-13T23:01:54.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:53 smithi002 ceph-mon[111294]: Upgrade: Updating osd.1 2024-09-13T23:01:54.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:53 smithi002 ceph-mon[111294]: Deploying daemon osd.1 on smithi002 2024-09-13T23:01:55.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:54 smithi047 ceph-mon[81243]: pgmap v61: 65 pgs: 65 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:01:55.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:54 smithi002 ceph-mon[111294]: pgmap v61: 65 pgs: 65 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:01:55.956 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:55 smithi002 systemd[1]: Stopping Ceph osd.1 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:01:56.500 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:56 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1[53733]: 2024-09-13T23:01:56.244+0000 7f573fc02700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:01:56.500 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:56 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1[53733]: 2024-09-13T23:01:56.244+0000 7f573fc02700 -1 osd.1 55 *** Got signal Terminated *** 2024-09-13T23:01:56.500 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:56 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1[53733]: 2024-09-13T23:01:56.244+0000 7f573fc02700 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:01:57.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:56 smithi047 ceph-mon[81243]: pgmap v62: 65 pgs: 65 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:01:57.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:56 smithi047 ceph-mon[81243]: osd.1 marked itself down and dead 2024-09-13T23:01:57.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:56 smithi002 ceph-mon[111294]: pgmap v62: 65 pgs: 65 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:01:57.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:56 smithi002 ceph-mon[111294]: osd.1 marked itself down and dead 2024-09-13T23:01:57.613 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:57 smithi002 podman[127519]: 2024-09-13 23:01:57.319635587 +0000 UTC m=+1.321025224 container died f0ac78c34831702a51ccf792b0195882726449aea163f962fcd6ce1ad7f466b6 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-13T23:01:57.870 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:57 smithi002 podman[127519]: 2024-09-13 23:01:57.711370396 +0000 UTC m=+1.712760026 container cleanup f0ac78c34831702a51ccf792b0195882726449aea163f962fcd6ce1ad7f466b6 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.vendor=CentOS, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T23:01:57.871 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:57 smithi002 bash[127519]: ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1 2024-09-13T23:01:58.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:57 smithi047 ceph-mon[81243]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:01:58.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:57 smithi047 ceph-mon[81243]: osdmap e56: 6 total, 5 up, 6 in 2024-09-13T23:01:58.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:57 smithi002 ceph-mon[111294]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:01:58.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:57 smithi002 ceph-mon[111294]: osdmap e56: 6 total, 5 up, 6 in 2024-09-13T23:01:58.250 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:57 smithi002 podman[127535]: 2024-09-13 23:01:57.954600363 +0000 UTC m=+0.630461894 container remove f0ac78c34831702a51ccf792b0195882726449aea163f962fcd6ce1ad7f466b6 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=HEAD, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.vendor=CentOS) 2024-09-13T23:01:58.558 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:58 smithi002 podman[127623]: 2024-09-13 23:01:58.1942809 +0000 UTC m=+0.016068470 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:01:58.558 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:58 smithi002 podman[127623]: 2024-09-13 23:01:58.322438995 +0000 UTC m=+0.144226602 container create 5ed5edfe8fb6758aa579132e74a635b2e221a43c6598e42001118d49c3df5c41 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, io.buildah.version=1.37.2) 2024-09-13T23:01:58.559 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:58 smithi002 podman[127623]: 2024-09-13 23:01:58.558045096 +0000 UTC m=+0.379832658 container init 5ed5edfe8fb6758aa579132e74a635b2e221a43c6598e42001118d49c3df5c41 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-13T23:01:58.878 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:58 smithi002 podman[127623]: 2024-09-13 23:01:58.561514761 +0000 UTC m=+0.383302332 container start 5ed5edfe8fb6758aa579132e74a635b2e221a43c6598e42001118d49c3df5c41 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:01:58.878 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:58 smithi002 podman[127623]: 2024-09-13 23:01:58.633132391 +0000 UTC m=+0.454919968 container attach 5ed5edfe8fb6758aa579132e74a635b2e221a43c6598e42001118d49c3df5c41 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T23:01:58.878 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:58 smithi002 podman[127623]: 2024-09-13 23:01:58.755748398 +0000 UTC m=+0.577535960 container died 5ed5edfe8fb6758aa579132e74a635b2e221a43c6598e42001118d49c3df5c41 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-13T23:01:59.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:58 smithi047 ceph-mon[81243]: pgmap v64: 65 pgs: 12 stale+active+clean, 53 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T23:01:59.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:58 smithi047 ceph-mon[81243]: osdmap e57: 6 total, 5 up, 6 in 2024-09-13T23:01:59.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:58 smithi002 ceph-mon[111294]: pgmap v64: 65 pgs: 12 stale+active+clean, 53 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T23:01:59.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:58 smithi002 ceph-mon[111294]: osdmap e57: 6 total, 5 up, 6 in 2024-09-13T23:01:59.750 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:59 smithi002 podman[127646]: 2024-09-13 23:01:59.379073248 +0000 UTC m=+0.617768506 container remove 5ed5edfe8fb6758aa579132e74a635b2e221a43c6598e42001118d49c3df5c41 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-09-13T23:01:59.750 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:59 smithi002 systemd[1]: ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-13T23:01:59.750 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:59 smithi002 systemd[1]: Stopped Ceph osd.1 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T23:01:59.750 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:59 smithi002 systemd[1]: ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.1.service: Consumed 1min 878ms CPU time. 2024-09-13T23:01:59.750 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:59 smithi002 systemd[1]: Starting Ceph osd.1 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:02:00.116 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:01:59 smithi002 ceph-mon[111294]: Health check failed: Degraded data redundancy: 32/264 objects degraded (12.121%), 11 pgs degraded (PG_DEGRADED) 2024-09-13T23:02:00.117 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:59 smithi002 podman[127745]: 2024-09-13 23:01:59.737098505 +0000 UTC m=+0.016614814 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:02:00.117 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:01:59 smithi002 podman[127745]: 2024-09-13 23:01:59.879979689 +0000 UTC m=+0.159495991 container create c288a6fc3b8619c76935b2c0e1f2798e00adf59e07ac5696afd7740b1912310a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T23:02:00.117 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:00 smithi002 podman[127745]: 2024-09-13 23:02:00.116309806 +0000 UTC m=+0.395826106 container init c288a6fc3b8619c76935b2c0e1f2798e00adf59e07ac5696afd7740b1912310a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-activate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:02:00.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:01:59 smithi047 ceph-mon[81243]: Health check failed: Degraded data redundancy: 32/264 objects degraded (12.121%), 11 pgs degraded (PG_DEGRADED) 2024-09-13T23:02:00.500 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:00 smithi002 podman[127745]: 2024-09-13 23:02:00.119942504 +0000 UTC m=+0.399458810 container start c288a6fc3b8619c76935b2c0e1f2798e00adf59e07ac5696afd7740b1912310a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-ecab7be, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:02:00.500 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:00 smithi002 podman[127745]: 2024-09-13 23:02:00.199439673 +0000 UTC m=+0.478955998 container attach c288a6fc3b8619c76935b2c0e1f2798e00adf59e07ac5696afd7740b1912310a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-13T23:02:00.501 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:00 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-activate[127760]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:02:00.501 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:00 smithi002 bash[127745]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:02:00.501 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:00 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-activate[127760]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:02:00.501 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:00 smithi002 bash[127745]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:02:01.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:00 smithi002 ceph-mon[111294]: pgmap v66: 65 pgs: 18 active+undersized, 3 stale+active+clean, 11 active+undersized+degraded, 33 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 32/264 objects degraded (12.121%) 2024-09-13T23:02:01.250 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:01 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-activate[127760]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T23:02:01.250 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:01 smithi002 bash[127745]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T23:02:01.250 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:01 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-activate[127760]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T23:02:01.251 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:01 smithi002 bash[127745]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T23:02:01.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:00 smithi047 ceph-mon[81243]: pgmap v66: 65 pgs: 18 active+undersized, 3 stale+active+clean, 11 active+undersized+degraded, 33 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 32/264 objects degraded (12.121%) 2024-09-13T23:02:01.620 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:01 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-activate[127760]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T23:02:01.620 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:01 smithi002 bash[127745]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T23:02:01.621 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:01 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-activate[127760]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T23:02:01.621 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:01 smithi002 bash[127745]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T23:02:01.621 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:01 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-activate[127760]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T23:02:01.621 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:01 smithi002 bash[127745]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T23:02:01.621 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:01 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-activate[127760]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T23:02:01.621 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:01 smithi002 bash[127745]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T23:02:01.621 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:01 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-activate[127760]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T23:02:01.621 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:01 smithi002 bash[127745]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T23:02:01.621 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:01 smithi002 podman[127745]: 2024-09-13 23:02:01.330203155 +0000 UTC m=+1.609719457 container died c288a6fc3b8619c76935b2c0e1f2798e00adf59e07ac5696afd7740b1912310a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-13T23:02:02.288 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:02 smithi002 podman[127910]: 2024-09-13 23:02:02.037443022 +0000 UTC m=+0.701033838 container remove c288a6fc3b8619c76935b2c0e1f2798e00adf59e07ac5696afd7740b1912310a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-13T23:02:02.288 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:02 smithi002 podman[127968]: 2024-09-13 23:02:02.163356805 +0000 UTC m=+0.017572971 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:02:02.288 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:02 smithi002 podman[127968]: 2024-09-13 23:02:02.288319652 +0000 UTC m=+0.142535849 container create 6f5ae2cfa81895a3081b5e931fc894a2450905aad20bfc2211264cf7f2f9122c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-13T23:02:02.543 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:02 smithi002 podman[127968]: 2024-09-13 23:02:02.515638405 +0000 UTC m=+0.369854559 container init 6f5ae2cfa81895a3081b5e931fc894a2450905aad20bfc2211264cf7f2f9122c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T23:02:02.543 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:02 smithi002 podman[127968]: 2024-09-13 23:02:02.518976235 +0000 UTC m=+0.373192399 container start 6f5ae2cfa81895a3081b5e931fc894a2450905aad20bfc2211264cf7f2f9122c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-13T23:02:03.000 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:02 smithi002 ceph-osd[127987]: -- 172.21.15.2:0/30437137 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55add36721e0 con 0x55add3608000 2024-09-13T23:02:03.000 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:02 smithi002 bash[127968]: 6f5ae2cfa81895a3081b5e931fc894a2450905aad20bfc2211264cf7f2f9122c 2024-09-13T23:02:03.000 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:02 smithi002 systemd[1]: Started Ceph osd.1 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T23:02:04.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:03 smithi002 ceph-mon[111294]: pgmap v67: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 34/264 objects degraded (12.879%) 2024-09-13T23:02:04.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:04.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:04.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:02:04.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:03 smithi047 ceph-mon[81243]: pgmap v67: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 34/264 objects degraded (12.879%) 2024-09-13T23:02:04.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:04.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:04.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:02:04.750 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:04 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1[127983]: 2024-09-13T23:02:04.400+0000 7f06a513a640 -1 Falling back to public interface 2024-09-13T23:02:05.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.807+0000 7fb01cbd7700 1 -- 172.21.15.2:0/2482020317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0180ffda0 msgr2=0x7fb018100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:05.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.807+0000 7fb01cbd7700 1 --2- 172.21.15.2:0/2482020317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0180ffda0 0x7fb018100180 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb008009910 tx=0x7fb008009c20 comp rx=0 tx=0).stop 2024-09-13T23:02:05.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.807+0000 7fb01cbd7700 1 -- 172.21.15.2:0/2482020317 shutdown_connections 2024-09-13T23:02:05.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.807+0000 7fb01cbd7700 1 --2- 172.21.15.2:0/2482020317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb018100750 0x7fb0181047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:05.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.807+0000 7fb01cbd7700 1 --2- 172.21.15.2:0/2482020317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0180ffda0 0x7fb018100180 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:05.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.807+0000 7fb01cbd7700 1 -- 172.21.15.2:0/2482020317 >> 172.21.15.2:0/2482020317 conn(0x7fb0180fb650 msgr2=0x7fb0180fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:05.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.807+0000 7fb01cbd7700 1 -- 172.21.15.2:0/2482020317 shutdown_connections 2024-09-13T23:02:05.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.807+0000 7fb01cbd7700 1 -- 172.21.15.2:0/2482020317 wait complete. 2024-09-13T23:02:05.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.807+0000 7fb01cbd7700 1 Processor -- start 2024-09-13T23:02:05.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.808+0000 7fb01cbd7700 1 -- start start 2024-09-13T23:02:05.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.808+0000 7fb01cbd7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0180ffda0 0x7fb01819c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:05.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.808+0000 7fb01cbd7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb018100750 0x7fb01819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:05.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.808+0000 7fb01cbd7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01819d2b0 con 0x7fb018100750 2024-09-13T23:02:05.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.808+0000 7fb01cbd7700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb018196760 con 0x7fb0180ffda0 2024-09-13T23:02:05.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.808+0000 7fb015d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb018100750 0x7fb01819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:05.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.808+0000 7fb015d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb018100750 0x7fb01819cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41858/0 (socket says 172.21.15.2:41858) 2024-09-13T23:02:05.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.808+0000 7fb015d9b700 1 -- 172.21.15.2:0/2120261454 learned_addr learned my addr 172.21.15.2:0/2120261454 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:02:05.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.808+0000 7fb01659c700 1 --2- 172.21.15.2:0/2120261454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0180ffda0 0x7fb01819c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:05.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.808+0000 7fb015d9b700 1 -- 172.21.15.2:0/2120261454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0180ffda0 msgr2=0x7fb01819c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:05.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.808+0000 7fb015d9b700 1 --2- 172.21.15.2:0/2120261454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0180ffda0 0x7fb01819c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:05.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.808+0000 7fb015d9b700 1 -- 172.21.15.2:0/2120261454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0080095f0 con 0x7fb018100750 2024-09-13T23:02:05.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.808+0000 7fb015d9b700 1 --2- 172.21.15.2:0/2120261454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb018100750 0x7fb01819cc20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00d8d0 tx=0x7fb00c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:05.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.809+0000 7fb0077fe700 1 -- 172.21.15.2:0/2120261454 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb00c004a00 con 0x7fb018100750 2024-09-13T23:02:05.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.809+0000 7fb0077fe700 1 -- 172.21.15.2:0/2120261454 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb00c0054e0 con 0x7fb018100750 2024-09-13T23:02:05.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.809+0000 7fb01cbd7700 1 -- 172.21.15.2:0/2120261454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb018196a40 con 0x7fb018100750 2024-09-13T23:02:05.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.809+0000 7fb0077fe700 1 -- 172.21.15.2:0/2120261454 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb00c00fc60 con 0x7fb018100750 2024-09-13T23:02:05.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.809+0000 7fb01cbd7700 1 -- 172.21.15.2:0/2120261454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb018196f90 con 0x7fb018100750 2024-09-13T23:02:05.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.810+0000 7fb01cbd7700 1 -- 172.21.15.2:0/2120261454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01804f2e0 con 0x7fb018100750 2024-09-13T23:02:05.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.810+0000 7fb0077fe700 1 -- 172.21.15.2:0/2120261454 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fb00c00fdc0 con 0x7fb018100750 2024-09-13T23:02:05.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.811+0000 7fb0077fe700 1 --2- 172.21.15.2:0/2120261454 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fb00006e680 0x7fb000070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:05.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.811+0000 7fb0077fe700 1 -- 172.21.15.2:0/2120261454 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb00c08e410 con 0x7fb018100750 2024-09-13T23:02:05.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.811+0000 7fb01659c700 1 --2- 172.21.15.2:0/2120261454 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fb00006e680 0x7fb000070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:05.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.811+0000 7fb01659c700 1 --2- 172.21.15.2:0/2120261454 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fb00006e680 0x7fb000070b40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb00800b5c0 tx=0x7fb00801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:05.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:05.815+0000 7fb0077fe700 1 -- 172.21.15.2:0/2120261454 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb00c05b210 con 0x7fb018100750 2024-09-13T23:02:05.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:05 smithi047 ceph-mon[81243]: pgmap v68: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 34/264 objects degraded (12.879%) 2024-09-13T23:02:05.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:05 smithi002 ceph-mon[111294]: pgmap v68: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 34/264 objects degraded (12.879%) 2024-09-13T23:02:06.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.061+0000 7fb01cbd7700 1 -- 172.21.15.2:0/2120261454 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb018197200 con 0x7fb00006e680 2024-09-13T23:02:06.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.062+0000 7fb0077fe700 1 -- 172.21.15.2:0/2120261454 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb018197200 con 0x7fb00006e680 2024-09-13T23:02:06.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.064+0000 7fb01cbd7700 1 -- 172.21.15.2:0/2120261454 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fb00006e680 msgr2=0x7fb000070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:06.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.064+0000 7fb01cbd7700 1 --2- 172.21.15.2:0/2120261454 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fb00006e680 0x7fb000070b40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb00800b5c0 tx=0x7fb00801a040 comp rx=0 tx=0).stop 2024-09-13T23:02:06.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.064+0000 7fb01cbd7700 1 -- 172.21.15.2:0/2120261454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb018100750 msgr2=0x7fb01819cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:06.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.064+0000 7fb01cbd7700 1 --2- 172.21.15.2:0/2120261454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb018100750 0x7fb01819cc20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00d8d0 tx=0x7fb00c00dbe0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.064+0000 7fb01cbd7700 1 -- 172.21.15.2:0/2120261454 shutdown_connections 2024-09-13T23:02:06.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.064+0000 7fb01cbd7700 1 --2- 172.21.15.2:0/2120261454 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fb00006e680 0x7fb000070b40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.064+0000 7fb01cbd7700 1 --2- 172.21.15.2:0/2120261454 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0180ffda0 0x7fb01819c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.064+0000 7fb01cbd7700 1 --2- 172.21.15.2:0/2120261454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb018100750 0x7fb01819cc20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.064+0000 7fb01cbd7700 1 -- 172.21.15.2:0/2120261454 >> 172.21.15.2:0/2120261454 conn(0x7fb0180fb650 msgr2=0x7fb018104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:06.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.065+0000 7fb01cbd7700 1 -- 172.21.15.2:0/2120261454 shutdown_connections 2024-09-13T23:02:06.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.065+0000 7fb01cbd7700 1 -- 172.21.15.2:0/2120261454 wait complete. 2024-09-13T23:02:06.080 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T23:02:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.190+0000 7fdc6d092700 1 -- 172.21.15.2:0/1895478768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc68101840 msgr2=0x7fdc68105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.190+0000 7fdc6d092700 1 --2- 172.21.15.2:0/1895478768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc68101840 0x7fdc68105890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009910 tx=0x7fdc50009c20 comp rx=0 tx=0).stop 2024-09-13T23:02:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.190+0000 7fdc6d092700 1 -- 172.21.15.2:0/1895478768 shutdown_connections 2024-09-13T23:02:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.190+0000 7fdc6d092700 1 --2- 172.21.15.2:0/1895478768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc68101840 0x7fdc68105890 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.190+0000 7fdc6d092700 1 --2- 172.21.15.2:0/1895478768 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc68100e90 0x7fdc68101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.190+0000 7fdc6d092700 1 -- 172.21.15.2:0/1895478768 >> 172.21.15.2:0/1895478768 conn(0x7fdc680fc740 msgr2=0x7fdc680feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.190+0000 7fdc6d092700 1 -- 172.21.15.2:0/1895478768 shutdown_connections 2024-09-13T23:02:06.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.190+0000 7fdc6d092700 1 -- 172.21.15.2:0/1895478768 wait complete. 2024-09-13T23:02:06.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.191+0000 7fdc6d092700 1 Processor -- start 2024-09-13T23:02:06.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.191+0000 7fdc6d092700 1 -- start start 2024-09-13T23:02:06.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.191+0000 7fdc6d092700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc68100e90 0x7fdc68073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:06.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.191+0000 7fdc6d092700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc68101840 0x7fdc680735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:06.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.191+0000 7fdc6d092700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc68073b10 con 0x7fdc68101840 2024-09-13T23:02:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.191+0000 7fdc6d092700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc68073c50 con 0x7fdc68100e90 2024-09-13T23:02:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.191+0000 7fdc6659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc68101840 0x7fdc680735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.191+0000 7fdc6659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc68101840 0x7fdc680735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41882/0 (socket says 172.21.15.2:41882) 2024-09-13T23:02:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.191+0000 7fdc6659c700 1 -- 172.21.15.2:0/3644868155 learned_addr learned my addr 172.21.15.2:0/3644868155 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:02:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.192+0000 7fdc66d9d700 1 --2- 172.21.15.2:0/3644868155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc68100e90 0x7fdc68073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.192+0000 7fdc6659c700 1 -- 172.21.15.2:0/3644868155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc68100e90 msgr2=0x7fdc68073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.192+0000 7fdc6659c700 1 --2- 172.21.15.2:0/3644868155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc68100e90 0x7fdc68073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.192+0000 7fdc6659c700 1 -- 172.21.15.2:0/3644868155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc500095f0 con 0x7fdc68101840 2024-09-13T23:02:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.192+0000 7fdc6659c700 1 --2- 172.21.15.2:0/3644868155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc68101840 0x7fdc680735d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdc500092e0 tx=0x7fdc5000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.192+0000 7fdc5ffff700 1 -- 172.21.15.2:0/3644868155 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc5001d070 con 0x7fdc68101840 2024-09-13T23:02:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.192+0000 7fdc5ffff700 1 -- 172.21.15.2:0/3644868155 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdc5000f460 con 0x7fdc68101840 2024-09-13T23:02:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.192+0000 7fdc6d092700 1 -- 172.21.15.2:0/3644868155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc68073ed0 con 0x7fdc68101840 2024-09-13T23:02:06.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.192+0000 7fdc5ffff700 1 -- 172.21.15.2:0/3644868155 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc500175f0 con 0x7fdc68101840 2024-09-13T23:02:06.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.192+0000 7fdc6d092700 1 -- 172.21.15.2:0/3644868155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc681a2eb0 con 0x7fdc68101840 2024-09-13T23:02:06.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.193+0000 7fdc6d092700 1 -- 172.21.15.2:0/3644868155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc681091e0 con 0x7fdc68101840 2024-09-13T23:02:06.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.194+0000 7fdc5ffff700 1 -- 172.21.15.2:0/3644868155 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fdc5000f5d0 con 0x7fdc68101840 2024-09-13T23:02:06.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.194+0000 7fdc5ffff700 1 --2- 172.21.15.2:0/3644868155 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fdc5406e6d0 0x7fdc54070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:06.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.194+0000 7fdc5ffff700 1 -- 172.21.15.2:0/3644868155 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fdc5008fba0 con 0x7fdc68101840 2024-09-13T23:02:06.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.194+0000 7fdc66d9d700 1 --2- 172.21.15.2:0/3644868155 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fdc5406e6d0 0x7fdc54070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:06.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.195+0000 7fdc66d9d700 1 --2- 172.21.15.2:0/3644868155 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fdc5406e6d0 0x7fdc54070b90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009f20 tx=0x7fdc580094f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:06.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.199+0000 7fdc5ffff700 1 -- 172.21.15.2:0/3644868155 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdc50058d50 con 0x7fdc68101840 2024-09-13T23:02:06.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.456+0000 7fdc6d092700 1 -- 172.21.15.2:0/3644868155 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc680746a0 con 0x7fdc5406e6d0 2024-09-13T23:02:06.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.457+0000 7fdc5ffff700 1 -- 172.21.15.2:0/3644868155 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fdc680746a0 con 0x7fdc5406e6d0 2024-09-13T23:02:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.460+0000 7fdc6d092700 1 -- 172.21.15.2:0/3644868155 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fdc5406e6d0 msgr2=0x7fdc54070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.460+0000 7fdc6d092700 1 --2- 172.21.15.2:0/3644868155 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fdc5406e6d0 0x7fdc54070b90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009f20 tx=0x7fdc580094f0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.460+0000 7fdc6d092700 1 -- 172.21.15.2:0/3644868155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc68101840 msgr2=0x7fdc680735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.460+0000 7fdc6d092700 1 --2- 172.21.15.2:0/3644868155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc68101840 0x7fdc680735d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdc500092e0 tx=0x7fdc5000be20 comp rx=0 tx=0).stop 2024-09-13T23:02:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.460+0000 7fdc6d092700 1 -- 172.21.15.2:0/3644868155 shutdown_connections 2024-09-13T23:02:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.460+0000 7fdc6d092700 1 --2- 172.21.15.2:0/3644868155 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fdc5406e6d0 0x7fdc54070b90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.460+0000 7fdc6d092700 1 --2- 172.21.15.2:0/3644868155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc68100e90 0x7fdc68073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.460+0000 7fdc6d092700 1 --2- 172.21.15.2:0/3644868155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc68101840 0x7fdc680735d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.460+0000 7fdc6d092700 1 -- 172.21.15.2:0/3644868155 >> 172.21.15.2:0/3644868155 conn(0x7fdc680fc740 msgr2=0x7fdc680fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.460+0000 7fdc6d092700 1 -- 172.21.15.2:0/3644868155 shutdown_connections 2024-09-13T23:02:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.460+0000 7fdc6d092700 1 -- 172.21.15.2:0/3644868155 wait complete. 2024-09-13T23:02:06.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.574+0000 7eff9dab4700 1 -- 172.21.15.2:0/2206786340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff98068580 msgr2=0x7eff980689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:06.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.574+0000 7eff9dab4700 1 --2- 172.21.15.2:0/2206786340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff98068580 0x7eff980689e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009910 tx=0x7eff8c009c20 comp rx=0 tx=0).stop 2024-09-13T23:02:06.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.574+0000 7eff9dab4700 1 -- 172.21.15.2:0/2206786340 shutdown_connections 2024-09-13T23:02:06.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.574+0000 7eff9dab4700 1 --2- 172.21.15.2:0/2206786340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff98068580 0x7eff980689e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.574+0000 7eff9dab4700 1 --2- 172.21.15.2:0/2206786340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff98106cd0 0x7eff981070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.574+0000 7eff9dab4700 1 -- 172.21.15.2:0/2206786340 >> 172.21.15.2:0/2206786340 conn(0x7eff98075670 msgr2=0x7eff98075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:06.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.574+0000 7eff9dab4700 1 -- 172.21.15.2:0/2206786340 shutdown_connections 2024-09-13T23:02:06.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.574+0000 7eff9dab4700 1 -- 172.21.15.2:0/2206786340 wait complete. 2024-09-13T23:02:06.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.575+0000 7eff9dab4700 1 Processor -- start 2024-09-13T23:02:06.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.575+0000 7eff9dab4700 1 -- start start 2024-09-13T23:02:06.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.575+0000 7eff9dab4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff98068580 0x7eff9819c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.575+0000 7eff9dab4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff98106cd0 0x7eff9819cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.575+0000 7eff9dab4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9819d200 con 0x7eff98068580 2024-09-13T23:02:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.575+0000 7eff9dab4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff981966b0 con 0x7eff98106cd0 2024-09-13T23:02:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.575+0000 7eff977fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff98068580 0x7eff9819c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.575+0000 7eff977fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff98068580 0x7eff9819c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41902/0 (socket says 172.21.15.2:41902) 2024-09-13T23:02:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.576+0000 7eff977fe700 1 -- 172.21.15.2:0/1555011301 learned_addr learned my addr 172.21.15.2:0/1555011301 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:02:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.576+0000 7eff96ffd700 1 --2- 172.21.15.2:0/1555011301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff98106cd0 0x7eff9819cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.576+0000 7eff977fe700 1 -- 172.21.15.2:0/1555011301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff98106cd0 msgr2=0x7eff9819cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.576+0000 7eff977fe700 1 --2- 172.21.15.2:0/1555011301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff98106cd0 0x7eff9819cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.576+0000 7eff977fe700 1 -- 172.21.15.2:0/1555011301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c0095f0 con 0x7eff98068580 2024-09-13T23:02:06.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.576+0000 7eff977fe700 1 --2- 172.21.15.2:0/1555011301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff98068580 0x7eff9819c630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff8800d8d0 tx=0x7eff8800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:06.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.576+0000 7eff94ff9700 1 -- 172.21.15.2:0/1555011301 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff880098a0 con 0x7eff98068580 2024-09-13T23:02:06.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.576+0000 7eff94ff9700 1 -- 172.21.15.2:0/1555011301 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff88010460 con 0x7eff98068580 2024-09-13T23:02:06.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.576+0000 7eff9dab4700 1 -- 172.21.15.2:0/1555011301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff98196990 con 0x7eff98068580 2024-09-13T23:02:06.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.576+0000 7eff9dab4700 1 -- 172.21.15.2:0/1555011301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff98196ee0 con 0x7eff98068580 2024-09-13T23:02:06.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.576+0000 7eff94ff9700 1 -- 172.21.15.2:0/1555011301 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff8800f5f0 con 0x7eff98068580 2024-09-13T23:02:06.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.577+0000 7eff9dab4700 1 -- 172.21.15.2:0/1555011301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff84005320 con 0x7eff98068580 2024-09-13T23:02:06.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.578+0000 7eff94ff9700 1 -- 172.21.15.2:0/1555011301 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7eff88009a00 con 0x7eff98068580 2024-09-13T23:02:06.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.578+0000 7eff94ff9700 1 --2- 172.21.15.2:0/1555011301 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7eff8006e680 0x7eff80070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:06.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.578+0000 7eff94ff9700 1 -- 172.21.15.2:0/1555011301 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7eff8808e450 con 0x7eff98068580 2024-09-13T23:02:06.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.578+0000 7eff96ffd700 1 --2- 172.21.15.2:0/1555011301 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7eff8006e680 0x7eff80070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:06.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.579+0000 7eff96ffd700 1 --2- 172.21.15.2:0/1555011301 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7eff8006e680 0x7eff80070b40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7eff980fe200 tx=0x7eff8c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.583+0000 7eff94ff9700 1 -- 172.21.15.2:0/1555011301 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7eff8805b1d0 con 0x7eff98068580 2024-09-13T23:02:06.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.805+0000 7eff9dab4700 1 -- 172.21.15.2:0/1555011301 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7eff84000bf0 con 0x7eff8006e680 2024-09-13T23:02:06.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.820+0000 7eff94ff9700 1 -- 172.21.15.2:0/1555011301 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7eff84000bf0 con 0x7eff8006e680 2024-09-13T23:02:06.821 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:02:06.821 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (3m) 34s ago 14m 26.9M - 0.25.0 c8568f914cd2 f570a73274bc 2024-09-13T23:02:06.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (14m) 34s ago 14m 8086k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T23:02:06.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (13m) 57s ago 13m 8044k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T23:02:06.822 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (64s) 34s ago 14m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 427cd38a7d88 2024-09-13T23:02:06.822 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (60s) 57s ago 13m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 ce5a1df96005 2024-09-13T23:02:06.822 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (3m) 34s ago 14m 75.9M - 9.4.12 2bacad6d85d8 650673516b69 2024-09-13T23:02:06.822 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (8m) 34s ago 8m 16.8M - 18.2.1 5be31c24972a 59e9c88c31ca 2024-09-13T23:02:06.822 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (8m) 34s ago 8m 91.0M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T23:02:06.822 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (8m) 57s ago 8m 150M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T23:02:06.822 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (8m) 57s ago 8m 18.9M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T23:02:06.822 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 running (5m) 34s ago 15m 495M - 19.1.1-324-gecab7be5 0652ff2b5d78 7a8aa9de37e4 2024-09-13T23:02:06.823 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (4m) 57s ago 13m 439M - 19.1.1-324-gecab7be5 0652ff2b5d78 13fa6f3b5a8a 2024-09-13T23:02:06.823 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (2m) 34s ago 15m 45.3M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 db0ef6c509cf 2024-09-13T23:02:06.823 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (103s) 57s ago 13m 35.3M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 ea0c2a2e0e1a 2024-09-13T23:02:06.823 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (4m) 34s ago 14m 14.8M - 1.5.0 0da6a335fe13 f3eae5f90ab8 2024-09-13T23:02:06.823 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (4m) 57s ago 13m 16.0M - 1.5.0 0da6a335fe13 a5c7d7f1eaa5 2024-09-13T23:02:06.823 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (40s) 34s ago 12m 11.5M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 0ca6dd66fa68 2024-09-13T23:02:06.823 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 starting - - - 1217M 2024-09-13T23:02:06.823 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (11m) 34s ago 11m 189M 1217M 18.2.1 5be31c24972a 9a2f4f6decfb 2024-09-13T23:02:06.823 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (11m) 57s ago 11m 259M 2241M 18.2.1 5be31c24972a fb455cc4c571 2024-09-13T23:02:06.823 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (10m) 57s ago 10m 223M 2241M 18.2.1 5be31c24972a f1bdc2c50535 2024-09-13T23:02:06.823 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (10m) 57s ago 10m 199M 2241M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T23:02:06.824 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (3m) 34s ago 13m 72.4M - 2.43.0 a07b618ecd1d aa241d1048de 2024-09-13T23:02:06.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.822+0000 7eff9dab4700 1 -- 172.21.15.2:0/1555011301 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7eff8006e680 msgr2=0x7eff80070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:06.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.822+0000 7eff9dab4700 1 --2- 172.21.15.2:0/1555011301 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7eff8006e680 0x7eff80070b40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7eff980fe200 tx=0x7eff8c01a040 comp rx=0 tx=0).stop 2024-09-13T23:02:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.822+0000 7eff9dab4700 1 -- 172.21.15.2:0/1555011301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff98068580 msgr2=0x7eff9819c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.822+0000 7eff9dab4700 1 --2- 172.21.15.2:0/1555011301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff98068580 0x7eff9819c630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff8800d8d0 tx=0x7eff8800dbe0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.822+0000 7eff9dab4700 1 -- 172.21.15.2:0/1555011301 shutdown_connections 2024-09-13T23:02:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.822+0000 7eff9dab4700 1 --2- 172.21.15.2:0/1555011301 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7eff8006e680 0x7eff80070b40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.822+0000 7eff9dab4700 1 --2- 172.21.15.2:0/1555011301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff98068580 0x7eff9819c630 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.822+0000 7eff9dab4700 1 --2- 172.21.15.2:0/1555011301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff98106cd0 0x7eff9819cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.822+0000 7eff9dab4700 1 -- 172.21.15.2:0/1555011301 >> 172.21.15.2:0/1555011301 conn(0x7eff98075670 msgr2=0x7eff980feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.823+0000 7eff9dab4700 1 -- 172.21.15.2:0/1555011301 shutdown_connections 2024-09-13T23:02:06.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.823+0000 7eff9dab4700 1 -- 172.21.15.2:0/1555011301 wait complete. 2024-09-13T23:02:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.939+0000 7fa9a6495700 1 -- 172.21.15.2:0/70831230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9a0101e60 msgr2=0x7fa9a0102240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.939+0000 7fa9a6495700 1 --2- 172.21.15.2:0/70831230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9a0101e60 0x7fa9a0102240 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa990009910 tx=0x7fa990009c20 comp rx=0 tx=0).stop 2024-09-13T23:02:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.939+0000 7fa9a6495700 1 -- 172.21.15.2:0/70831230 shutdown_connections 2024-09-13T23:02:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.939+0000 7fa9a6495700 1 --2- 172.21.15.2:0/70831230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a0102780 0x7fa9a010ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.939+0000 7fa9a6495700 1 --2- 172.21.15.2:0/70831230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9a0101e60 0x7fa9a0102240 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.939+0000 7fa9a6495700 1 -- 172.21.15.2:0/70831230 >> 172.21.15.2:0/70831230 conn(0x7fa9a00fb650 msgr2=0x7fa9a00fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.939+0000 7fa9a6495700 1 -- 172.21.15.2:0/70831230 shutdown_connections 2024-09-13T23:02:06.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.939+0000 7fa9a6495700 1 -- 172.21.15.2:0/70831230 wait complete. 2024-09-13T23:02:06.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.939+0000 7fa9a6495700 1 Processor -- start 2024-09-13T23:02:06.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.940+0000 7fa9a6495700 1 -- start start 2024-09-13T23:02:06.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.940+0000 7fa9a6495700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a0101e60 0x7fa9a019c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:06.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.940+0000 7fa9a6495700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9a0102780 0x7fa9a019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:06.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.940+0000 7fa9a6495700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a019d190 con 0x7fa9a0102780 2024-09-13T23:02:06.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.940+0000 7fa9a6495700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a0196720 con 0x7fa9a0101e60 2024-09-13T23:02:06.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.940+0000 7fa997fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9a0102780 0x7fa9a019cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:06.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.940+0000 7fa997fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9a0102780 0x7fa9a019cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41916/0 (socket says 172.21.15.2:41916) 2024-09-13T23:02:06.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.940+0000 7fa997fff700 1 -- 172.21.15.2:0/3457481281 learned_addr learned my addr 172.21.15.2:0/3457481281 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:02:06.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.940+0000 7fa99ffff700 1 --2- 172.21.15.2:0/3457481281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a0101e60 0x7fa9a019c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:06.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.940+0000 7fa997fff700 1 -- 172.21.15.2:0/3457481281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a0101e60 msgr2=0x7fa9a019c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:06.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.940+0000 7fa997fff700 1 --2- 172.21.15.2:0/3457481281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a0101e60 0x7fa9a019c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:06.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.940+0000 7fa997fff700 1 -- 172.21.15.2:0/3457481281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9900095f0 con 0x7fa9a0102780 2024-09-13T23:02:06.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.940+0000 7fa997fff700 1 --2- 172.21.15.2:0/3457481281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9a0102780 0x7fa9a019cb90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa98800c960 tx=0x7fa98800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:06.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.940+0000 7fa99dffb700 1 -- 172.21.15.2:0/3457481281 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa988007a70 con 0x7fa9a0102780 2024-09-13T23:02:06.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.941+0000 7fa99dffb700 1 -- 172.21.15.2:0/3457481281 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa988007bd0 con 0x7fa9a0102780 2024-09-13T23:02:06.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.941+0000 7fa9a6495700 1 -- 172.21.15.2:0/3457481281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a0196a00 con 0x7fa9a0102780 2024-09-13T23:02:06.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.941+0000 7fa99dffb700 1 -- 172.21.15.2:0/3457481281 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9880186c0 con 0x7fa9a0102780 2024-09-13T23:02:06.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.941+0000 7fa9a6495700 1 -- 172.21.15.2:0/3457481281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a0196f50 con 0x7fa9a0102780 2024-09-13T23:02:06.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.942+0000 7fa9a6495700 1 -- 172.21.15.2:0/3457481281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a0108310 con 0x7fa9a0102780 2024-09-13T23:02:06.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.942+0000 7fa99dffb700 1 -- 172.21.15.2:0/3457481281 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fa98800faa0 con 0x7fa9a0102780 2024-09-13T23:02:06.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.943+0000 7fa99dffb700 1 --2- 172.21.15.2:0/3457481281 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa98c06e680 0x7fa98c070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:06.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.943+0000 7fa99dffb700 1 -- 172.21.15.2:0/3457481281 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa98808e600 con 0x7fa9a0102780 2024-09-13T23:02:06.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.943+0000 7fa99ffff700 1 --2- 172.21.15.2:0/3457481281 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa98c06e680 0x7fa98c070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:06.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.943+0000 7fa99ffff700 1 --2- 172.21.15.2:0/3457481281 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa98c06e680 0x7fa98c070b40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa990000c00 tx=0x7fa990005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:06.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:06.947+0000 7fa99dffb700 1 -- 172.21.15.2:0/3457481281 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa98805b0f0 con 0x7fa9a0102780 2024-09-13T23:02:07.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.259+0000 7fa9a6495700 1 -- 172.21.15.2:0/3457481281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa9a004f2e0 con 0x7fa9a0102780 2024-09-13T23:02:07.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.259+0000 7fa99dffb700 1 -- 172.21.15.2:0/3457481281 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7fa98805af10 con 0x7fa9a0102780 2024-09-13T23:02:07.260 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:02:07.260 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T23:02:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:02:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:02:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T23:02:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:02:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:02:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T23:02:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4, 2024-09-13T23:02:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T23:02:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:02:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T23:02:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-13T23:02:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:02:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T23:02:07.261 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 8, 2024-09-13T23:02:07.262 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 5 2024-09-13T23:02:07.262 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T23:02:07.262 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:02:07.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.262+0000 7fa9a6495700 1 -- 172.21.15.2:0/3457481281 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa98c06e680 msgr2=0x7fa98c070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.262+0000 7fa9a6495700 1 --2- 172.21.15.2:0/3457481281 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa98c06e680 0x7fa98c070b40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa990000c00 tx=0x7fa990005fd0 comp rx=0 tx=0).stop 2024-09-13T23:02:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.262+0000 7fa9a6495700 1 -- 172.21.15.2:0/3457481281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9a0102780 msgr2=0x7fa9a019cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.262+0000 7fa9a6495700 1 --2- 172.21.15.2:0/3457481281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9a0102780 0x7fa9a019cb90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa98800c960 tx=0x7fa98800cd20 comp rx=0 tx=0).stop 2024-09-13T23:02:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.262+0000 7fa9a6495700 1 -- 172.21.15.2:0/3457481281 shutdown_connections 2024-09-13T23:02:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.262+0000 7fa9a6495700 1 --2- 172.21.15.2:0/3457481281 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa98c06e680 0x7fa98c070b40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.262+0000 7fa9a6495700 1 --2- 172.21.15.2:0/3457481281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa9a0101e60 0x7fa9a019c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.262+0000 7fa9a6495700 1 --2- 172.21.15.2:0/3457481281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9a0102780 0x7fa9a019cb90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.262+0000 7fa9a6495700 1 -- 172.21.15.2:0/3457481281 >> 172.21.15.2:0/3457481281 conn(0x7fa9a00fb650 msgr2=0x7fa9a0105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.262+0000 7fa9a6495700 1 -- 172.21.15.2:0/3457481281 shutdown_connections 2024-09-13T23:02:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.262+0000 7fa9a6495700 1 -- 172.21.15.2:0/3457481281 wait complete. 2024-09-13T23:02:07.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.371+0000 7f8e278c3700 1 -- 172.21.15.2:0/2273833879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e20101850 msgr2=0x7f8e201058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:07.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.371+0000 7f8e278c3700 1 --2- 172.21.15.2:0/2273833879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e20101850 0x7f8e201058a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009910 tx=0x7f8e14009c20 comp rx=0 tx=0).stop 2024-09-13T23:02:07.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.371+0000 7f8e278c3700 1 -- 172.21.15.2:0/2273833879 shutdown_connections 2024-09-13T23:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.371+0000 7f8e278c3700 1 --2- 172.21.15.2:0/2273833879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e20101850 0x7f8e201058a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.371+0000 7f8e278c3700 1 --2- 172.21.15.2:0/2273833879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e20100ea0 0x7f8e20101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.371+0000 7f8e278c3700 1 -- 172.21.15.2:0/2273833879 >> 172.21.15.2:0/2273833879 conn(0x7f8e200fc750 msgr2=0x7f8e200feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.371+0000 7f8e278c3700 1 -- 172.21.15.2:0/2273833879 shutdown_connections 2024-09-13T23:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.371+0000 7f8e278c3700 1 -- 172.21.15.2:0/2273833879 wait complete. 2024-09-13T23:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.372+0000 7f8e278c3700 1 Processor -- start 2024-09-13T23:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.372+0000 7f8e278c3700 1 -- start start 2024-09-13T23:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.372+0000 7f8e278c3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e20100ea0 0x7f8e2019c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.372+0000 7f8e278c3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e20101850 0x7f8e2019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:07.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.372+0000 7f8e278c3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2019d350 con 0x7f8e20100ea0 2024-09-13T23:02:07.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.372+0000 7f8e278c3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e20196800 con 0x7f8e20101850 2024-09-13T23:02:07.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.372+0000 7f8e2565f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e20100ea0 0x7f8e2019c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:07.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.372+0000 7f8e2565f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e20100ea0 0x7f8e2019c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41936/0 (socket says 172.21.15.2:41936) 2024-09-13T23:02:07.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.372+0000 7f8e2565f700 1 -- 172.21.15.2:0/2633126907 learned_addr learned my addr 172.21.15.2:0/2633126907 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:02:07.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.372+0000 7f8e24e5e700 1 --2- 172.21.15.2:0/2633126907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e20101850 0x7f8e2019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:07.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.372+0000 7f8e2565f700 1 -- 172.21.15.2:0/2633126907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e20101850 msgr2=0x7f8e2019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:07.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.372+0000 7f8e2565f700 1 --2- 172.21.15.2:0/2633126907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e20101850 0x7f8e2019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:07.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.372+0000 7f8e2565f700 1 -- 172.21.15.2:0/2633126907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e140095f0 con 0x7f8e20100ea0 2024-09-13T23:02:07.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.373+0000 7f8e2565f700 1 --2- 172.21.15.2:0/2633126907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e20100ea0 0x7f8e2019c780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000b4b0 tx=0x7f8e1000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.373+0000 7f8e1e7fc700 1 -- 172.21.15.2:0/2633126907 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e10011800 con 0x7f8e20100ea0 2024-09-13T23:02:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.373+0000 7f8e1e7fc700 1 -- 172.21.15.2:0/2633126907 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e10011e20 con 0x7f8e20100ea0 2024-09-13T23:02:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.373+0000 7f8e278c3700 1 -- 172.21.15.2:0/2633126907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e20196ae0 con 0x7f8e20100ea0 2024-09-13T23:02:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.373+0000 7f8e1e7fc700 1 -- 172.21.15.2:0/2633126907 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e1000f2e0 con 0x7f8e20100ea0 2024-09-13T23:02:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.373+0000 7f8e278c3700 1 -- 172.21.15.2:0/2633126907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e20197030 con 0x7f8e20100ea0 2024-09-13T23:02:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.374+0000 7f8e278c3700 1 -- 172.21.15.2:0/2633126907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e201091d0 con 0x7f8e20100ea0 2024-09-13T23:02:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.374+0000 7f8e1e7fc700 1 -- 172.21.15.2:0/2633126907 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f8e10010380 con 0x7f8e20100ea0 2024-09-13T23:02:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.375+0000 7f8e1e7fc700 1 --2- 172.21.15.2:0/2633126907 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f8e0806e680 0x7f8e08070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.375+0000 7f8e1e7fc700 1 -- 172.21.15.2:0/2633126907 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8e1008e0d0 con 0x7f8e20100ea0 2024-09-13T23:02:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.375+0000 7f8e24e5e700 1 --2- 172.21.15.2:0/2633126907 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f8e0806e680 0x7f8e08070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:07.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.375+0000 7f8e24e5e700 1 --2- 172.21.15.2:0/2633126907 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f8e0806e680 0x7f8e08070b40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8e200fd0c0 tx=0x7f8e1401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:07.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.379+0000 7f8e1e7fc700 1 -- 172.21.15.2:0/2633126907 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8e1005af80 con 0x7f8e20100ea0 2024-09-13T23:02:07.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.647+0000 7f8e278c3700 1 -- 172.21.15.2:0/2633126907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8e2004f2e0 con 0x7f8e20100ea0 2024-09-13T23:02:07.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.647+0000 7f8e1e7fc700 1 -- 172.21.15.2:0/2633126907 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1938 (secure 0 0 0) 0x7f8e1005ab10 con 0x7f8e20100ea0 2024-09-13T23:02:07.648 INFO:teuthology.orchestra.run.smithi002.stdout:e16 2024-09-13T23:02:07.648 INFO:teuthology.orchestra.run.smithi002.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T23:02:07.649 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:02:07.649 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:02:07.649 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-13T23:02:07.649 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:02:07.649 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:02:07.649 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-13T23:02:07.649 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 16 2024-09-13T23:02:07.649 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:02:07.649 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-13T22:53:05.963265+0000 2024-09-13T23:02:07.649 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-13T22:53:25.072026+0000 2024-09-13T23:02:07.649 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-13T23:02:07.649 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-13T23:02:07.649 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-13T23:02:07.650 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-13T23:02:07.650 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-13T23:02:07.650 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-13T23:02:07.650 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-13T23:02:07.650 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-13T23:02:07.650 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 47 2024-09-13T23:02:07.650 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:02:07.650 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 1 2024-09-13T23:02:07.650 INFO:teuthology.orchestra.run.smithi002.stdout:in 0 2024-09-13T23:02:07.650 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24267} 2024-09-13T23:02:07.650 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-13T23:02:07.650 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-13T23:02:07.651 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-13T23:02:07.651 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-13T23:02:07.651 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-13T23:02:07.651 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-13T23:02:07.651 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-13T23:02:07.651 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-13T23:02:07.651 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-13T23:02:07.651 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 0 members: 2024-09-13T23:02:07.651 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.gxzkha{0:24267} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:02:07.651 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.gglyyr{0:14488} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.2:6828/2123560657,v1:172.21.15.2:6829/2123560657] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:02:07.651 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:02:07.651 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:02:07.651 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-13T23:02:07.651 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:02:07.652 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.auedll{-1:14500} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/1577962179,v1:172.21.15.2:6827/1577962179] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:02:07.652 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.nqvveh{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:02:07.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.650+0000 7f8e278c3700 1 -- 172.21.15.2:0/2633126907 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f8e0806e680 msgr2=0x7f8e08070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:07.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.650+0000 7f8e278c3700 1 --2- 172.21.15.2:0/2633126907 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f8e0806e680 0x7f8e08070b40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8e200fd0c0 tx=0x7f8e1401a040 comp rx=0 tx=0).stop 2024-09-13T23:02:07.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.650+0000 7f8e278c3700 1 -- 172.21.15.2:0/2633126907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e20100ea0 msgr2=0x7f8e2019c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:07.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.650+0000 7f8e278c3700 1 --2- 172.21.15.2:0/2633126907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e20100ea0 0x7f8e2019c780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000b4b0 tx=0x7f8e1000b870 comp rx=0 tx=0).stop 2024-09-13T23:02:07.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.650+0000 7f8e278c3700 1 -- 172.21.15.2:0/2633126907 shutdown_connections 2024-09-13T23:02:07.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.650+0000 7f8e278c3700 1 --2- 172.21.15.2:0/2633126907 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f8e0806e680 0x7f8e08070b40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:07.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.650+0000 7f8e278c3700 1 --2- 172.21.15.2:0/2633126907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e20100ea0 0x7f8e2019c780 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:07.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.650+0000 7f8e278c3700 1 --2- 172.21.15.2:0/2633126907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8e20101850 0x7f8e2019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:07.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.650+0000 7f8e278c3700 1 -- 172.21.15.2:0/2633126907 >> 172.21.15.2:0/2633126907 conn(0x7f8e200fc750 msgr2=0x7f8e200fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:07.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.650+0000 7f8e278c3700 1 -- 172.21.15.2:0/2633126907 shutdown_connections 2024-09-13T23:02:07.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.650+0000 7f8e278c3700 1 -- 172.21.15.2:0/2633126907 wait complete. 2024-09-13T23:02:07.653 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2024-09-13T23:02:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.782+0000 7f6bbb2f5700 1 -- 172.21.15.2:0/2580458334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4105bf0 msgr2=0x7f6bb4105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.782+0000 7f6bbb2f5700 1 --2- 172.21.15.2:0/2580458334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4105bf0 0x7f6bb4105fd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009910 tx=0x7f6bb0009c20 comp rx=0 tx=0).stop 2024-09-13T23:02:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.782+0000 7f6bbb2f5700 1 -- 172.21.15.2:0/2580458334 shutdown_connections 2024-09-13T23:02:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.782+0000 7f6bbb2f5700 1 --2- 172.21.15.2:0/2580458334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bb40ffb40 0x7f6bb40fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.782+0000 7f6bbb2f5700 1 --2- 172.21.15.2:0/2580458334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4105bf0 0x7f6bb4105fd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.782+0000 7f6bbb2f5700 1 -- 172.21.15.2:0/2580458334 >> 172.21.15.2:0/2580458334 conn(0x7f6bb40fb610 msgr2=0x7f6bb40fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.782+0000 7f6bbb2f5700 1 -- 172.21.15.2:0/2580458334 shutdown_connections 2024-09-13T23:02:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.782+0000 7f6bbb2f5700 1 -- 172.21.15.2:0/2580458334 wait complete. 2024-09-13T23:02:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.783+0000 7f6bbb2f5700 1 Processor -- start 2024-09-13T23:02:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.783+0000 7f6bbb2f5700 1 -- start start 2024-09-13T23:02:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.784+0000 7f6bbb2f5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bb40ffb40 0x7f6bb41976c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.784+0000 7f6bbb2f5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4105bf0 0x7f6bb4197c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.784+0000 7f6bbb2f5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb4198220 con 0x7f6bb4105bf0 2024-09-13T23:02:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.784+0000 7f6bbb2f5700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb4198360 con 0x7f6bb40ffb40 2024-09-13T23:02:07.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.784+0000 7f6bb8890700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4105bf0 0x7f6bb4197c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:07.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.784+0000 7f6bb8890700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4105bf0 0x7f6bb4197c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41950/0 (socket says 172.21.15.2:41950) 2024-09-13T23:02:07.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.784+0000 7f6bb8890700 1 -- 172.21.15.2:0/680484846 learned_addr learned my addr 172.21.15.2:0/680484846 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:02:07.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.784+0000 7f6bb9091700 1 --2- 172.21.15.2:0/680484846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bb40ffb40 0x7f6bb41976c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:07.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.784+0000 7f6bb8890700 1 -- 172.21.15.2:0/680484846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bb40ffb40 msgr2=0x7f6bb41976c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:07.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.784+0000 7f6bb8890700 1 --2- 172.21.15.2:0/680484846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bb40ffb40 0x7f6bb41976c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:07.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.784+0000 7f6bb8890700 1 -- 172.21.15.2:0/680484846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb00095f0 con 0x7f6bb4105bf0 2024-09-13T23:02:07.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.784+0000 7f6bb8890700 1 --2- 172.21.15.2:0/680484846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4105bf0 0x7f6bb4197c00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400d900 tx=0x7f6ba400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:07.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.784+0000 7f6baa7fc700 1 -- 172.21.15.2:0/680484846 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ba40041f0 con 0x7f6bb4105bf0 2024-09-13T23:02:07.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.784+0000 7f6baa7fc700 1 -- 172.21.15.2:0/680484846 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ba4004cf0 con 0x7f6bb4105bf0 2024-09-13T23:02:07.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.784+0000 7f6bbb2f5700 1 -- 172.21.15.2:0/680484846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb41a0730 con 0x7f6bb4105bf0 2024-09-13T23:02:07.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.785+0000 7f6baa7fc700 1 -- 172.21.15.2:0/680484846 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ba400b750 con 0x7f6bb4105bf0 2024-09-13T23:02:07.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.785+0000 7f6bbb2f5700 1 -- 172.21.15.2:0/680484846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb41a0bf0 con 0x7f6bb4105bf0 2024-09-13T23:02:07.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.786+0000 7f6bbb2f5700 1 -- 172.21.15.2:0/680484846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb4108020 con 0x7f6bb4105bf0 2024-09-13T23:02:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.786+0000 7f6baa7fc700 1 -- 172.21.15.2:0/680484846 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f6ba4004750 con 0x7f6bb4105bf0 2024-09-13T23:02:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.787+0000 7f6baa7fc700 1 --2- 172.21.15.2:0/680484846 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f6ba006e680 0x7f6ba0070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.787+0000 7f6baa7fc700 1 -- 172.21.15.2:0/680484846 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f6ba408e3e0 con 0x7f6bb4105bf0 2024-09-13T23:02:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.787+0000 7f6bb9091700 1 --2- 172.21.15.2:0/680484846 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f6ba006e680 0x7f6ba0070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.787+0000 7f6bb9091700 1 --2- 172.21.15.2:0/680484846 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f6ba006e680 0x7f6ba0070b40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000b5c0 tx=0x7f6bb001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:07.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:07.791+0000 7f6baa7fc700 1 -- 172.21.15.2:0/680484846 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6ba40576b0 con 0x7f6bb4105bf0 2024-09-13T23:02:08.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:07 smithi002 ceph-mon[111294]: pgmap v69: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-13T23:02:08.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:07 smithi002 ceph-mon[111294]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:08.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:07 smithi002 ceph-mon[111294]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:08.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:07 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/3457481281' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:02:08.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:07 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/2633126907' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:02:08.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.041+0000 7f6bbb2f5700 1 -- 172.21.15.2:0/680484846 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bb40611d0 con 0x7f6ba006e680 2024-09-13T23:02:08.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.043+0000 7f6baa7fc700 1 -- 172.21.15.2:0/680484846 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6bb40611d0 con 0x7f6ba006e680 2024-09-13T23:02:08.044 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:02:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:02:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T23:02:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:02:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-13T23:02:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-13T23:02:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-13T23:02:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2024-09-13T23:02:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-13T23:02:08.044 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "8/23 daemons upgraded", 2024-09-13T23:02:08.045 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T23:02:08.045 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T23:02:08.045 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:02:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.045+0000 7f6bbb2f5700 1 -- 172.21.15.2:0/680484846 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f6ba006e680 msgr2=0x7f6ba0070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.045+0000 7f6bbb2f5700 1 --2- 172.21.15.2:0/680484846 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f6ba006e680 0x7f6ba0070b40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000b5c0 tx=0x7f6bb001a040 comp rx=0 tx=0).stop 2024-09-13T23:02:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.045+0000 7f6bbb2f5700 1 -- 172.21.15.2:0/680484846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4105bf0 msgr2=0x7f6bb4197c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.045+0000 7f6bbb2f5700 1 --2- 172.21.15.2:0/680484846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4105bf0 0x7f6bb4197c00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400d900 tx=0x7f6ba400dc10 comp rx=0 tx=0).stop 2024-09-13T23:02:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.046+0000 7f6bbb2f5700 1 -- 172.21.15.2:0/680484846 shutdown_connections 2024-09-13T23:02:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.046+0000 7f6bbb2f5700 1 --2- 172.21.15.2:0/680484846 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f6ba006e680 0x7f6ba0070b40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.046+0000 7f6bbb2f5700 1 --2- 172.21.15.2:0/680484846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6bb40ffb40 0x7f6bb41976c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.046+0000 7f6bbb2f5700 1 --2- 172.21.15.2:0/680484846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6bb4105bf0 0x7f6bb4197c00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:08.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.046+0000 7f6bbb2f5700 1 -- 172.21.15.2:0/680484846 >> 172.21.15.2:0/680484846 conn(0x7f6bb40fb610 msgr2=0x7f6bb40fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:08.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.046+0000 7f6bbb2f5700 1 -- 172.21.15.2:0/680484846 shutdown_connections 2024-09-13T23:02:08.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.046+0000 7f6bbb2f5700 1 -- 172.21.15.2:0/680484846 wait complete. 2024-09-13T23:02:08.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:07 smithi047 ceph-mon[81243]: pgmap v69: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-13T23:02:08.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:07 smithi047 ceph-mon[81243]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:08.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:07 smithi047 ceph-mon[81243]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:08.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:07 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/3457481281' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:02:08.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:07 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/2633126907' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:02:08.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.171+0000 7f49f006f700 1 -- 172.21.15.2:0/474629207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49e8101e80 msgr2=0x7f49e8102260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:08.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.171+0000 7f49f006f700 1 --2- 172.21.15.2:0/474629207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49e8101e80 0x7f49e8102260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f49e4009910 tx=0x7f49e4009c20 comp rx=0 tx=0).stop 2024-09-13T23:02:08.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.171+0000 7f49f006f700 1 -- 172.21.15.2:0/474629207 shutdown_connections 2024-09-13T23:02:08.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.171+0000 7f49f006f700 1 --2- 172.21.15.2:0/474629207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49e81027a0 0x7f49e810ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:08.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.171+0000 7f49f006f700 1 --2- 172.21.15.2:0/474629207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49e8101e80 0x7f49e8102260 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:08.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.171+0000 7f49f006f700 1 -- 172.21.15.2:0/474629207 >> 172.21.15.2:0/474629207 conn(0x7f49e80fb610 msgr2=0x7f49e80fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:08.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.171+0000 7f49f006f700 1 -- 172.21.15.2:0/474629207 shutdown_connections 2024-09-13T23:02:08.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.171+0000 7f49f006f700 1 -- 172.21.15.2:0/474629207 wait complete. 2024-09-13T23:02:08.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.172+0000 7f49f006f700 1 Processor -- start 2024-09-13T23:02:08.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.172+0000 7f49f006f700 1 -- start start 2024-09-13T23:02:08.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.172+0000 7f49f006f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49e8101e80 0x7f49e819c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:08.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.172+0000 7f49f006f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49e81027a0 0x7f49e819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:08.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.173+0000 7f49f006f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e819d240 con 0x7f49e8101e80 2024-09-13T23:02:08.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.173+0000 7f49f006f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e81966f0 con 0x7f49e81027a0 2024-09-13T23:02:08.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.173+0000 7f49ede0b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49e8101e80 0x7f49e819c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:08.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.173+0000 7f49ede0b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49e8101e80 0x7f49e819c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41970/0 (socket says 172.21.15.2:41970) 2024-09-13T23:02:08.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.173+0000 7f49ede0b700 1 -- 172.21.15.2:0/740401229 learned_addr learned my addr 172.21.15.2:0/740401229 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:02:08.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.173+0000 7f49ed60a700 1 --2- 172.21.15.2:0/740401229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49e81027a0 0x7f49e819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:08.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.173+0000 7f49ede0b700 1 -- 172.21.15.2:0/740401229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49e81027a0 msgr2=0x7f49e819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:08.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.173+0000 7f49ede0b700 1 --2- 172.21.15.2:0/740401229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49e81027a0 0x7f49e819cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:08.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.173+0000 7f49ede0b700 1 -- 172.21.15.2:0/740401229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e40095f0 con 0x7f49e8101e80 2024-09-13T23:02:08.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.173+0000 7f49ed60a700 1 --2- 172.21.15.2:0/740401229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49e81027a0 0x7f49e819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T23:02:08.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.173+0000 7f49ede0b700 1 --2- 172.21.15.2:0/740401229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49e8101e80 0x7f49e819c670 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f49e400bd70 tx=0x7f49e400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:08.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.174+0000 7f49deffd700 1 -- 172.21.15.2:0/740401229 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49e401d070 con 0x7f49e8101e80 2024-09-13T23:02:08.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.174+0000 7f49deffd700 1 -- 172.21.15.2:0/740401229 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49e4005dc0 con 0x7f49e8101e80 2024-09-13T23:02:08.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.174+0000 7f49deffd700 1 -- 172.21.15.2:0/740401229 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49e4017400 con 0x7f49e8101e80 2024-09-13T23:02:08.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.174+0000 7f49f006f700 1 -- 172.21.15.2:0/740401229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e8196970 con 0x7f49e8101e80 2024-09-13T23:02:08.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.174+0000 7f49f006f700 1 -- 172.21.15.2:0/740401229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e8196e60 con 0x7f49e8101e80 2024-09-13T23:02:08.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.175+0000 7f49f006f700 1 -- 172.21.15.2:0/740401229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e8108390 con 0x7f49e8101e80 2024-09-13T23:02:08.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.176+0000 7f49deffd700 1 -- 172.21.15.2:0/740401229 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f49e400f460 con 0x7f49e8101e80 2024-09-13T23:02:08.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.177+0000 7f49deffd700 1 --2- 172.21.15.2:0/740401229 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f49d406e6d0 0x7f49d4070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:08.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.177+0000 7f49deffd700 1 -- 172.21.15.2:0/740401229 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f49e408fc00 con 0x7f49e8101e80 2024-09-13T23:02:08.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.177+0000 7f49ed60a700 1 --2- 172.21.15.2:0/740401229 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f49d406e6d0 0x7f49d4070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:08.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.177+0000 7f49ed60a700 1 --2- 172.21.15.2:0/740401229 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f49d406e6d0 0x7f49d4070b90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f49e8197b60 tx=0x7f49d800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.181+0000 7f49deffd700 1 -- 172.21.15.2:0/740401229 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f49e405caa0 con 0x7f49e8101e80 2024-09-13T23:02:08.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.533+0000 7f49f006f700 1 -- 172.21.15.2:0/740401229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f49e804f2e0 con 0x7f49e8101e80 2024-09-13T23:02:08.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.533+0000 7f49deffd700 1 -- 172.21.15.2:0/740401229 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1182 (secure 0 0 0) 0x7f49e405c630 con 0x7f49e8101e80 2024-09-13T23:02:08.535 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 34/264 objects degraded (12.879%), 13 pgs degraded 2024-09-13T23:02:08.535 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T23:02:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T23:02:08.535 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T23:02:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: osd.1 (root=default,host=smithi002) is down 2024-09-13T23:02:08.535 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 34/264 objects degraded (12.879%), 13 pgs degraded 2024-09-13T23:02:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-13T23:02:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-13T23:02:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-13T23:02:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-13T23:02:08.535 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-13T23:02:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-13T23:02:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-13T23:02:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-13T23:02:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-13T23:02:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-13T23:02:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-13T23:02:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-13T23:02:08.536 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-13T23:02:08.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.536+0000 7f49f006f700 1 -- 172.21.15.2:0/740401229 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f49d406e6d0 msgr2=0x7f49d4070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:08.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.536+0000 7f49f006f700 1 --2- 172.21.15.2:0/740401229 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f49d406e6d0 0x7f49d4070b90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f49e8197b60 tx=0x7f49d800b410 comp rx=0 tx=0).stop 2024-09-13T23:02:08.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.536+0000 7f49f006f700 1 -- 172.21.15.2:0/740401229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49e8101e80 msgr2=0x7f49e819c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:08.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.536+0000 7f49f006f700 1 --2- 172.21.15.2:0/740401229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49e8101e80 0x7f49e819c670 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f49e400bd70 tx=0x7f49e400bda0 comp rx=0 tx=0).stop 2024-09-13T23:02:08.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.536+0000 7f49f006f700 1 -- 172.21.15.2:0/740401229 shutdown_connections 2024-09-13T23:02:08.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.536+0000 7f49f006f700 1 --2- 172.21.15.2:0/740401229 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f49d406e6d0 0x7f49d4070b90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:08.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.536+0000 7f49f006f700 1 --2- 172.21.15.2:0/740401229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49e8101e80 0x7f49e819c670 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:08.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.536+0000 7f49f006f700 1 --2- 172.21.15.2:0/740401229 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49e81027a0 0x7f49e819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:08.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.536+0000 7f49f006f700 1 -- 172.21.15.2:0/740401229 >> 172.21.15.2:0/740401229 conn(0x7f49e80fb610 msgr2=0x7f49e81054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:08.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.536+0000 7f49f006f700 1 -- 172.21.15.2:0/740401229 shutdown_connections 2024-09-13T23:02:08.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:08.536+0000 7f49f006f700 1 -- 172.21.15.2:0/740401229 wait complete. 2024-09-13T23:02:09.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:08 smithi002 ceph-mon[111294]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:09.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:09.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:09.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:02:09.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:09.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:08 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/740401229' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:02:09.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:09.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:09.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:08 smithi047 ceph-mon[81243]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:09.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:09.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:09.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:02:09.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:09.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:08 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/740401229' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:02:09.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:09.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:09.999 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:09 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1[127983]: 2024-09-13T23:02:09.739+0000 7f06a513a640 -1 osd.1 0 read_superblock omap replica is missing. 2024-09-13T23:02:10.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:09 smithi002 ceph-mon[111294]: pgmap v70: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-13T23:02:10.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:09 smithi002 ceph-mon[111294]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:10.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:09 smithi047 ceph-mon[81243]: pgmap v70: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-13T23:02:10.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:09 smithi047 ceph-mon[81243]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:10.384 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:10 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1[127983]: 2024-09-13T23:02:10.079+0000 7f06a513a640 -1 osd.1 55 log_to_monitors true 2024-09-13T23:02:11.000 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:02:10 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1[127983]: 2024-09-13T23:02:10.707+0000 7f069ced4640 -1 osd.1 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:02:11.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:10 smithi002 ceph-mon[111294]: Health check update: Degraded data redundancy: 34/264 objects degraded (12.879%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T23:02:11.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:10 smithi002 ceph-mon[111294]: from='osd.1 [v2:172.21.15.2:6810/425993590,v1:172.21.15.2:6811/425993590]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T23:02:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:10 smithi047 ceph-mon[81243]: Health check update: Degraded data redundancy: 34/264 objects degraded (12.879%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T23:02:11.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:10 smithi047 ceph-mon[81243]: from='osd.1 [v2:172.21.15.2:6810/425993590,v1:172.21.15.2:6811/425993590]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T23:02:11.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:11 smithi002 ceph-mon[111294]: pgmap v71: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-13T23:02:11.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:11 smithi002 ceph-mon[111294]: from='osd.1 [v2:172.21.15.2:6810/425993590,v1:172.21.15.2:6811/425993590]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T23:02:11.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:11 smithi002 ceph-mon[111294]: osdmap e58: 6 total, 5 up, 6 in 2024-09-13T23:02:11.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:11 smithi002 ceph-mon[111294]: from='osd.1 [v2:172.21.15.2:6810/425993590,v1:172.21.15.2:6811/425993590]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-13T23:02:12.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:11 smithi047 ceph-mon[81243]: pgmap v71: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-13T23:02:12.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:11 smithi047 ceph-mon[81243]: from='osd.1 [v2:172.21.15.2:6810/425993590,v1:172.21.15.2:6811/425993590]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T23:02:12.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:11 smithi047 ceph-mon[81243]: osdmap e58: 6 total, 5 up, 6 in 2024-09-13T23:02:12.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:11 smithi047 ceph-mon[81243]: from='osd.1 [v2:172.21.15.2:6810/425993590,v1:172.21.15.2:6811/425993590]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-13T23:02:13.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:12 smithi002 ceph-mon[111294]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:02:13.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:12 smithi002 ceph-mon[111294]: osd.1 [v2:172.21.15.2:6810/425993590,v1:172.21.15.2:6811/425993590] boot 2024-09-13T23:02:13.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:12 smithi002 ceph-mon[111294]: osdmap e59: 6 total, 6 up, 6 in 2024-09-13T23:02:13.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:02:13.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:13.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:13.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:13.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:02:13.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:13.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:02:13.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:02:13.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:02:13.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:02:13.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T23:02:13.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:12 smithi002 ceph-mon[111294]: osdmap e60: 6 total, 6 up, 6 in 2024-09-13T23:02:13.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:12 smithi047 ceph-mon[81243]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:02:13.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:12 smithi047 ceph-mon[81243]: osd.1 [v2:172.21.15.2:6810/425993590,v1:172.21.15.2:6811/425993590] boot 2024-09-13T23:02:13.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:12 smithi047 ceph-mon[81243]: osdmap e59: 6 total, 6 up, 6 in 2024-09-13T23:02:13.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T23:02:13.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:13.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:13.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:13.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:02:13.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:13.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:02:13.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:02:13.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:02:13.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:02:13.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T23:02:13.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:12 smithi047 ceph-mon[81243]: osdmap e60: 6 total, 6 up, 6 in 2024-09-13T23:02:14.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:13 smithi002 ceph-mon[111294]: pgmap v74: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-13T23:02:14.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:13 smithi002 ceph-mon[111294]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T23:02:14.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:13 smithi002 ceph-mon[111294]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-13T23:02:14.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:13 smithi047 ceph-mon[81243]: pgmap v74: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 34/264 objects degraded (12.879%) 2024-09-13T23:02:14.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:13 smithi047 ceph-mon[81243]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T23:02:14.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:13 smithi047 ceph-mon[81243]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-13T23:02:16.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:15 smithi002 ceph-mon[111294]: pgmap v76: 65 pgs: 7 active+undersized, 7 active+undersized+degraded, 51 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 18/264 objects degraded (6.818%) 2024-09-13T23:02:16.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:15 smithi002 ceph-mon[111294]: Health check update: Degraded data redundancy: 18/264 objects degraded (6.818%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T23:02:16.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:15 smithi047 ceph-mon[81243]: pgmap v76: 65 pgs: 7 active+undersized, 7 active+undersized+degraded, 51 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 18/264 objects degraded (6.818%) 2024-09-13T23:02:16.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:15 smithi047 ceph-mon[81243]: Health check update: Degraded data redundancy: 18/264 objects degraded (6.818%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T23:02:17.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:16 smithi047 ceph-mon[81243]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/264 objects degraded (6.818%), 7 pgs degraded) 2024-09-13T23:02:17.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:16 smithi002 ceph-mon[111294]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/264 objects degraded (6.818%), 7 pgs degraded) 2024-09-13T23:02:18.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:17 smithi047 ceph-mon[81243]: pgmap v77: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:02:18.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:17 smithi002 ceph-mon[111294]: pgmap v77: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:02:20.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:19 smithi047 ceph-mon[81243]: pgmap v78: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1 op/s 2024-09-13T23:02:20.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:19 smithi002 ceph-mon[111294]: pgmap v78: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1 op/s 2024-09-13T23:02:22.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:21 smithi047 ceph-mon[81243]: pgmap v79: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:02:22.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:21 smithi002 ceph-mon[111294]: pgmap v79: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:02:24.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:23 smithi047 ceph-mon[81243]: pgmap v80: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T23:02:24.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:23 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:24.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:23 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:02:24.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:23 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:24.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:23 smithi002 ceph-mon[111294]: pgmap v80: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T23:02:24.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:23 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:24.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:23 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:02:24.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:23 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:26.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:25 smithi047 ceph-mon[81243]: pgmap v81: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-13T23:02:26.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:25 smithi002 ceph-mon[111294]: pgmap v81: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-13T23:02:28.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:27 smithi002 ceph-mon[111294]: pgmap v82: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:02:28.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:27 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T23:02:28.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:27 smithi047 ceph-mon[81243]: pgmap v82: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:02:28.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:27 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T23:02:29.033 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:28 smithi002 ceph-mon[111294]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T23:02:29.033 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:28 smithi002 ceph-mon[111294]: Upgrade: osd.2 is safe to restart 2024-09-13T23:02:29.033 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:28 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:29.033 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:28 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T23:02:29.033 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:28 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:29.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:28 smithi047 ceph-mon[81243]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T23:02:29.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:28 smithi047 ceph-mon[81243]: Upgrade: osd.2 is safe to restart 2024-09-13T23:02:29.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:28 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:29.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:28 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T23:02:29.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:28 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:30.140 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:29 smithi002 ceph-mon[111294]: pgmap v83: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:02:30.140 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:29 smithi002 ceph-mon[111294]: Upgrade: Updating osd.2 2024-09-13T23:02:30.140 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:29 smithi002 ceph-mon[111294]: Deploying daemon osd.2 on smithi002 2024-09-13T23:02:30.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:29 smithi047 ceph-mon[81243]: pgmap v83: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:02:30.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:29 smithi047 ceph-mon[81243]: Upgrade: Updating osd.2 2024-09-13T23:02:30.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:29 smithi047 ceph-mon[81243]: Deploying daemon osd.2 on smithi002 2024-09-13T23:02:31.707 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:31 smithi002 systemd[1]: Stopping Ceph osd.2 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:02:32.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:31 smithi002 ceph-mon[111294]: pgmap v84: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:02:32.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:31 smithi002 ceph-mon[111294]: osd.2 marked itself down and dead 2024-09-13T23:02:32.000 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:31 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2[61377]: 2024-09-13T23:02:31.706+0000 7f42c849e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:02:32.000 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:31 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2[61377]: 2024-09-13T23:02:31.706+0000 7f42c849e700 -1 osd.2 60 *** Got signal Terminated *** 2024-09-13T23:02:32.000 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:31 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2[61377]: 2024-09-13T23:02:31.706+0000 7f42c849e700 -1 osd.2 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:02:32.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:31 smithi047 ceph-mon[81243]: pgmap v84: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:02:32.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:31 smithi047 ceph-mon[81243]: osd.2 marked itself down and dead 2024-09-13T23:02:32.441 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:32 smithi002 podman[132913]: 2024-09-13 23:02:32.125803639 +0000 UTC m=+0.511096577 container stop 9a2f4f6decfb5a54ce38317f7479dcf4f740ca780652b55e6b6cfa46f7764216 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, GIT_CLEAN=True, RELEASE=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-13T23:02:32.441 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:32 smithi002 podman[132913]: 2024-09-13 23:02:32.151614275 +0000 UTC m=+0.536907202 container died 9a2f4f6decfb5a54ce38317f7479dcf4f740ca780652b55e6b6cfa46f7764216 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=HEAD, org.label-schema.build-date=20240222, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1) 2024-09-13T23:02:32.733 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:32 smithi002 podman[132913]: 2024-09-13 23:02:32.540009602 +0000 UTC m=+0.925302528 container cleanup 9a2f4f6decfb5a54ce38317f7479dcf4f740ca780652b55e6b6cfa46f7764216 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, RELEASE=HEAD, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-09-13T23:02:32.733 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:32 smithi002 bash[132913]: ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2 2024-09-13T23:02:32.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:32 smithi002 ceph-mon[111294]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:02:33.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:32 smithi002 ceph-mon[111294]: osdmap e61: 6 total, 5 up, 6 in 2024-09-13T23:02:33.000 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:32 smithi002 podman[132928]: 2024-09-13 23:02:32.733251434 +0000 UTC m=+0.601107181 container remove 9a2f4f6decfb5a54ce38317f7479dcf4f740ca780652b55e6b6cfa46f7764216 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_CLEAN=True, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=HEAD, org.label-schema.build-date=20240222, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-13T23:02:33.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:32 smithi047 ceph-mon[81243]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:02:33.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:32 smithi047 ceph-mon[81243]: osdmap e61: 6 total, 5 up, 6 in 2024-09-13T23:02:33.437 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:33 smithi002 podman[133018]: 2024-09-13 23:02:33.075813771 +0000 UTC m=+0.016796349 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:02:33.437 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:33 smithi002 podman[133018]: 2024-09-13 23:02:33.192545026 +0000 UTC m=+0.133527595 container create de007fe21414d41a186f18242fc3a3f4ec403a26a44f3091155156ee532a31aa (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:02:33.437 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:33 smithi002 podman[133018]: 2024-09-13 23:02:33.436835396 +0000 UTC m=+0.377817964 container init de007fe21414d41a186f18242fc3a3f4ec403a26a44f3091155156ee532a31aa (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T23:02:33.750 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:33 smithi002 podman[133018]: 2024-09-13 23:02:33.440494022 +0000 UTC m=+0.381476592 container start de007fe21414d41a186f18242fc3a3f4ec403a26a44f3091155156ee532a31aa (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:02:33.750 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:33 smithi002 podman[133018]: 2024-09-13 23:02:33.520170234 +0000 UTC m=+0.461152806 container attach de007fe21414d41a186f18242fc3a3f4ec403a26a44f3091155156ee532a31aa (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:02:33.750 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:33 smithi002 podman[133018]: 2024-09-13 23:02:33.638724259 +0000 UTC m=+0.579706837 container died de007fe21414d41a186f18242fc3a3f4ec403a26a44f3091155156ee532a31aa (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-13T23:02:34.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:33 smithi047 ceph-mon[81243]: pgmap v86: 65 pgs: 9 stale+active+clean, 56 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T23:02:34.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:33 smithi047 ceph-mon[81243]: osdmap e62: 6 total, 5 up, 6 in 2024-09-13T23:02:34.195 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:33 smithi002 ceph-mon[111294]: pgmap v86: 65 pgs: 9 stale+active+clean, 56 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T23:02:34.195 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:33 smithi002 ceph-mon[111294]: osdmap e62: 6 total, 5 up, 6 in 2024-09-13T23:02:34.500 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:34 smithi002 podman[133040]: 2024-09-13 23:02:34.332017304 +0000 UTC m=+0.687375510 container remove de007fe21414d41a186f18242fc3a3f4ec403a26a44f3091155156ee532a31aa (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-ecab7be, io.buildah.version=1.37.2) 2024-09-13T23:02:34.500 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:34 smithi002 systemd[1]: ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-13T23:02:34.500 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:34 smithi002 systemd[1]: Stopped Ceph osd.2 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T23:02:34.500 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:34 smithi002 systemd[1]: ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.2.service: Consumed 49.886s CPU time. 2024-09-13T23:02:34.837 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:34 smithi002 systemd[1]: Starting Ceph osd.2 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:02:34.837 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:34 smithi002 podman[133144]: 2024-09-13 23:02:34.691469334 +0000 UTC m=+0.016342822 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:02:34.837 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:34 smithi002 podman[133144]: 2024-09-13 23:02:34.81669805 +0000 UTC m=+0.141571529 container create 858b4945f908e35e43e7d1168c0e9900cc51ceb77124565ad3e9209fce15c746 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True) 2024-09-13T23:02:35.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:34 smithi047 ceph-mon[81243]: pgmap v88: 65 pgs: 7 active+undersized, 7 stale+active+clean, 5 active+undersized+degraded, 46 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 11/264 objects degraded (4.167%) 2024-09-13T23:02:35.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:34 smithi047 ceph-mon[81243]: Health check failed: Degraded data redundancy: 11/264 objects degraded (4.167%), 5 pgs degraded (PG_DEGRADED) 2024-09-13T23:02:35.169 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:34 smithi002 ceph-mon[111294]: pgmap v88: 65 pgs: 7 active+undersized, 7 stale+active+clean, 5 active+undersized+degraded, 46 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 11/264 objects degraded (4.167%) 2024-09-13T23:02:35.169 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:34 smithi002 ceph-mon[111294]: Health check failed: Degraded data redundancy: 11/264 objects degraded (4.167%), 5 pgs degraded (PG_DEGRADED) 2024-09-13T23:02:35.169 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:35 smithi002 podman[133144]: 2024-09-13 23:02:35.077686293 +0000 UTC m=+0.402559782 container init 858b4945f908e35e43e7d1168c0e9900cc51ceb77124565ad3e9209fce15c746 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-13T23:02:35.169 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:35 smithi002 podman[133144]: 2024-09-13 23:02:35.081466552 +0000 UTC m=+0.406340032 container start 858b4945f908e35e43e7d1168c0e9900cc51ceb77124565ad3e9209fce15c746 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be) 2024-09-13T23:02:35.169 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:35 smithi002 podman[133144]: 2024-09-13 23:02:35.169258328 +0000 UTC m=+0.494131842 container attach 858b4945f908e35e43e7d1168c0e9900cc51ceb77124565ad3e9209fce15c746 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-13T23:02:35.499 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:35 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-activate[133159]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:02:35.500 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:35 smithi002 bash[133144]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:02:35.500 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:35 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-activate[133159]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:02:35.500 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:35 smithi002 bash[133144]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:02:36.250 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:35 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-activate[133159]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T23:02:36.323 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:35 smithi002 bash[133144]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T23:02:36.324 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:35 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-activate[133159]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T23:02:36.324 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:35 smithi002 bash[133144]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T23:02:36.750 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:36 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-activate[133159]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T23:02:36.750 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:36 smithi002 bash[133144]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T23:02:36.750 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:36 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-activate[133159]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T23:02:36.750 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:36 smithi002 bash[133144]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T23:02:36.750 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:36 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-activate[133159]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T23:02:36.750 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:36 smithi002 bash[133144]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T23:02:36.750 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:36 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-activate[133159]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T23:02:36.751 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:36 smithi002 bash[133144]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T23:02:36.751 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:36 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-activate[133159]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T23:02:36.751 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:36 smithi002 bash[133144]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T23:02:36.751 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:36 smithi002 podman[133144]: 2024-09-13 23:02:36.279810088 +0000 UTC m=+1.604683570 container died 858b4945f908e35e43e7d1168c0e9900cc51ceb77124565ad3e9209fce15c746 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-13T23:02:37.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:36 smithi002 ceph-mon[111294]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/264 objects degraded (13.258%) 2024-09-13T23:02:37.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:36 smithi047 ceph-mon[81243]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/264 objects degraded (13.258%) 2024-09-13T23:02:37.299 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:37 smithi002 podman[133309]: 2024-09-13 23:02:37.040013967 +0000 UTC m=+0.748888068 container remove 858b4945f908e35e43e7d1168c0e9900cc51ceb77124565ad3e9209fce15c746 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-13T23:02:37.299 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:37 smithi002 podman[133370]: 2024-09-13 23:02:37.16120299 +0000 UTC m=+0.018142805 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:02:37.299 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:37 smithi002 podman[133370]: 2024-09-13 23:02:37.299433976 +0000 UTC m=+0.156373833 container create 15b9e8db7556a471864ab460fc1632e7f03f9bbcb948b9b420e7164ede3ab9ba (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2, RELEASE=squid-ecab7be, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T23:02:38.000 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:37 smithi002 podman[133370]: 2024-09-13 23:02:37.660020325 +0000 UTC m=+0.516960142 container init 15b9e8db7556a471864ab460fc1632e7f03f9bbcb948b9b420e7164ede3ab9ba (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2, RELEASE=squid-ecab7be, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-13T23:02:38.000 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:37 smithi002 podman[133370]: 2024-09-13 23:02:37.66349163 +0000 UTC m=+0.520431445 container start 15b9e8db7556a471864ab460fc1632e7f03f9bbcb948b9b420e7164ede3ab9ba (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:02:38.000 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:37 smithi002 ceph-osd[133389]: -- 172.21.15.2:0/4188102728 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c59727c1e0 con 0x55c596429c00 2024-09-13T23:02:38.000 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:37 smithi002 bash[133370]: 15b9e8db7556a471864ab460fc1632e7f03f9bbcb948b9b420e7164ede3ab9ba 2024-09-13T23:02:38.000 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:37 smithi002 systemd[1]: Started Ceph osd.2 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T23:02:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.649+0000 7f8df4747700 1 -- 172.21.15.2:0/2538010308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dec100750 msgr2=0x7f8dec1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.649+0000 7f8df4747700 1 --2- 172.21.15.2:0/2538010308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dec100750 0x7f8dec1047a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009910 tx=0x7f8de0009c20 comp rx=0 tx=0).stop 2024-09-13T23:02:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.650+0000 7f8df4747700 1 -- 172.21.15.2:0/2538010308 shutdown_connections 2024-09-13T23:02:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.650+0000 7f8df4747700 1 --2- 172.21.15.2:0/2538010308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dec100750 0x7f8dec1047a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.650+0000 7f8df4747700 1 --2- 172.21.15.2:0/2538010308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dec0ffda0 0x7f8dec100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.650+0000 7f8df4747700 1 -- 172.21.15.2:0/2538010308 >> 172.21.15.2:0/2538010308 conn(0x7f8dec0fb650 msgr2=0x7f8dec0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:38.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.650+0000 7f8df4747700 1 -- 172.21.15.2:0/2538010308 shutdown_connections 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.650+0000 7f8df4747700 1 -- 172.21.15.2:0/2538010308 wait complete. 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.650+0000 7f8df4747700 1 Processor -- start 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.651+0000 7f8df4747700 1 -- start start 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.651+0000 7f8df4747700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dec0ffda0 0x7f8dec196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.651+0000 7f8df4747700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dec100750 0x7f8dec196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.651+0000 7f8df4747700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec197520 con 0x7f8dec0ffda0 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.651+0000 7f8df4747700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec19b330 con 0x7f8dec100750 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.651+0000 7f8df24e3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dec0ffda0 0x7f8dec196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.651+0000 7f8df24e3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dec0ffda0 0x7f8dec196950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33440/0 (socket says 172.21.15.2:33440) 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.651+0000 7f8df24e3700 1 -- 172.21.15.2:0/2622975758 learned_addr learned my addr 172.21.15.2:0/2622975758 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:02:38.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.651+0000 7f8df1ce2700 1 --2- 172.21.15.2:0/2622975758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dec100750 0x7f8dec196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.651+0000 7f8df24e3700 1 -- 172.21.15.2:0/2622975758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dec100750 msgr2=0x7f8dec196e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.651+0000 7f8df24e3700 1 --2- 172.21.15.2:0/2622975758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dec100750 0x7f8dec196e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.651+0000 7f8df24e3700 1 -- 172.21.15.2:0/2622975758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de00095f0 con 0x7f8dec0ffda0 2024-09-13T23:02:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.651+0000 7f8df24e3700 1 --2- 172.21.15.2:0/2622975758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dec0ffda0 0x7f8dec196950 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0060b0 tx=0x7f8ddc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.652+0000 7f8deb7fe700 1 -- 172.21.15.2:0/2622975758 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ddc00dda0 con 0x7f8dec0ffda0 2024-09-13T23:02:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.652+0000 7f8deb7fe700 1 -- 172.21.15.2:0/2622975758 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ddc00f040 con 0x7f8dec0ffda0 2024-09-13T23:02:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.652+0000 7f8deb7fe700 1 -- 172.21.15.2:0/2622975758 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ddc014790 con 0x7f8dec0ffda0 2024-09-13T23:02:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.652+0000 7f8df4747700 1 -- 172.21.15.2:0/2622975758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dec19b610 con 0x7f8dec0ffda0 2024-09-13T23:02:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.652+0000 7f8df4747700 1 -- 172.21.15.2:0/2622975758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dec19bb60 con 0x7f8dec0ffda0 2024-09-13T23:02:38.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.653+0000 7f8df4747700 1 -- 172.21.15.2:0/2622975758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dec04f2e0 con 0x7f8dec0ffda0 2024-09-13T23:02:38.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.653+0000 7f8deb7fe700 1 -- 172.21.15.2:0/2622975758 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f8ddc0148f0 con 0x7f8dec0ffda0 2024-09-13T23:02:38.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.654+0000 7f8deb7fe700 1 --2- 172.21.15.2:0/2622975758 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f8dd406e680 0x7f8dd4070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:38.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.654+0000 7f8deb7fe700 1 -- 172.21.15.2:0/2622975758 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8ddc08e010 con 0x7f8dec0ffda0 2024-09-13T23:02:38.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.654+0000 7f8df1ce2700 1 --2- 172.21.15.2:0/2622975758 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f8dd406e680 0x7f8dd4070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:38.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.654+0000 7f8df1ce2700 1 --2- 172.21.15.2:0/2622975758 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f8dd406e680 0x7f8dd4070b40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8de0006010 tx=0x7f8de0005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:38.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.658+0000 7f8deb7fe700 1 -- 172.21.15.2:0/2622975758 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8ddc0c31b0 con 0x7f8dec0ffda0 2024-09-13T23:02:38.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.910+0000 7f8df4747700 1 -- 172.21.15.2:0/2622975758 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8dec19be90 con 0x7f8dd406e680 2024-09-13T23:02:38.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:38.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:38.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:02:38.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:38 smithi002 ceph-mon[111294]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 35/264 objects degraded (13.258%) 2024-09-13T23:02:38.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:38.912 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:02:38.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.911+0000 7f8deb7fe700 1 -- 172.21.15.2:0/2622975758 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8dec19be90 con 0x7f8dd406e680 2024-09-13T23:02:38.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.914+0000 7f8df4747700 1 -- 172.21.15.2:0/2622975758 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f8dd406e680 msgr2=0x7f8dd4070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:38.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.914+0000 7f8df4747700 1 --2- 172.21.15.2:0/2622975758 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f8dd406e680 0x7f8dd4070b40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8de0006010 tx=0x7f8de0005960 comp rx=0 tx=0).stop 2024-09-13T23:02:38.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.914+0000 7f8df4747700 1 -- 172.21.15.2:0/2622975758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dec0ffda0 msgr2=0x7f8dec196950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:38.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.914+0000 7f8df4747700 1 --2- 172.21.15.2:0/2622975758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dec0ffda0 0x7f8dec196950 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0060b0 tx=0x7f8ddc00d3b0 comp rx=0 tx=0).stop 2024-09-13T23:02:38.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.914+0000 7f8df4747700 1 -- 172.21.15.2:0/2622975758 shutdown_connections 2024-09-13T23:02:38.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.914+0000 7f8df4747700 1 --2- 172.21.15.2:0/2622975758 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f8dd406e680 0x7f8dd4070b40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:38.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.914+0000 7f8df4747700 1 --2- 172.21.15.2:0/2622975758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8dec0ffda0 0x7f8dec196950 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:38.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.914+0000 7f8df4747700 1 --2- 172.21.15.2:0/2622975758 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8dec100750 0x7f8dec196e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:38.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.914+0000 7f8df4747700 1 -- 172.21.15.2:0/2622975758 >> 172.21.15.2:0/2622975758 conn(0x7f8dec0fb650 msgr2=0x7f8dec103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:38.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.914+0000 7f8df4747700 1 -- 172.21.15.2:0/2622975758 shutdown_connections 2024-09-13T23:02:38.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:38.914+0000 7f8df4747700 1 -- 172.21.15.2:0/2622975758 wait complete. 2024-09-13T23:02:38.929 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T23:02:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.036+0000 7f0fbeafd700 1 -- 172.21.15.2:0/4276668069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8068580 msgr2=0x7f0fb80689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.036+0000 7f0fbeafd700 1 --2- 172.21.15.2:0/4276668069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8068580 0x7f0fb80689e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8009910 tx=0x7f0fa8009c20 comp rx=0 tx=0).stop 2024-09-13T23:02:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.036+0000 7f0fbeafd700 1 -- 172.21.15.2:0/4276668069 shutdown_connections 2024-09-13T23:02:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.036+0000 7f0fbeafd700 1 --2- 172.21.15.2:0/4276668069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8068580 0x7f0fb80689e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.036+0000 7f0fbeafd700 1 --2- 172.21.15.2:0/4276668069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fb8106cd0 0x7f0fb81070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.036+0000 7f0fbeafd700 1 -- 172.21.15.2:0/4276668069 >> 172.21.15.2:0/4276668069 conn(0x7f0fb8075670 msgr2=0x7f0fb8075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.036+0000 7f0fbeafd700 1 -- 172.21.15.2:0/4276668069 shutdown_connections 2024-09-13T23:02:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.036+0000 7f0fbeafd700 1 -- 172.21.15.2:0/4276668069 wait complete. 2024-09-13T23:02:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.036+0000 7f0fbeafd700 1 Processor -- start 2024-09-13T23:02:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.037+0000 7f0fbeafd700 1 -- start start 2024-09-13T23:02:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.037+0000 7f0fbeafd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fb8068580 0x7f0fb80ffcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.037+0000 7f0fbeafd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8106cd0 0x7f0fb8100230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.037+0000 7f0fbeafd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb8100770 con 0x7f0fb8106cd0 2024-09-13T23:02:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.037+0000 7f0fbeafd700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb81008b0 con 0x7f0fb8068580 2024-09-13T23:02:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.037+0000 7f0faffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8106cd0 0x7f0fb8100230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.037+0000 7f0fbc899700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fb8068580 0x7f0fb80ffcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.037+0000 7f0faffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8106cd0 0x7f0fb8100230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33466/0 (socket says 172.21.15.2:33466) 2024-09-13T23:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.037+0000 7f0faffff700 1 -- 172.21.15.2:0/2379992645 learned_addr learned my addr 172.21.15.2:0/2379992645 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.037+0000 7f0faffff700 1 -- 172.21.15.2:0/2379992645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fb8068580 msgr2=0x7f0fb80ffcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.037+0000 7f0faffff700 1 --2- 172.21.15.2:0/2379992645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fb8068580 0x7f0fb80ffcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.037+0000 7f0faffff700 1 -- 172.21.15.2:0/2379992645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa80095f0 con 0x7f0fb8106cd0 2024-09-13T23:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.037+0000 7f0fbc899700 1 --2- 172.21.15.2:0/2379992645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fb8068580 0x7f0fb80ffcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T23:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.038+0000 7f0faffff700 1 --2- 172.21.15.2:0/2379992645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8106cd0 0x7f0fb8100230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800f690 tx=0x7f0fa800f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.038+0000 7f0fadffb700 1 -- 172.21.15.2:0/2379992645 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fa801d070 con 0x7f0fb8106cd0 2024-09-13T23:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.038+0000 7f0fadffb700 1 -- 172.21.15.2:0/2379992645 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0fa80050d0 con 0x7f0fb8106cd0 2024-09-13T23:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.038+0000 7f0fbeafd700 1 -- 172.21.15.2:0/2379992645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb8100b30 con 0x7f0fb8106cd0 2024-09-13T23:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.038+0000 7f0fadffb700 1 -- 172.21.15.2:0/2379992645 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fa8022470 con 0x7f0fb8106cd0 2024-09-13T23:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.038+0000 7f0fbeafd700 1 -- 172.21.15.2:0/2379992645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb81a2d10 con 0x7f0fb8106cd0 2024-09-13T23:02:39.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.040+0000 7f0fbeafd700 1 -- 172.21.15.2:0/2379992645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb81091d0 con 0x7f0fb8106cd0 2024-09-13T23:02:39.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.040+0000 7f0fadffb700 1 -- 172.21.15.2:0/2379992645 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f0fa8003780 con 0x7f0fb8106cd0 2024-09-13T23:02:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.041+0000 7f0fadffb700 1 --2- 172.21.15.2:0/2379992645 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f0fa006e680 0x7f0fa0070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.041+0000 7f0fadffb700 1 -- 172.21.15.2:0/2379992645 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f0fa808f940 con 0x7f0fb8106cd0 2024-09-13T23:02:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.041+0000 7f0fbc899700 1 --2- 172.21.15.2:0/2379992645 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f0fa006e680 0x7f0fa0070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.041+0000 7f0fbc899700 1 --2- 172.21.15.2:0/2379992645 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f0fa006e680 0x7f0fa0070b40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4009480 tx=0x7f0fb400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.046+0000 7f0fadffb700 1 -- 172.21.15.2:0/2379992645 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0fa8058cc0 con 0x7f0fb8106cd0 2024-09-13T23:02:39.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:39.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:39.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:02:39.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:38 smithi047 ceph-mon[81243]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 35/264 objects degraded (13.258%) 2024-09-13T23:02:39.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:39.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:02:39.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.287+0000 7f0fbeafd700 1 -- 172.21.15.2:0/2379992645 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fb80611d0 con 0x7f0fa006e680 2024-09-13T23:02:39.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.288+0000 7f0fadffb700 1 -- 172.21.15.2:0/2379992645 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0fb80611d0 con 0x7f0fa006e680 2024-09-13T23:02:39.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.290+0000 7f0fbeafd700 1 -- 172.21.15.2:0/2379992645 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f0fa006e680 msgr2=0x7f0fa0070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:39.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.290+0000 7f0fbeafd700 1 --2- 172.21.15.2:0/2379992645 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f0fa006e680 0x7f0fa0070b40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4009480 tx=0x7f0fb400b040 comp rx=0 tx=0).stop 2024-09-13T23:02:39.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.290+0000 7f0fbeafd700 1 -- 172.21.15.2:0/2379992645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8106cd0 msgr2=0x7f0fb8100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:39.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.290+0000 7f0fbeafd700 1 --2- 172.21.15.2:0/2379992645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8106cd0 0x7f0fb8100230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800f690 tx=0x7f0fa800f6c0 comp rx=0 tx=0).stop 2024-09-13T23:02:39.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.290+0000 7f0fbeafd700 1 -- 172.21.15.2:0/2379992645 shutdown_connections 2024-09-13T23:02:39.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.290+0000 7f0fbeafd700 1 --2- 172.21.15.2:0/2379992645 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f0fa006e680 0x7f0fa0070b40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:39.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.290+0000 7f0fbeafd700 1 --2- 172.21.15.2:0/2379992645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fb8068580 0x7f0fb80ffcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:39.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.290+0000 7f0fbeafd700 1 --2- 172.21.15.2:0/2379992645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fb8106cd0 0x7f0fb8100230 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:39.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.290+0000 7f0fbeafd700 1 -- 172.21.15.2:0/2379992645 >> 172.21.15.2:0/2379992645 conn(0x7f0fb8075670 msgr2=0x7f0fb80feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:39.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.291+0000 7f0fbeafd700 1 -- 172.21.15.2:0/2379992645 shutdown_connections 2024-09-13T23:02:39.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.291+0000 7f0fbeafd700 1 -- 172.21.15.2:0/2379992645 wait complete. 2024-09-13T23:02:39.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.410+0000 7fec63abc700 1 -- 172.21.15.2:0/1360025194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec5c101e40 msgr2=0x7fec5c102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:39.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.410+0000 7fec63abc700 1 --2- 172.21.15.2:0/1360025194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec5c101e40 0x7fec5c102220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fec58009940 tx=0x7fec58009c50 comp rx=0 tx=0).stop 2024-09-13T23:02:39.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.410+0000 7fec63abc700 1 -- 172.21.15.2:0/1360025194 shutdown_connections 2024-09-13T23:02:39.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.410+0000 7fec63abc700 1 --2- 172.21.15.2:0/1360025194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec5c102760 0x7fec5c10ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:39.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.410+0000 7fec63abc700 1 --2- 172.21.15.2:0/1360025194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec5c101e40 0x7fec5c102220 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:39.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.410+0000 7fec63abc700 1 -- 172.21.15.2:0/1360025194 >> 172.21.15.2:0/1360025194 conn(0x7fec5c0fb610 msgr2=0x7fec5c0fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:39.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.411+0000 7fec63abc700 1 -- 172.21.15.2:0/1360025194 shutdown_connections 2024-09-13T23:02:39.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.411+0000 7fec63abc700 1 -- 172.21.15.2:0/1360025194 wait complete. 2024-09-13T23:02:39.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.411+0000 7fec63abc700 1 Processor -- start 2024-09-13T23:02:39.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.411+0000 7fec63abc700 1 -- start start 2024-09-13T23:02:39.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.412+0000 7fec63abc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec5c101e40 0x7fec5c19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:39.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.412+0000 7fec63abc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec5c102760 0x7fec5c19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:39.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.412+0000 7fec63abc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c19d240 con 0x7fec5c102760 2024-09-13T23:02:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.412+0000 7fec63abc700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c1966f0 con 0x7fec5c101e40 2024-09-13T23:02:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.412+0000 7fec61057700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec5c102760 0x7fec5c19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.412+0000 7fec61057700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec5c102760 0x7fec5c19cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33480/0 (socket says 172.21.15.2:33480) 2024-09-13T23:02:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.412+0000 7fec61057700 1 -- 172.21.15.2:0/2994713035 learned_addr learned my addr 172.21.15.2:0/2994713035 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:02:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.412+0000 7fec61858700 1 --2- 172.21.15.2:0/2994713035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec5c101e40 0x7fec5c19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.412+0000 7fec61057700 1 -- 172.21.15.2:0/2994713035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec5c101e40 msgr2=0x7fec5c19c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.412+0000 7fec61057700 1 --2- 172.21.15.2:0/2994713035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec5c101e40 0x7fec5c19c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.412+0000 7fec61057700 1 -- 172.21.15.2:0/2994713035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec580095f0 con 0x7fec5c102760 2024-09-13T23:02:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.412+0000 7fec61057700 1 --2- 172.21.15.2:0/2994713035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec5c102760 0x7fec5c19cbb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00d8d0 tx=0x7fec4c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.413+0000 7fec52ffd700 1 -- 172.21.15.2:0/2994713035 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec4c0041f0 con 0x7fec5c102760 2024-09-13T23:02:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.413+0000 7fec52ffd700 1 -- 172.21.15.2:0/2994713035 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec4c007620 con 0x7fec5c102760 2024-09-13T23:02:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.413+0000 7fec63abc700 1 -- 172.21.15.2:0/2994713035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5c1969d0 con 0x7fec5c102760 2024-09-13T23:02:39.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.413+0000 7fec52ffd700 1 -- 172.21.15.2:0/2994713035 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec4c003c50 con 0x7fec5c102760 2024-09-13T23:02:39.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.413+0000 7fec63abc700 1 -- 172.21.15.2:0/2994713035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c196f20 con 0x7fec5c102760 2024-09-13T23:02:39.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.414+0000 7fec63abc700 1 -- 172.21.15.2:0/2994713035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5c108350 con 0x7fec5c102760 2024-09-13T23:02:39.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.415+0000 7fec52ffd700 1 -- 172.21.15.2:0/2994713035 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fec4c004350 con 0x7fec5c102760 2024-09-13T23:02:39.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.415+0000 7fec52ffd700 1 --2- 172.21.15.2:0/2994713035 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fec4806e680 0x7fec48070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:39.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.415+0000 7fec52ffd700 1 -- 172.21.15.2:0/2994713035 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fec4c08e160 con 0x7fec5c102760 2024-09-13T23:02:39.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.415+0000 7fec61858700 1 --2- 172.21.15.2:0/2994713035 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fec4806e680 0x7fec48070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:39.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.416+0000 7fec61858700 1 --2- 172.21.15.2:0/2994713035 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fec4806e680 0x7fec48070b40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fec58005b40 tx=0x7fec58005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:39.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.420+0000 7fec52ffd700 1 -- 172.21.15.2:0/2994713035 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fec4c05aee0 con 0x7fec5c102760 2024-09-13T23:02:39.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.641+0000 7fec63abc700 1 -- 172.21.15.2:0/2994713035 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fec5c197200 con 0x7fec4806e680 2024-09-13T23:02:39.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.651+0000 7fec52ffd700 1 -- 172.21.15.2:0/2994713035 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fec5c197200 con 0x7fec4806e680 2024-09-13T23:02:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:02:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (4m) 31s ago 14m 26.9M - 0.25.0 c8568f914cd2 f570a73274bc 2024-09-13T23:02:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (15m) 31s ago 15m 8342k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T23:02:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (14m) 89s ago 14m 8044k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T23:02:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (97s) 31s ago 15m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 427cd38a7d88 2024-09-13T23:02:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (93s) 89s ago 14m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 ce5a1df96005 2024-09-13T23:02:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (3m) 31s ago 14m 78.8M - 9.4.12 2bacad6d85d8 650673516b69 2024-09-13T23:02:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (9m) 31s ago 9m 17.1M - 18.2.1 5be31c24972a 59e9c88c31ca 2024-09-13T23:02:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (9m) 31s ago 9m 91.1M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T23:02:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (9m) 89s ago 9m 150M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T23:02:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (9m) 89s ago 9m 18.9M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T23:02:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 running (6m) 31s ago 16m 499M - 19.1.1-324-gecab7be5 0652ff2b5d78 7a8aa9de37e4 2024-09-13T23:02:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (5m) 89s ago 14m 439M - 19.1.1-324-gecab7be5 0652ff2b5d78 13fa6f3b5a8a 2024-09-13T23:02:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (2m) 31s ago 16m 47.5M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 db0ef6c509cf 2024-09-13T23:02:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (2m) 89s ago 13m 35.3M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 ea0c2a2e0e1a 2024-09-13T23:02:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (4m) 31s ago 15m 15.0M - 1.5.0 0da6a335fe13 f3eae5f90ab8 2024-09-13T23:02:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (4m) 89s ago 14m 16.0M - 1.5.0 0da6a335fe13 a5c7d7f1eaa5 2024-09-13T23:02:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (73s) 31s ago 13m 83.0M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 0ca6dd66fa68 2024-09-13T23:02:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (37s) 31s ago 12m 12.0M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 6f5ae2cfa818 2024-09-13T23:02:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 starting - - - 1217M 2024-09-13T23:02:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (11m) 89s ago 11m 259M 2241M 18.2.1 5be31c24972a fb455cc4c571 2024-09-13T23:02:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (11m) 89s ago 11m 223M 2241M 18.2.1 5be31c24972a f1bdc2c50535 2024-09-13T23:02:39.654 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (10m) 89s ago 10m 199M 2241M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T23:02:39.654 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (4m) 31s ago 14m 69.0M - 2.43.0 a07b618ecd1d aa241d1048de 2024-09-13T23:02:39.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.654+0000 7fec63abc700 1 -- 172.21.15.2:0/2994713035 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fec4806e680 msgr2=0x7fec48070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:39.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.654+0000 7fec63abc700 1 --2- 172.21.15.2:0/2994713035 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fec4806e680 0x7fec48070b40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fec58005b40 tx=0x7fec58005a90 comp rx=0 tx=0).stop 2024-09-13T23:02:39.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.654+0000 7fec63abc700 1 -- 172.21.15.2:0/2994713035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec5c102760 msgr2=0x7fec5c19cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:39.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.654+0000 7fec63abc700 1 --2- 172.21.15.2:0/2994713035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec5c102760 0x7fec5c19cbb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00d8d0 tx=0x7fec4c00dc90 comp rx=0 tx=0).stop 2024-09-13T23:02:39.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.654+0000 7fec63abc700 1 -- 172.21.15.2:0/2994713035 shutdown_connections 2024-09-13T23:02:39.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.654+0000 7fec63abc700 1 --2- 172.21.15.2:0/2994713035 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fec4806e680 0x7fec48070b40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:39.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.654+0000 7fec63abc700 1 --2- 172.21.15.2:0/2994713035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec5c101e40 0x7fec5c19c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:39.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.654+0000 7fec63abc700 1 --2- 172.21.15.2:0/2994713035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec5c102760 0x7fec5c19cbb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:39.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.654+0000 7fec63abc700 1 -- 172.21.15.2:0/2994713035 >> 172.21.15.2:0/2994713035 conn(0x7fec5c0fb610 msgr2=0x7fec5c105490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:39.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.654+0000 7fec63abc700 1 -- 172.21.15.2:0/2994713035 shutdown_connections 2024-09-13T23:02:39.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.654+0000 7fec63abc700 1 -- 172.21.15.2:0/2994713035 wait complete. 2024-09-13T23:02:39.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.767+0000 7f3e0aa38700 1 -- 172.21.15.2:0/2305119787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e040ff340 msgr2=0x7f3e040ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:39.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.767+0000 7f3e0aa38700 1 --2- 172.21.15.2:0/2305119787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e040ff340 0x7f3e040ff7a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009910 tx=0x7f3dec009c20 comp rx=0 tx=0).stop 2024-09-13T23:02:39.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.767+0000 7f3e0aa38700 1 -- 172.21.15.2:0/2305119787 shutdown_connections 2024-09-13T23:02:39.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.767+0000 7f3e0aa38700 1 --2- 172.21.15.2:0/2305119787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e040ff340 0x7f3e040ff7a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:39.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.767+0000 7f3e0aa38700 1 --2- 172.21.15.2:0/2305119787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e04105350 0x7f3e04105730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:39.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.767+0000 7f3e0aa38700 1 -- 172.21.15.2:0/2305119787 >> 172.21.15.2:0/2305119787 conn(0x7f3e04074e30 msgr2=0x7f3e04075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:39.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.767+0000 7f3e0aa38700 1 -- 172.21.15.2:0/2305119787 shutdown_connections 2024-09-13T23:02:39.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.767+0000 7f3e0aa38700 1 -- 172.21.15.2:0/2305119787 wait complete. 2024-09-13T23:02:39.770 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:39 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2[133385]: 2024-09-13T23:02:39.557+0000 7fba0dd32640 -1 Falling back to public interface 2024-09-13T23:02:39.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.768+0000 7f3e0aa38700 1 Processor -- start 2024-09-13T23:02:39.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.768+0000 7f3e0aa38700 1 -- start start 2024-09-13T23:02:39.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.769+0000 7f3e0aa38700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e040ff340 0x7f3e0419c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:39.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.769+0000 7f3e0aa38700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e04105350 0x7f3e0419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:39.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.769+0000 7f3e0aa38700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0419d230 con 0x7f3e040ff340 2024-09-13T23:02:39.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.769+0000 7f3e0aa38700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e04196690 con 0x7f3e04105350 2024-09-13T23:02:39.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.769+0000 7f3e03fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e040ff340 0x7f3e0419c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:39.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.769+0000 7f3e03fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e040ff340 0x7f3e0419c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33496/0 (socket says 172.21.15.2:33496) 2024-09-13T23:02:39.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.769+0000 7f3e03fff700 1 -- 172.21.15.2:0/2811998398 learned_addr learned my addr 172.21.15.2:0/2811998398 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:02:39.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.769+0000 7f3e03fff700 1 -- 172.21.15.2:0/2811998398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e04105350 msgr2=0x7f3e0419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:39.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.769+0000 7f3e03fff700 1 --2- 172.21.15.2:0/2811998398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e04105350 0x7f3e0419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:39.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.769+0000 7f3e03fff700 1 -- 172.21.15.2:0/2811998398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec0095f0 con 0x7f3e040ff340 2024-09-13T23:02:39.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.770+0000 7f3e03fff700 1 --2- 172.21.15.2:0/2811998398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e040ff340 0x7f3e0419c6a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3df400c930 tx=0x7f3df400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:39.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.770+0000 7f3e017fa700 1 -- 172.21.15.2:0/2811998398 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3df4007ad0 con 0x7f3e040ff340 2024-09-13T23:02:39.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.770+0000 7f3e0aa38700 1 -- 172.21.15.2:0/2811998398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e04196970 con 0x7f3e040ff340 2024-09-13T23:02:39.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.770+0000 7f3e017fa700 1 -- 172.21.15.2:0/2811998398 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3df4007c30 con 0x7f3e040ff340 2024-09-13T23:02:39.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.770+0000 7f3e017fa700 1 -- 172.21.15.2:0/2811998398 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3df4007ad0 con 0x7f3e040ff340 2024-09-13T23:02:39.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.770+0000 7f3e0aa38700 1 -- 172.21.15.2:0/2811998398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e04196ec0 con 0x7f3e040ff340 2024-09-13T23:02:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.772+0000 7f3e0aa38700 1 -- 172.21.15.2:0/2811998398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e04107850 con 0x7f3e040ff340 2024-09-13T23:02:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.772+0000 7f3e017fa700 1 -- 172.21.15.2:0/2811998398 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f3df400f450 con 0x7f3e040ff340 2024-09-13T23:02:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.772+0000 7f3e017fa700 1 --2- 172.21.15.2:0/2811998398 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3df006e7b0 0x7f3df0070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.773+0000 7f3e017fa700 1 -- 172.21.15.2:0/2811998398 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3df408e4b0 con 0x7f3e040ff340 2024-09-13T23:02:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.773+0000 7f3e037fe700 1 --2- 172.21.15.2:0/2811998398 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3df006e7b0 0x7f3df0070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.773+0000 7f3e037fe700 1 --2- 172.21.15.2:0/2811998398 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3df006e7b0 0x7f3df0070c70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00b5c0 tx=0x7f3dec005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:39.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:39.782+0000 7f3e017fa700 1 -- 172.21.15.2:0/2811998398 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3df4057660 con 0x7f3e040ff340 2024-09-13T23:02:40.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.151+0000 7f3e0aa38700 1 -- 172.21.15.2:0/2811998398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3e041971a0 con 0x7f3e040ff340 2024-09-13T23:02:40.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:39 smithi002 ceph-mon[111294]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:40.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:39 smithi002 ceph-mon[111294]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:40.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:39 smithi002 ceph-mon[111294]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:40.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.152+0000 7f3e017fa700 1 -- 172.21.15.2:0/2811998398 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7f3df405ad20 con 0x7f3e040ff340 2024-09-13T23:02:40.153 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:02:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T23:02:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:02:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:02:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T23:02:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:02:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:02:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T23:02:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 3, 2024-09-13T23:02:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:02:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:02:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T23:02:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-13T23:02:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:02:40.154 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T23:02:40.155 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 7, 2024-09-13T23:02:40.155 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T23:02:40.155 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T23:02:40.155 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:02:40.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.155+0000 7f3e0aa38700 1 -- 172.21.15.2:0/2811998398 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3df006e7b0 msgr2=0x7f3df0070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:40.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.155+0000 7f3e0aa38700 1 --2- 172.21.15.2:0/2811998398 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3df006e7b0 0x7f3df0070c70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00b5c0 tx=0x7f3dec005fd0 comp rx=0 tx=0).stop 2024-09-13T23:02:40.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.155+0000 7f3e0aa38700 1 -- 172.21.15.2:0/2811998398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e040ff340 msgr2=0x7f3e0419c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:40.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.155+0000 7f3e0aa38700 1 --2- 172.21.15.2:0/2811998398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e040ff340 0x7f3e0419c6a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3df400c930 tx=0x7f3df400ccf0 comp rx=0 tx=0).stop 2024-09-13T23:02:40.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.155+0000 7f3e0aa38700 1 -- 172.21.15.2:0/2811998398 shutdown_connections 2024-09-13T23:02:40.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.155+0000 7f3e0aa38700 1 --2- 172.21.15.2:0/2811998398 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3df006e7b0 0x7f3df0070c70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:40.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.155+0000 7f3e0aa38700 1 --2- 172.21.15.2:0/2811998398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e040ff340 0x7f3e0419c6a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:40.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.155+0000 7f3e0aa38700 1 --2- 172.21.15.2:0/2811998398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e04105350 0x7f3e0419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:40.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.155+0000 7f3e0aa38700 1 -- 172.21.15.2:0/2811998398 >> 172.21.15.2:0/2811998398 conn(0x7f3e04074e30 msgr2=0x7f3e040fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:40.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.155+0000 7f3e0aa38700 1 -- 172.21.15.2:0/2811998398 shutdown_connections 2024-09-13T23:02:40.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.156+0000 7f3e0aa38700 1 -- 172.21.15.2:0/2811998398 wait complete. 2024-09-13T23:02:40.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:39 smithi047 ceph-mon[81243]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:40.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:39 smithi047 ceph-mon[81243]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:40.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:39 smithi047 ceph-mon[81243]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:40.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.272+0000 7fc5f03f4700 1 -- 172.21.15.2:0/2117605533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e8106cd0 msgr2=0x7fc5e81070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:40.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.272+0000 7fc5f03f4700 1 --2- 172.21.15.2:0/2117605533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e8106cd0 0x7fc5e81070b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4009910 tx=0x7fc5e4009c20 comp rx=0 tx=0).stop 2024-09-13T23:02:40.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.272+0000 7fc5f03f4700 1 -- 172.21.15.2:0/2117605533 shutdown_connections 2024-09-13T23:02:40.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.272+0000 7fc5f03f4700 1 --2- 172.21.15.2:0/2117605533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5e8068580 0x7fc5e80689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:40.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.272+0000 7fc5f03f4700 1 --2- 172.21.15.2:0/2117605533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e8106cd0 0x7fc5e81070b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:40.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.272+0000 7fc5f03f4700 1 -- 172.21.15.2:0/2117605533 >> 172.21.15.2:0/2117605533 conn(0x7fc5e8075670 msgr2=0x7fc5e8075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:40.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.272+0000 7fc5f03f4700 1 -- 172.21.15.2:0/2117605533 shutdown_connections 2024-09-13T23:02:40.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.272+0000 7fc5f03f4700 1 -- 172.21.15.2:0/2117605533 wait complete. 2024-09-13T23:02:40.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.273+0000 7fc5f03f4700 1 Processor -- start 2024-09-13T23:02:40.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.273+0000 7fc5f03f4700 1 -- start start 2024-09-13T23:02:40.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.274+0000 7fc5f03f4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5e8068580 0x7fc5e819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:40.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.274+0000 7fc5f03f4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e8106cd0 0x7fc5e819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:40.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.274+0000 7fc5f03f4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e819d230 con 0x7fc5e8106cd0 2024-09-13T23:02:40.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.274+0000 7fc5f03f4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e81966e0 con 0x7fc5e8068580 2024-09-13T23:02:40.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.274+0000 7fc5ed98f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e8106cd0 0x7fc5e819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:40.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.274+0000 7fc5ed98f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e8106cd0 0x7fc5e819cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44232/0 (socket says 172.21.15.2:44232) 2024-09-13T23:02:40.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.274+0000 7fc5ed98f700 1 -- 172.21.15.2:0/1096973598 learned_addr learned my addr 172.21.15.2:0/1096973598 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:02:40.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.274+0000 7fc5ee190700 1 --2- 172.21.15.2:0/1096973598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5e8068580 0x7fc5e819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:40.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.274+0000 7fc5ed98f700 1 -- 172.21.15.2:0/1096973598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5e8068580 msgr2=0x7fc5e819c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:40.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.274+0000 7fc5ed98f700 1 --2- 172.21.15.2:0/1096973598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5e8068580 0x7fc5e819c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:40.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.274+0000 7fc5ed98f700 1 -- 172.21.15.2:0/1096973598 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e40095f0 con 0x7fc5e8106cd0 2024-09-13T23:02:40.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.274+0000 7fc5ed98f700 1 --2- 172.21.15.2:0/1096973598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e8106cd0 0x7fc5e819cba0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc00d900 tx=0x7fc5dc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:40.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.275+0000 7fc5db7fe700 1 -- 172.21.15.2:0/1096973598 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5dc0041f0 con 0x7fc5e8106cd0 2024-09-13T23:02:40.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.275+0000 7fc5db7fe700 1 -- 172.21.15.2:0/1096973598 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5dc004cf0 con 0x7fc5e8106cd0 2024-09-13T23:02:40.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.275+0000 7fc5db7fe700 1 -- 172.21.15.2:0/1096973598 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5dc00b750 con 0x7fc5e8106cd0 2024-09-13T23:02:40.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.275+0000 7fc5f03f4700 1 -- 172.21.15.2:0/1096973598 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e81969c0 con 0x7fc5e8106cd0 2024-09-13T23:02:40.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.276+0000 7fc5f03f4700 1 -- 172.21.15.2:0/1096973598 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e8196f10 con 0x7fc5e8106cd0 2024-09-13T23:02:40.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.276+0000 7fc5f03f4700 1 -- 172.21.15.2:0/1096973598 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e81091d0 con 0x7fc5e8106cd0 2024-09-13T23:02:40.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.277+0000 7fc5db7fe700 1 -- 172.21.15.2:0/1096973598 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fc5dc004750 con 0x7fc5e8106cd0 2024-09-13T23:02:40.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.277+0000 7fc5db7fe700 1 --2- 172.21.15.2:0/1096973598 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc5d406e680 0x7fc5d4070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:40.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.278+0000 7fc5db7fe700 1 -- 172.21.15.2:0/1096973598 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc5dc08e540 con 0x7fc5e8106cd0 2024-09-13T23:02:40.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.278+0000 7fc5ee190700 1 --2- 172.21.15.2:0/1096973598 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc5d406e680 0x7fc5d4070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:40.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.278+0000 7fc5ee190700 1 --2- 172.21.15.2:0/1096973598 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc5d406e680 0x7fc5d4070b40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4006010 tx=0x7fc5e401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:40.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.282+0000 7fc5db7fe700 1 -- 172.21.15.2:0/1096973598 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc5dc05b220 con 0x7fc5e8106cd0 2024-09-13T23:02:40.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.539+0000 7fc5f03f4700 1 -- 172.21.15.2:0/1096973598 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc5e8197130 con 0x7fc5e8106cd0 2024-09-13T23:02:40.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.540+0000 7fc5db7fe700 1 -- 172.21.15.2:0/1096973598 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1938 (secure 0 0 0) 0x7fc5dc05adb0 con 0x7fc5e8106cd0 2024-09-13T23:02:40.541 INFO:teuthology.orchestra.run.smithi002.stdout:e16 2024-09-13T23:02:40.541 INFO:teuthology.orchestra.run.smithi002.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T23:02:40.541 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:02:40.541 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:02:40.541 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-13T23:02:40.542 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:02:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:02:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-13T23:02:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 16 2024-09-13T23:02:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:02:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-13T22:53:05.963265+0000 2024-09-13T23:02:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-13T22:53:25.072026+0000 2024-09-13T23:02:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-13T23:02:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-13T23:02:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-13T23:02:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-13T23:02:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-13T23:02:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-13T23:02:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-13T23:02:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-13T23:02:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 47 2024-09-13T23:02:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:02:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 1 2024-09-13T23:02:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:in 0 2024-09-13T23:02:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24267} 2024-09-13T23:02:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-13T23:02:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-13T23:02:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-13T23:02:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-13T23:02:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-13T23:02:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-13T23:02:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-13T23:02:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-13T23:02:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-13T23:02:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 0 members: 2024-09-13T23:02:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.gxzkha{0:24267} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:02:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.gglyyr{0:14488} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.2:6828/2123560657,v1:172.21.15.2:6829/2123560657] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:02:40.544 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:02:40.544 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:02:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-13T23:02:40.544 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:02:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.auedll{-1:14500} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/1577962179,v1:172.21.15.2:6827/1577962179] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:02:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.nqvveh{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:02:40.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.542+0000 7fc5f03f4700 1 -- 172.21.15.2:0/1096973598 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc5d406e680 msgr2=0x7fc5d4070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:40.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.542+0000 7fc5f03f4700 1 --2- 172.21.15.2:0/1096973598 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc5d406e680 0x7fc5d4070b40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4006010 tx=0x7fc5e401a040 comp rx=0 tx=0).stop 2024-09-13T23:02:40.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.542+0000 7fc5f03f4700 1 -- 172.21.15.2:0/1096973598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e8106cd0 msgr2=0x7fc5e819cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.542+0000 7fc5f03f4700 1 --2- 172.21.15.2:0/1096973598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e8106cd0 0x7fc5e819cba0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc00d900 tx=0x7fc5dc00dc10 comp rx=0 tx=0).stop 2024-09-13T23:02:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.542+0000 7fc5f03f4700 1 -- 172.21.15.2:0/1096973598 shutdown_connections 2024-09-13T23:02:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.542+0000 7fc5f03f4700 1 --2- 172.21.15.2:0/1096973598 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc5d406e680 0x7fc5d4070b40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.542+0000 7fc5f03f4700 1 --2- 172.21.15.2:0/1096973598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc5e8068580 0x7fc5e819c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.542+0000 7fc5f03f4700 1 --2- 172.21.15.2:0/1096973598 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e8106cd0 0x7fc5e819cba0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.542+0000 7fc5f03f4700 1 -- 172.21.15.2:0/1096973598 >> 172.21.15.2:0/1096973598 conn(0x7fc5e8075670 msgr2=0x7fc5e80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.542+0000 7fc5f03f4700 1 -- 172.21.15.2:0/1096973598 shutdown_connections 2024-09-13T23:02:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.542+0000 7fc5f03f4700 1 -- 172.21.15.2:0/1096973598 wait complete. 2024-09-13T23:02:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2024-09-13T23:02:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.653+0000 7f1e5b04b700 1 -- 172.21.15.2:0/3629191930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e54101e80 msgr2=0x7f1e54102260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.653+0000 7f1e5b04b700 1 --2- 172.21.15.2:0/3629191930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e54101e80 0x7f1e54102260 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009910 tx=0x7f1e48009c20 comp rx=0 tx=0).stop 2024-09-13T23:02:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.653+0000 7f1e5b04b700 1 -- 172.21.15.2:0/3629191930 shutdown_connections 2024-09-13T23:02:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.653+0000 7f1e5b04b700 1 --2- 172.21.15.2:0/3629191930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e541027a0 0x7f1e5410ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.653+0000 7f1e5b04b700 1 --2- 172.21.15.2:0/3629191930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e54101e80 0x7f1e54102260 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.653+0000 7f1e5b04b700 1 -- 172.21.15.2:0/3629191930 >> 172.21.15.2:0/3629191930 conn(0x7f1e540fb650 msgr2=0x7f1e540fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.653+0000 7f1e5b04b700 1 -- 172.21.15.2:0/3629191930 shutdown_connections 2024-09-13T23:02:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.653+0000 7f1e5b04b700 1 -- 172.21.15.2:0/3629191930 wait complete. 2024-09-13T23:02:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.654+0000 7f1e5b04b700 1 Processor -- start 2024-09-13T23:02:40.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.654+0000 7f1e5b04b700 1 -- start start 2024-09-13T23:02:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.654+0000 7f1e5b04b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e54101e80 0x7f1e540ffae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.654+0000 7f1e5b04b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e541027a0 0x7f1e54100020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.654+0000 7f1e5b04b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e54100560 con 0x7f1e54101e80 2024-09-13T23:02:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.654+0000 7f1e5b04b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e541006a0 con 0x7f1e541027a0 2024-09-13T23:02:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.654+0000 7f1e58de7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e54101e80 0x7f1e540ffae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.654+0000 7f1e58de7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e54101e80 0x7f1e540ffae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44244/0 (socket says 172.21.15.2:44244) 2024-09-13T23:02:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.654+0000 7f1e58de7700 1 -- 172.21.15.2:0/2713573075 learned_addr learned my addr 172.21.15.2:0/2713573075 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:02:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.654+0000 7f1e53fff700 1 --2- 172.21.15.2:0/2713573075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e541027a0 0x7f1e54100020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.654+0000 7f1e58de7700 1 -- 172.21.15.2:0/2713573075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e541027a0 msgr2=0x7f1e54100020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.654+0000 7f1e58de7700 1 --2- 172.21.15.2:0/2713573075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e541027a0 0x7f1e54100020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.654+0000 7f1e58de7700 1 -- 172.21.15.2:0/2713573075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e480095f0 con 0x7f1e54101e80 2024-09-13T23:02:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.655+0000 7f1e58de7700 1 --2- 172.21.15.2:0/2713573075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e54101e80 0x7f1e540ffae0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1e48005f50 tx=0x7f1e4800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:40.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.655+0000 7f1e51ffb700 1 -- 172.21.15.2:0/2713573075 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e4801d070 con 0x7f1e54101e80 2024-09-13T23:02:40.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.655+0000 7f1e51ffb700 1 -- 172.21.15.2:0/2713573075 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e4800b610 con 0x7f1e54101e80 2024-09-13T23:02:40.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.655+0000 7f1e5b04b700 1 -- 172.21.15.2:0/2713573075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e54100920 con 0x7f1e54101e80 2024-09-13T23:02:40.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.655+0000 7f1e51ffb700 1 -- 172.21.15.2:0/2713573075 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e48022470 con 0x7f1e54101e80 2024-09-13T23:02:40.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.655+0000 7f1e5b04b700 1 -- 172.21.15.2:0/2713573075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e541a2d90 con 0x7f1e54101e80 2024-09-13T23:02:40.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.656+0000 7f1e5b04b700 1 -- 172.21.15.2:0/2713573075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e54108330 con 0x7f1e54101e80 2024-09-13T23:02:40.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.657+0000 7f1e51ffb700 1 -- 172.21.15.2:0/2713573075 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f1e48003780 con 0x7f1e54101e80 2024-09-13T23:02:40.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.657+0000 7f1e51ffb700 1 --2- 172.21.15.2:0/2713573075 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1e4406e680 0x7f1e44070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:40.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.657+0000 7f1e51ffb700 1 -- 172.21.15.2:0/2713573075 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1e4808f9b0 con 0x7f1e54101e80 2024-09-13T23:02:40.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.657+0000 7f1e53fff700 1 --2- 172.21.15.2:0/2713573075 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1e4406e680 0x7f1e44070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:40.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.658+0000 7f1e53fff700 1 --2- 172.21.15.2:0/2713573075 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1e4406e680 0x7f1e44070b40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1e541012d0 tx=0x7f1e40009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:40.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.661+0000 7f1e51ffb700 1 -- 172.21.15.2:0/2713573075 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1e48058c00 con 0x7f1e54101e80 2024-09-13T23:02:40.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.912+0000 7f1e5b04b700 1 -- 172.21.15.2:0/2713573075 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e540611d0 con 0x7f1e4406e680 2024-09-13T23:02:40.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.914+0000 7f1e51ffb700 1 -- 172.21.15.2:0/2713573075 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1e540611d0 con 0x7f1e4406e680 2024-09-13T23:02:40.914 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:02:40.914 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:02:40.915 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T23:02:40.915 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:02:40.915 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-13T23:02:40.915 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-13T23:02:40.915 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-13T23:02:40.915 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2024-09-13T23:02:40.915 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-13T23:02:40.915 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "8/23 daemons upgraded", 2024-09-13T23:02:40.915 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T23:02:40.915 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T23:02:40.915 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:02:40.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.916+0000 7f1e5b04b700 1 -- 172.21.15.2:0/2713573075 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1e4406e680 msgr2=0x7f1e44070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:40.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.916+0000 7f1e5b04b700 1 --2- 172.21.15.2:0/2713573075 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1e4406e680 0x7f1e44070b40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1e541012d0 tx=0x7f1e40009260 comp rx=0 tx=0).stop 2024-09-13T23:02:40.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.916+0000 7f1e5b04b700 1 -- 172.21.15.2:0/2713573075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e54101e80 msgr2=0x7f1e540ffae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:40.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.916+0000 7f1e5b04b700 1 --2- 172.21.15.2:0/2713573075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e54101e80 0x7f1e540ffae0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1e48005f50 tx=0x7f1e4800f690 comp rx=0 tx=0).stop 2024-09-13T23:02:40.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.916+0000 7f1e5b04b700 1 -- 172.21.15.2:0/2713573075 shutdown_connections 2024-09-13T23:02:40.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.916+0000 7f1e5b04b700 1 --2- 172.21.15.2:0/2713573075 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1e4406e680 0x7f1e44070b40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:40.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.916+0000 7f1e5b04b700 1 --2- 172.21.15.2:0/2713573075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e54101e80 0x7f1e540ffae0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:40.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.916+0000 7f1e5b04b700 1 --2- 172.21.15.2:0/2713573075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e541027a0 0x7f1e54100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:40.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.916+0000 7f1e5b04b700 1 -- 172.21.15.2:0/2713573075 >> 172.21.15.2:0/2713573075 conn(0x7f1e540fb650 msgr2=0x7f1e54105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:40.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.916+0000 7f1e5b04b700 1 -- 172.21.15.2:0/2713573075 shutdown_connections 2024-09-13T23:02:40.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:40.916+0000 7f1e5b04b700 1 -- 172.21.15.2:0/2713573075 wait complete. 2024-09-13T23:02:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.025+0000 7f3485816700 1 -- 172.21.15.2:0/3483871310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34800ff5a0 msgr2=0x7f34800ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.025+0000 7f3485816700 1 --2- 172.21.15.2:0/3483871310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34800ff5a0 0x7f34800ff980 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3470009910 tx=0x7f3470009c20 comp rx=0 tx=0).stop 2024-09-13T23:02:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.025+0000 7f3485816700 1 -- 172.21.15.2:0/3483871310 shutdown_connections 2024-09-13T23:02:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.025+0000 7f3485816700 1 --2- 172.21.15.2:0/3483871310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34800fff50 0x7f3480105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.025+0000 7f3485816700 1 --2- 172.21.15.2:0/3483871310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34800ff5a0 0x7f34800ff980 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.025+0000 7f3485816700 1 -- 172.21.15.2:0/3483871310 >> 172.21.15.2:0/3483871310 conn(0x7f3480074e30 msgr2=0x7f3480075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.025+0000 7f3485816700 1 -- 172.21.15.2:0/3483871310 shutdown_connections 2024-09-13T23:02:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.025+0000 7f3485816700 1 -- 172.21.15.2:0/3483871310 wait complete. 2024-09-13T23:02:41.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.026+0000 7f3485816700 1 Processor -- start 2024-09-13T23:02:41.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.026+0000 7f3485816700 1 -- start start 2024-09-13T23:02:41.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.026+0000 7f3485816700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34800ff5a0 0x7f348019c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:41.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.026+0000 7f3485816700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34800fff50 0x7f348019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:41.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.026+0000 7f3485816700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348019d2d0 con 0x7f34800ff5a0 2024-09-13T23:02:41.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.026+0000 7f3485816700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3480196780 con 0x7f34800fff50 2024-09-13T23:02:41.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.026+0000 7f347effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34800ff5a0 0x7f348019c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:41.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.026+0000 7f347effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34800ff5a0 0x7f348019c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44258/0 (socket says 172.21.15.2:44258) 2024-09-13T23:02:41.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.026+0000 7f347effd700 1 -- 172.21.15.2:0/2935446815 learned_addr learned my addr 172.21.15.2:0/2935446815 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:02:41.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.026+0000 7f347e7fc700 1 --2- 172.21.15.2:0/2935446815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34800fff50 0x7f348019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:41.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.026+0000 7f347effd700 1 -- 172.21.15.2:0/2935446815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34800fff50 msgr2=0x7f348019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:41.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.026+0000 7f347effd700 1 --2- 172.21.15.2:0/2935446815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34800fff50 0x7f348019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:41.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.026+0000 7f347effd700 1 -- 172.21.15.2:0/2935446815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34700095f0 con 0x7f34800ff5a0 2024-09-13T23:02:41.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.027+0000 7f347effd700 1 --2- 172.21.15.2:0/2935446815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34800ff5a0 0x7f348019c700 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3470005f50 tx=0x7f347000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:41.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.027+0000 7f3484814700 1 -- 172.21.15.2:0/2935446815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f347001d070 con 0x7f34800ff5a0 2024-09-13T23:02:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.027+0000 7f3484814700 1 -- 172.21.15.2:0/2935446815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f347000b610 con 0x7f34800ff5a0 2024-09-13T23:02:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.027+0000 7f3485816700 1 -- 172.21.15.2:0/2935446815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3480196a00 con 0x7f34800ff5a0 2024-09-13T23:02:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.027+0000 7f3484814700 1 -- 172.21.15.2:0/2935446815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3470022470 con 0x7f34800ff5a0 2024-09-13T23:02:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.027+0000 7f3485816700 1 -- 172.21.15.2:0/2935446815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3480196ef0 con 0x7f34800ff5a0 2024-09-13T23:02:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.028+0000 7f3485816700 1 -- 172.21.15.2:0/2935446815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3480109270 con 0x7f34800ff5a0 2024-09-13T23:02:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.028+0000 7f3484814700 1 -- 172.21.15.2:0/2935446815 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f3470003780 con 0x7f34800ff5a0 2024-09-13T23:02:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.029+0000 7f3484814700 1 --2- 172.21.15.2:0/2935446815 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f346806e680 0x7f3468070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:02:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.029+0000 7f3484814700 1 -- 172.21.15.2:0/2935446815 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f347008f990 con 0x7f34800ff5a0 2024-09-13T23:02:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.029+0000 7f347e7fc700 1 --2- 172.21.15.2:0/2935446815 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f346806e680 0x7f3468070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:02:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.029+0000 7f347e7fc700 1 --2- 172.21.15.2:0/2935446815 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f346806e680 0x7f3468070b40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3480197bf0 tx=0x7f3474009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:02:41.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.033+0000 7f3484814700 1 -- 172.21.15.2:0/2935446815 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f347005c710 con 0x7f34800ff5a0 2024-09-13T23:02:41.094 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:40 smithi002 ceph-mon[111294]: pgmap v91: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 35/264 objects degraded (13.258%) 2024-09-13T23:02:41.094 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:40 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/2811998398' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:02:41.094 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:40 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/1096973598' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:02:41.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:40 smithi047 ceph-mon[81243]: pgmap v91: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 35/264 objects degraded (13.258%) 2024-09-13T23:02:41.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:40 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/2811998398' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:02:41.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:40 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/1096973598' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:02:41.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.339+0000 7f3485816700 1 -- 172.21.15.2:0/2935446815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f348004f2e0 con 0x7f34800ff5a0 2024-09-13T23:02:41.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.340+0000 7f3484814700 1 -- 172.21.15.2:0/2935446815 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1130 (secure 0 0 0) 0x7f347005c2a0 con 0x7f34800ff5a0 2024-09-13T23:02:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 35/264 objects degraded (13.258%), 12 pgs degraded 2024-09-13T23:02:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T23:02:41.341 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T23:02:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T23:02:41.341 INFO:teuthology.orchestra.run.smithi002.stdout: osd.2 (root=default,host=smithi002) is down 2024-09-13T23:02:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 35/264 objects degraded (13.258%), 12 pgs degraded 2024-09-13T23:02:41.341 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-13T23:02:41.341 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-13T23:02:41.341 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-13T23:02:41.341 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-09-13T23:02:41.341 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-13T23:02:41.341 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-13T23:02:41.341 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-13T23:02:41.342 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-13T23:02:41.342 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-13T23:02:41.342 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-09-13T23:02:41.342 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-13T23:02:41.342 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-13T23:02:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.342+0000 7f3485816700 1 -- 172.21.15.2:0/2935446815 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f346806e680 msgr2=0x7f3468070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.342+0000 7f3485816700 1 --2- 172.21.15.2:0/2935446815 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f346806e680 0x7f3468070b40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3480197bf0 tx=0x7f3474009260 comp rx=0 tx=0).stop 2024-09-13T23:02:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.342+0000 7f3485816700 1 -- 172.21.15.2:0/2935446815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34800ff5a0 msgr2=0x7f348019c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:02:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.342+0000 7f3485816700 1 --2- 172.21.15.2:0/2935446815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34800ff5a0 0x7f348019c700 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3470005f50 tx=0x7f347000f690 comp rx=0 tx=0).stop 2024-09-13T23:02:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.342+0000 7f3485816700 1 -- 172.21.15.2:0/2935446815 shutdown_connections 2024-09-13T23:02:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.342+0000 7f3485816700 1 --2- 172.21.15.2:0/2935446815 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f346806e680 0x7f3468070b40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.342+0000 7f3485816700 1 --2- 172.21.15.2:0/2935446815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34800ff5a0 0x7f348019c700 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:41.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.342+0000 7f3485816700 1 --2- 172.21.15.2:0/2935446815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34800fff50 0x7f348019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:02:41.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.342+0000 7f3485816700 1 -- 172.21.15.2:0/2935446815 >> 172.21.15.2:0/2935446815 conn(0x7f3480074e30 msgr2=0x7f34800fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:02:41.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.342+0000 7f3485816700 1 -- 172.21.15.2:0/2935446815 shutdown_connections 2024-09-13T23:02:41.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:02:41.342+0000 7f3485816700 1 -- 172.21.15.2:0/2935446815 wait complete. 2024-09-13T23:02:42.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:41 smithi047 ceph-mon[81243]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:42.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:41 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/2935446815' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:02:42.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:41 smithi002 ceph-mon[111294]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:02:42.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:41 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/2935446815' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:02:42.851 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:42 smithi002 ceph-mon[111294]: pgmap v92: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/264 objects degraded (13.258%) 2024-09-13T23:02:43.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:42 smithi047 ceph-mon[81243]: pgmap v92: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/264 objects degraded (13.258%) 2024-09-13T23:02:44.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:44 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:44.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:44 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:44.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:44 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:44.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:44 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:44.663 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:44 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2[133385]: 2024-09-13T23:02:44.503+0000 7fba0dd32640 -1 osd.2 0 read_superblock omap replica is missing. 2024-09-13T23:02:44.664 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:44 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:44.664 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:44 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:44.664 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:44 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:44.664 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:44 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:44.999 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:44 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2[133385]: 2024-09-13T23:02:44.849+0000 7fba0dd32640 -1 osd.2 60 log_to_monitors true 2024-09-13T23:02:45.634 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:45 smithi002 ceph-mon[111294]: pgmap v93: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/264 objects degraded (13.258%) 2024-09-13T23:02:45.634 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:45 smithi002 ceph-mon[111294]: Health check update: Degraded data redundancy: 35/264 objects degraded (13.258%), 12 pgs degraded (PG_DEGRADED) 2024-09-13T23:02:45.634 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:45 smithi002 ceph-mon[111294]: from='osd.2 [v2:172.21.15.2:6818/234234084,v1:172.21.15.2:6819/234234084]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T23:02:45.634 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:02:45 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2[133385]: 2024-09-13T23:02:45.339+0000 7fba05acc640 -1 osd.2 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:02:45.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:45 smithi047 ceph-mon[81243]: pgmap v93: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 35/264 objects degraded (13.258%) 2024-09-13T23:02:45.664 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:45 smithi047 ceph-mon[81243]: Health check update: Degraded data redundancy: 35/264 objects degraded (13.258%), 12 pgs degraded (PG_DEGRADED) 2024-09-13T23:02:45.665 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:45 smithi047 ceph-mon[81243]: from='osd.2 [v2:172.21.15.2:6818/234234084,v1:172.21.15.2:6819/234234084]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T23:02:46.579 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:46 smithi002 ceph-mon[111294]: from='osd.2 [v2:172.21.15.2:6818/234234084,v1:172.21.15.2:6819/234234084]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T23:02:46.579 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:46 smithi002 ceph-mon[111294]: osdmap e63: 6 total, 5 up, 6 in 2024-09-13T23:02:46.579 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:46 smithi002 ceph-mon[111294]: from='osd.2 [v2:172.21.15.2:6818/234234084,v1:172.21.15.2:6819/234234084]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-13T23:02:46.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:46 smithi047 ceph-mon[81243]: from='osd.2 [v2:172.21.15.2:6818/234234084,v1:172.21.15.2:6819/234234084]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T23:02:46.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:46 smithi047 ceph-mon[81243]: osdmap e63: 6 total, 5 up, 6 in 2024-09-13T23:02:46.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:46 smithi047 ceph-mon[81243]: from='osd.2 [v2:172.21.15.2:6818/234234084,v1:172.21.15.2:6819/234234084]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-13T23:02:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:47 smithi002 ceph-mon[111294]: pgmap v95: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 35/264 objects degraded (13.258%) 2024-09-13T23:02:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:47 smithi002 ceph-mon[111294]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:02:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:47 smithi002 ceph-mon[111294]: osd.2 [v2:172.21.15.2:6818/234234084,v1:172.21.15.2:6819/234234084] boot 2024-09-13T23:02:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:47 smithi002 ceph-mon[111294]: osdmap e64: 6 total, 6 up, 6 in 2024-09-13T23:02:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:47 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:02:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:47 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:47 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:47 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:47 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:02:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:47 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:47.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:47 smithi047 ceph-mon[81243]: pgmap v95: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 35/264 objects degraded (13.258%) 2024-09-13T23:02:47.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:47 smithi047 ceph-mon[81243]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:02:47.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:47 smithi047 ceph-mon[81243]: osd.2 [v2:172.21.15.2:6818/234234084,v1:172.21.15.2:6819/234234084] boot 2024-09-13T23:02:47.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:47 smithi047 ceph-mon[81243]: osdmap e64: 6 total, 6 up, 6 in 2024-09-13T23:02:47.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:47 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T23:02:47.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:47 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:47.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:47 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:47.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:47 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:02:47.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:47 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:02:47.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:47 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:48.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:48 smithi047 ceph-mon[81243]: osdmap e65: 6 total, 6 up, 6 in 2024-09-13T23:02:48.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:48 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:02:48.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:48 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:02:48.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:48 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:02:48.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:48 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:02:48.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:48 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T23:02:48.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:48 smithi047 ceph-mon[81243]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T23:02:48.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:48 smithi047 ceph-mon[81243]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T23:02:48.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:48 smithi002 ceph-mon[111294]: osdmap e65: 6 total, 6 up, 6 in 2024-09-13T23:02:48.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:48 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:02:48.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:48 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:02:48.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:48 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:02:48.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:48 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:02:48.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:48 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T23:02:48.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:48 smithi002 ceph-mon[111294]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T23:02:48.751 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:48 smithi002 ceph-mon[111294]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T23:02:49.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:49 smithi047 ceph-mon[81243]: pgmap v98: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/264 objects degraded (13.258%) 2024-09-13T23:02:49.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:49 smithi002 ceph-mon[111294]: pgmap v98: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 35/264 objects degraded (13.258%) 2024-09-13T23:02:50.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:50 smithi047 ceph-mon[81243]: Health check update: Degraded data redundancy: 25/264 objects degraded (9.470%), 8 pgs degraded (PG_DEGRADED) 2024-09-13T23:02:50.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:50 smithi002 ceph-mon[111294]: Health check update: Degraded data redundancy: 25/264 objects degraded (9.470%), 8 pgs degraded (PG_DEGRADED) 2024-09-13T23:02:51.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:51 smithi047 ceph-mon[81243]: pgmap v99: 65 pgs: 9 active+undersized, 8 active+undersized+degraded, 48 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 25/264 objects degraded (9.470%) 2024-09-13T23:02:51.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:51 smithi002 ceph-mon[111294]: pgmap v99: 65 pgs: 9 active+undersized, 8 active+undersized+degraded, 48 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 25/264 objects degraded (9.470%) 2024-09-13T23:02:52.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:52 smithi002 ceph-mon[111294]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 25/264 objects degraded (9.470%), 8 pgs degraded) 2024-09-13T23:02:52.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:52 smithi047 ceph-mon[81243]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 25/264 objects degraded (9.470%), 8 pgs degraded) 2024-09-13T23:02:53.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:53 smithi002 ceph-mon[111294]: pgmap v100: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 628 B/s rd, 1 op/s 2024-09-13T23:02:53.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:53.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:02:53.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:53 smithi047 ceph-mon[81243]: pgmap v100: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 628 B/s rd, 1 op/s 2024-09-13T23:02:53.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:53.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:02:55.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:55 smithi002 ceph-mon[111294]: pgmap v101: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-13T23:02:55.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:55 smithi047 ceph-mon[81243]: pgmap v101: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-13T23:02:57.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:57 smithi002 ceph-mon[111294]: pgmap v102: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 968 B/s rd, 1 op/s 2024-09-13T23:02:57.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:57 smithi047 ceph-mon[81243]: pgmap v102: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 968 B/s rd, 1 op/s 2024-09-13T23:02:59.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:58 smithi047 ceph-mon[81243]: pgmap v103: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 876 B/s rd, 1 op/s 2024-09-13T23:02:59.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:02:58 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:02:59.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:58 smithi002 ceph-mon[111294]: pgmap v103: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 876 B/s rd, 1 op/s 2024-09-13T23:02:59.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:02:58 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:01.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:00 smithi047 ceph-mon[81243]: pgmap v104: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:03:01.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:00 smithi002 ceph-mon[111294]: pgmap v104: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:03:03.098 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:02 smithi047 ceph-mon[81243]: pgmap v105: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:03:03.098 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:02 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T23:03:03.098 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:02 smithi047 ceph-mon[81243]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T23:03:03.098 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:02 smithi047 ceph-mon[81243]: Upgrade: osd.3 is safe to restart 2024-09-13T23:03:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:02 smithi002 ceph-mon[111294]: pgmap v105: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:03:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:02 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T23:03:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:02 smithi002 ceph-mon[111294]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T23:03:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:02 smithi002 ceph-mon[111294]: Upgrade: osd.3 is safe to restart 2024-09-13T23:03:05.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:04 smithi002 ceph-mon[111294]: pgmap v106: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:03:05.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:04 smithi002 ceph-mon[111294]: Upgrade: Updating osd.3 2024-09-13T23:03:05.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:04 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:05.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:04 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T23:03:05.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:04 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:05.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:04 smithi002 ceph-mon[111294]: Deploying daemon osd.3 on smithi047 2024-09-13T23:03:05.376 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:04 smithi047 ceph-mon[81243]: pgmap v106: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:03:05.376 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:04 smithi047 ceph-mon[81243]: Upgrade: Updating osd.3 2024-09-13T23:03:05.376 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:04 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:05.376 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:04 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T23:03:05.376 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:04 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:05.376 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:04 smithi047 ceph-mon[81243]: Deploying daemon osd.3 on smithi047 2024-09-13T23:03:07.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:06 smithi002 ceph-mon[111294]: pgmap v107: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:03:07.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:06 smithi047 ceph-mon[81243]: pgmap v107: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:03:07.163 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:07 smithi047 systemd[1]: Stopping Ceph osd.3 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:03:07.663 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:07 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3[40579]: 2024-09-13T23:03:07.369+0000 7f3753bbb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:03:07.663 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:07 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3[40579]: 2024-09-13T23:03:07.369+0000 7f3753bbb700 -1 osd.3 65 *** Got signal Terminated *** 2024-09-13T23:03:07.663 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:07 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3[40579]: 2024-09-13T23:03:07.369+0000 7f3753bbb700 -1 osd.3 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:03:08.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:07 smithi002 ceph-mon[111294]: osd.3 marked itself down and dead 2024-09-13T23:03:08.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:03:08.312 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:07 smithi047 ceph-mon[81243]: osd.3 marked itself down and dead 2024-09-13T23:03:08.312 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:03:08.580 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:08 smithi047 podman[90295]: 2024-09-13 23:03:08.311868318 +0000 UTC m=+1.043972418 container died fb455cc4c5715ba53f394f9872936ecf2e60fc2be835c0f8480ff5bc7f1bd064 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.vendor=CentOS, RELEASE=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, GIT_CLEAN=True) 2024-09-13T23:03:08.912 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:08 smithi047 podman[90295]: 2024-09-13 23:03:08.66985752 +0000 UTC m=+1.401961619 container cleanup fb455cc4c5715ba53f394f9872936ecf2e60fc2be835c0f8480ff5bc7f1bd064 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222) 2024-09-13T23:03:08.913 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:08 smithi047 bash[90295]: ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3 2024-09-13T23:03:09.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:08 smithi002 ceph-mon[111294]: pgmap v108: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:03:09.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:08 smithi002 ceph-mon[111294]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:03:09.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:08 smithi002 ceph-mon[111294]: osdmap e66: 6 total, 5 up, 6 in 2024-09-13T23:03:09.297 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:08 smithi047 podman[90312]: 2024-09-13 23:03:08.946211047 +0000 UTC m=+0.626703736 container remove fb455cc4c5715ba53f394f9872936ecf2e60fc2be835c0f8480ff5bc7f1bd064 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, io.buildah.version=1.29.1) 2024-09-13T23:03:09.297 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:08 smithi047 ceph-mon[81243]: pgmap v108: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:03:09.297 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:08 smithi047 ceph-mon[81243]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:03:09.297 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:08 smithi047 ceph-mon[81243]: osdmap e66: 6 total, 5 up, 6 in 2024-09-13T23:03:09.600 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:09 smithi047 podman[90400]: 2024-09-13 23:03:09.297254046 +0000 UTC m=+0.104976586 container create cd131592e49edbc592a4b2fef4cd9692b1051b8829d32dce9896db65d782c454 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:03:09.600 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:09 smithi047 podman[90400]: 2024-09-13 23:03:09.208864963 +0000 UTC m=+0.016587513 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:03:09.600 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:09 smithi047 podman[90400]: 2024-09-13 23:03:09.599860133 +0000 UTC m=+0.407582685 container init cd131592e49edbc592a4b2fef4cd9692b1051b8829d32dce9896db65d782c454 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:03:09.913 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:09 smithi047 podman[90400]: 2024-09-13 23:03:09.603425759 +0000 UTC m=+0.411148300 container start cd131592e49edbc592a4b2fef4cd9692b1051b8829d32dce9896db65d782c454 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-13T23:03:09.913 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:09 smithi047 podman[90400]: 2024-09-13 23:03:09.666444182 +0000 UTC m=+0.474166723 container attach cd131592e49edbc592a4b2fef4cd9692b1051b8829d32dce9896db65d782c454 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-13T23:03:09.913 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:09 smithi047 podman[90400]: 2024-09-13 23:03:09.796053798 +0000 UTC m=+0.603776340 container died cd131592e49edbc592a4b2fef4cd9692b1051b8829d32dce9896db65d782c454 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-13T23:03:10.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:09 smithi002 ceph-mon[111294]: osdmap e67: 6 total, 5 up, 6 in 2024-09-13T23:03:10.370 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:09 smithi047 ceph-mon[81243]: osdmap e67: 6 total, 5 up, 6 in 2024-09-13T23:03:10.621 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:10 smithi047 podman[90422]: 2024-09-13 23:03:10.370107298 +0000 UTC m=+0.564603977 container remove cd131592e49edbc592a4b2fef4cd9692b1051b8829d32dce9896db65d782c454 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T23:03:10.621 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:10 smithi047 systemd[1]: ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-13T23:03:10.621 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:10 smithi047 systemd[1]: Stopped Ceph osd.3 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T23:03:10.621 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:10 smithi047 systemd[1]: ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 7.615s CPU time. 2024-09-13T23:03:10.912 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:10 smithi047 systemd[1]: Starting Ceph osd.3 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:03:10.912 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:10 smithi047 podman[90520]: 2024-09-13 23:03:10.821154325 +0000 UTC m=+0.101824671 container create d389796351e7a87bb1eb105c3193500b08f0f6f43e71c528abd55acf82bbf540 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-activate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:03:10.913 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:10 smithi047 podman[90520]: 2024-09-13 23:03:10.735612604 +0000 UTC m=+0.016282955 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:03:11.227 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:10 smithi047 ceph-mon[81243]: pgmap v111: 65 pgs: 18 peering, 6 stale+active+clean, 41 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:11.228 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:10 smithi047 ceph-mon[81243]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-09-13T23:03:11.228 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:11 smithi047 podman[90520]: 2024-09-13 23:03:11.090783406 +0000 UTC m=+0.371453748 container init d389796351e7a87bb1eb105c3193500b08f0f6f43e71c528abd55acf82bbf540 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:03:11.228 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:11 smithi047 podman[90520]: 2024-09-13 23:03:11.094491798 +0000 UTC m=+0.375162139 container start d389796351e7a87bb1eb105c3193500b08f0f6f43e71c528abd55acf82bbf540 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-13T23:03:11.228 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:11 smithi047 podman[90520]: 2024-09-13 23:03:11.190503288 +0000 UTC m=+0.471173632 container attach d389796351e7a87bb1eb105c3193500b08f0f6f43e71c528abd55acf82bbf540 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:03:11.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:10 smithi002 ceph-mon[111294]: pgmap v111: 65 pgs: 18 peering, 6 stale+active+clean, 41 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-13T23:03:11.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:10 smithi002 ceph-mon[111294]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-09-13T23:03:11.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.465+0000 7f11d55e4700 1 -- 172.21.15.2:0/506888639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d0068580 msgr2=0x7f11d00689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:11.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.465+0000 7f11d55e4700 1 --2- 172.21.15.2:0/506888639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d0068580 0x7f11d00689e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009910 tx=0x7f11c4009c20 comp rx=0 tx=0).stop 2024-09-13T23:03:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.465+0000 7f11d55e4700 1 -- 172.21.15.2:0/506888639 shutdown_connections 2024-09-13T23:03:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.465+0000 7f11d55e4700 1 --2- 172.21.15.2:0/506888639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d0068580 0x7f11d00689e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.465+0000 7f11d55e4700 1 --2- 172.21.15.2:0/506888639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11d0106cd0 0x7f11d01070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.465+0000 7f11d55e4700 1 -- 172.21.15.2:0/506888639 >> 172.21.15.2:0/506888639 conn(0x7f11d0075670 msgr2=0x7f11d0075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.465+0000 7f11d55e4700 1 -- 172.21.15.2:0/506888639 shutdown_connections 2024-09-13T23:03:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.465+0000 7f11d55e4700 1 -- 172.21.15.2:0/506888639 wait complete. 2024-09-13T23:03:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.466+0000 7f11d55e4700 1 Processor -- start 2024-09-13T23:03:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.466+0000 7f11d55e4700 1 -- start start 2024-09-13T23:03:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.466+0000 7f11d55e4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11d0068580 0x7f11d019e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.466+0000 7f11d55e4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d0106cd0 0x7f11d019ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.467+0000 7f11d55e4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d019f420 con 0x7f11d0106cd0 2024-09-13T23:03:11.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.467+0000 7f11d55e4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d01988d0 con 0x7f11d0068580 2024-09-13T23:03:11.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.467+0000 7f11ce7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d0106cd0 0x7f11d019ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:11.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.467+0000 7f11ce7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d0106cd0 0x7f11d019ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51068/0 (socket says 172.21.15.2:51068) 2024-09-13T23:03:11.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.467+0000 7f11ce7fc700 1 -- 172.21.15.2:0/736322982 learned_addr learned my addr 172.21.15.2:0/736322982 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:03:11.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.467+0000 7f11ceffd700 1 --2- 172.21.15.2:0/736322982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11d0068580 0x7f11d019e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:11.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.467+0000 7f11ceffd700 1 -- 172.21.15.2:0/736322982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d0106cd0 msgr2=0x7f11d019ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:11.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.467+0000 7f11ceffd700 1 --2- 172.21.15.2:0/736322982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d0106cd0 0x7f11d019ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:11.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.467+0000 7f11ceffd700 1 -- 172.21.15.2:0/736322982 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c40095f0 con 0x7f11d0068580 2024-09-13T23:03:11.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.467+0000 7f11ce7fc700 1 --2- 172.21.15.2:0/736322982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d0106cd0 0x7f11d019ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T23:03:11.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.467+0000 7f11ceffd700 1 --2- 172.21.15.2:0/736322982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11d0068580 0x7f11d019e850 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f11c000ef10 tx=0x7f11c000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:11.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.467+0000 7f11b7fff700 1 -- 172.21.15.2:0/736322982 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11c000c9f0 con 0x7f11d0068580 2024-09-13T23:03:11.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.467+0000 7f11b7fff700 1 -- 172.21.15.2:0/736322982 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f11c000f040 con 0x7f11d0068580 2024-09-13T23:03:11.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.467+0000 7f11d55e4700 1 -- 172.21.15.2:0/736322982 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d0198b50 con 0x7f11d0068580 2024-09-13T23:03:11.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.467+0000 7f11b7fff700 1 -- 172.21.15.2:0/736322982 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11c00146b0 con 0x7f11d0068580 2024-09-13T23:03:11.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.468+0000 7f11d55e4700 1 -- 172.21.15.2:0/736322982 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d01990a0 con 0x7f11d0068580 2024-09-13T23:03:11.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.469+0000 7f11d55e4700 1 -- 172.21.15.2:0/736322982 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d004f2e0 con 0x7f11d0068580 2024-09-13T23:03:11.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.469+0000 7f11b7fff700 1 -- 172.21.15.2:0/736322982 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f11c000cb50 con 0x7f11d0068580 2024-09-13T23:03:11.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.470+0000 7f11b7fff700 1 --2- 172.21.15.2:0/736322982 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f11b806e680 0x7f11b8070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:11.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.470+0000 7f11b7fff700 1 -- 172.21.15.2:0/736322982 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f11c008ea00 con 0x7f11d0068580 2024-09-13T23:03:11.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.470+0000 7f11ce7fc700 1 --2- 172.21.15.2:0/736322982 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f11b806e680 0x7f11b8070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:11.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.470+0000 7f11ce7fc700 1 --2- 172.21.15.2:0/736322982 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f11b806e680 0x7f11b8070b40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f11c400b760 tx=0x7f11c4005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:11.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.475+0000 7f11b7fff700 1 -- 172.21.15.2:0/736322982 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f11c005b6e0 con 0x7f11d0068580 2024-09-13T23:03:11.662 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:11 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-activate[90535]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:03:11.663 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:11 smithi047 bash[90520]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:03:11.663 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:11 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-activate[90535]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:03:11.663 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:11 smithi047 bash[90520]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:03:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.704+0000 7f11d55e4700 1 -- 172.21.15.2:0/736322982 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f11d0199330 con 0x7f11b806e680 2024-09-13T23:03:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.705+0000 7f11b7fff700 1 -- 172.21.15.2:0/736322982 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f11d0199330 con 0x7f11b806e680 2024-09-13T23:03:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.707+0000 7f11d55e4700 1 -- 172.21.15.2:0/736322982 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f11b806e680 msgr2=0x7f11b8070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.707+0000 7f11d55e4700 1 --2- 172.21.15.2:0/736322982 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f11b806e680 0x7f11b8070b40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f11c400b760 tx=0x7f11c4005a90 comp rx=0 tx=0).stop 2024-09-13T23:03:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.707+0000 7f11d55e4700 1 -- 172.21.15.2:0/736322982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11d0068580 msgr2=0x7f11d019e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.707+0000 7f11d55e4700 1 --2- 172.21.15.2:0/736322982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11d0068580 0x7f11d019e850 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f11c000ef10 tx=0x7f11c000c3a0 comp rx=0 tx=0).stop 2024-09-13T23:03:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.707+0000 7f11d55e4700 1 -- 172.21.15.2:0/736322982 shutdown_connections 2024-09-13T23:03:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.707+0000 7f11d55e4700 1 --2- 172.21.15.2:0/736322982 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f11b806e680 0x7f11b8070b40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.707+0000 7f11d55e4700 1 --2- 172.21.15.2:0/736322982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11d0068580 0x7f11d019e850 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.707+0000 7f11d55e4700 1 --2- 172.21.15.2:0/736322982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d0106cd0 0x7f11d019ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.707+0000 7f11d55e4700 1 -- 172.21.15.2:0/736322982 >> 172.21.15.2:0/736322982 conn(0x7f11d0075670 msgr2=0x7f11d00fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.707+0000 7f11d55e4700 1 -- 172.21.15.2:0/736322982 shutdown_connections 2024-09-13T23:03:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.707+0000 7f11d55e4700 1 -- 172.21.15.2:0/736322982 wait complete. 2024-09-13T23:03:11.719 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T23:03:11.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.822+0000 7fc6e273d700 1 -- 172.21.15.2:0/3608918493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6dc106cd0 msgr2=0x7fc6dc1070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:11.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.822+0000 7fc6e273d700 1 --2- 172.21.15.2:0/3608918493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6dc106cd0 0x7fc6dc1070b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009910 tx=0x7fc6cc009c20 comp rx=0 tx=0).stop 2024-09-13T23:03:11.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.823+0000 7fc6e273d700 1 -- 172.21.15.2:0/3608918493 shutdown_connections 2024-09-13T23:03:11.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.823+0000 7fc6e273d700 1 --2- 172.21.15.2:0/3608918493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6dc068580 0x7fc6dc0689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:11.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.823+0000 7fc6e273d700 1 --2- 172.21.15.2:0/3608918493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6dc106cd0 0x7fc6dc1070b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:11.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.823+0000 7fc6e273d700 1 -- 172.21.15.2:0/3608918493 >> 172.21.15.2:0/3608918493 conn(0x7fc6dc075670 msgr2=0x7fc6dc075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:11.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.823+0000 7fc6e273d700 1 -- 172.21.15.2:0/3608918493 shutdown_connections 2024-09-13T23:03:11.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.823+0000 7fc6e273d700 1 -- 172.21.15.2:0/3608918493 wait complete. 2024-09-13T23:03:11.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.823+0000 7fc6e273d700 1 Processor -- start 2024-09-13T23:03:11.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.823+0000 7fc6e273d700 1 -- start start 2024-09-13T23:03:11.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.824+0000 7fc6e273d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6dc068580 0x7fc6dc19c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:11.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.824+0000 7fc6e273d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6dc106cd0 0x7fc6dc19cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:11.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.824+0000 7fc6e273d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc19d230 con 0x7fc6dc106cd0 2024-09-13T23:03:11.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.824+0000 7fc6e273d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc1966e0 con 0x7fc6dc068580 2024-09-13T23:03:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.824+0000 7fc6db7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6dc106cd0 0x7fc6dc19cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.824+0000 7fc6db7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6dc106cd0 0x7fc6dc19cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51090/0 (socket says 172.21.15.2:51090) 2024-09-13T23:03:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.824+0000 7fc6db7fe700 1 -- 172.21.15.2:0/923911933 learned_addr learned my addr 172.21.15.2:0/923911933 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:03:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.824+0000 7fc6dbfff700 1 --2- 172.21.15.2:0/923911933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6dc068580 0x7fc6dc19c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.824+0000 7fc6db7fe700 1 -- 172.21.15.2:0/923911933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6dc068580 msgr2=0x7fc6dc19c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.824+0000 7fc6db7fe700 1 --2- 172.21.15.2:0/923911933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6dc068580 0x7fc6dc19c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.824+0000 7fc6db7fe700 1 -- 172.21.15.2:0/923911933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc0095f0 con 0x7fc6dc106cd0 2024-09-13T23:03:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.824+0000 7fc6dbfff700 1 --2- 172.21.15.2:0/923911933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6dc068580 0x7fc6dc19c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T23:03:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.825+0000 7fc6db7fe700 1 --2- 172.21.15.2:0/923911933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6dc106cd0 0x7fc6dc19cba0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000d900 tx=0x7fc6d000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.825+0000 7fc6d97fa700 1 -- 172.21.15.2:0/923911933 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d00041f0 con 0x7fc6dc106cd0 2024-09-13T23:03:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.825+0000 7fc6d97fa700 1 -- 172.21.15.2:0/923911933 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6d0004cf0 con 0x7fc6dc106cd0 2024-09-13T23:03:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.825+0000 7fc6e273d700 1 -- 172.21.15.2:0/923911933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6dc1969c0 con 0x7fc6dc106cd0 2024-09-13T23:03:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.825+0000 7fc6d97fa700 1 -- 172.21.15.2:0/923911933 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d000b750 con 0x7fc6dc106cd0 2024-09-13T23:03:11.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.825+0000 7fc6e273d700 1 -- 172.21.15.2:0/923911933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6dc196f10 con 0x7fc6dc106cd0 2024-09-13T23:03:11.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.826+0000 7fc6e273d700 1 -- 172.21.15.2:0/923911933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6dc1091d0 con 0x7fc6dc106cd0 2024-09-13T23:03:11.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.827+0000 7fc6d97fa700 1 -- 172.21.15.2:0/923911933 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fc6d0004830 con 0x7fc6dc106cd0 2024-09-13T23:03:11.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.827+0000 7fc6d97fa700 1 --2- 172.21.15.2:0/923911933 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc6c4072a90 0x7fc6c4074f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:11.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.828+0000 7fc6d97fa700 1 -- 172.21.15.2:0/923911933 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc6d008e4c0 con 0x7fc6dc106cd0 2024-09-13T23:03:11.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.828+0000 7fc6dbfff700 1 --2- 172.21.15.2:0/923911933 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc6c4072a90 0x7fc6c4074f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:11.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.828+0000 7fc6dbfff700 1 --2- 172.21.15.2:0/923911933 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc6c4072a90 0x7fc6c4074f50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc006010 tx=0x7fc6cc01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:11.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:11.832+0000 7fc6d97fa700 1 -- 172.21.15.2:0/923911933 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc6d005b240 con 0x7fc6dc106cd0 2024-09-13T23:03:11.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:11 smithi002 ceph-mon[111294]: from='client.44207 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.069+0000 7fc6e273d700 1 -- 172.21.15.2:0/923911933 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6dc197180 con 0x7fc6c4072a90 2024-09-13T23:03:12.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.070+0000 7fc6d97fa700 1 -- 172.21.15.2:0/923911933 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc6dc197180 con 0x7fc6c4072a90 2024-09-13T23:03:12.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.072+0000 7fc6e273d700 1 -- 172.21.15.2:0/923911933 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc6c4072a90 msgr2=0x7fc6c4074f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:12.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.072+0000 7fc6e273d700 1 --2- 172.21.15.2:0/923911933 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc6c4072a90 0x7fc6c4074f50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc006010 tx=0x7fc6cc01a040 comp rx=0 tx=0).stop 2024-09-13T23:03:12.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.072+0000 7fc6e273d700 1 -- 172.21.15.2:0/923911933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6dc106cd0 msgr2=0x7fc6dc19cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:12.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.072+0000 7fc6e273d700 1 --2- 172.21.15.2:0/923911933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6dc106cd0 0x7fc6dc19cba0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000d900 tx=0x7fc6d000dc10 comp rx=0 tx=0).stop 2024-09-13T23:03:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.072+0000 7fc6e273d700 1 -- 172.21.15.2:0/923911933 shutdown_connections 2024-09-13T23:03:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.072+0000 7fc6e273d700 1 --2- 172.21.15.2:0/923911933 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc6c4072a90 0x7fc6c4074f50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.072+0000 7fc6e273d700 1 --2- 172.21.15.2:0/923911933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6dc068580 0x7fc6dc19c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.072+0000 7fc6e273d700 1 --2- 172.21.15.2:0/923911933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6dc106cd0 0x7fc6dc19cba0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.072+0000 7fc6e273d700 1 -- 172.21.15.2:0/923911933 >> 172.21.15.2:0/923911933 conn(0x7fc6dc075670 msgr2=0x7fc6dc0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.072+0000 7fc6e273d700 1 -- 172.21.15.2:0/923911933 shutdown_connections 2024-09-13T23:03:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.073+0000 7fc6e273d700 1 -- 172.21.15.2:0/923911933 wait complete. 2024-09-13T23:03:12.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.180+0000 7f3851695700 1 -- 172.21.15.2:0/2254709216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f384c0730b0 msgr2=0x7f384c073490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:12.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.180+0000 7f3851695700 1 --2- 172.21.15.2:0/2254709216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f384c0730b0 0x7f384c073490 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f383c009910 tx=0x7f383c009c20 comp rx=0 tx=0).stop 2024-09-13T23:03:12.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.180+0000 7f3851695700 1 -- 172.21.15.2:0/2254709216 shutdown_connections 2024-09-13T23:03:12.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.180+0000 7f3851695700 1 --2- 172.21.15.2:0/2254709216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f384c0739d0 0x7f384c10cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:12.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.180+0000 7f3851695700 1 --2- 172.21.15.2:0/2254709216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f384c0730b0 0x7f384c073490 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:12.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.180+0000 7f3851695700 1 -- 172.21.15.2:0/2254709216 >> 172.21.15.2:0/2254709216 conn(0x7f384c0fc750 msgr2=0x7f384c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:12.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.180+0000 7f3851695700 1 -- 172.21.15.2:0/2254709216 shutdown_connections 2024-09-13T23:03:12.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.180+0000 7f3851695700 1 -- 172.21.15.2:0/2254709216 wait complete. 2024-09-13T23:03:12.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.181+0000 7f3851695700 1 Processor -- start 2024-09-13T23:03:12.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.181+0000 7f3851695700 1 -- start start 2024-09-13T23:03:12.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.182+0000 7f3851695700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f384c0730b0 0x7f384c19e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:12.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.182+0000 7f3851695700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f384c0739d0 0x7f384c19eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:12.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.182+0000 7f3851695700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c19f530 con 0x7f384c0739d0 2024-09-13T23:03:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.182+0000 7f3851695700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c1989e0 con 0x7f384c0730b0 2024-09-13T23:03:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.182+0000 7f384a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f384c0739d0 0x7f384c19eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.182+0000 7f384a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f384c0739d0 0x7f384c19eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51100/0 (socket says 172.21.15.2:51100) 2024-09-13T23:03:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.182+0000 7f384a7fc700 1 -- 172.21.15.2:0/119695479 learned_addr learned my addr 172.21.15.2:0/119695479 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:03:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.182+0000 7f384affd700 1 --2- 172.21.15.2:0/119695479 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f384c0730b0 0x7f384c19e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.182+0000 7f384a7fc700 1 -- 172.21.15.2:0/119695479 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f384c0730b0 msgr2=0x7f384c19e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.182+0000 7f384a7fc700 1 --2- 172.21.15.2:0/119695479 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f384c0730b0 0x7f384c19e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.182+0000 7f384a7fc700 1 -- 172.21.15.2:0/119695479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c0095f0 con 0x7f384c0739d0 2024-09-13T23:03:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.182+0000 7f384affd700 1 --2- 172.21.15.2:0/119695479 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f384c0730b0 0x7f384c19e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:03:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.182+0000 7f384a7fc700 1 --2- 172.21.15.2:0/119695479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f384c0739d0 0x7f384c19eea0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f384000b4b0 tx=0x7f384000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.182+0000 7f3833fff700 1 -- 172.21.15.2:0/119695479 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3840011800 con 0x7f384c0739d0 2024-09-13T23:03:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.182+0000 7f3833fff700 1 -- 172.21.15.2:0/119695479 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3840011e20 con 0x7f384c0739d0 2024-09-13T23:03:12.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.182+0000 7f3833fff700 1 -- 172.21.15.2:0/119695479 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f384000f2e0 con 0x7f384c0739d0 2024-09-13T23:03:12.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.182+0000 7f3851695700 1 -- 172.21.15.2:0/119695479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384c198cc0 con 0x7f384c0739d0 2024-09-13T23:03:12.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.183+0000 7f3851695700 1 -- 172.21.15.2:0/119695479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384c199210 con 0x7f384c0739d0 2024-09-13T23:03:12.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.184+0000 7f3851695700 1 -- 172.21.15.2:0/119695479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384c10a6c0 con 0x7f384c0739d0 2024-09-13T23:03:12.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.184+0000 7f3833fff700 1 -- 172.21.15.2:0/119695479 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f3840010380 con 0x7f384c0739d0 2024-09-13T23:03:12.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.184+0000 7f3833fff700 1 --2- 172.21.15.2:0/119695479 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f383406e680 0x7f3834070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:12.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.185+0000 7f3833fff700 1 -- 172.21.15.2:0/119695479 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f384008e0d0 con 0x7f384c0739d0 2024-09-13T23:03:12.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.185+0000 7f384affd700 1 --2- 172.21.15.2:0/119695479 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f383406e680 0x7f3834070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:12.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.185+0000 7f384affd700 1 --2- 172.21.15.2:0/119695479 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f383406e680 0x7f3834070b40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f383c006010 tx=0x7f383c00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:12.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.189+0000 7f3833fff700 1 -- 172.21.15.2:0/119695479 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f384005af80 con 0x7f384c0739d0 2024-09-13T23:03:12.264 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:11 smithi047 ceph-mon[81243]: from='client.44207 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:12.265 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:11 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-activate[90535]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T23:03:12.265 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:11 smithi047 bash[90520]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T23:03:12.265 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:11 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-activate[90535]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T23:03:12.265 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:11 smithi047 bash[90520]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T23:03:12.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.407+0000 7f3851695700 1 -- 172.21.15.2:0/119695479 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f384c1994e0 con 0x7f383406e680 2024-09-13T23:03:12.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.418+0000 7f3833fff700 1 -- 172.21.15.2:0/119695479 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f384c1994e0 con 0x7f383406e680 2024-09-13T23:03:12.419 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:03:12.420 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (4m) 29s ago 15m 27.0M - 0.25.0 c8568f914cd2 f570a73274bc 2024-09-13T23:03:12.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (15m) 29s ago 15m 8548k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T23:03:12.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (14m) 2m ago 14m 8044k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T23:03:12.420 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (2m) 29s ago 15m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 427cd38a7d88 2024-09-13T23:03:12.420 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (2m) 2m ago 14m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 ce5a1df96005 2024-09-13T23:03:12.420 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (4m) 29s ago 15m 80.3M - 9.4.12 2bacad6d85d8 650673516b69 2024-09-13T23:03:12.420 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (10m) 29s ago 10m 17.3M - 18.2.1 5be31c24972a 59e9c88c31ca 2024-09-13T23:03:12.420 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (9m) 29s ago 9m 91.1M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T23:03:12.420 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (9m) 2m ago 9m 150M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T23:03:12.420 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (9m) 2m ago 9m 18.9M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T23:03:12.420 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 running (6m) 29s ago 16m 499M - 19.1.1-324-gecab7be5 0652ff2b5d78 7a8aa9de37e4 2024-09-13T23:03:12.420 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (5m) 2m ago 14m 439M - 19.1.1-324-gecab7be5 0652ff2b5d78 13fa6f3b5a8a 2024-09-13T23:03:12.421 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (3m) 29s ago 17m 49.2M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 db0ef6c509cf 2024-09-13T23:03:12.421 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (2m) 2m ago 14m 35.3M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 ea0c2a2e0e1a 2024-09-13T23:03:12.421 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (5m) 29s ago 15m 15.0M - 1.5.0 0da6a335fe13 f3eae5f90ab8 2024-09-13T23:03:12.421 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (5m) 2m ago 14m 16.0M - 1.5.0 0da6a335fe13 a5c7d7f1eaa5 2024-09-13T23:03:12.421 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (105s) 29s ago 13m 84.5M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 0ca6dd66fa68 2024-09-13T23:03:12.421 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (70s) 29s ago 13m 86.5M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 6f5ae2cfa818 2024-09-13T23:03:12.421 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (35s) 29s ago 12m 11.9M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 15b9e8db7556 2024-09-13T23:03:12.421 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (12m) 2m ago 12m 259M 2241M 18.2.1 5be31c24972a fb455cc4c571 2024-09-13T23:03:12.421 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (11m) 2m ago 11m 223M 2241M 18.2.1 5be31c24972a f1bdc2c50535 2024-09-13T23:03:12.421 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (11m) 2m ago 11m 199M 2241M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T23:03:12.421 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (5m) 29s ago 15m 71.7M - 2.43.0 a07b618ecd1d aa241d1048de 2024-09-13T23:03:12.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.420+0000 7f3851695700 1 -- 172.21.15.2:0/119695479 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f383406e680 msgr2=0x7f3834070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:12.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.420+0000 7f3851695700 1 --2- 172.21.15.2:0/119695479 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f383406e680 0x7f3834070b40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f383c006010 tx=0x7f383c00b540 comp rx=0 tx=0).stop 2024-09-13T23:03:12.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.420+0000 7f3851695700 1 -- 172.21.15.2:0/119695479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f384c0739d0 msgr2=0x7f384c19eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:12.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.420+0000 7f3851695700 1 --2- 172.21.15.2:0/119695479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f384c0739d0 0x7f384c19eea0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f384000b4b0 tx=0x7f384000b870 comp rx=0 tx=0).stop 2024-09-13T23:03:12.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.420+0000 7f3851695700 1 -- 172.21.15.2:0/119695479 shutdown_connections 2024-09-13T23:03:12.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.420+0000 7f3851695700 1 --2- 172.21.15.2:0/119695479 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f383406e680 0x7f3834070b40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:12.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.420+0000 7f3851695700 1 --2- 172.21.15.2:0/119695479 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f384c0730b0 0x7f384c19e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:12.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.420+0000 7f3851695700 1 --2- 172.21.15.2:0/119695479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f384c0739d0 0x7f384c19eea0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:12.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.420+0000 7f3851695700 1 -- 172.21.15.2:0/119695479 >> 172.21.15.2:0/119695479 conn(0x7f384c0fc750 msgr2=0x7f384c107800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:12.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.421+0000 7f3851695700 1 -- 172.21.15.2:0/119695479 shutdown_connections 2024-09-13T23:03:12.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.421+0000 7f3851695700 1 -- 172.21.15.2:0/119695479 wait complete. 2024-09-13T23:03:12.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.527+0000 7fc264f53700 1 -- 172.21.15.2:0/322942693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc260105bd0 msgr2=0x7fc260105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:12.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.527+0000 7fc264f53700 1 --2- 172.21.15.2:0/322942693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc260105bd0 0x7fc260105fb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc250009910 tx=0x7fc250009c20 comp rx=0 tx=0).stop 2024-09-13T23:03:12.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.527+0000 7fc264f53700 1 -- 172.21.15.2:0/322942693 shutdown_connections 2024-09-13T23:03:12.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.527+0000 7fc264f53700 1 --2- 172.21.15.2:0/322942693 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2600ffc20 0x7fc260100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:12.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.527+0000 7fc264f53700 1 --2- 172.21.15.2:0/322942693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc260105bd0 0x7fc260105fb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:12.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.527+0000 7fc264f53700 1 -- 172.21.15.2:0/322942693 >> 172.21.15.2:0/322942693 conn(0x7fc260075670 msgr2=0x7fc260075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:12.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.527+0000 7fc264f53700 1 -- 172.21.15.2:0/322942693 shutdown_connections 2024-09-13T23:03:12.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.527+0000 7fc264f53700 1 -- 172.21.15.2:0/322942693 wait complete. 2024-09-13T23:03:12.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.528+0000 7fc264f53700 1 Processor -- start 2024-09-13T23:03:12.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.528+0000 7fc264f53700 1 -- start start 2024-09-13T23:03:12.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.528+0000 7fc264f53700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2600ffc20 0x7fc260101840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:12.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.528+0000 7fc264f53700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc260105bd0 0x7fc260101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:12.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.528+0000 7fc264f53700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2601022c0 con 0x7fc260105bd0 2024-09-13T23:03:12.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.528+0000 7fc264f53700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc260102400 con 0x7fc2600ffc20 2024-09-13T23:03:12.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.528+0000 7fc25dd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc260105bd0 0x7fc260101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:12.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.528+0000 7fc25dd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc260105bd0 0x7fc260101d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51126/0 (socket says 172.21.15.2:51126) 2024-09-13T23:03:12.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.528+0000 7fc25dd9b700 1 -- 172.21.15.2:0/2230684639 learned_addr learned my addr 172.21.15.2:0/2230684639 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:03:12.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.528+0000 7fc25e59c700 1 --2- 172.21.15.2:0/2230684639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2600ffc20 0x7fc260101840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:12.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.529+0000 7fc25dd9b700 1 -- 172.21.15.2:0/2230684639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2600ffc20 msgr2=0x7fc260101840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:12.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.529+0000 7fc25dd9b700 1 --2- 172.21.15.2:0/2230684639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2600ffc20 0x7fc260101840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:12.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.529+0000 7fc25dd9b700 1 -- 172.21.15.2:0/2230684639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2500095f0 con 0x7fc260105bd0 2024-09-13T23:03:12.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.529+0000 7fc25e59c700 1 --2- 172.21.15.2:0/2230684639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2600ffc20 0x7fc260101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:03:12.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.529+0000 7fc25dd9b700 1 --2- 172.21.15.2:0/2230684639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc260105bd0 0x7fc260101d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc25400b4b0 tx=0x7fc25400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:12.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.529+0000 7fc24f7fe700 1 -- 172.21.15.2:0/2230684639 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc254011800 con 0x7fc260105bd0 2024-09-13T23:03:12.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.529+0000 7fc264f53700 1 -- 172.21.15.2:0/2230684639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2601a2b10 con 0x7fc260105bd0 2024-09-13T23:03:12.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.529+0000 7fc24f7fe700 1 -- 172.21.15.2:0/2230684639 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc254011e20 con 0x7fc260105bd0 2024-09-13T23:03:12.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.529+0000 7fc24f7fe700 1 -- 172.21.15.2:0/2230684639 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc25400f2e0 con 0x7fc260105bd0 2024-09-13T23:03:12.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.529+0000 7fc264f53700 1 -- 172.21.15.2:0/2230684639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2601a2f20 con 0x7fc260105bd0 2024-09-13T23:03:12.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.530+0000 7fc264f53700 1 -- 172.21.15.2:0/2230684639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26004f2e0 con 0x7fc260105bd0 2024-09-13T23:03:12.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.531+0000 7fc24f7fe700 1 -- 172.21.15.2:0/2230684639 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fc254010380 con 0x7fc260105bd0 2024-09-13T23:03:12.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.531+0000 7fc24f7fe700 1 --2- 172.21.15.2:0/2230684639 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc24806e680 0x7fc248070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:12.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.531+0000 7fc24f7fe700 1 -- 172.21.15.2:0/2230684639 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc25408e180 con 0x7fc260105bd0 2024-09-13T23:03:12.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.531+0000 7fc25e59c700 1 --2- 172.21.15.2:0/2230684639 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc24806e680 0x7fc248070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:12.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.532+0000 7fc25e59c700 1 --2- 172.21.15.2:0/2230684639 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc24806e680 0x7fc248070b40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc25000b5c0 tx=0x7fc250005480 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:12.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.535+0000 7fc24f7fe700 1 -- 172.21.15.2:0/2230684639 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc2540573d0 con 0x7fc260105bd0 2024-09-13T23:03:12.602 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:12 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-activate[90535]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T23:03:12.602 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:12 smithi047 bash[90520]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T23:03:12.602 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:12 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-activate[90535]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T23:03:12.603 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:12 smithi047 bash[90520]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T23:03:12.603 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:12 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-activate[90535]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T23:03:12.603 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:12 smithi047 bash[90520]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T23:03:12.603 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:12 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-activate[90535]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T23:03:12.603 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:12 smithi047 bash[90520]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T23:03:12.603 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:12 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-activate[90535]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T23:03:12.603 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:12 smithi047 bash[90520]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T23:03:12.603 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:12 smithi047 podman[90520]: 2024-09-13 23:03:12.296199398 +0000 UTC m=+1.576869739 container died d389796351e7a87bb1eb105c3193500b08f0f6f43e71c528abd55acf82bbf540 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-activate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-13T23:03:12.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.835+0000 7fc264f53700 1 -- 172.21.15.2:0/2230684639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc260102d70 con 0x7fc260105bd0 2024-09-13T23:03:12.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.835+0000 7fc24f7fe700 1 -- 172.21.15.2:0/2230684639 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7fc25405aa90 con 0x7fc260105bd0 2024-09-13T23:03:12.837 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:03:12.837 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T23:03:12.837 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:03:12.837 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:03:12.837 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T23:03:12.837 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:03:12.837 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:03:12.837 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T23:03:12.837 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2, 2024-09-13T23:03:12.837 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 3 2024-09-13T23:03:12.837 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:03:12.837 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T23:03:12.838 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-13T23:03:12.838 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:03:12.838 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T23:03:12.838 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6, 2024-09-13T23:03:12.838 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 7 2024-09-13T23:03:12.838 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T23:03:12.838 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:03:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.838+0000 7fc264f53700 1 -- 172.21.15.2:0/2230684639 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc24806e680 msgr2=0x7fc248070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.838+0000 7fc264f53700 1 --2- 172.21.15.2:0/2230684639 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc24806e680 0x7fc248070b40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc25000b5c0 tx=0x7fc250005480 comp rx=0 tx=0).stop 2024-09-13T23:03:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.838+0000 7fc264f53700 1 -- 172.21.15.2:0/2230684639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc260105bd0 msgr2=0x7fc260101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.838+0000 7fc264f53700 1 --2- 172.21.15.2:0/2230684639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc260105bd0 0x7fc260101d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc25400b4b0 tx=0x7fc25400b870 comp rx=0 tx=0).stop 2024-09-13T23:03:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.838+0000 7fc264f53700 1 -- 172.21.15.2:0/2230684639 shutdown_connections 2024-09-13T23:03:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.838+0000 7fc264f53700 1 --2- 172.21.15.2:0/2230684639 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc24806e680 0x7fc248070b40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.838+0000 7fc264f53700 1 --2- 172.21.15.2:0/2230684639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2600ffc20 0x7fc260101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.838+0000 7fc264f53700 1 --2- 172.21.15.2:0/2230684639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc260105bd0 0x7fc260101d80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.838+0000 7fc264f53700 1 -- 172.21.15.2:0/2230684639 >> 172.21.15.2:0/2230684639 conn(0x7fc260075670 msgr2=0x7fc2600686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.838+0000 7fc264f53700 1 -- 172.21.15.2:0/2230684639 shutdown_connections 2024-09-13T23:03:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.838+0000 7fc264f53700 1 -- 172.21.15.2:0/2230684639 wait complete. 2024-09-13T23:03:12.912 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:12 smithi047 podman[90681]: 2024-09-13 23:03:12.844317157 +0000 UTC m=+0.541029817 container remove d389796351e7a87bb1eb105c3193500b08f0f6f43e71c528abd55acf82bbf540 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-13T23:03:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.946+0000 7f4e5ef32700 1 -- 172.21.15.2:0/2957308272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e580fff50 msgr2=0x7f4e58105840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.946+0000 7f4e5ef32700 1 --2- 172.21.15.2:0/2957308272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e580fff50 0x7f4e58105840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4e48009910 tx=0x7f4e48009c20 comp rx=0 tx=0).stop 2024-09-13T23:03:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.946+0000 7f4e5ef32700 1 -- 172.21.15.2:0/2957308272 shutdown_connections 2024-09-13T23:03:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.946+0000 7f4e5ef32700 1 --2- 172.21.15.2:0/2957308272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e580fff50 0x7f4e58105840 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.946+0000 7f4e5ef32700 1 --2- 172.21.15.2:0/2957308272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e580ff5a0 0x7f4e580ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.946+0000 7f4e5ef32700 1 -- 172.21.15.2:0/2957308272 >> 172.21.15.2:0/2957308272 conn(0x7f4e58074e30 msgr2=0x7f4e58075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.947+0000 7f4e5ef32700 1 -- 172.21.15.2:0/2957308272 shutdown_connections 2024-09-13T23:03:12.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.947+0000 7f4e5ef32700 1 -- 172.21.15.2:0/2957308272 wait complete. 2024-09-13T23:03:12.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.947+0000 7f4e5ef32700 1 Processor -- start 2024-09-13T23:03:12.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.947+0000 7f4e5ef32700 1 -- start start 2024-09-13T23:03:12.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.947+0000 7f4e5ef32700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e580ff5a0 0x7f4e58100520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:12.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.948+0000 7f4e5ef32700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e580fff50 0x7f4e58100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:12.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.948+0000 7f4e5ef32700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e58100fa0 con 0x7f4e580fff50 2024-09-13T23:03:12.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.948+0000 7f4e5ef32700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e581010e0 con 0x7f4e580ff5a0 2024-09-13T23:03:12.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.948+0000 7f4e57fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e580fff50 0x7f4e58100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.948+0000 7f4e57fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e580fff50 0x7f4e58100a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51152/0 (socket says 172.21.15.2:51152) 2024-09-13T23:03:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.948+0000 7f4e57fff700 1 -- 172.21.15.2:0/2396854715 learned_addr learned my addr 172.21.15.2:0/2396854715 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:03:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.948+0000 7f4e5ccce700 1 --2- 172.21.15.2:0/2396854715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e580ff5a0 0x7f4e58100520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.948+0000 7f4e57fff700 1 -- 172.21.15.2:0/2396854715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e580ff5a0 msgr2=0x7f4e58100520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.948+0000 7f4e57fff700 1 --2- 172.21.15.2:0/2396854715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e580ff5a0 0x7f4e58100520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.948+0000 7f4e57fff700 1 -- 172.21.15.2:0/2396854715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e480095f0 con 0x7f4e580fff50 2024-09-13T23:03:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.948+0000 7f4e57fff700 1 --2- 172.21.15.2:0/2396854715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e580fff50 0x7f4e58100a60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4e480092e0 tx=0x7f4e4800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.948+0000 7f4e55ffb700 1 -- 172.21.15.2:0/2396854715 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e4801d070 con 0x7f4e580fff50 2024-09-13T23:03:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.948+0000 7f4e55ffb700 1 -- 172.21.15.2:0/2396854715 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e48005dc0 con 0x7f4e580fff50 2024-09-13T23:03:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.948+0000 7f4e5ef32700 1 -- 172.21.15.2:0/2396854715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e58101360 con 0x7f4e580fff50 2024-09-13T23:03:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.948+0000 7f4e55ffb700 1 -- 172.21.15.2:0/2396854715 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e48017400 con 0x7f4e580fff50 2024-09-13T23:03:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.949+0000 7f4e5ef32700 1 -- 172.21.15.2:0/2396854715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e581a2d70 con 0x7f4e580fff50 2024-09-13T23:03:12.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.949+0000 7f4e5ef32700 1 -- 172.21.15.2:0/2396854715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e58109200 con 0x7f4e580fff50 2024-09-13T23:03:12.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.950+0000 7f4e55ffb700 1 -- 172.21.15.2:0/2396854715 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f4e4800f6f0 con 0x7f4e580fff50 2024-09-13T23:03:12.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.951+0000 7f4e55ffb700 1 --2- 172.21.15.2:0/2396854715 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4e4406e680 0x7f4e44070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:12.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.951+0000 7f4e55ffb700 1 -- 172.21.15.2:0/2396854715 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4e4808f9a0 con 0x7f4e580fff50 2024-09-13T23:03:12.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.951+0000 7f4e5ccce700 1 --2- 172.21.15.2:0/2396854715 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4e4406e680 0x7f4e44070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:12.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.951+0000 7f4e5ccce700 1 --2- 172.21.15.2:0/2396854715 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4e4406e680 0x7f4e44070b40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4e40005950 tx=0x7f4e4000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:12.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:12.955+0000 7f4e55ffb700 1 -- 172.21.15.2:0/2396854715 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4e48058bf0 con 0x7f4e580fff50 2024-09-13T23:03:13.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.221+0000 7f4e5ef32700 1 -- 172.21.15.2:0/2396854715 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4e5804f2e0 con 0x7f4e580fff50 2024-09-13T23:03:13.223 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:12 smithi002 ceph-mon[111294]: pgmap v112: 65 pgs: 10 active+undersized, 18 peering, 10 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/264 objects degraded (10.606%) 2024-09-13T23:03:13.223 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:12 smithi002 ceph-mon[111294]: Health check failed: Degraded data redundancy: 28/264 objects degraded (10.606%), 10 pgs degraded (PG_DEGRADED) 2024-09-13T23:03:13.223 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:12 smithi002 ceph-mon[111294]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:13.223 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:12 smithi002 ceph-mon[111294]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:13.223 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:12 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/2230684639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:03:13.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.222+0000 7f4e55ffb700 1 -- 172.21.15.2:0/2396854715 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1938 (secure 0 0 0) 0x7f4e4805c2b0 con 0x7f4e580fff50 2024-09-13T23:03:13.224 INFO:teuthology.orchestra.run.smithi002.stdout:e16 2024-09-13T23:03:13.224 INFO:teuthology.orchestra.run.smithi002.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T23:03:13.224 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:03:13.224 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:03:13.224 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-13T23:03:13.224 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:03:13.224 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:03:13.224 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-13T23:03:13.225 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 16 2024-09-13T23:03:13.225 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:03:13.225 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-13T22:53:05.963265+0000 2024-09-13T23:03:13.225 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-13T22:53:25.072026+0000 2024-09-13T23:03:13.225 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-13T23:03:13.225 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-13T23:03:13.225 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-13T23:03:13.225 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-13T23:03:13.225 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-13T23:03:13.225 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-13T23:03:13.225 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-13T23:03:13.225 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-13T23:03:13.225 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 47 2024-09-13T23:03:13.226 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:03:13.226 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 1 2024-09-13T23:03:13.226 INFO:teuthology.orchestra.run.smithi002.stdout:in 0 2024-09-13T23:03:13.226 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24267} 2024-09-13T23:03:13.226 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-13T23:03:13.226 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-13T23:03:13.226 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-13T23:03:13.226 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-13T23:03:13.226 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-13T23:03:13.226 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-13T23:03:13.226 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-13T23:03:13.226 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-13T23:03:13.226 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-13T23:03:13.227 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 0 members: 2024-09-13T23:03:13.227 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.gxzkha{0:24267} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:03:13.227 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.gglyyr{0:14488} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.2:6828/2123560657,v1:172.21.15.2:6829/2123560657] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:03:13.227 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:03:13.227 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:03:13.227 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-13T23:03:13.227 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:03:13.227 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.auedll{-1:14500} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/1577962179,v1:172.21.15.2:6827/1577962179] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:03:13.227 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.nqvveh{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:03:13.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.225+0000 7f4e5ef32700 1 -- 172.21.15.2:0/2396854715 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4e4406e680 msgr2=0x7f4e44070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:13.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.225+0000 7f4e5ef32700 1 --2- 172.21.15.2:0/2396854715 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4e4406e680 0x7f4e44070b40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4e40005950 tx=0x7f4e4000b410 comp rx=0 tx=0).stop 2024-09-13T23:03:13.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.225+0000 7f4e5ef32700 1 -- 172.21.15.2:0/2396854715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e580fff50 msgr2=0x7f4e58100a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:13.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.225+0000 7f4e5ef32700 1 --2- 172.21.15.2:0/2396854715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e580fff50 0x7f4e58100a60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4e480092e0 tx=0x7f4e4800bd70 comp rx=0 tx=0).stop 2024-09-13T23:03:13.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.225+0000 7f4e5ef32700 1 -- 172.21.15.2:0/2396854715 shutdown_connections 2024-09-13T23:03:13.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.225+0000 7f4e5ef32700 1 --2- 172.21.15.2:0/2396854715 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4e4406e680 0x7f4e44070b40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.225+0000 7f4e5ef32700 1 --2- 172.21.15.2:0/2396854715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e580ff5a0 0x7f4e58100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.225+0000 7f4e5ef32700 1 --2- 172.21.15.2:0/2396854715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e580fff50 0x7f4e58100a60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.225+0000 7f4e5ef32700 1 -- 172.21.15.2:0/2396854715 >> 172.21.15.2:0/2396854715 conn(0x7f4e58074e30 msgr2=0x7f4e580fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:13.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.225+0000 7f4e5ef32700 1 -- 172.21.15.2:0/2396854715 shutdown_connections 2024-09-13T23:03:13.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.225+0000 7f4e5ef32700 1 -- 172.21.15.2:0/2396854715 wait complete. 2024-09-13T23:03:13.229 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2024-09-13T23:03:13.233 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:12 smithi047 ceph-mon[81243]: pgmap v112: 65 pgs: 10 active+undersized, 18 peering, 10 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/264 objects degraded (10.606%) 2024-09-13T23:03:13.233 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:12 smithi047 ceph-mon[81243]: Health check failed: Degraded data redundancy: 28/264 objects degraded (10.606%), 10 pgs degraded (PG_DEGRADED) 2024-09-13T23:03:13.233 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:12 smithi047 ceph-mon[81243]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:13.233 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:12 smithi047 ceph-mon[81243]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:13.233 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:12 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/2230684639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:03:13.233 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:13 smithi047 podman[90741]: 2024-09-13 23:03:12.966002119 +0000 UTC m=+0.017314866 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:03:13.233 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:13 smithi047 podman[90741]: 2024-09-13 23:03:13.078428538 +0000 UTC m=+0.129741284 container create de54fd3fea34d3ccf8c793875efe227db06467a83afc8332c6ac04c2a6455850 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:03:13.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.334+0000 7f9c4fb0c700 1 -- 172.21.15.2:0/2329635029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c48100ea0 msgr2=0x7f9c48101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:13.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.334+0000 7f9c4fb0c700 1 --2- 172.21.15.2:0/2329635029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c48100ea0 0x7f9c48101280 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009910 tx=0x7f9c44009c20 comp rx=0 tx=0).stop 2024-09-13T23:03:13.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.334+0000 7f9c4fb0c700 1 -- 172.21.15.2:0/2329635029 shutdown_connections 2024-09-13T23:03:13.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.334+0000 7f9c4fb0c700 1 --2- 172.21.15.2:0/2329635029 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c48101850 0x7f9c481058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.334+0000 7f9c4fb0c700 1 --2- 172.21.15.2:0/2329635029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c48100ea0 0x7f9c48101280 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.334+0000 7f9c4fb0c700 1 -- 172.21.15.2:0/2329635029 >> 172.21.15.2:0/2329635029 conn(0x7f9c480fc750 msgr2=0x7f9c480feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:13.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.334+0000 7f9c4fb0c700 1 -- 172.21.15.2:0/2329635029 shutdown_connections 2024-09-13T23:03:13.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.334+0000 7f9c4fb0c700 1 -- 172.21.15.2:0/2329635029 wait complete. 2024-09-13T23:03:13.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.335+0000 7f9c4fb0c700 1 Processor -- start 2024-09-13T23:03:13.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.335+0000 7f9c4fb0c700 1 -- start start 2024-09-13T23:03:13.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.335+0000 7f9c4fb0c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c48100ea0 0x7f9c48073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:13.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.335+0000 7f9c4fb0c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c48101850 0x7f9c480735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:13.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.335+0000 7f9c4fb0c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c48073b10 con 0x7f9c48101850 2024-09-13T23:03:13.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.335+0000 7f9c4fb0c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c48073c50 con 0x7f9c48100ea0 2024-09-13T23:03:13.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.335+0000 7f9c4d0a7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c48101850 0x7f9c480735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:13.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.335+0000 7f9c4d0a7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c48101850 0x7f9c480735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51174/0 (socket says 172.21.15.2:51174) 2024-09-13T23:03:13.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.335+0000 7f9c4d0a7700 1 -- 172.21.15.2:0/2968563946 learned_addr learned my addr 172.21.15.2:0/2968563946 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:03:13.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.335+0000 7f9c4d8a8700 1 --2- 172.21.15.2:0/2968563946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c48100ea0 0x7f9c48073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:13.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.336+0000 7f9c4d0a7700 1 -- 172.21.15.2:0/2968563946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c48100ea0 msgr2=0x7f9c48073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:13.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.336+0000 7f9c4d0a7700 1 --2- 172.21.15.2:0/2968563946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c48100ea0 0x7f9c48073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.336+0000 7f9c4d0a7700 1 -- 172.21.15.2:0/2968563946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c440095f0 con 0x7f9c48101850 2024-09-13T23:03:13.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.336+0000 7f9c4d0a7700 1 --2- 172.21.15.2:0/2968563946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c48101850 0x7f9c480735d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00c960 tx=0x7f9c3c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:13.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.336+0000 7f9c3affd700 1 -- 172.21.15.2:0/2968563946 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c3c007a70 con 0x7f9c48101850 2024-09-13T23:03:13.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.336+0000 7f9c4fb0c700 1 -- 172.21.15.2:0/2968563946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c481a2af0 con 0x7f9c48101850 2024-09-13T23:03:13.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.336+0000 7f9c3affd700 1 -- 172.21.15.2:0/2968563946 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c3c007bd0 con 0x7f9c48101850 2024-09-13T23:03:13.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.336+0000 7f9c3affd700 1 -- 172.21.15.2:0/2968563946 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c3c018630 con 0x7f9c48101850 2024-09-13T23:03:13.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.336+0000 7f9c4fb0c700 1 -- 172.21.15.2:0/2968563946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c481a2e50 con 0x7f9c48101850 2024-09-13T23:03:13.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.337+0000 7f9c4fb0c700 1 -- 172.21.15.2:0/2968563946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c48109240 con 0x7f9c48101850 2024-09-13T23:03:13.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.338+0000 7f9c3affd700 1 -- 172.21.15.2:0/2968563946 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f9c3c00f450 con 0x7f9c48101850 2024-09-13T23:03:13.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.338+0000 7f9c3affd700 1 --2- 172.21.15.2:0/2968563946 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f9c3406e680 0x7f9c34070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:13.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.338+0000 7f9c3affd700 1 -- 172.21.15.2:0/2968563946 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f9c3c08e530 con 0x7f9c48101850 2024-09-13T23:03:13.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.338+0000 7f9c4d8a8700 1 --2- 172.21.15.2:0/2968563946 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f9c3406e680 0x7f9c34070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:13.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.339+0000 7f9c4d8a8700 1 --2- 172.21.15.2:0/2968563946 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f9c3406e680 0x7f9c34070b40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9c44006010 tx=0x7f9c4401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:13.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.343+0000 7f9c3affd700 1 -- 172.21.15.2:0/2968563946 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9c3c057780 con 0x7f9c48101850 2024-09-13T23:03:13.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.574+0000 7f9c4fb0c700 1 -- 172.21.15.2:0/2968563946 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c480611d0 con 0x7f9c3406e680 2024-09-13T23:03:13.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.576+0000 7f9c3affd700 1 -- 172.21.15.2:0/2968563946 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9c480611d0 con 0x7f9c3406e680 2024-09-13T23:03:13.576 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:03:13.576 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:03:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T23:03:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:03:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-13T23:03:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-13T23:03:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-13T23:03:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2024-09-13T23:03:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-13T23:03:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "9/23 daemons upgraded", 2024-09-13T23:03:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T23:03:13.577 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T23:03:13.577 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:03:13.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.578+0000 7f9c4fb0c700 1 -- 172.21.15.2:0/2968563946 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f9c3406e680 msgr2=0x7f9c34070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:13.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.578+0000 7f9c4fb0c700 1 --2- 172.21.15.2:0/2968563946 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f9c3406e680 0x7f9c34070b40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9c44006010 tx=0x7f9c4401a040 comp rx=0 tx=0).stop 2024-09-13T23:03:13.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.578+0000 7f9c4fb0c700 1 -- 172.21.15.2:0/2968563946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c48101850 msgr2=0x7f9c480735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:13.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.578+0000 7f9c4fb0c700 1 --2- 172.21.15.2:0/2968563946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c48101850 0x7f9c480735d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00c960 tx=0x7f9c3c00cc70 comp rx=0 tx=0).stop 2024-09-13T23:03:13.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.578+0000 7f9c4fb0c700 1 -- 172.21.15.2:0/2968563946 shutdown_connections 2024-09-13T23:03:13.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.578+0000 7f9c4fb0c700 1 --2- 172.21.15.2:0/2968563946 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f9c3406e680 0x7f9c34070b40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.578+0000 7f9c4fb0c700 1 --2- 172.21.15.2:0/2968563946 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c48100ea0 0x7f9c48073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.578+0000 7f9c4fb0c700 1 --2- 172.21.15.2:0/2968563946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c48101850 0x7f9c480735d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.578+0000 7f9c4fb0c700 1 -- 172.21.15.2:0/2968563946 >> 172.21.15.2:0/2968563946 conn(0x7f9c480fc750 msgr2=0x7f9c480fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:13.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.578+0000 7f9c4fb0c700 1 -- 172.21.15.2:0/2968563946 shutdown_connections 2024-09-13T23:03:13.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.578+0000 7f9c4fb0c700 1 -- 172.21.15.2:0/2968563946 wait complete. 2024-09-13T23:03:13.662 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:13 smithi047 podman[90741]: 2024-09-13 23:03:13.347879784 +0000 UTC m=+0.399192528 container init de54fd3fea34d3ccf8c793875efe227db06467a83afc8332c6ac04c2a6455850 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-13T23:03:13.662 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:13 smithi047 podman[90741]: 2024-09-13 23:03:13.35109988 +0000 UTC m=+0.402412624 container start de54fd3fea34d3ccf8c793875efe227db06467a83afc8332c6ac04c2a6455850 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True) 2024-09-13T23:03:13.662 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:13 smithi047 ceph-osd[90759]: -- 172.21.15.47:0/4024143500 <== mon.1 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563f968e61e0 con 0x563f96878000 2024-09-13T23:03:13.663 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:13 smithi047 bash[90741]: de54fd3fea34d3ccf8c793875efe227db06467a83afc8332c6ac04c2a6455850 2024-09-13T23:03:13.663 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:13 smithi047 systemd[1]: Started Ceph osd.3 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T23:03:13.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.686+0000 7f06ca3fa700 1 -- 172.21.15.2:0/877989295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c4101850 msgr2=0x7f06c41058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:13.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.686+0000 7f06ca3fa700 1 --2- 172.21.15.2:0/877989295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c4101850 0x7f06c41058a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009910 tx=0x7f06b8009c20 comp rx=0 tx=0).stop 2024-09-13T23:03:13.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.686+0000 7f06ca3fa700 1 -- 172.21.15.2:0/877989295 shutdown_connections 2024-09-13T23:03:13.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.686+0000 7f06ca3fa700 1 --2- 172.21.15.2:0/877989295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c4101850 0x7f06c41058a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.686+0000 7f06ca3fa700 1 --2- 172.21.15.2:0/877989295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c4100ea0 0x7f06c4101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.686+0000 7f06ca3fa700 1 -- 172.21.15.2:0/877989295 >> 172.21.15.2:0/877989295 conn(0x7f06c40fc750 msgr2=0x7f06c40feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:13.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.686+0000 7f06ca3fa700 1 -- 172.21.15.2:0/877989295 shutdown_connections 2024-09-13T23:03:13.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.686+0000 7f06ca3fa700 1 -- 172.21.15.2:0/877989295 wait complete. 2024-09-13T23:03:13.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.687+0000 7f06ca3fa700 1 Processor -- start 2024-09-13T23:03:13.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.687+0000 7f06ca3fa700 1 -- start start 2024-09-13T23:03:13.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.687+0000 7f06ca3fa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c4100ea0 0x7f06c4073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:13.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.687+0000 7f06ca3fa700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c4101850 0x7f06c40735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:13.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.687+0000 7f06ca3fa700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c4073b10 con 0x7f06c4100ea0 2024-09-13T23:03:13.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.687+0000 7f06ca3fa700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c4073c50 con 0x7f06c4101850 2024-09-13T23:03:13.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.687+0000 7f06c3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c4100ea0 0x7f06c4073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:13.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.687+0000 7f06c3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c4100ea0 0x7f06c4073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51196/0 (socket says 172.21.15.2:51196) 2024-09-13T23:03:13.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.687+0000 7f06c3fff700 1 -- 172.21.15.2:0/808870667 learned_addr learned my addr 172.21.15.2:0/808870667 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:03:13.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.687+0000 7f06c37fe700 1 --2- 172.21.15.2:0/808870667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c4101850 0x7f06c40735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:13.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.687+0000 7f06c3fff700 1 -- 172.21.15.2:0/808870667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c4101850 msgr2=0x7f06c40735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:13.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.687+0000 7f06c3fff700 1 --2- 172.21.15.2:0/808870667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c4101850 0x7f06c40735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:13.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.687+0000 7f06c3fff700 1 -- 172.21.15.2:0/808870667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b80095f0 con 0x7f06c4100ea0 2024-09-13T23:03:13.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.688+0000 7f06c3fff700 1 --2- 172.21.15.2:0/808870667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c4100ea0 0x7f06c4073090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f06b400e920 tx=0x7f06b400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:13.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.688+0000 7f06c17fa700 1 -- 172.21.15.2:0/808870667 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06b400c9d0 con 0x7f06c4100ea0 2024-09-13T23:03:13.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.688+0000 7f06c17fa700 1 -- 172.21.15.2:0/808870667 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f06b4010430 con 0x7f06c4100ea0 2024-09-13T23:03:13.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.688+0000 7f06ca3fa700 1 -- 172.21.15.2:0/808870667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c41a2b00 con 0x7f06c4100ea0 2024-09-13T23:03:13.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.688+0000 7f06c17fa700 1 -- 172.21.15.2:0/808870667 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06b4018630 con 0x7f06c4100ea0 2024-09-13T23:03:13.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.688+0000 7f06ca3fa700 1 -- 172.21.15.2:0/808870667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c41a2eb0 con 0x7f06c4100ea0 2024-09-13T23:03:13.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.689+0000 7f06ca3fa700 1 -- 172.21.15.2:0/808870667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c41092a0 con 0x7f06c4100ea0 2024-09-13T23:03:13.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.689+0000 7f06c17fa700 1 -- 172.21.15.2:0/808870667 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f06b40105a0 con 0x7f06c4100ea0 2024-09-13T23:03:13.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.690+0000 7f06c17fa700 1 --2- 172.21.15.2:0/808870667 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f06ac06e680 0x7f06ac070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.690+0000 7f06c17fa700 1 -- 172.21.15.2:0/808870667 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f06b4014070 con 0x7f06c4100ea0 2024-09-13T23:03:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.690+0000 7f06c37fe700 1 --2- 172.21.15.2:0/808870667 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f06ac06e680 0x7f06ac070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.690+0000 7f06c37fe700 1 --2- 172.21.15.2:0/808870667 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f06ac06e680 0x7f06ac070b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f06b80059d0 tx=0x7f06b8005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:13.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.694+0000 7f06c17fa700 1 -- 172.21.15.2:0/808870667 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f06b40541b0 con 0x7f06c4100ea0 2024-09-13T23:03:13.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.993+0000 7f06ca3fa700 1 -- 172.21.15.2:0/808870667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f06c4108c80 con 0x7f06c4100ea0 2024-09-13T23:03:13.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.993+0000 7f06c17fa700 1 -- 172.21.15.2:0/808870667 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1901 (secure 0 0 0) 0x7f06b4057ad0 con 0x7f06c4100ea0 2024-09-13T23:03:13.995 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Reduced data availability: 10 pgs peering; Degraded data redundancy: 28/264 objects degraded (10.606%), 10 pgs degraded 2024-09-13T23:03:13.995 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T23:03:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T23:03:13.995 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T23:03:13.995 INFO:teuthology.orchestra.run.smithi002.stdout: osd.3 (root=default,host=smithi047) is down 2024-09-13T23:03:13.996 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 10 pgs peering 2024-09-13T23:03:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.7 is stuck peering for 5m, current state peering, last acting [4,2] 2024-09-13T23:03:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.8 is stuck peering for 5m, current state peering, last acting [5,0] 2024-09-13T23:03:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.b is stuck peering for 5m, current state peering, last acting [4,5] 2024-09-13T23:03:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.14 is stuck peering for 94s, current state peering, last acting [4,5] 2024-09-13T23:03:13.996 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1a is stuck peering for 5m, current state peering, last acting [4,5] 2024-09-13T23:03:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1d is stuck peering for 5m, current state peering, last acting [5,0] 2024-09-13T23:03:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: pg 3.a is stuck peering for 5m, current state peering, last acting [4,1] 2024-09-13T23:03:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: pg 3.11 is stuck peering for 5m, current state peering, last acting [4,0] 2024-09-13T23:03:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: pg 3.13 is stuck peering for 5m, current state peering, last acting [5,2] 2024-09-13T23:03:13.997 INFO:teuthology.orchestra.run.smithi002.stdout: pg 3.14 is stuck peering for 5m, current state peering, last acting [4,5] 2024-09-13T23:03:13.997 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 28/264 objects degraded (10.606%), 10 pgs degraded 2024-09-13T23:03:13.998 INFO:teuthology.orchestra.run.smithi002.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-13T23:03:13.998 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-13T23:03:13.998 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-13T23:03:13.998 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-13T23:03:13.998 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-13T23:03:13.998 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-09-13T23:03:13.998 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-13T23:03:13.999 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-13T23:03:13.999 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-13T23:03:13.999 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-13T23:03:14.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.995+0000 7f06ca3fa700 1 -- 172.21.15.2:0/808870667 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f06ac06e680 msgr2=0x7f06ac070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.995+0000 7f06ca3fa700 1 --2- 172.21.15.2:0/808870667 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f06ac06e680 0x7f06ac070b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f06b80059d0 tx=0x7f06b8005940 comp rx=0 tx=0).stop 2024-09-13T23:03:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.995+0000 7f06ca3fa700 1 -- 172.21.15.2:0/808870667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c4100ea0 msgr2=0x7f06c4073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.995+0000 7f06ca3fa700 1 --2- 172.21.15.2:0/808870667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c4100ea0 0x7f06c4073090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f06b400e920 tx=0x7f06b400ec30 comp rx=0 tx=0).stop 2024-09-13T23:03:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.995+0000 7f06ca3fa700 1 -- 172.21.15.2:0/808870667 shutdown_connections 2024-09-13T23:03:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.995+0000 7f06ca3fa700 1 --2- 172.21.15.2:0/808870667 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f06ac06e680 0x7f06ac070b40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.995+0000 7f06ca3fa700 1 --2- 172.21.15.2:0/808870667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c4100ea0 0x7f06c4073090 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.995+0000 7f06ca3fa700 1 --2- 172.21.15.2:0/808870667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c4101850 0x7f06c40735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.995+0000 7f06ca3fa700 1 -- 172.21.15.2:0/808870667 >> 172.21.15.2:0/808870667 conn(0x7f06c40fc750 msgr2=0x7f06c40fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.995+0000 7f06ca3fa700 1 -- 172.21.15.2:0/808870667 shutdown_connections 2024-09-13T23:03:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:13.995+0000 7f06ca3fa700 1 -- 172.21.15.2:0/808870667 wait complete. 2024-09-13T23:03:14.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:13 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/2396854715' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:03:14.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:13 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:14.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:13 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:14.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:13 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:03:14.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:13 smithi002 ceph-mon[111294]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:14.270 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:13 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/2396854715' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:03:14.270 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:13 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:14.270 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:13 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:14.270 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:13 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:03:14.270 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:13 smithi047 ceph-mon[81243]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:15.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:14 smithi047 ceph-mon[81243]: pgmap v113: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-13T23:03:15.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:14 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/808870667' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:03:15.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:14 smithi047 ceph-mon[81243]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-09-13T23:03:15.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:14 smithi002 ceph-mon[111294]: pgmap v113: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-13T23:03:15.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:14 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/808870667' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:03:15.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:14 smithi002 ceph-mon[111294]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-09-13T23:03:15.616 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:15 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3[90755]: 2024-09-13T23:03:15.248+0000 7f2eb6b2f640 -1 Falling back to public interface 2024-09-13T23:03:17.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:17 smithi047 ceph-mon[81243]: pgmap v114: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-13T23:03:17.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:17 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:17.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:17 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:17.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:17 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:17.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:17 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:17.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:17 smithi002 ceph-mon[111294]: pgmap v114: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-13T23:03:17.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:17 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:17.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:17 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:17.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:17 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:17.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:17 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:19.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:19 smithi002 ceph-mon[111294]: pgmap v115: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-13T23:03:19.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:19 smithi047 ceph-mon[81243]: pgmap v115: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-09-13T23:03:20.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:20 smithi047 ceph-mon[81243]: Health check update: Degraded data redundancy: 59/264 objects degraded (22.348%), 18 pgs degraded (PG_DEGRADED) 2024-09-13T23:03:20.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:20 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:20.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:20 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:20.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:20 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:20.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:20 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:03:20.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:20 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:20.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:20 smithi002 ceph-mon[111294]: Health check update: Degraded data redundancy: 59/264 objects degraded (22.348%), 18 pgs degraded (PG_DEGRADED) 2024-09-13T23:03:20.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:20 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:20.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:20 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:20.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:20 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:20.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:20 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:03:20.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:20 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:21.162 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:20 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3[90755]: 2024-09-13T23:03:20.838+0000 7f2eb6b2f640 -1 osd.3 0 read_superblock omap replica is missing. 2024-09-13T23:03:21.662 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:21 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3[90755]: 2024-09-13T23:03:21.193+0000 7f2eb6b2f640 -1 osd.3 65 log_to_monitors true 2024-09-13T23:03:21.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:21 smithi047 ceph-mon[81243]: pgmap v116: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 59/264 objects degraded (22.348%) 2024-09-13T23:03:21.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:21 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:03:21.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:21 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:03:21.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:21 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:03:21.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:21 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:03:21.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:21 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T23:03:21.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:21 smithi047 ceph-mon[81243]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T23:03:21.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:21 smithi047 ceph-mon[81243]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-13T23:03:21.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:21 smithi047 ceph-mon[81243]: from='osd.3 [v2:172.21.15.47:6800/1689776592,v1:172.21.15.47:6801/1689776592]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T23:03:21.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:21 smithi047 ceph-mon[81243]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T23:03:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:21 smithi002 ceph-mon[111294]: pgmap v116: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 59/264 objects degraded (22.348%) 2024-09-13T23:03:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:21 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:03:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:21 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:03:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:21 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:03:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:21 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:03:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:21 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T23:03:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:21 smithi002 ceph-mon[111294]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T23:03:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:21 smithi002 ceph-mon[111294]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-13T23:03:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:21 smithi002 ceph-mon[111294]: from='osd.3 [v2:172.21.15.47:6800/1689776592,v1:172.21.15.47:6801/1689776592]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T23:03:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:21 smithi002 ceph-mon[111294]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T23:03:22.448 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:03:22 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3[90755]: 2024-09-13T23:03:22.177+0000 7f2eaa8c1640 -1 osd.3 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:03:22.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:22 smithi002 ceph-mon[111294]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T23:03:22.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:22 smithi002 ceph-mon[111294]: osdmap e68: 6 total, 5 up, 6 in 2024-09-13T23:03:22.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:22 smithi002 ceph-mon[111294]: from='osd.3 [v2:172.21.15.47:6800/1689776592,v1:172.21.15.47:6801/1689776592]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T23:03:22.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:22 smithi002 ceph-mon[111294]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T23:03:22.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:22 smithi002 ceph-mon[111294]: from='osd.3 ' entity='osd.3' 2024-09-13T23:03:22.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:22 smithi047 ceph-mon[81243]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T23:03:22.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:22 smithi047 ceph-mon[81243]: osdmap e68: 6 total, 5 up, 6 in 2024-09-13T23:03:22.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:22 smithi047 ceph-mon[81243]: from='osd.3 [v2:172.21.15.47:6800/1689776592,v1:172.21.15.47:6801/1689776592]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T23:03:22.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:22 smithi047 ceph-mon[81243]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T23:03:22.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:22 smithi047 ceph-mon[81243]: from='osd.3 ' entity='osd.3' 2024-09-13T23:03:23.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:23 smithi002 ceph-mon[111294]: pgmap v118: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 59/264 objects degraded (22.348%) 2024-09-13T23:03:23.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:23 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:23.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:23 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:03:23.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:23 smithi002 ceph-mon[111294]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:03:23.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:23 smithi002 ceph-mon[111294]: osd.3 [v2:172.21.15.47:6800/1689776592,v1:172.21.15.47:6801/1689776592] boot 2024-09-13T23:03:23.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:23 smithi002 ceph-mon[111294]: osdmap e69: 6 total, 6 up, 6 in 2024-09-13T23:03:23.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:23 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:03:23.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:23 smithi047 ceph-mon[81243]: pgmap v118: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 59/264 objects degraded (22.348%) 2024-09-13T23:03:23.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:23 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:23.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:23 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:03:23.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:23 smithi047 ceph-mon[81243]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:03:23.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:23 smithi047 ceph-mon[81243]: osd.3 [v2:172.21.15.47:6800/1689776592,v1:172.21.15.47:6801/1689776592] boot 2024-09-13T23:03:23.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:23 smithi047 ceph-mon[81243]: osdmap e69: 6 total, 6 up, 6 in 2024-09-13T23:03:23.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:23 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T23:03:25.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:25 smithi002 ceph-mon[111294]: pgmap v120: 65 pgs: 8 peering, 14 active+undersized, 16 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 51/264 objects degraded (19.318%) 2024-09-13T23:03:25.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:25 smithi002 ceph-mon[111294]: osdmap e70: 6 total, 6 up, 6 in 2024-09-13T23:03:25.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:25 smithi002 ceph-mon[111294]: Health check update: Degraded data redundancy: 51/264 objects degraded (19.318%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T23:03:25.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:25 smithi047 ceph-mon[81243]: pgmap v120: 65 pgs: 8 peering, 14 active+undersized, 16 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 51/264 objects degraded (19.318%) 2024-09-13T23:03:25.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:25 smithi047 ceph-mon[81243]: osdmap e70: 6 total, 6 up, 6 in 2024-09-13T23:03:25.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:25 smithi047 ceph-mon[81243]: Health check update: Degraded data redundancy: 51/264 objects degraded (19.318%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T23:03:27.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:27 smithi002 ceph-mon[111294]: pgmap v122: 65 pgs: 8 peering, 7 active+undersized, 9 active+undersized+degraded, 41 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 30/264 objects degraded (11.364%) 2024-09-13T23:03:27.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:27 smithi047 ceph-mon[81243]: pgmap v122: 65 pgs: 8 peering, 7 active+undersized, 9 active+undersized+degraded, 41 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 30/264 objects degraded (11.364%) 2024-09-13T23:03:28.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:28 smithi002 ceph-mon[111294]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/264 objects degraded (11.364%), 9 pgs degraded) 2024-09-13T23:03:28.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:28 smithi047 ceph-mon[81243]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/264 objects degraded (11.364%), 9 pgs degraded) 2024-09-13T23:03:29.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:29 smithi002 ceph-mon[111294]: pgmap v123: 65 pgs: 8 peering, 57 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 959 B/s rd, 1 op/s 2024-09-13T23:03:29.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:29 smithi047 ceph-mon[81243]: pgmap v123: 65 pgs: 8 peering, 57 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 959 B/s rd, 1 op/s 2024-09-13T23:03:31.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:31 smithi002 ceph-mon[111294]: pgmap v124: 65 pgs: 65 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T23:03:31.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:31 smithi047 ceph-mon[81243]: pgmap v124: 65 pgs: 65 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T23:03:33.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:33 smithi002 ceph-mon[111294]: pgmap v125: 65 pgs: 65 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-13T23:03:33.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:33 smithi047 ceph-mon[81243]: pgmap v125: 65 pgs: 65 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-13T23:03:35.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:35 smithi002 ceph-mon[111294]: pgmap v126: 65 pgs: 65 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-13T23:03:35.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:35 smithi047 ceph-mon[81243]: pgmap v126: 65 pgs: 65 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-13T23:03:36.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:36 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T23:03:36.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:36 smithi002 ceph-mon[111294]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T23:03:36.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:36 smithi002 ceph-mon[111294]: Upgrade: osd.4 is safe to restart 2024-09-13T23:03:36.525 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:36 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T23:03:36.526 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:36 smithi047 ceph-mon[81243]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T23:03:36.526 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:36 smithi047 ceph-mon[81243]: Upgrade: osd.4 is safe to restart 2024-09-13T23:03:37.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:37 smithi002 ceph-mon[111294]: pgmap v127: 65 pgs: 65 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 965 B/s rd, 2 op/s 2024-09-13T23:03:37.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:37 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:37.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:37 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T23:03:37.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:37 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:37.567 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:37 smithi047 ceph-mon[81243]: pgmap v127: 65 pgs: 65 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 965 B/s rd, 2 op/s 2024-09-13T23:03:37.678 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:37 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:37.678 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:37 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T23:03:37.678 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:37 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:38.598 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:38 smithi047 ceph-mon[81243]: Upgrade: Updating osd.4 2024-09-13T23:03:38.599 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:38 smithi047 ceph-mon[81243]: Deploying daemon osd.4 on smithi047 2024-09-13T23:03:38.599 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:38.599 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:03:38.599 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:38.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:38 smithi002 ceph-mon[111294]: Upgrade: Updating osd.4 2024-09-13T23:03:38.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:38 smithi002 ceph-mon[111294]: Deploying daemon osd.4 on smithi047 2024-09-13T23:03:38.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:38.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:03:38.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:39.277 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:39 smithi047 ceph-mon[81243]: pgmap v128: 65 pgs: 65 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-13T23:03:39.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:39 smithi002 ceph-mon[111294]: pgmap v128: 65 pgs: 65 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-13T23:03:39.912 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:39 smithi047 systemd[1]: Stopping Ceph osd.4 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:03:40.312 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:40 smithi047 ceph-mon[81243]: osd.4 marked itself down and dead 2024-09-13T23:03:40.312 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:40 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[47271]: 2024-09-13T23:03:40.048+0000 7fb4d2f65700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:03:40.312 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:40 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[47271]: 2024-09-13T23:03:40.048+0000 7fb4d2f65700 -1 osd.4 70 *** Got signal Terminated *** 2024-09-13T23:03:40.313 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:40 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[47271]: 2024-09-13T23:03:40.048+0000 7fb4d2f65700 -1 osd.4 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:03:40.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:40 smithi002 ceph-mon[111294]: osd.4 marked itself down and dead 2024-09-13T23:03:41.125 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:40 smithi047 podman[95663]: 2024-09-13 23:03:40.825437275 +0000 UTC m=+0.870444806 container died f1bdc2c5053536699f7d00b64e215d5755d632abd580f05117261616616e618a (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-13T23:03:41.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:41 smithi047 ceph-mon[81243]: pgmap v129: 65 pgs: 65 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:03:41.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:41 smithi047 ceph-mon[81243]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:03:41.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:41 smithi047 ceph-mon[81243]: osdmap e71: 6 total, 5 up, 6 in 2024-09-13T23:03:41.413 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:41 smithi047 podman[95663]: 2024-09-13 23:03:41.216143568 +0000 UTC m=+1.261151098 container cleanup f1bdc2c5053536699f7d00b64e215d5755d632abd580f05117261616616e618a (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2) 2024-09-13T23:03:41.413 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:41 smithi047 bash[95663]: ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4 2024-09-13T23:03:41.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:41 smithi002 ceph-mon[111294]: pgmap v129: 65 pgs: 65 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:03:41.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:41 smithi002 ceph-mon[111294]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:03:41.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:41 smithi002 ceph-mon[111294]: osdmap e71: 6 total, 5 up, 6 in 2024-09-13T23:03:41.793 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:41 smithi047 podman[95680]: 2024-09-13 23:03:41.459072521 +0000 UTC m=+0.631363308 container remove f1bdc2c5053536699f7d00b64e215d5755d632abd580f05117261616616e618a (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-13T23:03:42.071 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:41 smithi047 podman[95762]: 2024-09-13 23:03:41.793156275 +0000 UTC m=+0.113271934 container create 974af8d384ab311496b8f3212c401ac30fe59977af6063986bacf4076f53d59a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:03:42.071 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:41 smithi047 podman[95762]: 2024-09-13 23:03:41.696505027 +0000 UTC m=+0.016620703 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:03:42.071 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:41 smithi047 podman[95762]: 2024-09-13 23:03:41.987379033 +0000 UTC m=+0.307494695 container init 974af8d384ab311496b8f3212c401ac30fe59977af6063986bacf4076f53d59a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T23:03:42.071 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:41 smithi047 podman[95762]: 2024-09-13 23:03:41.990814075 +0000 UTC m=+0.310929734 container start 974af8d384ab311496b8f3212c401ac30fe59977af6063986bacf4076f53d59a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS) 2024-09-13T23:03:42.072 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:42 smithi047 podman[95762]: 2024-09-13 23:03:42.070694419 +0000 UTC m=+0.390810086 container attach 974af8d384ab311496b8f3212c401ac30fe59977af6063986bacf4076f53d59a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-13T23:03:42.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:42 smithi047 ceph-mon[81243]: osdmap e72: 6 total, 5 up, 6 in 2024-09-13T23:03:42.413 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:42 smithi047 podman[95762]: 2024-09-13 23:03:42.18423524 +0000 UTC m=+0.504350916 container died 974af8d384ab311496b8f3212c401ac30fe59977af6063986bacf4076f53d59a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-09-13T23:03:42.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:42 smithi002 ceph-mon[111294]: osdmap e72: 6 total, 5 up, 6 in 2024-09-13T23:03:43.009 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:42 smithi047 podman[95785]: 2024-09-13 23:03:42.757670986 +0000 UTC m=+0.564013335 container remove 974af8d384ab311496b8f3212c401ac30fe59977af6063986bacf4076f53d59a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:03:43.010 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:42 smithi047 systemd[1]: ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-13T23:03:43.010 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:42 smithi047 systemd[1]: Stopped Ceph osd.4 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T23:03:43.010 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:42 smithi047 systemd[1]: ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.4.service: Consumed 56.944s CPU time. 2024-09-13T23:03:43.274 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:43 smithi047 systemd[1]: Starting Ceph osd.4 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:03:43.274 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:43 smithi047 podman[95880]: 2024-09-13 23:03:43.124754117 +0000 UTC m=+0.016506241 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:03:43.274 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:43 smithi047 podman[95880]: 2024-09-13 23:03:43.259026196 +0000 UTC m=+0.150778318 container create 5e1d5b56528895403fa338d11a23e17c121540ff84dabdaa8cac186b35b80a99 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T23:03:43.545 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:43 smithi047 ceph-mon[81243]: pgmap v132: 65 pgs: 6 active+undersized, 10 peering, 3 stale+active+clean, 5 active+undersized+degraded, 41 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 23/264 objects degraded (8.712%) 2024-09-13T23:03:43.545 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:43 smithi047 ceph-mon[81243]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-13T23:03:43.545 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:43 smithi047 ceph-mon[81243]: Health check failed: Degraded data redundancy: 23/264 objects degraded (8.712%), 5 pgs degraded (PG_DEGRADED) 2024-09-13T23:03:43.545 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:43 smithi047 podman[95880]: 2024-09-13 23:03:43.469808904 +0000 UTC m=+0.361561028 container init 5e1d5b56528895403fa338d11a23e17c121540ff84dabdaa8cac186b35b80a99 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-13T23:03:43.545 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:43 smithi047 podman[95880]: 2024-09-13 23:03:43.473212863 +0000 UTC m=+0.364964985 container start 5e1d5b56528895403fa338d11a23e17c121540ff84dabdaa8cac186b35b80a99 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-activate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:03:43.545 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:43 smithi047 podman[95880]: 2024-09-13 23:03:43.544680351 +0000 UTC m=+0.436432481 container attach 5e1d5b56528895403fa338d11a23e17c121540ff84dabdaa8cac186b35b80a99 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-13T23:03:43.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:43 smithi002 ceph-mon[111294]: pgmap v132: 65 pgs: 6 active+undersized, 10 peering, 3 stale+active+clean, 5 active+undersized+degraded, 41 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 23/264 objects degraded (8.712%) 2024-09-13T23:03:43.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:43 smithi002 ceph-mon[111294]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-13T23:03:43.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:43 smithi002 ceph-mon[111294]: Health check failed: Degraded data redundancy: 23/264 objects degraded (8.712%), 5 pgs degraded (PG_DEGRADED) 2024-09-13T23:03:43.912 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:43 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-activate[95895]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:03:43.913 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:43 smithi047 bash[95880]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:03:43.913 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:43 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-activate[95895]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:03:43.913 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:43 smithi047 bash[95880]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:03:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.118+0000 7f9c6e26d700 1 -- 172.21.15.2:0/3438489539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c68106cd0 msgr2=0x7f9c681070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.118+0000 7f9c6e26d700 1 --2- 172.21.15.2:0/3438489539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c68106cd0 0x7f9c681070b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c58009910 tx=0x7f9c58009c20 comp rx=0 tx=0).stop 2024-09-13T23:03:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.118+0000 7f9c6e26d700 1 -- 172.21.15.2:0/3438489539 shutdown_connections 2024-09-13T23:03:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.118+0000 7f9c6e26d700 1 --2- 172.21.15.2:0/3438489539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c68068580 0x7f9c680689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.118+0000 7f9c6e26d700 1 --2- 172.21.15.2:0/3438489539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c68106cd0 0x7f9c681070b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.118+0000 7f9c6e26d700 1 -- 172.21.15.2:0/3438489539 >> 172.21.15.2:0/3438489539 conn(0x7f9c68075670 msgr2=0x7f9c68075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.118+0000 7f9c6e26d700 1 -- 172.21.15.2:0/3438489539 shutdown_connections 2024-09-13T23:03:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.118+0000 7f9c6e26d700 1 -- 172.21.15.2:0/3438489539 wait complete. 2024-09-13T23:03:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.119+0000 7f9c6e26d700 1 Processor -- start 2024-09-13T23:03:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.119+0000 7f9c6e26d700 1 -- start start 2024-09-13T23:03:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.120+0000 7f9c6e26d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c68068580 0x7f9c6819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.120+0000 7f9c6e26d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c68106cd0 0x7f9c6819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.120+0000 7f9c6e26d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6819d1a0 con 0x7f9c68106cd0 2024-09-13T23:03:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.120+0000 7f9c6e26d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c681966e0 con 0x7f9c68068580 2024-09-13T23:03:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.120+0000 7f9c677fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c68106cd0 0x7f9c6819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.120+0000 7f9c677fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c68106cd0 0x7f9c6819cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56042/0 (socket says 172.21.15.2:56042) 2024-09-13T23:03:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.120+0000 7f9c677fe700 1 -- 172.21.15.2:0/3535330255 learned_addr learned my addr 172.21.15.2:0/3535330255 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:03:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.120+0000 7f9c67fff700 1 --2- 172.21.15.2:0/3535330255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c68068580 0x7f9c6819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.120+0000 7f9c677fe700 1 -- 172.21.15.2:0/3535330255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c68068580 msgr2=0x7f9c6819c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.120+0000 7f9c677fe700 1 --2- 172.21.15.2:0/3535330255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c68068580 0x7f9c6819c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.120+0000 7f9c677fe700 1 -- 172.21.15.2:0/3535330255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c580095f0 con 0x7f9c68106cd0 2024-09-13T23:03:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.120+0000 7f9c677fe700 1 --2- 172.21.15.2:0/3535330255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c68106cd0 0x7f9c6819cba0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c930 tx=0x7f9c5c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.121+0000 7f9c657fa700 1 -- 172.21.15.2:0/3535330255 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c5c007ad0 con 0x7f9c68106cd0 2024-09-13T23:03:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.121+0000 7f9c6e26d700 1 -- 172.21.15.2:0/3535330255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c681969c0 con 0x7f9c68106cd0 2024-09-13T23:03:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.121+0000 7f9c657fa700 1 -- 172.21.15.2:0/3535330255 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c5c00ce80 con 0x7f9c68106cd0 2024-09-13T23:03:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.121+0000 7f9c657fa700 1 -- 172.21.15.2:0/3535330255 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c5c018630 con 0x7f9c68106cd0 2024-09-13T23:03:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.121+0000 7f9c6e26d700 1 -- 172.21.15.2:0/3535330255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c68196f10 con 0x7f9c68106cd0 2024-09-13T23:03:44.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.122+0000 7f9c6e26d700 1 -- 172.21.15.2:0/3535330255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c681091d0 con 0x7f9c68106cd0 2024-09-13T23:03:44.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.122+0000 7f9c657fa700 1 -- 172.21.15.2:0/3535330255 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f9c5c007c30 con 0x7f9c68106cd0 2024-09-13T23:03:44.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.123+0000 7f9c657fa700 1 --2- 172.21.15.2:0/3535330255 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f9c5006e680 0x7f9c50070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:44.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.123+0000 7f9c657fa700 1 -- 172.21.15.2:0/3535330255 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f9c5c08e610 con 0x7f9c68106cd0 2024-09-13T23:03:44.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.123+0000 7f9c67fff700 1 --2- 172.21.15.2:0/3535330255 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f9c5006e680 0x7f9c50070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:44.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.123+0000 7f9c67fff700 1 --2- 172.21.15.2:0/3535330255 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f9c5006e680 0x7f9c50070b40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9c58006010 tx=0x7f9c5801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:44.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.127+0000 7f9c657fa700 1 -- 172.21.15.2:0/3535330255 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9c5c05b390 con 0x7f9c68106cd0 2024-09-13T23:03:44.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.360+0000 7f9c6e26d700 1 -- 172.21.15.2:0/3535330255 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c68197d00 con 0x7f9c5006e680 2024-09-13T23:03:44.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.361+0000 7f9c657fa700 1 -- 172.21.15.2:0/3535330255 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f9c68197d00 con 0x7f9c5006e680 2024-09-13T23:03:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.363+0000 7f9c6e26d700 1 -- 172.21.15.2:0/3535330255 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f9c5006e680 msgr2=0x7f9c50070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.363+0000 7f9c6e26d700 1 --2- 172.21.15.2:0/3535330255 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f9c5006e680 0x7f9c50070b40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9c58006010 tx=0x7f9c5801a040 comp rx=0 tx=0).stop 2024-09-13T23:03:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.363+0000 7f9c6e26d700 1 -- 172.21.15.2:0/3535330255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c68106cd0 msgr2=0x7f9c6819cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.363+0000 7f9c6e26d700 1 --2- 172.21.15.2:0/3535330255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c68106cd0 0x7f9c6819cba0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c930 tx=0x7f9c5c00cc40 comp rx=0 tx=0).stop 2024-09-13T23:03:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.363+0000 7f9c6e26d700 1 -- 172.21.15.2:0/3535330255 shutdown_connections 2024-09-13T23:03:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.363+0000 7f9c6e26d700 1 --2- 172.21.15.2:0/3535330255 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f9c5006e680 0x7f9c50070b40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.363+0000 7f9c6e26d700 1 --2- 172.21.15.2:0/3535330255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c68068580 0x7f9c6819c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:44.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.363+0000 7f9c6e26d700 1 --2- 172.21.15.2:0/3535330255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c68106cd0 0x7f9c6819cba0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.363+0000 7f9c6e26d700 1 -- 172.21.15.2:0/3535330255 >> 172.21.15.2:0/3535330255 conn(0x7f9c68075670 msgr2=0x7f9c680fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.363+0000 7f9c6e26d700 1 -- 172.21.15.2:0/3535330255 shutdown_connections 2024-09-13T23:03:44.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.363+0000 7f9c6e26d700 1 -- 172.21.15.2:0/3535330255 wait complete. 2024-09-13T23:03:44.375 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T23:03:44.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.473+0000 7f119fbb0700 1 -- 172.21.15.2:0/3537841173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11981027a0 msgr2=0x7f119810ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:44.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.473+0000 7f119fbb0700 1 --2- 172.21.15.2:0/3537841173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11981027a0 0x7f119810ac90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f118c009910 tx=0x7f118c009c20 comp rx=0 tx=0).stop 2024-09-13T23:03:44.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.473+0000 7f119fbb0700 1 -- 172.21.15.2:0/3537841173 shutdown_connections 2024-09-13T23:03:44.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.473+0000 7f119fbb0700 1 --2- 172.21.15.2:0/3537841173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11981027a0 0x7f119810ac90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:44.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.473+0000 7f119fbb0700 1 --2- 172.21.15.2:0/3537841173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1198101e80 0x7f1198102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:44.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.473+0000 7f119fbb0700 1 -- 172.21.15.2:0/3537841173 >> 172.21.15.2:0/3537841173 conn(0x7f11980fb650 msgr2=0x7f11980fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:44.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.473+0000 7f119fbb0700 1 -- 172.21.15.2:0/3537841173 shutdown_connections 2024-09-13T23:03:44.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.473+0000 7f119fbb0700 1 -- 172.21.15.2:0/3537841173 wait complete. 2024-09-13T23:03:44.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.474+0000 7f119fbb0700 1 Processor -- start 2024-09-13T23:03:44.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.474+0000 7f119fbb0700 1 -- start start 2024-09-13T23:03:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.474+0000 7f119fbb0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1198101e80 0x7f11980ffae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.474+0000 7f119fbb0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11981027a0 0x7f1198100020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.474+0000 7f119fbb0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1198100560 con 0x7f1198101e80 2024-09-13T23:03:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.474+0000 7f119fbb0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11981006a0 con 0x7f11981027a0 2024-09-13T23:03:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.474+0000 7f119d94c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1198101e80 0x7f11980ffae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.474+0000 7f119d94c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1198101e80 0x7f11980ffae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56072/0 (socket says 172.21.15.2:56072) 2024-09-13T23:03:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.474+0000 7f119d94c700 1 -- 172.21.15.2:0/2384312513 learned_addr learned my addr 172.21.15.2:0/2384312513 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:03:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.474+0000 7f119d14b700 1 --2- 172.21.15.2:0/2384312513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11981027a0 0x7f1198100020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.474+0000 7f119d94c700 1 -- 172.21.15.2:0/2384312513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11981027a0 msgr2=0x7f1198100020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.474+0000 7f119d94c700 1 --2- 172.21.15.2:0/2384312513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11981027a0 0x7f1198100020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.474+0000 7f119d94c700 1 -- 172.21.15.2:0/2384312513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c0095f0 con 0x7f1198101e80 2024-09-13T23:03:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.475+0000 7f119d94c700 1 --2- 172.21.15.2:0/2384312513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1198101e80 0x7f11980ffae0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f119400c8a0 tx=0x7f119400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:44.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.475+0000 7f118affd700 1 -- 172.21.15.2:0/2384312513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f119400cea0 con 0x7f1198101e80 2024-09-13T23:03:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.475+0000 7f118affd700 1 -- 172.21.15.2:0/2384312513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1194004830 con 0x7f1198101e80 2024-09-13T23:03:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.475+0000 7f118affd700 1 -- 172.21.15.2:0/2384312513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11940055b0 con 0x7f1198101e80 2024-09-13T23:03:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.475+0000 7f119fbb0700 1 -- 172.21.15.2:0/2384312513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11981a2a50 con 0x7f1198101e80 2024-09-13T23:03:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.475+0000 7f119fbb0700 1 -- 172.21.15.2:0/2384312513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11981a2e60 con 0x7f1198101e80 2024-09-13T23:03:44.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.476+0000 7f119fbb0700 1 -- 172.21.15.2:0/2384312513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1198108320 con 0x7f1198101e80 2024-09-13T23:03:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.477+0000 7f118affd700 1 -- 172.21.15.2:0/2384312513 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f11940049a0 con 0x7f1198101e80 2024-09-13T23:03:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.477+0000 7f118affd700 1 --2- 172.21.15.2:0/2384312513 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f118406e680 0x7f1184070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.477+0000 7f118affd700 1 -- 172.21.15.2:0/2384312513 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f119408e1b0 con 0x7f1198101e80 2024-09-13T23:03:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.477+0000 7f119d14b700 1 --2- 172.21.15.2:0/2384312513 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f118406e680 0x7f1184070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:44.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.478+0000 7f119d14b700 1 --2- 172.21.15.2:0/2384312513 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f118406e680 0x7f1184070b40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f118c0059d0 tx=0x7f118c005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:44.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.482+0000 7f118affd700 1 -- 172.21.15.2:0/2384312513 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1194057480 con 0x7f1198101e80 2024-09-13T23:03:44.644 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:44 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-activate[95895]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T23:03:44.644 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:44 smithi047 bash[95880]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T23:03:44.645 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:44 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-activate[95895]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T23:03:44.645 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:44 smithi047 bash[95880]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T23:03:44.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.710+0000 7f119fbb0700 1 -- 172.21.15.2:0/2384312513 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f11980611d0 con 0x7f118406e680 2024-09-13T23:03:44.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.711+0000 7f118affd700 1 -- 172.21.15.2:0/2384312513 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f11980611d0 con 0x7f118406e680 2024-09-13T23:03:44.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.713+0000 7f119fbb0700 1 -- 172.21.15.2:0/2384312513 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f118406e680 msgr2=0x7f1184070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:44.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.713+0000 7f119fbb0700 1 --2- 172.21.15.2:0/2384312513 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f118406e680 0x7f1184070b40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f118c0059d0 tx=0x7f118c005960 comp rx=0 tx=0).stop 2024-09-13T23:03:44.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.713+0000 7f119fbb0700 1 -- 172.21.15.2:0/2384312513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1198101e80 msgr2=0x7f11980ffae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:44.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.713+0000 7f119fbb0700 1 --2- 172.21.15.2:0/2384312513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1198101e80 0x7f11980ffae0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f119400c8a0 tx=0x7f119400cc60 comp rx=0 tx=0).stop 2024-09-13T23:03:44.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.713+0000 7f119fbb0700 1 -- 172.21.15.2:0/2384312513 shutdown_connections 2024-09-13T23:03:44.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.713+0000 7f119fbb0700 1 --2- 172.21.15.2:0/2384312513 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f118406e680 0x7f1184070b40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:44.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.713+0000 7f119fbb0700 1 --2- 172.21.15.2:0/2384312513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1198101e80 0x7f11980ffae0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:44.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.713+0000 7f119fbb0700 1 --2- 172.21.15.2:0/2384312513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11981027a0 0x7f1198100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:44.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.713+0000 7f119fbb0700 1 -- 172.21.15.2:0/2384312513 >> 172.21.15.2:0/2384312513 conn(0x7f11980fb650 msgr2=0x7f1198105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:44.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.713+0000 7f119fbb0700 1 -- 172.21.15.2:0/2384312513 shutdown_connections 2024-09-13T23:03:44.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.714+0000 7f119fbb0700 1 -- 172.21.15.2:0/2384312513 wait complete. 2024-09-13T23:03:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.821+0000 7fa1ccc7f700 1 -- 172.21.15.2:0/1067719111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c8101850 msgr2=0x7fa1c81058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.821+0000 7fa1ccc7f700 1 --2- 172.21.15.2:0/1067719111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c8101850 0x7fa1c81058a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc009910 tx=0x7fa1bc009c20 comp rx=0 tx=0).stop 2024-09-13T23:03:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.822+0000 7fa1ccc7f700 1 -- 172.21.15.2:0/1067719111 shutdown_connections 2024-09-13T23:03:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.822+0000 7fa1ccc7f700 1 --2- 172.21.15.2:0/1067719111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c8101850 0x7fa1c81058a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.822+0000 7fa1ccc7f700 1 --2- 172.21.15.2:0/1067719111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1c8100ea0 0x7fa1c8101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.822+0000 7fa1ccc7f700 1 -- 172.21.15.2:0/1067719111 >> 172.21.15.2:0/1067719111 conn(0x7fa1c80fc750 msgr2=0x7fa1c80feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.822+0000 7fa1ccc7f700 1 -- 172.21.15.2:0/1067719111 shutdown_connections 2024-09-13T23:03:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.822+0000 7fa1ccc7f700 1 -- 172.21.15.2:0/1067719111 wait complete. 2024-09-13T23:03:44.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.822+0000 7fa1ccc7f700 1 Processor -- start 2024-09-13T23:03:44.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.822+0000 7fa1ccc7f700 1 -- start start 2024-09-13T23:03:44.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.823+0000 7fa1ccc7f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c8100ea0 0x7fa1c819c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:44.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.823+0000 7fa1ccc7f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1c8101850 0x7fa1c819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:44.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.823+0000 7fa1ccc7f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c819d360 con 0x7fa1c8100ea0 2024-09-13T23:03:44.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.823+0000 7fa1ccc7f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c8196810 con 0x7fa1c8101850 2024-09-13T23:03:44.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.823+0000 7fa1c659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c8100ea0 0x7fa1c819c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:44.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.823+0000 7fa1c659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c8100ea0 0x7fa1c819c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56090/0 (socket says 172.21.15.2:56090) 2024-09-13T23:03:44.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.823+0000 7fa1c659c700 1 -- 172.21.15.2:0/2320359415 learned_addr learned my addr 172.21.15.2:0/2320359415 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:03:44.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.823+0000 7fa1c5d9b700 1 --2- 172.21.15.2:0/2320359415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1c8101850 0x7fa1c819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:44.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.823+0000 7fa1c659c700 1 -- 172.21.15.2:0/2320359415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1c8101850 msgr2=0x7fa1c819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:44.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.823+0000 7fa1c659c700 1 --2- 172.21.15.2:0/2320359415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1c8101850 0x7fa1c819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:44.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.823+0000 7fa1c659c700 1 -- 172.21.15.2:0/2320359415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1bc0095f0 con 0x7fa1c8100ea0 2024-09-13T23:03:44.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.823+0000 7fa1c5d9b700 1 --2- 172.21.15.2:0/2320359415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1c8101850 0x7fa1c819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:03:44.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.823+0000 7fa1c659c700 1 --2- 172.21.15.2:0/2320359415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c8100ea0 0x7fa1c819c790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800b4b0 tx=0x7fa1b800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:44.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.824+0000 7fa1b77fe700 1 -- 172.21.15.2:0/2320359415 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1b8011800 con 0x7fa1c8100ea0 2024-09-13T23:03:44.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.824+0000 7fa1b77fe700 1 -- 172.21.15.2:0/2320359415 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa1b8011e20 con 0x7fa1c8100ea0 2024-09-13T23:03:44.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.824+0000 7fa1ccc7f700 1 -- 172.21.15.2:0/2320359415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c8196af0 con 0x7fa1c8100ea0 2024-09-13T23:03:44.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.824+0000 7fa1b77fe700 1 -- 172.21.15.2:0/2320359415 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1b800f2e0 con 0x7fa1c8100ea0 2024-09-13T23:03:44.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.824+0000 7fa1ccc7f700 1 -- 172.21.15.2:0/2320359415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c8197040 con 0x7fa1c8100ea0 2024-09-13T23:03:44.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.825+0000 7fa1ccc7f700 1 -- 172.21.15.2:0/2320359415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c81091d0 con 0x7fa1c8100ea0 2024-09-13T23:03:44.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.825+0000 7fa1b77fe700 1 -- 172.21.15.2:0/2320359415 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fa1b8011960 con 0x7fa1c8100ea0 2024-09-13T23:03:44.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.826+0000 7fa1b77fe700 1 --2- 172.21.15.2:0/2320359415 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa1b006e680 0x7fa1b0070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:44.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.826+0000 7fa1b77fe700 1 -- 172.21.15.2:0/2320359415 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa1b808e1b0 con 0x7fa1c8100ea0 2024-09-13T23:03:44.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.826+0000 7fa1c5d9b700 1 --2- 172.21.15.2:0/2320359415 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa1b006e680 0x7fa1b0070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:44.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.826+0000 7fa1c5d9b700 1 --2- 172.21.15.2:0/2320359415 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa1b006e680 0x7fa1b0070b40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc006010 tx=0x7fa1bc005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:44.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:44.830+0000 7fa1b77fe700 1 -- 172.21.15.2:0/2320359415 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa1b805af30 con 0x7fa1c8100ea0 2024-09-13T23:03:44.913 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:44 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-activate[95895]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T23:03:44.913 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:44 smithi047 bash[95880]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T23:03:44.913 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:44 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-activate[95895]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T23:03:44.913 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:44 smithi047 bash[95880]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T23:03:44.913 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:44 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-activate[95895]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T23:03:44.913 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:44 smithi047 bash[95880]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T23:03:44.913 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:44 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-activate[95895]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T23:03:44.913 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:44 smithi047 bash[95880]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T23:03:44.913 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:44 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-activate[95895]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T23:03:44.913 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:44 smithi047 bash[95880]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T23:03:44.913 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:44 smithi047 podman[95880]: 2024-09-13 23:03:44.678411988 +0000 UTC m=+1.570164117 container died 5e1d5b56528895403fa338d11a23e17c121540ff84dabdaa8cac186b35b80a99 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-activate, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-13T23:03:45.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.050+0000 7fa1ccc7f700 1 -- 172.21.15.2:0/2320359415 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1c81972c0 con 0x7fa1b006e680 2024-09-13T23:03:45.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.060+0000 7fa1b77fe700 1 -- 172.21.15.2:0/2320359415 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fa1c81972c0 con 0x7fa1b006e680 2024-09-13T23:03:45.061 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:03:45.061 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (5m) 61s ago 15m 27.0M - 0.25.0 c8568f914cd2 f570a73274bc 2024-09-13T23:03:45.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (16m) 61s ago 16m 8548k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T23:03:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (15m) 28s ago 15m 8220k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T23:03:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (2m) 61s ago 16m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 427cd38a7d88 2024-09-13T23:03:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (2m) 28s ago 15m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 ce5a1df96005 2024-09-13T23:03:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (4m) 61s ago 15m 80.3M - 9.4.12 2bacad6d85d8 650673516b69 2024-09-13T23:03:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (10m) 61s ago 10m 17.3M - 18.2.1 5be31c24972a 59e9c88c31ca 2024-09-13T23:03:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (10m) 61s ago 10m 91.1M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T23:03:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (10m) 28s ago 10m 150M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T23:03:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (10m) 28s ago 10m 19.8M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T23:03:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 running (7m) 61s ago 17m 499M - 19.1.1-324-gecab7be5 0652ff2b5d78 7a8aa9de37e4 2024-09-13T23:03:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (6m) 28s ago 15m 441M - 19.1.1-324-gecab7be5 0652ff2b5d78 13fa6f3b5a8a 2024-09-13T23:03:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (3m) 61s ago 17m 49.2M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 db0ef6c509cf 2024-09-13T23:03:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (3m) 28s ago 15m 40.4M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 ea0c2a2e0e1a 2024-09-13T23:03:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (6m) 61s ago 16m 15.0M - 1.5.0 0da6a335fe13 f3eae5f90ab8 2024-09-13T23:03:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (5m) 28s ago 15m 15.6M - 1.5.0 0da6a335fe13 a5c7d7f1eaa5 2024-09-13T23:03:45.063 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (2m) 61s ago 14m 84.5M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 0ca6dd66fa68 2024-09-13T23:03:45.063 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (102s) 61s ago 13m 86.5M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 6f5ae2cfa818 2024-09-13T23:03:45.063 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (67s) 61s ago 13m 11.9M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 15b9e8db7556 2024-09-13T23:03:45.063 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (32s) 28s ago 12m 11.5M 2241M 19.1.1-324-gecab7be5 0652ff2b5d78 de54fd3fea34 2024-09-13T23:03:45.063 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (12m) 28s ago 12m 225M 2241M 18.2.1 5be31c24972a f1bdc2c50535 2024-09-13T23:03:45.063 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (12m) 28s ago 12m 198M 2241M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T23:03:45.063 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (5m) 61s ago 15m 71.7M - 2.43.0 a07b618ecd1d aa241d1048de 2024-09-13T23:03:45.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.062+0000 7fa1ccc7f700 1 -- 172.21.15.2:0/2320359415 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa1b006e680 msgr2=0x7fa1b0070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:45.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.062+0000 7fa1ccc7f700 1 --2- 172.21.15.2:0/2320359415 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa1b006e680 0x7fa1b0070b40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc006010 tx=0x7fa1bc005960 comp rx=0 tx=0).stop 2024-09-13T23:03:45.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.062+0000 7fa1ccc7f700 1 -- 172.21.15.2:0/2320359415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c8100ea0 msgr2=0x7fa1c819c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:45.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.062+0000 7fa1ccc7f700 1 --2- 172.21.15.2:0/2320359415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c8100ea0 0x7fa1c819c790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800b4b0 tx=0x7fa1b800b870 comp rx=0 tx=0).stop 2024-09-13T23:03:45.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.062+0000 7fa1ccc7f700 1 -- 172.21.15.2:0/2320359415 shutdown_connections 2024-09-13T23:03:45.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.062+0000 7fa1ccc7f700 1 --2- 172.21.15.2:0/2320359415 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa1b006e680 0x7fa1b0070b40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.062+0000 7fa1ccc7f700 1 --2- 172.21.15.2:0/2320359415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1c8100ea0 0x7fa1c819c790 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.062+0000 7fa1ccc7f700 1 --2- 172.21.15.2:0/2320359415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa1c8101850 0x7fa1c819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.062+0000 7fa1ccc7f700 1 -- 172.21.15.2:0/2320359415 >> 172.21.15.2:0/2320359415 conn(0x7fa1c80fc750 msgr2=0x7fa1c80fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:45.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.062+0000 7fa1ccc7f700 1 -- 172.21.15.2:0/2320359415 shutdown_connections 2024-09-13T23:03:45.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.063+0000 7fa1ccc7f700 1 -- 172.21.15.2:0/2320359415 wait complete. 2024-09-13T23:03:45.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.170+0000 7f20c2e7f700 1 -- 172.21.15.2:0/2688192153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc0ffc20 msgr2=0x7f20bc100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:45.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.170+0000 7f20c2e7f700 1 --2- 172.21.15.2:0/2688192153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc0ffc20 0x7f20bc100080 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009910 tx=0x7f20a8009c20 comp rx=0 tx=0).stop 2024-09-13T23:03:45.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.170+0000 7f20c2e7f700 1 -- 172.21.15.2:0/2688192153 shutdown_connections 2024-09-13T23:03:45.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.170+0000 7f20c2e7f700 1 --2- 172.21.15.2:0/2688192153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc0ffc20 0x7f20bc100080 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.170+0000 7f20c2e7f700 1 --2- 172.21.15.2:0/2688192153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20bc105bd0 0x7f20bc105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.170+0000 7f20c2e7f700 1 -- 172.21.15.2:0/2688192153 >> 172.21.15.2:0/2688192153 conn(0x7f20bc075670 msgr2=0x7f20bc075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:45.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.170+0000 7f20c2e7f700 1 -- 172.21.15.2:0/2688192153 shutdown_connections 2024-09-13T23:03:45.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.170+0000 7f20c2e7f700 1 -- 172.21.15.2:0/2688192153 wait complete. 2024-09-13T23:03:45.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.170+0000 7f20c2e7f700 1 Processor -- start 2024-09-13T23:03:45.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.170+0000 7f20c2e7f700 1 -- start start 2024-09-13T23:03:45.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.171+0000 7f20c2e7f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc0ffc20 0x7f20bc101840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:45.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.171+0000 7f20c2e7f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20bc105bd0 0x7f20bc101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:45.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.171+0000 7f20c2e7f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc1022c0 con 0x7f20bc0ffc20 2024-09-13T23:03:45.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.171+0000 7f20c2e7f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc102400 con 0x7f20bc105bd0 2024-09-13T23:03:45.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.171+0000 7f20c0c1b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc0ffc20 0x7f20bc101840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:45.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.171+0000 7f20c0c1b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc0ffc20 0x7f20bc101840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56108/0 (socket says 172.21.15.2:56108) 2024-09-13T23:03:45.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.171+0000 7f20c0c1b700 1 -- 172.21.15.2:0/716554822 learned_addr learned my addr 172.21.15.2:0/716554822 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:03:45.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.171+0000 7f20c0c1b700 1 -- 172.21.15.2:0/716554822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20bc105bd0 msgr2=0x7f20bc101d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:45.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.171+0000 7f20c0c1b700 1 --2- 172.21.15.2:0/716554822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20bc105bd0 0x7f20bc101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.171+0000 7f20c0c1b700 1 -- 172.21.15.2:0/716554822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a80095f0 con 0x7f20bc0ffc20 2024-09-13T23:03:45.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.171+0000 7f20c0c1b700 1 --2- 172.21.15.2:0/716554822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc0ffc20 0x7f20bc101840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f20b000d8d0 tx=0x7f20b000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:45.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.172+0000 7f20b9ffb700 1 -- 172.21.15.2:0/716554822 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20b0009940 con 0x7f20bc0ffc20 2024-09-13T23:03:45.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.172+0000 7f20b9ffb700 1 -- 172.21.15.2:0/716554822 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20b0010460 con 0x7f20bc0ffc20 2024-09-13T23:03:45.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.172+0000 7f20c2e7f700 1 -- 172.21.15.2:0/716554822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20bc1a2a30 con 0x7f20bc0ffc20 2024-09-13T23:03:45.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.172+0000 7f20b9ffb700 1 -- 172.21.15.2:0/716554822 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20b000f5f0 con 0x7f20bc0ffc20 2024-09-13T23:03:45.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.172+0000 7f20c2e7f700 1 -- 172.21.15.2:0/716554822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20bc1a2e40 con 0x7f20bc0ffc20 2024-09-13T23:03:45.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.173+0000 7f20c2e7f700 1 -- 172.21.15.2:0/716554822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20bc04f2e0 con 0x7f20bc0ffc20 2024-09-13T23:03:45.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.173+0000 7f20b9ffb700 1 -- 172.21.15.2:0/716554822 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f20b00105d0 con 0x7f20bc0ffc20 2024-09-13T23:03:45.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.174+0000 7f20b9ffb700 1 --2- 172.21.15.2:0/716554822 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f20ac06e680 0x7f20ac070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:45.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.174+0000 7f20b9ffb700 1 -- 172.21.15.2:0/716554822 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f20b008e5a0 con 0x7f20bc0ffc20 2024-09-13T23:03:45.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.174+0000 7f20bbfff700 1 --2- 172.21.15.2:0/716554822 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f20ac06e680 0x7f20ac070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:45.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.174+0000 7f20bbfff700 1 --2- 172.21.15.2:0/716554822 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f20ac06e680 0x7f20ac070b40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f20a800b5c0 tx=0x7f20a8005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:45.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.178+0000 7f20b9ffb700 1 -- 172.21.15.2:0/716554822 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f20b00577f0 con 0x7f20bc0ffc20 2024-09-13T23:03:45.276 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:45 smithi047 podman[96037]: 2024-09-13 23:03:45.206975393 +0000 UTC m=+0.520925219 container remove 5e1d5b56528895403fa338d11a23e17c121540ff84dabdaa8cac186b35b80a99 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:03:45.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.474+0000 7f20c2e7f700 1 -- 172.21.15.2:0/716554822 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f20bc1a3160 con 0x7f20bc0ffc20 2024-09-13T23:03:45.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:45 smithi002 ceph-mon[111294]: pgmap v133: 65 pgs: 9 active+undersized, 10 peering, 2 stale+active+clean, 7 active+undersized+degraded, 37 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 29/264 objects degraded (10.985%) 2024-09-13T23:03:45.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:45 smithi002 ceph-mon[111294]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:45.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:45 smithi002 ceph-mon[111294]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.475+0000 7f20b9ffb700 1 -- 172.21.15.2:0/716554822 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7f20b005aeb0 con 0x7f20bc0ffc20 2024-09-13T23:03:45.476 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:03:45.476 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T23:03:45.476 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:03:45.477 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:03:45.477 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T23:03:45.477 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:03:45.477 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:03:45.477 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T23:03:45.477 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-09-13T23:03:45.477 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T23:03:45.477 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:03:45.477 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T23:03:45.477 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-13T23:03:45.477 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:03:45.477 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T23:03:45.477 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 5, 2024-09-13T23:03:45.477 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 8 2024-09-13T23:03:45.478 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T23:03:45.478 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.477+0000 7f20c2e7f700 1 -- 172.21.15.2:0/716554822 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f20ac06e680 msgr2=0x7f20ac070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.477+0000 7f20c2e7f700 1 --2- 172.21.15.2:0/716554822 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f20ac06e680 0x7f20ac070b40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f20a800b5c0 tx=0x7f20a8005fd0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.477+0000 7f20c2e7f700 1 -- 172.21.15.2:0/716554822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc0ffc20 msgr2=0x7f20bc101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.477+0000 7f20c2e7f700 1 --2- 172.21.15.2:0/716554822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc0ffc20 0x7f20bc101840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f20b000d8d0 tx=0x7f20b000dc90 comp rx=0 tx=0).stop 2024-09-13T23:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.477+0000 7f20c2e7f700 1 -- 172.21.15.2:0/716554822 shutdown_connections 2024-09-13T23:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.477+0000 7f20c2e7f700 1 --2- 172.21.15.2:0/716554822 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f20ac06e680 0x7f20ac070b40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.477+0000 7f20c2e7f700 1 --2- 172.21.15.2:0/716554822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc0ffc20 0x7f20bc101840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.477+0000 7f20c2e7f700 1 --2- 172.21.15.2:0/716554822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20bc105bd0 0x7f20bc101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.477+0000 7f20c2e7f700 1 -- 172.21.15.2:0/716554822 >> 172.21.15.2:0/716554822 conn(0x7f20bc075670 msgr2=0x7f20bc068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.478+0000 7f20c2e7f700 1 -- 172.21.15.2:0/716554822 shutdown_connections 2024-09-13T23:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.478+0000 7f20c2e7f700 1 -- 172.21.15.2:0/716554822 wait complete. 2024-09-13T23:03:45.567 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:45 smithi047 ceph-mon[81243]: pgmap v133: 65 pgs: 9 active+undersized, 10 peering, 2 stale+active+clean, 7 active+undersized+degraded, 37 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 29/264 objects degraded (10.985%) 2024-09-13T23:03:45.567 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:45 smithi047 ceph-mon[81243]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:45.568 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:45 smithi047 ceph-mon[81243]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:45.568 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:45 smithi047 podman[96099]: 2024-09-13 23:03:45.333098432 +0000 UTC m=+0.017047033 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:03:45.568 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:45 smithi047 podman[96099]: 2024-09-13 23:03:45.457929906 +0000 UTC m=+0.141878514 container create 185d7ae7181b12af67bd210c065a4e2782ead79db929d674014fe5b8705a7071 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-13T23:03:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.586+0000 7f94476c3700 1 -- 172.21.15.2:0/296213705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9440105bd0 msgr2=0x7f9440105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.586+0000 7f94476c3700 1 --2- 172.21.15.2:0/296213705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9440105bd0 0x7f9440105fb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f943c00b0a0 tx=0x7f943c00b3b0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.586+0000 7f94476c3700 1 -- 172.21.15.2:0/296213705 shutdown_connections 2024-09-13T23:03:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.586+0000 7f94476c3700 1 --2- 172.21.15.2:0/296213705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94400ffc20 0x7f9440100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.586+0000 7f94476c3700 1 --2- 172.21.15.2:0/296213705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9440105bd0 0x7f9440105fb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.586+0000 7f94476c3700 1 -- 172.21.15.2:0/296213705 >> 172.21.15.2:0/296213705 conn(0x7f9440075670 msgr2=0x7f9440075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:45.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.586+0000 7f94476c3700 1 -- 172.21.15.2:0/296213705 shutdown_connections 2024-09-13T23:03:45.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.586+0000 7f94476c3700 1 -- 172.21.15.2:0/296213705 wait complete. 2024-09-13T23:03:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.587+0000 7f94476c3700 1 Processor -- start 2024-09-13T23:03:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.587+0000 7f94476c3700 1 -- start start 2024-09-13T23:03:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.587+0000 7f94476c3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94400ffc20 0x7f9440101840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.587+0000 7f94476c3700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9440105bd0 0x7f9440101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.587+0000 7f94476c3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94401022c0 con 0x7f94400ffc20 2024-09-13T23:03:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.587+0000 7f94476c3700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9440102400 con 0x7f9440105bd0 2024-09-13T23:03:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.587+0000 7f944545f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94400ffc20 0x7f9440101840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.587+0000 7f944545f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94400ffc20 0x7f9440101840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56140/0 (socket says 172.21.15.2:56140) 2024-09-13T23:03:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.587+0000 7f944545f700 1 -- 172.21.15.2:0/439507495 learned_addr learned my addr 172.21.15.2:0/439507495 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:03:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.587+0000 7f944545f700 1 -- 172.21.15.2:0/439507495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9440105bd0 msgr2=0x7f9440101d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.587+0000 7f944545f700 1 --2- 172.21.15.2:0/439507495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9440105bd0 0x7f9440101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.587+0000 7f944545f700 1 -- 172.21.15.2:0/439507495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c009d00 con 0x7f94400ffc20 2024-09-13T23:03:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.588+0000 7f944545f700 1 --2- 172.21.15.2:0/439507495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94400ffc20 0x7f9440101840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f943c000f80 tx=0x7f943c00cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.588+0000 7f94367fc700 1 -- 172.21.15.2:0/439507495 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f943c00e040 con 0x7f94400ffc20 2024-09-13T23:03:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.588+0000 7f94367fc700 1 -- 172.21.15.2:0/439507495 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f943c003de0 con 0x7f94400ffc20 2024-09-13T23:03:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.588+0000 7f94476c3700 1 -- 172.21.15.2:0/439507495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9440102680 con 0x7f94400ffc20 2024-09-13T23:03:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.588+0000 7f94367fc700 1 -- 172.21.15.2:0/439507495 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f943c01d790 con 0x7f94400ffc20 2024-09-13T23:03:45.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.588+0000 7f94476c3700 1 -- 172.21.15.2:0/439507495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94401a2d50 con 0x7f94400ffc20 2024-09-13T23:03:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.589+0000 7f94476c3700 1 -- 172.21.15.2:0/439507495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f944004f2e0 con 0x7f94400ffc20 2024-09-13T23:03:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.589+0000 7f94367fc700 1 -- 172.21.15.2:0/439507495 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f943c004040 con 0x7f94400ffc20 2024-09-13T23:03:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.590+0000 7f94367fc700 1 --2- 172.21.15.2:0/439507495 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f942c06e680 0x7f942c070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:45.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.590+0000 7f94367fc700 1 -- 172.21.15.2:0/439507495 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f943c08fdc0 con 0x7f94400ffc20 2024-09-13T23:03:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.590+0000 7f9444c5e700 1 --2- 172.21.15.2:0/439507495 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f942c06e680 0x7f942c070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.590+0000 7f9444c5e700 1 --2- 172.21.15.2:0/439507495 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f942c06e680 0x7f942c070b40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9430005fd0 tx=0x7f9430005f60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:45.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.594+0000 7f94367fc700 1 -- 172.21.15.2:0/439507495 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f943c059010 con 0x7f94400ffc20 2024-09-13T23:03:45.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.870+0000 7f94476c3700 1 -- 172.21.15.2:0/439507495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f94401a30f0 con 0x7f94400ffc20 2024-09-13T23:03:45.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.870+0000 7f94367fc700 1 -- 172.21.15.2:0/439507495 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1938 (secure 0 0 0) 0x7f943c05c6d0 con 0x7f94400ffc20 2024-09-13T23:03:45.871 INFO:teuthology.orchestra.run.smithi002.stdout:e16 2024-09-13T23:03:45.871 INFO:teuthology.orchestra.run.smithi002.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T23:03:45.871 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:03:45.871 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:03:45.871 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-13T23:03:45.872 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:03:45.872 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:03:45.872 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-13T23:03:45.872 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 16 2024-09-13T23:03:45.872 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:03:45.872 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-13T22:53:05.963265+0000 2024-09-13T23:03:45.872 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-13T22:53:25.072026+0000 2024-09-13T23:03:45.872 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-13T23:03:45.872 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-13T23:03:45.872 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-13T23:03:45.872 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-13T23:03:45.872 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-13T23:03:45.872 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-13T23:03:45.872 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-13T23:03:45.873 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-13T23:03:45.873 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 47 2024-09-13T23:03:45.873 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:03:45.873 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 1 2024-09-13T23:03:45.873 INFO:teuthology.orchestra.run.smithi002.stdout:in 0 2024-09-13T23:03:45.873 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24267} 2024-09-13T23:03:45.873 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-13T23:03:45.873 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-13T23:03:45.873 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-13T23:03:45.873 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-13T23:03:45.873 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-13T23:03:45.873 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-13T23:03:45.873 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-13T23:03:45.873 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-13T23:03:45.874 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-13T23:03:45.874 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 0 members: 2024-09-13T23:03:45.874 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.gxzkha{0:24267} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:03:45.874 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.gglyyr{0:14488} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.2:6828/2123560657,v1:172.21.15.2:6829/2123560657] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:03:45.874 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:03:45.874 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:03:45.874 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-13T23:03:45.874 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:03:45.874 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.auedll{-1:14500} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/1577962179,v1:172.21.15.2:6827/1577962179] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:03:45.874 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.nqvveh{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:03:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.873+0000 7f94476c3700 1 -- 172.21.15.2:0/439507495 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f942c06e680 msgr2=0x7f942c070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.873+0000 7f94476c3700 1 --2- 172.21.15.2:0/439507495 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f942c06e680 0x7f942c070b40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9430005fd0 tx=0x7f9430005f60 comp rx=0 tx=0).stop 2024-09-13T23:03:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.873+0000 7f94476c3700 1 -- 172.21.15.2:0/439507495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94400ffc20 msgr2=0x7f9440101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.873+0000 7f94476c3700 1 --2- 172.21.15.2:0/439507495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94400ffc20 0x7f9440101840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f943c000f80 tx=0x7f943c00cdd0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.873+0000 7f94476c3700 1 -- 172.21.15.2:0/439507495 shutdown_connections 2024-09-13T23:03:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.873+0000 7f94476c3700 1 --2- 172.21.15.2:0/439507495 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f942c06e680 0x7f942c070b40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.873+0000 7f94476c3700 1 --2- 172.21.15.2:0/439507495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94400ffc20 0x7f9440101840 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.873+0000 7f94476c3700 1 --2- 172.21.15.2:0/439507495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9440105bd0 0x7f9440101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.873+0000 7f94476c3700 1 -- 172.21.15.2:0/439507495 >> 172.21.15.2:0/439507495 conn(0x7f9440075670 msgr2=0x7f94400686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:45.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.874+0000 7f94476c3700 1 -- 172.21.15.2:0/439507495 shutdown_connections 2024-09-13T23:03:45.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.874+0000 7f94476c3700 1 -- 172.21.15.2:0/439507495 wait complete. 2024-09-13T23:03:45.876 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2024-09-13T23:03:45.912 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:45 smithi047 podman[96099]: 2024-09-13 23:03:45.685186462 +0000 UTC m=+0.369135063 container init 185d7ae7181b12af67bd210c065a4e2782ead79db929d674014fe5b8705a7071 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-13T23:03:45.912 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:45 smithi047 podman[96099]: 2024-09-13 23:03:45.688641705 +0000 UTC m=+0.372590306 container start 185d7ae7181b12af67bd210c065a4e2782ead79db929d674014fe5b8705a7071 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-13T23:03:45.912 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:45 smithi047 ceph-osd[96117]: -- 172.21.15.47:0/3125035672 <== mon.1 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558d8feb21e0 con 0x558d8feb0000 2024-09-13T23:03:45.912 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:45 smithi047 bash[96099]: 185d7ae7181b12af67bd210c065a4e2782ead79db929d674014fe5b8705a7071 2024-09-13T23:03:45.913 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:45 smithi047 systemd[1]: Started Ceph osd.4 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T23:03:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.986+0000 7f6628181700 1 -- 172.21.15.2:0/2271190694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66200ffc20 msgr2=0x7f6620100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.986+0000 7f6628181700 1 --2- 172.21.15.2:0/2271190694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66200ffc20 0x7f6620100080 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6610009910 tx=0x7f6610009c20 comp rx=0 tx=0).stop 2024-09-13T23:03:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.986+0000 7f6628181700 1 -- 172.21.15.2:0/2271190694 shutdown_connections 2024-09-13T23:03:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.986+0000 7f6628181700 1 --2- 172.21.15.2:0/2271190694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66200ffc20 0x7f6620100080 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.986+0000 7f6628181700 1 --2- 172.21.15.2:0/2271190694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6620105bd0 0x7f6620105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.986+0000 7f6628181700 1 -- 172.21.15.2:0/2271190694 >> 172.21.15.2:0/2271190694 conn(0x7f6620075670 msgr2=0x7f6620075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.986+0000 7f6628181700 1 -- 172.21.15.2:0/2271190694 shutdown_connections 2024-09-13T23:03:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.986+0000 7f6628181700 1 -- 172.21.15.2:0/2271190694 wait complete. 2024-09-13T23:03:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.987+0000 7f6628181700 1 Processor -- start 2024-09-13T23:03:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.987+0000 7f6628181700 1 -- start start 2024-09-13T23:03:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.987+0000 7f6628181700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66200ffc20 0x7f6620197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.987+0000 7f6628181700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6620105bd0 0x7f6620197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.987+0000 7f6628181700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6620198380 con 0x7f66200ffc20 2024-09-13T23:03:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.987+0000 7f6628181700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66201984f0 con 0x7f6620105bd0 2024-09-13T23:03:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.987+0000 7f6625f1d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66200ffc20 0x7f6620197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.987+0000 7f6625f1d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66200ffc20 0x7f6620197760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56160/0 (socket says 172.21.15.2:56160) 2024-09-13T23:03:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.987+0000 7f6625f1d700 1 -- 172.21.15.2:0/1754480976 learned_addr learned my addr 172.21.15.2:0/1754480976 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:03:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.987+0000 7f662571c700 1 --2- 172.21.15.2:0/1754480976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6620105bd0 0x7f6620197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.988+0000 7f6625f1d700 1 -- 172.21.15.2:0/1754480976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6620105bd0 msgr2=0x7f6620197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.988+0000 7f6625f1d700 1 --2- 172.21.15.2:0/1754480976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6620105bd0 0x7f6620197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.988+0000 7f6625f1d700 1 -- 172.21.15.2:0/1754480976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66100095f0 con 0x7f66200ffc20 2024-09-13T23:03:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.988+0000 7f662571c700 1 --2- 172.21.15.2:0/1754480976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6620105bd0 0x7f6620197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T23:03:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.988+0000 7f6625f1d700 1 --2- 172.21.15.2:0/1754480976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66200ffc20 0x7f6620197760 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f661c00e920 tx=0x7f661c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.988+0000 7f6616ffd700 1 -- 172.21.15.2:0/1754480976 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f661c00c9d0 con 0x7f66200ffc20 2024-09-13T23:03:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.988+0000 7f6616ffd700 1 -- 172.21.15.2:0/1754480976 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f661c010430 con 0x7f66200ffc20 2024-09-13T23:03:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.988+0000 7f6628181700 1 -- 172.21.15.2:0/1754480976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66201a07d0 con 0x7f66200ffc20 2024-09-13T23:03:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.988+0000 7f6616ffd700 1 -- 172.21.15.2:0/1754480976 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f661c018630 con 0x7f66200ffc20 2024-09-13T23:03:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.988+0000 7f6628181700 1 -- 172.21.15.2:0/1754480976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66201a0cf0 con 0x7f66200ffc20 2024-09-13T23:03:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.989+0000 7f6628181700 1 -- 172.21.15.2:0/1754480976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66201080d0 con 0x7f66200ffc20 2024-09-13T23:03:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.990+0000 7f6616ffd700 1 -- 172.21.15.2:0/1754480976 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f661c0105a0 con 0x7f66200ffc20 2024-09-13T23:03:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.991+0000 7f6616ffd700 1 --2- 172.21.15.2:0/1754480976 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f660c06e680 0x7f660c070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.991+0000 7f6616ffd700 1 -- 172.21.15.2:0/1754480976 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f661c014070 con 0x7f66200ffc20 2024-09-13T23:03:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.991+0000 7f662571c700 1 --2- 172.21.15.2:0/1754480976 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f660c06e680 0x7f660c070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.991+0000 7f662571c700 1 --2- 172.21.15.2:0/1754480976 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f660c06e680 0x7f660c070b40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f66200691b0 tx=0x7f6610005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:45.995+0000 7f6616ffd700 1 -- 172.21.15.2:0/1754480976 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f661c0541b0 con 0x7f66200ffc20 2024-09-13T23:03:46.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.250+0000 7f6628181700 1 -- 172.21.15.2:0/1754480976 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6620068be0 con 0x7f660c06e680 2024-09-13T23:03:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.253+0000 7f6616ffd700 1 -- 172.21.15.2:0/1754480976 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f6620068be0 con 0x7f660c06e680 2024-09-13T23:03:46.254 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:03:46.254 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:03:46.255 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T23:03:46.255 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:03:46.255 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-13T23:03:46.255 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-13T23:03:46.255 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-13T23:03:46.255 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2024-09-13T23:03:46.255 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-13T23:03:46.255 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "10/23 daemons upgraded", 2024-09-13T23:03:46.255 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T23:03:46.255 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T23:03:46.255 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:03:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.256+0000 7f6628181700 1 -- 172.21.15.2:0/1754480976 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f660c06e680 msgr2=0x7f660c070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.256+0000 7f6628181700 1 --2- 172.21.15.2:0/1754480976 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f660c06e680 0x7f660c070b40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f66200691b0 tx=0x7f6610005940 comp rx=0 tx=0).stop 2024-09-13T23:03:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.256+0000 7f6628181700 1 -- 172.21.15.2:0/1754480976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66200ffc20 msgr2=0x7f6620197760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.256+0000 7f6628181700 1 --2- 172.21.15.2:0/1754480976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66200ffc20 0x7f6620197760 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f661c00e920 tx=0x7f661c00ec30 comp rx=0 tx=0).stop 2024-09-13T23:03:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.256+0000 7f6628181700 1 -- 172.21.15.2:0/1754480976 shutdown_connections 2024-09-13T23:03:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.256+0000 7f6628181700 1 --2- 172.21.15.2:0/1754480976 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f660c06e680 0x7f660c070b40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.256+0000 7f6628181700 1 --2- 172.21.15.2:0/1754480976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66200ffc20 0x7f6620197760 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.256+0000 7f6628181700 1 --2- 172.21.15.2:0/1754480976 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6620105bd0 0x7f6620197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.256+0000 7f6628181700 1 -- 172.21.15.2:0/1754480976 >> 172.21.15.2:0/1754480976 conn(0x7f6620075670 msgr2=0x7f66200fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.256+0000 7f6628181700 1 -- 172.21.15.2:0/1754480976 shutdown_connections 2024-09-13T23:03:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.256+0000 7f6628181700 1 -- 172.21.15.2:0/1754480976 wait complete. 2024-09-13T23:03:46.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.366+0000 7f81e9e28700 1 -- 172.21.15.2:0/970764179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81e4100ea0 msgr2=0x7f81e4101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:46.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.366+0000 7f81e9e28700 1 --2- 172.21.15.2:0/970764179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81e4100ea0 0x7f81e4101280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009910 tx=0x7f81d4009c20 comp rx=0 tx=0).stop 2024-09-13T23:03:46.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.366+0000 7f81e9e28700 1 -- 172.21.15.2:0/970764179 shutdown_connections 2024-09-13T23:03:46.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.366+0000 7f81e9e28700 1 --2- 172.21.15.2:0/970764179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81e4101850 0x7f81e41058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:46.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.366+0000 7f81e9e28700 1 --2- 172.21.15.2:0/970764179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81e4100ea0 0x7f81e4101280 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:46.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.366+0000 7f81e9e28700 1 -- 172.21.15.2:0/970764179 >> 172.21.15.2:0/970764179 conn(0x7f81e40fc750 msgr2=0x7f81e40feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:46.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.366+0000 7f81e9e28700 1 -- 172.21.15.2:0/970764179 shutdown_connections 2024-09-13T23:03:46.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.366+0000 7f81e9e28700 1 -- 172.21.15.2:0/970764179 wait complete. 2024-09-13T23:03:46.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.366+0000 7f81e9e28700 1 Processor -- start 2024-09-13T23:03:46.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.367+0000 7f81e9e28700 1 -- start start 2024-09-13T23:03:46.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.367+0000 7f81e9e28700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81e4100ea0 0x7f81e419c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:46.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.367+0000 7f81e9e28700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81e4101850 0x7f81e419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:46.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.367+0000 7f81e9e28700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e419d2c0 con 0x7f81e4101850 2024-09-13T23:03:46.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.367+0000 7f81e9e28700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4196770 con 0x7f81e4100ea0 2024-09-13T23:03:46.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.367+0000 7f81e2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81e4101850 0x7f81e419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.367+0000 7f81e2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81e4101850 0x7f81e419cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56172/0 (socket says 172.21.15.2:56172) 2024-09-13T23:03:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.367+0000 7f81e2ffd700 1 -- 172.21.15.2:0/1058895386 learned_addr learned my addr 172.21.15.2:0/1058895386 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:03:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.367+0000 7f81e37fe700 1 --2- 172.21.15.2:0/1058895386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81e4100ea0 0x7f81e419c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.367+0000 7f81e2ffd700 1 -- 172.21.15.2:0/1058895386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81e4100ea0 msgr2=0x7f81e419c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.367+0000 7f81e2ffd700 1 --2- 172.21.15.2:0/1058895386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81e4100ea0 0x7f81e419c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.367+0000 7f81e2ffd700 1 -- 172.21.15.2:0/1058895386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d40095f0 con 0x7f81e4101850 2024-09-13T23:03:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.367+0000 7f81e2ffd700 1 --2- 172.21.15.2:0/1058895386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81e4101850 0x7f81e419cc30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00d900 tx=0x7f81cc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.368+0000 7f81e0ff9700 1 -- 172.21.15.2:0/1058895386 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81cc009900 con 0x7f81e4101850 2024-09-13T23:03:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.368+0000 7f81e9e28700 1 -- 172.21.15.2:0/1058895386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e4196a50 con 0x7f81e4101850 2024-09-13T23:03:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.368+0000 7f81e0ff9700 1 -- 172.21.15.2:0/1058895386 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f81cc010460 con 0x7f81e4101850 2024-09-13T23:03:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.368+0000 7f81e0ff9700 1 -- 172.21.15.2:0/1058895386 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81cc00f5f0 con 0x7f81e4101850 2024-09-13T23:03:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.368+0000 7f81e9e28700 1 -- 172.21.15.2:0/1058895386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e4196fa0 con 0x7f81e4101850 2024-09-13T23:03:46.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.369+0000 7f81e9e28700 1 -- 172.21.15.2:0/1058895386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e4109240 con 0x7f81e4101850 2024-09-13T23:03:46.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.369+0000 7f81e0ff9700 1 -- 172.21.15.2:0/1058895386 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f81cc0105d0 con 0x7f81e4101850 2024-09-13T23:03:46.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.370+0000 7f81e0ff9700 1 --2- 172.21.15.2:0/1058895386 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f81d006e680 0x7f81d0070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:03:46.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.370+0000 7f81e0ff9700 1 -- 172.21.15.2:0/1058895386 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f81cc08e190 con 0x7f81e4101850 2024-09-13T23:03:46.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.370+0000 7f81e37fe700 1 --2- 172.21.15.2:0/1058895386 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f81d006e680 0x7f81d0070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:03:46.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.370+0000 7f81e37fe700 1 --2- 172.21.15.2:0/1058895386 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f81d006e680 0x7f81d0070b40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f81d4006010 tx=0x7f81d401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:03:46.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.374+0000 7f81e0ff9700 1 -- 172.21.15.2:0/1058895386 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f81cc05af10 con 0x7f81e4101850 2024-09-13T23:03:46.557 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:46 smithi047 ceph-mon[81243]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:46.557 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:46 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/716554822' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:03:46.557 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:46 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:46.558 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:46 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:46.558 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:46 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:03:46.558 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:46 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/439507495' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:03:46.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.669+0000 7f81e9e28700 1 -- 172.21.15.2:0/1058895386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f81e404f2e0 con 0x7f81e4101850 2024-09-13T23:03:46.670 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:46 smithi002 ceph-mon[111294]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:46.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:46 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/716554822' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:03:46.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:46 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:46.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:46 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:46.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:46 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:03:46.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:46 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/439507495' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:03:46.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.670+0000 7f81e0ff9700 1 -- 172.21.15.2:0/1058895386 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1112 (secure 0 0 0) 0x7f81cc05aaa0 con 0x7f81e4101850 2024-09-13T23:03:46.672 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Reduced data availability: 2 pgs peering; Degraded data redundancy: 29/264 objects degraded (10.985%), 7 pgs degraded 2024-09-13T23:03:46.672 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T23:03:46.672 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T23:03:46.672 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T23:03:46.672 INFO:teuthology.orchestra.run.smithi002.stdout: osd.4 (root=default,host=smithi047) is down 2024-09-13T23:03:46.672 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 2 pgs peering 2024-09-13T23:03:46.672 INFO:teuthology.orchestra.run.smithi002.stdout: pg 3.9 is stuck peering for 5m, current state peering, last acting [2,5] 2024-09-13T23:03:46.672 INFO:teuthology.orchestra.run.smithi002.stdout: pg 3.1a is stuck peering for 5m, current state peering, last acting [1,2] 2024-09-13T23:03:46.672 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 29/264 objects degraded (10.985%), 7 pgs degraded 2024-09-13T23:03:46.672 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-13T23:03:46.672 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-13T23:03:46.672 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-13T23:03:46.673 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-13T23:03:46.673 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-13T23:03:46.673 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-13T23:03:46.673 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-13T23:03:46.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.672+0000 7f81e9e28700 1 -- 172.21.15.2:0/1058895386 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f81d006e680 msgr2=0x7f81d0070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:46.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.672+0000 7f81e9e28700 1 --2- 172.21.15.2:0/1058895386 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f81d006e680 0x7f81d0070b40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f81d4006010 tx=0x7f81d401a040 comp rx=0 tx=0).stop 2024-09-13T23:03:46.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.672+0000 7f81e9e28700 1 -- 172.21.15.2:0/1058895386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81e4101850 msgr2=0x7f81e419cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:03:46.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.672+0000 7f81e9e28700 1 --2- 172.21.15.2:0/1058895386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81e4101850 0x7f81e419cc30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00d900 tx=0x7f81cc00dc10 comp rx=0 tx=0).stop 2024-09-13T23:03:46.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.672+0000 7f81e9e28700 1 -- 172.21.15.2:0/1058895386 shutdown_connections 2024-09-13T23:03:46.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.672+0000 7f81e9e28700 1 --2- 172.21.15.2:0/1058895386 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f81d006e680 0x7f81d0070b40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:46.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.672+0000 7f81e9e28700 1 --2- 172.21.15.2:0/1058895386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f81e4100ea0 0x7f81e419c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:46.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.672+0000 7f81e9e28700 1 --2- 172.21.15.2:0/1058895386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81e4101850 0x7f81e419cc30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:03:46.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.672+0000 7f81e9e28700 1 -- 172.21.15.2:0/1058895386 >> 172.21.15.2:0/1058895386 conn(0x7f81e40fc750 msgr2=0x7f81e40fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:03:46.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.672+0000 7f81e9e28700 1 -- 172.21.15.2:0/1058895386 shutdown_connections 2024-09-13T23:03:46.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:03:46.672+0000 7f81e9e28700 1 -- 172.21.15.2:0/1058895386 wait complete. 2024-09-13T23:03:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:47 smithi002 ceph-mon[111294]: pgmap v134: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 46/264 objects degraded (17.424%) 2024-09-13T23:03:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:47 smithi002 ceph-mon[111294]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:47 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/1058895386' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:03:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:47 smithi002 ceph-mon[111294]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-13T23:03:47.534 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:47 smithi047 ceph-mon[81243]: pgmap v134: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 46/264 objects degraded (17.424%) 2024-09-13T23:03:47.534 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:47 smithi047 ceph-mon[81243]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:03:47.534 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:47 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/1058895386' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:03:47.534 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:47 smithi047 ceph-mon[81243]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-13T23:03:47.912 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:47 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:03:47.577+0000 7fc2c276f640 -1 Falling back to public interface 2024-09-13T23:03:50.117 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:49 smithi047 ceph-mon[81243]: pgmap v135: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 46/264 objects degraded (17.424%) 2024-09-13T23:03:50.118 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:49 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:50.118 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:49 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:50.118 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:49 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:50.118 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:49 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:50.118 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:49 smithi047 ceph-mon[81243]: Health check update: Degraded data redundancy: 46/264 objects degraded (17.424%), 15 pgs degraded (PG_DEGRADED) 2024-09-13T23:03:50.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:49 smithi002 ceph-mon[111294]: pgmap v135: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 46/264 objects degraded (17.424%) 2024-09-13T23:03:50.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:49 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:50.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:49 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:50.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:49 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:50.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:49 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:50.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:49 smithi002 ceph-mon[111294]: Health check update: Degraded data redundancy: 46/264 objects degraded (17.424%), 15 pgs degraded (PG_DEGRADED) 2024-09-13T23:03:52.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:51 smithi047 ceph-mon[81243]: pgmap v136: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 960 B/s rd, 0 op/s; 46/264 objects degraded (17.424%) 2024-09-13T23:03:52.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:51 smithi002 ceph-mon[111294]: pgmap v136: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 960 B/s rd, 0 op/s; 46/264 objects degraded (17.424%) 2024-09-13T23:03:53.519 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:03:53.174+0000 7fc2c276f640 -1 osd.4 0 read_superblock omap replica is missing. 2024-09-13T23:03:53.520 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:03:53.517+0000 7fc2c276f640 -1 osd.4 70 log_to_monitors true 2024-09-13T23:03:53.879 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-mon[81243]: pgmap v137: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 1 op/s; 46/264 objects degraded (17.424%) 2024-09-13T23:03:53.879 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:53.879 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:53.879 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:53.879 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:03:53.879 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:53.880 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:03:53.880 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:03:53.880 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:03:53.880 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:03:53.880 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T23:03:53.880 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-mon[81243]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T23:03:53.880 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-mon[81243]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T23:03:53.880 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:53.880 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:03:53.880 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-mon[81243]: from='osd.4 [v2:172.21.15.47:6808/402911036,v1:172.21.15.47:6809/402911036]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T23:03:53.880 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-mon[81243]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T23:03:54.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:53 smithi002 ceph-mon[111294]: pgmap v137: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 1 op/s; 46/264 objects degraded (17.424%) 2024-09-13T23:03:54.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:54.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:54.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:03:54.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:03:54.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:54.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:03:54.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:03:54.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:03:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:03:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T23:03:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:53 smithi002 ceph-mon[111294]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T23:03:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:53 smithi002 ceph-mon[111294]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T23:03:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:03:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:03:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:53 smithi002 ceph-mon[111294]: from='osd.4 [v2:172.21.15.47:6808/402911036,v1:172.21.15.47:6809/402911036]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T23:03:54.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:53 smithi002 ceph-mon[111294]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T23:03:54.162 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:03:53 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:03:53.877+0000 7fc2ba509640 -1 osd.4 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:03:55.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:54 smithi047 ceph-mon[81243]: pgmap v138: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 46/264 objects degraded (17.424%) 2024-09-13T23:03:55.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:54 smithi047 ceph-mon[81243]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T23:03:55.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:54 smithi047 ceph-mon[81243]: osdmap e73: 6 total, 5 up, 6 in 2024-09-13T23:03:55.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:54 smithi047 ceph-mon[81243]: from='osd.4 [v2:172.21.15.47:6808/402911036,v1:172.21.15.47:6809/402911036]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T23:03:55.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:54 smithi047 ceph-mon[81243]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T23:03:55.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:54 smithi002 ceph-mon[111294]: pgmap v138: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 46/264 objects degraded (17.424%) 2024-09-13T23:03:55.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:54 smithi002 ceph-mon[111294]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T23:03:55.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:54 smithi002 ceph-mon[111294]: osdmap e73: 6 total, 5 up, 6 in 2024-09-13T23:03:55.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:54 smithi002 ceph-mon[111294]: from='osd.4 [v2:172.21.15.47:6808/402911036,v1:172.21.15.47:6809/402911036]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T23:03:55.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:54 smithi002 ceph-mon[111294]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T23:03:56.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:55 smithi047 ceph-mon[81243]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:03:56.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:55 smithi047 ceph-mon[81243]: osd.4 [v2:172.21.15.47:6808/402911036,v1:172.21.15.47:6809/402911036] boot 2024-09-13T23:03:56.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:55 smithi047 ceph-mon[81243]: osdmap e74: 6 total, 6 up, 6 in 2024-09-13T23:03:56.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:55 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:03:56.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:55 smithi002 ceph-mon[111294]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:03:56.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:55 smithi002 ceph-mon[111294]: osd.4 [v2:172.21.15.47:6808/402911036,v1:172.21.15.47:6809/402911036] boot 2024-09-13T23:03:56.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:55 smithi002 ceph-mon[111294]: osdmap e74: 6 total, 6 up, 6 in 2024-09-13T23:03:56.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:55 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T23:03:57.065 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:56 smithi047 ceph-mon[81243]: pgmap v141: 65 pgs: 14 peering, 12 active+undersized, 8 active+undersized+degraded, 31 active+clean; 254 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 32/264 objects degraded (12.121%) 2024-09-13T23:03:57.065 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:56 smithi047 ceph-mon[81243]: Health check update: Degraded data redundancy: 32/264 objects degraded (12.121%), 8 pgs degraded (PG_DEGRADED) 2024-09-13T23:03:57.065 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:56 smithi047 ceph-mon[81243]: osdmap e75: 6 total, 6 up, 6 in 2024-09-13T23:03:57.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:56 smithi002 ceph-mon[111294]: pgmap v141: 65 pgs: 14 peering, 12 active+undersized, 8 active+undersized+degraded, 31 active+clean; 254 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 32/264 objects degraded (12.121%) 2024-09-13T23:03:57.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:56 smithi002 ceph-mon[111294]: Health check update: Degraded data redundancy: 32/264 objects degraded (12.121%), 8 pgs degraded (PG_DEGRADED) 2024-09-13T23:03:57.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:56 smithi002 ceph-mon[111294]: osdmap e75: 6 total, 6 up, 6 in 2024-09-13T23:03:59.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:58 smithi047 ceph-mon[81243]: pgmap v143: 65 pgs: 14 peering, 7 active+undersized, 3 active+undersized+degraded, 41 active+clean; 254 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 9/264 objects degraded (3.409%) 2024-09-13T23:03:59.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:58 smithi002 ceph-mon[111294]: pgmap v143: 65 pgs: 14 peering, 7 active+undersized, 3 active+undersized+degraded, 41 active+clean; 254 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 9/264 objects degraded (3.409%) 2024-09-13T23:04:00.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:03:59 smithi002 ceph-mon[111294]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/264 objects degraded (3.409%), 3 pgs degraded) 2024-09-13T23:04:00.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:03:59 smithi047 ceph-mon[81243]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/264 objects degraded (3.409%), 3 pgs degraded) 2024-09-13T23:04:01.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:00 smithi002 ceph-mon[111294]: pgmap v144: 65 pgs: 14 peering, 51 active+clean; 254 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s 2024-09-13T23:04:01.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:00 smithi047 ceph-mon[81243]: pgmap v144: 65 pgs: 14 peering, 51 active+clean; 254 MiB data, 1004 MiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s 2024-09-13T23:04:03.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:02 smithi002 ceph-mon[111294]: pgmap v145: 65 pgs: 65 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 1 KiB/s rd, 2 op/s 2024-09-13T23:04:03.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:02 smithi047 ceph-mon[81243]: pgmap v145: 65 pgs: 65 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 1 KiB/s rd, 2 op/s 2024-09-13T23:04:05.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:04 smithi002 ceph-mon[111294]: pgmap v146: 65 pgs: 65 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 910 B/s rd, 1 op/s 2024-09-13T23:04:05.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:04 smithi047 ceph-mon[81243]: pgmap v146: 65 pgs: 65 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 910 B/s rd, 1 op/s 2024-09-13T23:04:07.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:06 smithi047 ceph-mon[81243]: pgmap v147: 65 pgs: 65 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-09-13T23:04:07.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:06 smithi002 ceph-mon[111294]: pgmap v147: 65 pgs: 65 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-09-13T23:04:08.227 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T23:04:08.227 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:07 smithi047 ceph-mon[81243]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T23:04:08.227 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:07 smithi047 ceph-mon[81243]: Upgrade: osd.5 is safe to restart 2024-09-13T23:04:08.227 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:08.227 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:04:08.227 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:08.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T23:04:08.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:07 smithi002 ceph-mon[111294]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T23:04:08.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:07 smithi002 ceph-mon[111294]: Upgrade: osd.5 is safe to restart 2024-09-13T23:04:08.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:08.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:04:08.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:09.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:08 smithi047 ceph-mon[81243]: pgmap v148: 65 pgs: 65 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-13T23:04:09.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:08 smithi002 ceph-mon[111294]: pgmap v148: 65 pgs: 65 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-13T23:04:10.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:10 smithi002 ceph-mon[111294]: Upgrade: Updating osd.5 2024-09-13T23:04:10.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:10 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:10.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:10 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T23:04:10.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:10 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:10.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:10 smithi002 ceph-mon[111294]: Deploying daemon osd.5 on smithi047 2024-09-13T23:04:10.556 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:10 smithi047 ceph-mon[81243]: Upgrade: Updating osd.5 2024-09-13T23:04:10.557 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:10 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:10.557 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:10 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T23:04:10.557 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:10 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:10.557 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:10 smithi047 ceph-mon[81243]: Deploying daemon osd.5 on smithi047 2024-09-13T23:04:11.460 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:11 smithi047 ceph-mon[81243]: pgmap v149: 65 pgs: 65 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:04:11.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:11 smithi002 ceph-mon[111294]: pgmap v149: 65 pgs: 65 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:04:12.154 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:12 smithi047 systemd[1]: Stopping Ceph osd.5 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:04:12.912 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:12 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[53864]: 2024-09-13T23:04:12.435+0000 7f82f64a1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:04:12.913 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:12 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[53864]: 2024-09-13T23:04:12.435+0000 7f82f64a1700 -1 osd.5 75 *** Got signal Terminated *** 2024-09-13T23:04:12.913 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:12 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[53864]: 2024-09-13T23:04:12.435+0000 7f82f64a1700 -1 osd.5 75 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:04:13.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:13 smithi002 ceph-mon[111294]: pgmap v150: 65 pgs: 65 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:04:13.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:13 smithi002 ceph-mon[111294]: osd.5 marked itself down and dead 2024-09-13T23:04:13.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:13 smithi047 ceph-mon[81243]: pgmap v150: 65 pgs: 65 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:04:13.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:13 smithi047 ceph-mon[81243]: osd.5 marked itself down and dead 2024-09-13T23:04:14.011 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:13 smithi047 podman[100563]: 2024-09-13 23:04:13.72461095 +0000 UTC m=+1.412789294 container died ab35ed98725dbcbe6276a08301d5c0685c06841e691a29ec8d0332dfc2873708 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-09-13T23:04:14.381 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:14 smithi047 ceph-mon[81243]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:04:14.381 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:14 smithi047 ceph-mon[81243]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-13T23:04:14.381 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:14 smithi047 ceph-mon[81243]: osdmap e76: 6 total, 5 up, 6 in 2024-09-13T23:04:14.381 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:14 smithi047 podman[100563]: 2024-09-13 23:04:14.093060658 +0000 UTC m=+1.781238999 container cleanup ab35ed98725dbcbe6276a08301d5c0685c06841e691a29ec8d0332dfc2873708 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, RELEASE=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.1) 2024-09-13T23:04:14.381 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:14 smithi047 bash[100563]: ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5 2024-09-13T23:04:14.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:14 smithi002 ceph-mon[111294]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T23:04:14.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:14 smithi002 ceph-mon[111294]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-13T23:04:14.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:14 smithi002 ceph-mon[111294]: osdmap e76: 6 total, 5 up, 6 in 2024-09-13T23:04:14.662 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:14 smithi047 podman[100582]: 2024-09-13 23:04:14.380801578 +0000 UTC m=+0.651520002 container remove ab35ed98725dbcbe6276a08301d5c0685c06841e691a29ec8d0332dfc2873708 (image=quay.io/ceph/ceph@sha256:9f35728f6070a596500c0804814a12ab6b98e05067316dc64876fb4b28d04af3, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.1, io.buildah.version=1.29.1, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T23:04:14.981 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:14 smithi047 podman[100672]: 2024-09-13 23:04:14.614276375 +0000 UTC m=+0.016385215 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:04:14.981 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:14 smithi047 podman[100672]: 2024-09-13 23:04:14.711723851 +0000 UTC m=+0.113832691 container create fd0538d60c0d7913ca78ebe975f990fde395941338a9792004fbbee7b7847441 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-13T23:04:15.253 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:14 smithi047 podman[100672]: 2024-09-13 23:04:14.981530303 +0000 UTC m=+0.383639142 container init fd0538d60c0d7913ca78ebe975f990fde395941338a9792004fbbee7b7847441 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T23:04:15.253 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:14 smithi047 podman[100672]: 2024-09-13 23:04:14.985013834 +0000 UTC m=+0.387122674 container start fd0538d60c0d7913ca78ebe975f990fde395941338a9792004fbbee7b7847441 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:04:15.253 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:15 smithi047 podman[100672]: 2024-09-13 23:04:15.07296832 +0000 UTC m=+0.475077179 container attach fd0538d60c0d7913ca78ebe975f990fde395941338a9792004fbbee7b7847441 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T23:04:15.253 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:15 smithi047 podman[100672]: 2024-09-13 23:04:15.184380925 +0000 UTC m=+0.586489765 container died fd0538d60c0d7913ca78ebe975f990fde395941338a9792004fbbee7b7847441 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-13T23:04:15.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:15 smithi047 ceph-mon[81243]: pgmap v152: 65 pgs: 13 stale+active+clean, 52 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T23:04:15.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:15 smithi047 ceph-mon[81243]: osdmap e77: 6 total, 5 up, 6 in 2024-09-13T23:04:15.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:15 smithi002 ceph-mon[111294]: pgmap v152: 65 pgs: 13 stale+active+clean, 52 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-13T23:04:15.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:15 smithi002 ceph-mon[111294]: osdmap e77: 6 total, 5 up, 6 in 2024-09-13T23:04:16.162 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:15 smithi047 podman[100695]: 2024-09-13 23:04:15.743371297 +0000 UTC m=+0.550025053 container remove fd0538d60c0d7913ca78ebe975f990fde395941338a9792004fbbee7b7847441 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-13T23:04:16.162 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:15 smithi047 systemd[1]: ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-13T23:04:16.163 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:15 smithi047 systemd[1]: Stopped Ceph osd.5 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T23:04:16.163 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:15 smithi047 systemd[1]: ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.5.service: Consumed 55.332s CPU time. 2024-09-13T23:04:16.163 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:15 smithi047 systemd[1]: Starting Ceph osd.5 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:04:16.472 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:16 smithi047 ceph-mon[81243]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-13T23:04:16.472 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:16 smithi047 ceph-mon[81243]: Health check failed: Degraded data redundancy: 7/264 objects degraded (2.652%), 4 pgs degraded (PG_DEGRADED) 2024-09-13T23:04:16.472 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:16 smithi047 podman[100796]: 2024-09-13 23:04:16.094512441 +0000 UTC m=+0.016193462 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:04:16.473 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:16 smithi047 podman[100796]: 2024-09-13 23:04:16.210976495 +0000 UTC m=+0.132657513 container create e6695470bcdd7b0f43af1397295723fd81ccbd02229e39af05ac58f4ffefae10 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T23:04:16.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:16 smithi002 ceph-mon[111294]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-13T23:04:16.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:16 smithi002 ceph-mon[111294]: Health check failed: Degraded data redundancy: 7/264 objects degraded (2.652%), 4 pgs degraded (PG_DEGRADED) 2024-09-13T23:04:16.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.797+0000 7f5b78887700 1 -- 172.21.15.2:0/1015149555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b74100750 msgr2=0x7f5b741047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:16.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.797+0000 7f5b78887700 1 --2- 172.21.15.2:0/1015149555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b74100750 0x7f5b741047a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009910 tx=0x7f5b68009c20 comp rx=0 tx=0).stop 2024-09-13T23:04:16.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.797+0000 7f5b78887700 1 -- 172.21.15.2:0/1015149555 shutdown_connections 2024-09-13T23:04:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.797+0000 7f5b78887700 1 --2- 172.21.15.2:0/1015149555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b74100750 0x7f5b741047a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.797+0000 7f5b78887700 1 --2- 172.21.15.2:0/1015149555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b740ffda0 0x7f5b74100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.797+0000 7f5b78887700 1 -- 172.21.15.2:0/1015149555 >> 172.21.15.2:0/1015149555 conn(0x7f5b740fb650 msgr2=0x7f5b740fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.797+0000 7f5b78887700 1 -- 172.21.15.2:0/1015149555 shutdown_connections 2024-09-13T23:04:16.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.797+0000 7f5b78887700 1 -- 172.21.15.2:0/1015149555 wait complete. 2024-09-13T23:04:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.798+0000 7f5b78887700 1 Processor -- start 2024-09-13T23:04:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.798+0000 7f5b78887700 1 -- start start 2024-09-13T23:04:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.798+0000 7f5b78887700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b740ffda0 0x7f5b741977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.798+0000 7f5b78887700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b74100750 0x7f5b74197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.798+0000 7f5b78887700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b74198300 con 0x7f5b740ffda0 2024-09-13T23:04:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.798+0000 7f5b78887700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b74198470 con 0x7f5b74100750 2024-09-13T23:04:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.798+0000 7f5b7259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b740ffda0 0x7f5b741977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.798+0000 7f5b7259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b740ffda0 0x7f5b741977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33344/0 (socket says 172.21.15.2:33344) 2024-09-13T23:04:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.798+0000 7f5b7259c700 1 -- 172.21.15.2:0/151846344 learned_addr learned my addr 172.21.15.2:0/151846344 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:04:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.798+0000 7f5b71d9b700 1 --2- 172.21.15.2:0/151846344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b74100750 0x7f5b74197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.799+0000 7f5b7259c700 1 -- 172.21.15.2:0/151846344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b74100750 msgr2=0x7f5b74197ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.799+0000 7f5b7259c700 1 --2- 172.21.15.2:0/151846344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b74100750 0x7f5b74197ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.799+0000 7f5b7259c700 1 -- 172.21.15.2:0/151846344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b680095f0 con 0x7f5b740ffda0 2024-09-13T23:04:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.799+0000 7f5b71d9b700 1 --2- 172.21.15.2:0/151846344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b74100750 0x7f5b74197ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T23:04:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.799+0000 7f5b7259c700 1 --2- 172.21.15.2:0/151846344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b740ffda0 0x7f5b741977a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400d8d0 tx=0x7f5b6400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.799+0000 7f5b637fe700 1 -- 172.21.15.2:0/151846344 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b640098a0 con 0x7f5b740ffda0 2024-09-13T23:04:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.799+0000 7f5b637fe700 1 -- 172.21.15.2:0/151846344 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b64010460 con 0x7f5b740ffda0 2024-09-13T23:04:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.799+0000 7f5b78887700 1 -- 172.21.15.2:0/151846344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b741a0810 con 0x7f5b740ffda0 2024-09-13T23:04:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.799+0000 7f5b637fe700 1 -- 172.21.15.2:0/151846344 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b6400f5f0 con 0x7f5b740ffda0 2024-09-13T23:04:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.799+0000 7f5b78887700 1 -- 172.21.15.2:0/151846344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b741a0cd0 con 0x7f5b740ffda0 2024-09-13T23:04:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.800+0000 7f5b78887700 1 -- 172.21.15.2:0/151846344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b741081a0 con 0x7f5b740ffda0 2024-09-13T23:04:16.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.801+0000 7f5b637fe700 1 -- 172.21.15.2:0/151846344 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f5b64009a00 con 0x7f5b740ffda0 2024-09-13T23:04:16.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.801+0000 7f5b637fe700 1 --2- 172.21.15.2:0/151846344 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f5b5c06e680 0x7f5b5c070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:16.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.801+0000 7f5b637fe700 1 -- 172.21.15.2:0/151846344 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f5b6408e4a0 con 0x7f5b740ffda0 2024-09-13T23:04:16.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.802+0000 7f5b71d9b700 1 --2- 172.21.15.2:0/151846344 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f5b5c06e680 0x7f5b5c070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:16.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.802+0000 7f5b71d9b700 1 --2- 172.21.15.2:0/151846344 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f5b5c06e680 0x7f5b5c070b40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5b68006010 tx=0x7f5b6801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:16.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:16.806+0000 7f5b637fe700 1 -- 172.21.15.2:0/151846344 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5b640576f0 con 0x7f5b740ffda0 2024-09-13T23:04:16.912 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:16 smithi047 podman[100796]: 2024-09-13 23:04:16.472319594 +0000 UTC m=+0.394000613 container init e6695470bcdd7b0f43af1397295723fd81ccbd02229e39af05ac58f4ffefae10 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-13T23:04:16.913 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:16 smithi047 podman[100796]: 2024-09-13 23:04:16.475807716 +0000 UTC m=+0.397488735 container start e6695470bcdd7b0f43af1397295723fd81ccbd02229e39af05ac58f4ffefae10 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T23:04:16.913 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:16 smithi047 podman[100796]: 2024-09-13 23:04:16.555687311 +0000 UTC m=+0.477368330 container attach e6695470bcdd7b0f43af1397295723fd81ccbd02229e39af05ac58f4ffefae10 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:04:16.913 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:16 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-activate[100811]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:04:16.913 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:16 smithi047 bash[100796]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:04:16.913 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:16 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-activate[100811]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:04:16.913 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:16 smithi047 bash[100796]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T23:04:17.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.035+0000 7f5b78887700 1 -- 172.21.15.2:0/151846344 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b740611d0 con 0x7f5b5c06e680 2024-09-13T23:04:17.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.036+0000 7f5b637fe700 1 -- 172.21.15.2:0/151846344 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f5b740611d0 con 0x7f5b5c06e680 2024-09-13T23:04:17.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.039+0000 7f5b78887700 1 -- 172.21.15.2:0/151846344 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f5b5c06e680 msgr2=0x7f5b5c070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.039+0000 7f5b78887700 1 --2- 172.21.15.2:0/151846344 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f5b5c06e680 0x7f5b5c070b40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5b68006010 tx=0x7f5b6801a040 comp rx=0 tx=0).stop 2024-09-13T23:04:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.039+0000 7f5b78887700 1 -- 172.21.15.2:0/151846344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b740ffda0 msgr2=0x7f5b741977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.039+0000 7f5b78887700 1 --2- 172.21.15.2:0/151846344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b740ffda0 0x7f5b741977a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400d8d0 tx=0x7f5b6400dbe0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.039+0000 7f5b78887700 1 -- 172.21.15.2:0/151846344 shutdown_connections 2024-09-13T23:04:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.039+0000 7f5b78887700 1 --2- 172.21.15.2:0/151846344 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f5b5c06e680 0x7f5b5c070b40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.039+0000 7f5b78887700 1 --2- 172.21.15.2:0/151846344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b740ffda0 0x7f5b741977a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.039+0000 7f5b78887700 1 --2- 172.21.15.2:0/151846344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b74100750 0x7f5b74197ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.039+0000 7f5b78887700 1 -- 172.21.15.2:0/151846344 >> 172.21.15.2:0/151846344 conn(0x7f5b740fb650 msgr2=0x7f5b740fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.039+0000 7f5b78887700 1 -- 172.21.15.2:0/151846344 shutdown_connections 2024-09-13T23:04:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.039+0000 7f5b78887700 1 -- 172.21.15.2:0/151846344 wait complete. 2024-09-13T23:04:17.050 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T23:04:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.147+0000 7efe6b3e4700 1 -- 172.21.15.2:0/513411357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe640fff50 msgr2=0x7efe64105840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.147+0000 7efe6b3e4700 1 --2- 172.21.15.2:0/513411357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe640fff50 0x7efe64105840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efe54009910 tx=0x7efe54009c20 comp rx=0 tx=0).stop 2024-09-13T23:04:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.147+0000 7efe6b3e4700 1 -- 172.21.15.2:0/513411357 shutdown_connections 2024-09-13T23:04:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.147+0000 7efe6b3e4700 1 --2- 172.21.15.2:0/513411357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe640fff50 0x7efe64105840 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.147+0000 7efe6b3e4700 1 --2- 172.21.15.2:0/513411357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe640ff5a0 0x7efe640ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.147+0000 7efe6b3e4700 1 -- 172.21.15.2:0/513411357 >> 172.21.15.2:0/513411357 conn(0x7efe64074e30 msgr2=0x7efe64075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.147+0000 7efe6b3e4700 1 -- 172.21.15.2:0/513411357 shutdown_connections 2024-09-13T23:04:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.148+0000 7efe6b3e4700 1 -- 172.21.15.2:0/513411357 wait complete. 2024-09-13T23:04:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.148+0000 7efe6b3e4700 1 Processor -- start 2024-09-13T23:04:17.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.148+0000 7efe6b3e4700 1 -- start start 2024-09-13T23:04:17.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.148+0000 7efe6b3e4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe640ff5a0 0x7efe6419e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:17.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.148+0000 7efe6b3e4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe640fff50 0x7efe6419edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:17.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.148+0000 7efe6b3e4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6419f450 con 0x7efe640ff5a0 2024-09-13T23:04:17.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.148+0000 7efe6b3e4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe64198900 con 0x7efe640fff50 2024-09-13T23:04:17.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.148+0000 7efe69180700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe640ff5a0 0x7efe6419e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:17.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.149+0000 7efe69180700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe640ff5a0 0x7efe6419e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33354/0 (socket says 172.21.15.2:33354) 2024-09-13T23:04:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.149+0000 7efe69180700 1 -- 172.21.15.2:0/2820426828 learned_addr learned my addr 172.21.15.2:0/2820426828 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:04:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.149+0000 7efe6897f700 1 --2- 172.21.15.2:0/2820426828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe640fff50 0x7efe6419edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.149+0000 7efe69180700 1 -- 172.21.15.2:0/2820426828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe640fff50 msgr2=0x7efe6419edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.149+0000 7efe69180700 1 --2- 172.21.15.2:0/2820426828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe640fff50 0x7efe6419edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.149+0000 7efe69180700 1 -- 172.21.15.2:0/2820426828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe540095f0 con 0x7efe640ff5a0 2024-09-13T23:04:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.149+0000 7efe69180700 1 --2- 172.21.15.2:0/2820426828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe640ff5a0 0x7efe6419e880 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efe6000c8a0 tx=0x7efe6000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.149+0000 7efe5a7fc700 1 -- 172.21.15.2:0/2820426828 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe600078e0 con 0x7efe640ff5a0 2024-09-13T23:04:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.149+0000 7efe5a7fc700 1 -- 172.21.15.2:0/2820426828 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe6000f450 con 0x7efe640ff5a0 2024-09-13T23:04:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.149+0000 7efe5a7fc700 1 -- 172.21.15.2:0/2820426828 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe6000e5e0 con 0x7efe640ff5a0 2024-09-13T23:04:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.149+0000 7efe6b3e4700 1 -- 172.21.15.2:0/2820426828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe64198be0 con 0x7efe640ff5a0 2024-09-13T23:04:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.149+0000 7efe6b3e4700 1 -- 172.21.15.2:0/2820426828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe64199100 con 0x7efe640ff5a0 2024-09-13T23:04:17.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.150+0000 7efe6b3e4700 1 -- 172.21.15.2:0/2820426828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe64104fc0 con 0x7efe640ff5a0 2024-09-13T23:04:17.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.151+0000 7efe5a7fc700 1 -- 172.21.15.2:0/2820426828 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7efe6000f5c0 con 0x7efe640ff5a0 2024-09-13T23:04:17.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.151+0000 7efe5a7fc700 1 --2- 172.21.15.2:0/2820426828 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7efe5006e680 0x7efe50070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:17.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.151+0000 7efe5a7fc700 1 -- 172.21.15.2:0/2820426828 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6156+0+0 (secure 0 0 0) 0x7efe6008e440 con 0x7efe640ff5a0 2024-09-13T23:04:17.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.152+0000 7efe6897f700 1 --2- 172.21.15.2:0/2820426828 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7efe5006e680 0x7efe50070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:17.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.152+0000 7efe6897f700 1 --2- 172.21.15.2:0/2820426828 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7efe5006e680 0x7efe50070b40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe54006010 tx=0x7efe5401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:17.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.156+0000 7efe5a7fc700 1 -- 172.21.15.2:0/2820426828 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efe6005b240 con 0x7efe640ff5a0 2024-09-13T23:04:17.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.384+0000 7efe6b3e4700 1 -- 172.21.15.2:0/2820426828 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe641993d0 con 0x7efe5006e680 2024-09-13T23:04:17.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.385+0000 7efe5a7fc700 1 -- 172.21.15.2:0/2820426828 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7efe641993d0 con 0x7efe5006e680 2024-09-13T23:04:17.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.387+0000 7efe6b3e4700 1 -- 172.21.15.2:0/2820426828 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7efe5006e680 msgr2=0x7efe50070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:17.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.387+0000 7efe6b3e4700 1 --2- 172.21.15.2:0/2820426828 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7efe5006e680 0x7efe50070b40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe54006010 tx=0x7efe5401a040 comp rx=0 tx=0).stop 2024-09-13T23:04:17.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.387+0000 7efe6b3e4700 1 -- 172.21.15.2:0/2820426828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe640ff5a0 msgr2=0x7efe6419e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:17.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.387+0000 7efe6b3e4700 1 --2- 172.21.15.2:0/2820426828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe640ff5a0 0x7efe6419e880 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efe6000c8a0 tx=0x7efe6000cbb0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.388+0000 7efe6b3e4700 1 -- 172.21.15.2:0/2820426828 shutdown_connections 2024-09-13T23:04:17.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.388+0000 7efe6b3e4700 1 --2- 172.21.15.2:0/2820426828 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7efe5006e680 0x7efe50070b40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.388+0000 7efe6b3e4700 1 --2- 172.21.15.2:0/2820426828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe640ff5a0 0x7efe6419e880 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.388+0000 7efe6b3e4700 1 --2- 172.21.15.2:0/2820426828 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe640fff50 0x7efe6419edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.388+0000 7efe6b3e4700 1 -- 172.21.15.2:0/2820426828 >> 172.21.15.2:0/2820426828 conn(0x7efe64074e30 msgr2=0x7efe640fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:17.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.388+0000 7efe6b3e4700 1 -- 172.21.15.2:0/2820426828 shutdown_connections 2024-09-13T23:04:17.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.388+0000 7efe6b3e4700 1 -- 172.21.15.2:0/2820426828 wait complete. 2024-09-13T23:04:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.495+0000 7f409fe88700 1 -- 172.21.15.2:0/1669746208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40980fff50 msgr2=0x7f4098105840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.495+0000 7f409fe88700 1 --2- 172.21.15.2:0/1669746208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40980fff50 0x7f4098105840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4088009910 tx=0x7f4088009c20 comp rx=0 tx=0).stop 2024-09-13T23:04:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.496+0000 7f409fe88700 1 -- 172.21.15.2:0/1669746208 shutdown_connections 2024-09-13T23:04:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.496+0000 7f409fe88700 1 --2- 172.21.15.2:0/1669746208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40980fff50 0x7f4098105840 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.496+0000 7f409fe88700 1 --2- 172.21.15.2:0/1669746208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40980ff5a0 0x7f40980ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.496+0000 7f409fe88700 1 -- 172.21.15.2:0/1669746208 >> 172.21.15.2:0/1669746208 conn(0x7f4098074e30 msgr2=0x7f4098075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.496+0000 7f409fe88700 1 -- 172.21.15.2:0/1669746208 shutdown_connections 2024-09-13T23:04:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.496+0000 7f409fe88700 1 -- 172.21.15.2:0/1669746208 wait complete. 2024-09-13T23:04:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.496+0000 7f409fe88700 1 Processor -- start 2024-09-13T23:04:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.496+0000 7f409fe88700 1 -- start start 2024-09-13T23:04:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.497+0000 7f409fe88700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40980ff5a0 0x7f409819c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.497+0000 7f409fe88700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40980fff50 0x7f409819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.497+0000 7f409fe88700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409819d240 con 0x7f40980fff50 2024-09-13T23:04:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.497+0000 7f409fe88700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40981966f0 con 0x7f40980ff5a0 2024-09-13T23:04:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.497+0000 7f409d423700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40980fff50 0x7f409819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.497+0000 7f409d423700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40980fff50 0x7f409819cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33376/0 (socket says 172.21.15.2:33376) 2024-09-13T23:04:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.497+0000 7f409d423700 1 -- 172.21.15.2:0/2556660275 learned_addr learned my addr 172.21.15.2:0/2556660275 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:04:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.497+0000 7f409dc24700 1 --2- 172.21.15.2:0/2556660275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40980ff5a0 0x7f409819c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.497+0000 7f409d423700 1 -- 172.21.15.2:0/2556660275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40980ff5a0 msgr2=0x7f409819c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.497+0000 7f409d423700 1 --2- 172.21.15.2:0/2556660275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40980ff5a0 0x7f409819c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.497+0000 7f409d423700 1 -- 172.21.15.2:0/2556660275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40880095f0 con 0x7f40980fff50 2024-09-13T23:04:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.497+0000 7f409dc24700 1 --2- 172.21.15.2:0/2556660275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40980ff5a0 0x7f409819c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:04:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.497+0000 7f409d423700 1 --2- 172.21.15.2:0/2556660275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40980fff50 0x7f409819cbb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f40880092e0 tx=0x7f408800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.497+0000 7f408effd700 1 -- 172.21.15.2:0/2556660275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f408801d070 con 0x7f40980fff50 2024-09-13T23:04:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.497+0000 7f409fe88700 1 -- 172.21.15.2:0/2556660275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4098196970 con 0x7f40980fff50 2024-09-13T23:04:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.497+0000 7f408effd700 1 -- 172.21.15.2:0/2556660275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f408800f460 con 0x7f40980fff50 2024-09-13T23:04:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.497+0000 7f408effd700 1 -- 172.21.15.2:0/2556660275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40880175f0 con 0x7f40980fff50 2024-09-13T23:04:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.498+0000 7f409fe88700 1 -- 172.21.15.2:0/2556660275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4098196e60 con 0x7f40980fff50 2024-09-13T23:04:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.498+0000 7f409fe88700 1 -- 172.21.15.2:0/2556660275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4098109200 con 0x7f40980fff50 2024-09-13T23:04:17.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.499+0000 7f408effd700 1 -- 172.21.15.2:0/2556660275 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f408800f5d0 con 0x7f40980fff50 2024-09-13T23:04:17.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.499+0000 7f408effd700 1 --2- 172.21.15.2:0/2556660275 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f408406e680 0x7f4084070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:17.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.500+0000 7f408effd700 1 -- 172.21.15.2:0/2556660275 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f408808fae0 con 0x7f40980fff50 2024-09-13T23:04:17.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.500+0000 7f409dc24700 1 --2- 172.21.15.2:0/2556660275 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f408406e680 0x7f4084070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:17.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.500+0000 7f409dc24700 1 --2- 172.21.15.2:0/2556660275 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f408406e680 0x7f4084070b40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4094005fd0 tx=0x7f4094005dc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.504+0000 7f408effd700 1 -- 172.21.15.2:0/2556660275 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f408805c860 con 0x7f40980fff50 2024-09-13T23:04:17.642 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:17 smithi047 ceph-mon[81243]: pgmap v154: 65 pgs: 7 active+undersized, 7 peering, 3 stale+active+clean, 4 active+undersized+degraded, 44 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 7/264 objects degraded (2.652%) 2024-09-13T23:04:17.642 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:17 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-activate[100811]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T23:04:17.642 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:17 smithi047 bash[100796]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T23:04:17.642 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:17 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-activate[100811]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T23:04:17.643 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:17 smithi047 bash[100796]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T23:04:17.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.721+0000 7f409fe88700 1 -- 172.21.15.2:0/2556660275 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4098197080 con 0x7f408406e680 2024-09-13T23:04:17.723 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:17 smithi002 ceph-mon[111294]: pgmap v154: 65 pgs: 7 active+undersized, 7 peering, 3 stale+active+clean, 4 active+undersized+degraded, 44 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 7/264 objects degraded (2.652%) 2024-09-13T23:04:17.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.731+0000 7f408effd700 1 -- 172.21.15.2:0/2556660275 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f4098197080 con 0x7f408406e680 2024-09-13T23:04:17.732 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:04:17.732 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (5m) 94s ago 16m 27.0M - 0.25.0 c8568f914cd2 f570a73274bc 2024-09-13T23:04:17.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (16m) 94s ago 16m 8548k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T23:04:17.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (15m) 28s ago 15m 8446k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T23:04:17.732 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (3m) 94s ago 16m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 427cd38a7d88 2024-09-13T23:04:17.733 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (3m) 28s ago 15m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 ce5a1df96005 2024-09-13T23:04:17.733 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (5m) 94s ago 16m 80.3M - 9.4.12 2bacad6d85d8 650673516b69 2024-09-13T23:04:17.733 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (11m) 94s ago 11m 17.3M - 18.2.1 5be31c24972a 59e9c88c31ca 2024-09-13T23:04:17.733 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (11m) 94s ago 10m 91.1M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T23:04:17.733 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (11m) 28s ago 11m 150M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T23:04:17.733 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (10m) 28s ago 10m 20.0M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T23:04:17.733 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 running (7m) 94s ago 17m 499M - 19.1.1-324-gecab7be5 0652ff2b5d78 7a8aa9de37e4 2024-09-13T23:04:17.733 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (6m) 28s ago 15m 441M - 19.1.1-324-gecab7be5 0652ff2b5d78 13fa6f3b5a8a 2024-09-13T23:04:17.733 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (4m) 94s ago 18m 49.2M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 db0ef6c509cf 2024-09-13T23:04:17.733 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (3m) 28s ago 15m 40.1M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 ea0c2a2e0e1a 2024-09-13T23:04:17.733 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (6m) 94s ago 16m 15.0M - 1.5.0 0da6a335fe13 f3eae5f90ab8 2024-09-13T23:04:17.733 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (6m) 28s ago 15m 15.6M - 1.5.0 0da6a335fe13 a5c7d7f1eaa5 2024-09-13T23:04:17.733 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (2m) 94s ago 14m 84.5M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 0ca6dd66fa68 2024-09-13T23:04:17.734 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (2m) 94s ago 14m 86.5M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 6f5ae2cfa818 2024-09-13T23:04:17.734 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (100s) 94s ago 13m 11.9M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 15b9e8db7556 2024-09-13T23:04:17.734 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (64s) 28s ago 13m 102M 2241M 19.1.1-324-gecab7be5 0652ff2b5d78 de54fd3fea34 2024-09-13T23:04:17.734 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (32s) 28s ago 13m 11.2M 2241M 19.1.1-324-gecab7be5 0652ff2b5d78 185d7ae7181b 2024-09-13T23:04:17.734 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (12m) 28s ago 12m 197M 2241M 18.2.1 5be31c24972a ab35ed98725d 2024-09-13T23:04:17.734 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (6m) 94s ago 16m 71.7M - 2.43.0 a07b618ecd1d aa241d1048de 2024-09-13T23:04:17.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.733+0000 7f409fe88700 1 -- 172.21.15.2:0/2556660275 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f408406e680 msgr2=0x7f4084070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:17.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.733+0000 7f409fe88700 1 --2- 172.21.15.2:0/2556660275 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f408406e680 0x7f4084070b40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4094005fd0 tx=0x7f4094005dc0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.733+0000 7f409fe88700 1 -- 172.21.15.2:0/2556660275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40980fff50 msgr2=0x7f409819cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:17.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.733+0000 7f409fe88700 1 --2- 172.21.15.2:0/2556660275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40980fff50 0x7f409819cbb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f40880092e0 tx=0x7f408800be20 comp rx=0 tx=0).stop 2024-09-13T23:04:17.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.733+0000 7f409fe88700 1 -- 172.21.15.2:0/2556660275 shutdown_connections 2024-09-13T23:04:17.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.733+0000 7f409fe88700 1 --2- 172.21.15.2:0/2556660275 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f408406e680 0x7f4084070b40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.733+0000 7f409fe88700 1 --2- 172.21.15.2:0/2556660275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40980ff5a0 0x7f409819c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.733+0000 7f409fe88700 1 --2- 172.21.15.2:0/2556660275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40980fff50 0x7f409819cbb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.733+0000 7f409fe88700 1 -- 172.21.15.2:0/2556660275 >> 172.21.15.2:0/2556660275 conn(0x7f4098074e30 msgr2=0x7f40980fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:17.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.733+0000 7f409fe88700 1 -- 172.21.15.2:0/2556660275 shutdown_connections 2024-09-13T23:04:17.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.734+0000 7f409fe88700 1 -- 172.21.15.2:0/2556660275 wait complete. 2024-09-13T23:04:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.840+0000 7fd03b7f9700 1 -- 172.21.15.2:0/2178600413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd034100020 msgr2=0x7fd034103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.840+0000 7fd03b7f9700 1 --2- 172.21.15.2:0/2178600413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd034100020 0x7fd034103f10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd024009910 tx=0x7fd024009c20 comp rx=0 tx=0).stop 2024-09-13T23:04:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.840+0000 7fd03b7f9700 1 -- 172.21.15.2:0/2178600413 shutdown_connections 2024-09-13T23:04:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.840+0000 7fd03b7f9700 1 --2- 172.21.15.2:0/2178600413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd034100020 0x7fd034103f10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.840+0000 7fd03b7f9700 1 --2- 172.21.15.2:0/2178600413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0340ff670 0x7fd0340ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.840+0000 7fd03b7f9700 1 -- 172.21.15.2:0/2178600413 >> 172.21.15.2:0/2178600413 conn(0x7fd034074e30 msgr2=0x7fd034075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:17.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.840+0000 7fd03b7f9700 1 -- 172.21.15.2:0/2178600413 shutdown_connections 2024-09-13T23:04:17.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.840+0000 7fd03b7f9700 1 -- 172.21.15.2:0/2178600413 wait complete. 2024-09-13T23:04:17.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.841+0000 7fd03b7f9700 1 Processor -- start 2024-09-13T23:04:17.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.841+0000 7fd03b7f9700 1 -- start start 2024-09-13T23:04:17.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.841+0000 7fd03b7f9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0340ff670 0x7fd03419c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:17.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.841+0000 7fd03b7f9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd034100020 0x7fd03419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:17.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.841+0000 7fd03b7f9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03419d1f0 con 0x7fd0340ff670 2024-09-13T23:04:17.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.841+0000 7fd03b7f9700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0341966a0 con 0x7fd034100020 2024-09-13T23:04:17.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.841+0000 7fd039595700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0340ff670 0x7fd03419c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:17.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.841+0000 7fd039595700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0340ff670 0x7fd03419c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33404/0 (socket says 172.21.15.2:33404) 2024-09-13T23:04:17.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.841+0000 7fd039595700 1 -- 172.21.15.2:0/1524413185 learned_addr learned my addr 172.21.15.2:0/1524413185 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:04:17.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.841+0000 7fd038d94700 1 --2- 172.21.15.2:0/1524413185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd034100020 0x7fd03419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:17.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.842+0000 7fd039595700 1 -- 172.21.15.2:0/1524413185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd034100020 msgr2=0x7fd03419cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:17.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.842+0000 7fd039595700 1 --2- 172.21.15.2:0/1524413185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd034100020 0x7fd03419cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:17.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.842+0000 7fd039595700 1 -- 172.21.15.2:0/1524413185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0240095f0 con 0x7fd0340ff670 2024-09-13T23:04:17.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.842+0000 7fd039595700 1 --2- 172.21.15.2:0/1524413185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0340ff670 0x7fd03419c620 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd03000db60 tx=0x7fd03000de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:17.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.842+0000 7fd02a7fc700 1 -- 172.21.15.2:0/1524413185 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd030007c30 con 0x7fd0340ff670 2024-09-13T23:04:17.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.842+0000 7fd02a7fc700 1 -- 172.21.15.2:0/1524413185 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd0300044e0 con 0x7fd0340ff670 2024-09-13T23:04:17.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.842+0000 7fd03b7f9700 1 -- 172.21.15.2:0/1524413185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd034196980 con 0x7fd0340ff670 2024-09-13T23:04:17.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.842+0000 7fd02a7fc700 1 -- 172.21.15.2:0/1524413185 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd030005250 con 0x7fd0340ff670 2024-09-13T23:04:17.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.842+0000 7fd03b7f9700 1 -- 172.21.15.2:0/1524413185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd034196ed0 con 0x7fd0340ff670 2024-09-13T23:04:17.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.843+0000 7fd03b7f9700 1 -- 172.21.15.2:0/1524413185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd034109920 con 0x7fd0340ff670 2024-09-13T23:04:17.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.844+0000 7fd02a7fc700 1 -- 172.21.15.2:0/1524413185 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fd0300054b0 con 0x7fd0340ff670 2024-09-13T23:04:17.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.844+0000 7fd02a7fc700 1 --2- 172.21.15.2:0/1524413185 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fd02006e680 0x7fd020070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:17.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.844+0000 7fd02a7fc700 1 -- 172.21.15.2:0/1524413185 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd03008e340 con 0x7fd0340ff670 2024-09-13T23:04:17.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.844+0000 7fd038d94700 1 --2- 172.21.15.2:0/1524413185 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fd02006e680 0x7fd020070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:17.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.845+0000 7fd038d94700 1 --2- 172.21.15.2:0/1524413185 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fd02006e680 0x7fd020070b40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd034105eb0 tx=0x7fd02401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:17.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:17.849+0000 7fd02a7fc700 1 -- 172.21.15.2:0/1524413185 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd03005b140 con 0x7fd0340ff670 2024-09-13T23:04:17.913 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:17 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-activate[100811]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T23:04:17.913 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:17 smithi047 bash[100796]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T23:04:17.913 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:17 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-activate[100811]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T23:04:17.913 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:17 smithi047 bash[100796]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T23:04:17.913 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:17 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-activate[100811]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T23:04:17.913 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:17 smithi047 bash[100796]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T23:04:17.913 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:17 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-activate[100811]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T23:04:17.913 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:17 smithi047 bash[100796]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T23:04:17.913 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:17 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-activate[100811]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T23:04:17.913 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:17 smithi047 bash[100796]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T23:04:17.913 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:17 smithi047 podman[100796]: 2024-09-13 23:04:17.671094386 +0000 UTC m=+1.592775405 container died e6695470bcdd7b0f43af1397295723fd81ccbd02229e39af05ac58f4ffefae10 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-13T23:04:18.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.149+0000 7fd03b7f9700 1 -- 172.21.15.2:0/1524413185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd034197cb0 con 0x7fd0340ff670 2024-09-13T23:04:18.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.149+0000 7fd02a7fc700 1 -- 172.21.15.2:0/1524413185 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+708 (secure 0 0 0) 0x7fd034197cb0 con 0x7fd0340ff670 2024-09-13T23:04:18.150 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:04:18.150 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T23:04:18.150 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:04:18.151 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:04:18.151 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T23:04:18.151 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:04:18.151 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:04:18.151 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T23:04:18.151 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 5 2024-09-13T23:04:18.151 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:04:18.151 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T23:04:18.151 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-09-13T23:04:18.151 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:04:18.151 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T23:04:18.151 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4, 2024-09-13T23:04:18.151 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 9 2024-09-13T23:04:18.152 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T23:04:18.152 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:04:18.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.151+0000 7fd03b7f9700 1 -- 172.21.15.2:0/1524413185 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fd02006e680 msgr2=0x7fd020070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:18.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.151+0000 7fd03b7f9700 1 --2- 172.21.15.2:0/1524413185 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fd02006e680 0x7fd020070b40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd034105eb0 tx=0x7fd02401a040 comp rx=0 tx=0).stop 2024-09-13T23:04:18.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.151+0000 7fd03b7f9700 1 -- 172.21.15.2:0/1524413185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0340ff670 msgr2=0x7fd03419c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:18.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.151+0000 7fd03b7f9700 1 --2- 172.21.15.2:0/1524413185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0340ff670 0x7fd03419c620 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd03000db60 tx=0x7fd03000de70 comp rx=0 tx=0).stop 2024-09-13T23:04:18.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.151+0000 7fd03b7f9700 1 -- 172.21.15.2:0/1524413185 shutdown_connections 2024-09-13T23:04:18.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.152+0000 7fd03b7f9700 1 --2- 172.21.15.2:0/1524413185 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fd02006e680 0x7fd020070b40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.152+0000 7fd03b7f9700 1 --2- 172.21.15.2:0/1524413185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0340ff670 0x7fd03419c620 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.152+0000 7fd03b7f9700 1 --2- 172.21.15.2:0/1524413185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd034100020 0x7fd03419cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.152+0000 7fd03b7f9700 1 -- 172.21.15.2:0/1524413185 >> 172.21.15.2:0/1524413185 conn(0x7fd034074e30 msgr2=0x7fd0340fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:18.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.152+0000 7fd03b7f9700 1 -- 172.21.15.2:0/1524413185 shutdown_connections 2024-09-13T23:04:18.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.152+0000 7fd03b7f9700 1 -- 172.21.15.2:0/1524413185 wait complete. 2024-09-13T23:04:18.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.259+0000 7fe090292700 1 -- 172.21.15.2:0/2863686270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088101840 msgr2=0x7fe088105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:18.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.259+0000 7fe090292700 1 --2- 172.21.15.2:0/2863686270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088101840 0x7fe088105890 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe078009910 tx=0x7fe078009c20 comp rx=0 tx=0).stop 2024-09-13T23:04:18.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.260+0000 7fe090292700 1 -- 172.21.15.2:0/2863686270 shutdown_connections 2024-09-13T23:04:18.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.260+0000 7fe090292700 1 --2- 172.21.15.2:0/2863686270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088101840 0x7fe088105890 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.260+0000 7fe090292700 1 --2- 172.21.15.2:0/2863686270 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe088100e90 0x7fe088101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.260+0000 7fe090292700 1 -- 172.21.15.2:0/2863686270 >> 172.21.15.2:0/2863686270 conn(0x7fe0880fc740 msgr2=0x7fe0880feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:18.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.260+0000 7fe090292700 1 -- 172.21.15.2:0/2863686270 shutdown_connections 2024-09-13T23:04:18.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.260+0000 7fe090292700 1 -- 172.21.15.2:0/2863686270 wait complete. 2024-09-13T23:04:18.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.260+0000 7fe090292700 1 Processor -- start 2024-09-13T23:04:18.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.260+0000 7fe090292700 1 -- start start 2024-09-13T23:04:18.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.261+0000 7fe090292700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088100e90 0x7fe08819c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:18.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.261+0000 7fe090292700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe088101840 0x7fe08819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:18.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.261+0000 7fe090292700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08819d2e0 con 0x7fe088100e90 2024-09-13T23:04:18.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.261+0000 7fe090292700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe088196790 con 0x7fe088101840 2024-09-13T23:04:18.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.261+0000 7fe08e02e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088100e90 0x7fe08819c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:18.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.261+0000 7fe08e02e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088100e90 0x7fe08819c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33432/0 (socket says 172.21.15.2:33432) 2024-09-13T23:04:18.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.261+0000 7fe08e02e700 1 -- 172.21.15.2:0/937922219 learned_addr learned my addr 172.21.15.2:0/937922219 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:04:18.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.261+0000 7fe08d82d700 1 --2- 172.21.15.2:0/937922219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe088101840 0x7fe08819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:18.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.261+0000 7fe08e02e700 1 -- 172.21.15.2:0/937922219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe088101840 msgr2=0x7fe08819cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:18.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.261+0000 7fe08e02e700 1 --2- 172.21.15.2:0/937922219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe088101840 0x7fe08819cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.261+0000 7fe08e02e700 1 -- 172.21.15.2:0/937922219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0780095f0 con 0x7fe088100e90 2024-09-13T23:04:18.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.261+0000 7fe08e02e700 1 --2- 172.21.15.2:0/937922219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088100e90 0x7fe08819c710 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe08400d8d0 tx=0x7fe08400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:18.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.261+0000 7fe07f7fe700 1 -- 172.21.15.2:0/937922219 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0840098a0 con 0x7fe088100e90 2024-09-13T23:04:18.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.261+0000 7fe07f7fe700 1 -- 172.21.15.2:0/937922219 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe084010460 con 0x7fe088100e90 2024-09-13T23:04:18.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.262+0000 7fe07f7fe700 1 -- 172.21.15.2:0/937922219 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe08400f5f0 con 0x7fe088100e90 2024-09-13T23:04:18.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.262+0000 7fe090292700 1 -- 172.21.15.2:0/937922219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe088196a70 con 0x7fe088100e90 2024-09-13T23:04:18.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.262+0000 7fe090292700 1 -- 172.21.15.2:0/937922219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe088196fc0 con 0x7fe088100e90 2024-09-13T23:04:18.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.263+0000 7fe090292700 1 -- 172.21.15.2:0/937922219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe088109290 con 0x7fe088100e90 2024-09-13T23:04:18.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.263+0000 7fe07f7fe700 1 -- 172.21.15.2:0/937922219 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fe084009a00 con 0x7fe088100e90 2024-09-13T23:04:18.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.264+0000 7fe07f7fe700 1 --2- 172.21.15.2:0/937922219 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fe07406e680 0x7fe074070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:18.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.264+0000 7fe07f7fe700 1 -- 172.21.15.2:0/937922219 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe08408e3a0 con 0x7fe088100e90 2024-09-13T23:04:18.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.264+0000 7fe08d82d700 1 --2- 172.21.15.2:0/937922219 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fe07406e680 0x7fe074070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:18.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.264+0000 7fe08d82d700 1 --2- 172.21.15.2:0/937922219 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fe07406e680 0x7fe074070b40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe088197c00 tx=0x7fe07801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:18.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.268+0000 7fe07f7fe700 1 -- 172.21.15.2:0/937922219 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe08405b1a0 con 0x7fe088100e90 2024-09-13T23:04:18.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:18 smithi002 ceph-mon[111294]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:18.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:18 smithi002 ceph-mon[111294]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:18.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:18 smithi002 ceph-mon[111294]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:18.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:18 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/1524413185' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:18.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.525+0000 7fe090292700 1 -- 172.21.15.2:0/937922219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe08804f2e0 con 0x7fe088100e90 2024-09-13T23:04:18.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.526+0000 7fe07f7fe700 1 -- 172.21.15.2:0/937922219 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1938 (secure 0 0 0) 0x7fe08405ad30 con 0x7fe088100e90 2024-09-13T23:04:18.527 INFO:teuthology.orchestra.run.smithi002.stdout:e16 2024-09-13T23:04:18.527 INFO:teuthology.orchestra.run.smithi002.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T23:04:18.527 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:04:18.527 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:04:18.527 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-13T23:04:18.527 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:04:18.527 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:04:18.527 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-13T23:04:18.527 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 16 2024-09-13T23:04:18.527 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:04:18.527 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-13T22:53:05.963265+0000 2024-09-13T23:04:18.527 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-13T22:53:25.072026+0000 2024-09-13T23:04:18.528 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-13T23:04:18.528 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-13T23:04:18.528 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-13T23:04:18.528 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-13T23:04:18.528 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-13T23:04:18.528 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-13T23:04:18.528 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-13T23:04:18.528 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-13T23:04:18.528 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 47 2024-09-13T23:04:18.528 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:04:18.528 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 1 2024-09-13T23:04:18.528 INFO:teuthology.orchestra.run.smithi002.stdout:in 0 2024-09-13T23:04:18.528 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24267} 2024-09-13T23:04:18.529 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-13T23:04:18.529 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-13T23:04:18.529 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-13T23:04:18.529 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-13T23:04:18.529 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-13T23:04:18.529 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-13T23:04:18.529 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-13T23:04:18.529 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-13T23:04:18.529 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-13T23:04:18.529 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 0 members: 2024-09-13T23:04:18.529 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.gxzkha{0:24267} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:04:18.529 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.gglyyr{0:14488} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.2:6828/2123560657,v1:172.21.15.2:6829/2123560657] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:04:18.529 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:04:18.529 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:04:18.530 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-13T23:04:18.530 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:04:18.530 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.auedll{-1:14500} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/1577962179,v1:172.21.15.2:6827/1577962179] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:04:18.530 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.nqvveh{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:04:18.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.529+0000 7fe090292700 1 -- 172.21.15.2:0/937922219 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fe07406e680 msgr2=0x7fe074070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.529+0000 7fe090292700 1 --2- 172.21.15.2:0/937922219 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fe07406e680 0x7fe074070b40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe088197c00 tx=0x7fe07801a040 comp rx=0 tx=0).stop 2024-09-13T23:04:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.529+0000 7fe090292700 1 -- 172.21.15.2:0/937922219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088100e90 msgr2=0x7fe08819c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.529+0000 7fe090292700 1 --2- 172.21.15.2:0/937922219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088100e90 0x7fe08819c710 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe08400d8d0 tx=0x7fe08400dbe0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.529+0000 7fe090292700 1 -- 172.21.15.2:0/937922219 shutdown_connections 2024-09-13T23:04:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.529+0000 7fe090292700 1 --2- 172.21.15.2:0/937922219 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fe07406e680 0x7fe074070b40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.529+0000 7fe090292700 1 --2- 172.21.15.2:0/937922219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe088100e90 0x7fe08819c710 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.529+0000 7fe090292700 1 --2- 172.21.15.2:0/937922219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe088101840 0x7fe08819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.529+0000 7fe090292700 1 -- 172.21.15.2:0/937922219 >> 172.21.15.2:0/937922219 conn(0x7fe0880fc740 msgr2=0x7fe0880fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.529+0000 7fe090292700 1 -- 172.21.15.2:0/937922219 shutdown_connections 2024-09-13T23:04:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.529+0000 7fe090292700 1 -- 172.21.15.2:0/937922219 wait complete. 2024-09-13T23:04:18.531 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2024-09-13T23:04:18.580 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:18 smithi047 ceph-mon[81243]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:18.580 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:18 smithi047 ceph-mon[81243]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:18.581 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:18 smithi047 ceph-mon[81243]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:18.581 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:18 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/1524413185' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:18.581 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:18 smithi047 podman[100952]: 2024-09-13 23:04:18.259798872 +0000 UTC m=+0.581941254 container remove e6695470bcdd7b0f43af1397295723fd81ccbd02229e39af05ac58f4ffefae10 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-13T23:04:18.581 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:18 smithi047 podman[101012]: 2024-09-13 23:04:18.477217876 +0000 UTC m=+0.113289968 container create aeb44a8238281b8232de7eda7ab8f8924db0d5ee021c940da7179127765593fa (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-13T23:04:18.581 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:18 smithi047 podman[101012]: 2024-09-13 23:04:18.380419561 +0000 UTC m=+0.016491611 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:04:18.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.638+0000 7f4060817700 1 -- 172.21.15.2:0/4286767347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f405c101850 msgr2=0x7f405c1058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:18.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.638+0000 7f4060817700 1 --2- 172.21.15.2:0/4286767347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f405c101850 0x7f405c1058a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4050009910 tx=0x7f4050009c20 comp rx=0 tx=0).stop 2024-09-13T23:04:18.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.638+0000 7f4060817700 1 -- 172.21.15.2:0/4286767347 shutdown_connections 2024-09-13T23:04:18.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.638+0000 7f4060817700 1 --2- 172.21.15.2:0/4286767347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f405c101850 0x7f405c1058a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.638+0000 7f4060817700 1 --2- 172.21.15.2:0/4286767347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f405c100ea0 0x7f405c101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.638+0000 7f4060817700 1 -- 172.21.15.2:0/4286767347 >> 172.21.15.2:0/4286767347 conn(0x7f405c0fc750 msgr2=0x7f405c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:18.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.638+0000 7f4060817700 1 -- 172.21.15.2:0/4286767347 shutdown_connections 2024-09-13T23:04:18.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.638+0000 7f4060817700 1 -- 172.21.15.2:0/4286767347 wait complete. 2024-09-13T23:04:18.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.638+0000 7f4060817700 1 Processor -- start 2024-09-13T23:04:18.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.639+0000 7f4060817700 1 -- start start 2024-09-13T23:04:18.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.639+0000 7f4060817700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f405c100ea0 0x7f405c19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:18.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.639+0000 7f4060817700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f405c101850 0x7f405c19ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:18.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.639+0000 7f4060817700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c19f4a0 con 0x7f405c101850 2024-09-13T23:04:18.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.639+0000 7f4060817700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c198950 con 0x7f405c100ea0 2024-09-13T23:04:18.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.639+0000 7f4059d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f405c101850 0x7f405c19ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.639+0000 7f4059d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f405c101850 0x7f405c19ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33436/0 (socket says 172.21.15.2:33436) 2024-09-13T23:04:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.639+0000 7f4059d9b700 1 -- 172.21.15.2:0/2815551983 learned_addr learned my addr 172.21.15.2:0/2815551983 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:04:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.639+0000 7f405a59c700 1 --2- 172.21.15.2:0/2815551983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f405c100ea0 0x7f405c19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.639+0000 7f4059d9b700 1 -- 172.21.15.2:0/2815551983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f405c100ea0 msgr2=0x7f405c19e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.639+0000 7f4059d9b700 1 --2- 172.21.15.2:0/2815551983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f405c100ea0 0x7f405c19e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.639+0000 7f4059d9b700 1 -- 172.21.15.2:0/2815551983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40500095f0 con 0x7f405c101850 2024-09-13T23:04:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.639+0000 7f405a59c700 1 --2- 172.21.15.2:0/2815551983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f405c100ea0 0x7f405c19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:04:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.639+0000 7f4059d9b700 1 --2- 172.21.15.2:0/2815551983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f405c101850 0x7f405c19ee10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f40500059d0 tx=0x7f405000f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.639+0000 7f404b7fe700 1 -- 172.21.15.2:0/2815551983 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405001d070 con 0x7f405c101850 2024-09-13T23:04:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.639+0000 7f404b7fe700 1 -- 172.21.15.2:0/2815551983 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f405000b610 con 0x7f405c101850 2024-09-13T23:04:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.640+0000 7f404b7fe700 1 -- 172.21.15.2:0/2815551983 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4050022470 con 0x7f405c101850 2024-09-13T23:04:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.640+0000 7f4060817700 1 -- 172.21.15.2:0/2815551983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405c198bd0 con 0x7f405c101850 2024-09-13T23:04:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.640+0000 7f4060817700 1 -- 172.21.15.2:0/2815551983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405c1990c0 con 0x7f405c101850 2024-09-13T23:04:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.641+0000 7f4060817700 1 -- 172.21.15.2:0/2815551983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405c105020 con 0x7f405c101850 2024-09-13T23:04:18.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.641+0000 7f404b7fe700 1 -- 172.21.15.2:0/2815551983 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f405000fc70 con 0x7f405c101850 2024-09-13T23:04:18.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.641+0000 7f404b7fe700 1 --2- 172.21.15.2:0/2815551983 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f404406e680 0x7f4044070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:18.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.642+0000 7f404b7fe700 1 -- 172.21.15.2:0/2815551983 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f405008fa40 con 0x7f405c101850 2024-09-13T23:04:18.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.642+0000 7f405a59c700 1 --2- 172.21.15.2:0/2815551983 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f404406e680 0x7f4044070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:18.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.642+0000 7f405a59c700 1 --2- 172.21.15.2:0/2815551983 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f404406e680 0x7f4044070b40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f404c009be0 tx=0x7f404c009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:18.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.646+0000 7f404b7fe700 1 -- 172.21.15.2:0/2815551983 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f405005c7c0 con 0x7f405c101850 2024-09-13T23:04:18.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.880+0000 7f4060817700 1 -- 172.21.15.2:0/2815551983 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f405c199e60 con 0x7f404406e680 2024-09-13T23:04:18.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.881+0000 7f404b7fe700 1 -- 172.21.15.2:0/2815551983 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f405c199e60 con 0x7f404406e680 2024-09-13T23:04:18.882 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:04:18.882 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:04:18.882 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T23:04:18.882 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:04:18.882 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-13T23:04:18.882 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-13T23:04:18.882 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-13T23:04:18.882 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2024-09-13T23:04:18.883 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-13T23:04:18.883 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "11/23 daemons upgraded", 2024-09-13T23:04:18.883 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T23:04:18.883 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T23:04:18.883 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:04:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.883+0000 7f4060817700 1 -- 172.21.15.2:0/2815551983 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f404406e680 msgr2=0x7f4044070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.883+0000 7f4060817700 1 --2- 172.21.15.2:0/2815551983 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f404406e680 0x7f4044070b40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f404c009be0 tx=0x7f404c009260 comp rx=0 tx=0).stop 2024-09-13T23:04:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.883+0000 7f4060817700 1 -- 172.21.15.2:0/2815551983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f405c101850 msgr2=0x7f405c19ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.883+0000 7f4060817700 1 --2- 172.21.15.2:0/2815551983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f405c101850 0x7f405c19ee10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f40500059d0 tx=0x7f405000f740 comp rx=0 tx=0).stop 2024-09-13T23:04:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.884+0000 7f4060817700 1 -- 172.21.15.2:0/2815551983 shutdown_connections 2024-09-13T23:04:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.884+0000 7f4060817700 1 --2- 172.21.15.2:0/2815551983 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f404406e680 0x7f4044070b40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.884+0000 7f4060817700 1 --2- 172.21.15.2:0/2815551983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f405c100ea0 0x7f405c19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.884+0000 7f4060817700 1 --2- 172.21.15.2:0/2815551983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f405c101850 0x7f405c19ee10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.884+0000 7f4060817700 1 -- 172.21.15.2:0/2815551983 >> 172.21.15.2:0/2815551983 conn(0x7f405c0fc750 msgr2=0x7f405c0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.884+0000 7f4060817700 1 -- 172.21.15.2:0/2815551983 shutdown_connections 2024-09-13T23:04:18.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.884+0000 7f4060817700 1 -- 172.21.15.2:0/2815551983 wait complete. 2024-09-13T23:04:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.994+0000 7fb90e4d0700 1 -- 172.21.15.2:0/552423680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb908105bf0 msgr2=0x7fb908105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.994+0000 7fb90e4d0700 1 --2- 172.21.15.2:0/552423680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb908105bf0 0x7fb908105fd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009910 tx=0x7fb8f8009c20 comp rx=0 tx=0).stop 2024-09-13T23:04:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.994+0000 7fb90e4d0700 1 -- 172.21.15.2:0/552423680 shutdown_connections 2024-09-13T23:04:18.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.994+0000 7fb90e4d0700 1 --2- 172.21.15.2:0/552423680 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9080ffb40 0x7fb9080fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.994+0000 7fb90e4d0700 1 --2- 172.21.15.2:0/552423680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb908105bf0 0x7fb908105fd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.994+0000 7fb90e4d0700 1 -- 172.21.15.2:0/552423680 >> 172.21.15.2:0/552423680 conn(0x7fb9080fb610 msgr2=0x7fb9080fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.994+0000 7fb90e4d0700 1 -- 172.21.15.2:0/552423680 shutdown_connections 2024-09-13T23:04:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.994+0000 7fb90e4d0700 1 -- 172.21.15.2:0/552423680 wait complete. 2024-09-13T23:04:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.995+0000 7fb90e4d0700 1 Processor -- start 2024-09-13T23:04:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.995+0000 7fb90e4d0700 1 -- start start 2024-09-13T23:04:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.995+0000 7fb90e4d0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9080ffb40 0x7fb90819c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.995+0000 7fb90e4d0700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb908105bf0 0x7fb90819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.995+0000 7fb90e4d0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90819d270 con 0x7fb9080ffb40 2024-09-13T23:04:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.995+0000 7fb90e4d0700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb908196720 con 0x7fb908105bf0 2024-09-13T23:04:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.996+0000 7fb907fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9080ffb40 0x7fb90819c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.996+0000 7fb9077fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb908105bf0 0x7fb90819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.996+0000 7fb9077fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb908105bf0 0x7fb90819cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.2:45006/0 (socket says 172.21.15.2:45006) 2024-09-13T23:04:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.996+0000 7fb907fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9080ffb40 0x7fb90819c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33452/0 (socket says 172.21.15.2:33452) 2024-09-13T23:04:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.996+0000 7fb9077fe700 1 -- 172.21.15.2:0/1914904179 learned_addr learned my addr 172.21.15.2:0/1914904179 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:04:18.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.996+0000 7fb9077fe700 1 -- 172.21.15.2:0/1914904179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9080ffb40 msgr2=0x7fb90819c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:18.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.996+0000 7fb9077fe700 1 --2- 172.21.15.2:0/1914904179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9080ffb40 0x7fb90819c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:18.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.996+0000 7fb9077fe700 1 -- 172.21.15.2:0/1914904179 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f80095f0 con 0x7fb908105bf0 2024-09-13T23:04:18.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.996+0000 7fb907fff700 1 --2- 172.21.15.2:0/1914904179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9080ffb40 0x7fb90819c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T23:04:18.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.996+0000 7fb9077fe700 1 --2- 172.21.15.2:0/1914904179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb908105bf0 0x7fb90819cbe0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00d900 tx=0x7fb8fc00dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:18.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.996+0000 7fb9057fa700 1 -- 172.21.15.2:0/1914904179 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8fc0041f0 con 0x7fb908105bf0 2024-09-13T23:04:18.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.996+0000 7fb9057fa700 1 -- 172.21.15.2:0/1914904179 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb8fc004cf0 con 0x7fb908105bf0 2024-09-13T23:04:18.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.996+0000 7fb90e4d0700 1 -- 172.21.15.2:0/1914904179 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb908196a00 con 0x7fb908105bf0 2024-09-13T23:04:18.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.997+0000 7fb9057fa700 1 -- 172.21.15.2:0/1914904179 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8fc00b750 con 0x7fb908105bf0 2024-09-13T23:04:18.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.997+0000 7fb90e4d0700 1 -- 172.21.15.2:0/1914904179 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb908196f50 con 0x7fb908105bf0 2024-09-13T23:04:19.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.998+0000 7fb90e4d0700 1 -- 172.21.15.2:0/1914904179 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9080679c0 con 0x7fb908105bf0 2024-09-13T23:04:19.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.998+0000 7fb9057fa700 1 -- 172.21.15.2:0/1914904179 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fb8fc004830 con 0x7fb908105bf0 2024-09-13T23:04:19.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.999+0000 7fb9057fa700 1 --2- 172.21.15.2:0/1914904179 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fb8f006e680 0x7fb8f0070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:19.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.999+0000 7fb9057fa700 1 -- 172.21.15.2:0/1914904179 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb8fc08e520 con 0x7fb908105bf0 2024-09-13T23:04:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.999+0000 7fb907fff700 1 --2- 172.21.15.2:0/1914904179 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fb8f006e680 0x7fb8f0070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:19.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:18.999+0000 7fb907fff700 1 --2- 172.21.15.2:0/1914904179 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fb8f006e680 0x7fb8f0070b40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8006010 tx=0x7fb8f801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:19.003+0000 7fb9057fa700 1 -- 172.21.15.2:0/1914904179 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb8fc05b240 con 0x7fb908105bf0 2024-09-13T23:04:19.163 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:18 smithi047 podman[101012]: 2024-09-13 23:04:18.713249772 +0000 UTC m=+0.349321829 container init aeb44a8238281b8232de7eda7ab8f8924db0d5ee021c940da7179127765593fa (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-13T23:04:19.163 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:18 smithi047 podman[101012]: 2024-09-13 23:04:18.716821589 +0000 UTC m=+0.352893639 container start aeb44a8238281b8232de7eda7ab8f8924db0d5ee021c940da7179127765593fa (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:04:19.163 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:18 smithi047 ceph-osd[101030]: -- 172.21.15.47:0/952455307 <== mon.1 v2:172.21.15.47:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dd62d7a1e0 con 0x55dd62d78000 2024-09-13T23:04:19.163 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:18 smithi047 bash[101012]: aeb44a8238281b8232de7eda7ab8f8924db0d5ee021c940da7179127765593fa 2024-09-13T23:04:19.163 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:18 smithi047 systemd[1]: Started Ceph osd.5 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T23:04:19.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:19.300+0000 7fb90e4d0700 1 -- 172.21.15.2:0/1914904179 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb9081971c0 con 0x7fb908105bf0 2024-09-13T23:04:19.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:19.301+0000 7fb9057fa700 1 -- 172.21.15.2:0/1914904179 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1674 (secure 0 0 0) 0x7fb8fc05add0 con 0x7fb908105bf0 2024-09-13T23:04:19.302 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Reduced data availability: 4 pgs peering; Degraded data redundancy: 31/264 objects degraded (11.742%), 10 pgs degraded 2024-09-13T23:04:19.302 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T23:04:19.302 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T23:04:19.302 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T23:04:19.302 INFO:teuthology.orchestra.run.smithi002.stdout: osd.5 (root=default,host=smithi047) is down 2024-09-13T23:04:19.302 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-13T23:04:19.302 INFO:teuthology.orchestra.run.smithi002.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-13T23:04:19.302 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 4 pgs peering 2024-09-13T23:04:19.302 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.18 is stuck peering for 6m, current state peering, last acting [4,3] 2024-09-13T23:04:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: pg 3.e is stuck peering for 6m, current state peering, last acting [4,1] 2024-09-13T23:04:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: pg 3.1c is stuck peering for 6m, current state peering, last acting [4,1] 2024-09-13T23:04:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: pg 3.1d is stuck peering for 6m, current state peering, last acting [4,1] 2024-09-13T23:04:19.303 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 31/264 objects degraded (11.742%), 10 pgs degraded 2024-09-13T23:04:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-13T23:04:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-13T23:04:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-09-13T23:04:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-13T23:04:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-13T23:04:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-13T23:04:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-13T23:04:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-09-13T23:04:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-09-13T23:04:19.303 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-13T23:04:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:19.303+0000 7fb90e4d0700 1 -- 172.21.15.2:0/1914904179 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fb8f006e680 msgr2=0x7fb8f0070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:19.303+0000 7fb90e4d0700 1 --2- 172.21.15.2:0/1914904179 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fb8f006e680 0x7fb8f0070b40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8006010 tx=0x7fb8f801a040 comp rx=0 tx=0).stop 2024-09-13T23:04:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:19.303+0000 7fb90e4d0700 1 -- 172.21.15.2:0/1914904179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb908105bf0 msgr2=0x7fb90819cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:19.303+0000 7fb90e4d0700 1 --2- 172.21.15.2:0/1914904179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb908105bf0 0x7fb90819cbe0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00d900 tx=0x7fb8fc00dc10 comp rx=0 tx=0).stop 2024-09-13T23:04:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:19.303+0000 7fb90e4d0700 1 -- 172.21.15.2:0/1914904179 shutdown_connections 2024-09-13T23:04:19.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:19.303+0000 7fb90e4d0700 1 --2- 172.21.15.2:0/1914904179 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fb8f006e680 0x7fb8f0070b40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:19.303+0000 7fb90e4d0700 1 --2- 172.21.15.2:0/1914904179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9080ffb40 0x7fb90819c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:19.303+0000 7fb90e4d0700 1 --2- 172.21.15.2:0/1914904179 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb908105bf0 0x7fb90819cbe0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:19.303+0000 7fb90e4d0700 1 -- 172.21.15.2:0/1914904179 >> 172.21.15.2:0/1914904179 conn(0x7fb9080fb610 msgr2=0x7fb908103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:19.303+0000 7fb90e4d0700 1 -- 172.21.15.2:0/1914904179 shutdown_connections 2024-09-13T23:04:19.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:19.303+0000 7fb90e4d0700 1 -- 172.21.15.2:0/1914904179 wait complete. 2024-09-13T23:04:19.579 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:19 smithi047 ceph-mon[81243]: pgmap v155: 65 pgs: 11 active+undersized, 7 peering, 10 active+undersized+degraded, 37 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 31/264 objects degraded (11.742%) 2024-09-13T23:04:19.579 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:19 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/937922219' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:04:19.579 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:19 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:19.579 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:19 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:19.579 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:19 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:19.579 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:19 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/1914904179' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:04:19.602 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:19 smithi002 ceph-mon[111294]: pgmap v155: 65 pgs: 11 active+undersized, 7 peering, 10 active+undersized+degraded, 37 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 31/264 objects degraded (11.742%) 2024-09-13T23:04:19.603 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:19 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/937922219' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:04:19.603 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:19 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:19.603 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:19 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:19.603 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:19 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:19.603 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:19 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/1914904179' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:04:20.608 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:20 smithi047 ceph-mon[81243]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:20.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:20 smithi002 ceph-mon[111294]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:20.912 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:20 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:04:20.607+0000 7f31e3e24640 -1 Falling back to public interface 2024-09-13T23:04:21.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:21 smithi047 ceph-mon[81243]: pgmap v156: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 0 op/s; 40/264 objects degraded (15.152%) 2024-09-13T23:04:21.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:21 smithi047 ceph-mon[81243]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-13T23:04:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:21 smithi002 ceph-mon[111294]: pgmap v156: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 0 op/s; 40/264 objects degraded (15.152%) 2024-09-13T23:04:21.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:21 smithi002 ceph-mon[111294]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-13T23:04:22.911 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:22 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:22.911 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:22 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:22.911 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:22 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:22.911 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:22 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:22.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:22 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:23.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:22 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:23.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:22 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:23.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:22 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:23.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:23 smithi047 ceph-mon[81243]: pgmap v157: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 951 B/s rd, 1 op/s; 40/264 objects degraded (15.152%) 2024-09-13T23:04:23.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:23 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:23.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:23 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:04:24.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:23 smithi002 ceph-mon[111294]: pgmap v157: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 951 B/s rd, 1 op/s; 40/264 objects degraded (15.152%) 2024-09-13T23:04:24.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:23 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:24.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:23 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:04:25.877 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:25 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:04:25.597+0000 7f31e3e24640 -1 osd.5 0 read_superblock omap replica is missing. 2024-09-13T23:04:25.877 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:25 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:04:25.876+0000 7f31e3e24640 -1 osd.5 75 log_to_monitors true 2024-09-13T23:04:25.877 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:25 smithi047 ceph-mon[81243]: pgmap v158: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s; 40/264 objects degraded (15.152%) 2024-09-13T23:04:25.877 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:25 smithi047 ceph-mon[81243]: Health check update: Degraded data redundancy: 40/264 objects degraded (15.152%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T23:04:25.877 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:25 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:25.877 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:25 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:25.878 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:25 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:25.878 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:25 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:04:25.878 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:25 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:25 smithi002 ceph-mon[111294]: pgmap v158: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s; 40/264 objects degraded (15.152%) 2024-09-13T23:04:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:25 smithi002 ceph-mon[111294]: Health check update: Degraded data redundancy: 40/264 objects degraded (15.152%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T23:04:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:25 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:25 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:25 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:25 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:04:26.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:25 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:26.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:26.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:26.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:26.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:26.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:26.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: Upgrade: Setting container_image for all osd 2024-09-13T23:04:26.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:26.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T23:04:26.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T23:04:26.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T23:04:26.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T23:04:26.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T23:04:26.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T23:04:26.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T23:04:26.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T23:04:26.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T23:04:26.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T23:04:26.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T23:04:26.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T23:04:26.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: Upgrade: Setting require_osd_release to 19 squid 2024-09-13T23:04:26.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-13T23:04:26.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='osd.5 [v2:172.21.15.47:6816/2934534194,v1:172.21.15.47:6817/2934534194]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T23:04:26.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:26 smithi047 ceph-mon[81243]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T23:04:27.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:27.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:27.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:27.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:27.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:27.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: Upgrade: Setting container_image for all osd 2024-09-13T23:04:27.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:27.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T23:04:27.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T23:04:27.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T23:04:27.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T23:04:27.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T23:04:27.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T23:04:27.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T23:04:27.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T23:04:27.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T23:04:27.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T23:04:27.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T23:04:27.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T23:04:27.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: Upgrade: Setting require_osd_release to 19 squid 2024-09-13T23:04:27.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-13T23:04:27.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='osd.5 [v2:172.21.15.47:6816/2934534194,v1:172.21.15.47:6817/2934534194]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T23:04:27.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:26 smithi002 ceph-mon[111294]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T23:04:27.795 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:04:27 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:04:27.527+0000 7f31d7bb6640 -1 osd.5 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:04:27.796 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:27 smithi047 ceph-mon[81243]: pgmap v159: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 705 B/s rd, 1 op/s; 40/264 objects degraded (15.152%) 2024-09-13T23:04:27.796 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:27 smithi047 ceph-mon[81243]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-13T23:04:27.796 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:27 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-13T23:04:27.796 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:27 smithi047 ceph-mon[81243]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T23:04:27.796 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:27 smithi047 ceph-mon[81243]: osdmap e78: 6 total, 5 up, 6 in 2024-09-13T23:04:27.796 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:27 smithi047 ceph-mon[81243]: from='osd.5 [v2:172.21.15.47:6816/2934534194,v1:172.21.15.47:6817/2934534194]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T23:04:27.796 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:27 smithi047 ceph-mon[81243]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T23:04:27.796 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:27 smithi047 ceph-mon[81243]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-13T23:04:27.797 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:27 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:27.797 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:27 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-13T23:04:27.797 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:27 smithi047 ceph-mon[81243]: from='osd.5 ' entity='osd.5' 2024-09-13T23:04:27.797 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:27 smithi047 ceph-mon[81243]: osdmap e79: 6 total, 5 up, 6 in 2024-09-13T23:04:27.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:27 smithi002 ceph-mon[111294]: pgmap v159: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 254 MiB data, 1005 MiB used, 535 GiB / 536 GiB avail; 705 B/s rd, 1 op/s; 40/264 objects degraded (15.152%) 2024-09-13T23:04:28.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:27 smithi002 ceph-mon[111294]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-13T23:04:28.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:27 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-13T23:04:28.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:27 smithi002 ceph-mon[111294]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T23:04:28.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:27 smithi002 ceph-mon[111294]: osdmap e78: 6 total, 5 up, 6 in 2024-09-13T23:04:28.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:27 smithi002 ceph-mon[111294]: from='osd.5 [v2:172.21.15.47:6816/2934534194,v1:172.21.15.47:6817/2934534194]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T23:04:28.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:27 smithi002 ceph-mon[111294]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-13T23:04:28.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:27 smithi002 ceph-mon[111294]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-13T23:04:28.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:27 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:28.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:27 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-13T23:04:28.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:27 smithi002 ceph-mon[111294]: from='osd.5 ' entity='osd.5' 2024-09-13T23:04:28.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:27 smithi002 ceph-mon[111294]: osdmap e79: 6 total, 5 up, 6 in 2024-09-13T23:04:29.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:28 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-13T23:04:29.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:28 smithi002 ceph-mon[111294]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 2 up:standby 2024-09-13T23:04:29.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:28 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:29.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:28 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:29.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:28 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:04:29.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:28 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:29.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:28 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:29.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:28 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:29.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:28 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:29.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:28 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:29.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:28 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:29.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:28 smithi002 ceph-mon[111294]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:04:29.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:28 smithi002 ceph-mon[111294]: osd.5 [v2:172.21.15.47:6816/2934534194,v1:172.21.15.47:6817/2934534194] boot 2024-09-13T23:04:29.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:28 smithi002 ceph-mon[111294]: osdmap e80: 6 total, 6 up, 6 in 2024-09-13T23:04:29.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:28 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:04:29.053 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:28 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-13T23:04:29.053 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:28 smithi047 ceph-mon[81243]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 2 up:standby 2024-09-13T23:04:29.054 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:28 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:29.054 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:28 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:29.054 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:28 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:04:29.054 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:28 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:29.054 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:28 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:29.054 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:28 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:29.054 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:28 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:29.054 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:28 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:29.054 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:28 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:29.054 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:28 smithi047 ceph-mon[81243]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T23:04:29.054 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:28 smithi047 ceph-mon[81243]: osd.5 [v2:172.21.15.47:6816/2934534194,v1:172.21.15.47:6817/2934534194] boot 2024-09-13T23:04:29.054 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:28 smithi047 ceph-mon[81243]: osdmap e80: 6 total, 6 up, 6 in 2024-09-13T23:04:29.054 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:28 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T23:04:29.942 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:29 smithi002 ceph-mon[111294]: pgmap v162: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 254 MiB data, 950 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 40/264 objects degraded (15.152%) 2024-09-13T23:04:29.942 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:29 smithi002 ceph-mon[111294]: mds.? [v2:172.21.15.2:6828/2657486485,v1:172.21.15.2:6829/2657486485] up:boot 2024-09-13T23:04:29.942 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:29 smithi002 ceph-mon[111294]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 3 up:standby 2024-09-13T23:04:29.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:29 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.gglyyr"}]: dispatch 2024-09-13T23:04:29.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:29 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:29.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:29 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.auedll", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:04:29.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:29 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:29.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:29 smithi002 ceph-mon[111294]: osdmap e81: 6 total, 6 up, 6 in 2024-09-13T23:04:30.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:29 smithi047 ceph-mon[81243]: pgmap v162: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 254 MiB data, 950 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 40/264 objects degraded (15.152%) 2024-09-13T23:04:30.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:29 smithi047 ceph-mon[81243]: mds.? [v2:172.21.15.2:6828/2657486485,v1:172.21.15.2:6829/2657486485] up:boot 2024-09-13T23:04:30.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:29 smithi047 ceph-mon[81243]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 3 up:standby 2024-09-13T23:04:30.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:29 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.gglyyr"}]: dispatch 2024-09-13T23:04:30.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:29 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:30.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:29 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.auedll", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:04:30.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:29 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:30.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:29 smithi047 ceph-mon[81243]: osdmap e81: 6 total, 6 up, 6 in 2024-09-13T23:04:30.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:30 smithi002 ceph-mon[111294]: Upgrade: Updating mds.cephfs.smithi002.auedll 2024-09-13T23:04:31.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:30 smithi002 ceph-mon[111294]: Deploying daemon mds.cephfs.smithi002.auedll on smithi002 2024-09-13T23:04:31.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:30 smithi047 ceph-mon[81243]: Upgrade: Updating mds.cephfs.smithi002.auedll 2024-09-13T23:04:31.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:30 smithi047 ceph-mon[81243]: Deploying daemon mds.cephfs.smithi002.auedll on smithi002 2024-09-13T23:04:31.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:31 smithi002 ceph-mon[111294]: pgmap v165: 65 pgs: 3 peering, 14 active+undersized, 11 active+undersized+degraded, 37 active+clean; 254 MiB data, 950 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 35/264 objects degraded (13.258%) 2024-09-13T23:04:32.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:31 smithi002 ceph-mon[111294]: Health check update: Degraded data redundancy: 35/264 objects degraded (13.258%), 11 pgs degraded (PG_DEGRADED) 2024-09-13T23:04:32.133 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:31 smithi047 ceph-mon[81243]: pgmap v165: 65 pgs: 3 peering, 14 active+undersized, 11 active+undersized+degraded, 37 active+clean; 254 MiB data, 950 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 35/264 objects degraded (13.258%) 2024-09-13T23:04:32.133 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:31 smithi047 ceph-mon[81243]: Health check update: Degraded data redundancy: 35/264 objects degraded (13.258%), 11 pgs degraded (PG_DEGRADED) 2024-09-13T23:04:33.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:32 smithi002 ceph-mon[111294]: osdmap e82: 6 total, 6 up, 6 in 2024-09-13T23:04:33.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:32 smithi002 ceph-mon[111294]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 2 up:standby 2024-09-13T23:04:33.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:32 smithi047 ceph-mon[81243]: osdmap e82: 6 total, 6 up, 6 in 2024-09-13T23:04:33.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:32 smithi047 ceph-mon[81243]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 2 up:standby 2024-09-13T23:04:33.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:33 smithi002 ceph-mon[111294]: pgmap v167: 65 pgs: 3 peering, 62 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 235 B/s rd, 0 op/s 2024-09-13T23:04:34.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:33 smithi002 ceph-mon[111294]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/264 objects degraded (13.258%), 11 pgs degraded) 2024-09-13T23:04:34.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:33 smithi047 ceph-mon[81243]: pgmap v167: 65 pgs: 3 peering, 62 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 235 B/s rd, 0 op/s 2024-09-13T23:04:34.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:33 smithi047 ceph-mon[81243]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/264 objects degraded (13.258%), 11 pgs degraded) 2024-09-13T23:04:35.017 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:34 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.auedll"}]: dispatch 2024-09-13T23:04:35.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:34 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.auedll"}]: dispatch 2024-09-13T23:04:35.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:35 smithi002 ceph-mon[111294]: pgmap v168: 65 pgs: 3 peering, 62 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 0 op/s 2024-09-13T23:04:36.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:35 smithi047 ceph-mon[81243]: pgmap v168: 65 pgs: 3 peering, 62 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 0 op/s 2024-09-13T23:04:37.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:36 smithi047 ceph-mon[81243]: mds.? [v2:172.21.15.2:6826/3279333632,v1:172.21.15.2:6827/3279333632] up:boot 2024-09-13T23:04:37.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:36 smithi047 ceph-mon[81243]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 3 up:standby 2024-09-13T23:04:37.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:36 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.auedll"}]: dispatch 2024-09-13T23:04:37.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:36 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:37.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:36 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:37.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:36 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:37.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:36 smithi002 ceph-mon[111294]: mds.? [v2:172.21.15.2:6826/3279333632,v1:172.21.15.2:6827/3279333632] up:boot 2024-09-13T23:04:37.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:36 smithi002 ceph-mon[111294]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 3 up:standby 2024-09-13T23:04:37.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:36 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.auedll"}]: dispatch 2024-09-13T23:04:37.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:36 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:37.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:36 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:37.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:36 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:37.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:37 smithi002 ceph-mon[111294]: pgmap v169: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 139 B/s rd, 0 op/s 2024-09-13T23:04:38.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:37 smithi047 ceph-mon[81243]: pgmap v169: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 139 B/s rd, 0 op/s 2024-09-13T23:04:39.127 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:39.127 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:04:39.127 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:38 smithi047 ceph-mon[81243]: pgmap v170: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 122 B/s rd, 0 op/s 2024-09-13T23:04:39.185 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:39.185 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:04:39.185 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:38 smithi002 ceph-mon[111294]: pgmap v170: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 122 B/s rd, 0 op/s 2024-09-13T23:04:41.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:40 smithi002 ceph-mon[111294]: pgmap v171: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-09-13T23:04:41.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:40 smithi047 ceph-mon[81243]: pgmap v171: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-09-13T23:04:42.313 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:42 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:42.314 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:42 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:42.314 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:42 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:42.314 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:42 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:42.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:42 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:42.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:42 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:42.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:42 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:42.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:42 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:44.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:43 smithi002 ceph-mon[111294]: pgmap v172: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:04:44.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:43 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:44.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:43 smithi047 ceph-mon[81243]: pgmap v172: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:04:44.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:43 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:45.979 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:45 smithi002 ceph-mon[111294]: pgmap v173: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:04:45.979 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:45.979 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:45.979 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:45.979 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:04:45.979 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:45.979 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:45.980 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:45.980 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:45.980 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:45.980 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:46.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:45 smithi047 ceph-mon[81243]: pgmap v173: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:04:46.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:46.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:46.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:46.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:04:46.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:46.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:46.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:46.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:46.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:46.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:48.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:47 smithi002 ceph-mon[111294]: pgmap v174: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:04:48.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:47 smithi002 ceph-mon[111294]: Upgrade: Updating mds.cephfs.smithi002.gglyyr 2024-09-13T23:04:48.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:47 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:48.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:47 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.gglyyr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:04:48.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:47 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:48.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:47 smithi002 ceph-mon[111294]: Deploying daemon mds.cephfs.smithi002.gglyyr on smithi002 2024-09-13T23:04:48.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:47 smithi047 ceph-mon[81243]: pgmap v174: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:04:48.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:47 smithi047 ceph-mon[81243]: Upgrade: Updating mds.cephfs.smithi002.gglyyr 2024-09-13T23:04:48.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:47 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:48.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:47 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.gglyyr", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:04:48.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:47 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:04:48.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:47 smithi047 ceph-mon[81243]: Deploying daemon mds.cephfs.smithi002.gglyyr on smithi002 2024-09-13T23:04:49.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.416+0000 7f57b832e700 1 -- 172.21.15.2:0/848473262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b0101840 msgr2=0x7f57b0105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:49.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.416+0000 7f57b832e700 1 --2- 172.21.15.2:0/848473262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b0101840 0x7f57b0105890 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009910 tx=0x7f57a0009c20 comp rx=0 tx=0).stop 2024-09-13T23:04:49.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.417+0000 7f57b832e700 1 -- 172.21.15.2:0/848473262 shutdown_connections 2024-09-13T23:04:49.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.417+0000 7f57b832e700 1 --2- 172.21.15.2:0/848473262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b0101840 0x7f57b0105890 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:49.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.417+0000 7f57b832e700 1 --2- 172.21.15.2:0/848473262 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57b0100e90 0x7f57b0101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:49.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.417+0000 7f57b832e700 1 -- 172.21.15.2:0/848473262 >> 172.21.15.2:0/848473262 conn(0x7f57b00fc740 msgr2=0x7f57b00feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:49.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.417+0000 7f57b832e700 1 -- 172.21.15.2:0/848473262 shutdown_connections 2024-09-13T23:04:49.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.417+0000 7f57b832e700 1 -- 172.21.15.2:0/848473262 wait complete. 2024-09-13T23:04:49.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.417+0000 7f57b832e700 1 Processor -- start 2024-09-13T23:04:49.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.417+0000 7f57b832e700 1 -- start start 2024-09-13T23:04:49.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.417+0000 7f57b832e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b0100e90 0x7f57b0073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:49.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.417+0000 7f57b832e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57b0101840 0x7f57b00735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:49.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.417+0000 7f57b832e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b0073b10 con 0x7f57b0100e90 2024-09-13T23:04:49.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.417+0000 7f57b832e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b0073c50 con 0x7f57b0101840 2024-09-13T23:04:49.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.418+0000 7f57b60ca700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b0100e90 0x7f57b0073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:49.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.418+0000 7f57b60ca700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b0100e90 0x7f57b0073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46366/0 (socket says 172.21.15.2:46366) 2024-09-13T23:04:49.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.418+0000 7f57b60ca700 1 -- 172.21.15.2:0/2091109869 learned_addr learned my addr 172.21.15.2:0/2091109869 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:04:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.418+0000 7f57b58c9700 1 --2- 172.21.15.2:0/2091109869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57b0101840 0x7f57b00735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.418+0000 7f57b60ca700 1 -- 172.21.15.2:0/2091109869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57b0101840 msgr2=0x7f57b00735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.418+0000 7f57b60ca700 1 --2- 172.21.15.2:0/2091109869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57b0101840 0x7f57b00735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.418+0000 7f57b60ca700 1 -- 172.21.15.2:0/2091109869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a00095f0 con 0x7f57b0100e90 2024-09-13T23:04:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.418+0000 7f57b60ca700 1 --2- 172.21.15.2:0/2091109869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b0100e90 0x7f57b0073090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00b4b0 tx=0x7f57ac00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:49.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.418+0000 7f57a77fe700 1 -- 172.21.15.2:0/2091109869 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57ac011800 con 0x7f57b0100e90 2024-09-13T23:04:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.418+0000 7f57a77fe700 1 -- 172.21.15.2:0/2091109869 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f57ac011e20 con 0x7f57b0100e90 2024-09-13T23:04:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.418+0000 7f57b832e700 1 -- 172.21.15.2:0/2091109869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b01a2bd0 con 0x7f57b0100e90 2024-09-13T23:04:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.418+0000 7f57a77fe700 1 -- 172.21.15.2:0/2091109869 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57ac00f2e0 con 0x7f57b0100e90 2024-09-13T23:04:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.418+0000 7f57b832e700 1 -- 172.21.15.2:0/2091109869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b01a2f80 con 0x7f57b0100e90 2024-09-13T23:04:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.419+0000 7f57b832e700 1 -- 172.21.15.2:0/2091109869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b01091c0 con 0x7f57b0100e90 2024-09-13T23:04:49.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.420+0000 7f57a77fe700 1 -- 172.21.15.2:0/2091109869 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f57ac010380 con 0x7f57b0100e90 2024-09-13T23:04:49.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.420+0000 7f57a77fe700 1 --2- 172.21.15.2:0/2091109869 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f579c06e680 0x7f579c070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:49.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.420+0000 7f57a77fe700 1 -- 172.21.15.2:0/2091109869 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f57ac08dfe0 con 0x7f57b0100e90 2024-09-13T23:04:49.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.420+0000 7f57b58c9700 1 --2- 172.21.15.2:0/2091109869 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f579c06e680 0x7f579c070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:49.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.421+0000 7f57b58c9700 1 --2- 172.21.15.2:0/2091109869 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f579c06e680 0x7f579c070b40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f57a0006010 tx=0x7f57a001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:49.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.425+0000 7f57a77fe700 1 -- 172.21.15.2:0/2091109869 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f57ac0572b0 con 0x7f57b0100e90 2024-09-13T23:04:49.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.656+0000 7f57b832e700 1 -- 172.21.15.2:0/2091109869 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f57b00611d0 con 0x7f579c06e680 2024-09-13T23:04:49.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.657+0000 7f57a77fe700 1 -- 172.21.15.2:0/2091109869 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f57b00611d0 con 0x7f579c06e680 2024-09-13T23:04:49.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.659+0000 7f57b832e700 1 -- 172.21.15.2:0/2091109869 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f579c06e680 msgr2=0x7f579c070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:49.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.659+0000 7f57b832e700 1 --2- 172.21.15.2:0/2091109869 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f579c06e680 0x7f579c070b40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f57a0006010 tx=0x7f57a001a040 comp rx=0 tx=0).stop 2024-09-13T23:04:49.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.659+0000 7f57b832e700 1 -- 172.21.15.2:0/2091109869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b0100e90 msgr2=0x7f57b0073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:49.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.659+0000 7f57b832e700 1 --2- 172.21.15.2:0/2091109869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b0100e90 0x7f57b0073090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00b4b0 tx=0x7f57ac00b7c0 comp rx=0 tx=0).stop 2024-09-13T23:04:49.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.659+0000 7f57b832e700 1 -- 172.21.15.2:0/2091109869 shutdown_connections 2024-09-13T23:04:49.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.659+0000 7f57b832e700 1 --2- 172.21.15.2:0/2091109869 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f579c06e680 0x7f579c070b40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:49.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.659+0000 7f57b832e700 1 --2- 172.21.15.2:0/2091109869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57b0100e90 0x7f57b0073090 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:49.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.659+0000 7f57b832e700 1 --2- 172.21.15.2:0/2091109869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57b0101840 0x7f57b00735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:49.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.659+0000 7f57b832e700 1 -- 172.21.15.2:0/2091109869 >> 172.21.15.2:0/2091109869 conn(0x7f57b00fc740 msgr2=0x7f57b00fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:49.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.659+0000 7f57b832e700 1 -- 172.21.15.2:0/2091109869 shutdown_connections 2024-09-13T23:04:49.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.659+0000 7f57b832e700 1 -- 172.21.15.2:0/2091109869 wait complete. 2024-09-13T23:04:49.671 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T23:04:49.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.769+0000 7f0b45dac700 1 -- 172.21.15.2:0/1532198316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b40100ea0 msgr2=0x7f0b40101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:49.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.769+0000 7f0b45dac700 1 --2- 172.21.15.2:0/1532198316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b40100ea0 0x7f0b40101280 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0b30009910 tx=0x7f0b30009c20 comp rx=0 tx=0).stop 2024-09-13T23:04:49.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.769+0000 7f0b45dac700 1 -- 172.21.15.2:0/1532198316 shutdown_connections 2024-09-13T23:04:49.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.769+0000 7f0b45dac700 1 --2- 172.21.15.2:0/1532198316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b40101850 0x7f0b401058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:49.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.769+0000 7f0b45dac700 1 --2- 172.21.15.2:0/1532198316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b40100ea0 0x7f0b40101280 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:49.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.769+0000 7f0b45dac700 1 -- 172.21.15.2:0/1532198316 >> 172.21.15.2:0/1532198316 conn(0x7f0b400fc750 msgr2=0x7f0b400feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:49.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.769+0000 7f0b45dac700 1 -- 172.21.15.2:0/1532198316 shutdown_connections 2024-09-13T23:04:49.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.769+0000 7f0b45dac700 1 -- 172.21.15.2:0/1532198316 wait complete. 2024-09-13T23:04:49.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.769+0000 7f0b45dac700 1 Processor -- start 2024-09-13T23:04:49.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.770+0000 7f0b45dac700 1 -- start start 2024-09-13T23:04:49.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.770+0000 7f0b45dac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b40100ea0 0x7f0b4019c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.770+0000 7f0b45dac700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b40101850 0x7f0b4019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.770+0000 7f0b45dac700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4019d2c0 con 0x7f0b40100ea0 2024-09-13T23:04:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.770+0000 7f0b45dac700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b40196770 con 0x7f0b40101850 2024-09-13T23:04:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.770+0000 7f0b3f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b40100ea0 0x7f0b4019c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.770+0000 7f0b3f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b40100ea0 0x7f0b4019c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46374/0 (socket says 172.21.15.2:46374) 2024-09-13T23:04:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.770+0000 7f0b3f7fe700 1 -- 172.21.15.2:0/1919394054 learned_addr learned my addr 172.21.15.2:0/1919394054 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:04:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.770+0000 7f0b3f7fe700 1 -- 172.21.15.2:0/1919394054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b40101850 msgr2=0x7f0b4019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.770+0000 7f0b3f7fe700 1 --2- 172.21.15.2:0/1919394054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b40101850 0x7f0b4019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.770+0000 7f0b3f7fe700 1 -- 172.21.15.2:0/1919394054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b300095f0 con 0x7f0b40100ea0 2024-09-13T23:04:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.770+0000 7f0b3f7fe700 1 --2- 172.21.15.2:0/1919394054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b40100ea0 0x7f0b4019c6f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0b30006010 tx=0x7f0b3000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.771+0000 7f0b3cff9700 1 -- 172.21.15.2:0/1919394054 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b3001d070 con 0x7f0b40100ea0 2024-09-13T23:04:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.771+0000 7f0b3cff9700 1 -- 172.21.15.2:0/1919394054 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b3000f460 con 0x7f0b40100ea0 2024-09-13T23:04:49.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.771+0000 7f0b45dac700 1 -- 172.21.15.2:0/1919394054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b401969f0 con 0x7f0b40100ea0 2024-09-13T23:04:49.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.771+0000 7f0b3cff9700 1 -- 172.21.15.2:0/1919394054 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b30017630 con 0x7f0b40100ea0 2024-09-13T23:04:49.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.771+0000 7f0b45dac700 1 -- 172.21.15.2:0/1919394054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b40196ee0 con 0x7f0b40100ea0 2024-09-13T23:04:49.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.772+0000 7f0b45dac700 1 -- 172.21.15.2:0/1919394054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b40109240 con 0x7f0b40100ea0 2024-09-13T23:04:49.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.772+0000 7f0b3cff9700 1 -- 172.21.15.2:0/1919394054 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f0b3000f5d0 con 0x7f0b40100ea0 2024-09-13T23:04:49.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.773+0000 7f0b3cff9700 1 --2- 172.21.15.2:0/1919394054 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f0b2806e680 0x7f0b28070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:49.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.773+0000 7f0b3cff9700 1 -- 172.21.15.2:0/1919394054 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f0b3008fa20 con 0x7f0b40100ea0 2024-09-13T23:04:49.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.773+0000 7f0b3effd700 1 --2- 172.21.15.2:0/1919394054 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f0b2806e680 0x7f0b28070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:49.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.773+0000 7f0b3effd700 1 --2- 172.21.15.2:0/1919394054 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f0b2806e680 0x7f0b28070b40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0b34005950 tx=0x7f0b340058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:49.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:49.777+0000 7f0b3cff9700 1 -- 172.21.15.2:0/1919394054 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0b3005c820 con 0x7f0b40100ea0 2024-09-13T23:04:49.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:49 smithi002 ceph-mon[111294]: pgmap v175: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:04:50.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:49 smithi002 ceph-mon[111294]: osdmap e83: 6 total, 6 up, 6 in 2024-09-13T23:04:50.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:49 smithi002 ceph-mon[111294]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 2 up:standby 2024-09-13T23:04:50.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:49 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.gglyyr"}]: dispatch 2024-09-13T23:04:50.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.011+0000 7f0b45dac700 1 -- 172.21.15.2:0/1919394054 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b401971c0 con 0x7f0b2806e680 2024-09-13T23:04:50.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.012+0000 7f0b3cff9700 1 -- 172.21.15.2:0/1919394054 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0b401971c0 con 0x7f0b2806e680 2024-09-13T23:04:50.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.014+0000 7f0b45dac700 1 -- 172.21.15.2:0/1919394054 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f0b2806e680 msgr2=0x7f0b28070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:50.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.014+0000 7f0b45dac700 1 --2- 172.21.15.2:0/1919394054 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f0b2806e680 0x7f0b28070b40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0b34005950 tx=0x7f0b340058e0 comp rx=0 tx=0).stop 2024-09-13T23:04:50.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.014+0000 7f0b45dac700 1 -- 172.21.15.2:0/1919394054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b40100ea0 msgr2=0x7f0b4019c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:50.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.014+0000 7f0b45dac700 1 --2- 172.21.15.2:0/1919394054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b40100ea0 0x7f0b4019c6f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0b30006010 tx=0x7f0b3000be20 comp rx=0 tx=0).stop 2024-09-13T23:04:50.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.014+0000 7f0b45dac700 1 -- 172.21.15.2:0/1919394054 shutdown_connections 2024-09-13T23:04:50.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.014+0000 7f0b45dac700 1 --2- 172.21.15.2:0/1919394054 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f0b2806e680 0x7f0b28070b40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:50.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.014+0000 7f0b45dac700 1 --2- 172.21.15.2:0/1919394054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b40100ea0 0x7f0b4019c6f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:50.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.014+0000 7f0b45dac700 1 --2- 172.21.15.2:0/1919394054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b40101850 0x7f0b4019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:50.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.014+0000 7f0b45dac700 1 -- 172.21.15.2:0/1919394054 >> 172.21.15.2:0/1919394054 conn(0x7f0b400fc750 msgr2=0x7f0b400fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:50.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.014+0000 7f0b45dac700 1 -- 172.21.15.2:0/1919394054 shutdown_connections 2024-09-13T23:04:50.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.014+0000 7f0b45dac700 1 -- 172.21.15.2:0/1919394054 wait complete. 2024-09-13T23:04:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.123+0000 7fde8db31700 1 -- 172.21.15.2:0/4162580739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde88101850 msgr2=0x7fde881058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.123+0000 7fde8db31700 1 --2- 172.21.15.2:0/4162580739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde88101850 0x7fde881058a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fde70009910 tx=0x7fde70009c20 comp rx=0 tx=0).stop 2024-09-13T23:04:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.123+0000 7fde8db31700 1 -- 172.21.15.2:0/4162580739 shutdown_connections 2024-09-13T23:04:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.123+0000 7fde8db31700 1 --2- 172.21.15.2:0/4162580739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde88101850 0x7fde881058a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.123+0000 7fde8db31700 1 --2- 172.21.15.2:0/4162580739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde88100ea0 0x7fde88101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.123+0000 7fde8db31700 1 -- 172.21.15.2:0/4162580739 >> 172.21.15.2:0/4162580739 conn(0x7fde880fc750 msgr2=0x7fde880feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.123+0000 7fde8db31700 1 -- 172.21.15.2:0/4162580739 shutdown_connections 2024-09-13T23:04:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.123+0000 7fde8db31700 1 -- 172.21.15.2:0/4162580739 wait complete. 2024-09-13T23:04:50.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.123+0000 7fde8db31700 1 Processor -- start 2024-09-13T23:04:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.124+0000 7fde8db31700 1 -- start start 2024-09-13T23:04:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.124+0000 7fde8db31700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde88100ea0 0x7fde8819e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.124+0000 7fde8db31700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde88101850 0x7fde8819ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.124+0000 7fde8db31700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8819f4a0 con 0x7fde88101850 2024-09-13T23:04:50.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.124+0000 7fde8db31700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde88198950 con 0x7fde88100ea0 2024-09-13T23:04:50.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.124+0000 7fde86ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde88101850 0x7fde8819ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:50.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.124+0000 7fde86ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde88101850 0x7fde8819ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46392/0 (socket says 172.21.15.2:46392) 2024-09-13T23:04:50.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.124+0000 7fde86ffd700 1 -- 172.21.15.2:0/2082027935 learned_addr learned my addr 172.21.15.2:0/2082027935 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:04:50.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.124+0000 7fde877fe700 1 --2- 172.21.15.2:0/2082027935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde88100ea0 0x7fde8819e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:50.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.124+0000 7fde86ffd700 1 -- 172.21.15.2:0/2082027935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde88100ea0 msgr2=0x7fde8819e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:50.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.124+0000 7fde86ffd700 1 --2- 172.21.15.2:0/2082027935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde88100ea0 0x7fde8819e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:50.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.124+0000 7fde86ffd700 1 -- 172.21.15.2:0/2082027935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde700095f0 con 0x7fde88101850 2024-09-13T23:04:50.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.124+0000 7fde877fe700 1 --2- 172.21.15.2:0/2082027935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde88100ea0 0x7fde8819e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:04:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.124+0000 7fde86ffd700 1 --2- 172.21.15.2:0/2082027935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde88101850 0x7fde8819ee10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fde700092e0 tx=0x7fde7000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.125+0000 7fde84ff9700 1 -- 172.21.15.2:0/2082027935 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde7001d070 con 0x7fde88101850 2024-09-13T23:04:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.125+0000 7fde8db31700 1 -- 172.21.15.2:0/2082027935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde88198bd0 con 0x7fde88101850 2024-09-13T23:04:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.125+0000 7fde84ff9700 1 -- 172.21.15.2:0/2082027935 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde70005dc0 con 0x7fde88101850 2024-09-13T23:04:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.125+0000 7fde84ff9700 1 -- 172.21.15.2:0/2082027935 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde70017400 con 0x7fde88101850 2024-09-13T23:04:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.125+0000 7fde8db31700 1 -- 172.21.15.2:0/2082027935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde881990c0 con 0x7fde88101850 2024-09-13T23:04:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.126+0000 7fde8db31700 1 -- 172.21.15.2:0/2082027935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde88105020 con 0x7fde88101850 2024-09-13T23:04:50.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.126+0000 7fde84ff9700 1 -- 172.21.15.2:0/2082027935 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fde7000f460 con 0x7fde88101850 2024-09-13T23:04:50.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.127+0000 7fde84ff9700 1 --2- 172.21.15.2:0/2082027935 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fde7406e680 0x7fde74070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:50.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.127+0000 7fde84ff9700 1 -- 172.21.15.2:0/2082027935 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fde7008fa00 con 0x7fde88101850 2024-09-13T23:04:50.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.127+0000 7fde877fe700 1 --2- 172.21.15.2:0/2082027935 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fde7406e680 0x7fde74070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:50.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.127+0000 7fde877fe700 1 --2- 172.21.15.2:0/2082027935 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fde7406e680 0x7fde74070b40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fde78009dd0 tx=0x7fde78009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:50.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.131+0000 7fde84ff9700 1 -- 172.21.15.2:0/2082027935 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fde7005c800 con 0x7fde88101850 2024-09-13T23:04:50.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:49 smithi047 ceph-mon[81243]: pgmap v175: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:04:50.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:49 smithi047 ceph-mon[81243]: osdmap e83: 6 total, 6 up, 6 in 2024-09-13T23:04:50.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:49 smithi047 ceph-mon[81243]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 2 up:standby 2024-09-13T23:04:50.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:49 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.gglyyr"}]: dispatch 2024-09-13T23:04:50.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.349+0000 7fde8db31700 1 -- 172.21.15.2:0/2082027935 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fde88199ed0 con 0x7fde7406e680 2024-09-13T23:04:50.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.359+0000 7fde84ff9700 1 -- 172.21.15.2:0/2082027935 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fde88199ed0 con 0x7fde7406e680 2024-09-13T23:04:50.361 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:04:50.361 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (6m) 9s ago 17m 26.0M - 0.25.0 c8568f914cd2 f570a73274bc 2024-09-13T23:04:50.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (17m) 9s ago 17m 8904k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T23:04:50.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (16m) 28s ago 16m 8694k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T23:04:50.362 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (3m) 9s ago 17m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 427cd38a7d88 2024-09-13T23:04:50.362 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (3m) 28s ago 16m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 ce5a1df96005 2024-09-13T23:04:50.362 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (6m) 9s ago 16m 76.9M - 9.4.12 2bacad6d85d8 650673516b69 2024-09-13T23:04:50.362 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (15s) 9s ago 11m 12.2M - 19.1.1-324-gecab7be5 0652ff2b5d78 6c66160ad777 2024-09-13T23:04:50.362 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (11m) 9s ago 11m 11.3M - 18.2.1 5be31c24972a f0e83b5a6019 2024-09-13T23:04:50.362 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (11m) 28s ago 11m 149M - 18.2.1 5be31c24972a 30162604b505 2024-09-13T23:04:50.362 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (11m) 28s ago 11m 20.2M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T23:04:50.362 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 running (8m) 9s ago 18m 503M - 19.1.1-324-gecab7be5 0652ff2b5d78 7a8aa9de37e4 2024-09-13T23:04:50.362 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (7m) 28s ago 16m 441M - 19.1.1-324-gecab7be5 0652ff2b5d78 13fa6f3b5a8a 2024-09-13T23:04:50.362 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (4m) 9s ago 18m 53.6M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 db0ef6c509cf 2024-09-13T23:04:50.362 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (4m) 28s ago 16m 41.7M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 ea0c2a2e0e1a 2024-09-13T23:04:50.362 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (7m) 9s ago 17m 14.9M - 1.5.0 0da6a335fe13 f3eae5f90ab8 2024-09-13T23:04:50.362 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (7m) 28s ago 16m 15.5M - 1.5.0 0da6a335fe13 a5c7d7f1eaa5 2024-09-13T23:04:50.363 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (3m) 9s ago 15m 88.2M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 0ca6dd66fa68 2024-09-13T23:04:50.363 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (2m) 9s ago 14m 89.2M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 6f5ae2cfa818 2024-09-13T23:04:50.363 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (2m) 9s ago 14m 77.9M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 15b9e8db7556 2024-09-13T23:04:50.363 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (97s) 28s ago 14m 103M 2241M 19.1.1-324-gecab7be5 0652ff2b5d78 de54fd3fea34 2024-09-13T23:04:50.363 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (65s) 28s ago 13m 85.4M 2241M 19.1.1-324-gecab7be5 0652ff2b5d78 185d7ae7181b 2024-09-13T23:04:50.363 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (31s) 28s ago 13m 12.1M 2241M 19.1.1-324-gecab7be5 0652ff2b5d78 aeb44a823828 2024-09-13T23:04:50.363 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (6m) 9s ago 16m 76.7M - 2.43.0 a07b618ecd1d aa241d1048de 2024-09-13T23:04:50.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.362+0000 7fde8db31700 1 -- 172.21.15.2:0/2082027935 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fde7406e680 msgr2=0x7fde74070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:50.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.362+0000 7fde8db31700 1 --2- 172.21.15.2:0/2082027935 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fde7406e680 0x7fde74070b40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fde78009dd0 tx=0x7fde78009040 comp rx=0 tx=0).stop 2024-09-13T23:04:50.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.362+0000 7fde8db31700 1 -- 172.21.15.2:0/2082027935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde88101850 msgr2=0x7fde8819ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:50.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.362+0000 7fde8db31700 1 --2- 172.21.15.2:0/2082027935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde88101850 0x7fde8819ee10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fde700092e0 tx=0x7fde7000be20 comp rx=0 tx=0).stop 2024-09-13T23:04:50.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.362+0000 7fde8db31700 1 -- 172.21.15.2:0/2082027935 shutdown_connections 2024-09-13T23:04:50.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.362+0000 7fde8db31700 1 --2- 172.21.15.2:0/2082027935 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fde7406e680 0x7fde74070b40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:50.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.362+0000 7fde8db31700 1 --2- 172.21.15.2:0/2082027935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde88100ea0 0x7fde8819e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:50.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.362+0000 7fde8db31700 1 --2- 172.21.15.2:0/2082027935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde88101850 0x7fde8819ee10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:50.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.362+0000 7fde8db31700 1 -- 172.21.15.2:0/2082027935 >> 172.21.15.2:0/2082027935 conn(0x7fde880fc750 msgr2=0x7fde880feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:50.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.362+0000 7fde8db31700 1 -- 172.21.15.2:0/2082027935 shutdown_connections 2024-09-13T23:04:50.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.362+0000 7fde8db31700 1 -- 172.21.15.2:0/2082027935 wait complete. 2024-09-13T23:04:50.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.469+0000 7f96de472700 1 -- 172.21.15.2:0/897371570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d8101e60 msgr2=0x7f96d8102240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:50.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.469+0000 7f96de472700 1 --2- 172.21.15.2:0/897371570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d8101e60 0x7f96d8102240 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009910 tx=0x7f96c8009c20 comp rx=0 tx=0).stop 2024-09-13T23:04:50.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.469+0000 7f96de472700 1 -- 172.21.15.2:0/897371570 shutdown_connections 2024-09-13T23:04:50.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.469+0000 7f96de472700 1 --2- 172.21.15.2:0/897371570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96d8102780 0x7f96d810ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:50.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.469+0000 7f96de472700 1 --2- 172.21.15.2:0/897371570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d8101e60 0x7f96d8102240 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:50.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.469+0000 7f96de472700 1 -- 172.21.15.2:0/897371570 >> 172.21.15.2:0/897371570 conn(0x7f96d80fb650 msgr2=0x7f96d80fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:50.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.469+0000 7f96de472700 1 -- 172.21.15.2:0/897371570 shutdown_connections 2024-09-13T23:04:50.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.469+0000 7f96de472700 1 -- 172.21.15.2:0/897371570 wait complete. 2024-09-13T23:04:50.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.470+0000 7f96de472700 1 Processor -- start 2024-09-13T23:04:50.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.470+0000 7f96de472700 1 -- start start 2024-09-13T23:04:50.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.470+0000 7f96de472700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d8101e60 0x7f96d81969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:50.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.470+0000 7f96de472700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96d8102780 0x7f96d8196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:50.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.470+0000 7f96de472700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d81975a0 con 0x7f96d8101e60 2024-09-13T23:04:50.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.470+0000 7f96de472700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d819b360 con 0x7f96d8102780 2024-09-13T23:04:50.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.470+0000 7f96d7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d8101e60 0x7f96d81969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:50.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.470+0000 7f96d7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d8101e60 0x7f96d81969d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34296/0 (socket says 172.21.15.2:34296) 2024-09-13T23:04:50.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.470+0000 7f96d7fff700 1 -- 172.21.15.2:0/3913530630 learned_addr learned my addr 172.21.15.2:0/3913530630 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:04:50.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.471+0000 7f96d77fe700 1 --2- 172.21.15.2:0/3913530630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96d8102780 0x7f96d8196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:50.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.471+0000 7f96d7fff700 1 -- 172.21.15.2:0/3913530630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96d8102780 msgr2=0x7f96d8196f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:50.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.471+0000 7f96d7fff700 1 --2- 172.21.15.2:0/3913530630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96d8102780 0x7f96d8196f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:50.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.471+0000 7f96d7fff700 1 -- 172.21.15.2:0/3913530630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c80095f0 con 0x7f96d8101e60 2024-09-13T23:04:50.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.471+0000 7f96d7fff700 1 --2- 172.21.15.2:0/3913530630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d8101e60 0x7f96d81969d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f96c8006010 tx=0x7f96c800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:50.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.471+0000 7f96d57fa700 1 -- 172.21.15.2:0/3913530630 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96c801d070 con 0x7f96d8101e60 2024-09-13T23:04:50.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.471+0000 7f96de472700 1 -- 172.21.15.2:0/3913530630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d819b5e0 con 0x7f96d8101e60 2024-09-13T23:04:50.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.471+0000 7f96d57fa700 1 -- 172.21.15.2:0/3913530630 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f96c8004fb0 con 0x7f96d8101e60 2024-09-13T23:04:50.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.471+0000 7f96d57fa700 1 -- 172.21.15.2:0/3913530630 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96c800f690 con 0x7f96d8101e60 2024-09-13T23:04:50.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.471+0000 7f96de472700 1 -- 172.21.15.2:0/3913530630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d819bad0 con 0x7f96d8101e60 2024-09-13T23:04:50.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.472+0000 7f96de472700 1 -- 172.21.15.2:0/3913530630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d8108340 con 0x7f96d8101e60 2024-09-13T23:04:50.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.473+0000 7f96d57fa700 1 -- 172.21.15.2:0/3913530630 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f96c80228a0 con 0x7f96d8101e60 2024-09-13T23:04:50.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.473+0000 7f96d57fa700 1 --2- 172.21.15.2:0/3913530630 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f96c006e680 0x7f96c0070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:50.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.474+0000 7f96d77fe700 1 --2- 172.21.15.2:0/3913530630 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f96c006e680 0x7f96c0070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:50.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.474+0000 7f96d57fa700 1 -- 172.21.15.2:0/3913530630 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f96c808fe20 con 0x7f96d8101e60 2024-09-13T23:04:50.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.474+0000 7f96d77fe700 1 --2- 172.21.15.2:0/3913530630 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f96c006e680 0x7f96c0070b40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f96cc006fd0 tx=0x7f96cc008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:50.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.478+0000 7f96d57fa700 1 -- 172.21.15.2:0/3913530630 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f96c805cba0 con 0x7f96d8101e60 2024-09-13T23:04:50.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.779+0000 7f96de472700 1 -- 172.21.15.2:0/3913530630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f96d804f2e0 con 0x7f96d8101e60 2024-09-13T23:04:50.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.780+0000 7f96d57fa700 1 -- 172.21.15.2:0/3913530630 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+815 (secure 0 0 0) 0x7f96c8027340 con 0x7f96d8101e60 2024-09-13T23:04:50.781 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:04:50.781 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T23:04:50.781 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:04:50.781 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:04:50.781 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T23:04:50.781 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:04:50.781 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:04:50.781 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T23:04:50.781 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T23:04:50.781 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:04:50.781 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T23:04:50.782 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2, 2024-09-13T23:04:50.782 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 1 2024-09-13T23:04:50.782 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:04:50.782 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T23:04:50.782 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2, 2024-09-13T23:04:50.782 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 11 2024-09-13T23:04:50.782 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T23:04:50.782 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:04:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.782+0000 7f96de472700 1 -- 172.21.15.2:0/3913530630 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f96c006e680 msgr2=0x7f96c0070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.782+0000 7f96de472700 1 --2- 172.21.15.2:0/3913530630 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f96c006e680 0x7f96c0070b40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f96cc006fd0 tx=0x7f96cc008040 comp rx=0 tx=0).stop 2024-09-13T23:04:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.782+0000 7f96de472700 1 -- 172.21.15.2:0/3913530630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d8101e60 msgr2=0x7f96d81969d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.782+0000 7f96de472700 1 --2- 172.21.15.2:0/3913530630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d8101e60 0x7f96d81969d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f96c8006010 tx=0x7f96c800be20 comp rx=0 tx=0).stop 2024-09-13T23:04:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.782+0000 7f96de472700 1 -- 172.21.15.2:0/3913530630 shutdown_connections 2024-09-13T23:04:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.782+0000 7f96de472700 1 --2- 172.21.15.2:0/3913530630 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f96c006e680 0x7f96c0070b40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.782+0000 7f96de472700 1 --2- 172.21.15.2:0/3913530630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d8101e60 0x7f96d81969d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.782+0000 7f96de472700 1 --2- 172.21.15.2:0/3913530630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96d8102780 0x7f96d8196f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:50.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.782+0000 7f96de472700 1 -- 172.21.15.2:0/3913530630 >> 172.21.15.2:0/3913530630 conn(0x7f96d80fb650 msgr2=0x7f96d8105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:50.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.782+0000 7f96de472700 1 -- 172.21.15.2:0/3913530630 shutdown_connections 2024-09-13T23:04:50.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.782+0000 7f96de472700 1 -- 172.21.15.2:0/3913530630 wait complete. 2024-09-13T23:04:50.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.890+0000 7f56a79d2700 1 -- 172.21.15.2:0/4063737548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56a0101060 msgr2=0x7f56a01047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:50.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.890+0000 7f56a79d2700 1 --2- 172.21.15.2:0/4063737548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56a0101060 0x7f56a01047b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5690009910 tx=0x7f5690009c20 comp rx=0 tx=0).stop 2024-09-13T23:04:50.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.890+0000 7f56a79d2700 1 -- 172.21.15.2:0/4063737548 shutdown_connections 2024-09-13T23:04:50.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.890+0000 7f56a79d2700 1 --2- 172.21.15.2:0/4063737548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56a0101060 0x7f56a01047b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:50.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.890+0000 7f56a79d2700 1 --2- 172.21.15.2:0/4063737548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56a01006b0 0x7f56a0100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:50.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.890+0000 7f56a79d2700 1 -- 172.21.15.2:0/4063737548 >> 172.21.15.2:0/4063737548 conn(0x7f56a0074e30 msgr2=0x7f56a0075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:50.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.890+0000 7f56a79d2700 1 -- 172.21.15.2:0/4063737548 shutdown_connections 2024-09-13T23:04:50.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.890+0000 7f56a79d2700 1 -- 172.21.15.2:0/4063737548 wait complete. 2024-09-13T23:04:50.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.891+0000 7f56a79d2700 1 Processor -- start 2024-09-13T23:04:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.891+0000 7f56a79d2700 1 -- start start 2024-09-13T23:04:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.891+0000 7f56a79d2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56a01006b0 0x7f56a019c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.891+0000 7f56a79d2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56a0101060 0x7f56a019cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.891+0000 7f56a79d2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a019d160 con 0x7f56a0101060 2024-09-13T23:04:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.891+0000 7f56a79d2700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a01966a0 con 0x7f56a01006b0 2024-09-13T23:04:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.891+0000 7f56a4f6d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56a0101060 0x7f56a019cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.891+0000 7f56a4f6d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56a0101060 0x7f56a019cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34314/0 (socket says 172.21.15.2:34314) 2024-09-13T23:04:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.891+0000 7f56a4f6d700 1 -- 172.21.15.2:0/2111743193 learned_addr learned my addr 172.21.15.2:0/2111743193 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:04:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.892+0000 7f56a576e700 1 --2- 172.21.15.2:0/2111743193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56a01006b0 0x7f56a019c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.892+0000 7f56a4f6d700 1 -- 172.21.15.2:0/2111743193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56a01006b0 msgr2=0x7f56a019c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.892+0000 7f56a4f6d700 1 --2- 172.21.15.2:0/2111743193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56a01006b0 0x7f56a019c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.892+0000 7f56a4f6d700 1 -- 172.21.15.2:0/2111743193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56900095f0 con 0x7f56a0101060 2024-09-13T23:04:50.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.892+0000 7f56a4f6d700 1 --2- 172.21.15.2:0/2111743193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56a0101060 0x7f56a019cb60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f569000bda0 tx=0x7f569000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:50.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.892+0000 7f56967fc700 1 -- 172.21.15.2:0/2111743193 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f569001d070 con 0x7f56a0101060 2024-09-13T23:04:50.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.892+0000 7f56967fc700 1 -- 172.21.15.2:0/2111743193 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f569000f460 con 0x7f56a0101060 2024-09-13T23:04:50.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.892+0000 7f56a79d2700 1 -- 172.21.15.2:0/2111743193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a0196920 con 0x7f56a0101060 2024-09-13T23:04:50.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.892+0000 7f56967fc700 1 -- 172.21.15.2:0/2111743193 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5690017630 con 0x7f56a0101060 2024-09-13T23:04:50.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.892+0000 7f56a79d2700 1 -- 172.21.15.2:0/2111743193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a0196e10 con 0x7f56a0101060 2024-09-13T23:04:50.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.893+0000 7f56a79d2700 1 -- 172.21.15.2:0/2111743193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a01090a0 con 0x7f56a0101060 2024-09-13T23:04:50.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.894+0000 7f56967fc700 1 -- 172.21.15.2:0/2111743193 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f569000fab0 con 0x7f56a0101060 2024-09-13T23:04:50.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.895+0000 7f56967fc700 1 --2- 172.21.15.2:0/2111743193 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f568c06e680 0x7f568c070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:50.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.895+0000 7f56a576e700 1 --2- 172.21.15.2:0/2111743193 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f568c06e680 0x7f568c070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:50.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.895+0000 7f56967fc700 1 -- 172.21.15.2:0/2111743193 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f569008fa30 con 0x7f56a0101060 2024-09-13T23:04:50.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.895+0000 7f56a576e700 1 --2- 172.21.15.2:0/2111743193 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f568c06e680 0x7f568c070b40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f569c00ac50 tx=0x7f569c00a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:50.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:50.899+0000 7f56967fc700 1 -- 172.21.15.2:0/2111743193 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f569005c7d0 con 0x7f56a0101060 2024-09-13T23:04:50.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:50 smithi002 ceph-mon[111294]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:51.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.153+0000 7f56a79d2700 1 -- 172.21.15.2:0/2111743193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f56a004f2e0 con 0x7f56a0101060 2024-09-13T23:04:51.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.154+0000 7f56967fc700 1 -- 172.21.15.2:0/2111743193 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1746 (secure 0 0 0) 0x7f569005c360 con 0x7f56a0101060 2024-09-13T23:04:51.155 INFO:teuthology.orchestra.run.smithi002.stdout:e21 2024-09-13T23:04:51.155 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-13T23:04:48:669739+0000 2024-09-13T23:04:51.155 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:04:51.155 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:04:51.155 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-13T23:04:51.155 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:04:51.155 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:04:51.155 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-13T23:04:51.155 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 17 2024-09-13T23:04:51.155 INFO:teuthology.orchestra.run.smithi002.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T23:04:51.155 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-13T22:53:05.963265+0000 2024-09-13T23:04:51.156 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-13T23:04:27.724473+0000 2024-09-13T23:04:51.156 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-13T23:04:51.156 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-13T23:04:51.156 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-13T23:04:51.156 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-13T23:04:51.156 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-13T23:04:51.156 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-13T23:04:51.156 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-13T23:04:51.156 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-13T23:04:51.156 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 0 2024-09-13T23:04:51.156 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:04:51.156 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 1 2024-09-13T23:04:51.156 INFO:teuthology.orchestra.run.smithi002.stdout:in 0 2024-09-13T23:04:51.156 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24267} 2024-09-13T23:04:51.157 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-13T23:04:51.157 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-13T23:04:51.157 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-13T23:04:51.157 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-13T23:04:51.157 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-13T23:04:51.157 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-13T23:04:51.157 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-13T23:04:51.157 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-13T23:04:51.157 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-13T23:04:51.157 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 24267 members: 24267 2024-09-13T23:04:51.157 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.gxzkha{0:24267} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.47:6824/2157973647,v1:172.21.15.47:6825/2157973647] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:04:51.157 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:04:51.157 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:04:51.157 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-13T23:04:51.158 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:04:51.158 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.nqvveh{-1:24277} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:04:51.158 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.auedll{-1:34384} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/3279333632,v1:172.21.15.2:6827/3279333632] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:04:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.156+0000 7f56a79d2700 1 -- 172.21.15.2:0/2111743193 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f568c06e680 msgr2=0x7f568c070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.156+0000 7f56a79d2700 1 --2- 172.21.15.2:0/2111743193 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f568c06e680 0x7f568c070b40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f569c00ac50 tx=0x7f569c00a380 comp rx=0 tx=0).stop 2024-09-13T23:04:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.156+0000 7f56a79d2700 1 -- 172.21.15.2:0/2111743193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56a0101060 msgr2=0x7f56a019cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.156+0000 7f56a79d2700 1 --2- 172.21.15.2:0/2111743193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56a0101060 0x7f56a019cb60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f569000bda0 tx=0x7f569000bdd0 comp rx=0 tx=0).stop 2024-09-13T23:04:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.156+0000 7f56a79d2700 1 -- 172.21.15.2:0/2111743193 shutdown_connections 2024-09-13T23:04:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.156+0000 7f56a79d2700 1 --2- 172.21.15.2:0/2111743193 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f568c06e680 0x7f568c070b40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.156+0000 7f56a79d2700 1 --2- 172.21.15.2:0/2111743193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f56a01006b0 0x7f56a019c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.156+0000 7f56a79d2700 1 --2- 172.21.15.2:0/2111743193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56a0101060 0x7f56a019cb60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.156+0000 7f56a79d2700 1 -- 172.21.15.2:0/2111743193 >> 172.21.15.2:0/2111743193 conn(0x7f56a0074e30 msgr2=0x7f56a0103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.156+0000 7f56a79d2700 1 -- 172.21.15.2:0/2111743193 shutdown_connections 2024-09-13T23:04:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.156+0000 7f56a79d2700 1 -- 172.21.15.2:0/2111743193 wait complete. 2024-09-13T23:04:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 21 2024-09-13T23:04:51.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:50 smithi047 ceph-mon[81243]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:51.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.265+0000 7f54d4814700 1 -- 172.21.15.2:0/2895919787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54d00ffc20 msgr2=0x7f54d0100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:51.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.265+0000 7f54d4814700 1 --2- 172.21.15.2:0/2895919787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54d00ffc20 0x7f54d0100080 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f54b8009910 tx=0x7f54b8009c20 comp rx=0 tx=0).stop 2024-09-13T23:04:51.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.265+0000 7f54d4814700 1 -- 172.21.15.2:0/2895919787 shutdown_connections 2024-09-13T23:04:51.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.265+0000 7f54d4814700 1 --2- 172.21.15.2:0/2895919787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54d00ffc20 0x7f54d0100080 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:51.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.265+0000 7f54d4814700 1 --2- 172.21.15.2:0/2895919787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54d0105bd0 0x7f54d0105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:51.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.265+0000 7f54d4814700 1 -- 172.21.15.2:0/2895919787 >> 172.21.15.2:0/2895919787 conn(0x7f54d0075670 msgr2=0x7f54d0075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:51.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.265+0000 7f54d4814700 1 -- 172.21.15.2:0/2895919787 shutdown_connections 2024-09-13T23:04:51.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.265+0000 7f54d4814700 1 -- 172.21.15.2:0/2895919787 wait complete. 2024-09-13T23:04:51.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.266+0000 7f54d4814700 1 Processor -- start 2024-09-13T23:04:51.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.266+0000 7f54d4814700 1 -- start start 2024-09-13T23:04:51.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.266+0000 7f54d4814700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54d00ffc20 0x7f54d019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:51.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.266+0000 7f54d4814700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54d0105bd0 0x7f54d019cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:51.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.266+0000 7f54d4814700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d019d200 con 0x7f54d00ffc20 2024-09-13T23:04:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.266+0000 7f54d4814700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d01966b0 con 0x7f54d0105bd0 2024-09-13T23:04:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.266+0000 7f54ce59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54d00ffc20 0x7f54d019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.266+0000 7f54ce59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54d00ffc20 0x7f54d019c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34338/0 (socket says 172.21.15.2:34338) 2024-09-13T23:04:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.266+0000 7f54ce59c700 1 -- 172.21.15.2:0/2423719820 learned_addr learned my addr 172.21.15.2:0/2423719820 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:04:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.266+0000 7f54c5d9b700 1 --2- 172.21.15.2:0/2423719820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54d0105bd0 0x7f54d019cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.267+0000 7f54ce59c700 1 -- 172.21.15.2:0/2423719820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54d0105bd0 msgr2=0x7f54d019cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.267+0000 7f54ce59c700 1 --2- 172.21.15.2:0/2423719820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54d0105bd0 0x7f54d019cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.267+0000 7f54ce59c700 1 -- 172.21.15.2:0/2423719820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b80095f0 con 0x7f54d00ffc20 2024-09-13T23:04:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.267+0000 7f54ce59c700 1 --2- 172.21.15.2:0/2423719820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54d00ffc20 0x7f54d019c630 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f54c000e920 tx=0x7f54c000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.267+0000 7f54c7fff700 1 -- 172.21.15.2:0/2423719820 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54c000c9d0 con 0x7f54d00ffc20 2024-09-13T23:04:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.267+0000 7f54c7fff700 1 -- 172.21.15.2:0/2423719820 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f54c0010430 con 0x7f54d00ffc20 2024-09-13T23:04:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.267+0000 7f54d4814700 1 -- 172.21.15.2:0/2423719820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d0196990 con 0x7f54d00ffc20 2024-09-13T23:04:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.267+0000 7f54c7fff700 1 -- 172.21.15.2:0/2423719820 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54c0018630 con 0x7f54d00ffc20 2024-09-13T23:04:51.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.267+0000 7f54d4814700 1 -- 172.21.15.2:0/2423719820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d0196ee0 con 0x7f54d00ffc20 2024-09-13T23:04:51.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.268+0000 7f54d4814700 1 -- 172.21.15.2:0/2423719820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d004f2e0 con 0x7f54d00ffc20 2024-09-13T23:04:51.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.269+0000 7f54c7fff700 1 -- 172.21.15.2:0/2423719820 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f54c00105a0 con 0x7f54d00ffc20 2024-09-13T23:04:51.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.269+0000 7f54c7fff700 1 --2- 172.21.15.2:0/2423719820 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f54bc06e680 0x7f54bc070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.269+0000 7f54c7fff700 1 -- 172.21.15.2:0/2423719820 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f54c0014070 con 0x7f54d00ffc20 2024-09-13T23:04:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.269+0000 7f54c5d9b700 1 --2- 172.21.15.2:0/2423719820 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f54bc06e680 0x7f54bc070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:51.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.270+0000 7f54c5d9b700 1 --2- 172.21.15.2:0/2423719820 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f54bc06e680 0x7f54bc070b40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f54d00ffa60 tx=0x7f54b8005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:51.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.274+0000 7f54c7fff700 1 -- 172.21.15.2:0/2423719820 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f54c00541b0 con 0x7f54d00ffc20 2024-09-13T23:04:51.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.503+0000 7f54d4814700 1 -- 172.21.15.2:0/2423719820 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f54d0197260 con 0x7f54bc06e680 2024-09-13T23:04:51.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.504+0000 7f54c7fff700 1 -- 172.21.15.2:0/2423719820 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f54d0197260 con 0x7f54bc06e680 2024-09-13T23:04:51.505 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:04:51.505 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:04:51.505 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T23:04:51.506 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:04:51.506 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-13T23:04:51.506 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-13T23:04:51.506 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-13T23:04:51.506 INFO:teuthology.orchestra.run.smithi002.stdout: "osd", 2024-09-13T23:04:51.506 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2024-09-13T23:04:51.506 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-13T23:04:51.506 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "13/23 daemons upgraded", 2024-09-13T23:04:51.506 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T23:04:51.506 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T23:04:51.506 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:04:51.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.506+0000 7f54d4814700 1 -- 172.21.15.2:0/2423719820 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f54bc06e680 msgr2=0x7f54bc070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:51.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.506+0000 7f54d4814700 1 --2- 172.21.15.2:0/2423719820 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f54bc06e680 0x7f54bc070b40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f54d00ffa60 tx=0x7f54b8005940 comp rx=0 tx=0).stop 2024-09-13T23:04:51.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.506+0000 7f54d4814700 1 -- 172.21.15.2:0/2423719820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54d00ffc20 msgr2=0x7f54d019c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:51.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.506+0000 7f54d4814700 1 --2- 172.21.15.2:0/2423719820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54d00ffc20 0x7f54d019c630 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f54c000e920 tx=0x7f54c000ec30 comp rx=0 tx=0).stop 2024-09-13T23:04:51.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.506+0000 7f54d4814700 1 -- 172.21.15.2:0/2423719820 shutdown_connections 2024-09-13T23:04:51.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.506+0000 7f54d4814700 1 --2- 172.21.15.2:0/2423719820 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f54bc06e680 0x7f54bc070b40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:51.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.506+0000 7f54d4814700 1 --2- 172.21.15.2:0/2423719820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54d00ffc20 0x7f54d019c630 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:51.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.506+0000 7f54d4814700 1 --2- 172.21.15.2:0/2423719820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f54d0105bd0 0x7f54d019cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:51.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.506+0000 7f54d4814700 1 -- 172.21.15.2:0/2423719820 >> 172.21.15.2:0/2423719820 conn(0x7f54d0075670 msgr2=0x7f54d0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:51.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.506+0000 7f54d4814700 1 -- 172.21.15.2:0/2423719820 shutdown_connections 2024-09-13T23:04:51.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.506+0000 7f54d4814700 1 -- 172.21.15.2:0/2423719820 wait complete. 2024-09-13T23:04:51.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.614+0000 7f2db2821700 1 -- 172.21.15.2:0/1518823989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dac101850 msgr2=0x7f2dac1058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:51.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.614+0000 7f2db2821700 1 --2- 172.21.15.2:0/1518823989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dac101850 0x7f2dac1058a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2da0009910 tx=0x7f2da0009c20 comp rx=0 tx=0).stop 2024-09-13T23:04:51.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.614+0000 7f2db2821700 1 -- 172.21.15.2:0/1518823989 shutdown_connections 2024-09-13T23:04:51.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.614+0000 7f2db2821700 1 --2- 172.21.15.2:0/1518823989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dac101850 0x7f2dac1058a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:51.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.614+0000 7f2db2821700 1 --2- 172.21.15.2:0/1518823989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2dac100ea0 0x7f2dac101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:51.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.614+0000 7f2db2821700 1 -- 172.21.15.2:0/1518823989 >> 172.21.15.2:0/1518823989 conn(0x7f2dac0fc750 msgr2=0x7f2dac0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:51.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.614+0000 7f2db2821700 1 -- 172.21.15.2:0/1518823989 shutdown_connections 2024-09-13T23:04:51.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.614+0000 7f2db2821700 1 -- 172.21.15.2:0/1518823989 wait complete. 2024-09-13T23:04:51.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.615+0000 7f2db2821700 1 Processor -- start 2024-09-13T23:04:51.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.615+0000 7f2db2821700 1 -- start start 2024-09-13T23:04:51.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.615+0000 7f2db2821700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dac100ea0 0x7f2dac073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:51.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.615+0000 7f2db2821700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2dac101850 0x7f2dac0735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:51.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.615+0000 7f2db2821700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac073b10 con 0x7f2dac100ea0 2024-09-13T23:04:51.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.615+0000 7f2db2821700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac073c50 con 0x7f2dac101850 2024-09-13T23:04:51.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.615+0000 7f2dabfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dac100ea0 0x7f2dac073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:51.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.615+0000 7f2dabfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dac100ea0 0x7f2dac073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34358/0 (socket says 172.21.15.2:34358) 2024-09-13T23:04:51.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.615+0000 7f2dabfff700 1 -- 172.21.15.2:0/3743109993 learned_addr learned my addr 172.21.15.2:0/3743109993 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:04:51.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.615+0000 7f2dab7fe700 1 --2- 172.21.15.2:0/3743109993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2dac101850 0x7f2dac0735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:51.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.616+0000 7f2dabfff700 1 -- 172.21.15.2:0/3743109993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2dac101850 msgr2=0x7f2dac0735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:51.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.616+0000 7f2dabfff700 1 --2- 172.21.15.2:0/3743109993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2dac101850 0x7f2dac0735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:51.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.616+0000 7f2dabfff700 1 -- 172.21.15.2:0/3743109993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da00095f0 con 0x7f2dac100ea0 2024-09-13T23:04:51.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.616+0000 7f2dabfff700 1 --2- 172.21.15.2:0/3743109993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dac100ea0 0x7f2dac073090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00e920 tx=0x7f2d9c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:51.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.616+0000 7f2da97fa700 1 -- 172.21.15.2:0/3743109993 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d9c00c9d0 con 0x7f2dac100ea0 2024-09-13T23:04:51.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.616+0000 7f2db2821700 1 -- 172.21.15.2:0/3743109993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dac1a2b00 con 0x7f2dac100ea0 2024-09-13T23:04:51.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.616+0000 7f2da97fa700 1 -- 172.21.15.2:0/3743109993 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d9c010430 con 0x7f2dac100ea0 2024-09-13T23:04:51.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.616+0000 7f2da97fa700 1 -- 172.21.15.2:0/3743109993 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d9c018630 con 0x7f2dac100ea0 2024-09-13T23:04:51.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.616+0000 7f2db2821700 1 -- 172.21.15.2:0/3743109993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dac1a2eb0 con 0x7f2dac100ea0 2024-09-13T23:04:51.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.617+0000 7f2db2821700 1 -- 172.21.15.2:0/3743109993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dac1092a0 con 0x7f2dac100ea0 2024-09-13T23:04:51.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.618+0000 7f2da97fa700 1 -- 172.21.15.2:0/3743109993 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f2d9c0105a0 con 0x7f2dac100ea0 2024-09-13T23:04:51.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.618+0000 7f2da97fa700 1 --2- 172.21.15.2:0/3743109993 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2d9406e680 0x7f2d94070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:04:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.618+0000 7f2da97fa700 1 -- 172.21.15.2:0/3743109993 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f2d9c014070 con 0x7f2dac100ea0 2024-09-13T23:04:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.618+0000 7f2dab7fe700 1 --2- 172.21.15.2:0/3743109993 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2d9406e680 0x7f2d94070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:04:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.619+0000 7f2dab7fe700 1 --2- 172.21.15.2:0/3743109993 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2d9406e680 0x7f2d94070b40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2da00059d0 tx=0x7f2da0005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:04:51.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.623+0000 7f2da97fa700 1 -- 172.21.15.2:0/3743109993 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2d9c0541b0 con 0x7f2dac100ea0 2024-09-13T23:04:51.790 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:51 smithi002 ceph-mon[111294]: pgmap v177: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:04:51.790 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:51 smithi002 ceph-mon[111294]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:51.790 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:51 smithi002 ceph-mon[111294]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:51.790 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:51 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/3913530630' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:51.790 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:51 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/2111743193' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:04:51.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.926+0000 7f2db2821700 1 -- 172.21.15.2:0/3743109993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2dac04f2e0 con 0x7f2dac100ea0 2024-09-13T23:04:51.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.926+0000 7f2da97fa700 1 -- 172.21.15.2:0/3743109993 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f2d9c057ad0 con 0x7f2dac100ea0 2024-09-13T23:04:51.928 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T23:04:51.928 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T23:04:51.928 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T23:04:51.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.928+0000 7f2db2821700 1 -- 172.21.15.2:0/3743109993 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2d9406e680 msgr2=0x7f2d94070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:51.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.928+0000 7f2db2821700 1 --2- 172.21.15.2:0/3743109993 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2d9406e680 0x7f2d94070b40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2da00059d0 tx=0x7f2da0005940 comp rx=0 tx=0).stop 2024-09-13T23:04:51.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.928+0000 7f2db2821700 1 -- 172.21.15.2:0/3743109993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dac100ea0 msgr2=0x7f2dac073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:04:51.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.928+0000 7f2db2821700 1 --2- 172.21.15.2:0/3743109993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dac100ea0 0x7f2dac073090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00e920 tx=0x7f2d9c00ec30 comp rx=0 tx=0).stop 2024-09-13T23:04:51.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.928+0000 7f2db2821700 1 -- 172.21.15.2:0/3743109993 shutdown_connections 2024-09-13T23:04:51.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.928+0000 7f2db2821700 1 --2- 172.21.15.2:0/3743109993 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2d9406e680 0x7f2d94070b40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:51.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.928+0000 7f2db2821700 1 --2- 172.21.15.2:0/3743109993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2dac100ea0 0x7f2dac073090 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:51.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.928+0000 7f2db2821700 1 --2- 172.21.15.2:0/3743109993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2dac101850 0x7f2dac0735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:04:51.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.928+0000 7f2db2821700 1 -- 172.21.15.2:0/3743109993 >> 172.21.15.2:0/3743109993 conn(0x7f2dac0fc750 msgr2=0x7f2dac0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:04:51.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.928+0000 7f2db2821700 1 -- 172.21.15.2:0/3743109993 shutdown_connections 2024-09-13T23:04:51.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:04:51.929+0000 7f2db2821700 1 -- 172.21.15.2:0/3743109993 wait complete. 2024-09-13T23:04:52.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:51 smithi047 ceph-mon[81243]: pgmap v177: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:04:52.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:51 smithi047 ceph-mon[81243]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:52.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:51 smithi047 ceph-mon[81243]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:52.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:51 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/3913530630' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:04:52.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:51 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/2111743193' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:04:52.886 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:52 smithi002 ceph-mon[111294]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:52.887 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:52 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/3743109993' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:04:53.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:52 smithi047 ceph-mon[81243]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:04:53.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:52 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/3743109993' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:04:53.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:53 smithi002 ceph-mon[111294]: pgmap v178: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:04:53.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:04:53.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:53.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:53.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:54.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:53 smithi047 ceph-mon[81243]: pgmap v178: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:04:54.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:04:54.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:54.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:54.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:04:55.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:54 smithi002 ceph-mon[111294]: mds.? [v2:172.21.15.2:6828/4224459092,v1:172.21.15.2:6829/4224459092] up:boot 2024-09-13T23:04:55.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:54 smithi002 ceph-mon[111294]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 3 up:standby 2024-09-13T23:04:55.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:54 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.gglyyr"}]: dispatch 2024-09-13T23:04:55.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:54 smithi047 ceph-mon[81243]: mds.? [v2:172.21.15.2:6828/4224459092,v1:172.21.15.2:6829/4224459092] up:boot 2024-09-13T23:04:55.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:54 smithi047 ceph-mon[81243]: fsmap cephfs:1 {0=cephfs.smithi047.gxzkha=up:active} 3 up:standby 2024-09-13T23:04:55.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:54 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.gglyyr"}]: dispatch 2024-09-13T23:04:56.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:55 smithi002 ceph-mon[111294]: pgmap v179: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:04:56.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:55 smithi047 ceph-mon[81243]: pgmap v179: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:04:57.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:57 smithi002 ceph-mon[111294]: pgmap v180: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:04:58.019 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:57 smithi047 ceph-mon[81243]: pgmap v180: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:04:59.875 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:59 smithi002 ceph-mon[111294]: pgmap v181: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:04:59.875 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:59 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:59.876 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:59 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:59.876 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:59 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:59.876 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:04:59 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:59.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:59 smithi047 ceph-mon[81243]: pgmap v181: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:04:59.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:59 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:59.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:59 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:59.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:59 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:04:59.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:04:59 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:01.828 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:01 smithi002 ceph-mon[111294]: pgmap v182: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:05:01.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:01 smithi047 ceph-mon[81243]: pgmap v182: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:05:03.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:03 smithi047 ceph-mon[81243]: pgmap v183: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:05:03.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:03.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:03.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:05:03.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:05:03.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:03.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:05:03.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:03.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:03.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:03.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:03.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:03 smithi002 ceph-mon[111294]: pgmap v183: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:05:03.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:03.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:03.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:05:03.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:05:03.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:03.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:05:03.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:03.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:03.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:03.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:05.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:04 smithi047 ceph-mon[81243]: Upgrade: Updating mds.cephfs.smithi047.gxzkha 2024-09-13T23:05:05.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:04 smithi047 ceph-mon[81243]: pgmap v184: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:05:05.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:04 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:05.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:04 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.gxzkha", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:05:05.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:04 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:05:05.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:04 smithi047 ceph-mon[81243]: Deploying daemon mds.cephfs.smithi047.gxzkha on smithi047 2024-09-13T23:05:05.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:04 smithi002 ceph-mon[111294]: Upgrade: Updating mds.cephfs.smithi047.gxzkha 2024-09-13T23:05:05.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:04 smithi002 ceph-mon[111294]: pgmap v184: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail 2024-09-13T23:05:05.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:04 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:05.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:04 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.gxzkha", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:05:05.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:04 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:05:05.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:04 smithi002 ceph-mon[111294]: Deploying daemon mds.cephfs.smithi047.gxzkha on smithi047 2024-09-13T23:05:05.876 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:05 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002[111290]: 2024-09-13T23:05:05.566+0000 7fb0c61c6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T23:05:06.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:05 smithi047 ceph-mon[81243]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T23:05:06.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:05 smithi047 ceph-mon[81243]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T23:05:06.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:05 smithi047 ceph-mon[81243]: osdmap e84: 6 total, 6 up, 6 in 2024-09-13T23:05:06.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:05 smithi047 ceph-mon[81243]: Standby daemon mds.cephfs.smithi047.nqvveh assigned to filesystem cephfs as rank 0 2024-09-13T23:05:06.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:05 smithi047 ceph-mon[81243]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T23:05:06.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:05 smithi047 ceph-mon[81243]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T23:05:06.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:05 smithi047 ceph-mon[81243]: fsmap cephfs:1/1 {0=cephfs.smithi047.nqvveh=up:replay} 2 up:standby 2024-09-13T23:05:06.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:05 smithi002 ceph-mon[111294]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T23:05:06.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:05 smithi002 ceph-mon[111294]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T23:05:06.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:05 smithi002 ceph-mon[111294]: osdmap e84: 6 total, 6 up, 6 in 2024-09-13T23:05:06.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:05 smithi002 ceph-mon[111294]: Standby daemon mds.cephfs.smithi047.nqvveh assigned to filesystem cephfs as rank 0 2024-09-13T23:05:06.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:05 smithi002 ceph-mon[111294]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T23:05:06.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:05 smithi002 ceph-mon[111294]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T23:05:06.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:05 smithi002 ceph-mon[111294]: fsmap cephfs:1/1 {0=cephfs.smithi047.nqvveh=up:replay} 2 up:standby 2024-09-13T23:05:07.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:07 smithi047 ceph-mon[81243]: pgmap v186: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 819 KiB/s rd, 0 op/s 2024-09-13T23:05:07.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:07 smithi002 ceph-mon[111294]: pgmap v186: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 819 KiB/s rd, 0 op/s 2024-09-13T23:05:09.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:09.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:05:09.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:08 smithi047 ceph-mon[81243]: pgmap v187: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 5.2 MiB/s rd, 2 op/s 2024-09-13T23:05:09.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:09.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:05:09.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:08 smithi002 ceph-mon[111294]: pgmap v187: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 5.2 MiB/s rd, 2 op/s 2024-09-13T23:05:11.142 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:10 smithi047 ceph-mon[81243]: pgmap v188: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 6.0 MiB/s rd, 2 op/s 2024-09-13T23:05:11.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:10 smithi002 ceph-mon[111294]: pgmap v188: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 6.0 MiB/s rd, 2 op/s 2024-09-13T23:05:13.216 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:13 smithi047 ceph-mon[81243]: pgmap v189: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-13T23:05:13.216 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:13 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:13.216 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:13 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:13.216 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:13 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:05:13.217 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:13 smithi047 ceph-mon[81243]: mds.? [v2:172.21.15.47:6824/1060893681,v1:172.21.15.47:6825/1060893681] up:boot 2024-09-13T23:05:13.217 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:13 smithi047 ceph-mon[81243]: fsmap cephfs:1/1 {0=cephfs.smithi047.nqvveh=up:replay} 3 up:standby 2024-09-13T23:05:13.217 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:13 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.gxzkha"}]: dispatch 2024-09-13T23:05:13.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:13 smithi002 ceph-mon[111294]: pgmap v189: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-13T23:05:13.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:13 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:13.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:13 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:13.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:13 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:05:13.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:13 smithi002 ceph-mon[111294]: mds.? [v2:172.21.15.47:6824/1060893681,v1:172.21.15.47:6825/1060893681] up:boot 2024-09-13T23:05:13.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:13 smithi002 ceph-mon[111294]: fsmap cephfs:1/1 {0=cephfs.smithi047.nqvveh=up:replay} 3 up:standby 2024-09-13T23:05:13.501 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:13 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.gxzkha"}]: dispatch 2024-09-13T23:05:15.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:15 smithi047 ceph-mon[81243]: pgmap v190: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-13T23:05:15.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:15 smithi002 ceph-mon[111294]: pgmap v190: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-13T23:05:16.632 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:16 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:16.632 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:16 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:16.632 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:16 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:16.632 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:16 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:16.633 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:16 smithi047 ceph-mon[81243]: mds.? [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] up:reconnect 2024-09-13T23:05:16.633 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:16 smithi047 ceph-mon[81243]: fsmap cephfs:1/1 {0=cephfs.smithi047.nqvveh=up:reconnect} 3 up:standby 2024-09-13T23:05:16.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:16 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:16.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:16 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:16.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:16 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:16.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:16 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:16.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:16 smithi002 ceph-mon[111294]: mds.? [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] up:reconnect 2024-09-13T23:05:16.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:16 smithi002 ceph-mon[111294]: fsmap cephfs:1/1 {0=cephfs.smithi047.nqvveh=up:reconnect} 3 up:standby 2024-09-13T23:05:17.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:17 smithi047 ceph-mon[81243]: pgmap v191: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 6 op/s 2024-09-13T23:05:17.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:17 smithi047 ceph-mon[81243]: reconnect by client.24309 192.168.0.1:0/3679635712 after 0.000999979 2024-09-13T23:05:17.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:17 smithi047 ceph-mon[81243]: reconnect by client.14524 192.168.0.1:0/4269068546 after 0.000999979 2024-09-13T23:05:17.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:17 smithi047 ceph-mon[81243]: mds.? [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] up:rejoin 2024-09-13T23:05:17.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:17 smithi047 ceph-mon[81243]: fsmap cephfs:1/1 {0=cephfs.smithi047.nqvveh=up:rejoin} 3 up:standby 2024-09-13T23:05:17.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:17 smithi047 ceph-mon[81243]: daemon mds.cephfs.smithi047.nqvveh is now active in filesystem cephfs as rank 0 2024-09-13T23:05:17.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:17 smithi002 ceph-mon[111294]: pgmap v191: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 6 op/s 2024-09-13T23:05:17.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:17 smithi002 ceph-mon[111294]: reconnect by client.24309 192.168.0.1:0/3679635712 after 0.000999979 2024-09-13T23:05:17.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:17 smithi002 ceph-mon[111294]: reconnect by client.14524 192.168.0.1:0/4269068546 after 0.000999979 2024-09-13T23:05:17.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:17 smithi002 ceph-mon[111294]: mds.? [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] up:rejoin 2024-09-13T23:05:17.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:17 smithi002 ceph-mon[111294]: fsmap cephfs:1/1 {0=cephfs.smithi047.nqvveh=up:rejoin} 3 up:standby 2024-09-13T23:05:17.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:17 smithi002 ceph-mon[111294]: daemon mds.cephfs.smithi047.nqvveh is now active in filesystem cephfs as rank 0 2024-09-13T23:05:18.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:18 smithi002 ceph-mon[111294]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T23:05:18.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:18 smithi002 ceph-mon[111294]: mds.? [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] up:active 2024-09-13T23:05:18.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:18 smithi002 ceph-mon[111294]: fsmap cephfs:1 {0=cephfs.smithi047.nqvveh=up:active} 3 up:standby 2024-09-13T23:05:18.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:18 smithi047 ceph-mon[81243]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T23:05:18.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:18 smithi047 ceph-mon[81243]: mds.? [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] up:active 2024-09-13T23:05:18.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:18 smithi047 ceph-mon[81243]: fsmap cephfs:1 {0=cephfs.smithi047.nqvveh=up:active} 3 up:standby 2024-09-13T23:05:19.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:19 smithi047 ceph-mon[81243]: pgmap v192: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 5 op/s 2024-09-13T23:05:19.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:19 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:19.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:19 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:19.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:19 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:05:19.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:19 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:05:19.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:19 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:19.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:19 smithi002 ceph-mon[111294]: pgmap v192: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 5 op/s 2024-09-13T23:05:19.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:19 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:19.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:19 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:19.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:19 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:05:19.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:19 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:05:19.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:19 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:20.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:20 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:05:20.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:20 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:20.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:20 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:20.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:20 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:20.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:20 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:20.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:20 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:05:20.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:20 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:20.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:20 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:20.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:20 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:20.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:20 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:21.640 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:21 smithi047 ceph-mon[81243]: pgmap v193: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 4 op/s 2024-09-13T23:05:21.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:21 smithi002 ceph-mon[111294]: pgmap v193: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 4 op/s 2024-09-13T23:05:22.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.051+0000 7f8ca3de6700 1 -- 172.21.15.2:0/942913975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c100320 msgr2=0x7f8c9c10cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:22.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.051+0000 7f8ca3de6700 1 --2- 172.21.15.2:0/942913975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c100320 0x7f8c9c10cfe0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c009910 tx=0x7f8c8c009c20 comp rx=0 tx=0).stop 2024-09-13T23:05:22.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.051+0000 7f8ca3de6700 1 -- 172.21.15.2:0/942913975 shutdown_connections 2024-09-13T23:05:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.051+0000 7f8ca3de6700 1 --2- 172.21.15.2:0/942913975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c100320 0x7f8c9c10cfe0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.051+0000 7f8ca3de6700 1 --2- 172.21.15.2:0/942913975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c9c0ff970 0x7f8c9c0ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.051+0000 7f8ca3de6700 1 -- 172.21.15.2:0/942913975 >> 172.21.15.2:0/942913975 conn(0x7f8c9c0fb650 msgr2=0x7f8c9c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.051+0000 7f8ca3de6700 1 -- 172.21.15.2:0/942913975 shutdown_connections 2024-09-13T23:05:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.051+0000 7f8ca3de6700 1 -- 172.21.15.2:0/942913975 wait complete. 2024-09-13T23:05:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.052+0000 7f8ca3de6700 1 Processor -- start 2024-09-13T23:05:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.052+0000 7f8ca3de6700 1 -- start start 2024-09-13T23:05:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.052+0000 7f8ca3de6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c9c0ff970 0x7f8c9c19e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.052+0000 7f8ca3de6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c100320 0x7f8c9c19ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.052+0000 7f8ca3de6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c19f3f0 con 0x7f8c9c100320 2024-09-13T23:05:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.052+0000 7f8ca3de6700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c1988a0 con 0x7f8c9c0ff970 2024-09-13T23:05:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.053+0000 7f8ca1381700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c100320 0x7f8c9c19ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.053+0000 7f8ca1381700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c100320 0x7f8c9c19ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54064/0 (socket says 172.21.15.2:54064) 2024-09-13T23:05:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.053+0000 7f8ca1381700 1 -- 172.21.15.2:0/2370924801 learned_addr learned my addr 172.21.15.2:0/2370924801 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:05:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.053+0000 7f8ca1b82700 1 --2- 172.21.15.2:0/2370924801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c9c0ff970 0x7f8c9c19e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.053+0000 7f8ca1381700 1 -- 172.21.15.2:0/2370924801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c9c0ff970 msgr2=0x7f8c9c19e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.053+0000 7f8ca1381700 1 --2- 172.21.15.2:0/2370924801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c9c0ff970 0x7f8c9c19e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.053+0000 7f8ca1381700 1 -- 172.21.15.2:0/2370924801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c0095f0 con 0x7f8c9c100320 2024-09-13T23:05:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.053+0000 7f8ca1381700 1 --2- 172.21.15.2:0/2370924801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c100320 0x7f8c9c19ed60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c000c00 tx=0x7f8c8c0055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.053+0000 7f8c92ffd700 1 -- 172.21.15.2:0/2370924801 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c8c01d070 con 0x7f8c9c100320 2024-09-13T23:05:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.053+0000 7f8c92ffd700 1 -- 172.21.15.2:0/2370924801 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c8c005dc0 con 0x7f8c9c100320 2024-09-13T23:05:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.053+0000 7f8ca3de6700 1 -- 172.21.15.2:0/2370924801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9c198b20 con 0x7f8c9c100320 2024-09-13T23:05:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.053+0000 7f8c92ffd700 1 -- 172.21.15.2:0/2370924801 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c8c021410 con 0x7f8c9c100320 2024-09-13T23:05:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.053+0000 7f8ca3de6700 1 -- 172.21.15.2:0/2370924801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9c199070 con 0x7f8c9c100320 2024-09-13T23:05:22.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.054+0000 7f8ca3de6700 1 -- 172.21.15.2:0/2370924801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9c10a750 con 0x7f8c9c100320 2024-09-13T23:05:22.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.055+0000 7f8c92ffd700 1 -- 172.21.15.2:0/2370924801 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f8c8c00f460 con 0x7f8c9c100320 2024-09-13T23:05:22.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.056+0000 7f8c92ffd700 1 --2- 172.21.15.2:0/2370924801 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f8c8806e680 0x7f8c88070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:22.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.056+0000 7f8c92ffd700 1 -- 172.21.15.2:0/2370924801 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f8c8c08f880 con 0x7f8c9c100320 2024-09-13T23:05:22.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.056+0000 7f8ca1b82700 1 --2- 172.21.15.2:0/2370924801 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f8c8806e680 0x7f8c88070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:22.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.056+0000 7f8ca1b82700 1 --2- 172.21.15.2:0/2370924801 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f8c8806e680 0x7f8c88070b40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8c98005950 tx=0x7f8c9800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:22.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.060+0000 7f8c92ffd700 1 -- 172.21.15.2:0/2370924801 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8c8c05c5a0 con 0x7f8c9c100320 2024-09-13T23:05:22.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.288+0000 7f8ca3de6700 1 -- 172.21.15.2:0/2370924801 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c9c199350 con 0x7f8c8806e680 2024-09-13T23:05:22.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.289+0000 7f8c92ffd700 1 -- 172.21.15.2:0/2370924801 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8c9c199350 con 0x7f8c8806e680 2024-09-13T23:05:22.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.291+0000 7f8ca3de6700 1 -- 172.21.15.2:0/2370924801 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f8c8806e680 msgr2=0x7f8c88070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:22.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.291+0000 7f8ca3de6700 1 --2- 172.21.15.2:0/2370924801 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f8c8806e680 0x7f8c88070b40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8c98005950 tx=0x7f8c9800b410 comp rx=0 tx=0).stop 2024-09-13T23:05:22.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.291+0000 7f8ca3de6700 1 -- 172.21.15.2:0/2370924801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c100320 msgr2=0x7f8c9c19ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:22.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.291+0000 7f8ca3de6700 1 --2- 172.21.15.2:0/2370924801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c100320 0x7f8c9c19ed60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c000c00 tx=0x7f8c8c0055f0 comp rx=0 tx=0).stop 2024-09-13T23:05:22.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.291+0000 7f8ca3de6700 1 -- 172.21.15.2:0/2370924801 shutdown_connections 2024-09-13T23:05:22.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.291+0000 7f8ca3de6700 1 --2- 172.21.15.2:0/2370924801 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f8c8806e680 0x7f8c88070b40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:22.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.291+0000 7f8ca3de6700 1 --2- 172.21.15.2:0/2370924801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c9c0ff970 0x7f8c9c19e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:22.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.291+0000 7f8ca3de6700 1 --2- 172.21.15.2:0/2370924801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c9c100320 0x7f8c9c19ed60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:22.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.291+0000 7f8ca3de6700 1 -- 172.21.15.2:0/2370924801 >> 172.21.15.2:0/2370924801 conn(0x7f8c9c0fb650 msgr2=0x7f8c9c0fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:22.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.291+0000 7f8ca3de6700 1 -- 172.21.15.2:0/2370924801 shutdown_connections 2024-09-13T23:05:22.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.291+0000 7f8ca3de6700 1 -- 172.21.15.2:0/2370924801 wait complete. 2024-09-13T23:05:22.304 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T23:05:22.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.401+0000 7f2e2fc42700 1 -- 172.21.15.2:0/569923343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e28100750 msgr2=0x7f2e281047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:22.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.401+0000 7f2e2fc42700 1 --2- 172.21.15.2:0/569923343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e28100750 0x7f2e281047a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009910 tx=0x7f2e18009c20 comp rx=0 tx=0).stop 2024-09-13T23:05:22.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.401+0000 7f2e2fc42700 1 -- 172.21.15.2:0/569923343 shutdown_connections 2024-09-13T23:05:22.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.401+0000 7f2e2fc42700 1 --2- 172.21.15.2:0/569923343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e28100750 0x7f2e281047a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:22.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.401+0000 7f2e2fc42700 1 --2- 172.21.15.2:0/569923343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e280ffda0 0x7f2e28100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:22.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.401+0000 7f2e2fc42700 1 -- 172.21.15.2:0/569923343 >> 172.21.15.2:0/569923343 conn(0x7f2e280fb650 msgr2=0x7f2e280fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:22.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.401+0000 7f2e2fc42700 1 -- 172.21.15.2:0/569923343 shutdown_connections 2024-09-13T23:05:22.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.401+0000 7f2e2fc42700 1 -- 172.21.15.2:0/569923343 wait complete. 2024-09-13T23:05:22.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.401+0000 7f2e2fc42700 1 Processor -- start 2024-09-13T23:05:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.401+0000 7f2e2fc42700 1 -- start start 2024-09-13T23:05:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.402+0000 7f2e2fc42700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e280ffda0 0x7f2e28197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.402+0000 7f2e2fc42700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e28100750 0x7f2e28197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.402+0000 7f2e2fc42700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e281982f0 con 0x7f2e28100750 2024-09-13T23:05:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.402+0000 7f2e2fc42700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e28198430 con 0x7f2e280ffda0 2024-09-13T23:05:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.402+0000 7f2e2d1dd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e28100750 0x7f2e28197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.402+0000 7f2e2d1dd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e28100750 0x7f2e28197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54094/0 (socket says 172.21.15.2:54094) 2024-09-13T23:05:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.402+0000 7f2e2d1dd700 1 -- 172.21.15.2:0/1509197381 learned_addr learned my addr 172.21.15.2:0/1509197381 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:05:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.402+0000 7f2e2d9de700 1 --2- 172.21.15.2:0/1509197381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e280ffda0 0x7f2e28197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.402+0000 7f2e2d1dd700 1 -- 172.21.15.2:0/1509197381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e280ffda0 msgr2=0x7f2e28197760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.402+0000 7f2e2d1dd700 1 --2- 172.21.15.2:0/1509197381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e280ffda0 0x7f2e28197760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.402+0000 7f2e2d1dd700 1 -- 172.21.15.2:0/1509197381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e180095f0 con 0x7f2e28100750 2024-09-13T23:05:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.402+0000 7f2e2d1dd700 1 --2- 172.21.15.2:0/1509197381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e28100750 0x7f2e28197ca0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2e1800bda0 tx=0x7f2e1800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.402+0000 7f2e1effd700 1 -- 172.21.15.2:0/1509197381 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e1801d070 con 0x7f2e28100750 2024-09-13T23:05:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.402+0000 7f2e1effd700 1 -- 172.21.15.2:0/1509197381 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e18004fb0 con 0x7f2e28100750 2024-09-13T23:05:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.403+0000 7f2e2fc42700 1 -- 172.21.15.2:0/1509197381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e281a07d0 con 0x7f2e28100750 2024-09-13T23:05:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.403+0000 7f2e1effd700 1 -- 172.21.15.2:0/1509197381 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e1800f480 con 0x7f2e28100750 2024-09-13T23:05:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.403+0000 7f2e2fc42700 1 -- 172.21.15.2:0/1509197381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e281a0be0 con 0x7f2e28100750 2024-09-13T23:05:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.403+0000 7f2e2fc42700 1 -- 172.21.15.2:0/1509197381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e281081a0 con 0x7f2e28100750 2024-09-13T23:05:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.404+0000 7f2e1effd700 1 -- 172.21.15.2:0/1509197381 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f2e18022870 con 0x7f2e28100750 2024-09-13T23:05:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.405+0000 7f2e1effd700 1 --2- 172.21.15.2:0/1509197381 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2e1406e680 0x7f2e14070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.405+0000 7f2e1effd700 1 -- 172.21.15.2:0/1509197381 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f2e1808fb50 con 0x7f2e28100750 2024-09-13T23:05:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.405+0000 7f2e2d9de700 1 --2- 172.21.15.2:0/1509197381 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2e1406e680 0x7f2e14070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.405+0000 7f2e2d9de700 1 --2- 172.21.15.2:0/1509197381 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2e1406e680 0x7f2e14070b40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400e270 tx=0x7f2e24009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:22.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.409+0000 7f2e1effd700 1 -- 172.21.15.2:0/1509197381 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2e18058df0 con 0x7f2e28100750 2024-09-13T23:05:22.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.639+0000 7f2e2fc42700 1 -- 172.21.15.2:0/1509197381 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e28069520 con 0x7f2e1406e680 2024-09-13T23:05:22.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.640+0000 7f2e1effd700 1 -- 172.21.15.2:0/1509197381 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2e28069520 con 0x7f2e1406e680 2024-09-13T23:05:22.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.642+0000 7f2e2fc42700 1 -- 172.21.15.2:0/1509197381 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2e1406e680 msgr2=0x7f2e14070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:22.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.642+0000 7f2e2fc42700 1 --2- 172.21.15.2:0/1509197381 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2e1406e680 0x7f2e14070b40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400e270 tx=0x7f2e24009040 comp rx=0 tx=0).stop 2024-09-13T23:05:22.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.642+0000 7f2e2fc42700 1 -- 172.21.15.2:0/1509197381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e28100750 msgr2=0x7f2e28197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:22.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.642+0000 7f2e2fc42700 1 --2- 172.21.15.2:0/1509197381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e28100750 0x7f2e28197ca0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2e1800bda0 tx=0x7f2e1800be80 comp rx=0 tx=0).stop 2024-09-13T23:05:22.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.642+0000 7f2e2fc42700 1 -- 172.21.15.2:0/1509197381 shutdown_connections 2024-09-13T23:05:22.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.642+0000 7f2e2fc42700 1 --2- 172.21.15.2:0/1509197381 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2e1406e680 0x7f2e14070b40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:22.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.642+0000 7f2e2fc42700 1 --2- 172.21.15.2:0/1509197381 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e280ffda0 0x7f2e28197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:22.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.642+0000 7f2e2fc42700 1 --2- 172.21.15.2:0/1509197381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e28100750 0x7f2e28197ca0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:22.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.642+0000 7f2e2fc42700 1 -- 172.21.15.2:0/1509197381 >> 172.21.15.2:0/1509197381 conn(0x7f2e280fb650 msgr2=0x7f2e280fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:22.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.642+0000 7f2e2fc42700 1 -- 172.21.15.2:0/1509197381 shutdown_connections 2024-09-13T23:05:22.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.642+0000 7f2e2fc42700 1 -- 172.21.15.2:0/1509197381 wait complete. 2024-09-13T23:05:22.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.750+0000 7f75b4fb8700 1 -- 172.21.15.2:0/1756019552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75b00ff410 msgr2=0x7f75b00ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:22.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.750+0000 7f75b4fb8700 1 --2- 172.21.15.2:0/1756019552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75b00ff410 0x7f75b00ff890 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009910 tx=0x7f75a4009c20 comp rx=0 tx=0).stop 2024-09-13T23:05:22.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.750+0000 7f75b4fb8700 1 -- 172.21.15.2:0/1756019552 shutdown_connections 2024-09-13T23:05:22.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.750+0000 7f75b4fb8700 1 --2- 172.21.15.2:0/1756019552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75b00ff410 0x7f75b00ff890 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:22.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.750+0000 7f75b4fb8700 1 --2- 172.21.15.2:0/1756019552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75b0106db0 0x7f75b0107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:22.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.750+0000 7f75b4fb8700 1 -- 172.21.15.2:0/1756019552 >> 172.21.15.2:0/1756019552 conn(0x7f75b0074e30 msgr2=0x7f75b0075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:22.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.750+0000 7f75b4fb8700 1 -- 172.21.15.2:0/1756019552 shutdown_connections 2024-09-13T23:05:22.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.750+0000 7f75b4fb8700 1 -- 172.21.15.2:0/1756019552 wait complete. 2024-09-13T23:05:22.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.751+0000 7f75b4fb8700 1 Processor -- start 2024-09-13T23:05:22.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.751+0000 7f75b4fb8700 1 -- start start 2024-09-13T23:05:22.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.751+0000 7f75b4fb8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75b00ff410 0x7f75b01005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:22.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.751+0000 7f75b4fb8700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75b0106db0 0x7f75b0100b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:22.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.751+0000 7f75b4fb8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b0101070 con 0x7f75b00ff410 2024-09-13T23:05:22.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.751+0000 7f75b4fb8700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b01011b0 con 0x7f75b0106db0 2024-09-13T23:05:22.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.751+0000 7f75ae59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75b00ff410 0x7f75b01005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:22.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.751+0000 7f75ae59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75b00ff410 0x7f75b01005f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54106/0 (socket says 172.21.15.2:54106) 2024-09-13T23:05:22.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.751+0000 7f75ae59c700 1 -- 172.21.15.2:0/2929579188 learned_addr learned my addr 172.21.15.2:0/2929579188 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:05:22.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.751+0000 7f75add9b700 1 --2- 172.21.15.2:0/2929579188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75b0106db0 0x7f75b0100b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:22.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.752+0000 7f75ae59c700 1 -- 172.21.15.2:0/2929579188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75b0106db0 msgr2=0x7f75b0100b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:22.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.752+0000 7f75ae59c700 1 --2- 172.21.15.2:0/2929579188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75b0106db0 0x7f75b0100b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:22.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.752+0000 7f75ae59c700 1 -- 172.21.15.2:0/2929579188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a40095f0 con 0x7f75b00ff410 2024-09-13T23:05:22.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.752+0000 7f75ae59c700 1 --2- 172.21.15.2:0/2929579188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75b00ff410 0x7f75b01005f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f75a000d900 tx=0x7f75a000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:22.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.752+0000 7f759f7fe700 1 -- 172.21.15.2:0/2929579188 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75a0004a00 con 0x7f75b00ff410 2024-09-13T23:05:22.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.752+0000 7f759f7fe700 1 -- 172.21.15.2:0/2929579188 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f75a00054e0 con 0x7f75b00ff410 2024-09-13T23:05:22.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.752+0000 7f75b4fb8700 1 -- 172.21.15.2:0/2929579188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b01a2bf0 con 0x7f75b00ff410 2024-09-13T23:05:22.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.752+0000 7f759f7fe700 1 -- 172.21.15.2:0/2929579188 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75a0009d00 con 0x7f75b00ff410 2024-09-13T23:05:22.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.752+0000 7f75b4fb8700 1 -- 172.21.15.2:0/2929579188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b01a3000 con 0x7f75b00ff410 2024-09-13T23:05:22.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.753+0000 7f75b4fb8700 1 -- 172.21.15.2:0/2929579188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b0109300 con 0x7f75b00ff410 2024-09-13T23:05:22.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.754+0000 7f759f7fe700 1 -- 172.21.15.2:0/2929579188 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f75a0005020 con 0x7f75b00ff410 2024-09-13T23:05:22.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.754+0000 7f759f7fe700 1 --2- 172.21.15.2:0/2929579188 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f759806e680 0x7f7598070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:22.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.755+0000 7f75add9b700 1 --2- 172.21.15.2:0/2929579188 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f759806e680 0x7f7598070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:22.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.755+0000 7f759f7fe700 1 -- 172.21.15.2:0/2929579188 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f75a008e630 con 0x7f75b00ff410 2024-09-13T23:05:22.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.755+0000 7f75add9b700 1 --2- 172.21.15.2:0/2929579188 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f759806e680 0x7f7598070b40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f75b0101de0 tx=0x7f75a401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:22.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.759+0000 7f759f7fe700 1 -- 172.21.15.2:0/2929579188 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f75a0057780 con 0x7f75b00ff410 2024-09-13T23:05:22.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.977+0000 7f75b4fb8700 1 -- 172.21.15.2:0/2929579188 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f75b00611d0 con 0x7f759806e680 2024-09-13T23:05:22.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.986+0000 7f759f7fe700 1 -- 172.21.15.2:0/2929579188 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f75b00611d0 con 0x7f759806e680 2024-09-13T23:05:22.989 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:05:22.989 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (6m) 24s ago 17m 26.0M - 0.25.0 c8568f914cd2 f570a73274bc 2024-09-13T23:05:22.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (17m) 24s ago 17m 8933k - 18.2.1 5be31c24972a 19309dec779c 2024-09-13T23:05:22.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (16m) 7s ago 16m 8904k - 18.2.1 5be31c24972a 3e4245c0c842 2024-09-13T23:05:22.989 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (4m) 24s ago 17m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 427cd38a7d88 2024-09-13T23:05:22.989 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (4m) 7s ago 16m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 ce5a1df96005 2024-09-13T23:05:22.989 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (6m) 24s ago 17m 81.2M - 9.4.12 2bacad6d85d8 650673516b69 2024-09-13T23:05:22.989 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (47s) 24s ago 12m 13.1M - 19.1.1-324-gecab7be5 0652ff2b5d78 6c66160ad777 2024-09-13T23:05:22.989 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (29s) 24s ago 12m 14.5M - 19.1.1-324-gecab7be5 0652ff2b5d78 f3dd67424bdb 2024-09-13T23:05:22.989 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (11s) 7s ago 12m 10.8M - 19.1.1-324-gecab7be5 0652ff2b5d78 9e8e78202975 2024-09-13T23:05:22.989 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (12m) 7s ago 12m 241M - 18.2.1 5be31c24972a 645f12d6268b 2024-09-13T23:05:22.989 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 running (8m) 24s ago 19m 503M - 19.1.1-324-gecab7be5 0652ff2b5d78 7a8aa9de37e4 2024-09-13T23:05:22.990 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (7m) 7s ago 16m 442M - 19.1.1-324-gecab7be5 0652ff2b5d78 13fa6f3b5a8a 2024-09-13T23:05:22.990 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (5m) 24s ago 19m 54.9M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 db0ef6c509cf 2024-09-13T23:05:22.990 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (5m) 7s ago 16m 42.3M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 ea0c2a2e0e1a 2024-09-13T23:05:22.990 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (7m) 24s ago 17m 14.9M - 1.5.0 0da6a335fe13 f3eae5f90ab8 2024-09-13T23:05:22.990 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (7m) 7s ago 16m 15.9M - 1.5.0 0da6a335fe13 a5c7d7f1eaa5 2024-09-13T23:05:22.990 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (3m) 24s ago 15m 88.3M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 0ca6dd66fa68 2024-09-13T23:05:22.990 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (3m) 24s ago 15m 89.3M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 6f5ae2cfa818 2024-09-13T23:05:22.990 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (2m) 24s ago 14m 78.0M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 15b9e8db7556 2024-09-13T23:05:22.990 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (2m) 7s ago 14m 113M 2241M 19.1.1-324-gecab7be5 0652ff2b5d78 de54fd3fea34 2024-09-13T23:05:22.990 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (97s) 7s ago 14m 88.6M 2241M 19.1.1-324-gecab7be5 0652ff2b5d78 185d7ae7181b 2024-09-13T23:05:22.990 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (64s) 7s ago 13m 89.9M 2241M 19.1.1-324-gecab7be5 0652ff2b5d78 aeb44a823828 2024-09-13T23:05:22.990 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (7m) 24s ago 17m 76.8M - 2.43.0 a07b618ecd1d aa241d1048de 2024-09-13T23:05:22.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.989+0000 7f75b4fb8700 1 -- 172.21.15.2:0/2929579188 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f759806e680 msgr2=0x7f7598070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:22.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.989+0000 7f75b4fb8700 1 --2- 172.21.15.2:0/2929579188 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f759806e680 0x7f7598070b40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f75b0101de0 tx=0x7f75a401a040 comp rx=0 tx=0).stop 2024-09-13T23:05:22.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.989+0000 7f75b4fb8700 1 -- 172.21.15.2:0/2929579188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75b00ff410 msgr2=0x7f75b01005f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:22.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.989+0000 7f75b4fb8700 1 --2- 172.21.15.2:0/2929579188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75b00ff410 0x7f75b01005f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f75a000d900 tx=0x7f75a000dc10 comp rx=0 tx=0).stop 2024-09-13T23:05:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.989+0000 7f75b4fb8700 1 -- 172.21.15.2:0/2929579188 shutdown_connections 2024-09-13T23:05:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.989+0000 7f75b4fb8700 1 --2- 172.21.15.2:0/2929579188 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f759806e680 0x7f7598070b40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.989+0000 7f75b4fb8700 1 --2- 172.21.15.2:0/2929579188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75b00ff410 0x7f75b01005f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.989+0000 7f75b4fb8700 1 --2- 172.21.15.2:0/2929579188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75b0106db0 0x7f75b0100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.989+0000 7f75b4fb8700 1 -- 172.21.15.2:0/2929579188 >> 172.21.15.2:0/2929579188 conn(0x7f75b0074e30 msgr2=0x7f75b00fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.989+0000 7f75b4fb8700 1 -- 172.21.15.2:0/2929579188 shutdown_connections 2024-09-13T23:05:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:22.989+0000 7f75b4fb8700 1 -- 172.21.15.2:0/2929579188 wait complete. 2024-09-13T23:05:23.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.096+0000 7fa10abb5700 1 -- 172.21.15.2:0/583109972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa104100ea0 msgr2=0x7fa104101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:23.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.096+0000 7fa10abb5700 1 --2- 172.21.15.2:0/583109972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa104100ea0 0x7fa104101280 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa10000b0a0 tx=0x7fa10000b3b0 comp rx=0 tx=0).stop 2024-09-13T23:05:23.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.096+0000 7fa10abb5700 1 -- 172.21.15.2:0/583109972 shutdown_connections 2024-09-13T23:05:23.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.096+0000 7fa10abb5700 1 --2- 172.21.15.2:0/583109972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa104101850 0x7fa1041058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:23.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.096+0000 7fa10abb5700 1 --2- 172.21.15.2:0/583109972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa104100ea0 0x7fa104101280 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:23.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.096+0000 7fa10abb5700 1 -- 172.21.15.2:0/583109972 >> 172.21.15.2:0/583109972 conn(0x7fa1040fc750 msgr2=0x7fa1040feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:23.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.096+0000 7fa10abb5700 1 -- 172.21.15.2:0/583109972 shutdown_connections 2024-09-13T23:05:23.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.096+0000 7fa10abb5700 1 -- 172.21.15.2:0/583109972 wait complete. 2024-09-13T23:05:23.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.097+0000 7fa10abb5700 1 Processor -- start 2024-09-13T23:05:23.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.097+0000 7fa10abb5700 1 -- start start 2024-09-13T23:05:23.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.097+0000 7fa10abb5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa104100ea0 0x7fa10419c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:23.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.097+0000 7fa10abb5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa104101850 0x7fa10419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:23.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.097+0000 7fa10abb5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10419d2e0 con 0x7fa104101850 2024-09-13T23:05:23.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.097+0000 7fa10abb5700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa104196790 con 0x7fa104100ea0 2024-09-13T23:05:23.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.097+0000 7fa0fbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa104101850 0x7fa10419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:23.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.097+0000 7fa0fbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa104101850 0x7fa10419cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54122/0 (socket says 172.21.15.2:54122) 2024-09-13T23:05:23.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.097+0000 7fa0fbfff700 1 -- 172.21.15.2:0/1625615404 learned_addr learned my addr 172.21.15.2:0/1625615404 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:05:23.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.097+0000 7fa108951700 1 --2- 172.21.15.2:0/1625615404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa104100ea0 0x7fa10419c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:23.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.098+0000 7fa0fbfff700 1 -- 172.21.15.2:0/1625615404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa104100ea0 msgr2=0x7fa10419c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:23.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.098+0000 7fa0fbfff700 1 --2- 172.21.15.2:0/1625615404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa104100ea0 0x7fa10419c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:23.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.098+0000 7fa0fbfff700 1 -- 172.21.15.2:0/1625615404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa100009d00 con 0x7fa104101850 2024-09-13T23:05:23.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.098+0000 7fa0fbfff700 1 --2- 172.21.15.2:0/1625615404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa104101850 0x7fa10419cc50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400e8f0 tx=0x7fa0f400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:23.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.098+0000 7fa0f9ffb700 1 -- 172.21.15.2:0/1625615404 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0f4009790 con 0x7fa104101850 2024-09-13T23:05:23.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.098+0000 7fa0f9ffb700 1 -- 172.21.15.2:0/1625615404 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0f4004cf0 con 0x7fa104101850 2024-09-13T23:05:23.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.098+0000 7fa0f9ffb700 1 -- 172.21.15.2:0/1625615404 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0f4005690 con 0x7fa104101850 2024-09-13T23:05:23.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.098+0000 7fa10abb5700 1 -- 172.21.15.2:0/1625615404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa104196a70 con 0x7fa104101850 2024-09-13T23:05:23.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.098+0000 7fa10abb5700 1 -- 172.21.15.2:0/1625615404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa104196f70 con 0x7fa104101850 2024-09-13T23:05:23.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.099+0000 7fa10abb5700 1 -- 172.21.15.2:0/1625615404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa104109240 con 0x7fa104101850 2024-09-13T23:05:23.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.100+0000 7fa0f9ffb700 1 -- 172.21.15.2:0/1625615404 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fa0f4004750 con 0x7fa104101850 2024-09-13T23:05:23.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.100+0000 7fa0f9ffb700 1 --2- 172.21.15.2:0/1625615404 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa0ec06e680 0x7fa0ec070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:23.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.100+0000 7fa0f9ffb700 1 -- 172.21.15.2:0/1625615404 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fa0f4014070 con 0x7fa104101850 2024-09-13T23:05:23.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.100+0000 7fa108951700 1 --2- 172.21.15.2:0/1625615404 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa0ec06e680 0x7fa0ec070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:23.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.101+0000 7fa108951700 1 --2- 172.21.15.2:0/1625615404 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa0ec06e680 0x7fa0ec070b40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa10000b780 tx=0x7fa1000061f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:23.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.105+0000 7fa0f9ffb700 1 -- 172.21.15.2:0/1625615404 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa0f405b730 con 0x7fa104101850 2024-09-13T23:05:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.403+0000 7fa10abb5700 1 -- 172.21.15.2:0/1625615404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa104197d40 con 0x7fa104101850 2024-09-13T23:05:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.403+0000 7fa0f9ffb700 1 -- 172.21.15.2:0/1625615404 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+815 (secure 0 0 0) 0x7fa0f405b2c0 con 0x7fa104101850 2024-09-13T23:05:23.406 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:05:23.406 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T23:05:23.406 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:05:23.406 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:05:23.406 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T23:05:23.406 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:05:23.406 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:05:23.406 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T23:05:23.406 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T23:05:23.406 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:05:23.406 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T23:05:23.406 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-09-13T23:05:23.406 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 3 2024-09-13T23:05:23.406 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:05:23.407 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T23:05:23.407 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-09-13T23:05:23.407 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 13 2024-09-13T23:05:23.407 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T23:05:23.407 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:05:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.406+0000 7fa10abb5700 1 -- 172.21.15.2:0/1625615404 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa0ec06e680 msgr2=0x7fa0ec070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.406+0000 7fa10abb5700 1 --2- 172.21.15.2:0/1625615404 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa0ec06e680 0x7fa0ec070b40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa10000b780 tx=0x7fa1000061f0 comp rx=0 tx=0).stop 2024-09-13T23:05:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.406+0000 7fa10abb5700 1 -- 172.21.15.2:0/1625615404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa104101850 msgr2=0x7fa10419cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.406+0000 7fa10abb5700 1 --2- 172.21.15.2:0/1625615404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa104101850 0x7fa10419cc50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400e8f0 tx=0x7fa0f400ecb0 comp rx=0 tx=0).stop 2024-09-13T23:05:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.406+0000 7fa10abb5700 1 -- 172.21.15.2:0/1625615404 shutdown_connections 2024-09-13T23:05:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.406+0000 7fa10abb5700 1 --2- 172.21.15.2:0/1625615404 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa0ec06e680 0x7fa0ec070b40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.406+0000 7fa10abb5700 1 --2- 172.21.15.2:0/1625615404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa104100ea0 0x7fa10419c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.406+0000 7fa10abb5700 1 --2- 172.21.15.2:0/1625615404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa104101850 0x7fa10419cc50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.406+0000 7fa10abb5700 1 -- 172.21.15.2:0/1625615404 >> 172.21.15.2:0/1625615404 conn(0x7fa1040fc750 msgr2=0x7fa1040fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.406+0000 7fa10abb5700 1 -- 172.21.15.2:0/1625615404 shutdown_connections 2024-09-13T23:05:23.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.406+0000 7fa10abb5700 1 -- 172.21.15.2:0/1625615404 wait complete. 2024-09-13T23:05:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.516+0000 7f3c06e5c700 1 -- 172.21.15.2:0/859277153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c00101850 msgr2=0x7f3c001058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.516+0000 7f3c06e5c700 1 --2- 172.21.15.2:0/859277153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c00101850 0x7f3c001058a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009910 tx=0x7f3bf4009c20 comp rx=0 tx=0).stop 2024-09-13T23:05:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.516+0000 7f3c06e5c700 1 -- 172.21.15.2:0/859277153 shutdown_connections 2024-09-13T23:05:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.516+0000 7f3c06e5c700 1 --2- 172.21.15.2:0/859277153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c00101850 0x7f3c001058a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.516+0000 7f3c06e5c700 1 --2- 172.21.15.2:0/859277153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c00100ea0 0x7f3c00101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.516+0000 7f3c06e5c700 1 -- 172.21.15.2:0/859277153 >> 172.21.15.2:0/859277153 conn(0x7f3c000fc750 msgr2=0x7f3c000feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.516+0000 7f3c06e5c700 1 -- 172.21.15.2:0/859277153 shutdown_connections 2024-09-13T23:05:23.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.516+0000 7f3c06e5c700 1 -- 172.21.15.2:0/859277153 wait complete. 2024-09-13T23:05:23.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.516+0000 7f3c06e5c700 1 Processor -- start 2024-09-13T23:05:23.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.517+0000 7f3c06e5c700 1 -- start start 2024-09-13T23:05:23.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.517+0000 7f3c06e5c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c00100ea0 0x7f3c00073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:23.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.517+0000 7f3c06e5c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c00101850 0x7f3c000735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:23.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.517+0000 7f3c06e5c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c00073b10 con 0x7f3c00100ea0 2024-09-13T23:05:23.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.517+0000 7f3c06e5c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c00073c50 con 0x7f3c00101850 2024-09-13T23:05:23.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.517+0000 7f3c04bf8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c00100ea0 0x7f3c00073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:23.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.517+0000 7f3c04bf8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c00100ea0 0x7f3c00073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54140/0 (socket says 172.21.15.2:54140) 2024-09-13T23:05:23.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.517+0000 7f3c04bf8700 1 -- 172.21.15.2:0/1798982829 learned_addr learned my addr 172.21.15.2:0/1798982829 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:05:23.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.517+0000 7f3bfffff700 1 --2- 172.21.15.2:0/1798982829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c00101850 0x7f3c000735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:23.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.517+0000 7f3c04bf8700 1 -- 172.21.15.2:0/1798982829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c00101850 msgr2=0x7f3c000735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:23.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.517+0000 7f3c04bf8700 1 --2- 172.21.15.2:0/1798982829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c00101850 0x7f3c000735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:23.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.517+0000 7f3c04bf8700 1 -- 172.21.15.2:0/1798982829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf40095f0 con 0x7f3c00100ea0 2024-09-13T23:05:23.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.517+0000 7f3c04bf8700 1 --2- 172.21.15.2:0/1798982829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c00100ea0 0x7f3c00073090 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000d900 tx=0x7f3bf000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:23.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.518+0000 7f3bfdffb700 1 -- 172.21.15.2:0/1798982829 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bf00041f0 con 0x7f3c00100ea0 2024-09-13T23:05:23.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.518+0000 7f3bfdffb700 1 -- 172.21.15.2:0/1798982829 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3bf0004cf0 con 0x7f3c00100ea0 2024-09-13T23:05:23.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.518+0000 7f3c06e5c700 1 -- 172.21.15.2:0/1798982829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c001a2b00 con 0x7f3c00100ea0 2024-09-13T23:05:23.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.518+0000 7f3bfdffb700 1 -- 172.21.15.2:0/1798982829 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bf000b750 con 0x7f3c00100ea0 2024-09-13T23:05:23.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.518+0000 7f3c06e5c700 1 -- 172.21.15.2:0/1798982829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c001a2f10 con 0x7f3c00100ea0 2024-09-13T23:05:23.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.519+0000 7f3c06e5c700 1 -- 172.21.15.2:0/1798982829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c001092a0 con 0x7f3c00100ea0 2024-09-13T23:05:23.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.519+0000 7f3bfdffb700 1 -- 172.21.15.2:0/1798982829 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f3bf0004350 con 0x7f3c00100ea0 2024-09-13T23:05:23.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.520+0000 7f3bfdffb700 1 --2- 172.21.15.2:0/1798982829 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3be806e680 0x7f3be8070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:23.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.520+0000 7f3bfdffb700 1 -- 172.21.15.2:0/1798982829 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f3bf008e840 con 0x7f3c00100ea0 2024-09-13T23:05:23.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.520+0000 7f3bfffff700 1 --2- 172.21.15.2:0/1798982829 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3be806e680 0x7f3be8070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:23.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.520+0000 7f3bfffff700 1 --2- 172.21.15.2:0/1798982829 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3be806e680 0x7f3be8070b40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3c00074880 tx=0x7f3bf401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:23.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.524+0000 7f3bfdffb700 1 -- 172.21.15.2:0/1798982829 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3bf0057990 con 0x7f3c00100ea0 2024-09-13T23:05:23.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:23 smithi047 ceph-mon[81243]: pgmap v194: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 511 B/s wr, 8 op/s 2024-09-13T23:05:23.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:23 smithi047 ceph-mon[81243]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:23.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:23 smithi047 ceph-mon[81243]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:23.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:23 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:23.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:23 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:05:23.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:23 smithi002 ceph-mon[111294]: pgmap v194: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 511 B/s wr, 8 op/s 2024-09-13T23:05:23.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:23 smithi002 ceph-mon[111294]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:23.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:23 smithi002 ceph-mon[111294]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:23.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:23 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:23.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:23 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:05:23.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.778+0000 7f3c06e5c700 1 -- 172.21.15.2:0/1798982829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3c00108c80 con 0x7f3c00100ea0 2024-09-13T23:05:23.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.779+0000 7f3bfdffb700 1 -- 172.21.15.2:0/1798982829 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) v1 ==== 76+0+1925 (secure 0 0 0) 0x7f3bf00167a0 con 0x7f3c00100ea0 2024-09-13T23:05:23.781 INFO:teuthology.orchestra.run.smithi002.stdout:e28 2024-09-13T23:05:23.781 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-13T23:05:18:147247+0000 2024-09-13T23:05:23.781 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:05:23.781 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:05:23.781 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-13T23:05:23.781 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:05:23.781 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:05:23.781 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-13T23:05:23.781 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 28 2024-09-13T23:05:23.781 INFO:teuthology.orchestra.run.smithi002.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T23:05:23.782 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-13T22:53:05.963265+0000 2024-09-13T23:05:23.782 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-13T23:05:18.147243+0000 2024-09-13T23:05:23.782 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-13T23:05:23.782 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-13T23:05:23.782 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-13T23:05:23.782 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-13T23:05:23.782 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-13T23:05:23.782 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-13T23:05:23.782 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-13T23:05:23.782 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-13T23:05:23.782 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 84 2024-09-13T23:05:23.782 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:05:23.782 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 1 2024-09-13T23:05:23.783 INFO:teuthology.orchestra.run.smithi002.stdout:in 0 2024-09-13T23:05:23.783 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24277} 2024-09-13T23:05:23.783 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-13T23:05:23.783 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-13T23:05:23.783 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-13T23:05:23.783 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-13T23:05:23.783 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-13T23:05:23.783 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-13T23:05:23.783 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-13T23:05:23.783 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-13T23:05:23.783 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-13T23:05:23.783 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 24277 members: 24277 2024-09-13T23:05:23.784 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.nqvveh{0:24277} state up:active seq 182 join_fscid=1 addr [v2:172.21.15.47:6826/2007272492,v1:172.21.15.47:6827/2007272492] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T23:05:23.784 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:05:23.784 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:05:23.784 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-13T23:05:23.784 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:05:23.784 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.auedll{-1:34384} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/3279333632,v1:172.21.15.2:6827/3279333632] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:05:23.784 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.gglyyr{-1:34416} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6828/4224459092,v1:172.21.15.2:6829/4224459092] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:05:23.784 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.gxzkha{-1:44295} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.47:6824/1060893681,v1:172.21.15.47:6825/1060893681] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:05:23.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.782+0000 7f3c06e5c700 1 -- 172.21.15.2:0/1798982829 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3be806e680 msgr2=0x7f3be8070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:23.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.782+0000 7f3c06e5c700 1 --2- 172.21.15.2:0/1798982829 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3be806e680 0x7f3be8070b40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3c00074880 tx=0x7f3bf401a040 comp rx=0 tx=0).stop 2024-09-13T23:05:23.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.782+0000 7f3c06e5c700 1 -- 172.21.15.2:0/1798982829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c00100ea0 msgr2=0x7f3c00073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:23.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.782+0000 7f3c06e5c700 1 --2- 172.21.15.2:0/1798982829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c00100ea0 0x7f3c00073090 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000d900 tx=0x7f3bf000dcc0 comp rx=0 tx=0).stop 2024-09-13T23:05:23.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.782+0000 7f3c06e5c700 1 -- 172.21.15.2:0/1798982829 shutdown_connections 2024-09-13T23:05:23.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.782+0000 7f3c06e5c700 1 --2- 172.21.15.2:0/1798982829 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3be806e680 0x7f3be8070b40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:23.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.782+0000 7f3c06e5c700 1 --2- 172.21.15.2:0/1798982829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c00100ea0 0x7f3c00073090 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:23.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.782+0000 7f3c06e5c700 1 --2- 172.21.15.2:0/1798982829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c00101850 0x7f3c000735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.782+0000 7f3c06e5c700 1 -- 172.21.15.2:0/1798982829 >> 172.21.15.2:0/1798982829 conn(0x7f3c000fc750 msgr2=0x7f3c000fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.782+0000 7f3c06e5c700 1 -- 172.21.15.2:0/1798982829 shutdown_connections 2024-09-13T23:05:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.782+0000 7f3c06e5c700 1 -- 172.21.15.2:0/1798982829 wait complete. 2024-09-13T23:05:23.786 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-13T23:05:23.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.893+0000 7f1e78765700 1 -- 172.21.15.2:0/4291480904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e70105bd0 msgr2=0x7f1e70105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:23.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.893+0000 7f1e78765700 1 --2- 172.21.15.2:0/4291480904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e70105bd0 0x7f1e70105fb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009910 tx=0x7f1e6c009c20 comp rx=0 tx=0).stop 2024-09-13T23:05:23.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.893+0000 7f1e78765700 1 -- 172.21.15.2:0/4291480904 shutdown_connections 2024-09-13T23:05:23.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.893+0000 7f1e78765700 1 --2- 172.21.15.2:0/4291480904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e700ffc20 0x7f1e70100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:23.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.893+0000 7f1e78765700 1 --2- 172.21.15.2:0/4291480904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e70105bd0 0x7f1e70105fb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:23.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.893+0000 7f1e78765700 1 -- 172.21.15.2:0/4291480904 >> 172.21.15.2:0/4291480904 conn(0x7f1e70075670 msgr2=0x7f1e70075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:23.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.893+0000 7f1e78765700 1 -- 172.21.15.2:0/4291480904 shutdown_connections 2024-09-13T23:05:23.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.893+0000 7f1e78765700 1 -- 172.21.15.2:0/4291480904 wait complete. 2024-09-13T23:05:23.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.894+0000 7f1e78765700 1 Processor -- start 2024-09-13T23:05:23.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.894+0000 7f1e78765700 1 -- start start 2024-09-13T23:05:23.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.894+0000 7f1e78765700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e700ffc20 0x7f1e7019c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:23.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.894+0000 7f1e78765700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e70105bd0 0x7f1e7019cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:23.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.894+0000 7f1e78765700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7019d1f0 con 0x7f1e700ffc20 2024-09-13T23:05:23.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.894+0000 7f1e78765700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e701966a0 con 0x7f1e70105bd0 2024-09-13T23:05:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.894+0000 7f1e76501700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e700ffc20 0x7f1e7019c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.894+0000 7f1e76501700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e700ffc20 0x7f1e7019c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54154/0 (socket says 172.21.15.2:54154) 2024-09-13T23:05:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.894+0000 7f1e76501700 1 -- 172.21.15.2:0/70559612 learned_addr learned my addr 172.21.15.2:0/70559612 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:05:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.894+0000 7f1e75d00700 1 --2- 172.21.15.2:0/70559612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e70105bd0 0x7f1e7019cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.894+0000 7f1e76501700 1 -- 172.21.15.2:0/70559612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e70105bd0 msgr2=0x7f1e7019cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.894+0000 7f1e76501700 1 --2- 172.21.15.2:0/70559612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e70105bd0 0x7f1e7019cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.894+0000 7f1e76501700 1 -- 172.21.15.2:0/70559612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c0095f0 con 0x7f1e700ffc20 2024-09-13T23:05:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.895+0000 7f1e76501700 1 --2- 172.21.15.2:0/70559612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e700ffc20 0x7f1e7019c620 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c005f50 tx=0x7f1e6c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.895+0000 7f1e677fe700 1 -- 172.21.15.2:0/70559612 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e6c01d070 con 0x7f1e700ffc20 2024-09-13T23:05:23.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.895+0000 7f1e677fe700 1 -- 172.21.15.2:0/70559612 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e6c00b610 con 0x7f1e700ffc20 2024-09-13T23:05:23.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.895+0000 7f1e677fe700 1 -- 172.21.15.2:0/70559612 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e6c022470 con 0x7f1e700ffc20 2024-09-13T23:05:23.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.895+0000 7f1e78765700 1 -- 172.21.15.2:0/70559612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e70196920 con 0x7f1e700ffc20 2024-09-13T23:05:23.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.895+0000 7f1e78765700 1 -- 172.21.15.2:0/70559612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e70196e10 con 0x7f1e700ffc20 2024-09-13T23:05:23.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.896+0000 7f1e78765700 1 -- 172.21.15.2:0/70559612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7004f2e0 con 0x7f1e700ffc20 2024-09-13T23:05:23.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.897+0000 7f1e677fe700 1 -- 172.21.15.2:0/70559612 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f1e6c00fca0 con 0x7f1e700ffc20 2024-09-13T23:05:23.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.897+0000 7f1e677fe700 1 --2- 172.21.15.2:0/70559612 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1e5c06e680 0x7f1e5c070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:23.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.897+0000 7f1e677fe700 1 -- 172.21.15.2:0/70559612 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f1e6c08fad0 con 0x7f1e700ffc20 2024-09-13T23:05:23.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.897+0000 7f1e75d00700 1 --2- 172.21.15.2:0/70559612 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1e5c06e680 0x7f1e5c070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:23.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.898+0000 7f1e75d00700 1 --2- 172.21.15.2:0/70559612 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1e5c06e680 0x7f1e5c070b40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1e700ffa40 tx=0x7f1e60009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:23.902+0000 7f1e677fe700 1 -- 172.21.15.2:0/70559612 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1e6c05c7f0 con 0x7f1e700ffc20 2024-09-13T23:05:24.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.135+0000 7f1e78765700 1 -- 172.21.15.2:0/70559612 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e701970f0 con 0x7f1e5c06e680 2024-09-13T23:05:24.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.136+0000 7f1e677fe700 1 -- 172.21.15.2:0/70559612 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1e701970f0 con 0x7f1e5c06e680 2024-09-13T23:05:24.138 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:05:24.139 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:05:24.139 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T23:05:24.139 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:05:24.139 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-13T23:05:24.139 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-13T23:05:24.139 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-13T23:05:24.139 INFO:teuthology.orchestra.run.smithi002.stdout: "osd", 2024-09-13T23:05:24.139 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2024-09-13T23:05:24.139 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-13T23:05:24.139 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "15/23 daemons upgraded", 2024-09-13T23:05:24.139 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T23:05:24.139 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T23:05:24.139 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:05:24.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.138+0000 7f1e78765700 1 -- 172.21.15.2:0/70559612 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1e5c06e680 msgr2=0x7f1e5c070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:24.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.138+0000 7f1e78765700 1 --2- 172.21.15.2:0/70559612 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1e5c06e680 0x7f1e5c070b40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1e700ffa40 tx=0x7f1e60009260 comp rx=0 tx=0).stop 2024-09-13T23:05:24.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.138+0000 7f1e78765700 1 -- 172.21.15.2:0/70559612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e700ffc20 msgr2=0x7f1e7019c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:24.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.138+0000 7f1e78765700 1 --2- 172.21.15.2:0/70559612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e700ffc20 0x7f1e7019c620 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c005f50 tx=0x7f1e6c00f740 comp rx=0 tx=0).stop 2024-09-13T23:05:24.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.138+0000 7f1e78765700 1 -- 172.21.15.2:0/70559612 shutdown_connections 2024-09-13T23:05:24.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.138+0000 7f1e78765700 1 --2- 172.21.15.2:0/70559612 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f1e5c06e680 0x7f1e5c070b40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:24.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.138+0000 7f1e78765700 1 --2- 172.21.15.2:0/70559612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e700ffc20 0x7f1e7019c620 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:24.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.138+0000 7f1e78765700 1 --2- 172.21.15.2:0/70559612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e70105bd0 0x7f1e7019cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:24.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.138+0000 7f1e78765700 1 -- 172.21.15.2:0/70559612 >> 172.21.15.2:0/70559612 conn(0x7f1e70075670 msgr2=0x7f1e700686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:24.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.139+0000 7f1e78765700 1 -- 172.21.15.2:0/70559612 shutdown_connections 2024-09-13T23:05:24.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.139+0000 7f1e78765700 1 -- 172.21.15.2:0/70559612 wait complete. 2024-09-13T23:05:24.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.248+0000 7f09003e6700 1 -- 172.21.15.2:0/2436230519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08f8105bf0 msgr2=0x7f08f8105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:24.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.248+0000 7f09003e6700 1 --2- 172.21.15.2:0/2436230519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08f8105bf0 0x7f08f8105fd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f08f400b0a0 tx=0x7f08f400b3b0 comp rx=0 tx=0).stop 2024-09-13T23:05:24.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.248+0000 7f09003e6700 1 -- 172.21.15.2:0/2436230519 shutdown_connections 2024-09-13T23:05:24.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.248+0000 7f09003e6700 1 --2- 172.21.15.2:0/2436230519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08f80ffb40 0x7f08f80fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:24.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.248+0000 7f09003e6700 1 --2- 172.21.15.2:0/2436230519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08f8105bf0 0x7f08f8105fd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:24.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.248+0000 7f09003e6700 1 -- 172.21.15.2:0/2436230519 >> 172.21.15.2:0/2436230519 conn(0x7f08f80fb610 msgr2=0x7f08f80fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:24.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.248+0000 7f09003e6700 1 -- 172.21.15.2:0/2436230519 shutdown_connections 2024-09-13T23:05:24.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.248+0000 7f09003e6700 1 -- 172.21.15.2:0/2436230519 wait complete. 2024-09-13T23:05:24.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.249+0000 7f09003e6700 1 Processor -- start 2024-09-13T23:05:24.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.249+0000 7f09003e6700 1 -- start start 2024-09-13T23:05:24.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.249+0000 7f09003e6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08f80ffb40 0x7f08f8195480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:24.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.249+0000 7f09003e6700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08f8105bf0 0x7f08f81959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:24.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.249+0000 7f09003e6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f8195f00 con 0x7f08f80ffb40 2024-09-13T23:05:24.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.249+0000 7f09003e6700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f8196070 con 0x7f08f8105bf0 2024-09-13T23:05:24.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.249+0000 7f08fe182700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08f80ffb40 0x7f08f8195480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:24.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.249+0000 7f08fe182700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08f80ffb40 0x7f08f8195480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54168/0 (socket says 172.21.15.2:54168) 2024-09-13T23:05:24.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.249+0000 7f08fe182700 1 -- 172.21.15.2:0/4163346900 learned_addr learned my addr 172.21.15.2:0/4163346900 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:05:24.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.249+0000 7f08fd981700 1 --2- 172.21.15.2:0/4163346900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08f8105bf0 0x7f08f81959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:24.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.249+0000 7f08fe182700 1 -- 172.21.15.2:0/4163346900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08f8105bf0 msgr2=0x7f08f81959c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:24.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.249+0000 7f08fe182700 1 --2- 172.21.15.2:0/4163346900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08f8105bf0 0x7f08f81959c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:24.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.249+0000 7f08fe182700 1 -- 172.21.15.2:0/4163346900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f4009d00 con 0x7f08f80ffb40 2024-09-13T23:05:24.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.250+0000 7f08fe182700 1 --2- 172.21.15.2:0/4163346900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08f80ffb40 0x7f08f8195480 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f08f400b070 tx=0x7f08f400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:24.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.250+0000 7f08ef7fe700 1 -- 172.21.15.2:0/4163346900 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f400e040 con 0x7f08f80ffb40 2024-09-13T23:05:24.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.250+0000 7f08ef7fe700 1 -- 172.21.15.2:0/4163346900 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f08f4003c10 con 0x7f08f80ffb40 2024-09-13T23:05:24.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.250+0000 7f09003e6700 1 -- 172.21.15.2:0/4163346900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f81962f0 con 0x7f08f80ffb40 2024-09-13T23:05:24.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.250+0000 7f08ef7fe700 1 -- 172.21.15.2:0/4163346900 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f401d740 con 0x7f08f80ffb40 2024-09-13T23:05:24.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.250+0000 7f09003e6700 1 -- 172.21.15.2:0/4163346900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f81a2d70 con 0x7f08f80ffb40 2024-09-13T23:05:24.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.251+0000 7f09003e6700 1 -- 172.21.15.2:0/4163346900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f8108020 con 0x7f08f80ffb40 2024-09-13T23:05:24.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.252+0000 7f08ef7fe700 1 -- 172.21.15.2:0/4163346900 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f08f4004040 con 0x7f08f80ffb40 2024-09-13T23:05:24.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.252+0000 7f08ef7fe700 1 --2- 172.21.15.2:0/4163346900 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f08e406e680 0x7f08e4070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:24.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.252+0000 7f08fd981700 1 --2- 172.21.15.2:0/4163346900 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f08e406e680 0x7f08e4070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:24.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.252+0000 7f08ef7fe700 1 -- 172.21.15.2:0/4163346900 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f08f408fba0 con 0x7f08f80ffb40 2024-09-13T23:05:24.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.253+0000 7f08fd981700 1 --2- 172.21.15.2:0/4163346900 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f08e406e680 0x7f08e4070b40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f08f8069770 tx=0x7f08e800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:24.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.257+0000 7f08ef7fe700 1 -- 172.21.15.2:0/4163346900 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f08f405c940 con 0x7f08f80ffb40 2024-09-13T23:05:24.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:24 smithi002 ceph-mon[111294]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:24.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:24 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/1625615404' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:24.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:24 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/1798982829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:05:24.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.559+0000 7f09003e6700 1 -- 172.21.15.2:0/4163346900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f08f804f2e0 con 0x7f08f80ffb40 2024-09-13T23:05:24.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.559+0000 7f08ef7fe700 1 -- 172.21.15.2:0/4163346900 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f08f40170e0 con 0x7f08f80ffb40 2024-09-13T23:05:24.561 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T23:05:24.561 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T23:05:24.561 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T23:05:24.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.562+0000 7f09003e6700 1 -- 172.21.15.2:0/4163346900 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f08e406e680 msgr2=0x7f08e4070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:24.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.562+0000 7f09003e6700 1 --2- 172.21.15.2:0/4163346900 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f08e406e680 0x7f08e4070b40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f08f8069770 tx=0x7f08e800b410 comp rx=0 tx=0).stop 2024-09-13T23:05:24.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.562+0000 7f09003e6700 1 -- 172.21.15.2:0/4163346900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08f80ffb40 msgr2=0x7f08f8195480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:24.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.562+0000 7f09003e6700 1 --2- 172.21.15.2:0/4163346900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08f80ffb40 0x7f08f8195480 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f08f400b070 tx=0x7f08f400cd20 comp rx=0 tx=0).stop 2024-09-13T23:05:24.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.562+0000 7f09003e6700 1 -- 172.21.15.2:0/4163346900 shutdown_connections 2024-09-13T23:05:24.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.562+0000 7f09003e6700 1 --2- 172.21.15.2:0/4163346900 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f08e406e680 0x7f08e4070b40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:24.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.562+0000 7f09003e6700 1 --2- 172.21.15.2:0/4163346900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08f80ffb40 0x7f08f8195480 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:24.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.562+0000 7f09003e6700 1 --2- 172.21.15.2:0/4163346900 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08f8105bf0 0x7f08f81959c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:24.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.562+0000 7f09003e6700 1 -- 172.21.15.2:0/4163346900 >> 172.21.15.2:0/4163346900 conn(0x7f08f80fb610 msgr2=0x7f08f80fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:24.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.562+0000 7f09003e6700 1 -- 172.21.15.2:0/4163346900 shutdown_connections 2024-09-13T23:05:24.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:24.562+0000 7f09003e6700 1 -- 172.21.15.2:0/4163346900 wait complete. 2024-09-13T23:05:24.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:24 smithi047 ceph-mon[81243]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:24.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:24 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/1625615404' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:24.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:24 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/1798982829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:05:25.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:25 smithi047 ceph-mon[81243]: pgmap v195: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 4.5 MiB/s rd, 511 B/s wr, 4 op/s 2024-09-13T23:05:25.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:25 smithi047 ceph-mon[81243]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:25.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:25 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/4163346900' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:05:25.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:25 smithi002 ceph-mon[111294]: pgmap v195: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 4.5 MiB/s rd, 511 B/s wr, 4 op/s 2024-09-13T23:05:25.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:25 smithi002 ceph-mon[111294]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:25.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:25 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/4163346900' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:05:26.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:26 smithi002 ceph-mon[111294]: Upgrade: Updating mds.cephfs.smithi047.nqvveh 2024-09-13T23:05:26.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:26.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.nqvveh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:05:26.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:26 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:05:26.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:26 smithi002 ceph-mon[111294]: Deploying daemon mds.cephfs.smithi047.nqvveh on smithi047 2024-09-13T23:05:26.769 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:26 smithi047 ceph-mon[81243]: Upgrade: Updating mds.cephfs.smithi047.nqvveh 2024-09-13T23:05:26.770 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:26.770 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi047.nqvveh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T23:05:26.770 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:26 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:05:26.770 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:26 smithi047 ceph-mon[81243]: Deploying daemon mds.cephfs.smithi047.nqvveh on smithi047 2024-09-13T23:05:27.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:27 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002[111290]: 2024-09-13T23:05:27.274+0000 7fb0c61c6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T23:05:27.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:27 smithi002 ceph-mon[111294]: pgmap v196: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 4.5 MiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-13T23:05:27.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:27 smithi002 ceph-mon[111294]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T23:05:27.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:27 smithi002 ceph-mon[111294]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T23:05:27.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:27 smithi002 ceph-mon[111294]: osdmap e85: 6 total, 6 up, 6 in 2024-09-13T23:05:27.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:27 smithi002 ceph-mon[111294]: Standby daemon mds.cephfs.smithi002.auedll assigned to filesystem cephfs as rank 0 2024-09-13T23:05:27.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:27 smithi002 ceph-mon[111294]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T23:05:27.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:27 smithi002 ceph-mon[111294]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T23:05:27.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:27 smithi002 ceph-mon[111294]: fsmap cephfs:1/1 {0=cephfs.smithi002.auedll=up:replay} 2 up:standby 2024-09-13T23:05:27.770 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:27 smithi047 ceph-mon[81243]: pgmap v196: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 4.5 MiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-09-13T23:05:27.770 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:27 smithi047 ceph-mon[81243]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T23:05:27.770 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:27 smithi047 ceph-mon[81243]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T23:05:27.770 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:27 smithi047 ceph-mon[81243]: osdmap e85: 6 total, 6 up, 6 in 2024-09-13T23:05:27.770 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:27 smithi047 ceph-mon[81243]: Standby daemon mds.cephfs.smithi002.auedll assigned to filesystem cephfs as rank 0 2024-09-13T23:05:27.770 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:27 smithi047 ceph-mon[81243]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T23:05:27.771 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:27 smithi047 ceph-mon[81243]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T23:05:27.771 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:27 smithi047 ceph-mon[81243]: fsmap cephfs:1/1 {0=cephfs.smithi002.auedll=up:replay} 2 up:standby 2024-09-13T23:05:29.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:29 smithi047 ceph-mon[81243]: pgmap v198: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 4.3 KiB/s rd, 6.0 KiB/s wr, 6 op/s 2024-09-13T23:05:29.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:29 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.nqvveh"}]: dispatch 2024-09-13T23:05:29.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:29 smithi002 ceph-mon[111294]: pgmap v198: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 4.3 KiB/s rd, 6.0 KiB/s wr, 6 op/s 2024-09-13T23:05:29.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:29 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.nqvveh"}]: dispatch 2024-09-13T23:05:31.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:31 smithi002 ceph-mon[111294]: pgmap v199: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 823 KiB/s rd, 6.0 KiB/s wr, 6 op/s 2024-09-13T23:05:31.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:31 smithi047 ceph-mon[81243]: pgmap v199: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 823 KiB/s rd, 6.0 KiB/s wr, 6 op/s 2024-09-13T23:05:33.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:33 smithi047 ceph-mon[81243]: pgmap v200: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 5.4 KiB/s wr, 7 op/s 2024-09-13T23:05:33.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:33 smithi002 ceph-mon[111294]: pgmap v200: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 5.4 KiB/s wr, 7 op/s 2024-09-13T23:05:35.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:35 smithi002 ceph-mon[111294]: pgmap v201: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 5.4 KiB/s wr, 7 op/s 2024-09-13T23:05:35.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:35 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:35.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:35 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:35.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:35 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:05:35.796 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:35 smithi047 ceph-mon[81243]: pgmap v201: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 5.4 KiB/s wr, 7 op/s 2024-09-13T23:05:35.796 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:35 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:35.796 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:35 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:35.796 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:35 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:05:36.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:36 smithi002 ceph-mon[111294]: reconnect by client.14524 192.168.0.1:0/4269068546 after 0.000999978 2024-09-13T23:05:36.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:36 smithi002 ceph-mon[111294]: reconnect by client.24309 192.168.0.1:0/3679635712 after 0.000999978 2024-09-13T23:05:36.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:36 smithi002 ceph-mon[111294]: mds.? [v2:172.21.15.47:6826/2798869340,v1:172.21.15.47:6827/2798869340] up:boot 2024-09-13T23:05:36.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:36 smithi002 ceph-mon[111294]: mds.? [v2:172.21.15.2:6826/3279333632,v1:172.21.15.2:6827/3279333632] up:reconnect 2024-09-13T23:05:36.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:36 smithi002 ceph-mon[111294]: fsmap cephfs:1/1 {0=cephfs.smithi002.auedll=up:reconnect} 3 up:standby 2024-09-13T23:05:36.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:36 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.nqvveh"}]: dispatch 2024-09-13T23:05:36.863 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:36 smithi047 ceph-mon[81243]: reconnect by client.14524 192.168.0.1:0/4269068546 after 0.000999978 2024-09-13T23:05:36.863 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:36 smithi047 ceph-mon[81243]: reconnect by client.24309 192.168.0.1:0/3679635712 after 0.000999978 2024-09-13T23:05:36.863 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:36 smithi047 ceph-mon[81243]: mds.? [v2:172.21.15.47:6826/2798869340,v1:172.21.15.47:6827/2798869340] up:boot 2024-09-13T23:05:36.863 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:36 smithi047 ceph-mon[81243]: mds.? [v2:172.21.15.2:6826/3279333632,v1:172.21.15.2:6827/3279333632] up:reconnect 2024-09-13T23:05:36.863 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:36 smithi047 ceph-mon[81243]: fsmap cephfs:1/1 {0=cephfs.smithi002.auedll=up:reconnect} 3 up:standby 2024-09-13T23:05:36.863 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:36 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi047.nqvveh"}]: dispatch 2024-09-13T23:05:37.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:37 smithi002 ceph-mon[111294]: pgmap v202: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-13T23:05:37.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:37 smithi002 ceph-mon[111294]: mds.? [v2:172.21.15.2:6826/3279333632,v1:172.21.15.2:6827/3279333632] up:rejoin 2024-09-13T23:05:37.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:37 smithi002 ceph-mon[111294]: fsmap cephfs:1/1 {0=cephfs.smithi002.auedll=up:rejoin} 3 up:standby 2024-09-13T23:05:37.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:37 smithi002 ceph-mon[111294]: daemon mds.cephfs.smithi002.auedll is now active in filesystem cephfs as rank 0 2024-09-13T23:05:37.880 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:37 smithi047 ceph-mon[81243]: pgmap v202: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-13T23:05:37.881 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:37 smithi047 ceph-mon[81243]: mds.? [v2:172.21.15.2:6826/3279333632,v1:172.21.15.2:6827/3279333632] up:rejoin 2024-09-13T23:05:37.881 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:37 smithi047 ceph-mon[81243]: fsmap cephfs:1/1 {0=cephfs.smithi002.auedll=up:rejoin} 3 up:standby 2024-09-13T23:05:37.881 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:37 smithi047 ceph-mon[81243]: daemon mds.cephfs.smithi002.auedll is now active in filesystem cephfs as rank 0 2024-09-13T23:05:38.651 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:38 smithi002 ceph-mon[111294]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T23:05:38.652 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:38 smithi002 ceph-mon[111294]: mds.? [v2:172.21.15.2:6826/3279333632,v1:172.21.15.2:6827/3279333632] up:active 2024-09-13T23:05:38.652 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:38 smithi002 ceph-mon[111294]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 3 up:standby 2024-09-13T23:05:38.652 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:38.652 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:38.652 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:05:38.652 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:38.652 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:38.855 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:38 smithi047 ceph-mon[81243]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T23:05:38.855 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:38 smithi047 ceph-mon[81243]: mds.? [v2:172.21.15.2:6826/3279333632,v1:172.21.15.2:6827/3279333632] up:active 2024-09-13T23:05:38.855 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:38 smithi047 ceph-mon[81243]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 3 up:standby 2024-09-13T23:05:38.855 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:38.855 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:38.855 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:05:38.855 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:38.856 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:39.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:39 smithi047 ceph-mon[81243]: pgmap v203: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-13T23:05:39.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:39 smithi002 ceph-mon[111294]: pgmap v203: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-13T23:05:41.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: pgmap v204: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-09-13T23:05:41.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:41.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:41.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:05:41.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:05:41.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:41.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:05:41.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:41.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:41.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:41.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:41.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:41.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:41.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi002.auedll"}]: dispatch 2024-09-13T23:05:41.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi002.auedll"}]': finished 2024-09-13T23:05:41.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi002.gglyyr"}]: dispatch 2024-09-13T23:05:41.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi002.gglyyr"}]': finished 2024-09-13T23:05:41.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi047.gxzkha"}]: dispatch 2024-09-13T23:05:41.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi047.gxzkha"}]': finished 2024-09-13T23:05:41.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi047.nqvveh"}]: dispatch 2024-09-13T23:05:41.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi047.nqvveh"}]': finished 2024-09-13T23:05:41.915 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:41 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T23:05:42.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: pgmap v204: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-09-13T23:05:42.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:42.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:42.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:05:42.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:05:42.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:42.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:05:42.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:42.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:42.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:42.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:42.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:42.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:42.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi002.auedll"}]: dispatch 2024-09-13T23:05:42.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi002.auedll"}]': finished 2024-09-13T23:05:42.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi002.gglyyr"}]: dispatch 2024-09-13T23:05:42.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi002.gglyyr"}]': finished 2024-09-13T23:05:42.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi047.gxzkha"}]: dispatch 2024-09-13T23:05:42.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi047.gxzkha"}]': finished 2024-09-13T23:05:42.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi047.nqvveh"}]: dispatch 2024-09-13T23:05:42.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi047.nqvveh"}]': finished 2024-09-13T23:05:42.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:41 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T23:05:42.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:42 smithi047 ceph-mon[81243]: Upgrade: Setting container_image for all mds 2024-09-13T23:05:42.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:42 smithi047 ceph-mon[81243]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T23:05:42.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:42 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T23:05:42.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:42 smithi047 ceph-mon[81243]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 3 up:standby 2024-09-13T23:05:42.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:42 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-13T23:05:43.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:42 smithi002 ceph-mon[111294]: Upgrade: Setting container_image for all mds 2024-09-13T23:05:43.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:42 smithi002 ceph-mon[111294]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T23:05:43.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:42 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T23:05:43.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:42 smithi002 ceph-mon[111294]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 3 up:standby 2024-09-13T23:05:43.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:42 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-13T23:05:43.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:43 smithi002 ceph-mon[111294]: pgmap v205: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 170 B/s wr, 9 op/s 2024-09-13T23:05:43.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:43 smithi002 ceph-mon[111294]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-13T23:05:43.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:43 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-13T23:05:43.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:43 smithi002 ceph-mon[111294]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 3 up:standby 2024-09-13T23:05:43.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:43 smithi002 ceph-mon[111294]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T23:05:43.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:43 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:43.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:43 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:43.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:43 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:43.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:43 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:43.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:43 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:43.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:43 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:43.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:43 smithi047 ceph-mon[81243]: pgmap v205: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 170 B/s wr, 9 op/s 2024-09-13T23:05:43.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:43 smithi047 ceph-mon[81243]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-13T23:05:43.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:43 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-13T23:05:43.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:43 smithi047 ceph-mon[81243]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 3 up:standby 2024-09-13T23:05:43.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:43 smithi047 ceph-mon[81243]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T23:05:43.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:43 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:43.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:43 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:43.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:43 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:43.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:43 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:43.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:43 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:43.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:43 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:44.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:44 smithi047 ceph-mon[81243]: Upgrade: Setting container_image for all rgw 2024-09-13T23:05:44.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:44 smithi047 ceph-mon[81243]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T23:05:44.966 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:44 smithi002 ceph-mon[111294]: Upgrade: Setting container_image for all rgw 2024-09-13T23:05:44.966 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:44 smithi002 ceph-mon[111294]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T23:05:45.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:45 smithi047 ceph-mon[81243]: pgmap v206: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 7.9 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T23:05:45.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:45.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi002", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T23:05:45.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:45 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:05:45.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:45 smithi002 ceph-mon[111294]: pgmap v206: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 7.9 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T23:05:45.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:45.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi002", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T23:05:45.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:45 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:05:46.902 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:46 smithi002 ceph-mon[111294]: Upgrade: Updating ceph-exporter.smithi002 (1/2) 2024-09-13T23:05:46.902 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:46 smithi002 ceph-mon[111294]: Deploying daemon ceph-exporter.smithi002 on smithi002 2024-09-13T23:05:46.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:46 smithi047 ceph-mon[81243]: Upgrade: Updating ceph-exporter.smithi002 (1/2) 2024-09-13T23:05:46.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:46 smithi047 ceph-mon[81243]: Deploying daemon ceph-exporter.smithi002 on smithi002 2024-09-13T23:05:47.817 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:47 smithi002 ceph-mon[111294]: pgmap v207: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-13T23:05:47.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:47 smithi047 ceph-mon[81243]: pgmap v207: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-13T23:05:50.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:49 smithi002 ceph-mon[111294]: pgmap v208: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-09-13T23:05:50.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:49 smithi047 ceph-mon[81243]: pgmap v208: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-09-13T23:05:51.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:50 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:51.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:50 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:51.094 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:50 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:51.094 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:50 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:52.048 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:51 smithi002 ceph-mon[111294]: pgmap v209: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-13T23:05:52.049 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:51 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:52.049 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:51 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi047", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T23:05:52.049 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:51 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:05:52.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:51 smithi047 ceph-mon[81243]: pgmap v209: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-13T23:05:52.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:51 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:52.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:51 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi047", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T23:05:52.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:51 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:05:53.058 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:52 smithi047 ceph-mon[81243]: Upgrade: Updating ceph-exporter.smithi047 (2/2) 2024-09-13T23:05:53.058 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:52 smithi047 ceph-mon[81243]: Deploying daemon ceph-exporter.smithi047 on smithi047 2024-09-13T23:05:53.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:52 smithi002 ceph-mon[111294]: Upgrade: Updating ceph-exporter.smithi047 (2/2) 2024-09-13T23:05:53.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:52 smithi002 ceph-mon[111294]: Deploying daemon ceph-exporter.smithi047 on smithi047 2024-09-13T23:05:54.149 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:53 smithi047 ceph-mon[81243]: pgmap v210: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-13T23:05:54.149 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:05:54.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:53 smithi002 ceph-mon[111294]: pgmap v210: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-13T23:05:54.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:05:54.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.689+0000 7f1922be9700 1 -- 172.21.15.2:0/2168479561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f191c102720 msgr2=0x7f191c10ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.689+0000 7f1922be9700 1 --2- 172.21.15.2:0/2168479561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f191c102720 0x7f191c10ac10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1908009910 tx=0x7f1908009c20 comp rx=0 tx=0).stop 2024-09-13T23:05:54.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.689+0000 7f1922be9700 1 -- 172.21.15.2:0/2168479561 shutdown_connections 2024-09-13T23:05:54.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.689+0000 7f1922be9700 1 --2- 172.21.15.2:0/2168479561 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f191c102720 0x7f191c10ac10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.689+0000 7f1922be9700 1 --2- 172.21.15.2:0/2168479561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f191c101e00 0x7f191c1021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.689+0000 7f1922be9700 1 -- 172.21.15.2:0/2168479561 >> 172.21.15.2:0/2168479561 conn(0x7f191c0fb650 msgr2=0x7f191c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.690+0000 7f1922be9700 1 -- 172.21.15.2:0/2168479561 shutdown_connections 2024-09-13T23:05:54.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.690+0000 7f1922be9700 1 -- 172.21.15.2:0/2168479561 wait complete. 2024-09-13T23:05:54.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.690+0000 7f1922be9700 1 Processor -- start 2024-09-13T23:05:54.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.690+0000 7f1922be9700 1 -- start start 2024-09-13T23:05:54.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.691+0000 7f1922be9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f191c101e00 0x7f191c0ffa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.691+0000 7f1922be9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f191c102720 0x7f191c0fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.691+0000 7f1922be9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191c1004e0 con 0x7f191c102720 2024-09-13T23:05:54.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.691+0000 7f1922be9700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191c100620 con 0x7f191c101e00 2024-09-13T23:05:54.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.691+0000 7f191bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f191c102720 0x7f191c0fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.691+0000 7f191bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f191c102720 0x7f191c0fffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60358/0 (socket says 172.21.15.2:60358) 2024-09-13T23:05:54.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.691+0000 7f191bfff700 1 -- 172.21.15.2:0/3831700747 learned_addr learned my addr 172.21.15.2:0/3831700747 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:05:54.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.691+0000 7f1920985700 1 --2- 172.21.15.2:0/3831700747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f191c101e00 0x7f191c0ffa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.691+0000 7f191bfff700 1 -- 172.21.15.2:0/3831700747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f191c101e00 msgr2=0x7f191c0ffa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.691+0000 7f191bfff700 1 --2- 172.21.15.2:0/3831700747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f191c101e00 0x7f191c0ffa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.691+0000 7f191bfff700 1 -- 172.21.15.2:0/3831700747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19080095f0 con 0x7f191c102720 2024-09-13T23:05:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.691+0000 7f191bfff700 1 --2- 172.21.15.2:0/3831700747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f191c102720 0x7f191c0fffa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1908009fd0 tx=0x7f190800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.692+0000 7f1919ffb700 1 -- 172.21.15.2:0/3831700747 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f190801d070 con 0x7f191c102720 2024-09-13T23:05:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.692+0000 7f1919ffb700 1 -- 172.21.15.2:0/3831700747 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f19080050d0 con 0x7f191c102720 2024-09-13T23:05:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.692+0000 7f1922be9700 1 -- 172.21.15.2:0/3831700747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191c1008a0 con 0x7f191c102720 2024-09-13T23:05:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.692+0000 7f1919ffb700 1 -- 172.21.15.2:0/3831700747 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1908022470 con 0x7f191c102720 2024-09-13T23:05:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.692+0000 7f1922be9700 1 -- 172.21.15.2:0/3831700747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191c1a2dc0 con 0x7f191c102720 2024-09-13T23:05:54.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.693+0000 7f1922be9700 1 -- 172.21.15.2:0/3831700747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f191c108310 con 0x7f191c102720 2024-09-13T23:05:54.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.694+0000 7f1919ffb700 1 -- 172.21.15.2:0/3831700747 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f1908003680 con 0x7f191c102720 2024-09-13T23:05:54.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.694+0000 7f1919ffb700 1 --2- 172.21.15.2:0/3831700747 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f190c06e680 0x7f190c070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:54.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.695+0000 7f1919ffb700 1 -- 172.21.15.2:0/3831700747 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f190808fa50 con 0x7f191c102720 2024-09-13T23:05:54.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.695+0000 7f1920985700 1 --2- 172.21.15.2:0/3831700747 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f190c06e680 0x7f190c070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:54.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.695+0000 7f1920985700 1 --2- 172.21.15.2:0/3831700747 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f190c06e680 0x7f190c070b40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1910009c60 tx=0x7f1910009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:54.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.699+0000 7f1919ffb700 1 -- 172.21.15.2:0/3831700747 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1908058bf0 con 0x7f191c102720 2024-09-13T23:05:54.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.973+0000 7f1922be9700 1 -- 172.21.15.2:0/3831700747 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f191c0611d0 con 0x7f190c06e680 2024-09-13T23:05:54.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.975+0000 7f1919ffb700 1 -- 172.21.15.2:0/3831700747 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f191c0611d0 con 0x7f190c06e680 2024-09-13T23:05:54.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.977+0000 7f1922be9700 1 -- 172.21.15.2:0/3831700747 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f190c06e680 msgr2=0x7f190c070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.977+0000 7f1922be9700 1 --2- 172.21.15.2:0/3831700747 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f190c06e680 0x7f190c070b40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1910009c60 tx=0x7f1910009260 comp rx=0 tx=0).stop 2024-09-13T23:05:54.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.977+0000 7f1922be9700 1 -- 172.21.15.2:0/3831700747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f191c102720 msgr2=0x7f191c0fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.977+0000 7f1922be9700 1 --2- 172.21.15.2:0/3831700747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f191c102720 0x7f191c0fffa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1908009fd0 tx=0x7f190800f690 comp rx=0 tx=0).stop 2024-09-13T23:05:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.977+0000 7f1922be9700 1 -- 172.21.15.2:0/3831700747 shutdown_connections 2024-09-13T23:05:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.977+0000 7f1922be9700 1 --2- 172.21.15.2:0/3831700747 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f190c06e680 0x7f190c070b40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.977+0000 7f1922be9700 1 --2- 172.21.15.2:0/3831700747 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f191c101e00 0x7f191c0ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.977+0000 7f1922be9700 1 --2- 172.21.15.2:0/3831700747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f191c102720 0x7f191c0fffa0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.977+0000 7f1922be9700 1 -- 172.21.15.2:0/3831700747 >> 172.21.15.2:0/3831700747 conn(0x7f191c0fb650 msgr2=0x7f191c105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.978+0000 7f1922be9700 1 -- 172.21.15.2:0/3831700747 shutdown_connections 2024-09-13T23:05:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:54.978+0000 7f1922be9700 1 -- 172.21.15.2:0/3831700747 wait complete. 2024-09-13T23:05:54.993 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T23:05:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.099+0000 7fa5f272d700 1 -- 172.21.15.2:0/184008166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5ec101de0 msgr2=0x7fa5ec1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.099+0000 7fa5f272d700 1 --2- 172.21.15.2:0/184008166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5ec101de0 0x7fa5ec1021c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009910 tx=0x7fa5dc009c20 comp rx=0 tx=0).stop 2024-09-13T23:05:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.099+0000 7fa5f272d700 1 -- 172.21.15.2:0/184008166 shutdown_connections 2024-09-13T23:05:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.099+0000 7fa5f272d700 1 --2- 172.21.15.2:0/184008166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5ec102700 0x7fa5ec10abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.099+0000 7fa5f272d700 1 --2- 172.21.15.2:0/184008166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5ec101de0 0x7fa5ec1021c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.099+0000 7fa5f272d700 1 -- 172.21.15.2:0/184008166 >> 172.21.15.2:0/184008166 conn(0x7fa5ec0fb610 msgr2=0x7fa5ec0fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.099+0000 7fa5f272d700 1 -- 172.21.15.2:0/184008166 shutdown_connections 2024-09-13T23:05:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.099+0000 7fa5f272d700 1 -- 172.21.15.2:0/184008166 wait complete. 2024-09-13T23:05:55.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.100+0000 7fa5f272d700 1 Processor -- start 2024-09-13T23:05:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.100+0000 7fa5f272d700 1 -- start start 2024-09-13T23:05:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.100+0000 7fa5f272d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5ec101de0 0x7fa5ec19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.100+0000 7fa5f272d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5ec102700 0x7fa5ec19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.100+0000 7fa5f272d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec19d240 con 0x7fa5ec101de0 2024-09-13T23:05:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.100+0000 7fa5f272d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec1966f0 con 0x7fa5ec102700 2024-09-13T23:05:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.100+0000 7fa5ebfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5ec101de0 0x7fa5ec19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.100+0000 7fa5eb7fe700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5ec102700 0x7fa5ec19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.100+0000 7fa5ebfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5ec101de0 0x7fa5ec19c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60382/0 (socket says 172.21.15.2:60382) 2024-09-13T23:05:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.100+0000 7fa5ebfff700 1 -- 172.21.15.2:0/2101254017 learned_addr learned my addr 172.21.15.2:0/2101254017 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:05:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.101+0000 7fa5eb7fe700 1 -- 172.21.15.2:0/2101254017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5ec101de0 msgr2=0x7fa5ec19c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.101+0000 7fa5eb7fe700 1 --2- 172.21.15.2:0/2101254017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5ec101de0 0x7fa5ec19c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.101+0000 7fa5eb7fe700 1 -- 172.21.15.2:0/2101254017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc0095f0 con 0x7fa5ec102700 2024-09-13T23:05:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.101+0000 7fa5eb7fe700 1 --2- 172.21.15.2:0/2101254017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5ec102700 0x7fa5ec19cbb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000e940 tx=0x7fa5e000ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.101+0000 7fa5e97fa700 1 -- 172.21.15.2:0/2101254017 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5e000c990 con 0x7fa5ec102700 2024-09-13T23:05:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.102+0000 7fa5f272d700 1 -- 172.21.15.2:0/2101254017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ec1969d0 con 0x7fa5ec102700 2024-09-13T23:05:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.102+0000 7fa5e97fa700 1 -- 172.21.15.2:0/2101254017 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa5e0010430 con 0x7fa5ec102700 2024-09-13T23:05:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.102+0000 7fa5e97fa700 1 -- 172.21.15.2:0/2101254017 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5e0018650 con 0x7fa5ec102700 2024-09-13T23:05:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.102+0000 7fa5f272d700 1 -- 172.21.15.2:0/2101254017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ec196f20 con 0x7fa5ec102700 2024-09-13T23:05:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.103+0000 7fa5f272d700 1 -- 172.21.15.2:0/2101254017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ec1082f0 con 0x7fa5ec102700 2024-09-13T23:05:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.103+0000 7fa5e97fa700 1 -- 172.21.15.2:0/2101254017 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fa5e000caf0 con 0x7fa5ec102700 2024-09-13T23:05:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.104+0000 7fa5e97fa700 1 --2- 172.21.15.2:0/2101254017 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa5d406e680 0x7fa5d4070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.104+0000 7fa5e97fa700 1 -- 172.21.15.2:0/2101254017 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa5e0014070 con 0x7fa5ec102700 2024-09-13T23:05:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.104+0000 7fa5ebfff700 1 --2- 172.21.15.2:0/2101254017 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa5d406e680 0x7fa5d4070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.104+0000 7fa5ebfff700 1 --2- 172.21.15.2:0/2101254017 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa5d406e680 0x7fa5d4070b40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009fd0 tx=0x7fa5dc005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.109+0000 7fa5e97fa700 1 -- 172.21.15.2:0/2101254017 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa5e00541b0 con 0x7fa5ec102700 2024-09-13T23:05:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.341+0000 7fa5f272d700 1 -- 172.21.15.2:0/2101254017 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5ec197190 con 0x7fa5d406e680 2024-09-13T23:05:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.342+0000 7fa5e97fa700 1 -- 172.21.15.2:0/2101254017 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fa5ec197190 con 0x7fa5d406e680 2024-09-13T23:05:55.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.345+0000 7fa5f272d700 1 -- 172.21.15.2:0/2101254017 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa5d406e680 msgr2=0x7fa5d4070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.345+0000 7fa5f272d700 1 --2- 172.21.15.2:0/2101254017 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa5d406e680 0x7fa5d4070b40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009fd0 tx=0x7fa5dc005a90 comp rx=0 tx=0).stop 2024-09-13T23:05:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.345+0000 7fa5f272d700 1 -- 172.21.15.2:0/2101254017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5ec102700 msgr2=0x7fa5ec19cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.345+0000 7fa5f272d700 1 --2- 172.21.15.2:0/2101254017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5ec102700 0x7fa5ec19cbb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000e940 tx=0x7fa5e000ec50 comp rx=0 tx=0).stop 2024-09-13T23:05:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.345+0000 7fa5f272d700 1 -- 172.21.15.2:0/2101254017 shutdown_connections 2024-09-13T23:05:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.345+0000 7fa5f272d700 1 --2- 172.21.15.2:0/2101254017 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa5d406e680 0x7fa5d4070b40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.345+0000 7fa5f272d700 1 --2- 172.21.15.2:0/2101254017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5ec101de0 0x7fa5ec19c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.345+0000 7fa5f272d700 1 --2- 172.21.15.2:0/2101254017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa5ec102700 0x7fa5ec19cbb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.345+0000 7fa5f272d700 1 -- 172.21.15.2:0/2101254017 >> 172.21.15.2:0/2101254017 conn(0x7fa5ec0fb610 msgr2=0x7fa5ec105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.345+0000 7fa5f272d700 1 -- 172.21.15.2:0/2101254017 shutdown_connections 2024-09-13T23:05:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.345+0000 7fa5f272d700 1 -- 172.21.15.2:0/2101254017 wait complete. 2024-09-13T23:05:55.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.454+0000 7f512f6dc700 1 -- 172.21.15.2:0/786000372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51280ffb40 msgr2=0x7f51280fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.454+0000 7f512f6dc700 1 --2- 172.21.15.2:0/786000372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51280ffb40 0x7f51280fffc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5118009910 tx=0x7f5118009c20 comp rx=0 tx=0).stop 2024-09-13T23:05:55.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.454+0000 7f512f6dc700 1 -- 172.21.15.2:0/786000372 shutdown_connections 2024-09-13T23:05:55.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.454+0000 7f512f6dc700 1 --2- 172.21.15.2:0/786000372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51280ffb40 0x7f51280fffc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.454+0000 7f512f6dc700 1 --2- 172.21.15.2:0/786000372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5128105bf0 0x7f5128105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.454+0000 7f512f6dc700 1 -- 172.21.15.2:0/786000372 >> 172.21.15.2:0/786000372 conn(0x7f51280fb650 msgr2=0x7f51280fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.455+0000 7f512f6dc700 1 -- 172.21.15.2:0/786000372 shutdown_connections 2024-09-13T23:05:55.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.455+0000 7f512f6dc700 1 -- 172.21.15.2:0/786000372 wait complete. 2024-09-13T23:05:55.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.455+0000 7f512f6dc700 1 Processor -- start 2024-09-13T23:05:55.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.455+0000 7f512f6dc700 1 -- start start 2024-09-13T23:05:55.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.456+0000 7f512f6dc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51280ffb40 0x7f51281976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.456+0000 7f512f6dc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5128105bf0 0x7f5128197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.456+0000 7f512f6dc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5128198210 con 0x7f5128105bf0 2024-09-13T23:05:55.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.456+0000 7f512f6dc700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5128198380 con 0x7f51280ffb40 2024-09-13T23:05:55.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.456+0000 7f512cc77700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5128105bf0 0x7f5128197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.456+0000 7f512cc77700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5128105bf0 0x7f5128197bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60404/0 (socket says 172.21.15.2:60404) 2024-09-13T23:05:55.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.456+0000 7f512cc77700 1 -- 172.21.15.2:0/1759358911 learned_addr learned my addr 172.21.15.2:0/1759358911 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:05:55.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.456+0000 7f512d478700 1 --2- 172.21.15.2:0/1759358911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51280ffb40 0x7f51281976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.456+0000 7f512cc77700 1 -- 172.21.15.2:0/1759358911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51280ffb40 msgr2=0x7f51281976b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.456+0000 7f512cc77700 1 --2- 172.21.15.2:0/1759358911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51280ffb40 0x7f51281976b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.456+0000 7f512cc77700 1 -- 172.21.15.2:0/1759358911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51180095f0 con 0x7f5128105bf0 2024-09-13T23:05:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.456+0000 7f512cc77700 1 --2- 172.21.15.2:0/1759358911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5128105bf0 0x7f5128197bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f51180092e0 tx=0x7f511800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.456+0000 7f511e7fc700 1 -- 172.21.15.2:0/1759358911 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f511801d070 con 0x7f5128105bf0 2024-09-13T23:05:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.457+0000 7f511e7fc700 1 -- 172.21.15.2:0/1759358911 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5118005e00 con 0x7f5128105bf0 2024-09-13T23:05:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.457+0000 7f512f6dc700 1 -- 172.21.15.2:0/1759358911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51281a0720 con 0x7f5128105bf0 2024-09-13T23:05:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.457+0000 7f511e7fc700 1 -- 172.21.15.2:0/1759358911 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5118017400 con 0x7f5128105bf0 2024-09-13T23:05:55.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.457+0000 7f512f6dc700 1 -- 172.21.15.2:0/1759358911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51281a0b90 con 0x7f5128105bf0 2024-09-13T23:05:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.458+0000 7f512f6dc700 1 -- 172.21.15.2:0/1759358911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512804f2e0 con 0x7f5128105bf0 2024-09-13T23:05:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.458+0000 7f511e7fc700 1 -- 172.21.15.2:0/1759358911 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f511800f6f0 con 0x7f5128105bf0 2024-09-13T23:05:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.459+0000 7f511e7fc700 1 --2- 172.21.15.2:0/1759358911 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f511406e680 0x7f5114070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.459+0000 7f511e7fc700 1 -- 172.21.15.2:0/1759358911 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f511808fa10 con 0x7f5128105bf0 2024-09-13T23:05:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.459+0000 7f512d478700 1 --2- 172.21.15.2:0/1759358911 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f511406e680 0x7f5114070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.459+0000 7f512d478700 1 --2- 172.21.15.2:0/1759358911 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f511406e680 0x7f5114070b40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5124007be0 tx=0x7f51240073d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.463+0000 7f511e7fc700 1 -- 172.21.15.2:0/1759358911 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5118058c30 con 0x7f5128105bf0 2024-09-13T23:05:55.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.683+0000 7f512f6dc700 1 -- 172.21.15.2:0/1759358911 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f51280fd730 con 0x7f511406e680 2024-09-13T23:05:55.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.693+0000 7f511e7fc700 1 -- 172.21.15.2:0/1759358911 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f51280fd730 con 0x7f511406e680 2024-09-13T23:05:55.694 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:05:55.694 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (7m) 57s ago 18m 26.0M - 0.25.0 c8568f914cd2 f570a73274bc 2024-09-13T23:05:55.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 starting - - - - 2024-09-13T23:05:55.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 starting - - - - 2024-09-13T23:05:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (4m) 57s ago 18m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 427cd38a7d88 2024-09-13T23:05:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (4m) 18s ago 17m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 ce5a1df96005 2024-09-13T23:05:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (7m) 57s ago 17m 81.2M - 9.4.12 2bacad6d85d8 650673516b69 2024-09-13T23:05:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (80s) 57s ago 12m 13.1M - 19.1.1-324-gecab7be5 0652ff2b5d78 6c66160ad777 2024-09-13T23:05:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (62s) 57s ago 12m 14.5M - 19.1.1-324-gecab7be5 0652ff2b5d78 f3dd67424bdb 2024-09-13T23:05:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (44s) 18s ago 12m 13.0M - 19.1.1-324-gecab7be5 0652ff2b5d78 9e8e78202975 2024-09-13T23:05:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (21s) 18s ago 12m 11.8M - 19.1.1-324-gecab7be5 0652ff2b5d78 705dc8749820 2024-09-13T23:05:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 running (9m) 57s ago 19m 503M - 19.1.1-324-gecab7be5 0652ff2b5d78 7a8aa9de37e4 2024-09-13T23:05:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (8m) 18s ago 17m 442M - 19.1.1-324-gecab7be5 0652ff2b5d78 13fa6f3b5a8a 2024-09-13T23:05:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (5m) 57s ago 19m 54.9M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 db0ef6c509cf 2024-09-13T23:05:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (5m) 18s ago 17m 45.0M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 ea0c2a2e0e1a 2024-09-13T23:05:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (8m) 57s ago 18m 14.9M - 1.5.0 0da6a335fe13 f3eae5f90ab8 2024-09-13T23:05:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (8m) 18s ago 17m 15.8M - 1.5.0 0da6a335fe13 a5c7d7f1eaa5 2024-09-13T23:05:55.695 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (4m) 57s ago 16m 88.3M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 0ca6dd66fa68 2024-09-13T23:05:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (3m) 57s ago 15m 89.3M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 6f5ae2cfa818 2024-09-13T23:05:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (3m) 57s ago 15m 78.0M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 15b9e8db7556 2024-09-13T23:05:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (2m) 18s ago 15m 115M 2241M 19.1.1-324-gecab7be5 0652ff2b5d78 de54fd3fea34 2024-09-13T23:05:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (2m) 18s ago 14m 90.3M 2241M 19.1.1-324-gecab7be5 0652ff2b5d78 185d7ae7181b 2024-09-13T23:05:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (97s) 18s ago 14m 91.4M 2241M 19.1.1-324-gecab7be5 0652ff2b5d78 aeb44a823828 2024-09-13T23:05:55.696 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (7m) 57s ago 17m 76.8M - 2.43.0 a07b618ecd1d aa241d1048de 2024-09-13T23:05:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.696+0000 7f512f6dc700 1 -- 172.21.15.2:0/1759358911 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f511406e680 msgr2=0x7f5114070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.696+0000 7f512f6dc700 1 --2- 172.21.15.2:0/1759358911 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f511406e680 0x7f5114070b40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5124007be0 tx=0x7f51240073d0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.696+0000 7f512f6dc700 1 -- 172.21.15.2:0/1759358911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5128105bf0 msgr2=0x7f5128197bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.696+0000 7f512f6dc700 1 --2- 172.21.15.2:0/1759358911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5128105bf0 0x7f5128197bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f51180092e0 tx=0x7f511800bd70 comp rx=0 tx=0).stop 2024-09-13T23:05:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.696+0000 7f512f6dc700 1 -- 172.21.15.2:0/1759358911 shutdown_connections 2024-09-13T23:05:55.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.696+0000 7f512f6dc700 1 --2- 172.21.15.2:0/1759358911 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f511406e680 0x7f5114070b40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.696+0000 7f512f6dc700 1 --2- 172.21.15.2:0/1759358911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51280ffb40 0x7f51281976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.696+0000 7f512f6dc700 1 --2- 172.21.15.2:0/1759358911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5128105bf0 0x7f5128197bf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.696+0000 7f512f6dc700 1 -- 172.21.15.2:0/1759358911 >> 172.21.15.2:0/1759358911 conn(0x7f51280fb650 msgr2=0x7f51280fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.696+0000 7f512f6dc700 1 -- 172.21.15.2:0/1759358911 shutdown_connections 2024-09-13T23:05:55.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.696+0000 7f512f6dc700 1 -- 172.21.15.2:0/1759358911 wait complete. 2024-09-13T23:05:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.804+0000 7ff980b2b700 1 -- 172.21.15.2:0/2385914980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c102700 msgr2=0x7ff97c10abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.804+0000 7ff980b2b700 1 --2- 172.21.15.2:0/2385914980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c102700 0x7ff97c10abf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff970009910 tx=0x7ff970009c20 comp rx=0 tx=0).stop 2024-09-13T23:05:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.804+0000 7ff980b2b700 1 -- 172.21.15.2:0/2385914980 shutdown_connections 2024-09-13T23:05:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.804+0000 7ff980b2b700 1 --2- 172.21.15.2:0/2385914980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c102700 0x7ff97c10abf0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.804+0000 7ff980b2b700 1 --2- 172.21.15.2:0/2385914980 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff97c101de0 0x7ff97c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.804+0000 7ff980b2b700 1 -- 172.21.15.2:0/2385914980 >> 172.21.15.2:0/2385914980 conn(0x7ff97c0fb650 msgr2=0x7ff97c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:55.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.804+0000 7ff980b2b700 1 -- 172.21.15.2:0/2385914980 shutdown_connections 2024-09-13T23:05:55.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.804+0000 7ff980b2b700 1 -- 172.21.15.2:0/2385914980 wait complete. 2024-09-13T23:05:55.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.805+0000 7ff980b2b700 1 Processor -- start 2024-09-13T23:05:55.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.805+0000 7ff980b2b700 1 -- start start 2024-09-13T23:05:55.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.805+0000 7ff980b2b700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff97c101de0 0x7ff97c19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.805+0000 7ff980b2b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c102700 0x7ff97c19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.805+0000 7ff980b2b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c19d270 con 0x7ff97c102700 2024-09-13T23:05:55.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.805+0000 7ff980b2b700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c196720 con 0x7ff97c101de0 2024-09-13T23:05:55.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.805+0000 7ff979d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c102700 0x7ff97c19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.805+0000 7ff979d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c102700 0x7ff97c19cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60424/0 (socket says 172.21.15.2:60424) 2024-09-13T23:05:55.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.805+0000 7ff979d9b700 1 -- 172.21.15.2:0/573890544 learned_addr learned my addr 172.21.15.2:0/573890544 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:05:55.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.805+0000 7ff97a59c700 1 --2- 172.21.15.2:0/573890544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff97c101de0 0x7ff97c19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.806+0000 7ff979d9b700 1 -- 172.21.15.2:0/573890544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff97c101de0 msgr2=0x7ff97c19c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:55.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.806+0000 7ff979d9b700 1 --2- 172.21.15.2:0/573890544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff97c101de0 0x7ff97c19c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:55.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.806+0000 7ff979d9b700 1 -- 172.21.15.2:0/573890544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9700095f0 con 0x7ff97c102700 2024-09-13T23:05:55.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.806+0000 7ff979d9b700 1 --2- 172.21.15.2:0/573890544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c102700 0x7ff97c19cbe0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff970009fd0 tx=0x7ff97000bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.806+0000 7ff96b7fe700 1 -- 172.21.15.2:0/573890544 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff97001d070 con 0x7ff97c102700 2024-09-13T23:05:55.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.806+0000 7ff96b7fe700 1 -- 172.21.15.2:0/573890544 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff9700052a0 con 0x7ff97c102700 2024-09-13T23:05:55.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.806+0000 7ff96b7fe700 1 -- 172.21.15.2:0/573890544 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff970022470 con 0x7ff97c102700 2024-09-13T23:05:55.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.806+0000 7ff980b2b700 1 -- 172.21.15.2:0/573890544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97c1969a0 con 0x7ff97c102700 2024-09-13T23:05:55.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.806+0000 7ff980b2b700 1 -- 172.21.15.2:0/573890544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff97c196e90 con 0x7ff97c102700 2024-09-13T23:05:55.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.807+0000 7ff980b2b700 1 -- 172.21.15.2:0/573890544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97c1082f0 con 0x7ff97c102700 2024-09-13T23:05:55.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.808+0000 7ff96b7fe700 1 -- 172.21.15.2:0/573890544 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7ff97000f6f0 con 0x7ff97c102700 2024-09-13T23:05:55.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.808+0000 7ff96b7fe700 1 --2- 172.21.15.2:0/573890544 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff96406e680 0x7ff964070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:55.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.808+0000 7ff97a59c700 1 --2- 172.21.15.2:0/573890544 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff96406e680 0x7ff964070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:55.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.809+0000 7ff96b7fe700 1 -- 172.21.15.2:0/573890544 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ff97008f9e0 con 0x7ff97c102700 2024-09-13T23:05:55.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.809+0000 7ff97a59c700 1 --2- 172.21.15.2:0/573890544 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff96406e680 0x7ff964070b40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009c60 tx=0x7ff96c009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:55.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:55.813+0000 7ff96b7fe700 1 -- 172.21.15.2:0/573890544 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff97005c6b0 con 0x7ff97c102700 2024-09-13T23:05:55.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:55 smithi002 ceph-mon[111294]: pgmap v211: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-09-13T23:05:56.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:55 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:56.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:55 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:56.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:55 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:05:56.092 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:55 smithi047 ceph-mon[81243]: pgmap v211: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-09-13T23:05:56.092 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:55 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:56.092 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:55 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:56.092 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:55 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:05:56.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.116+0000 7ff980b2b700 1 -- 172.21.15.2:0/573890544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff97c04f2e0 con 0x7ff97c102700 2024-09-13T23:05:56.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.116+0000 7ff96b7fe700 1 -- 172.21.15.2:0/573890544 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7ff97005c240 con 0x7ff97c102700 2024-09-13T23:05:56.117 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:05:56.117 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T23:05:56.117 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:05:56.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:05:56.118 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T23:05:56.118 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:05:56.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:05:56.118 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T23:05:56.118 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T23:05:56.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:05:56.118 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T23:05:56.118 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T23:05:56.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:05:56.118 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T23:05:56.118 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 14 2024-09-13T23:05:56.118 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T23:05:56.119 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:05:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.118+0000 7ff980b2b700 1 -- 172.21.15.2:0/573890544 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff96406e680 msgr2=0x7ff964070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:56.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.118+0000 7ff980b2b700 1 --2- 172.21.15.2:0/573890544 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff96406e680 0x7ff964070b40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009c60 tx=0x7ff96c009260 comp rx=0 tx=0).stop 2024-09-13T23:05:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.118+0000 7ff980b2b700 1 -- 172.21.15.2:0/573890544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c102700 msgr2=0x7ff97c19cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.118+0000 7ff980b2b700 1 --2- 172.21.15.2:0/573890544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c102700 0x7ff97c19cbe0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff970009fd0 tx=0x7ff97000bfc0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.118+0000 7ff980b2b700 1 -- 172.21.15.2:0/573890544 shutdown_connections 2024-09-13T23:05:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.118+0000 7ff980b2b700 1 --2- 172.21.15.2:0/573890544 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff96406e680 0x7ff964070b40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.118+0000 7ff980b2b700 1 --2- 172.21.15.2:0/573890544 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff97c101de0 0x7ff97c19c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.118+0000 7ff980b2b700 1 --2- 172.21.15.2:0/573890544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c102700 0x7ff97c19cbe0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.118+0000 7ff980b2b700 1 -- 172.21.15.2:0/573890544 >> 172.21.15.2:0/573890544 conn(0x7ff97c0fb650 msgr2=0x7ff97c105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.118+0000 7ff980b2b700 1 -- 172.21.15.2:0/573890544 shutdown_connections 2024-09-13T23:05:56.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.119+0000 7ff980b2b700 1 -- 172.21.15.2:0/573890544 wait complete. 2024-09-13T23:05:56.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.227+0000 7ff2d969c700 1 -- 172.21.15.2:0/689324867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d4101e00 msgr2=0x7ff2d41021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:56.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.227+0000 7ff2d969c700 1 --2- 172.21.15.2:0/689324867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d4101e00 0x7ff2d41021e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400b0a0 tx=0x7ff2c400b3b0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.227+0000 7ff2d969c700 1 -- 172.21.15.2:0/689324867 shutdown_connections 2024-09-13T23:05:56.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.227+0000 7ff2d969c700 1 --2- 172.21.15.2:0/689324867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2d4102720 0x7ff2d410ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.227+0000 7ff2d969c700 1 --2- 172.21.15.2:0/689324867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d4101e00 0x7ff2d41021e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.227+0000 7ff2d969c700 1 -- 172.21.15.2:0/689324867 >> 172.21.15.2:0/689324867 conn(0x7ff2d40fb650 msgr2=0x7ff2d40fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:56.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.228+0000 7ff2d969c700 1 -- 172.21.15.2:0/689324867 shutdown_connections 2024-09-13T23:05:56.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.228+0000 7ff2d969c700 1 -- 172.21.15.2:0/689324867 wait complete. 2024-09-13T23:05:56.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.228+0000 7ff2d969c700 1 Processor -- start 2024-09-13T23:05:56.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.228+0000 7ff2d969c700 1 -- start start 2024-09-13T23:05:56.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.229+0000 7ff2d969c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d4101e00 0x7ff2d4196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:56.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.229+0000 7ff2d969c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2d4102720 0x7ff2d4196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:56.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.229+0000 7ff2d969c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4197550 con 0x7ff2d4101e00 2024-09-13T23:05:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.229+0000 7ff2d969c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d419b360 con 0x7ff2d4102720 2024-09-13T23:05:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.229+0000 7ff2d2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d4101e00 0x7ff2d4196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.229+0000 7ff2d2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d4101e00 0x7ff2d4196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60444/0 (socket says 172.21.15.2:60444) 2024-09-13T23:05:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.229+0000 7ff2d2ffd700 1 -- 172.21.15.2:0/1536251363 learned_addr learned my addr 172.21.15.2:0/1536251363 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:05:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.229+0000 7ff2d27fc700 1 --2- 172.21.15.2:0/1536251363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2d4102720 0x7ff2d4196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.229+0000 7ff2d2ffd700 1 -- 172.21.15.2:0/1536251363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2d4102720 msgr2=0x7ff2d4196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.229+0000 7ff2d2ffd700 1 --2- 172.21.15.2:0/1536251363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2d4102720 0x7ff2d4196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.229+0000 7ff2d2ffd700 1 -- 172.21.15.2:0/1536251363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c4009d00 con 0x7ff2d4101e00 2024-09-13T23:05:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.229+0000 7ff2d27fc700 1 --2- 172.21.15.2:0/1536251363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2d4102720 0x7ff2d4196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:05:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.229+0000 7ff2d2ffd700 1 --2- 172.21.15.2:0/1536251363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d4101e00 0x7ff2d4196980 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400b070 tx=0x7ff2c400bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.229+0000 7ff2cbfff700 1 -- 172.21.15.2:0/1536251363 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c400e040 con 0x7ff2d4101e00 2024-09-13T23:05:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.229+0000 7ff2cbfff700 1 -- 172.21.15.2:0/1536251363 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2c4003c10 con 0x7ff2d4101e00 2024-09-13T23:05:56.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.229+0000 7ff2cbfff700 1 -- 172.21.15.2:0/1536251363 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c401d6a0 con 0x7ff2d4101e00 2024-09-13T23:05:56.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.230+0000 7ff2d969c700 1 -- 172.21.15.2:0/1536251363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d419b5e0 con 0x7ff2d4101e00 2024-09-13T23:05:56.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.230+0000 7ff2d969c700 1 -- 172.21.15.2:0/1536251363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d419ba80 con 0x7ff2d4101e00 2024-09-13T23:05:56.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.231+0000 7ff2d969c700 1 -- 172.21.15.2:0/1536251363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d4108310 con 0x7ff2d4101e00 2024-09-13T23:05:56.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.231+0000 7ff2cbfff700 1 -- 172.21.15.2:0/1536251363 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7ff2c4019070 con 0x7ff2d4101e00 2024-09-13T23:05:56.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.231+0000 7ff2cbfff700 1 --2- 172.21.15.2:0/1536251363 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff2c006e680 0x7ff2c0070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:56.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.232+0000 7ff2cbfff700 1 -- 172.21.15.2:0/1536251363 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ff2c408fb60 con 0x7ff2d4101e00 2024-09-13T23:05:56.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.232+0000 7ff2d27fc700 1 --2- 172.21.15.2:0/1536251363 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff2c006e680 0x7ff2c0070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:56.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.232+0000 7ff2d27fc700 1 --2- 172.21.15.2:0/1536251363 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff2c006e680 0x7ff2c0070b40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4197fa0 tx=0x7ff2bc009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:56.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.236+0000 7ff2cbfff700 1 -- 172.21.15.2:0/1536251363 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff2c405c8b0 con 0x7ff2d4101e00 2024-09-13T23:05:56.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.492+0000 7ff2d969c700 1 -- 172.21.15.2:0/1536251363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff2d4107cf0 con 0x7ff2d4101e00 2024-09-13T23:05:56.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.493+0000 7ff2cbfff700 1 -- 172.21.15.2:0/1536251363 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1996 (secure 0 0 0) 0x7ff2c4017070 con 0x7ff2d4101e00 2024-09-13T23:05:56.494 INFO:teuthology.orchestra.run.smithi002.stdout:e36 2024-09-13T23:05:56.494 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-13T23:05:43:492744+0000 2024-09-13T23:05:56.494 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:05:56.494 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:05:56.494 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-13T23:05:56.494 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:05:56.494 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:05:56.494 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-13T23:05:56.494 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 36 2024-09-13T23:05:56.494 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:05:56.494 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-13T22:53:05.963265+0000 2024-09-13T23:05:56.494 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-13T23:05:43.492734+0000 2024-09-13T23:05:56.495 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-13T23:05:56.495 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-13T23:05:56.495 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-13T23:05:56.495 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-13T23:05:56.495 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-13T23:05:56.495 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-13T23:05:56.495 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-13T23:05:56.495 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-13T23:05:56.495 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 85 2024-09-13T23:05:56.495 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T23:05:56.495 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 1 2024-09-13T23:05:56.495 INFO:teuthology.orchestra.run.smithi002.stdout:in 0 2024-09-13T23:05:56.495 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=34384} 2024-09-13T23:05:56.495 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-13T23:05:56.496 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-13T23:05:56.496 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-13T23:05:56.496 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-13T23:05:56.496 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-13T23:05:56.496 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-13T23:05:56.496 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-13T23:05:56.496 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-13T23:05:56.496 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-13T23:05:56.496 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 34384 members: 34384 2024-09-13T23:05:56.496 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.auedll{0:34384} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.2:6826/3279333632,v1:172.21.15.2:6827/3279333632] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:05:56.496 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.gglyyr{0:34416} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.2:6828/4224459092,v1:172.21.15.2:6829/4224459092] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:05:56.496 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:05:56.496 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:05:56.497 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-13T23:05:56.497 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:05:56.497 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.gxzkha{-1:44295} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.47:6824/1060893681,v1:172.21.15.47:6825/1060893681] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:05:56.497 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.nqvveh{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.47:6826/2798869340,v1:172.21.15.47:6827/2798869340] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:05:56.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.495+0000 7ff2d969c700 1 -- 172.21.15.2:0/1536251363 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff2c006e680 msgr2=0x7ff2c0070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:56.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.495+0000 7ff2d969c700 1 --2- 172.21.15.2:0/1536251363 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff2c006e680 0x7ff2c0070b40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4197fa0 tx=0x7ff2bc009260 comp rx=0 tx=0).stop 2024-09-13T23:05:56.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.495+0000 7ff2d969c700 1 -- 172.21.15.2:0/1536251363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d4101e00 msgr2=0x7ff2d4196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:56.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.495+0000 7ff2d969c700 1 --2- 172.21.15.2:0/1536251363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d4101e00 0x7ff2d4196980 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400b070 tx=0x7ff2c400bd10 comp rx=0 tx=0).stop 2024-09-13T23:05:56.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.495+0000 7ff2d969c700 1 -- 172.21.15.2:0/1536251363 shutdown_connections 2024-09-13T23:05:56.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.495+0000 7ff2d969c700 1 --2- 172.21.15.2:0/1536251363 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff2c006e680 0x7ff2c0070b40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.495+0000 7ff2d969c700 1 --2- 172.21.15.2:0/1536251363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d4101e00 0x7ff2d4196980 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.495+0000 7ff2d969c700 1 --2- 172.21.15.2:0/1536251363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2d4102720 0x7ff2d4196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.495+0000 7ff2d969c700 1 -- 172.21.15.2:0/1536251363 >> 172.21.15.2:0/1536251363 conn(0x7ff2d40fb650 msgr2=0x7ff2d4105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:56.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.495+0000 7ff2d969c700 1 -- 172.21.15.2:0/1536251363 shutdown_connections 2024-09-13T23:05:56.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.495+0000 7ff2d969c700 1 -- 172.21.15.2:0/1536251363 wait complete. 2024-09-13T23:05:56.499 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 36 2024-09-13T23:05:56.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.604+0000 7f3c29144700 1 -- 172.21.15.2:0/3705250808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c240ffb40 msgr2=0x7f3c240fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:56.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.604+0000 7f3c29144700 1 --2- 172.21.15.2:0/3705250808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c240ffb40 0x7f3c240fffc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c009910 tx=0x7f3c0c009c20 comp rx=0 tx=0).stop 2024-09-13T23:05:56.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.604+0000 7f3c29144700 1 -- 172.21.15.2:0/3705250808 shutdown_connections 2024-09-13T23:05:56.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.604+0000 7f3c29144700 1 --2- 172.21.15.2:0/3705250808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c240ffb40 0x7f3c240fffc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.604+0000 7f3c29144700 1 --2- 172.21.15.2:0/3705250808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c24105bf0 0x7f3c24105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.604+0000 7f3c29144700 1 -- 172.21.15.2:0/3705250808 >> 172.21.15.2:0/3705250808 conn(0x7f3c240fb650 msgr2=0x7f3c240fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:56.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.604+0000 7f3c29144700 1 -- 172.21.15.2:0/3705250808 shutdown_connections 2024-09-13T23:05:56.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.604+0000 7f3c29144700 1 -- 172.21.15.2:0/3705250808 wait complete. 2024-09-13T23:05:56.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.605+0000 7f3c29144700 1 Processor -- start 2024-09-13T23:05:56.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.605+0000 7f3c29144700 1 -- start start 2024-09-13T23:05:56.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.605+0000 7f3c29144700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c240ffb40 0x7f3c241976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:56.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.605+0000 7f3c29144700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24105bf0 0x7f3c24197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:56.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.605+0000 7f3c29144700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c241981c0 con 0x7f3c24105bf0 2024-09-13T23:05:56.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.605+0000 7f3c29144700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c24198300 con 0x7f3c240ffb40 2024-09-13T23:05:56.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.605+0000 7f3c2259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24105bf0 0x7f3c24197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:56.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.605+0000 7f3c2259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24105bf0 0x7f3c24197bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60470/0 (socket says 172.21.15.2:60470) 2024-09-13T23:05:56.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.606+0000 7f3c2259c700 1 -- 172.21.15.2:0/1945317981 learned_addr learned my addr 172.21.15.2:0/1945317981 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:05:56.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.606+0000 7f3c22d9d700 1 --2- 172.21.15.2:0/1945317981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c240ffb40 0x7f3c241976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:56.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.606+0000 7f3c2259c700 1 -- 172.21.15.2:0/1945317981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c240ffb40 msgr2=0x7f3c241976b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:56.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.606+0000 7f3c2259c700 1 --2- 172.21.15.2:0/1945317981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c240ffb40 0x7f3c241976b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.606+0000 7f3c2259c700 1 -- 172.21.15.2:0/1945317981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c0095f0 con 0x7f3c24105bf0 2024-09-13T23:05:56.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.606+0000 7f3c2259c700 1 --2- 172.21.15.2:0/1945317981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24105bf0 0x7f3c24197bf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00b5c0 tx=0x7f3c0c00bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:56.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.606+0000 7f3c1bfff700 1 -- 172.21.15.2:0/1945317981 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c0c01d070 con 0x7f3c24105bf0 2024-09-13T23:05:56.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.606+0000 7f3c1bfff700 1 -- 172.21.15.2:0/1945317981 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c0c00f460 con 0x7f3c24105bf0 2024-09-13T23:05:56.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.606+0000 7f3c1bfff700 1 -- 172.21.15.2:0/1945317981 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c0c017630 con 0x7f3c24105bf0 2024-09-13T23:05:56.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.606+0000 7f3c29144700 1 -- 172.21.15.2:0/1945317981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c241a0720 con 0x7f3c24105bf0 2024-09-13T23:05:56.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.606+0000 7f3c29144700 1 -- 172.21.15.2:0/1945317981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c241a0ad0 con 0x7f3c24105bf0 2024-09-13T23:05:56.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.607+0000 7f3c29144700 1 -- 172.21.15.2:0/1945317981 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2404f2e0 con 0x7f3c24105bf0 2024-09-13T23:05:56.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.608+0000 7f3c1bfff700 1 -- 172.21.15.2:0/1945317981 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f3c0c00f5d0 con 0x7f3c24105bf0 2024-09-13T23:05:56.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.608+0000 7f3c1bfff700 1 --2- 172.21.15.2:0/1945317981 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3c1006e680 0x7f3c10070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:56.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.608+0000 7f3c1bfff700 1 -- 172.21.15.2:0/1945317981 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f3c0c08faf0 con 0x7f3c24105bf0 2024-09-13T23:05:56.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.609+0000 7f3c22d9d700 1 --2- 172.21.15.2:0/1945317981 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3c1006e680 0x7f3c10070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:56.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.609+0000 7f3c22d9d700 1 --2- 172.21.15.2:0/1945317981 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3c1006e680 0x7f3c10070b40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3c14005950 tx=0x7f3c1400a300 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:56.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.613+0000 7f3c1bfff700 1 -- 172.21.15.2:0/1945317981 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3c0c058d10 con 0x7f3c24105bf0 2024-09-13T23:05:56.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:56 smithi002 ceph-mon[111294]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:56.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:56 smithi002 ceph-mon[111294]: from='client.44335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:56.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:56 smithi002 ceph-mon[111294]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:56.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:56 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/573890544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:56.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:56 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/1536251363' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:05:56.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.841+0000 7f3c29144700 1 -- 172.21.15.2:0/1945317981 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c240fd730 con 0x7f3c1006e680 2024-09-13T23:05:56.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.843+0000 7f3c1bfff700 1 -- 172.21.15.2:0/1945317981 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f3c240fd730 con 0x7f3c1006e680 2024-09-13T23:05:56.844 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:05:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808", 2024-09-13T23:05:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-13T23:05:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T23:05:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-13T23:05:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-13T23:05:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-13T23:05:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "mds", 2024-09-13T23:05:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "osd", 2024-09-13T23:05:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2024-09-13T23:05:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-13T23:05:56.844 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "16/23 daemons upgraded", 2024-09-13T23:05:56.845 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-09-13T23:05:56.845 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T23:05:56.845 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:05:56.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.846+0000 7f3c29144700 1 -- 172.21.15.2:0/1945317981 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3c1006e680 msgr2=0x7f3c10070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:56.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.846+0000 7f3c29144700 1 --2- 172.21.15.2:0/1945317981 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3c1006e680 0x7f3c10070b40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3c14005950 tx=0x7f3c1400a300 comp rx=0 tx=0).stop 2024-09-13T23:05:56.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.846+0000 7f3c29144700 1 -- 172.21.15.2:0/1945317981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24105bf0 msgr2=0x7f3c24197bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:56.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.846+0000 7f3c29144700 1 --2- 172.21.15.2:0/1945317981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24105bf0 0x7f3c24197bf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00b5c0 tx=0x7f3c0c00bd50 comp rx=0 tx=0).stop 2024-09-13T23:05:56.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.846+0000 7f3c29144700 1 -- 172.21.15.2:0/1945317981 shutdown_connections 2024-09-13T23:05:56.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.846+0000 7f3c29144700 1 --2- 172.21.15.2:0/1945317981 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3c1006e680 0x7f3c10070b40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.846+0000 7f3c29144700 1 --2- 172.21.15.2:0/1945317981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c240ffb40 0x7f3c241976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.846+0000 7f3c29144700 1 --2- 172.21.15.2:0/1945317981 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24105bf0 0x7f3c24197bf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.846+0000 7f3c29144700 1 -- 172.21.15.2:0/1945317981 >> 172.21.15.2:0/1945317981 conn(0x7f3c240fb650 msgr2=0x7f3c240fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:56.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.846+0000 7f3c29144700 1 -- 172.21.15.2:0/1945317981 shutdown_connections 2024-09-13T23:05:56.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.846+0000 7f3c29144700 1 -- 172.21.15.2:0/1945317981 wait complete. 2024-09-13T23:05:56.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:56 smithi047 ceph-mon[81243]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:56.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:56 smithi047 ceph-mon[81243]: from='client.44335 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:56.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:56 smithi047 ceph-mon[81243]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:56.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:56 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/573890544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:05:56.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:56 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/1536251363' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:05:56.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.953+0000 7fc21829c700 1 -- 172.21.15.2:0/339675860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2100ffda0 msgr2=0x7fc210100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:56.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.953+0000 7fc21829c700 1 --2- 172.21.15.2:0/339675860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2100ffda0 0x7fc210100180 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009910 tx=0x7fc20c009c20 comp rx=0 tx=0).stop 2024-09-13T23:05:56.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.954+0000 7fc21829c700 1 -- 172.21.15.2:0/339675860 shutdown_connections 2024-09-13T23:05:56.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.954+0000 7fc21829c700 1 --2- 172.21.15.2:0/339675860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc210100750 0x7fc2101047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.954+0000 7fc21829c700 1 --2- 172.21.15.2:0/339675860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2100ffda0 0x7fc210100180 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.954+0000 7fc21829c700 1 -- 172.21.15.2:0/339675860 >> 172.21.15.2:0/339675860 conn(0x7fc2100fb650 msgr2=0x7fc2100fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:56.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.954+0000 7fc21829c700 1 -- 172.21.15.2:0/339675860 shutdown_connections 2024-09-13T23:05:56.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.954+0000 7fc21829c700 1 -- 172.21.15.2:0/339675860 wait complete. 2024-09-13T23:05:56.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.954+0000 7fc21829c700 1 Processor -- start 2024-09-13T23:05:56.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.954+0000 7fc21829c700 1 -- start start 2024-09-13T23:05:56.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.955+0000 7fc21829c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2100ffda0 0x7fc21019b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:56.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.955+0000 7fc21829c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc210100750 0x7fc21019ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:56.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.955+0000 7fc21829c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21019c120 con 0x7fc210100750 2024-09-13T23:05:56.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.955+0000 7fc21829c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2101955d0 con 0x7fc2100ffda0 2024-09-13T23:05:56.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.955+0000 7fc215837700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc210100750 0x7fc21019ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:56.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.955+0000 7fc215837700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc210100750 0x7fc21019ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60484/0 (socket says 172.21.15.2:60484) 2024-09-13T23:05:56.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.955+0000 7fc215837700 1 -- 172.21.15.2:0/2273541993 learned_addr learned my addr 172.21.15.2:0/2273541993 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:05:56.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.955+0000 7fc216038700 1 --2- 172.21.15.2:0/2273541993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2100ffda0 0x7fc21019b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:56.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.955+0000 7fc215837700 1 -- 172.21.15.2:0/2273541993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2100ffda0 msgr2=0x7fc21019b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:56.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.955+0000 7fc215837700 1 --2- 172.21.15.2:0/2273541993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2100ffda0 0x7fc21019b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:56.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.955+0000 7fc215837700 1 -- 172.21.15.2:0/2273541993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c0095f0 con 0x7fc210100750 2024-09-13T23:05:56.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.955+0000 7fc215837700 1 --2- 172.21.15.2:0/2273541993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc210100750 0x7fc21019ba90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc20000e8f0 tx=0x7fc20000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:56.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.955+0000 7fc2077fe700 1 -- 172.21.15.2:0/2273541993 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc200009790 con 0x7fc210100750 2024-09-13T23:05:56.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.956+0000 7fc21829c700 1 -- 172.21.15.2:0/2273541993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2101958b0 con 0x7fc210100750 2024-09-13T23:05:56.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.956+0000 7fc2077fe700 1 -- 172.21.15.2:0/2273541993 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc20000c810 con 0x7fc210100750 2024-09-13T23:05:56.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.956+0000 7fc2077fe700 1 -- 172.21.15.2:0/2273541993 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc200005580 con 0x7fc210100750 2024-09-13T23:05:56.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.956+0000 7fc21829c700 1 -- 172.21.15.2:0/2273541993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc210195e00 con 0x7fc210100750 2024-09-13T23:05:56.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.957+0000 7fc21829c700 1 -- 172.21.15.2:0/2273541993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc210108140 con 0x7fc210100750 2024-09-13T23:05:56.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.957+0000 7fc2077fe700 1 -- 172.21.15.2:0/2273541993 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fc20000c980 con 0x7fc210100750 2024-09-13T23:05:56.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.958+0000 7fc2077fe700 1 --2- 172.21.15.2:0/2273541993 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc1fc06e680 0x7fc1fc070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:05:56.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.958+0000 7fc2077fe700 1 -- 172.21.15.2:0/2273541993 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc200014070 con 0x7fc210100750 2024-09-13T23:05:56.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.958+0000 7fc216038700 1 --2- 172.21.15.2:0/2273541993 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc1fc06e680 0x7fc1fc070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:05:56.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.958+0000 7fc216038700 1 --2- 172.21.15.2:0/2273541993 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc1fc06e680 0x7fc1fc070b40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00b760 tx=0x7fc20c005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:05:56.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:56.962+0000 7fc2077fe700 1 -- 172.21.15.2:0/2273541993 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc20005b5e0 con 0x7fc210100750 2024-09-13T23:05:57.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:57.261+0000 7fc21829c700 1 -- 172.21.15.2:0/2273541993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc210196080 con 0x7fc210100750 2024-09-13T23:05:57.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:57.262+0000 7fc2077fe700 1 -- 172.21.15.2:0/2273541993 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fc20005b170 con 0x7fc210100750 2024-09-13T23:05:57.262 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T23:05:57.262 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T23:05:57.262 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T23:05:57.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:57.264+0000 7fc21829c700 1 -- 172.21.15.2:0/2273541993 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc1fc06e680 msgr2=0x7fc1fc070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:57.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:57.264+0000 7fc21829c700 1 --2- 172.21.15.2:0/2273541993 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc1fc06e680 0x7fc1fc070b40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00b760 tx=0x7fc20c005a90 comp rx=0 tx=0).stop 2024-09-13T23:05:57.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:57.264+0000 7fc21829c700 1 -- 172.21.15.2:0/2273541993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc210100750 msgr2=0x7fc21019ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:05:57.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:57.264+0000 7fc21829c700 1 --2- 172.21.15.2:0/2273541993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc210100750 0x7fc21019ba90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc20000e8f0 tx=0x7fc20000ec00 comp rx=0 tx=0).stop 2024-09-13T23:05:57.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:57.264+0000 7fc21829c700 1 -- 172.21.15.2:0/2273541993 shutdown_connections 2024-09-13T23:05:57.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:57.264+0000 7fc21829c700 1 --2- 172.21.15.2:0/2273541993 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fc1fc06e680 0x7fc1fc070b40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:57.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:57.264+0000 7fc21829c700 1 --2- 172.21.15.2:0/2273541993 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2100ffda0 0x7fc21019b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:57.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:57.264+0000 7fc21829c700 1 --2- 172.21.15.2:0/2273541993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc210100750 0x7fc21019ba90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:05:57.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:57.264+0000 7fc21829c700 1 -- 172.21.15.2:0/2273541993 >> 172.21.15.2:0/2273541993 conn(0x7fc2100fb650 msgr2=0x7fc2100fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:05:57.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:57.264+0000 7fc21829c700 1 -- 172.21.15.2:0/2273541993 shutdown_connections 2024-09-13T23:05:57.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:05:57.264+0000 7fc21829c700 1 -- 172.21.15.2:0/2273541993 wait complete. 2024-09-13T23:05:58.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:57 smithi002 ceph-mon[111294]: pgmap v212: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-09-13T23:05:58.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:57 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:58.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:57 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:58.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:57 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/2273541993' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:05:58.156 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:57 smithi047 ceph-mon[81243]: pgmap v212: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-09-13T23:05:58.156 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:57 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:58.156 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:57 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:58.156 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:57 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/2273541993' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:05:59.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:58 smithi002 ceph-mon[111294]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:59.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:58 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:59.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:58 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:59.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:58 smithi047 ceph-mon[81243]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:05:59.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:58 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:59.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:58 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:05:59.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:05:59 smithi047 ceph-mon[81243]: pgmap v213: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-13T23:06:00.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:05:59 smithi002 ceph-mon[111294]: pgmap v213: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-13T23:06:01.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:01 smithi002 ceph-mon[111294]: pgmap v214: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 9.5 MiB/s rd, 2 op/s 2024-09-13T23:06:01.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:01 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:01.750 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:01 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:02.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:01 smithi047 ceph-mon[81243]: pgmap v214: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 9.5 MiB/s rd, 2 op/s 2024-09-13T23:06:02.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:01 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:02.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:01 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:04.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:03 smithi002 ceph-mon[111294]: pgmap v215: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 9.2 MiB/s rd, 3 op/s 2024-09-13T23:06:04.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:04.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:04.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:04.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:03 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:04.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:03 smithi047 ceph-mon[81243]: pgmap v215: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 9.2 MiB/s rd, 3 op/s 2024-09-13T23:06:04.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:04.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:04.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:04.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:03 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:05.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:05 smithi002 ceph-mon[111294]: pgmap v216: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 202 KiB/s rd, 1 op/s 2024-09-13T23:06:06.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:05 smithi047 ceph-mon[81243]: pgmap v216: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 202 KiB/s rd, 1 op/s 2024-09-13T23:06:07.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:07 smithi047 ceph-mon[81243]: pgmap v217: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 202 KiB/s rd, 1 op/s 2024-09-13T23:06:07.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:07.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:07.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:06:07.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:06:07.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:07.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:06:07.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:07.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:07.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:07.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:07.913 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:07.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:07 smithi047 ceph-mon[81243]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T23:06:07.914 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T23:06:07.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:07 smithi002 ceph-mon[111294]: pgmap v217: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 202 KiB/s rd, 1 op/s 2024-09-13T23:06:08.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:08.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:08.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:06:08.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:06:08.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:08.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:06:08.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:08.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:08.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:08.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:08.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:08.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:07 smithi002 ceph-mon[111294]: Upgrade: Setting filesystem cephfs Joinable 2024-09-13T23:06:08.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-13T23:06:09.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T23:06:09.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T23:06:09.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T23:06:09.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:09.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi002"}]: dispatch 2024-09-13T23:06:09.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi002"}]': finished 2024-09-13T23:06:09.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi047"}]: dispatch 2024-09-13T23:06:09.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi047"}]': finished 2024-09-13T23:06:09.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.001 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: Upgrade: Setting container_image for all iscsi 2024-09-13T23:06:09.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:09.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: Upgrade: Setting container_image for all nfs 2024-09-13T23:06:09.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:09.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: Upgrade: Setting container_image for all nvmeof 2024-09-13T23:06:09.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:09.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: Upgrade: Finalizing container_image settings 2024-09-13T23:06:09.003 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T23:06:09.003 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T23:06:09.003 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:06:09.003 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T23:06:09.003 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T23:06:09.003 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T23:06:09.003 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T23:06:09.003 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T23:06:09.003 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T23:06:09.003 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T23:06:09.003 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T23:06:09.003 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T23:06:09.003 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T23:06:09.004 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T23:06:09.004 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:06:09.004 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T23:06:09.004 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T23:06:09.004 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T23:06:09.004 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T23:06:09.004 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T23:06:09.004 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T23:06:09.004 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T23:06:09.004 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T23:06:09.004 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:06:09.004 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:06:09.004 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:06:09.005 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:06:09.005 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:06:09.005 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:06:09.005 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T23:06:09.005 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T23:06:09.005 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:06:09.005 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:06:09.005 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:06:09.005 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:09.005 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:06:09.005 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:09.005 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:06:09.005 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:06:09.006 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:06:09.006 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:09.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-13T23:06:09.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: fsmap cephfs:1 {0=cephfs.smithi002.auedll=up:active} 1 up:standby-replay 2 up:standby 2024-09-13T23:06:09.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T23:06:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi002"}]: dispatch 2024-09-13T23:06:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi002"}]': finished 2024-09-13T23:06:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi047"}]: dispatch 2024-09-13T23:06:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi047"}]': finished 2024-09-13T23:06:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: Upgrade: Setting container_image for all iscsi 2024-09-13T23:06:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: Upgrade: Setting container_image for all nfs 2024-09-13T23:06:09.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: Upgrade: Setting container_image for all nvmeof 2024-09-13T23:06:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: Upgrade: Finalizing container_image settings 2024-09-13T23:06:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T23:06:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T23:06:09.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:06:09.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T23:06:09.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T23:06:09.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T23:06:09.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T23:06:09.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T23:06:09.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T23:06:09.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T23:06:09.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T23:06:09.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T23:06:09.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T23:06:09.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T23:06:09.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:06:09.166 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T23:06:09.167 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T23:06:09.167 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T23:06:09.167 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T23:06:09.167 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T23:06:09.167 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T23:06:09.167 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T23:06:09.167 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T23:06:09.167 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:06:09.167 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:06:09.167 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:06:09.167 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:06:09.167 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:06:09.168 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T23:06:09.168 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T23:06:09.168 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T23:06:09.168 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:06:09.168 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:06:09.168 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:06:09.168 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:09.168 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:06:09.168 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:09.168 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:06:09.168 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:06:09.168 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:06:09.168 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:06:09.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:09 smithi002 ceph-mon[111294]: Upgrade: Complete! 2024-09-13T23:06:09.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:09 smithi002 ceph-mon[111294]: pgmap v218: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:06:10.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:09 smithi047 ceph-mon[81243]: Upgrade: Complete! 2024-09-13T23:06:10.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:09 smithi047 ceph-mon[81243]: pgmap v218: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:06:12.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:11 smithi047 ceph-mon[81243]: pgmap v219: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:12.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:11 smithi002 ceph-mon[111294]: pgmap v219: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:14.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:13 smithi047 ceph-mon[81243]: pgmap v220: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:06:14.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:13 smithi002 ceph-mon[111294]: pgmap v220: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:06:16.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:15 smithi047 ceph-mon[81243]: pgmap v221: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:16.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:15 smithi002 ceph-mon[111294]: pgmap v221: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:18.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:17 smithi047 ceph-mon[81243]: pgmap v222: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:06:18.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:17 smithi002 ceph-mon[111294]: pgmap v222: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:06:19.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:19 smithi002 ceph-mon[111294]: pgmap v223: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:06:20.015 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:19 smithi047 ceph-mon[81243]: pgmap v223: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:06:22.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:21 smithi047 ceph-mon[81243]: pgmap v224: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:22.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:21 smithi002 ceph-mon[111294]: pgmap v224: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:24.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:23 smithi047 ceph-mon[81243]: pgmap v225: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:06:24.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:23 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:06:24.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:23 smithi002 ceph-mon[111294]: pgmap v225: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:06:24.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:23 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:06:26.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:25 smithi047 ceph-mon[81243]: pgmap v226: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:26.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:25 smithi002 ceph-mon[111294]: pgmap v226: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:27.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.388+0000 7f4f40325700 1 -- 172.21.15.2:0/2291338724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38101ea0 msgr2=0x7f4f38102280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:27.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.388+0000 7f4f40325700 1 --2- 172.21.15.2:0/2291338724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38101ea0 0x7f4f38102280 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4f34009910 tx=0x7f4f34009c20 comp rx=0 tx=0).stop 2024-09-13T23:06:27.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.388+0000 7f4f40325700 1 -- 172.21.15.2:0/2291338724 shutdown_connections 2024-09-13T23:06:27.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.388+0000 7f4f40325700 1 --2- 172.21.15.2:0/2291338724 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f381027c0 0x7f4f3810acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:27.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.388+0000 7f4f40325700 1 --2- 172.21.15.2:0/2291338724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38101ea0 0x7f4f38102280 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:27.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.388+0000 7f4f40325700 1 -- 172.21.15.2:0/2291338724 >> 172.21.15.2:0/2291338724 conn(0x7f4f380fb650 msgr2=0x7f4f380fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:27.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.388+0000 7f4f40325700 1 -- 172.21.15.2:0/2291338724 shutdown_connections 2024-09-13T23:06:27.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.388+0000 7f4f40325700 1 -- 172.21.15.2:0/2291338724 wait complete. 2024-09-13T23:06:27.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.389+0000 7f4f40325700 1 Processor -- start 2024-09-13T23:06:27.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.389+0000 7f4f40325700 1 -- start start 2024-09-13T23:06:27.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.389+0000 7f4f40325700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38101ea0 0x7f4f3819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:27.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.389+0000 7f4f40325700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f381027c0 0x7f4f3819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:27.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.389+0000 7f4f40325700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3819d230 con 0x7f4f38101ea0 2024-09-13T23:06:27.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.389+0000 7f4f40325700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f381966e0 con 0x7f4f381027c0 2024-09-13T23:06:27.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.389+0000 7f4f3e0c1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38101ea0 0x7f4f3819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:27.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.389+0000 7f4f3e0c1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38101ea0 0x7f4f3819c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52304/0 (socket says 172.21.15.2:52304) 2024-09-13T23:06:27.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.389+0000 7f4f3e0c1700 1 -- 172.21.15.2:0/2780488112 learned_addr learned my addr 172.21.15.2:0/2780488112 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:06:27.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.389+0000 7f4f3d8c0700 1 --2- 172.21.15.2:0/2780488112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f381027c0 0x7f4f3819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:27.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.390+0000 7f4f3e0c1700 1 -- 172.21.15.2:0/2780488112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f381027c0 msgr2=0x7f4f3819cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:27.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.390+0000 7f4f3e0c1700 1 --2- 172.21.15.2:0/2780488112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f381027c0 0x7f4f3819cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:27.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.390+0000 7f4f3e0c1700 1 -- 172.21.15.2:0/2780488112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f340095f0 con 0x7f4f38101ea0 2024-09-13T23:06:27.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.390+0000 7f4f3e0c1700 1 --2- 172.21.15.2:0/2780488112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38101ea0 0x7f4f3819c660 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400b5c0 tx=0x7f4f3400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:27.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.390+0000 7f4f2f7fe700 1 -- 172.21.15.2:0/2780488112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f3401d070 con 0x7f4f38101ea0 2024-09-13T23:06:27.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.390+0000 7f4f2f7fe700 1 -- 172.21.15.2:0/2780488112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f3400f460 con 0x7f4f38101ea0 2024-09-13T23:06:27.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.390+0000 7f4f40325700 1 -- 172.21.15.2:0/2780488112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f38196960 con 0x7f4f38101ea0 2024-09-13T23:06:27.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.390+0000 7f4f2f7fe700 1 -- 172.21.15.2:0/2780488112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f34017630 con 0x7f4f38101ea0 2024-09-13T23:06:27.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.390+0000 7f4f40325700 1 -- 172.21.15.2:0/2780488112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f38196e50 con 0x7f4f38101ea0 2024-09-13T23:06:27.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.391+0000 7f4f40325700 1 -- 172.21.15.2:0/2780488112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f38108350 con 0x7f4f38101ea0 2024-09-13T23:06:27.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.392+0000 7f4f2f7fe700 1 -- 172.21.15.2:0/2780488112 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f4f3400f5d0 con 0x7f4f38101ea0 2024-09-13T23:06:27.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.392+0000 7f4f2f7fe700 1 --2- 172.21.15.2:0/2780488112 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4f2406e680 0x7f4f24070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:27.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.392+0000 7f4f2f7fe700 1 -- 172.21.15.2:0/2780488112 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f4f3408faf0 con 0x7f4f38101ea0 2024-09-13T23:06:27.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.392+0000 7f4f3d8c0700 1 --2- 172.21.15.2:0/2780488112 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4f2406e680 0x7f4f24070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:27.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.393+0000 7f4f3d8c0700 1 --2- 172.21.15.2:0/2780488112 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4f2406e680 0x7f4f24070b40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4f38197b50 tx=0x7f4f2800a300 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:27.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.397+0000 7f4f2f7fe700 1 -- 172.21.15.2:0/2780488112 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4f3405c840 con 0x7f4f38101ea0 2024-09-13T23:06:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.626+0000 7f4f40325700 1 -- 172.21.15.2:0/2780488112 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f381970c0 con 0x7f4f2406e680 2024-09-13T23:06:27.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.627+0000 7f4f2f7fe700 1 -- 172.21.15.2:0/2780488112 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f4f381970c0 con 0x7f4f2406e680 2024-09-13T23:06:27.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.629+0000 7f4f40325700 1 -- 172.21.15.2:0/2780488112 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4f2406e680 msgr2=0x7f4f24070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:27.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.629+0000 7f4f40325700 1 --2- 172.21.15.2:0/2780488112 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4f2406e680 0x7f4f24070b40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4f38197b50 tx=0x7f4f2800a300 comp rx=0 tx=0).stop 2024-09-13T23:06:27.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.629+0000 7f4f40325700 1 -- 172.21.15.2:0/2780488112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38101ea0 msgr2=0x7f4f3819c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:27.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.629+0000 7f4f40325700 1 --2- 172.21.15.2:0/2780488112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38101ea0 0x7f4f3819c660 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400b5c0 tx=0x7f4f3400bd50 comp rx=0 tx=0).stop 2024-09-13T23:06:27.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.629+0000 7f4f40325700 1 -- 172.21.15.2:0/2780488112 shutdown_connections 2024-09-13T23:06:27.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.629+0000 7f4f40325700 1 --2- 172.21.15.2:0/2780488112 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4f2406e680 0x7f4f24070b40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:27.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.629+0000 7f4f40325700 1 --2- 172.21.15.2:0/2780488112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f38101ea0 0x7f4f3819c660 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:27.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.629+0000 7f4f40325700 1 --2- 172.21.15.2:0/2780488112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f381027c0 0x7f4f3819cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:27.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.629+0000 7f4f40325700 1 -- 172.21.15.2:0/2780488112 >> 172.21.15.2:0/2780488112 conn(0x7f4f380fb650 msgr2=0x7f4f38105490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:27.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.629+0000 7f4f40325700 1 -- 172.21.15.2:0/2780488112 shutdown_connections 2024-09-13T23:06:27.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:27.629+0000 7f4f40325700 1 -- 172.21.15.2:0/2780488112 wait complete. 2024-09-13T23:06:27.948 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:27 smithi002 ceph-mon[111294]: pgmap v227: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:06:28.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:27 smithi047 ceph-mon[81243]: pgmap v227: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:06:28.369 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch ps' 2024-09-13T23:06:28.620 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:06:29.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:28 smithi002 ceph-mon[111294]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:29.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:28 smithi047 ceph-mon[81243]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:29.994 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:29 smithi002 ceph-mon[111294]: pgmap v228: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:06:30.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:29 smithi047 ceph-mon[81243]: pgmap v228: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:06:30.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.208+0000 7f6cfa25f700 1 -- 172.21.15.2:0/3419343960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf4101850 msgr2=0x7f6cf41058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.208+0000 7f6cfa25f700 1 --2- 172.21.15.2:0/3419343960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf4101850 0x7f6cf41058a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009910 tx=0x7f6ce8009c20 comp rx=0 tx=0).stop 2024-09-13T23:06:30.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.209+0000 7f6cfa25f700 1 -- 172.21.15.2:0/3419343960 shutdown_connections 2024-09-13T23:06:30.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.209+0000 7f6cfa25f700 1 --2- 172.21.15.2:0/3419343960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf4101850 0x7f6cf41058a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.209+0000 7f6cfa25f700 1 --2- 172.21.15.2:0/3419343960 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cf4100ea0 0x7f6cf4101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.209+0000 7f6cfa25f700 1 -- 172.21.15.2:0/3419343960 >> 172.21.15.2:0/3419343960 conn(0x7f6cf40fc750 msgr2=0x7f6cf40feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.209+0000 7f6cfa25f700 1 -- 172.21.15.2:0/3419343960 shutdown_connections 2024-09-13T23:06:30.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.209+0000 7f6cfa25f700 1 -- 172.21.15.2:0/3419343960 wait complete. 2024-09-13T23:06:30.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.209+0000 7f6cfa25f700 1 Processor -- start 2024-09-13T23:06:30.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.209+0000 7f6cfa25f700 1 -- start start 2024-09-13T23:06:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.210+0000 7f6cfa25f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf4100ea0 0x7f6cf419c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.210+0000 7f6cfa25f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cf4101850 0x7f6cf419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.210+0000 7f6cfa25f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf419d2d0 con 0x7f6cf4100ea0 2024-09-13T23:06:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.210+0000 7f6cfa25f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf4196780 con 0x7f6cf4101850 2024-09-13T23:06:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.210+0000 7f6cf37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf4100ea0 0x7f6cf419c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.210+0000 7f6cf37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf4100ea0 0x7f6cf419c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47074/0 (socket says 172.21.15.2:47074) 2024-09-13T23:06:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.210+0000 7f6cf37fe700 1 -- 172.21.15.2:0/1221960125 learned_addr learned my addr 172.21.15.2:0/1221960125 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:06:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.210+0000 7f6cf2ffd700 1 --2- 172.21.15.2:0/1221960125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cf4101850 0x7f6cf419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.210+0000 7f6cf37fe700 1 -- 172.21.15.2:0/1221960125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cf4101850 msgr2=0x7f6cf419cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.210+0000 7f6cf37fe700 1 --2- 172.21.15.2:0/1221960125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cf4101850 0x7f6cf419cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.210+0000 7f6cf37fe700 1 -- 172.21.15.2:0/1221960125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce80095f0 con 0x7f6cf4100ea0 2024-09-13T23:06:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.210+0000 7f6cf37fe700 1 --2- 172.21.15.2:0/1221960125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf4100ea0 0x7f6cf419c700 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400d8d0 tx=0x7f6ce400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.210+0000 7f6cf0ff9700 1 -- 172.21.15.2:0/1221960125 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ce40098a0 con 0x7f6cf4100ea0 2024-09-13T23:06:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.210+0000 7f6cf0ff9700 1 -- 172.21.15.2:0/1221960125 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ce4010460 con 0x7f6cf4100ea0 2024-09-13T23:06:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.210+0000 7f6cfa25f700 1 -- 172.21.15.2:0/1221960125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf4196a60 con 0x7f6cf4100ea0 2024-09-13T23:06:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.210+0000 7f6cf0ff9700 1 -- 172.21.15.2:0/1221960125 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ce400f5f0 con 0x7f6cf4100ea0 2024-09-13T23:06:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.211+0000 7f6cfa25f700 1 -- 172.21.15.2:0/1221960125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf4196f80 con 0x7f6cf4100ea0 2024-09-13T23:06:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.212+0000 7f6cfa25f700 1 -- 172.21.15.2:0/1221960125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf41092a0 con 0x7f6cf4100ea0 2024-09-13T23:06:30.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.212+0000 7f6cf0ff9700 1 -- 172.21.15.2:0/1221960125 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f6ce4009a00 con 0x7f6cf4100ea0 2024-09-13T23:06:30.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.213+0000 7f6cf0ff9700 1 --2- 172.21.15.2:0/1221960125 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f6cdc06e680 0x7f6cdc070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:30.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.213+0000 7f6cf0ff9700 1 -- 172.21.15.2:0/1221960125 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f6ce408e450 con 0x7f6cf4100ea0 2024-09-13T23:06:30.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.213+0000 7f6cf2ffd700 1 --2- 172.21.15.2:0/1221960125 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f6cdc06e680 0x7f6cdc070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:30.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.213+0000 7f6cf2ffd700 1 --2- 172.21.15.2:0/1221960125 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f6cdc06e680 0x7f6cdc070b40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8006010 tx=0x7f6ce801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:30.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.217+0000 7f6cf0ff9700 1 -- 172.21.15.2:0/1221960125 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6ce405b1a0 con 0x7f6cf4100ea0 2024-09-13T23:06:30.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.438+0000 7f6cfa25f700 1 -- 172.21.15.2:0/1221960125 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cf4197da0 con 0x7f6cdc06e680 2024-09-13T23:06:30.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.455+0000 7f6cf0ff9700 1 -- 172.21.15.2:0/1221960125 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f6cf4197da0 con 0x7f6cdc06e680 2024-09-13T23:06:30.456 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:06:30.457 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (8m) 27s ago 18m 26.0M - 0.25.0 c8568f914cd2 f570a73274bc 2024-09-13T23:06:30.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (41s) 27s ago 19m 8150k - 19.1.1-324-gecab7be5 0652ff2b5d78 7e223c4231dc 2024-09-13T23:06:30.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (36s) 33s ago 18m 7314k - 19.1.1-324-gecab7be5 0652ff2b5d78 7457c53e2c65 2024-09-13T23:06:30.457 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (5m) 27s ago 18m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 427cd38a7d88 2024-09-13T23:06:30.457 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (5m) 33s ago 17m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 ce5a1df96005 2024-09-13T23:06:30.457 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (7m) 27s ago 18m 80.1M - 9.4.12 2bacad6d85d8 650673516b69 2024-09-13T23:06:30.457 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (115s) 27s ago 13m 85.4M - 19.1.1-324-gecab7be5 0652ff2b5d78 6c66160ad777 2024-09-13T23:06:30.457 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (97s) 27s ago 13m 86.7M - 19.1.1-324-gecab7be5 0652ff2b5d78 f3dd67424bdb 2024-09-13T23:06:30.457 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (78s) 33s ago 13m 13.1M - 19.1.1-324-gecab7be5 0652ff2b5d78 9e8e78202975 2024-09-13T23:06:30.457 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (55s) 33s ago 13m 14.1M - 19.1.1-324-gecab7be5 0652ff2b5d78 705dc8749820 2024-09-13T23:06:30.457 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 running (9m) 27s ago 20m 505M - 19.1.1-324-gecab7be5 0652ff2b5d78 7a8aa9de37e4 2024-09-13T23:06:30.457 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (9m) 33s ago 17m 442M - 19.1.1-324-gecab7be5 0652ff2b5d78 13fa6f3b5a8a 2024-09-13T23:06:30.457 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (6m) 27s ago 20m 58.5M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 db0ef6c509cf 2024-09-13T23:06:30.458 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (6m) 33s ago 17m 46.1M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 ea0c2a2e0e1a 2024-09-13T23:06:30.458 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (8m) 27s ago 18m 14.7M - 1.5.0 0da6a335fe13 f3eae5f90ab8 2024-09-13T23:06:30.458 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (8m) 33s ago 17m 15.8M - 1.5.0 0da6a335fe13 a5c7d7f1eaa5 2024-09-13T23:06:30.458 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (5m) 27s ago 17m 96.0M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 0ca6dd66fa68 2024-09-13T23:06:30.458 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (4m) 27s ago 16m 102M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 6f5ae2cfa818 2024-09-13T23:06:30.458 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (3m) 27s ago 16m 89.8M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 15b9e8db7556 2024-09-13T23:06:30.458 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (3m) 33s ago 15m 117M 2241M 19.1.1-324-gecab7be5 0652ff2b5d78 de54fd3fea34 2024-09-13T23:06:30.458 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (2m) 33s ago 15m 92.7M 2241M 19.1.1-324-gecab7be5 0652ff2b5d78 185d7ae7181b 2024-09-13T23:06:30.458 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (2m) 33s ago 14m 92.6M 2241M 19.1.1-324-gecab7be5 0652ff2b5d78 aeb44a823828 2024-09-13T23:06:30.458 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (8m) 27s ago 18m 81.1M - 2.43.0 a07b618ecd1d aa241d1048de 2024-09-13T23:06:30.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.457+0000 7f6cfa25f700 1 -- 172.21.15.2:0/1221960125 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f6cdc06e680 msgr2=0x7f6cdc070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.457+0000 7f6cfa25f700 1 --2- 172.21.15.2:0/1221960125 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f6cdc06e680 0x7f6cdc070b40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8006010 tx=0x7f6ce801a040 comp rx=0 tx=0).stop 2024-09-13T23:06:30.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.457+0000 7f6cfa25f700 1 -- 172.21.15.2:0/1221960125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf4100ea0 msgr2=0x7f6cf419c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:30.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.457+0000 7f6cfa25f700 1 --2- 172.21.15.2:0/1221960125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf4100ea0 0x7f6cf419c700 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400d8d0 tx=0x7f6ce400dbe0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.458+0000 7f6cfa25f700 1 -- 172.21.15.2:0/1221960125 shutdown_connections 2024-09-13T23:06:30.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.458+0000 7f6cfa25f700 1 --2- 172.21.15.2:0/1221960125 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f6cdc06e680 0x7f6cdc070b40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.458+0000 7f6cfa25f700 1 --2- 172.21.15.2:0/1221960125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cf4100ea0 0x7f6cf419c700 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.458+0000 7f6cfa25f700 1 --2- 172.21.15.2:0/1221960125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6cf4101850 0x7f6cf419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:30.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.458+0000 7f6cfa25f700 1 -- 172.21.15.2:0/1221960125 >> 172.21.15.2:0/1221960125 conn(0x7f6cf40fc750 msgr2=0x7f6cf40fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:30.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.458+0000 7f6cfa25f700 1 -- 172.21.15.2:0/1221960125 shutdown_connections 2024-09-13T23:06:30.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:30.458+0000 7f6cfa25f700 1 -- 172.21.15.2:0/1221960125 wait complete. 2024-09-13T23:06:31.142 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch upgrade status' 2024-09-13T23:06:31.356 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:06:31.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:31 smithi002 ceph-mon[111294]: pgmap v229: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:32.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:31 smithi002 ceph-mon[111294]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:32.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:31 smithi047 ceph-mon[81243]: pgmap v229: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:32.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:31 smithi047 ceph-mon[81243]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.982+0000 7f7bcc09d700 1 -- 172.21.15.2:0/2015160880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc4101e00 msgr2=0x7f7bc41021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.982+0000 7f7bcc09d700 1 --2- 172.21.15.2:0/2015160880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc4101e00 0x7f7bc41021e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009910 tx=0x7f7bc0009c20 comp rx=0 tx=0).stop 2024-09-13T23:06:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.982+0000 7f7bcc09d700 1 -- 172.21.15.2:0/2015160880 shutdown_connections 2024-09-13T23:06:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.982+0000 7f7bcc09d700 1 --2- 172.21.15.2:0/2015160880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bc4102720 0x7f7bc410ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.982+0000 7f7bcc09d700 1 --2- 172.21.15.2:0/2015160880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc4101e00 0x7f7bc41021e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.982+0000 7f7bcc09d700 1 -- 172.21.15.2:0/2015160880 >> 172.21.15.2:0/2015160880 conn(0x7f7bc40fb650 msgr2=0x7f7bc40fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:32.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.982+0000 7f7bcc09d700 1 -- 172.21.15.2:0/2015160880 shutdown_connections 2024-09-13T23:06:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.982+0000 7f7bcc09d700 1 -- 172.21.15.2:0/2015160880 wait complete. 2024-09-13T23:06:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.983+0000 7f7bcc09d700 1 Processor -- start 2024-09-13T23:06:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.983+0000 7f7bcc09d700 1 -- start start 2024-09-13T23:06:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.983+0000 7f7bcc09d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bc4101e00 0x7f7bc419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.983+0000 7f7bcc09d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc4102720 0x7f7bc419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.983+0000 7f7bcc09d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc419d260 con 0x7f7bc4102720 2024-09-13T23:06:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.983+0000 7f7bcc09d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc4196710 con 0x7f7bc4101e00 2024-09-13T23:06:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.983+0000 7f7bc9638700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc4102720 0x7f7bc419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.983+0000 7f7bc9638700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc4102720 0x7f7bc419cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47078/0 (socket says 172.21.15.2:47078) 2024-09-13T23:06:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.983+0000 7f7bc9638700 1 -- 172.21.15.2:0/1590019930 learned_addr learned my addr 172.21.15.2:0/1590019930 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:06:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.983+0000 7f7bc9e39700 1 --2- 172.21.15.2:0/1590019930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bc4101e00 0x7f7bc419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.984+0000 7f7bc9638700 1 -- 172.21.15.2:0/1590019930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bc4101e00 msgr2=0x7f7bc419c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:32.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.984+0000 7f7bc9638700 1 --2- 172.21.15.2:0/1590019930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bc4101e00 0x7f7bc419c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.984+0000 7f7bc9638700 1 -- 172.21.15.2:0/1590019930 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc00095f0 con 0x7f7bc4102720 2024-09-13T23:06:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.984+0000 7f7bc9638700 1 --2- 172.21.15.2:0/1590019930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc4102720 0x7f7bc419cbd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400d8d0 tx=0x7f7bb400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.984+0000 7f7bbaffd700 1 -- 172.21.15.2:0/1590019930 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bb40041f0 con 0x7f7bc4102720 2024-09-13T23:06:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.984+0000 7f7bbaffd700 1 -- 172.21.15.2:0/1590019930 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7bb4004350 con 0x7f7bc4102720 2024-09-13T23:06:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.984+0000 7f7bcc09d700 1 -- 172.21.15.2:0/1590019930 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc41969f0 con 0x7f7bc4102720 2024-09-13T23:06:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.984+0000 7f7bbaffd700 1 -- 172.21.15.2:0/1590019930 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bb4003c80 con 0x7f7bc4102720 2024-09-13T23:06:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.984+0000 7f7bcc09d700 1 -- 172.21.15.2:0/1590019930 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc4196f40 con 0x7f7bc4102720 2024-09-13T23:06:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.985+0000 7f7bcc09d700 1 -- 172.21.15.2:0/1590019930 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc4108310 con 0x7f7bc4102720 2024-09-13T23:06:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.985+0000 7f7bbaffd700 1 -- 172.21.15.2:0/1590019930 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f7bb400f690 con 0x7f7bc4102720 2024-09-13T23:06:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.986+0000 7f7bbaffd700 1 --2- 172.21.15.2:0/1590019930 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f7bb006e680 0x7f7bb0070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.986+0000 7f7bbaffd700 1 -- 172.21.15.2:0/1590019930 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f7bb408e130 con 0x7f7bc4102720 2024-09-13T23:06:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.986+0000 7f7bc9e39700 1 --2- 172.21.15.2:0/1590019930 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f7bb006e680 0x7f7bb0070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.986+0000 7f7bc9e39700 1 --2- 172.21.15.2:0/1590019930 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f7bb006e680 0x7f7bb0070b40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0006010 tx=0x7f7bc001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:32.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:32.990+0000 7f7bbaffd700 1 -- 172.21.15.2:0/1590019930 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7bb405ae80 con 0x7f7bc4102720 2024-09-13T23:06:33.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:33.225+0000 7f7bcc09d700 1 -- 172.21.15.2:0/1590019930 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bc41971b0 con 0x7f7bb006e680 2024-09-13T23:06:33.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:33.226+0000 7f7bbaffd700 1 -- 172.21.15.2:0/1590019930 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f7bc41971b0 con 0x7f7bb006e680 2024-09-13T23:06:33.227 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:06:33.227 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": null, 2024-09-13T23:06:33.227 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": false, 2024-09-13T23:06:33.227 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "", 2024-09-13T23:06:33.227 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [], 2024-09-13T23:06:33.227 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": null, 2024-09-13T23:06:33.227 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "", 2024-09-13T23:06:33.227 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-13T23:06:33.227 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:06:33.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:33.228+0000 7f7bcc09d700 1 -- 172.21.15.2:0/1590019930 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f7bb006e680 msgr2=0x7f7bb0070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:33.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:33.228+0000 7f7bcc09d700 1 --2- 172.21.15.2:0/1590019930 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f7bb006e680 0x7f7bb0070b40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0006010 tx=0x7f7bc001a040 comp rx=0 tx=0).stop 2024-09-13T23:06:33.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:33.228+0000 7f7bcc09d700 1 -- 172.21.15.2:0/1590019930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc4102720 msgr2=0x7f7bc419cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:33.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:33.228+0000 7f7bcc09d700 1 --2- 172.21.15.2:0/1590019930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc4102720 0x7f7bc419cbd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400d8d0 tx=0x7f7bb400dbe0 comp rx=0 tx=0).stop 2024-09-13T23:06:33.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:33.228+0000 7f7bcc09d700 1 -- 172.21.15.2:0/1590019930 shutdown_connections 2024-09-13T23:06:33.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:33.228+0000 7f7bcc09d700 1 --2- 172.21.15.2:0/1590019930 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f7bb006e680 0x7f7bb0070b40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:33.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:33.228+0000 7f7bcc09d700 1 --2- 172.21.15.2:0/1590019930 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7bc4101e00 0x7f7bc419c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:33.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:33.228+0000 7f7bcc09d700 1 --2- 172.21.15.2:0/1590019930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bc4102720 0x7f7bc419cbd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:33.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:33.228+0000 7f7bcc09d700 1 -- 172.21.15.2:0/1590019930 >> 172.21.15.2:0/1590019930 conn(0x7f7bc40fb650 msgr2=0x7f7bc4105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:33.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:33.228+0000 7f7bcc09d700 1 -- 172.21.15.2:0/1590019930 shutdown_connections 2024-09-13T23:06:33.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:33.229+0000 7f7bcc09d700 1 -- 172.21.15.2:0/1590019930 wait complete. 2024-09-13T23:06:33.902 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:33 smithi002 ceph-mon[111294]: pgmap v230: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:06:33.925 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph health detail' 2024-09-13T23:06:34.134 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:06:34.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:33 smithi047 ceph-mon[81243]: pgmap v230: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:06:35.142 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:34 smithi002 ceph-mon[111294]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:35.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:34 smithi047 ceph-mon[81243]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:06:35.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.711+0000 7f5ee6dd2700 1 -- 172.21.15.2:0/1397200836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ee00ffda0 msgr2=0x7f5ee0100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:35.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.712+0000 7f5ee6dd2700 1 --2- 172.21.15.2:0/1397200836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ee00ffda0 0x7f5ee0100180 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009910 tx=0x7f5ed0009c20 comp rx=0 tx=0).stop 2024-09-13T23:06:35.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.712+0000 7f5ee6dd2700 1 -- 172.21.15.2:0/1397200836 shutdown_connections 2024-09-13T23:06:35.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.712+0000 7f5ee6dd2700 1 --2- 172.21.15.2:0/1397200836 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ee0100750 0x7f5ee01047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:35.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.712+0000 7f5ee6dd2700 1 --2- 172.21.15.2:0/1397200836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ee00ffda0 0x7f5ee0100180 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:35.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.712+0000 7f5ee6dd2700 1 -- 172.21.15.2:0/1397200836 >> 172.21.15.2:0/1397200836 conn(0x7f5ee00fb650 msgr2=0x7f5ee00fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:35.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.712+0000 7f5ee6dd2700 1 -- 172.21.15.2:0/1397200836 shutdown_connections 2024-09-13T23:06:35.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.712+0000 7f5ee6dd2700 1 -- 172.21.15.2:0/1397200836 wait complete. 2024-09-13T23:06:35.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.713+0000 7f5ee6dd2700 1 Processor -- start 2024-09-13T23:06:35.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.713+0000 7f5ee6dd2700 1 -- start start 2024-09-13T23:06:35.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.713+0000 7f5ee6dd2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ee00ffda0 0x7f5ee01976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:35.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.713+0000 7f5ee6dd2700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ee0100750 0x7f5ee0197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:35.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.713+0000 7f5ee6dd2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee0198250 con 0x7f5ee00ffda0 2024-09-13T23:06:35.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.713+0000 7f5ee6dd2700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee0198390 con 0x7f5ee0100750 2024-09-13T23:06:35.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.713+0000 7f5ee4b6e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ee00ffda0 0x7f5ee01976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:35.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.713+0000 7f5ee4b6e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ee00ffda0 0x7f5ee01976f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47090/0 (socket says 172.21.15.2:47090) 2024-09-13T23:06:35.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.713+0000 7f5ee4b6e700 1 -- 172.21.15.2:0/2745504740 learned_addr learned my addr 172.21.15.2:0/2745504740 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:06:35.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.713+0000 7f5edffff700 1 --2- 172.21.15.2:0/2745504740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ee0100750 0x7f5ee0197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:35.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.713+0000 7f5ee4b6e700 1 -- 172.21.15.2:0/2745504740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ee0100750 msgr2=0x7f5ee0197c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:35.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.713+0000 7f5ee4b6e700 1 --2- 172.21.15.2:0/2745504740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ee0100750 0x7f5ee0197c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:35.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.713+0000 7f5ee4b6e700 1 -- 172.21.15.2:0/2745504740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed00095f0 con 0x7f5ee00ffda0 2024-09-13T23:06:35.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.714+0000 7f5ee4b6e700 1 --2- 172.21.15.2:0/2745504740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ee00ffda0 0x7f5ee01976f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00092e0 tx=0x7f5ed000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:35.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.714+0000 7f5eddffb700 1 -- 172.21.15.2:0/2745504740 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ed001d070 con 0x7f5ee00ffda0 2024-09-13T23:06:35.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.714+0000 7f5ee6dd2700 1 -- 172.21.15.2:0/2745504740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee01a0760 con 0x7f5ee00ffda0 2024-09-13T23:06:35.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.714+0000 7f5eddffb700 1 -- 172.21.15.2:0/2745504740 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ed0005e00 con 0x7f5ee00ffda0 2024-09-13T23:06:35.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.714+0000 7f5eddffb700 1 -- 172.21.15.2:0/2745504740 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ed0017400 con 0x7f5ee00ffda0 2024-09-13T23:06:35.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.714+0000 7f5ee6dd2700 1 -- 172.21.15.2:0/2745504740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee01a0b70 con 0x7f5ee00ffda0 2024-09-13T23:06:35.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.715+0000 7f5ee6dd2700 1 -- 172.21.15.2:0/2745504740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee0108140 con 0x7f5ee00ffda0 2024-09-13T23:06:35.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.716+0000 7f5eddffb700 1 -- 172.21.15.2:0/2745504740 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f5ed000f6f0 con 0x7f5ee00ffda0 2024-09-13T23:06:35.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.716+0000 7f5eddffb700 1 --2- 172.21.15.2:0/2745504740 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f5ecc06e680 0x7f5ecc070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:35.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.716+0000 7f5eddffb700 1 -- 172.21.15.2:0/2745504740 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f5ed008fb50 con 0x7f5ee00ffda0 2024-09-13T23:06:35.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.716+0000 7f5edffff700 1 --2- 172.21.15.2:0/2745504740 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f5ecc06e680 0x7f5ecc070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:35.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.717+0000 7f5edffff700 1 --2- 172.21.15.2:0/2745504740 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f5ecc06e680 0x7f5ecc070b40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5ee00696c0 tx=0x7f5ec800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:35.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:35.721+0000 7f5eddffb700 1 -- 172.21.15.2:0/2745504740 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5ed0058cf0 con 0x7f5ee00ffda0 2024-09-13T23:06:36.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:36.019+0000 7f5ee6dd2700 1 -- 172.21.15.2:0/2745504740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5ee0107b20 con 0x7f5ee00ffda0 2024-09-13T23:06:36.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:36.019+0000 7f5eddffb700 1 -- 172.21.15.2:0/2745504740 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f5ed005c3b0 con 0x7f5ee00ffda0 2024-09-13T23:06:36.020 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T23:06:36.020 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-13T23:06:36.020 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-13T23:06:36.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:36.021+0000 7f5ee6dd2700 1 -- 172.21.15.2:0/2745504740 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f5ecc06e680 msgr2=0x7f5ecc070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:36.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:36.021+0000 7f5ee6dd2700 1 --2- 172.21.15.2:0/2745504740 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f5ecc06e680 0x7f5ecc070b40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5ee00696c0 tx=0x7f5ec800b410 comp rx=0 tx=0).stop 2024-09-13T23:06:36.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:36.021+0000 7f5ee6dd2700 1 -- 172.21.15.2:0/2745504740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ee00ffda0 msgr2=0x7f5ee01976f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:36.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:36.021+0000 7f5ee6dd2700 1 --2- 172.21.15.2:0/2745504740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ee00ffda0 0x7f5ee01976f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00092e0 tx=0x7f5ed000bd70 comp rx=0 tx=0).stop 2024-09-13T23:06:36.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:36.021+0000 7f5ee6dd2700 1 -- 172.21.15.2:0/2745504740 shutdown_connections 2024-09-13T23:06:36.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:36.021+0000 7f5ee6dd2700 1 --2- 172.21.15.2:0/2745504740 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f5ecc06e680 0x7f5ecc070b40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:36.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:36.021+0000 7f5ee6dd2700 1 --2- 172.21.15.2:0/2745504740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ee00ffda0 0x7f5ee01976f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:36.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:36.021+0000 7f5ee6dd2700 1 --2- 172.21.15.2:0/2745504740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5ee0100750 0x7f5ee0197c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:36.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:36.021+0000 7f5ee6dd2700 1 -- 172.21.15.2:0/2745504740 >> 172.21.15.2:0/2745504740 conn(0x7f5ee00fb650 msgr2=0x7f5ee00fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:36.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:36.021+0000 7f5ee6dd2700 1 -- 172.21.15.2:0/2745504740 shutdown_connections 2024-09-13T23:06:36.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:36.021+0000 7f5ee6dd2700 1 -- 172.21.15.2:0/2745504740 wait complete. 2024-09-13T23:06:36.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:35 smithi047 ceph-mon[81243]: pgmap v231: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:36.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:35 smithi002 ceph-mon[111294]: pgmap v231: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:36.708 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions' 2024-09-13T23:06:36.920 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:06:36.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:36 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/2745504740' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:06:37.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:36 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/2745504740' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T23:06:37.807 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:37 smithi002 ceph-mon[111294]: pgmap v232: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:06:38.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:37 smithi047 ceph-mon[81243]: pgmap v232: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:06:38.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.534+0000 7fda19d3d700 1 -- 172.21.15.2:0/56951331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda140ffa10 msgr2=0x7fda140ffdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:38.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.534+0000 7fda19d3d700 1 --2- 172.21.15.2:0/56951331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda140ffa10 0x7fda140ffdf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fda04009910 tx=0x7fda04009c20 comp rx=0 tx=0).stop 2024-09-13T23:06:38.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.534+0000 7fda19d3d700 1 -- 172.21.15.2:0/56951331 shutdown_connections 2024-09-13T23:06:38.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.534+0000 7fda19d3d700 1 --2- 172.21.15.2:0/56951331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda14100330 0x7fda1410d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:38.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.534+0000 7fda19d3d700 1 --2- 172.21.15.2:0/56951331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda140ffa10 0x7fda140ffdf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:38.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.534+0000 7fda19d3d700 1 -- 172.21.15.2:0/56951331 >> 172.21.15.2:0/56951331 conn(0x7fda140fb650 msgr2=0x7fda140fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:38.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.534+0000 7fda19d3d700 1 -- 172.21.15.2:0/56951331 shutdown_connections 2024-09-13T23:06:38.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.534+0000 7fda19d3d700 1 -- 172.21.15.2:0/56951331 wait complete. 2024-09-13T23:06:38.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.534+0000 7fda19d3d700 1 Processor -- start 2024-09-13T23:06:38.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.535+0000 7fda19d3d700 1 -- start start 2024-09-13T23:06:38.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.535+0000 7fda19d3d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda140ffa10 0x7fda1419e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:38.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.535+0000 7fda19d3d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda14100330 0x7fda1419edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:38.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.535+0000 7fda19d3d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1419f440 con 0x7fda140ffa10 2024-09-13T23:06:38.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.535+0000 7fda19d3d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda141988f0 con 0x7fda14100330 2024-09-13T23:06:38.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.535+0000 7fda137fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda140ffa10 0x7fda1419e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:38.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.535+0000 7fda137fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda140ffa10 0x7fda1419e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47102/0 (socket says 172.21.15.2:47102) 2024-09-13T23:06:38.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.535+0000 7fda137fe700 1 -- 172.21.15.2:0/4200786521 learned_addr learned my addr 172.21.15.2:0/4200786521 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:06:38.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.535+0000 7fda12ffd700 1 --2- 172.21.15.2:0/4200786521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda14100330 0x7fda1419edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:38.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.535+0000 7fda137fe700 1 -- 172.21.15.2:0/4200786521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda14100330 msgr2=0x7fda1419edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:38.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.535+0000 7fda137fe700 1 --2- 172.21.15.2:0/4200786521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda14100330 0x7fda1419edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:38.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.535+0000 7fda137fe700 1 -- 172.21.15.2:0/4200786521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda040095f0 con 0x7fda140ffa10 2024-09-13T23:06:38.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.535+0000 7fda12ffd700 1 --2- 172.21.15.2:0/4200786521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda14100330 0x7fda1419edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:06:38.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.535+0000 7fda137fe700 1 --2- 172.21.15.2:0/4200786521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda140ffa10 0x7fda1419e870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fda040092e0 tx=0x7fda040056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:38.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.536+0000 7fda10ff9700 1 -- 172.21.15.2:0/4200786521 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda0401d070 con 0x7fda140ffa10 2024-09-13T23:06:38.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.536+0000 7fda10ff9700 1 -- 172.21.15.2:0/4200786521 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda0400f460 con 0x7fda140ffa10 2024-09-13T23:06:38.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.536+0000 7fda19d3d700 1 -- 172.21.15.2:0/4200786521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda14198b70 con 0x7fda140ffa10 2024-09-13T23:06:38.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.536+0000 7fda10ff9700 1 -- 172.21.15.2:0/4200786521 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda04021640 con 0x7fda140ffa10 2024-09-13T23:06:38.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.536+0000 7fda19d3d700 1 -- 172.21.15.2:0/4200786521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda141990c0 con 0x7fda140ffa10 2024-09-13T23:06:38.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.537+0000 7fda19d3d700 1 -- 172.21.15.2:0/4200786521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1410a7f0 con 0x7fda140ffa10 2024-09-13T23:06:38.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.537+0000 7fda10ff9700 1 -- 172.21.15.2:0/4200786521 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fda04003a60 con 0x7fda140ffa10 2024-09-13T23:06:38.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.538+0000 7fda10ff9700 1 --2- 172.21.15.2:0/4200786521 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fd9fc06e680 0x7fd9fc070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:06:38.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.538+0000 7fda10ff9700 1 -- 172.21.15.2:0/4200786521 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fda0408f830 con 0x7fda140ffa10 2024-09-13T23:06:38.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.538+0000 7fda12ffd700 1 --2- 172.21.15.2:0/4200786521 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fd9fc06e680 0x7fd9fc070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:06:38.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.538+0000 7fda12ffd700 1 --2- 172.21.15.2:0/4200786521 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fd9fc06e680 0x7fd9fc070b40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fda08005950 tx=0x7fda080058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:06:38.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.542+0000 7fda10ff9700 1 -- 172.21.15.2:0/4200786521 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fda0405c580 con 0x7fda140ffa10 2024-09-13T23:06:38.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.841+0000 7fda19d3d700 1 -- 172.21.15.2:0/4200786521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fda1404f2e0 con 0x7fda140ffa10 2024-09-13T23:06:38.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.841+0000 7fda10ff9700 1 -- 172.21.15.2:0/4200786521 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fda0405c110 con 0x7fda140ffa10 2024-09-13T23:06:38.842 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:06:38.842 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T23:06:38.842 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:06:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:06:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T23:06:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:06:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:06:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T23:06:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T23:06:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:06:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T23:06:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T23:06:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:06:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T23:06:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 14 2024-09-13T23:06:38.843 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T23:06:38.843 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:06:38.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.844+0000 7fda19d3d700 1 -- 172.21.15.2:0/4200786521 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fd9fc06e680 msgr2=0x7fd9fc070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:38.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.844+0000 7fda19d3d700 1 --2- 172.21.15.2:0/4200786521 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fd9fc06e680 0x7fd9fc070b40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fda08005950 tx=0x7fda080058e0 comp rx=0 tx=0).stop 2024-09-13T23:06:38.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.844+0000 7fda19d3d700 1 -- 172.21.15.2:0/4200786521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda140ffa10 msgr2=0x7fda1419e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:06:38.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.844+0000 7fda19d3d700 1 --2- 172.21.15.2:0/4200786521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda140ffa10 0x7fda1419e870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fda040092e0 tx=0x7fda040056a0 comp rx=0 tx=0).stop 2024-09-13T23:06:38.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.844+0000 7fda19d3d700 1 -- 172.21.15.2:0/4200786521 shutdown_connections 2024-09-13T23:06:38.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.844+0000 7fda19d3d700 1 --2- 172.21.15.2:0/4200786521 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fd9fc06e680 0x7fd9fc070b40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:38.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.844+0000 7fda19d3d700 1 --2- 172.21.15.2:0/4200786521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda140ffa10 0x7fda1419e870 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:38.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.844+0000 7fda19d3d700 1 --2- 172.21.15.2:0/4200786521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda14100330 0x7fda1419edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:06:38.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.844+0000 7fda19d3d700 1 -- 172.21.15.2:0/4200786521 >> 172.21.15.2:0/4200786521 conn(0x7fda140fb650 msgr2=0x7fda140fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:06:38.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.844+0000 7fda19d3d700 1 -- 172.21.15.2:0/4200786521 shutdown_connections 2024-09-13T23:06:38.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:06:38.844+0000 7fda19d3d700 1 -- 172.21.15.2:0/4200786521 wait complete. 2024-09-13T23:06:39.131 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:06:39.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:06:39.420 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-13T23:06:39.629 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:06:40.009 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:39 smithi002 ceph-mon[111294]: pgmap v233: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:06:40.009 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:39 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/4200786521' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:40.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:39 smithi047 ceph-mon[81243]: pgmap v233: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:06:40.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:39 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/4200786521' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:06:41.241 INFO:teuthology.orchestra.run.smithi002.stdout:wait for servicemap items w/ changing names to refresh 2024-09-13T23:06:41.889 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'sleep 60' 2024-09-13T23:06:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:06:42.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:41 smithi047 ceph-mon[81243]: pgmap v234: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:42.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:41 smithi002 ceph-mon[111294]: pgmap v234: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:44.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:43 smithi047 ceph-mon[81243]: pgmap v235: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:06:44.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:43 smithi002 ceph-mon[111294]: pgmap v235: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:06:46.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:45 smithi047 ceph-mon[81243]: pgmap v236: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:46.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:45 smithi002 ceph-mon[111294]: pgmap v236: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:48.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:47 smithi047 ceph-mon[81243]: pgmap v237: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:06:48.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:47 smithi002 ceph-mon[111294]: pgmap v237: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:06:50.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:49 smithi047 ceph-mon[81243]: pgmap v238: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:06:50.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:49 smithi002 ceph-mon[111294]: pgmap v238: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:06:52.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:51 smithi047 ceph-mon[81243]: pgmap v239: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:52.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:51 smithi002 ceph-mon[111294]: pgmap v239: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:54.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:53 smithi047 ceph-mon[81243]: pgmap v240: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:06:54.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:06:54.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:53 smithi002 ceph-mon[111294]: pgmap v240: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:06:54.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:06:56.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:55 smithi047 ceph-mon[81243]: pgmap v241: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:56.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:55 smithi002 ceph-mon[111294]: pgmap v241: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:06:58.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:57 smithi047 ceph-mon[81243]: pgmap v242: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:06:58.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:57 smithi002 ceph-mon[111294]: pgmap v242: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:07:00.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:06:59 smithi047 ceph-mon[81243]: pgmap v243: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:00.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:06:59 smithi002 ceph-mon[111294]: pgmap v243: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:00.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:00 smithi047 ceph-mon[81243]: pgmap v244: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:01.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:00 smithi002 ceph-mon[111294]: pgmap v244: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:02 smithi002 ceph-mon[111294]: pgmap v245: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:03.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:02 smithi047 ceph-mon[81243]: pgmap v245: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:05.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:04 smithi002 ceph-mon[111294]: pgmap v246: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:05.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:04 smithi047 ceph-mon[81243]: pgmap v246: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:07.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:06 smithi002 ceph-mon[111294]: pgmap v247: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:07:07.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:06 smithi047 ceph-mon[81243]: pgmap v247: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:07:08.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:07:08.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:07:09.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:08 smithi002 ceph-mon[111294]: pgmap v248: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:09.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:07:09.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:07:09.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:07:09.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:07:09.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:08 smithi047 ceph-mon[81243]: pgmap v248: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:09.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:07:09.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:07:09.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:07:09.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:07:11.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:10 smithi047 ceph-mon[81243]: pgmap v249: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:11.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:10 smithi002 ceph-mon[111294]: pgmap v249: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:13.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:12 smithi002 ceph-mon[111294]: pgmap v250: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:13.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:12 smithi047 ceph-mon[81243]: pgmap v250: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:15.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:14 smithi002 ceph-mon[111294]: pgmap v251: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:15.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:14 smithi047 ceph-mon[81243]: pgmap v251: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:17.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:16 smithi002 ceph-mon[111294]: pgmap v252: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:07:17.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:16 smithi047 ceph-mon[81243]: pgmap v252: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:07:19.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:18 smithi002 ceph-mon[111294]: pgmap v253: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:19.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:18 smithi047 ceph-mon[81243]: pgmap v253: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:21.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:20 smithi002 ceph-mon[111294]: pgmap v254: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:21.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:20 smithi047 ceph-mon[81243]: pgmap v254: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:23.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:22 smithi002 ceph-mon[111294]: pgmap v255: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:23.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:22 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:07:23.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:22 smithi047 ceph-mon[81243]: pgmap v255: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:23.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:22 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:07:25.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:24 smithi002 ceph-mon[111294]: pgmap v256: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:25.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:24 smithi047 ceph-mon[81243]: pgmap v256: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:27.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:26 smithi002 ceph-mon[111294]: pgmap v257: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:27.314 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:26 smithi047 ceph-mon[81243]: pgmap v257: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:29.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:28 smithi002 ceph-mon[111294]: pgmap v258: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:07:29.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:28 smithi047 ceph-mon[81243]: pgmap v258: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:07:31.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:30 smithi002 ceph-mon[111294]: pgmap v259: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:31.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:30 smithi047 ceph-mon[81243]: pgmap v259: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:33.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:33 smithi047 ceph-mon[81243]: pgmap v260: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:33.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:33 smithi002 ceph-mon[111294]: pgmap v260: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:35.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:35 smithi047 ceph-mon[81243]: pgmap v261: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:35.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:35 smithi002 ceph-mon[111294]: pgmap v261: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:37.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:37 smithi047 ceph-mon[81243]: pgmap v262: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:37.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:37 smithi002 ceph-mon[111294]: pgmap v262: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:38.391 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:07:38.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:07:39.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:39 smithi047 ceph-mon[81243]: pgmap v263: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:39.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:39 smithi002 ceph-mon[111294]: pgmap v263: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:41.277 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:41 smithi047 ceph-mon[81243]: pgmap v264: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:41.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:41 smithi002 ceph-mon[111294]: pgmap v264: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:43.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:43 smithi047 ceph-mon[81243]: pgmap v265: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:43.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:43 smithi002 ceph-mon[111294]: pgmap v265: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:44.276 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph orch ps' 2024-09-13T23:07:44.492 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:07:45.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:45 smithi002 ceph-mon[111294]: pgmap v266: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:45.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:45 smithi047 ceph-mon[81243]: pgmap v266: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:46.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.306+0000 7f9cc8010700 1 -- 172.21.15.2:0/2842666112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cc0105350 msgr2=0x7f9cc0105730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:46.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.306+0000 7f9cc8010700 1 --2- 172.21.15.2:0/2842666112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cc0105350 0x7f9cc0105730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009910 tx=0x7f9cb4009c20 comp rx=0 tx=0).stop 2024-09-13T23:07:46.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.306+0000 7f9cc8010700 1 -- 172.21.15.2:0/2842666112 shutdown_connections 2024-09-13T23:07:46.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.306+0000 7f9cc8010700 1 --2- 172.21.15.2:0/2842666112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc00ff340 0x7f9cc00ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.306+0000 7f9cc8010700 1 --2- 172.21.15.2:0/2842666112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cc0105350 0x7f9cc0105730 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.306+0000 7f9cc8010700 1 -- 172.21.15.2:0/2842666112 >> 172.21.15.2:0/2842666112 conn(0x7f9cc0074e30 msgr2=0x7f9cc0075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.306+0000 7f9cc8010700 1 -- 172.21.15.2:0/2842666112 shutdown_connections 2024-09-13T23:07:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.306+0000 7f9cc8010700 1 -- 172.21.15.2:0/2842666112 wait complete. 2024-09-13T23:07:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.307+0000 7f9cc8010700 1 Processor -- start 2024-09-13T23:07:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.307+0000 7f9cc8010700 1 -- start start 2024-09-13T23:07:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.307+0000 7f9cc8010700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc00ff340 0x7f9cc0194490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.307+0000 7f9cc8010700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cc0105350 0x7f9cc01949d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.307+0000 7f9cc8010700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc0194fa0 con 0x7f9cc0105350 2024-09-13T23:07:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.307+0000 7f9cc8010700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc0195110 con 0x7f9cc00ff340 2024-09-13T23:07:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.307+0000 7f9cc55ab700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cc0105350 0x7f9cc01949d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.307+0000 7f9cc55ab700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cc0105350 0x7f9cc01949d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50212/0 (socket says 172.21.15.2:50212) 2024-09-13T23:07:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.307+0000 7f9cc55ab700 1 -- 172.21.15.2:0/394807240 learned_addr learned my addr 172.21.15.2:0/394807240 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:07:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.307+0000 7f9cc5dac700 1 --2- 172.21.15.2:0/394807240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc00ff340 0x7f9cc0194490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.308+0000 7f9cc55ab700 1 -- 172.21.15.2:0/394807240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc00ff340 msgr2=0x7f9cc0194490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.308+0000 7f9cc55ab700 1 --2- 172.21.15.2:0/394807240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc00ff340 0x7f9cc0194490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.308+0000 7f9cc55ab700 1 -- 172.21.15.2:0/394807240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb40095f0 con 0x7f9cc0105350 2024-09-13T23:07:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.308+0000 7f9cc55ab700 1 --2- 172.21.15.2:0/394807240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cc0105350 0x7f9cc01949d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00dd40 tx=0x7f9cbc00a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.308+0000 7f9cb2ffd700 1 -- 172.21.15.2:0/394807240 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cbc00ad10 con 0x7f9cc0105350 2024-09-13T23:07:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.308+0000 7f9cb2ffd700 1 -- 172.21.15.2:0/394807240 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9cbc00ae70 con 0x7f9cc0105350 2024-09-13T23:07:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.308+0000 7f9cc8010700 1 -- 172.21.15.2:0/394807240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc01a2a40 con 0x7f9cc0105350 2024-09-13T23:07:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.308+0000 7f9cb2ffd700 1 -- 172.21.15.2:0/394807240 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cbc0168a0 con 0x7f9cc0105350 2024-09-13T23:07:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.308+0000 7f9cc8010700 1 -- 172.21.15.2:0/394807240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc01a2eb0 con 0x7f9cc0105350 2024-09-13T23:07:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.309+0000 7f9cc8010700 1 -- 172.21.15.2:0/394807240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc0107850 con 0x7f9cc0105350 2024-09-13T23:07:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.310+0000 7f9cb2ffd700 1 -- 172.21.15.2:0/394807240 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f9cbc00e450 con 0x7f9cc0105350 2024-09-13T23:07:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.311+0000 7f9cb2ffd700 1 --2- 172.21.15.2:0/394807240 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f9cac06e680 0x7f9cac070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.311+0000 7f9cb2ffd700 1 -- 172.21.15.2:0/394807240 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f9cbc08e5c0 con 0x7f9cc0105350 2024-09-13T23:07:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.311+0000 7f9cc5dac700 1 --2- 172.21.15.2:0/394807240 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f9cac06e680 0x7f9cac070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.311+0000 7f9cc5dac700 1 --2- 172.21.15.2:0/394807240 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f9cac06e680 0x7f9cac070b40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4006010 tx=0x7f9cb401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:46.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.315+0000 7f9cb2ffd700 1 -- 172.21.15.2:0/394807240 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9cbc057810 con 0x7f9cc0105350 2024-09-13T23:07:46.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.537+0000 7f9cc8010700 1 -- 172.21.15.2:0/394807240 --> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cc00611d0 con 0x7f9cac06e680 2024-09-13T23:07:46.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.547+0000 7f9cb2ffd700 1 -- 172.21.15.2:0/394807240 <== mgr.34104 v2:172.21.15.2:6800/1532736539 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f9cc00611d0 con 0x7f9cac06e680 2024-09-13T23:07:46.548 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T23:07:46.548 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (9m) 103s ago 20m 26.0M - 0.25.0 c8568f914cd2 f570a73274bc 2024-09-13T23:07:46.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi002 smithi002 running (117s) 103s ago 20m 8150k - 19.1.1-324-gecab7be5 0652ff2b5d78 7e223c4231dc 2024-09-13T23:07:46.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-exporter.smithi047 smithi047 running (112s) 109s ago 19m 7314k - 19.1.1-324-gecab7be5 0652ff2b5d78 7457c53e2c65 2024-09-13T23:07:46.548 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (6m) 103s ago 20m 6899k - 19.1.1-324-gecab7be5 0652ff2b5d78 427cd38a7d88 2024-09-13T23:07:46.548 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi047 smithi047 running (6m) 109s ago 19m 6895k - 19.1.1-324-gecab7be5 0652ff2b5d78 ce5a1df96005 2024-09-13T23:07:46.548 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (8m) 103s ago 19m 80.1M - 9.4.12 2bacad6d85d8 650673516b69 2024-09-13T23:07:46.549 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.auedll smithi002 running (3m) 103s ago 14m 85.4M - 19.1.1-324-gecab7be5 0652ff2b5d78 6c66160ad777 2024-09-13T23:07:46.549 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.gglyyr smithi002 running (2m) 103s ago 14m 86.7M - 19.1.1-324-gecab7be5 0652ff2b5d78 f3dd67424bdb 2024-09-13T23:07:46.549 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.gxzkha smithi047 running (2m) 109s ago 14m 13.1M - 19.1.1-324-gecab7be5 0652ff2b5d78 9e8e78202975 2024-09-13T23:07:46.549 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi047.nqvveh smithi047 running (2m) 109s ago 14m 14.1M - 19.1.1-324-gecab7be5 0652ff2b5d78 705dc8749820 2024-09-13T23:07:46.549 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.yumtzz smithi002 *:8443,9283,8765 running (11m) 103s ago 21m 505M - 19.1.1-324-gecab7be5 0652ff2b5d78 7a8aa9de37e4 2024-09-13T23:07:46.549 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi047.gcymvd smithi047 *:8443,9283,8765 running (10m) 109s ago 19m 442M - 19.1.1-324-gecab7be5 0652ff2b5d78 13fa6f3b5a8a 2024-09-13T23:07:46.549 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (7m) 103s ago 21m 58.5M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 db0ef6c509cf 2024-09-13T23:07:46.549 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi047 smithi047 running (7m) 109s ago 19m 46.1M 2048M 19.1.1-324-gecab7be5 0652ff2b5d78 ea0c2a2e0e1a 2024-09-13T23:07:46.549 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (10m) 103s ago 20m 14.7M - 1.5.0 0da6a335fe13 f3eae5f90ab8 2024-09-13T23:07:46.549 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi047 smithi047 *:9100 running (9m) 109s ago 19m 15.8M - 1.5.0 0da6a335fe13 a5c7d7f1eaa5 2024-09-13T23:07:46.549 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (6m) 103s ago 18m 96.0M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 0ca6dd66fa68 2024-09-13T23:07:46.549 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (5m) 103s ago 17m 102M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 6f5ae2cfa818 2024-09-13T23:07:46.549 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (5m) 103s ago 17m 89.8M 1217M 19.1.1-324-gecab7be5 0652ff2b5d78 15b9e8db7556 2024-09-13T23:07:46.549 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi047 running (4m) 109s ago 16m 117M 2241M 19.1.1-324-gecab7be5 0652ff2b5d78 de54fd3fea34 2024-09-13T23:07:46.550 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi047 running (4m) 109s ago 16m 92.7M 2241M 19.1.1-324-gecab7be5 0652ff2b5d78 185d7ae7181b 2024-09-13T23:07:46.550 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi047 running (3m) 109s ago 16m 92.6M 2241M 19.1.1-324-gecab7be5 0652ff2b5d78 aeb44a823828 2024-09-13T23:07:46.550 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (9m) 103s ago 19m 81.1M - 2.43.0 a07b618ecd1d aa241d1048de 2024-09-13T23:07:46.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.549+0000 7f9cc8010700 1 -- 172.21.15.2:0/394807240 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f9cac06e680 msgr2=0x7f9cac070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:46.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.549+0000 7f9cc8010700 1 --2- 172.21.15.2:0/394807240 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f9cac06e680 0x7f9cac070b40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4006010 tx=0x7f9cb401a040 comp rx=0 tx=0).stop 2024-09-13T23:07:46.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.549+0000 7f9cc8010700 1 -- 172.21.15.2:0/394807240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cc0105350 msgr2=0x7f9cc01949d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:46.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.549+0000 7f9cc8010700 1 --2- 172.21.15.2:0/394807240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cc0105350 0x7f9cc01949d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00dd40 tx=0x7f9cbc00a530 comp rx=0 tx=0).stop 2024-09-13T23:07:46.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.549+0000 7f9cc8010700 1 -- 172.21.15.2:0/394807240 shutdown_connections 2024-09-13T23:07:46.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.549+0000 7f9cc8010700 1 --2- 172.21.15.2:0/394807240 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f9cac06e680 0x7f9cac070b40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:46.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.549+0000 7f9cc8010700 1 --2- 172.21.15.2:0/394807240 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc00ff340 0x7f9cc0194490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:46.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.549+0000 7f9cc8010700 1 --2- 172.21.15.2:0/394807240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cc0105350 0x7f9cc01949d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:46.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.549+0000 7f9cc8010700 1 -- 172.21.15.2:0/394807240 >> 172.21.15.2:0/394807240 conn(0x7f9cc0074e30 msgr2=0x7f9cc00fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:46.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.550+0000 7f9cc8010700 1 -- 172.21.15.2:0/394807240 shutdown_connections 2024-09-13T23:07:46.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:46.550+0000 7f9cc8010700 1 -- 172.21.15.2:0/394807240 wait complete. 2024-09-13T23:07:47.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:47 smithi002 ceph-mon[111294]: pgmap v267: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:07:47.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:47 smithi002 ceph-mon[111294]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:47.252 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions' 2024-09-13T23:07:47.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:47 smithi047 ceph-mon[81243]: pgmap v267: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:07:47.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:47 smithi047 ceph-mon[81243]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T23:07:47.461 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:07:49.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.097+0000 7f388d75d700 1 -- 172.21.15.2:0/4267534769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3888100ea0 msgr2=0x7f3888101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:49.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.097+0000 7f388d75d700 1 --2- 172.21.15.2:0/4267534769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3888100ea0 0x7f3888101280 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f387800b0a0 tx=0x7f387800b3b0 comp rx=0 tx=0).stop 2024-09-13T23:07:49.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.097+0000 7f388d75d700 1 -- 172.21.15.2:0/4267534769 shutdown_connections 2024-09-13T23:07:49.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.097+0000 7f388d75d700 1 --2- 172.21.15.2:0/4267534769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3888101850 0x7f38881058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:49.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.097+0000 7f388d75d700 1 --2- 172.21.15.2:0/4267534769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3888100ea0 0x7f3888101280 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:49.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.097+0000 7f388d75d700 1 -- 172.21.15.2:0/4267534769 >> 172.21.15.2:0/4267534769 conn(0x7f38880fc750 msgr2=0x7f38880feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:49.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.097+0000 7f388d75d700 1 -- 172.21.15.2:0/4267534769 shutdown_connections 2024-09-13T23:07:49.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.097+0000 7f388d75d700 1 -- 172.21.15.2:0/4267534769 wait complete. 2024-09-13T23:07:49.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.098+0000 7f388d75d700 1 Processor -- start 2024-09-13T23:07:49.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.098+0000 7f388d75d700 1 -- start start 2024-09-13T23:07:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.098+0000 7f388d75d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3888100ea0 0x7f388819c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:49.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.098+0000 7f388d75d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3888101850 0x7f388819cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:49.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.098+0000 7f388d75d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388819d250 con 0x7f3888100ea0 2024-09-13T23:07:49.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.098+0000 7f388d75d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3888196770 con 0x7f3888101850 2024-09-13T23:07:49.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.098+0000 7f3886ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3888100ea0 0x7f388819c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:49.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.098+0000 7f3886ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3888100ea0 0x7f388819c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50226/0 (socket says 172.21.15.2:50226) 2024-09-13T23:07:49.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.098+0000 7f3886ffd700 1 -- 172.21.15.2:0/1808627954 learned_addr learned my addr 172.21.15.2:0/1808627954 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:07:49.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.098+0000 7f38867fc700 1 --2- 172.21.15.2:0/1808627954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3888101850 0x7f388819cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.098+0000 7f3886ffd700 1 -- 172.21.15.2:0/1808627954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3888101850 msgr2=0x7f388819cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.098+0000 7f3886ffd700 1 --2- 172.21.15.2:0/1808627954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3888101850 0x7f388819cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.098+0000 7f3886ffd700 1 -- 172.21.15.2:0/1808627954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3878009d00 con 0x7f3888100ea0 2024-09-13T23:07:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.098+0000 7f38867fc700 1 --2- 172.21.15.2:0/1808627954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3888101850 0x7f388819cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:07:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.099+0000 7f3886ffd700 1 --2- 172.21.15.2:0/1808627954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3888100ea0 0x7f388819c680 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3878000f80 tx=0x7f387800cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.099+0000 7f387ffff700 1 -- 172.21.15.2:0/1808627954 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f387800e040 con 0x7f3888100ea0 2024-09-13T23:07:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.099+0000 7f387ffff700 1 -- 172.21.15.2:0/1808627954 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3878003de0 con 0x7f3888100ea0 2024-09-13T23:07:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.099+0000 7f388d75d700 1 -- 172.21.15.2:0/1808627954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38881969f0 con 0x7f3888100ea0 2024-09-13T23:07:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.099+0000 7f387ffff700 1 -- 172.21.15.2:0/1808627954 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f387801d790 con 0x7f3888100ea0 2024-09-13T23:07:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.099+0000 7f388d75d700 1 -- 172.21.15.2:0/1808627954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3888196ee0 con 0x7f3888100ea0 2024-09-13T23:07:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.100+0000 7f388d75d700 1 -- 172.21.15.2:0/1808627954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3888109240 con 0x7f3888100ea0 2024-09-13T23:07:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.100+0000 7f387ffff700 1 -- 172.21.15.2:0/1808627954 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f3878004040 con 0x7f3888100ea0 2024-09-13T23:07:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.101+0000 7f387ffff700 1 --2- 172.21.15.2:0/1808627954 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f387406e680 0x7f3874070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.101+0000 7f387ffff700 1 -- 172.21.15.2:0/1808627954 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f387808fe40 con 0x7f3888100ea0 2024-09-13T23:07:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.101+0000 7f38867fc700 1 --2- 172.21.15.2:0/1808627954 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f387406e680 0x7f3874070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.101+0000 7f38867fc700 1 --2- 172.21.15.2:0/1808627954 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f387406e680 0x7f3874070b40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3870005950 tx=0x7f38700058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:49.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.105+0000 7f387ffff700 1 -- 172.21.15.2:0/1808627954 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f387805caf0 con 0x7f3888100ea0 2024-09-13T23:07:49.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:49 smithi002 ceph-mon[111294]: pgmap v268: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:49.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.403+0000 7f388d75d700 1 -- 172.21.15.2:0/1808627954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f388804f2e0 con 0x7f3888100ea0 2024-09-13T23:07:49.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.404+0000 7f387ffff700 1 -- 172.21.15.2:0/1808627954 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f387805c680 con 0x7f3888100ea0 2024-09-13T23:07:49.405 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-13T23:07:49.405 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-13T23:07:49.405 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:07:49.405 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:07:49.405 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-13T23:07:49.405 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 2 2024-09-13T23:07:49.405 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:07:49.405 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-13T23:07:49.405 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 6 2024-09-13T23:07:49.405 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:07:49.405 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-13T23:07:49.406 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 4 2024-09-13T23:07:49.406 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-13T23:07:49.406 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-13T23:07:49.406 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)": 14 2024-09-13T23:07:49.406 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-13T23:07:49.406 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-13T23:07:49.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.406+0000 7f388d75d700 1 -- 172.21.15.2:0/1808627954 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f387406e680 msgr2=0x7f3874070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:49.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.406+0000 7f388d75d700 1 --2- 172.21.15.2:0/1808627954 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f387406e680 0x7f3874070b40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3870005950 tx=0x7f38700058e0 comp rx=0 tx=0).stop 2024-09-13T23:07:49.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.406+0000 7f388d75d700 1 -- 172.21.15.2:0/1808627954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3888100ea0 msgr2=0x7f388819c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:49.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.406+0000 7f388d75d700 1 --2- 172.21.15.2:0/1808627954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3888100ea0 0x7f388819c680 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3878000f80 tx=0x7f387800cdd0 comp rx=0 tx=0).stop 2024-09-13T23:07:49.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.406+0000 7f388d75d700 1 -- 172.21.15.2:0/1808627954 shutdown_connections 2024-09-13T23:07:49.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.406+0000 7f388d75d700 1 --2- 172.21.15.2:0/1808627954 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f387406e680 0x7f3874070b40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:49.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.406+0000 7f388d75d700 1 --2- 172.21.15.2:0/1808627954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3888100ea0 0x7f388819c680 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:49.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.406+0000 7f388d75d700 1 --2- 172.21.15.2:0/1808627954 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3888101850 0x7f388819cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:49.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.406+0000 7f388d75d700 1 -- 172.21.15.2:0/1808627954 >> 172.21.15.2:0/1808627954 conn(0x7f38880fc750 msgr2=0x7f38880fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:49.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.406+0000 7f388d75d700 1 -- 172.21.15.2:0/1808627954 shutdown_connections 2024-09-13T23:07:49.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:49.406+0000 7f388d75d700 1 -- 172.21.15.2:0/1808627954 wait complete. 2024-09-13T23:07:49.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:49 smithi047 ceph-mon[81243]: pgmap v268: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:50.095 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:50 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/1808627954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:07:50.123 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-13T23:07:50.340 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:07:50.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:50 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/1808627954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:07:51.129 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:51 smithi002 ceph-mon[111294]: pgmap v269: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:51.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:51 smithi047 ceph-mon[81243]: pgmap v269: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:51.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.890+0000 7f68fa27d700 1 -- 172.21.15.2:0/2823009699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f4100750 msgr2=0x7f68f41047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:51.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.890+0000 7f68fa27d700 1 --2- 172.21.15.2:0/2823009699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f4100750 0x7f68f41047a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009910 tx=0x7f68e8009c20 comp rx=0 tx=0).stop 2024-09-13T23:07:51.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.890+0000 7f68fa27d700 1 -- 172.21.15.2:0/2823009699 shutdown_connections 2024-09-13T23:07:51.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.890+0000 7f68fa27d700 1 --2- 172.21.15.2:0/2823009699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f4100750 0x7f68f41047a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:51.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.890+0000 7f68fa27d700 1 --2- 172.21.15.2:0/2823009699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68f40ffda0 0x7f68f4100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:51.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.890+0000 7f68fa27d700 1 -- 172.21.15.2:0/2823009699 >> 172.21.15.2:0/2823009699 conn(0x7f68f40fb650 msgr2=0x7f68f40fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:51.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.890+0000 7f68fa27d700 1 -- 172.21.15.2:0/2823009699 shutdown_connections 2024-09-13T23:07:51.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.890+0000 7f68fa27d700 1 -- 172.21.15.2:0/2823009699 wait complete. 2024-09-13T23:07:51.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.890+0000 7f68fa27d700 1 Processor -- start 2024-09-13T23:07:51.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.891+0000 7f68fa27d700 1 -- start start 2024-09-13T23:07:51.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.891+0000 7f68fa27d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f40ffda0 0x7f68f41977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:51.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.891+0000 7f68fa27d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68f4100750 0x7f68f4197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:51.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.891+0000 7f68fa27d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f4198300 con 0x7f68f40ffda0 2024-09-13T23:07:51.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.891+0000 7f68fa27d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f4198470 con 0x7f68f4100750 2024-09-13T23:07:51.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.891+0000 7f68f3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f40ffda0 0x7f68f41977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:51.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.891+0000 7f68f3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f40ffda0 0x7f68f41977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39686/0 (socket says 172.21.15.2:39686) 2024-09-13T23:07:51.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.891+0000 7f68f3fff700 1 -- 172.21.15.2:0/2850539627 learned_addr learned my addr 172.21.15.2:0/2850539627 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:07:51.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.891+0000 7f68f37fe700 1 --2- 172.21.15.2:0/2850539627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68f4100750 0x7f68f4197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:51.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.891+0000 7f68f3fff700 1 -- 172.21.15.2:0/2850539627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68f4100750 msgr2=0x7f68f4197ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:51.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.891+0000 7f68f3fff700 1 --2- 172.21.15.2:0/2850539627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68f4100750 0x7f68f4197ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:51.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.891+0000 7f68f3fff700 1 -- 172.21.15.2:0/2850539627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e80095f0 con 0x7f68f40ffda0 2024-09-13T23:07:51.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.892+0000 7f68f3fff700 1 --2- 172.21.15.2:0/2850539627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f40ffda0 0x7f68f41977a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f68e400d900 tx=0x7f68e400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:51.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.892+0000 7f68f17fa700 1 -- 172.21.15.2:0/2850539627 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68e40041f0 con 0x7f68f40ffda0 2024-09-13T23:07:51.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.892+0000 7f68f17fa700 1 -- 172.21.15.2:0/2850539627 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f68e4004cf0 con 0x7f68f40ffda0 2024-09-13T23:07:51.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.892+0000 7f68fa27d700 1 -- 172.21.15.2:0/2850539627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f41a0810 con 0x7f68f40ffda0 2024-09-13T23:07:51.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.892+0000 7f68f17fa700 1 -- 172.21.15.2:0/2850539627 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68e400b750 con 0x7f68f40ffda0 2024-09-13T23:07:51.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.892+0000 7f68fa27d700 1 -- 172.21.15.2:0/2850539627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f41a0cd0 con 0x7f68f40ffda0 2024-09-13T23:07:51.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.893+0000 7f68fa27d700 1 -- 172.21.15.2:0/2850539627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f41081a0 con 0x7f68f40ffda0 2024-09-13T23:07:51.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.894+0000 7f68f17fa700 1 -- 172.21.15.2:0/2850539627 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f68e4004750 con 0x7f68f40ffda0 2024-09-13T23:07:51.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.894+0000 7f68f17fa700 1 --2- 172.21.15.2:0/2850539627 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f68dc06e680 0x7f68dc070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:51.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.894+0000 7f68f17fa700 1 -- 172.21.15.2:0/2850539627 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f68e408e460 con 0x7f68f40ffda0 2024-09-13T23:07:51.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.894+0000 7f68f37fe700 1 --2- 172.21.15.2:0/2850539627 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f68dc06e680 0x7f68dc070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:51.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.895+0000 7f68f37fe700 1 --2- 172.21.15.2:0/2850539627 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f68dc06e680 0x7f68dc070b40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009fd0 tx=0x7f68e801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:51.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:51.899+0000 7f68f17fa700 1 -- 172.21.15.2:0/2850539627 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f68e4057680 con 0x7f68f40ffda0 2024-09-13T23:07:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:52.193+0000 7f68fa27d700 1 -- 172.21.15.2:0/2850539627 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f68f404f2e0 con 0x7f68f40ffda0 2024-09-13T23:07:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:52.194+0000 7f68f17fa700 1 -- 172.21.15.2:0/2850539627 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f68e405ad40 con 0x7f68f40ffda0 2024-09-13T23:07:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:52.196+0000 7f68fa27d700 1 -- 172.21.15.2:0/2850539627 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f68dc06e680 msgr2=0x7f68dc070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:52.196+0000 7f68fa27d700 1 --2- 172.21.15.2:0/2850539627 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f68dc06e680 0x7f68dc070b40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009fd0 tx=0x7f68e801a040 comp rx=0 tx=0).stop 2024-09-13T23:07:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:52.196+0000 7f68fa27d700 1 -- 172.21.15.2:0/2850539627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f40ffda0 msgr2=0x7f68f41977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:52.196+0000 7f68fa27d700 1 --2- 172.21.15.2:0/2850539627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f40ffda0 0x7f68f41977a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f68e400d900 tx=0x7f68e400dc10 comp rx=0 tx=0).stop 2024-09-13T23:07:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:52.196+0000 7f68fa27d700 1 -- 172.21.15.2:0/2850539627 shutdown_connections 2024-09-13T23:07:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:52.196+0000 7f68fa27d700 1 --2- 172.21.15.2:0/2850539627 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f68dc06e680 0x7f68dc070b40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:52.196+0000 7f68fa27d700 1 --2- 172.21.15.2:0/2850539627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f40ffda0 0x7f68f41977a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:52.196+0000 7f68fa27d700 1 --2- 172.21.15.2:0/2850539627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68f4100750 0x7f68f4197ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:52.196+0000 7f68fa27d700 1 -- 172.21.15.2:0/2850539627 >> 172.21.15.2:0/2850539627 conn(0x7f68f40fb650 msgr2=0x7f68f40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:52.196+0000 7f68fa27d700 1 -- 172.21.15.2:0/2850539627 shutdown_connections 2024-09-13T23:07:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:52.196+0000 7f68fa27d700 1 -- 172.21.15.2:0/2850539627 wait complete. 2024-09-13T23:07:52.207 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-13T23:07:52.845 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -e sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-13T23:07:53.058 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:07:53.180 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:53 smithi002 ceph-mon[111294]: pgmap v270: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:53.180 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:53 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/2850539627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:07:53.180 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:07:53.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:53 smithi047 ceph-mon[81243]: pgmap v270: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:53.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:53 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/2850539627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:07:53.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:07:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.676+0000 7f020873c700 1 -- 172.21.15.2:0/2893802474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0200100ea0 msgr2=0x7f0200101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.676+0000 7f020873c700 1 --2- 172.21.15.2:0/2893802474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0200100ea0 0x7f0200101280 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00b0a0 tx=0x7f01fc00b3b0 comp rx=0 tx=0).stop 2024-09-13T23:07:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.676+0000 7f020873c700 1 -- 172.21.15.2:0/2893802474 shutdown_connections 2024-09-13T23:07:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.676+0000 7f020873c700 1 --2- 172.21.15.2:0/2893802474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0200101850 0x7f02001058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.676+0000 7f020873c700 1 --2- 172.21.15.2:0/2893802474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0200100ea0 0x7f0200101280 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.676+0000 7f020873c700 1 -- 172.21.15.2:0/2893802474 >> 172.21.15.2:0/2893802474 conn(0x7f02000fc750 msgr2=0x7f02000feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.676+0000 7f020873c700 1 -- 172.21.15.2:0/2893802474 shutdown_connections 2024-09-13T23:07:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.676+0000 7f020873c700 1 -- 172.21.15.2:0/2893802474 wait complete. 2024-09-13T23:07:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.676+0000 7f020873c700 1 Processor -- start 2024-09-13T23:07:54.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.677+0000 7f020873c700 1 -- start start 2024-09-13T23:07:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.677+0000 7f020873c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0200100ea0 0x7f020019e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.677+0000 7f020873c700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0200101850 0x7f020019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.677+0000 7f020873c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020019f4f0 con 0x7f0200100ea0 2024-09-13T23:07:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.677+0000 7f020873c700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02001989a0 con 0x7f0200101850 2024-09-13T23:07:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.677+0000 7f02064d8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0200100ea0 0x7f020019e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.677+0000 7f02064d8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0200100ea0 0x7f020019e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39706/0 (socket says 172.21.15.2:39706) 2024-09-13T23:07:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.677+0000 7f02064d8700 1 -- 172.21.15.2:0/3057792780 learned_addr learned my addr 172.21.15.2:0/3057792780 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:07:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.677+0000 7f02064d8700 1 -- 172.21.15.2:0/3057792780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0200101850 msgr2=0x7f020019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.677+0000 7f0205cd7700 1 --2- 172.21.15.2:0/3057792780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0200101850 0x7f020019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.677+0000 7f02064d8700 1 --2- 172.21.15.2:0/3057792780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0200101850 0x7f020019ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.677+0000 7f02064d8700 1 -- 172.21.15.2:0/3057792780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc009d00 con 0x7f0200100ea0 2024-09-13T23:07:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.677+0000 7f02064d8700 1 --2- 172.21.15.2:0/3057792780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0200100ea0 0x7f020019e920 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00b070 tx=0x7f01fc00cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:54.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.678+0000 7f01f77fe700 1 -- 172.21.15.2:0/3057792780 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01fc00e040 con 0x7f0200100ea0 2024-09-13T23:07:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.678+0000 7f020873c700 1 -- 172.21.15.2:0/3057792780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0200198c20 con 0x7f0200100ea0 2024-09-13T23:07:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.678+0000 7f01f77fe700 1 -- 172.21.15.2:0/3057792780 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f01fc003de0 con 0x7f0200100ea0 2024-09-13T23:07:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.678+0000 7f01f77fe700 1 -- 172.21.15.2:0/3057792780 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01fc01d8e0 con 0x7f0200100ea0 2024-09-13T23:07:54.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.678+0000 7f020873c700 1 -- 172.21.15.2:0/3057792780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0200199110 con 0x7f0200100ea0 2024-09-13T23:07:54.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.679+0000 7f020873c700 1 -- 172.21.15.2:0/3057792780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0200105020 con 0x7f0200100ea0 2024-09-13T23:07:54.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.679+0000 7f01f77fe700 1 -- 172.21.15.2:0/3057792780 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f01fc004040 con 0x7f0200100ea0 2024-09-13T23:07:54.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.680+0000 7f01f77fe700 1 --2- 172.21.15.2:0/3057792780 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f01ec06e680 0x7f01ec070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:54.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.680+0000 7f01f77fe700 1 -- 172.21.15.2:0/3057792780 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f01fc08fa30 con 0x7f0200100ea0 2024-09-13T23:07:54.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.680+0000 7f0205cd7700 1 --2- 172.21.15.2:0/3057792780 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f01ec06e680 0x7f01ec070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:54.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.680+0000 7f0205cd7700 1 --2- 172.21.15.2:0/3057792780 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f01ec06e680 0x7f01ec070b40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f01f0005950 tx=0x7f01f00058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:54.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.684+0000 7f01f77fe700 1 -- 172.21.15.2:0/3057792780 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f01fc05c700 con 0x7f0200100ea0 2024-09-13T23:07:54.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.980+0000 7f020873c700 1 -- 172.21.15.2:0/3057792780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0200199f00 con 0x7f0200100ea0 2024-09-13T23:07:54.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.981+0000 7f01f77fe700 1 -- 172.21.15.2:0/3057792780 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f01fc05c290 con 0x7f0200100ea0 2024-09-13T23:07:54.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.983+0000 7f020873c700 1 -- 172.21.15.2:0/3057792780 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f01ec06e680 msgr2=0x7f01ec070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:54.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.983+0000 7f020873c700 1 --2- 172.21.15.2:0/3057792780 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f01ec06e680 0x7f01ec070b40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f01f0005950 tx=0x7f01f00058e0 comp rx=0 tx=0).stop 2024-09-13T23:07:54.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.983+0000 7f020873c700 1 -- 172.21.15.2:0/3057792780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0200100ea0 msgr2=0x7f020019e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:54.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.983+0000 7f020873c700 1 --2- 172.21.15.2:0/3057792780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0200100ea0 0x7f020019e920 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00b070 tx=0x7f01fc00cdd0 comp rx=0 tx=0).stop 2024-09-13T23:07:54.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.983+0000 7f020873c700 1 -- 172.21.15.2:0/3057792780 shutdown_connections 2024-09-13T23:07:54.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.983+0000 7f020873c700 1 --2- 172.21.15.2:0/3057792780 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f01ec06e680 0x7f01ec070b40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:54.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.983+0000 7f020873c700 1 --2- 172.21.15.2:0/3057792780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0200100ea0 0x7f020019e920 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:54.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.983+0000 7f020873c700 1 --2- 172.21.15.2:0/3057792780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0200101850 0x7f020019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:54.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.983+0000 7f020873c700 1 -- 172.21.15.2:0/3057792780 >> 172.21.15.2:0/3057792780 conn(0x7f02000fc750 msgr2=0x7f02000fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:54.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.983+0000 7f020873c700 1 -- 172.21.15.2:0/3057792780 shutdown_connections 2024-09-13T23:07:54.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:54.983+0000 7f020873c700 1 -- 172.21.15.2:0/3057792780 wait complete. 2024-09-13T23:07:54.994 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-324-gecab7be5 (ecab7be58963a5bd03910cd73eef66405d7fdd50) squid (stable)" 2024-09-13T23:07:55.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:55 smithi002 ceph-mon[111294]: pgmap v271: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:55.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:55 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/3057792780' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:07:55.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:55 smithi047 ceph-mon[81243]: pgmap v271: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:07:55.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:55 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/3057792780' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T23:07:55.608 DEBUG:teuthology.parallel:result is None 2024-09-13T23:07:55.608 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T23:07:55.619 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-13T23:07:55.620 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T23:07:55.833 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:07:57.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:57 smithi002 ceph-mon[111294]: pgmap v272: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:07:57.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:57 smithi047 ceph-mon[81243]: pgmap v272: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:07:57.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.489+0000 7f4b9888e700 1 -- 172.21.15.2:0/3141806536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b940ffc20 msgr2=0x7f4b94100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.489+0000 7f4b9888e700 1 --2- 172.21.15.2:0/3141806536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b940ffc20 0x7f4b94100080 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009910 tx=0x7f4b88009c20 comp rx=0 tx=0).stop 2024-09-13T23:07:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.489+0000 7f4b9888e700 1 -- 172.21.15.2:0/3141806536 shutdown_connections 2024-09-13T23:07:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.489+0000 7f4b9888e700 1 --2- 172.21.15.2:0/3141806536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b940ffc20 0x7f4b94100080 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.489+0000 7f4b9888e700 1 --2- 172.21.15.2:0/3141806536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b94105bd0 0x7f4b94105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.489+0000 7f4b9888e700 1 -- 172.21.15.2:0/3141806536 >> 172.21.15.2:0/3141806536 conn(0x7f4b94075670 msgr2=0x7f4b94075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.489+0000 7f4b9888e700 1 -- 172.21.15.2:0/3141806536 shutdown_connections 2024-09-13T23:07:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.489+0000 7f4b9888e700 1 -- 172.21.15.2:0/3141806536 wait complete. 2024-09-13T23:07:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.490+0000 7f4b9888e700 1 Processor -- start 2024-09-13T23:07:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.490+0000 7f4b9888e700 1 -- start start 2024-09-13T23:07:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.490+0000 7f4b9888e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b940ffc20 0x7f4b9419e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.490+0000 7f4b9888e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b94105bd0 0x7f4b9419edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.490+0000 7f4b9888e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9419f440 con 0x7f4b94105bd0 2024-09-13T23:07:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.490+0000 7f4b9888e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b941988f0 con 0x7f4b940ffc20 2024-09-13T23:07:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.490+0000 7f4b91d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b94105bd0 0x7f4b9419edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.490+0000 7f4b91d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b94105bd0 0x7f4b9419edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39720/0 (socket says 172.21.15.2:39720) 2024-09-13T23:07:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.490+0000 7f4b91d9b700 1 -- 172.21.15.2:0/1758909606 learned_addr learned my addr 172.21.15.2:0/1758909606 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:07:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.491+0000 7f4b9259c700 1 --2- 172.21.15.2:0/1758909606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b940ffc20 0x7f4b9419e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.491+0000 7f4b91d9b700 1 -- 172.21.15.2:0/1758909606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b940ffc20 msgr2=0x7f4b9419e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.491+0000 7f4b91d9b700 1 --2- 172.21.15.2:0/1758909606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b940ffc20 0x7f4b9419e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.491+0000 7f4b91d9b700 1 -- 172.21.15.2:0/1758909606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b880095f0 con 0x7f4b94105bd0 2024-09-13T23:07:57.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.491+0000 7f4b91d9b700 1 --2- 172.21.15.2:0/1758909606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b94105bd0 0x7f4b9419edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4b88006010 tx=0x7f4b8800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.491+0000 7f4b837fe700 1 -- 172.21.15.2:0/1758909606 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b8801d070 con 0x7f4b94105bd0 2024-09-13T23:07:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.491+0000 7f4b837fe700 1 -- 172.21.15.2:0/1758909606 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4b88005dc0 con 0x7f4b94105bd0 2024-09-13T23:07:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.491+0000 7f4b9888e700 1 -- 172.21.15.2:0/1758909606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b94198b70 con 0x7f4b94105bd0 2024-09-13T23:07:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.491+0000 7f4b837fe700 1 -- 172.21.15.2:0/1758909606 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b88017400 con 0x7f4b94105bd0 2024-09-13T23:07:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.491+0000 7f4b9888e700 1 -- 172.21.15.2:0/1758909606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b94199060 con 0x7f4b94105bd0 2024-09-13T23:07:57.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.492+0000 7f4b9888e700 1 -- 172.21.15.2:0/1758909606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9404f2e0 con 0x7f4b94105bd0 2024-09-13T23:07:57.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.493+0000 7f4b837fe700 1 -- 172.21.15.2:0/1758909606 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f4b88003a60 con 0x7f4b94105bd0 2024-09-13T23:07:57.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.493+0000 7f4b837fe700 1 --2- 172.21.15.2:0/1758909606 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4b7c06e680 0x7f4b7c070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:07:57.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.493+0000 7f4b837fe700 1 -- 172.21.15.2:0/1758909606 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f4b8808fb80 con 0x7f4b94105bd0 2024-09-13T23:07:57.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.493+0000 7f4b9259c700 1 --2- 172.21.15.2:0/1758909606 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4b7c06e680 0x7f4b7c070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:07:57.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.494+0000 7f4b9259c700 1 --2- 172.21.15.2:0/1758909606 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4b7c06e680 0x7f4b7c070b40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4b84005950 tx=0x7f4b8400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:07:57.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.498+0000 7f4b837fe700 1 -- 172.21.15.2:0/1758909606 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4b8805c7b0 con 0x7f4b94105bd0 2024-09-13T23:07:57.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.757+0000 7f4b9888e700 1 -- 172.21.15.2:0/1758909606 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4b94199e00 con 0x7f4b94105bd0 2024-09-13T23:07:57.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.758+0000 7f4b837fe700 1 -- 172.21.15.2:0/1758909606 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1996 (secure 0 0 0) 0x7f4b8805c340 con 0x7f4b94105bd0 2024-09-13T23:07:57.759 INFO:teuthology.orchestra.run.smithi002.stdout:e37 2024-09-13T23:07:57.759 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-13T23:06:07:742454+0000 2024-09-13T23:07:57.759 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T23:07:57.759 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T23:07:57.759 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-13T23:07:57.759 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:07:57.759 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-13T23:07:57.760 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-13T23:07:57.760 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 37 2024-09-13T23:07:57.760 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T23:07:57.760 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-13T22:53:05.963265+0000 2024-09-13T23:07:57.760 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-13T23:06:06.787593+0000 2024-09-13T23:07:57.760 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-13T23:07:57.760 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-13T23:07:57.760 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-13T23:07:57.760 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-13T23:07:57.760 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-13T23:07:57.760 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-13T23:07:57.761 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-13T23:07:57.761 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-13T23:07:57.761 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 85 2024-09-13T23:07:57.761 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T23:07:57.761 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 1 2024-09-13T23:07:57.761 INFO:teuthology.orchestra.run.smithi002.stdout:in 0 2024-09-13T23:07:57.761 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=34384} 2024-09-13T23:07:57.761 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-13T23:07:57.761 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-13T23:07:57.761 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-13T23:07:57.761 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-13T23:07:57.762 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-13T23:07:57.762 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-13T23:07:57.762 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-13T23:07:57.762 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-13T23:07:57.762 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-13T23:07:57.762 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 34384 members: 34384 2024-09-13T23:07:57.762 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.auedll{0:34384} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.2:6826/3279333632,v1:172.21.15.2:6827/3279333632] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:07:57.762 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.gglyyr{0:34416} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.2:6828/4224459092,v1:172.21.15.2:6829/4224459092] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:07:57.762 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:07:57.762 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:07:57.762 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-13T23:07:57.762 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:07:57.763 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.gxzkha{-1:44295} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.47:6824/1060893681,v1:172.21.15.47:6825/1060893681] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:07:57.763 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi047.nqvveh{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.47:6826/2798869340,v1:172.21.15.47:6827/2798869340] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T23:07:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.760+0000 7f4b9888e700 1 -- 172.21.15.2:0/1758909606 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4b7c06e680 msgr2=0x7f4b7c070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.760+0000 7f4b9888e700 1 --2- 172.21.15.2:0/1758909606 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4b7c06e680 0x7f4b7c070b40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4b84005950 tx=0x7f4b8400b410 comp rx=0 tx=0).stop 2024-09-13T23:07:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.760+0000 7f4b9888e700 1 -- 172.21.15.2:0/1758909606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b94105bd0 msgr2=0x7f4b9419edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:07:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.760+0000 7f4b9888e700 1 --2- 172.21.15.2:0/1758909606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b94105bd0 0x7f4b9419edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4b88006010 tx=0x7f4b8800bd70 comp rx=0 tx=0).stop 2024-09-13T23:07:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.760+0000 7f4b9888e700 1 -- 172.21.15.2:0/1758909606 shutdown_connections 2024-09-13T23:07:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.760+0000 7f4b9888e700 1 --2- 172.21.15.2:0/1758909606 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4b7c06e680 0x7f4b7c070b40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.760+0000 7f4b9888e700 1 --2- 172.21.15.2:0/1758909606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b940ffc20 0x7f4b9419e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.760+0000 7f4b9888e700 1 --2- 172.21.15.2:0/1758909606 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b94105bd0 0x7f4b9419edb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:07:57.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.760+0000 7f4b9888e700 1 -- 172.21.15.2:0/1758909606 >> 172.21.15.2:0/1758909606 conn(0x7f4b94075670 msgr2=0x7f4b94068640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:07:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.760+0000 7f4b9888e700 1 -- 172.21.15.2:0/1758909606 shutdown_connections 2024-09-13T23:07:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:07:57.760+0000 7f4b9888e700 1 -- 172.21.15.2:0/1758909606 wait complete. 2024-09-13T23:07:57.765 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 37 2024-09-13T23:07:58.345 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:58 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/1758909606' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:07:58.368 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-13T23:07:58.378 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-13T23:07:58.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:58 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/1758909606' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T23:07:58.587 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:07:59.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:07:59 smithi002 ceph-mon[111294]: pgmap v273: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:07:59.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:07:59 smithi047 ceph-mon[81243]: pgmap v273: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:00.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.245+0000 7feadb172700 1 -- 172.21.15.2:0/2245454903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fead4100750 msgr2=0x7fead41047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:00.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.245+0000 7feadb172700 1 --2- 172.21.15.2:0/2245454903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fead4100750 0x7fead41047a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feac0009910 tx=0x7feac0009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:00.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.245+0000 7feadb172700 1 -- 172.21.15.2:0/2245454903 shutdown_connections 2024-09-13T23:08:00.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.245+0000 7feadb172700 1 --2- 172.21.15.2:0/2245454903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fead4100750 0x7fead41047a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.245+0000 7feadb172700 1 --2- 172.21.15.2:0/2245454903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead40ffda0 0x7fead4100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.245+0000 7feadb172700 1 -- 172.21.15.2:0/2245454903 >> 172.21.15.2:0/2245454903 conn(0x7fead40fb650 msgr2=0x7fead40fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:00.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.245+0000 7feadb172700 1 -- 172.21.15.2:0/2245454903 shutdown_connections 2024-09-13T23:08:00.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.245+0000 7feadb172700 1 -- 172.21.15.2:0/2245454903 wait complete. 2024-09-13T23:08:00.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.245+0000 7feadb172700 1 Processor -- start 2024-09-13T23:08:00.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.245+0000 7feadb172700 1 -- start start 2024-09-13T23:08:00.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.246+0000 7feadb172700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead40ffda0 0x7fead4101840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:00.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.246+0000 7feadb172700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fead4100750 0x7fead4101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.246+0000 7feadb172700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead41022c0 con 0x7fead4100750 2024-09-13T23:08:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.246+0000 7feadb172700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead4102400 con 0x7fead40ffda0 2024-09-13T23:08:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.246+0000 7fead3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fead4100750 0x7fead4101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.246+0000 7fead3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fead4100750 0x7fead4101d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52494/0 (socket says 172.21.15.2:52494) 2024-09-13T23:08:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.246+0000 7fead3fff700 1 -- 172.21.15.2:0/4175828000 learned_addr learned my addr 172.21.15.2:0/4175828000 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.246+0000 7fead8f0e700 1 --2- 172.21.15.2:0/4175828000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead40ffda0 0x7fead4101840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.246+0000 7fead3fff700 1 -- 172.21.15.2:0/4175828000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead40ffda0 msgr2=0x7fead4101840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.246+0000 7fead3fff700 1 --2- 172.21.15.2:0/4175828000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead40ffda0 0x7fead4101840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.246+0000 7fead3fff700 1 -- 172.21.15.2:0/4175828000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac00095f0 con 0x7fead4100750 2024-09-13T23:08:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.246+0000 7fead3fff700 1 --2- 172.21.15.2:0/4175828000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fead4100750 0x7fead4101d80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feac00092e0 tx=0x7feac000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.247+0000 7fead1ffb700 1 -- 172.21.15.2:0/4175828000 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac001d070 con 0x7fead4100750 2024-09-13T23:08:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.247+0000 7fead1ffb700 1 -- 172.21.15.2:0/4175828000 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feac0005dc0 con 0x7fead4100750 2024-09-13T23:08:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.247+0000 7feadb172700 1 -- 172.21.15.2:0/4175828000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead4102680 con 0x7fead4100750 2024-09-13T23:08:00.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.247+0000 7fead1ffb700 1 -- 172.21.15.2:0/4175828000 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac0017400 con 0x7fead4100750 2024-09-13T23:08:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.247+0000 7feadb172700 1 -- 172.21.15.2:0/4175828000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead41a2e50 con 0x7fead4100750 2024-09-13T23:08:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.248+0000 7feadb172700 1 -- 172.21.15.2:0/4175828000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead404f2e0 con 0x7fead4100750 2024-09-13T23:08:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.248+0000 7fead1ffb700 1 -- 172.21.15.2:0/4175828000 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7feac000f6f0 con 0x7fead4100750 2024-09-13T23:08:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.249+0000 7fead1ffb700 1 --2- 172.21.15.2:0/4175828000 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7feac406e680 0x7feac4070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.249+0000 7fead1ffb700 1 -- 172.21.15.2:0/4175828000 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7feac008fa20 con 0x7fead4100750 2024-09-13T23:08:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.249+0000 7fead8f0e700 1 --2- 172.21.15.2:0/4175828000 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7feac406e680 0x7feac4070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.249+0000 7fead8f0e700 1 --2- 172.21.15.2:0/4175828000 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7feac406e680 0x7feac4070b40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7feac8005950 tx=0x7feac800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:00.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.253+0000 7fead1ffb700 1 -- 172.21.15.2:0/4175828000 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7feac0058ba0 con 0x7fead4100750 2024-09-13T23:08:00.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.506+0000 7feadb172700 1 -- 172.21.15.2:0/4175828000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fead41a3100 con 0x7fead4100750 2024-09-13T23:08:00.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.507+0000 7fead1ffb700 1 -- 172.21.15.2:0/4175828000 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+5251 (secure 0 0 0) 0x7feac005c260 con 0x7fead4100750 2024-09-13T23:08:00.508 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:00.508 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":37,"btime":"2024-09-13T23:06:07:742454+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44295,"name":"cephfs.smithi047.gxzkha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6825/1060893681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1060893681},{"type":"v1","addr":"172.21.15.47:6825","nonce":1060893681}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44325,"name":"cephfs.smithi047.nqvveh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6827/2798869340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2798869340},{"type":"v1","addr":"172.21.15.47:6827","nonce":2798869340}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:06:06.787593+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi002.auedll","rank":0,"incarnation":30,"state":"up:active","state_seq":18,"addr":"172.21.15.2:6827/3279333632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3279333632},{"type":"v1","addr":"172.21.15.2:6827","nonce":3279333632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34416":{"gid":34416,"name":"cephfs.smithi002.gglyyr","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6829/4224459092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4224459092},{"type":"v1","addr":"172.21.15.2:6829","nonce":4224459092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34384,"qdb_cluster":[34384]},"id":1}]} 2024-09-13T23:08:00.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.509+0000 7feadb172700 1 -- 172.21.15.2:0/4175828000 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7feac406e680 msgr2=0x7feac4070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:00.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.509+0000 7feadb172700 1 --2- 172.21.15.2:0/4175828000 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7feac406e680 0x7feac4070b40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7feac8005950 tx=0x7feac800b410 comp rx=0 tx=0).stop 2024-09-13T23:08:00.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.509+0000 7feadb172700 1 -- 172.21.15.2:0/4175828000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fead4100750 msgr2=0x7fead4101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:00.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.509+0000 7feadb172700 1 --2- 172.21.15.2:0/4175828000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fead4100750 0x7fead4101d80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feac00092e0 tx=0x7feac000bd70 comp rx=0 tx=0).stop 2024-09-13T23:08:00.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.509+0000 7feadb172700 1 -- 172.21.15.2:0/4175828000 shutdown_connections 2024-09-13T23:08:00.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.509+0000 7feadb172700 1 --2- 172.21.15.2:0/4175828000 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7feac406e680 0x7feac4070b40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.509+0000 7feadb172700 1 --2- 172.21.15.2:0/4175828000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead40ffda0 0x7fead4101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.509+0000 7feadb172700 1 --2- 172.21.15.2:0/4175828000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fead4100750 0x7fead4101d80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:00.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.509+0000 7feadb172700 1 -- 172.21.15.2:0/4175828000 >> 172.21.15.2:0/4175828000 conn(0x7fead40fb650 msgr2=0x7fead4103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:00.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.509+0000 7feadb172700 1 -- 172.21.15.2:0/4175828000 shutdown_connections 2024-09-13T23:08:00.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:00.509+0000 7feadb172700 1 -- 172.21.15.2:0/4175828000 wait complete. 2024-09-13T23:08:00.511 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 37 2024-09-13T23:08:01.085 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:01 smithi002 ceph-mon[111294]: pgmap v274: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:01.085 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:01 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/4175828000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T23:08:01.110 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 1, 'flags': 50} 2024-09-13T23:08:01.111 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 17 2024-09-13T23:08:01.324 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:01.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:01 smithi047 ceph-mon[81243]: pgmap v274: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:01.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:01 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/4175828000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T23:08:03.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.000+0000 7fed4f4e1700 1 -- 172.21.15.2:0/3576139702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed48100ea0 msgr2=0x7fed48101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:03.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.000+0000 7fed4f4e1700 1 --2- 172.21.15.2:0/3576139702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed48100ea0 0x7fed48101280 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fed44009910 tx=0x7fed44009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:03.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.000+0000 7fed4f4e1700 1 -- 172.21.15.2:0/3576139702 shutdown_connections 2024-09-13T23:08:03.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.000+0000 7fed4f4e1700 1 --2- 172.21.15.2:0/3576139702 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed48101850 0x7fed481058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:03.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.000+0000 7fed4f4e1700 1 --2- 172.21.15.2:0/3576139702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed48100ea0 0x7fed48101280 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:03.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.000+0000 7fed4f4e1700 1 -- 172.21.15.2:0/3576139702 >> 172.21.15.2:0/3576139702 conn(0x7fed480fc750 msgr2=0x7fed480feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:03.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.000+0000 7fed4f4e1700 1 -- 172.21.15.2:0/3576139702 shutdown_connections 2024-09-13T23:08:03.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.000+0000 7fed4f4e1700 1 -- 172.21.15.2:0/3576139702 wait complete. 2024-09-13T23:08:03.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.001+0000 7fed4f4e1700 1 Processor -- start 2024-09-13T23:08:03.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.001+0000 7fed4f4e1700 1 -- start start 2024-09-13T23:08:03.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.001+0000 7fed4f4e1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed48100ea0 0x7fed48073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:03.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.001+0000 7fed4f4e1700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed48101850 0x7fed480735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:03.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.001+0000 7fed4f4e1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed48073b10 con 0x7fed48100ea0 2024-09-13T23:08:03.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.001+0000 7fed4f4e1700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed48073c50 con 0x7fed48101850 2024-09-13T23:08:03.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.001+0000 7fed4d27d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed48100ea0 0x7fed48073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:03.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.001+0000 7fed4d27d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed48100ea0 0x7fed48073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52514/0 (socket says 172.21.15.2:52514) 2024-09-13T23:08:03.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.001+0000 7fed4d27d700 1 -- 172.21.15.2:0/1453623630 learned_addr learned my addr 172.21.15.2:0/1453623630 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:03.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.001+0000 7fed4ca7c700 1 --2- 172.21.15.2:0/1453623630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed48101850 0x7fed480735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:03.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.001+0000 7fed4d27d700 1 -- 172.21.15.2:0/1453623630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed48101850 msgr2=0x7fed480735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:03.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.001+0000 7fed4d27d700 1 --2- 172.21.15.2:0/1453623630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed48101850 0x7fed480735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:03.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.001+0000 7fed4d27d700 1 -- 172.21.15.2:0/1453623630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed440095f0 con 0x7fed48100ea0 2024-09-13T23:08:03.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.002+0000 7fed4d27d700 1 --2- 172.21.15.2:0/1453623630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed48100ea0 0x7fed48073090 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fed44006010 tx=0x7fed4400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:03.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.002+0000 7fed3e7fc700 1 -- 172.21.15.2:0/1453623630 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed4401d070 con 0x7fed48100ea0 2024-09-13T23:08:03.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.002+0000 7fed4f4e1700 1 -- 172.21.15.2:0/1453623630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed48073ed0 con 0x7fed48100ea0 2024-09-13T23:08:03.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.002+0000 7fed3e7fc700 1 -- 172.21.15.2:0/1453623630 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed4400f460 con 0x7fed48100ea0 2024-09-13T23:08:03.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.002+0000 7fed3e7fc700 1 -- 172.21.15.2:0/1453623630 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed440175f0 con 0x7fed48100ea0 2024-09-13T23:08:03.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.002+0000 7fed4f4e1700 1 -- 172.21.15.2:0/1453623630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed481a2e90 con 0x7fed48100ea0 2024-09-13T23:08:03.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.003+0000 7fed4f4e1700 1 -- 172.21.15.2:0/1453623630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed48109240 con 0x7fed48100ea0 2024-09-13T23:08:03.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.003+0000 7fed3e7fc700 1 -- 172.21.15.2:0/1453623630 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fed4400f5d0 con 0x7fed48100ea0 2024-09-13T23:08:03.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.004+0000 7fed3e7fc700 1 --2- 172.21.15.2:0/1453623630 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fed3406e680 0x7fed34070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:03.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.004+0000 7fed3e7fc700 1 -- 172.21.15.2:0/1453623630 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fed4408fc00 con 0x7fed48100ea0 2024-09-13T23:08:03.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.004+0000 7fed4ca7c700 1 --2- 172.21.15.2:0/1453623630 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fed3406e680 0x7fed34070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:03.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.004+0000 7fed4ca7c700 1 --2- 172.21.15.2:0/1453623630 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fed3406e680 0x7fed34070b40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fed38006fd0 tx=0x7fed38008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:03.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.008+0000 7fed3e7fc700 1 -- 172.21.15.2:0/1453623630 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fed44095020 con 0x7fed48100ea0 2024-09-13T23:08:03.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.263+0000 7fed4f4e1700 1 -- 172.21.15.2:0/1453623630 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7fed4804f2e0 con 0x7fed48100ea0 2024-09-13T23:08:03.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.263+0000 7fed3e7fc700 1 -- 172.21.15.2:0/1453623630 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v37) v1 ==== 107+0+4127 (secure 0 0 0) 0x7fed44058da0 con 0x7fed48100ea0 2024-09-13T23:08:03.264 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:03.264 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"btime":"2024-09-13T23:04:27:724477+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14500,"name":"cephfs.smithi002.auedll","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/1577962179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1577962179},{"type":"v1","addr":"172.21.15.2:6827","nonce":1577962179}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24277,"name":"cephfs.smithi047.nqvveh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.47:6827/2007272492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2007272492},{"type":"v1","addr":"172.21.15.47:6827","nonce":2007272492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:04:27.724473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24267":{"gid":24267,"name":"cephfs.smithi047.gxzkha","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.47:6825/2157973647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2157973647},{"type":"v1","addr":"172.21.15.47:6825","nonce":2157973647}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24267,"qdb_cluster":[24267]},"id":1}]} 2024-09-13T23:08:03.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.265+0000 7fed4f4e1700 1 -- 172.21.15.2:0/1453623630 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fed3406e680 msgr2=0x7fed34070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:03.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.265+0000 7fed4f4e1700 1 --2- 172.21.15.2:0/1453623630 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fed3406e680 0x7fed34070b40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fed38006fd0 tx=0x7fed38008040 comp rx=0 tx=0).stop 2024-09-13T23:08:03.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.265+0000 7fed4f4e1700 1 -- 172.21.15.2:0/1453623630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed48100ea0 msgr2=0x7fed48073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:03.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.265+0000 7fed4f4e1700 1 --2- 172.21.15.2:0/1453623630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed48100ea0 0x7fed48073090 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fed44006010 tx=0x7fed4400be20 comp rx=0 tx=0).stop 2024-09-13T23:08:03.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.266+0000 7fed4f4e1700 1 -- 172.21.15.2:0/1453623630 shutdown_connections 2024-09-13T23:08:03.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.266+0000 7fed4f4e1700 1 --2- 172.21.15.2:0/1453623630 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fed3406e680 0x7fed34070b40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:03.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.266+0000 7fed4f4e1700 1 --2- 172.21.15.2:0/1453623630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed48100ea0 0x7fed48073090 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:03.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.266+0000 7fed4f4e1700 1 --2- 172.21.15.2:0/1453623630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed48101850 0x7fed480735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:03.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.266+0000 7fed4f4e1700 1 -- 172.21.15.2:0/1453623630 >> 172.21.15.2:0/1453623630 conn(0x7fed480fc750 msgr2=0x7fed480fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:03.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.266+0000 7fed4f4e1700 1 -- 172.21.15.2:0/1453623630 shutdown_connections 2024-09-13T23:08:03.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:03.266+0000 7fed4f4e1700 1 -- 172.21.15.2:0/1453623630 wait complete. 2024-09-13T23:08:03.267 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2024-09-13T23:08:03.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:03 smithi047 ceph-mon[81243]: pgmap v275: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:03.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:03 smithi002 ceph-mon[111294]: pgmap v275: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:04.061 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 17 2024-09-13T23:08:04.061 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 18 2024-09-13T23:08:04.273 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:04.395 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:04 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/1453623630' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-13T23:08:04.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:04 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/1453623630' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-13T23:08:05.331 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:05 smithi002 ceph-mon[111294]: pgmap v276: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:05.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:05 smithi047 ceph-mon[81243]: pgmap v276: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:05.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.834+0000 7fcb313b7700 1 -- 172.21.15.2:0/1140181651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb2c100750 msgr2=0x7fcb2c1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:05.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.834+0000 7fcb313b7700 1 --2- 172.21.15.2:0/1140181651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb2c100750 0x7fcb2c1047a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009910 tx=0x7fcb20009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:05.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.834+0000 7fcb313b7700 1 -- 172.21.15.2:0/1140181651 shutdown_connections 2024-09-13T23:08:05.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.834+0000 7fcb313b7700 1 --2- 172.21.15.2:0/1140181651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb2c100750 0x7fcb2c1047a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:05.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.834+0000 7fcb313b7700 1 --2- 172.21.15.2:0/1140181651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb2c0ffda0 0x7fcb2c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:05.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.834+0000 7fcb313b7700 1 -- 172.21.15.2:0/1140181651 >> 172.21.15.2:0/1140181651 conn(0x7fcb2c0fb650 msgr2=0x7fcb2c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:05.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.834+0000 7fcb313b7700 1 -- 172.21.15.2:0/1140181651 shutdown_connections 2024-09-13T23:08:05.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.834+0000 7fcb313b7700 1 -- 172.21.15.2:0/1140181651 wait complete. 2024-09-13T23:08:05.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.835+0000 7fcb313b7700 1 Processor -- start 2024-09-13T23:08:05.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.835+0000 7fcb313b7700 1 -- start start 2024-09-13T23:08:05.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.835+0000 7fcb313b7700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb2c0ffda0 0x7fcb2c19c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:05.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.835+0000 7fcb313b7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb2c100750 0x7fcb2c19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:05.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.835+0000 7fcb313b7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c19d250 con 0x7fcb2c100750 2024-09-13T23:08:05.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.835+0000 7fcb313b7700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c196700 con 0x7fcb2c0ffda0 2024-09-13T23:08:05.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.836+0000 7fcb2a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb2c100750 0x7fcb2c19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:05.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.836+0000 7fcb2a7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb2c100750 0x7fcb2c19cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52522/0 (socket says 172.21.15.2:52522) 2024-09-13T23:08:05.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.836+0000 7fcb2a7fc700 1 -- 172.21.15.2:0/2547442643 learned_addr learned my addr 172.21.15.2:0/2547442643 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:05.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.836+0000 7fcb2affd700 1 --2- 172.21.15.2:0/2547442643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb2c0ffda0 0x7fcb2c19c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:05.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.836+0000 7fcb2a7fc700 1 -- 172.21.15.2:0/2547442643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb2c0ffda0 msgr2=0x7fcb2c19c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:05.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.836+0000 7fcb2a7fc700 1 --2- 172.21.15.2:0/2547442643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb2c0ffda0 0x7fcb2c19c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:05.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.836+0000 7fcb2a7fc700 1 -- 172.21.15.2:0/2547442643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb200095f0 con 0x7fcb2c100750 2024-09-13T23:08:05.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.836+0000 7fcb2a7fc700 1 --2- 172.21.15.2:0/2547442643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb2c100750 0x7fcb2c19cbc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcb200092e0 tx=0x7fcb2000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:05.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.836+0000 7fcb13fff700 1 -- 172.21.15.2:0/2547442643 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb2001d070 con 0x7fcb2c100750 2024-09-13T23:08:05.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.836+0000 7fcb13fff700 1 -- 172.21.15.2:0/2547442643 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb20005dc0 con 0x7fcb2c100750 2024-09-13T23:08:05.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.836+0000 7fcb313b7700 1 -- 172.21.15.2:0/2547442643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2c196980 con 0x7fcb2c100750 2024-09-13T23:08:05.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.836+0000 7fcb13fff700 1 -- 172.21.15.2:0/2547442643 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb20017400 con 0x7fcb2c100750 2024-09-13T23:08:05.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.836+0000 7fcb313b7700 1 -- 172.21.15.2:0/2547442643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2c196e70 con 0x7fcb2c100750 2024-09-13T23:08:05.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.837+0000 7fcb313b7700 1 -- 172.21.15.2:0/2547442643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2c04f2e0 con 0x7fcb2c100750 2024-09-13T23:08:05.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.838+0000 7fcb13fff700 1 -- 172.21.15.2:0/2547442643 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fcb2000f460 con 0x7fcb2c100750 2024-09-13T23:08:05.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.838+0000 7fcb13fff700 1 --2- 172.21.15.2:0/2547442643 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fcb1406e680 0x7fcb14070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:05.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.838+0000 7fcb13fff700 1 -- 172.21.15.2:0/2547442643 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fcb2008fb50 con 0x7fcb2c100750 2024-09-13T23:08:05.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.838+0000 7fcb2affd700 1 --2- 172.21.15.2:0/2547442643 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fcb1406e680 0x7fcb14070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:05.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.839+0000 7fcb2affd700 1 --2- 172.21.15.2:0/2547442643 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fcb1406e680 0x7fcb14070b40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c005fd0 tx=0x7fcb1c005f60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:05.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:05.843+0000 7fcb13fff700 1 -- 172.21.15.2:0/2547442643 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcb2005c820 con 0x7fcb2c100750 2024-09-13T23:08:06.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:06.099+0000 7fcb313b7700 1 -- 172.21.15.2:0/2547442643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7fcb2c197c10 con 0x7fcb2c100750 2024-09-13T23:08:06.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:06.099+0000 7fcb13fff700 1 -- 172.21.15.2:0/2547442643 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v37) v1 ==== 107+0+4903 (secure 0 0 0) 0x7fcb2005c3b0 con 0x7fcb2c100750 2024-09-13T23:08:06.100 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:06.100 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":18,"btime":"2024-09-13T23:04:28:735448+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14500,"name":"cephfs.smithi002.auedll","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/1577962179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1577962179},{"type":"v1","addr":"172.21.15.2:6827","nonce":1577962179}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24277,"name":"cephfs.smithi047.nqvveh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.47:6827/2007272492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2007272492},{"type":"v1","addr":"172.21.15.47:6827","nonce":2007272492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34380,"name":"cephfs.smithi002.gglyyr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/2657486485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2657486485},{"type":"v1","addr":"172.21.15.2:6829","nonce":2657486485}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:04:27.724473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24267":{"gid":24267,"name":"cephfs.smithi047.gxzkha","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.47:6825/2157973647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2157973647},{"type":"v1","addr":"172.21.15.47:6825","nonce":2157973647}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24267,"qdb_cluster":[24267]},"id":1}]} 2024-09-13T23:08:06.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:06.102+0000 7fcb313b7700 1 -- 172.21.15.2:0/2547442643 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fcb1406e680 msgr2=0x7fcb14070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:06.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:06.102+0000 7fcb313b7700 1 --2- 172.21.15.2:0/2547442643 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fcb1406e680 0x7fcb14070b40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c005fd0 tx=0x7fcb1c005f60 comp rx=0 tx=0).stop 2024-09-13T23:08:06.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:06.102+0000 7fcb313b7700 1 -- 172.21.15.2:0/2547442643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb2c100750 msgr2=0x7fcb2c19cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:06.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:06.102+0000 7fcb313b7700 1 --2- 172.21.15.2:0/2547442643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb2c100750 0x7fcb2c19cbc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcb200092e0 tx=0x7fcb2000be20 comp rx=0 tx=0).stop 2024-09-13T23:08:06.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:06.102+0000 7fcb313b7700 1 -- 172.21.15.2:0/2547442643 shutdown_connections 2024-09-13T23:08:06.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:06.102+0000 7fcb313b7700 1 --2- 172.21.15.2:0/2547442643 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fcb1406e680 0x7fcb14070b40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:06.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:06.102+0000 7fcb313b7700 1 --2- 172.21.15.2:0/2547442643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb2c0ffda0 0x7fcb2c19c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:06.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:06.102+0000 7fcb313b7700 1 --2- 172.21.15.2:0/2547442643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb2c100750 0x7fcb2c19cbc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:06.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:06.102+0000 7fcb313b7700 1 -- 172.21.15.2:0/2547442643 >> 172.21.15.2:0/2547442643 conn(0x7fcb2c0fb650 msgr2=0x7fcb2c103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:06.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:06.102+0000 7fcb313b7700 1 -- 172.21.15.2:0/2547442643 shutdown_connections 2024-09-13T23:08:06.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:06.102+0000 7fcb313b7700 1 -- 172.21.15.2:0/2547442643 wait complete. 2024-09-13T23:08:06.104 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 18 2024-09-13T23:08:06.687 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 18 2024-09-13T23:08:06.687 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 19 2024-09-13T23:08:06.910 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:07.325 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:07 smithi002 ceph-mon[111294]: pgmap v277: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:08:07.326 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:07 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/2547442643' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-13T23:08:07.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:07 smithi047 ceph-mon[81243]: pgmap v277: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:08:07.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:07 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/2547442643' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-13T23:08:08.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:08:08.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:08:08.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.489+0000 7f3403442700 1 -- 172.21.15.2:0/2603482924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33fc0fff50 msgr2=0x7f33fc105840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.489+0000 7f3403442700 1 --2- 172.21.15.2:0/2603482924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33fc0fff50 0x7f33fc105840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009910 tx=0x7f33ec009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.489+0000 7f3403442700 1 -- 172.21.15.2:0/2603482924 shutdown_connections 2024-09-13T23:08:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.489+0000 7f3403442700 1 --2- 172.21.15.2:0/2603482924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33fc0fff50 0x7f33fc105840 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.489+0000 7f3403442700 1 --2- 172.21.15.2:0/2603482924 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33fc0ff5a0 0x7f33fc0ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.489+0000 7f3403442700 1 -- 172.21.15.2:0/2603482924 >> 172.21.15.2:0/2603482924 conn(0x7f33fc074e30 msgr2=0x7f33fc075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.490+0000 7f3403442700 1 -- 172.21.15.2:0/2603482924 shutdown_connections 2024-09-13T23:08:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.490+0000 7f3403442700 1 -- 172.21.15.2:0/2603482924 wait complete. 2024-09-13T23:08:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.490+0000 7f3403442700 1 Processor -- start 2024-09-13T23:08:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.490+0000 7f3403442700 1 -- start start 2024-09-13T23:08:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.491+0000 7f3403442700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33fc0ff5a0 0x7f33fc19e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.491+0000 7f3403442700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33fc0fff50 0x7f33fc19ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.491+0000 7f3403442700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc19f3e0 con 0x7f33fc0ff5a0 2024-09-13T23:08:08.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.491+0000 7f3403442700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc198890 con 0x7f33fc0fff50 2024-09-13T23:08:08.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.491+0000 7f34011de700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33fc0ff5a0 0x7f33fc19e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:08.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.491+0000 7f34009dd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33fc0fff50 0x7f33fc19ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:08.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.491+0000 7f34011de700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33fc0ff5a0 0x7f33fc19e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52548/0 (socket says 172.21.15.2:52548) 2024-09-13T23:08:08.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.491+0000 7f34011de700 1 -- 172.21.15.2:0/610330685 learned_addr learned my addr 172.21.15.2:0/610330685 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:08.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.491+0000 7f34011de700 1 -- 172.21.15.2:0/610330685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33fc0fff50 msgr2=0x7f33fc19ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:08.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.491+0000 7f34011de700 1 --2- 172.21.15.2:0/610330685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33fc0fff50 0x7f33fc19ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:08.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.491+0000 7f34011de700 1 -- 172.21.15.2:0/610330685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec0095f0 con 0x7f33fc0ff5a0 2024-09-13T23:08:08.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.491+0000 7f34011de700 1 --2- 172.21.15.2:0/610330685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33fc0ff5a0 0x7f33fc19e810 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f33f800d8d0 tx=0x7f33f800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:08.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.492+0000 7f33f27fc700 1 -- 172.21.15.2:0/610330685 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33f80098a0 con 0x7f33fc0ff5a0 2024-09-13T23:08:08.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.492+0000 7f33f27fc700 1 -- 172.21.15.2:0/610330685 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f33f8010460 con 0x7f33fc0ff5a0 2024-09-13T23:08:08.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.492+0000 7f3403442700 1 -- 172.21.15.2:0/610330685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33fc198b70 con 0x7f33fc0ff5a0 2024-09-13T23:08:08.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.492+0000 7f33f27fc700 1 -- 172.21.15.2:0/610330685 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33f800f5f0 con 0x7f33fc0ff5a0 2024-09-13T23:08:08.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.492+0000 7f3403442700 1 -- 172.21.15.2:0/610330685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33fc1990c0 con 0x7f33fc0ff5a0 2024-09-13T23:08:08.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.493+0000 7f3403442700 1 -- 172.21.15.2:0/610330685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33fc0feed0 con 0x7f33fc0ff5a0 2024-09-13T23:08:08.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.493+0000 7f33f27fc700 1 -- 172.21.15.2:0/610330685 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f33f8009a00 con 0x7f33fc0ff5a0 2024-09-13T23:08:08.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.494+0000 7f33f27fc700 1 --2- 172.21.15.2:0/610330685 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f33e806e680 0x7f33e8070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:08.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.494+0000 7f33f27fc700 1 -- 172.21.15.2:0/610330685 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f33f808e5f0 con 0x7f33fc0ff5a0 2024-09-13T23:08:08.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.494+0000 7f34009dd700 1 --2- 172.21.15.2:0/610330685 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f33e806e680 0x7f33e8070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:08.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.494+0000 7f34009dd700 1 --2- 172.21.15.2:0/610330685 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f33e806e680 0x7f33e8070b40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f33fc105aa0 tx=0x7f33ec01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:08.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.498+0000 7f33f27fc700 1 -- 172.21.15.2:0/610330685 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f33f805b220 con 0x7f33fc0ff5a0 2024-09-13T23:08:08.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.756+0000 7f3403442700 1 -- 172.21.15.2:0/610330685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f33fc04f2e0 con 0x7f33fc0ff5a0 2024-09-13T23:08:08.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.757+0000 7f33f27fc700 1 -- 172.21.15.2:0/610330685 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v37) v1 ==== 107+0+4127 (secure 0 0 0) 0x7f33f805adb0 con 0x7f33fc0ff5a0 2024-09-13T23:08:08.758 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:08.758 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"btime":"2024-09-13T23:04:31:744457+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi047.nqvveh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.47:6827/2007272492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2007272492},{"type":"v1","addr":"172.21.15.47:6827","nonce":2007272492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34380,"name":"cephfs.smithi002.gglyyr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/2657486485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2657486485},{"type":"v1","addr":"172.21.15.2:6829","nonce":2657486485}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:04:27.724473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24267":{"gid":24267,"name":"cephfs.smithi047.gxzkha","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.47:6825/2157973647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2157973647},{"type":"v1","addr":"172.21.15.47:6825","nonce":2157973647}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24267,"qdb_cluster":[24267]},"id":1}]} 2024-09-13T23:08:08.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.759+0000 7f3403442700 1 -- 172.21.15.2:0/610330685 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f33e806e680 msgr2=0x7f33e8070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:08.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.759+0000 7f3403442700 1 --2- 172.21.15.2:0/610330685 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f33e806e680 0x7f33e8070b40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f33fc105aa0 tx=0x7f33ec01a040 comp rx=0 tx=0).stop 2024-09-13T23:08:08.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.759+0000 7f3403442700 1 -- 172.21.15.2:0/610330685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33fc0ff5a0 msgr2=0x7f33fc19e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:08.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.759+0000 7f3403442700 1 --2- 172.21.15.2:0/610330685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33fc0ff5a0 0x7f33fc19e810 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f33f800d8d0 tx=0x7f33f800dbe0 comp rx=0 tx=0).stop 2024-09-13T23:08:08.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.759+0000 7f3403442700 1 -- 172.21.15.2:0/610330685 shutdown_connections 2024-09-13T23:08:08.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.759+0000 7f3403442700 1 --2- 172.21.15.2:0/610330685 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f33e806e680 0x7f33e8070b40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:08.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.759+0000 7f3403442700 1 --2- 172.21.15.2:0/610330685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33fc0ff5a0 0x7f33fc19e810 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:08.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.759+0000 7f3403442700 1 --2- 172.21.15.2:0/610330685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33fc0fff50 0x7f33fc19ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:08.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.759+0000 7f3403442700 1 -- 172.21.15.2:0/610330685 >> 172.21.15.2:0/610330685 conn(0x7f33fc074e30 msgr2=0x7f33fc0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:08.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.760+0000 7f3403442700 1 -- 172.21.15.2:0/610330685 shutdown_connections 2024-09-13T23:08:08.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:08.760+0000 7f3403442700 1 -- 172.21.15.2:0/610330685 wait complete. 2024-09-13T23:08:08.761 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-13T23:08:09.338 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:09 smithi002 ceph-mon[111294]: pgmap v278: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:09.339 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:09 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:08:09.339 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:09 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/610330685' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-13T23:08:09.365 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-09-13T23:08:09.365 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-13T23:08:09.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:09 smithi047 ceph-mon[81243]: pgmap v278: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:09.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:09 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:08:09.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:09 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/610330685' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-13T23:08:09.586 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:10.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:10 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:08:10.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:10 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:08:10.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:10 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:10.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:10 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:08:10.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:10 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:08:10.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:10 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:08:10.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:10 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:08:10.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:10 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:08:10.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:10 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:08:10.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:10 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:08:11.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.263+0000 7f791d209700 1 -- 172.21.15.2:0/52802822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79180731c0 msgr2=0x7f79180735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:11.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.263+0000 7f791d209700 1 --2- 172.21.15.2:0/52802822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79180731c0 0x7f79180735a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7908009910 tx=0x7f7908009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:11.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.264+0000 7f791d209700 1 -- 172.21.15.2:0/52802822 shutdown_connections 2024-09-13T23:08:11.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.264+0000 7f791d209700 1 --2- 172.21.15.2:0/52802822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7918073ae0 0x7f791810cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:11.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.264+0000 7f791d209700 1 --2- 172.21.15.2:0/52802822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79180731c0 0x7f79180735a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:11.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.264+0000 7f791d209700 1 -- 172.21.15.2:0/52802822 >> 172.21.15.2:0/52802822 conn(0x7f79180fc750 msgr2=0x7f79180feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:11.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.264+0000 7f791d209700 1 -- 172.21.15.2:0/52802822 shutdown_connections 2024-09-13T23:08:11.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.264+0000 7f791d209700 1 -- 172.21.15.2:0/52802822 wait complete. 2024-09-13T23:08:11.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.264+0000 7f791d209700 1 Processor -- start 2024-09-13T23:08:11.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.265+0000 7f791d209700 1 -- start start 2024-09-13T23:08:11.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.265+0000 7f791d209700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79180731c0 0x7f791819e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:11.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.265+0000 7f791d209700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7918073ae0 0x7f791819ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.265+0000 7f791d209700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791819f400 con 0x7f79180731c0 2024-09-13T23:08:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.265+0000 7f791d209700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7918198900 con 0x7f7918073ae0 2024-09-13T23:08:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.265+0000 7f7916d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79180731c0 0x7f791819e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.265+0000 7f7916d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79180731c0 0x7f791819e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54686/0 (socket says 172.21.15.2:54686) 2024-09-13T23:08:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.265+0000 7f7916d9d700 1 -- 172.21.15.2:0/1738605721 learned_addr learned my addr 172.21.15.2:0/1738605721 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.265+0000 7f791659c700 1 --2- 172.21.15.2:0/1738605721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7918073ae0 0x7f791819ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.265+0000 7f7916d9d700 1 -- 172.21.15.2:0/1738605721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7918073ae0 msgr2=0x7f791819ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:11.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.265+0000 7f7916d9d700 1 --2- 172.21.15.2:0/1738605721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7918073ae0 0x7f791819ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.265+0000 7f7916d9d700 1 -- 172.21.15.2:0/1738605721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79080095f0 con 0x7f79180731c0 2024-09-13T23:08:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.266+0000 7f7916d9d700 1 --2- 172.21.15.2:0/1738605721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79180731c0 0x7f791819e830 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f79080092e0 tx=0x7f790800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.266+0000 7f78fffff700 1 -- 172.21.15.2:0/1738605721 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f790801d070 con 0x7f79180731c0 2024-09-13T23:08:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.266+0000 7f791d209700 1 -- 172.21.15.2:0/1738605721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7918198b80 con 0x7f79180731c0 2024-09-13T23:08:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.266+0000 7f78fffff700 1 -- 172.21.15.2:0/1738605721 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f790800f460 con 0x7f79180731c0 2024-09-13T23:08:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.266+0000 7f78fffff700 1 -- 172.21.15.2:0/1738605721 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7908005e20 con 0x7f79180731c0 2024-09-13T23:08:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.266+0000 7f791d209700 1 -- 172.21.15.2:0/1738605721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7918199070 con 0x7f79180731c0 2024-09-13T23:08:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.267+0000 7f791d209700 1 -- 172.21.15.2:0/1738605721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f791810a640 con 0x7f79180731c0 2024-09-13T23:08:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.267+0000 7f78fffff700 1 -- 172.21.15.2:0/1738605721 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f790800f5d0 con 0x7f79180731c0 2024-09-13T23:08:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.268+0000 7f78fffff700 1 --2- 172.21.15.2:0/1738605721 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f790006e680 0x7f7900070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.268+0000 7f78fffff700 1 -- 172.21.15.2:0/1738605721 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f790808fbb0 con 0x7f79180731c0 2024-09-13T23:08:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.268+0000 7f791659c700 1 --2- 172.21.15.2:0/1738605721 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f790006e680 0x7f7900070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.269+0000 7f791659c700 1 --2- 172.21.15.2:0/1738605721 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f790006e680 0x7f7900070b40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f790c005950 tx=0x7f790c0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:11.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.273+0000 7f78fffff700 1 -- 172.21.15.2:0/1738605721 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7908096080 con 0x7f79180731c0 2024-09-13T23:08:11.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.527+0000 7f791d209700 1 -- 172.21.15.2:0/1738605721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f7918199dc0 con 0x7f79180731c0 2024-09-13T23:08:11.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.528+0000 7f78fffff700 1 -- 172.21.15.2:0/1738605721 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v37) v1 ==== 107+0+4971 (secure 0 0 0) 0x7f790805c940 con 0x7f79180731c0 2024-09-13T23:08:11.529 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:11.529 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"btime":"2024-09-13T23:04:35:753557+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi047.nqvveh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.47:6827/2007272492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2007272492},{"type":"v1","addr":"172.21.15.47:6827","nonce":2007272492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34380,"name":"cephfs.smithi002.gglyyr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/2657486485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2657486485},{"type":"v1","addr":"172.21.15.2:6829","nonce":2657486485}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":34384,"name":"cephfs.smithi002.auedll","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/3279333632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3279333632},{"type":"v1","addr":"172.21.15.2:6827","nonce":3279333632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:04:27.724473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24267":{"gid":24267,"name":"cephfs.smithi047.gxzkha","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.47:6825/2157973647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2157973647},{"type":"v1","addr":"172.21.15.47:6825","nonce":2157973647}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24267,"qdb_cluster":[24267]},"id":1}]} 2024-09-13T23:08:11.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.530+0000 7f791d209700 1 -- 172.21.15.2:0/1738605721 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f790006e680 msgr2=0x7f7900070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:11.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.530+0000 7f791d209700 1 --2- 172.21.15.2:0/1738605721 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f790006e680 0x7f7900070b40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f790c005950 tx=0x7f790c0058e0 comp rx=0 tx=0).stop 2024-09-13T23:08:11.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.530+0000 7f791d209700 1 -- 172.21.15.2:0/1738605721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79180731c0 msgr2=0x7f791819e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:11.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.530+0000 7f791d209700 1 --2- 172.21.15.2:0/1738605721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79180731c0 0x7f791819e830 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f79080092e0 tx=0x7f790800be20 comp rx=0 tx=0).stop 2024-09-13T23:08:11.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.530+0000 7f791d209700 1 -- 172.21.15.2:0/1738605721 shutdown_connections 2024-09-13T23:08:11.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.530+0000 7f791d209700 1 --2- 172.21.15.2:0/1738605721 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f790006e680 0x7f7900070b40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:11.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.530+0000 7f791d209700 1 --2- 172.21.15.2:0/1738605721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79180731c0 0x7f791819e830 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:11.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.530+0000 7f791d209700 1 --2- 172.21.15.2:0/1738605721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7918073ae0 0x7f791819ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:11.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.530+0000 7f791d209700 1 -- 172.21.15.2:0/1738605721 >> 172.21.15.2:0/1738605721 conn(0x7f79180fc750 msgr2=0x7f7918107780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:11.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.530+0000 7f791d209700 1 -- 172.21.15.2:0/1738605721 shutdown_connections 2024-09-13T23:08:11.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:11.530+0000 7f791d209700 1 -- 172.21.15.2:0/1738605721 wait complete. 2024-09-13T23:08:11.532 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2024-09-13T23:08:11.908 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:11 smithi002 ceph-mon[111294]: pgmap v279: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:11.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:11 smithi047 ceph-mon[81243]: pgmap v279: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:12.133 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-09-13T23:08:12.134 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-13T23:08:12.342 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:12.681 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:12 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/1738605721' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T23:08:12.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:12 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/1738605721' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T23:08:13.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:13 smithi002 ceph-mon[111294]: pgmap v280: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:13.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:13 smithi047 ceph-mon[81243]: pgmap v280: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.960+0000 7fe0f31e9700 1 -- 172.21.15.2:0/3066054736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec0ffc20 msgr2=0x7fe0ec100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.960+0000 7fe0f31e9700 1 --2- 172.21.15.2:0/3066054736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec0ffc20 0x7fe0ec100080 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009910 tx=0x7fe0e0009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.960+0000 7fe0f31e9700 1 -- 172.21.15.2:0/3066054736 shutdown_connections 2024-09-13T23:08:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.960+0000 7fe0f31e9700 1 --2- 172.21.15.2:0/3066054736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec0ffc20 0x7fe0ec100080 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:13.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.960+0000 7fe0f31e9700 1 --2- 172.21.15.2:0/3066054736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0ec105bd0 0x7fe0ec105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:13.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.960+0000 7fe0f31e9700 1 -- 172.21.15.2:0/3066054736 >> 172.21.15.2:0/3066054736 conn(0x7fe0ec075670 msgr2=0x7fe0ec075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:13.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.960+0000 7fe0f31e9700 1 -- 172.21.15.2:0/3066054736 shutdown_connections 2024-09-13T23:08:13.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.960+0000 7fe0f31e9700 1 -- 172.21.15.2:0/3066054736 wait complete. 2024-09-13T23:08:13.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.961+0000 7fe0f31e9700 1 Processor -- start 2024-09-13T23:08:13.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.961+0000 7fe0f31e9700 1 -- start start 2024-09-13T23:08:13.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.961+0000 7fe0f31e9700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0ec0ffc20 0x7fe0ec19c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:13.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.961+0000 7fe0f31e9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec105bd0 0x7fe0ec19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:13.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.961+0000 7fe0f31e9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec19d200 con 0x7fe0ec105bd0 2024-09-13T23:08:13.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.961+0000 7fe0f31e9700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec1966b0 con 0x7fe0ec0ffc20 2024-09-13T23:08:13.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.961+0000 7fe0ebfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec105bd0 0x7fe0ec19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:13.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.961+0000 7fe0f0f85700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0ec0ffc20 0x7fe0ec19c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:13.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.961+0000 7fe0ebfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec105bd0 0x7fe0ec19cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54700/0 (socket says 172.21.15.2:54700) 2024-09-13T23:08:13.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.962+0000 7fe0ebfff700 1 -- 172.21.15.2:0/802407885 learned_addr learned my addr 172.21.15.2:0/802407885 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:13.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.962+0000 7fe0ebfff700 1 -- 172.21.15.2:0/802407885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0ec0ffc20 msgr2=0x7fe0ec19c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:13.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.962+0000 7fe0ebfff700 1 --2- 172.21.15.2:0/802407885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0ec0ffc20 0x7fe0ec19c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:13.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.962+0000 7fe0ebfff700 1 -- 172.21.15.2:0/802407885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e00095f0 con 0x7fe0ec105bd0 2024-09-13T23:08:13.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.962+0000 7fe0ebfff700 1 --2- 172.21.15.2:0/802407885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec105bd0 0x7fe0ec19cb70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe0e00092e0 tx=0x7fe0e000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:13.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.962+0000 7fe0e9ffb700 1 -- 172.21.15.2:0/802407885 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0e001d070 con 0x7fe0ec105bd0 2024-09-13T23:08:13.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.962+0000 7fe0e9ffb700 1 -- 172.21.15.2:0/802407885 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe0e0005e00 con 0x7fe0ec105bd0 2024-09-13T23:08:13.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.962+0000 7fe0e9ffb700 1 -- 172.21.15.2:0/802407885 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0e0017400 con 0x7fe0ec105bd0 2024-09-13T23:08:13.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.962+0000 7fe0f31e9700 1 -- 172.21.15.2:0/802407885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ec196930 con 0x7fe0ec105bd0 2024-09-13T23:08:13.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.962+0000 7fe0f31e9700 1 -- 172.21.15.2:0/802407885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ec196e20 con 0x7fe0ec105bd0 2024-09-13T23:08:13.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.964+0000 7fe0f31e9700 1 -- 172.21.15.2:0/802407885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ec04f2e0 con 0x7fe0ec105bd0 2024-09-13T23:08:13.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.964+0000 7fe0e9ffb700 1 -- 172.21.15.2:0/802407885 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fe0e000f6f0 con 0x7fe0ec105bd0 2024-09-13T23:08:13.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.965+0000 7fe0e9ffb700 1 --2- 172.21.15.2:0/802407885 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fe0d406e680 0x7fe0d4070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:13.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.965+0000 7fe0e9ffb700 1 -- 172.21.15.2:0/802407885 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe0e008fa50 con 0x7fe0ec105bd0 2024-09-13T23:08:13.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.965+0000 7fe0f0f85700 1 --2- 172.21.15.2:0/802407885 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fe0d406e680 0x7fe0d4070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:13.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.965+0000 7fe0f0f85700 1 --2- 172.21.15.2:0/802407885 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fe0d406e680 0x7fe0d4070b40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc005950 tx=0x7fe0dc00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:13.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:13.969+0000 7fe0e9ffb700 1 -- 172.21.15.2:0/802407885 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe0e005c7a0 con 0x7fe0ec105bd0 2024-09-13T23:08:14.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:14.230+0000 7fe0f31e9700 1 -- 172.21.15.2:0/802407885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fe0ec197150 con 0x7fe0ec105bd0 2024-09-13T23:08:14.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:14.230+0000 7fe0e9ffb700 1 -- 172.21.15.2:0/802407885 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v37) v1 ==== 107+0+4195 (secure 0 0 0) 0x7fe0e005c330 con 0x7fe0ec105bd0 2024-09-13T23:08:14.231 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:14.231 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"btime":"2024-09-13T23:04:48:669739+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi047.nqvveh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.47:6827/2007272492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2007272492},{"type":"v1","addr":"172.21.15.47:6827","nonce":2007272492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34384,"name":"cephfs.smithi002.auedll","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/3279333632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3279333632},{"type":"v1","addr":"172.21.15.2:6827","nonce":3279333632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:04:27.724473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24267":{"gid":24267,"name":"cephfs.smithi047.gxzkha","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.47:6825/2157973647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2157973647},{"type":"v1","addr":"172.21.15.47:6825","nonce":2157973647}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24267,"qdb_cluster":[24267]},"id":1}]} 2024-09-13T23:08:14.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:14.232+0000 7fe0f31e9700 1 -- 172.21.15.2:0/802407885 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fe0d406e680 msgr2=0x7fe0d4070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:14.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:14.232+0000 7fe0f31e9700 1 --2- 172.21.15.2:0/802407885 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fe0d406e680 0x7fe0d4070b40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc005950 tx=0x7fe0dc00b410 comp rx=0 tx=0).stop 2024-09-13T23:08:14.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:14.232+0000 7fe0f31e9700 1 -- 172.21.15.2:0/802407885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec105bd0 msgr2=0x7fe0ec19cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:14.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:14.232+0000 7fe0f31e9700 1 --2- 172.21.15.2:0/802407885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec105bd0 0x7fe0ec19cb70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe0e00092e0 tx=0x7fe0e000bd70 comp rx=0 tx=0).stop 2024-09-13T23:08:14.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:14.232+0000 7fe0f31e9700 1 -- 172.21.15.2:0/802407885 shutdown_connections 2024-09-13T23:08:14.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:14.232+0000 7fe0f31e9700 1 --2- 172.21.15.2:0/802407885 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fe0d406e680 0x7fe0d4070b40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:14.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:14.232+0000 7fe0f31e9700 1 --2- 172.21.15.2:0/802407885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0ec0ffc20 0x7fe0ec19c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:14.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:14.232+0000 7fe0f31e9700 1 --2- 172.21.15.2:0/802407885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0ec105bd0 0x7fe0ec19cb70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:14.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:14.232+0000 7fe0f31e9700 1 -- 172.21.15.2:0/802407885 >> 172.21.15.2:0/802407885 conn(0x7fe0ec075670 msgr2=0x7fe0ec068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:14.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:14.232+0000 7fe0f31e9700 1 -- 172.21.15.2:0/802407885 shutdown_connections 2024-09-13T23:08:14.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:14.233+0000 7fe0f31e9700 1 -- 172.21.15.2:0/802407885 wait complete. 2024-09-13T23:08:14.234 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 21 2024-09-13T23:08:14.809 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:14 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/802407885' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T23:08:14.832 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-09-13T23:08:14.833 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-13T23:08:14.912 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:14 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/802407885' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T23:08:15.041 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:15.896 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:15 smithi002 ceph-mon[111294]: pgmap v281: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:16.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:15 smithi047 ceph-mon[81243]: pgmap v281: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:16.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.786+0000 7fdbbf7eb700 1 -- 172.21.15.2:0/572692088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb8073130 msgr2=0x7fdbb8073510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:16.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.786+0000 7fdbbf7eb700 1 --2- 172.21.15.2:0/572692088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb8073130 0x7fdbb8073510 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4009910 tx=0x7fdbb4009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:16.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.786+0000 7fdbbf7eb700 1 -- 172.21.15.2:0/572692088 shutdown_connections 2024-09-13T23:08:16.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.786+0000 7fdbbf7eb700 1 --2- 172.21.15.2:0/572692088 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbb8073a50 0x7fdbb8111710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:16.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.786+0000 7fdbbf7eb700 1 --2- 172.21.15.2:0/572692088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb8073130 0x7fdbb8073510 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:16.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.786+0000 7fdbbf7eb700 1 -- 172.21.15.2:0/572692088 >> 172.21.15.2:0/572692088 conn(0x7fdbb80fc750 msgr2=0x7fdbb80feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:16.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.786+0000 7fdbbf7eb700 1 -- 172.21.15.2:0/572692088 shutdown_connections 2024-09-13T23:08:16.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.786+0000 7fdbbf7eb700 1 -- 172.21.15.2:0/572692088 wait complete. 2024-09-13T23:08:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.786+0000 7fdbbf7eb700 1 Processor -- start 2024-09-13T23:08:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.786+0000 7fdbbf7eb700 1 -- start start 2024-09-13T23:08:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.787+0000 7fdbbf7eb700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbb8073130 0x7fdbb819cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.787+0000 7fdbbf7eb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb8073a50 0x7fdbb819d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.787+0000 7fdbbf7eb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb819db70 con 0x7fdbb8073a50 2024-09-13T23:08:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.787+0000 7fdbbf7eb700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb81a1900 con 0x7fdbb8073130 2024-09-13T23:08:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.787+0000 7fdbbcd86700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb8073a50 0x7fdbb819d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:16.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.787+0000 7fdbbcd86700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb8073a50 0x7fdbb819d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54720/0 (socket says 172.21.15.2:54720) 2024-09-13T23:08:16.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.787+0000 7fdbbcd86700 1 -- 172.21.15.2:0/2444167944 learned_addr learned my addr 172.21.15.2:0/2444167944 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:16.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.787+0000 7fdbbd587700 1 --2- 172.21.15.2:0/2444167944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbb8073130 0x7fdbb819cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:16.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.787+0000 7fdbbcd86700 1 -- 172.21.15.2:0/2444167944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbb8073130 msgr2=0x7fdbb819cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:16.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.787+0000 7fdbbcd86700 1 --2- 172.21.15.2:0/2444167944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbb8073130 0x7fdbb819cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:16.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.787+0000 7fdbbcd86700 1 -- 172.21.15.2:0/2444167944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb40095f0 con 0x7fdbb8073a50 2024-09-13T23:08:16.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.787+0000 7fdbbd587700 1 --2- 172.21.15.2:0/2444167944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbb8073130 0x7fdbb819cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:08:16.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.787+0000 7fdbbcd86700 1 --2- 172.21.15.2:0/2444167944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb8073a50 0x7fdbb819d490 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdba800b4b0 tx=0x7fdba800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:16.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.788+0000 7fdbae7fc700 1 -- 172.21.15.2:0/2444167944 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdba8011800 con 0x7fdbb8073a50 2024-09-13T23:08:16.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.788+0000 7fdbae7fc700 1 -- 172.21.15.2:0/2444167944 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdba8011e20 con 0x7fdbb8073a50 2024-09-13T23:08:16.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.788+0000 7fdbae7fc700 1 -- 172.21.15.2:0/2444167944 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdba800f2e0 con 0x7fdbb8073a50 2024-09-13T23:08:16.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.788+0000 7fdbbf7eb700 1 -- 172.21.15.2:0/2444167944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb81a1be0 con 0x7fdbb8073a50 2024-09-13T23:08:16.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.788+0000 7fdbbf7eb700 1 -- 172.21.15.2:0/2444167944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb81a2130 con 0x7fdbb8073a50 2024-09-13T23:08:16.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.789+0000 7fdbbf7eb700 1 -- 172.21.15.2:0/2444167944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb810ee90 con 0x7fdbb8073a50 2024-09-13T23:08:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.789+0000 7fdbae7fc700 1 -- 172.21.15.2:0/2444167944 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fdba8010380 con 0x7fdbb8073a50 2024-09-13T23:08:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.790+0000 7fdbae7fc700 1 --2- 172.21.15.2:0/2444167944 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fdba406e680 0x7fdba4070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.790+0000 7fdbae7fc700 1 -- 172.21.15.2:0/2444167944 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fdba808e180 con 0x7fdbb8073a50 2024-09-13T23:08:16.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.790+0000 7fdbbd587700 1 --2- 172.21.15.2:0/2444167944 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fdba406e680 0x7fdba4070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:16.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.790+0000 7fdbbd587700 1 --2- 172.21.15.2:0/2444167944 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fdba406e680 0x7fdba4070b40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400b5c0 tx=0x7fdbb401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:16.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:16.794+0000 7fdbae7fc700 1 -- 172.21.15.2:0/2444167944 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdba8057450 con 0x7fdbb8073a50 2024-09-13T23:08:17.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:17.053+0000 7fdbbf7eb700 1 -- 172.21.15.2:0/2444167944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fdbb804f2e0 con 0x7fdbb8073a50 2024-09-13T23:08:17.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:17.054+0000 7fdbae7fc700 1 -- 172.21.15.2:0/2444167944 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v37) v1 ==== 107+0+5039 (secure 0 0 0) 0x7fdba805ab10 con 0x7fdbb8073a50 2024-09-13T23:08:17.056 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:17.056 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":22,"btime":"2024-09-13T23:04:53:682331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi047.nqvveh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.47:6827/2007272492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2007272492},{"type":"v1","addr":"172.21.15.47:6827","nonce":2007272492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34384,"name":"cephfs.smithi002.auedll","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/3279333632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3279333632},{"type":"v1","addr":"172.21.15.2:6827","nonce":3279333632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34416,"name":"cephfs.smithi002.gglyyr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/4224459092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4224459092},{"type":"v1","addr":"172.21.15.2:6829","nonce":4224459092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:04:27.724473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24267":{"gid":24267,"name":"cephfs.smithi047.gxzkha","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.47:6825/2157973647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":2157973647},{"type":"v1","addr":"172.21.15.47:6825","nonce":2157973647}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24267,"qdb_cluster":[24267]},"id":1}]} 2024-09-13T23:08:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:17.056+0000 7fdbbf7eb700 1 -- 172.21.15.2:0/2444167944 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fdba406e680 msgr2=0x7fdba4070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:17.056+0000 7fdbbf7eb700 1 --2- 172.21.15.2:0/2444167944 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fdba406e680 0x7fdba4070b40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400b5c0 tx=0x7fdbb401a040 comp rx=0 tx=0).stop 2024-09-13T23:08:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:17.056+0000 7fdbbf7eb700 1 -- 172.21.15.2:0/2444167944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb8073a50 msgr2=0x7fdbb819d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:17.056+0000 7fdbbf7eb700 1 --2- 172.21.15.2:0/2444167944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb8073a50 0x7fdbb819d490 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdba800b4b0 tx=0x7fdba800b870 comp rx=0 tx=0).stop 2024-09-13T23:08:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:17.057+0000 7fdbbf7eb700 1 -- 172.21.15.2:0/2444167944 shutdown_connections 2024-09-13T23:08:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:17.057+0000 7fdbbf7eb700 1 --2- 172.21.15.2:0/2444167944 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fdba406e680 0x7fdba4070b40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:17.057+0000 7fdbbf7eb700 1 --2- 172.21.15.2:0/2444167944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbb8073130 0x7fdbb819cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:17.057+0000 7fdbbf7eb700 1 --2- 172.21.15.2:0/2444167944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbb8073a50 0x7fdbb819d490 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:17.057+0000 7fdbbf7eb700 1 -- 172.21.15.2:0/2444167944 >> 172.21.15.2:0/2444167944 conn(0x7fdbb80fc750 msgr2=0x7fdbb8103220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:17.057+0000 7fdbbf7eb700 1 -- 172.21.15.2:0/2444167944 shutdown_connections 2024-09-13T23:08:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:17.057+0000 7fdbbf7eb700 1 -- 172.21.15.2:0/2444167944 wait complete. 2024-09-13T23:08:17.060 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 22 2024-09-13T23:08:17.728 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-09-13T23:08:17.728 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-13T23:08:17.938 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:18.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:17 smithi002 ceph-mon[111294]: pgmap v282: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:08:18.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:17 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/2444167944' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T23:08:18.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:17 smithi047 ceph-mon[81243]: pgmap v282: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:08:18.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:17 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/2444167944' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T23:08:19.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.549+0000 7f3624666700 1 -- 172.21.15.2:0/2086097742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c100340 msgr2=0x7f361c10d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:19.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.549+0000 7f3624666700 1 --2- 172.21.15.2:0/2086097742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c100340 0x7f361c10d000 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f360c009910 tx=0x7f360c009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:19.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.549+0000 7f3624666700 1 -- 172.21.15.2:0/2086097742 shutdown_connections 2024-09-13T23:08:19.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.549+0000 7f3624666700 1 --2- 172.21.15.2:0/2086097742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c100340 0x7f361c10d000 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:19.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.549+0000 7f3624666700 1 --2- 172.21.15.2:0/2086097742 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f361c0ff990 0x7f361c0ffd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:19.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.549+0000 7f3624666700 1 -- 172.21.15.2:0/2086097742 >> 172.21.15.2:0/2086097742 conn(0x7f361c0fb650 msgr2=0x7f361c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.549+0000 7f3624666700 1 -- 172.21.15.2:0/2086097742 shutdown_connections 2024-09-13T23:08:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.549+0000 7f3624666700 1 -- 172.21.15.2:0/2086097742 wait complete. 2024-09-13T23:08:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.550+0000 7f3624666700 1 Processor -- start 2024-09-13T23:08:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.550+0000 7f3624666700 1 -- start start 2024-09-13T23:08:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.550+0000 7f3624666700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f361c0ff990 0x7f361c19e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.550+0000 7f3624666700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c100340 0x7f361c19eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.550+0000 7f3624666700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c19f430 con 0x7f361c100340 2024-09-13T23:08:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.550+0000 7f3624666700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c1988e0 con 0x7f361c0ff990 2024-09-13T23:08:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.550+0000 7f3621c01700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c100340 0x7f361c19eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.550+0000 7f3621c01700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c100340 0x7f361c19eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54752/0 (socket says 172.21.15.2:54752) 2024-09-13T23:08:19.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.550+0000 7f3621c01700 1 -- 172.21.15.2:0/4215576233 learned_addr learned my addr 172.21.15.2:0/4215576233 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:19.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.550+0000 7f3622402700 1 --2- 172.21.15.2:0/4215576233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f361c0ff990 0x7f361c19e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:19.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.550+0000 7f3621c01700 1 -- 172.21.15.2:0/4215576233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f361c0ff990 msgr2=0x7f361c19e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:19.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.550+0000 7f3621c01700 1 --2- 172.21.15.2:0/4215576233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f361c0ff990 0x7f361c19e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:19.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.550+0000 7f3621c01700 1 -- 172.21.15.2:0/4215576233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c0095f0 con 0x7f361c100340 2024-09-13T23:08:19.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.550+0000 7f3622402700 1 --2- 172.21.15.2:0/4215576233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f361c0ff990 0x7f361c19e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:08:19.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.551+0000 7f3621c01700 1 --2- 172.21.15.2:0/4215576233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c100340 0x7f361c19eda0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f360c005620 tx=0x7f360c005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:19.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.551+0000 7f36137fe700 1 -- 172.21.15.2:0/4215576233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f360c01d070 con 0x7f361c100340 2024-09-13T23:08:19.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.551+0000 7f36137fe700 1 -- 172.21.15.2:0/4215576233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f360c005dc0 con 0x7f361c100340 2024-09-13T23:08:19.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.551+0000 7f36137fe700 1 -- 172.21.15.2:0/4215576233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f360c021410 con 0x7f361c100340 2024-09-13T23:08:19.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.551+0000 7f3624666700 1 -- 172.21.15.2:0/4215576233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361c198b60 con 0x7f361c100340 2024-09-13T23:08:19.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.551+0000 7f3624666700 1 -- 172.21.15.2:0/4215576233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361c199060 con 0x7f361c100340 2024-09-13T23:08:19.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.552+0000 7f3624666700 1 -- 172.21.15.2:0/4215576233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361c10a770 con 0x7f361c100340 2024-09-13T23:08:19.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.553+0000 7f36137fe700 1 -- 172.21.15.2:0/4215576233 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f360c00f7f0 con 0x7f361c100340 2024-09-13T23:08:19.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.553+0000 7f36137fe700 1 --2- 172.21.15.2:0/4215576233 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f360806e680 0x7f3608070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:19.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.553+0000 7f36137fe700 1 -- 172.21.15.2:0/4215576233 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f360c08f8d0 con 0x7f361c100340 2024-09-13T23:08:19.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.553+0000 7f3622402700 1 --2- 172.21.15.2:0/4215576233 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f360806e680 0x7f3608070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:19.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.554+0000 7f3622402700 1 --2- 172.21.15.2:0/4215576233 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f360806e680 0x7f3608070b40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3618009690 tx=0x7f3618009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:19.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.557+0000 7f36137fe700 1 -- 172.21.15.2:0/4215576233 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f360c05c5a0 con 0x7f361c100340 2024-09-13T23:08:19.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.812+0000 7f3624666700 1 -- 172.21.15.2:0/4215576233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f361c04f2e0 con 0x7f361c100340 2024-09-13T23:08:19.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.812+0000 7f36137fe700 1 -- 172.21.15.2:0/4215576233 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v37) v1 ==== 107+0+4241 (secure 0 0 0) 0x7f360c05c130 con 0x7f361c100340 2024-09-13T23:08:19.815 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:19.815 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"btime":"2024-09-13T23:05:05:566995+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi047.nqvveh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.47:6827/2007272492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2007272492},{"type":"v1","addr":"172.21.15.47:6827","nonce":2007272492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34384,"name":"cephfs.smithi002.auedll","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/3279333632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3279333632},{"type":"v1","addr":"172.21.15.2:6827","nonce":3279333632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34416,"name":"cephfs.smithi002.gglyyr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/4224459092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4224459092},{"type":"v1","addr":"172.21.15.2:6829","nonce":4224459092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:05:05.566991+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T23:08:19.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.815+0000 7f3624666700 1 -- 172.21.15.2:0/4215576233 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f360806e680 msgr2=0x7f3608070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:19.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.815+0000 7f3624666700 1 --2- 172.21.15.2:0/4215576233 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f360806e680 0x7f3608070b40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3618009690 tx=0x7f3618009040 comp rx=0 tx=0).stop 2024-09-13T23:08:19.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.815+0000 7f3624666700 1 -- 172.21.15.2:0/4215576233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c100340 msgr2=0x7f361c19eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:19.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.815+0000 7f3624666700 1 --2- 172.21.15.2:0/4215576233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c100340 0x7f361c19eda0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f360c005620 tx=0x7f360c005700 comp rx=0 tx=0).stop 2024-09-13T23:08:19.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.815+0000 7f3624666700 1 -- 172.21.15.2:0/4215576233 shutdown_connections 2024-09-13T23:08:19.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.815+0000 7f3624666700 1 --2- 172.21.15.2:0/4215576233 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f360806e680 0x7f3608070b40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:19.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.815+0000 7f3624666700 1 --2- 172.21.15.2:0/4215576233 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f361c0ff990 0x7f361c19e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:19.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.815+0000 7f3624666700 1 --2- 172.21.15.2:0/4215576233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f361c100340 0x7f361c19eda0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:19.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.815+0000 7f3624666700 1 -- 172.21.15.2:0/4215576233 >> 172.21.15.2:0/4215576233 conn(0x7f361c0fb650 msgr2=0x7f361c0fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:19.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.815+0000 7f3624666700 1 -- 172.21.15.2:0/4215576233 shutdown_connections 2024-09-13T23:08:19.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:19.815+0000 7f3624666700 1 -- 172.21.15.2:0/4215576233 wait complete. 2024-09-13T23:08:19.818 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 23 2024-09-13T23:08:20.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:19 smithi047 ceph-mon[81243]: pgmap v283: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:20.188 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:19 smithi002 ceph-mon[111294]: pgmap v283: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:20.493 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-09-13T23:08:20.493 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-13T23:08:20.702 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:21.057 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:20 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/4215576233' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T23:08:21.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:20 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/4215576233' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T23:08:22.110 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:21 smithi002 ceph-mon[111294]: pgmap v284: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:22.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:21 smithi047 ceph-mon[81243]: pgmap v284: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:22.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.345+0000 7f22f082a700 1 -- 172.21.15.2:0/2230522016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ec101840 msgr2=0x7f22ec105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:22.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.345+0000 7f22f082a700 1 --2- 172.21.15.2:0/2230522016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ec101840 0x7f22ec105890 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009910 tx=0x7f22d4009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:22.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.345+0000 7f22f082a700 1 -- 172.21.15.2:0/2230522016 shutdown_connections 2024-09-13T23:08:22.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.345+0000 7f22f082a700 1 --2- 172.21.15.2:0/2230522016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ec101840 0x7f22ec105890 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:22.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.345+0000 7f22f082a700 1 --2- 172.21.15.2:0/2230522016 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22ec100e90 0x7f22ec101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:22.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.345+0000 7f22f082a700 1 -- 172.21.15.2:0/2230522016 >> 172.21.15.2:0/2230522016 conn(0x7f22ec0fc740 msgr2=0x7f22ec0feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:22.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.345+0000 7f22f082a700 1 -- 172.21.15.2:0/2230522016 shutdown_connections 2024-09-13T23:08:22.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.345+0000 7f22f082a700 1 -- 172.21.15.2:0/2230522016 wait complete. 2024-09-13T23:08:22.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.346+0000 7f22f082a700 1 Processor -- start 2024-09-13T23:08:22.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.346+0000 7f22f082a700 1 -- start start 2024-09-13T23:08:22.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.346+0000 7f22f082a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ec100e90 0x7f22ec19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:22.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.346+0000 7f22f082a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22ec101840 0x7f22ec19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:22.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.346+0000 7f22f082a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec19d240 con 0x7f22ec100e90 2024-09-13T23:08:22.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.346+0000 7f22f082a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec1966f0 con 0x7f22ec101840 2024-09-13T23:08:22.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.346+0000 7f22ea59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ec100e90 0x7f22ec19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:22.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.346+0000 7f22ea59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ec100e90 0x7f22ec19c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34900/0 (socket says 172.21.15.2:34900) 2024-09-13T23:08:22.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.346+0000 7f22ea59c700 1 -- 172.21.15.2:0/587460915 learned_addr learned my addr 172.21.15.2:0/587460915 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:22.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.347+0000 7f22e9d9b700 1 --2- 172.21.15.2:0/587460915 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22ec101840 0x7f22ec19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:22.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.347+0000 7f22ea59c700 1 -- 172.21.15.2:0/587460915 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22ec101840 msgr2=0x7f22ec19cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:22.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.347+0000 7f22ea59c700 1 --2- 172.21.15.2:0/587460915 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22ec101840 0x7f22ec19cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:22.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.347+0000 7f22ea59c700 1 -- 172.21.15.2:0/587460915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d40095f0 con 0x7f22ec100e90 2024-09-13T23:08:22.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.347+0000 7f22ea59c700 1 --2- 172.21.15.2:0/587460915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ec100e90 0x7f22ec19c670 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f22dc0060b0 tx=0x7f22dc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:22.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.347+0000 7f22e37fe700 1 -- 172.21.15.2:0/587460915 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22dc00dda0 con 0x7f22ec100e90 2024-09-13T23:08:22.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.347+0000 7f22e37fe700 1 -- 172.21.15.2:0/587460915 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22dc00f040 con 0x7f22ec100e90 2024-09-13T23:08:22.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.347+0000 7f22e37fe700 1 -- 172.21.15.2:0/587460915 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22dc014790 con 0x7f22ec100e90 2024-09-13T23:08:22.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.347+0000 7f22f082a700 1 -- 172.21.15.2:0/587460915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ec1969d0 con 0x7f22ec100e90 2024-09-13T23:08:22.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.347+0000 7f22f082a700 1 -- 172.21.15.2:0/587460915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ec196f20 con 0x7f22ec100e90 2024-09-13T23:08:22.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.348+0000 7f22f082a700 1 -- 172.21.15.2:0/587460915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ec109290 con 0x7f22ec100e90 2024-09-13T23:08:22.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.349+0000 7f22e37fe700 1 -- 172.21.15.2:0/587460915 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f22dc014980 con 0x7f22ec100e90 2024-09-13T23:08:22.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.349+0000 7f22e37fe700 1 --2- 172.21.15.2:0/587460915 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f22d806e680 0x7f22d8070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:22.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.349+0000 7f22e37fe700 1 -- 172.21.15.2:0/587460915 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f22dc08e110 con 0x7f22ec100e90 2024-09-13T23:08:22.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.349+0000 7f22e9d9b700 1 --2- 172.21.15.2:0/587460915 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f22d806e680 0x7f22d8070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:22.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.350+0000 7f22e9d9b700 1 --2- 172.21.15.2:0/587460915 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f22d806e680 0x7f22d8070b40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f22ec197b60 tx=0x7f22d401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:22.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.354+0000 7f22e37fe700 1 -- 172.21.15.2:0/587460915 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f22dc05ae90 con 0x7f22ec100e90 2024-09-13T23:08:22.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.604+0000 7f22f082a700 1 -- 172.21.15.2:0/587460915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f22ec04f2e0 con 0x7f22ec100e90 2024-09-13T23:08:22.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.605+0000 7f22e37fe700 1 -- 172.21.15.2:0/587460915 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v37) v1 ==== 107+0+4252 (secure 0 0 0) 0x7f22dc05aa20 con 0x7f22ec100e90 2024-09-13T23:08:22.606 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:22.606 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":24,"btime":"2024-09-13T23:05:05:572730+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi002.auedll","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/3279333632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3279333632},{"type":"v1","addr":"172.21.15.2:6827","nonce":3279333632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34416,"name":"cephfs.smithi002.gglyyr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/4224459092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4224459092},{"type":"v1","addr":"172.21.15.2:6829","nonce":4224459092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:05:05.572716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi047.nqvveh","rank":0,"incarnation":24,"state":"up:replay","state_seq":2,"addr":"172.21.15.47:6827/2007272492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2007272492},{"type":"v1","addr":"172.21.15.47:6827","nonce":2007272492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T23:08:22.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.607+0000 7f22f082a700 1 -- 172.21.15.2:0/587460915 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f22d806e680 msgr2=0x7f22d8070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:22.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.607+0000 7f22f082a700 1 --2- 172.21.15.2:0/587460915 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f22d806e680 0x7f22d8070b40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f22ec197b60 tx=0x7f22d401a040 comp rx=0 tx=0).stop 2024-09-13T23:08:22.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.607+0000 7f22f082a700 1 -- 172.21.15.2:0/587460915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ec100e90 msgr2=0x7f22ec19c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:22.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.607+0000 7f22f082a700 1 --2- 172.21.15.2:0/587460915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ec100e90 0x7f22ec19c670 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f22dc0060b0 tx=0x7f22dc00d3b0 comp rx=0 tx=0).stop 2024-09-13T23:08:22.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.607+0000 7f22f082a700 1 -- 172.21.15.2:0/587460915 shutdown_connections 2024-09-13T23:08:22.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.607+0000 7f22f082a700 1 --2- 172.21.15.2:0/587460915 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f22d806e680 0x7f22d8070b40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:22.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.607+0000 7f22f082a700 1 --2- 172.21.15.2:0/587460915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ec100e90 0x7f22ec19c670 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:22.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.607+0000 7f22f082a700 1 --2- 172.21.15.2:0/587460915 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22ec101840 0x7f22ec19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:22.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.607+0000 7f22f082a700 1 -- 172.21.15.2:0/587460915 >> 172.21.15.2:0/587460915 conn(0x7f22ec0fc740 msgr2=0x7f22ec0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:22.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.607+0000 7f22f082a700 1 -- 172.21.15.2:0/587460915 shutdown_connections 2024-09-13T23:08:22.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:22.607+0000 7f22f082a700 1 -- 172.21.15.2:0/587460915 wait complete. 2024-09-13T23:08:22.609 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 24 2024-09-13T23:08:22.901 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:22 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/587460915' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T23:08:23.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:22 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/587460915' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T23:08:23.224 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-13T23:08:23.225 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-13T23:08:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:23.813 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:23 smithi002 ceph-mon[111294]: pgmap v285: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:23.814 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:23 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:08:24.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:23 smithi047 ceph-mon[81243]: pgmap v285: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:24.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:23 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:08:25.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.060+0000 7fcfd47bc700 1 -- 172.21.15.2:0/378462265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfcc101de0 msgr2=0x7fcfcc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:25.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.060+0000 7fcfd47bc700 1 --2- 172.21.15.2:0/378462265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfcc101de0 0x7fcfcc1021c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009910 tx=0x7fcfc8009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:25.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.060+0000 7fcfd47bc700 1 -- 172.21.15.2:0/378462265 shutdown_connections 2024-09-13T23:08:25.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.060+0000 7fcfd47bc700 1 --2- 172.21.15.2:0/378462265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfcc102700 0x7fcfcc10abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:25.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.060+0000 7fcfd47bc700 1 --2- 172.21.15.2:0/378462265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfcc101de0 0x7fcfcc1021c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:25.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.060+0000 7fcfd47bc700 1 -- 172.21.15.2:0/378462265 >> 172.21.15.2:0/378462265 conn(0x7fcfcc0fb650 msgr2=0x7fcfcc0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:25.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.060+0000 7fcfd47bc700 1 -- 172.21.15.2:0/378462265 shutdown_connections 2024-09-13T23:08:25.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.060+0000 7fcfd47bc700 1 -- 172.21.15.2:0/378462265 wait complete. 2024-09-13T23:08:25.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.060+0000 7fcfd47bc700 1 Processor -- start 2024-09-13T23:08:25.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.060+0000 7fcfd47bc700 1 -- start start 2024-09-13T23:08:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.061+0000 7fcfd47bc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfcc101de0 0x7fcfcc19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.061+0000 7fcfd47bc700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfcc102700 0x7fcfcc19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.061+0000 7fcfd47bc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc19d270 con 0x7fcfcc101de0 2024-09-13T23:08:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.061+0000 7fcfd47bc700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc196720 con 0x7fcfcc102700 2024-09-13T23:08:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.061+0000 7fcfd2558700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfcc101de0 0x7fcfcc19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.061+0000 7fcfd2558700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfcc101de0 0x7fcfcc19c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34912/0 (socket says 172.21.15.2:34912) 2024-09-13T23:08:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.061+0000 7fcfd2558700 1 -- 172.21.15.2:0/2518518148 learned_addr learned my addr 172.21.15.2:0/2518518148 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.061+0000 7fcfd1d57700 1 --2- 172.21.15.2:0/2518518148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfcc102700 0x7fcfcc19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.061+0000 7fcfd2558700 1 -- 172.21.15.2:0/2518518148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfcc102700 msgr2=0x7fcfcc19cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.061+0000 7fcfd2558700 1 --2- 172.21.15.2:0/2518518148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfcc102700 0x7fcfcc19cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:25.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.061+0000 7fcfd2558700 1 -- 172.21.15.2:0/2518518148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc80095f0 con 0x7fcfcc101de0 2024-09-13T23:08:25.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.061+0000 7fcfd1d57700 1 --2- 172.21.15.2:0/2518518148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfcc102700 0x7fcfcc19cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:08:25.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.061+0000 7fcfd2558700 1 --2- 172.21.15.2:0/2518518148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfcc101de0 0x7fcfcc19c6a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800b5c0 tx=0x7fcfc800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:25.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.061+0000 7fcfc37fe700 1 -- 172.21.15.2:0/2518518148 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfc801d070 con 0x7fcfcc101de0 2024-09-13T23:08:25.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.062+0000 7fcfd47bc700 1 -- 172.21.15.2:0/2518518148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfcc1969a0 con 0x7fcfcc101de0 2024-09-13T23:08:25.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.062+0000 7fcfc37fe700 1 -- 172.21.15.2:0/2518518148 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcfc8005e00 con 0x7fcfcc101de0 2024-09-13T23:08:25.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.062+0000 7fcfc37fe700 1 -- 172.21.15.2:0/2518518148 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfc8017400 con 0x7fcfcc101de0 2024-09-13T23:08:25.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.062+0000 7fcfd47bc700 1 -- 172.21.15.2:0/2518518148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfcc196e90 con 0x7fcfcc101de0 2024-09-13T23:08:25.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.062+0000 7fcfd47bc700 1 -- 172.21.15.2:0/2518518148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfcc1082f0 con 0x7fcfcc101de0 2024-09-13T23:08:25.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.063+0000 7fcfc37fe700 1 -- 172.21.15.2:0/2518518148 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fcfc800f460 con 0x7fcfcc101de0 2024-09-13T23:08:25.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.064+0000 7fcfc37fe700 1 --2- 172.21.15.2:0/2518518148 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fcfb806e680 0x7fcfb8070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:25.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.064+0000 7fcfc37fe700 1 -- 172.21.15.2:0/2518518148 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fcfc808fb90 con 0x7fcfcc101de0 2024-09-13T23:08:25.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.064+0000 7fcfd1d57700 1 --2- 172.21.15.2:0/2518518148 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fcfb806e680 0x7fcfb8070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:25.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.064+0000 7fcfd1d57700 1 --2- 172.21.15.2:0/2518518148 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fcfb806e680 0x7fcfb8070b40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc005d90 tx=0x7fcfbc009670 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:25.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.068+0000 7fcfc37fe700 1 -- 172.21.15.2:0/2518518148 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcfc805c860 con 0x7fcfcc101de0 2024-09-13T23:08:25.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.332+0000 7fcfd47bc700 1 -- 172.21.15.2:0/2518518148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7fcfcc197cd0 con 0x7fcfcc101de0 2024-09-13T23:08:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.332+0000 7fcfc37fe700 1 -- 172.21.15.2:0/2518518148 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v37) v1 ==== 107+0+5099 (secure 0 0 0) 0x7fcfc805c3f0 con 0x7fcfcc101de0 2024-09-13T23:08:25.333 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:25.333 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-09-13T23:05:12:927428+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi002.auedll","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/3279333632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3279333632},{"type":"v1","addr":"172.21.15.2:6827","nonce":3279333632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34416,"name":"cephfs.smithi002.gglyyr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/4224459092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4224459092},{"type":"v1","addr":"172.21.15.2:6829","nonce":4224459092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44295,"name":"cephfs.smithi047.gxzkha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6825/1060893681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1060893681},{"type":"v1","addr":"172.21.15.47:6825","nonce":1060893681}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:05:05.572716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi047.nqvveh","rank":0,"incarnation":24,"state":"up:replay","state_seq":2,"addr":"172.21.15.47:6827/2007272492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2007272492},{"type":"v1","addr":"172.21.15.47:6827","nonce":2007272492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T23:08:25.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.334+0000 7fcfd47bc700 1 -- 172.21.15.2:0/2518518148 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fcfb806e680 msgr2=0x7fcfb8070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:25.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.334+0000 7fcfd47bc700 1 --2- 172.21.15.2:0/2518518148 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fcfb806e680 0x7fcfb8070b40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc005d90 tx=0x7fcfbc009670 comp rx=0 tx=0).stop 2024-09-13T23:08:25.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.334+0000 7fcfd47bc700 1 -- 172.21.15.2:0/2518518148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfcc101de0 msgr2=0x7fcfcc19c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:25.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.334+0000 7fcfd47bc700 1 --2- 172.21.15.2:0/2518518148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfcc101de0 0x7fcfcc19c6a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800b5c0 tx=0x7fcfc800be20 comp rx=0 tx=0).stop 2024-09-13T23:08:25.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.334+0000 7fcfd47bc700 1 -- 172.21.15.2:0/2518518148 shutdown_connections 2024-09-13T23:08:25.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.334+0000 7fcfd47bc700 1 --2- 172.21.15.2:0/2518518148 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fcfb806e680 0x7fcfb8070b40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:25.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.334+0000 7fcfd47bc700 1 --2- 172.21.15.2:0/2518518148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfcc101de0 0x7fcfcc19c6a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:25.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.334+0000 7fcfd47bc700 1 --2- 172.21.15.2:0/2518518148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfcc102700 0x7fcfcc19cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:25.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.334+0000 7fcfd47bc700 1 -- 172.21.15.2:0/2518518148 >> 172.21.15.2:0/2518518148 conn(0x7fcfcc0fb650 msgr2=0x7fcfcc105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:25.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.335+0000 7fcfd47bc700 1 -- 172.21.15.2:0/2518518148 shutdown_connections 2024-09-13T23:08:25.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:25.335+0000 7fcfd47bc700 1 -- 172.21.15.2:0/2518518148 wait complete. 2024-09-13T23:08:25.336 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-13T23:08:25.942 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:25 smithi002 ceph-mon[111294]: pgmap v286: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:25.942 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:25 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/2518518148' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T23:08:25.964 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-13T23:08:25.965 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-13T23:08:26.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:25 smithi047 ceph-mon[81243]: pgmap v286: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:26.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:25 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/2518518148' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T23:08:26.173 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:27.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.767+0000 7ff6e0220700 1 -- 172.21.15.2:0/2832701958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d80ffda0 msgr2=0x7ff6d8100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:27.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.767+0000 7ff6e0220700 1 --2- 172.21.15.2:0/2832701958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d80ffda0 0x7ff6d8100180 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009910 tx=0x7ff6d4009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:27.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.767+0000 7ff6e0220700 1 -- 172.21.15.2:0/2832701958 shutdown_connections 2024-09-13T23:08:27.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.767+0000 7ff6e0220700 1 --2- 172.21.15.2:0/2832701958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6d8100750 0x7ff6d81047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:27.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.767+0000 7ff6e0220700 1 --2- 172.21.15.2:0/2832701958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d80ffda0 0x7ff6d8100180 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:27.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.767+0000 7ff6e0220700 1 -- 172.21.15.2:0/2832701958 >> 172.21.15.2:0/2832701958 conn(0x7ff6d80fb650 msgr2=0x7ff6d80fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:27.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.768+0000 7ff6e0220700 1 -- 172.21.15.2:0/2832701958 shutdown_connections 2024-09-13T23:08:27.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.768+0000 7ff6e0220700 1 -- 172.21.15.2:0/2832701958 wait complete. 2024-09-13T23:08:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.768+0000 7ff6e0220700 1 Processor -- start 2024-09-13T23:08:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.768+0000 7ff6e0220700 1 -- start start 2024-09-13T23:08:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.768+0000 7ff6e0220700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d80ffda0 0x7ff6d8101840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.769+0000 7ff6e0220700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6d8100750 0x7ff6d8101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.769+0000 7ff6e0220700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d8102350 con 0x7ff6d80ffda0 2024-09-13T23:08:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.769+0000 7ff6e0220700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d81024c0 con 0x7ff6d8100750 2024-09-13T23:08:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.769+0000 7ff6ddfbc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d80ffda0 0x7ff6d8101840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.769+0000 7ff6ddfbc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d80ffda0 0x7ff6d8101840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34936/0 (socket says 172.21.15.2:34936) 2024-09-13T23:08:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.769+0000 7ff6ddfbc700 1 -- 172.21.15.2:0/1536015583 learned_addr learned my addr 172.21.15.2:0/1536015583 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.769+0000 7ff6dd7bb700 1 --2- 172.21.15.2:0/1536015583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6d8100750 0x7ff6d8101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:27.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.769+0000 7ff6ddfbc700 1 -- 172.21.15.2:0/1536015583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6d8100750 msgr2=0x7ff6d8101d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:27.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.769+0000 7ff6ddfbc700 1 --2- 172.21.15.2:0/1536015583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6d8100750 0x7ff6d8101d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:27.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.769+0000 7ff6ddfbc700 1 -- 172.21.15.2:0/1536015583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d40095f0 con 0x7ff6d80ffda0 2024-09-13T23:08:27.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.769+0000 7ff6dd7bb700 1 --2- 172.21.15.2:0/1536015583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6d8100750 0x7ff6d8101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:08:27.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.769+0000 7ff6ddfbc700 1 --2- 172.21.15.2:0/1536015583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d80ffda0 0x7ff6d8101840 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4006010 tx=0x7ff6d400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:27.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.769+0000 7ff6ceffd700 1 -- 172.21.15.2:0/1536015583 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6d401d070 con 0x7ff6d80ffda0 2024-09-13T23:08:27.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.770+0000 7ff6ceffd700 1 -- 172.21.15.2:0/1536015583 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6d4004fb0 con 0x7ff6d80ffda0 2024-09-13T23:08:27.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.770+0000 7ff6e0220700 1 -- 172.21.15.2:0/1536015583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d81a2bf0 con 0x7ff6d80ffda0 2024-09-13T23:08:27.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.770+0000 7ff6ceffd700 1 -- 172.21.15.2:0/1536015583 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6d4022ea0 con 0x7ff6d80ffda0 2024-09-13T23:08:27.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.770+0000 7ff6e0220700 1 -- 172.21.15.2:0/1536015583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d81a2fa0 con 0x7ff6d80ffda0 2024-09-13T23:08:27.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.771+0000 7ff6e0220700 1 -- 172.21.15.2:0/1536015583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d804f2e0 con 0x7ff6d80ffda0 2024-09-13T23:08:27.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.771+0000 7ff6ceffd700 1 -- 172.21.15.2:0/1536015583 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7ff6d4022470 con 0x7ff6d80ffda0 2024-09-13T23:08:27.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.772+0000 7ff6ceffd700 1 --2- 172.21.15.2:0/1536015583 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff6c406e680 0x7ff6c4070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:27.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.772+0000 7ff6ceffd700 1 -- 172.21.15.2:0/1536015583 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ff6d408fb10 con 0x7ff6d80ffda0 2024-09-13T23:08:27.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.772+0000 7ff6dd7bb700 1 --2- 172.21.15.2:0/1536015583 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff6c406e680 0x7ff6c4070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:27.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.772+0000 7ff6dd7bb700 1 --2- 172.21.15.2:0/1536015583 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff6c406e680 0x7ff6c4070b40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8103030 tx=0x7ff6c8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:27.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:27.776+0000 7ff6ceffd700 1 -- 172.21.15.2:0/1536015583 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff6d4058de0 con 0x7ff6d80ffda0 2024-09-13T23:08:28.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:28.034+0000 7ff6e0220700 1 -- 172.21.15.2:0/1536015583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7ff6d81a31f0 con 0x7ff6d80ffda0 2024-09-13T23:08:28.036 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:27 smithi002 ceph-mon[111294]: pgmap v287: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:08:28.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:28.035+0000 7ff6ceffd700 1 -- 172.21.15.2:0/1536015583 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v37) v1 ==== 107+0+5104 (secure 0 0 0) 0x7ff6d4027090 con 0x7ff6d80ffda0 2024-09-13T23:08:28.036 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:28.037 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-13T23:05:16:144155+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi002.auedll","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/3279333632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3279333632},{"type":"v1","addr":"172.21.15.2:6827","nonce":3279333632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34416,"name":"cephfs.smithi002.gglyyr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/4224459092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4224459092},{"type":"v1","addr":"172.21.15.2:6829","nonce":4224459092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44295,"name":"cephfs.smithi047.gxzkha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6825/1060893681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1060893681},{"type":"v1","addr":"172.21.15.47:6825","nonce":1060893681}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:05:15.200580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi047.nqvveh","rank":0,"incarnation":24,"state":"up:reconnect","state_seq":180,"addr":"172.21.15.47:6827/2007272492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2007272492},{"type":"v1","addr":"172.21.15.47:6827","nonce":2007272492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T23:08:28.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:28.037+0000 7ff6e0220700 1 -- 172.21.15.2:0/1536015583 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff6c406e680 msgr2=0x7ff6c4070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:28.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:28.037+0000 7ff6e0220700 1 --2- 172.21.15.2:0/1536015583 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff6c406e680 0x7ff6c4070b40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8103030 tx=0x7ff6c8008040 comp rx=0 tx=0).stop 2024-09-13T23:08:28.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:28.037+0000 7ff6e0220700 1 -- 172.21.15.2:0/1536015583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d80ffda0 msgr2=0x7ff6d8101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:28.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:28.037+0000 7ff6e0220700 1 --2- 172.21.15.2:0/1536015583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d80ffda0 0x7ff6d8101840 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4006010 tx=0x7ff6d400be20 comp rx=0 tx=0).stop 2024-09-13T23:08:28.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:28.037+0000 7ff6e0220700 1 -- 172.21.15.2:0/1536015583 shutdown_connections 2024-09-13T23:08:28.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:28.037+0000 7ff6e0220700 1 --2- 172.21.15.2:0/1536015583 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7ff6c406e680 0x7ff6c4070b40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:28.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:28.037+0000 7ff6e0220700 1 --2- 172.21.15.2:0/1536015583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6d80ffda0 0x7ff6d8101840 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:28.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:28.037+0000 7ff6e0220700 1 --2- 172.21.15.2:0/1536015583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6d8100750 0x7ff6d8101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:28.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:28.037+0000 7ff6e0220700 1 -- 172.21.15.2:0/1536015583 >> 172.21.15.2:0/1536015583 conn(0x7ff6d80fb650 msgr2=0x7ff6d8104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:28.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:28.038+0000 7ff6e0220700 1 -- 172.21.15.2:0/1536015583 shutdown_connections 2024-09-13T23:08:28.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:28.038+0000 7ff6e0220700 1 -- 172.21.15.2:0/1536015583 wait complete. 2024-09-13T23:08:28.039 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-13T23:08:28.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:27 smithi047 ceph-mon[81243]: pgmap v287: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:08:28.612 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-13T23:08:28.613 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-13T23:08:28.825 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:28.946 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:28 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/1536015583' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T23:08:29.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:28 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/1536015583' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T23:08:29.878 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:29 smithi002 ceph-mon[111294]: pgmap v288: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:30.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:29 smithi047 ceph-mon[81243]: pgmap v288: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:30.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.379+0000 7f2705189700 1 -- 172.21.15.2:0/1570990852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2700100750 msgr2=0x7f27001047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:30.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.379+0000 7f2705189700 1 --2- 172.21.15.2:0/1570990852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2700100750 0x7f27001047a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009910 tx=0x7f26f4009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:30.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.379+0000 7f2705189700 1 -- 172.21.15.2:0/1570990852 shutdown_connections 2024-09-13T23:08:30.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.379+0000 7f2705189700 1 --2- 172.21.15.2:0/1570990852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2700100750 0x7f27001047a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:30.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.379+0000 7f2705189700 1 --2- 172.21.15.2:0/1570990852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27000ffda0 0x7f2700100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:30.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.379+0000 7f2705189700 1 -- 172.21.15.2:0/1570990852 >> 172.21.15.2:0/1570990852 conn(0x7f27000fb650 msgr2=0x7f27000fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:30.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.379+0000 7f2705189700 1 -- 172.21.15.2:0/1570990852 shutdown_connections 2024-09-13T23:08:30.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.379+0000 7f2705189700 1 -- 172.21.15.2:0/1570990852 wait complete. 2024-09-13T23:08:30.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.380+0000 7f2705189700 1 Processor -- start 2024-09-13T23:08:30.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.380+0000 7f2705189700 1 -- start start 2024-09-13T23:08:30.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.380+0000 7f2705189700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27000ffda0 0x7f270019c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:30.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.380+0000 7f2705189700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2700100750 0x7f270019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:30.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.380+0000 7f2705189700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270019d1b0 con 0x7f27000ffda0 2024-09-13T23:08:30.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.380+0000 7f2705189700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27001966f0 con 0x7f2700100750 2024-09-13T23:08:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.380+0000 7f26fed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27000ffda0 0x7f270019c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.380+0000 7f26fed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27000ffda0 0x7f270019c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37972/0 (socket says 172.21.15.2:37972) 2024-09-13T23:08:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.380+0000 7f26fed9d700 1 -- 172.21.15.2:0/3781909134 learned_addr learned my addr 172.21.15.2:0/3781909134 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.380+0000 7f26fe59c700 1 --2- 172.21.15.2:0/3781909134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2700100750 0x7f270019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.381+0000 7f26fed9d700 1 -- 172.21.15.2:0/3781909134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2700100750 msgr2=0x7f270019cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.381+0000 7f26fed9d700 1 --2- 172.21.15.2:0/3781909134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2700100750 0x7f270019cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.381+0000 7f26fed9d700 1 -- 172.21.15.2:0/3781909134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f40095f0 con 0x7f27000ffda0 2024-09-13T23:08:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.381+0000 7f26fed9d700 1 --2- 172.21.15.2:0/3781909134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27000ffda0 0x7f270019c670 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f26f000cfd0 tx=0x7f26f000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.381+0000 7f26e7fff700 1 -- 172.21.15.2:0/3781909134 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26f000ad70 con 0x7f27000ffda0 2024-09-13T23:08:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.381+0000 7f26e7fff700 1 -- 172.21.15.2:0/3781909134 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f26f00128e0 con 0x7f27000ffda0 2024-09-13T23:08:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.381+0000 7f2705189700 1 -- 172.21.15.2:0/3781909134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27001969d0 con 0x7f27000ffda0 2024-09-13T23:08:30.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.381+0000 7f26e7fff700 1 -- 172.21.15.2:0/3781909134 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26f0011880 con 0x7f27000ffda0 2024-09-13T23:08:30.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.381+0000 7f2705189700 1 -- 172.21.15.2:0/3781909134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2700196f20 con 0x7f27000ffda0 2024-09-13T23:08:30.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.382+0000 7f2705189700 1 -- 172.21.15.2:0/3781909134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f270004f2e0 con 0x7f27000ffda0 2024-09-13T23:08:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.382+0000 7f26e7fff700 1 -- 172.21.15.2:0/3781909134 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f26f0011ab0 con 0x7f27000ffda0 2024-09-13T23:08:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.383+0000 7f26e7fff700 1 --2- 172.21.15.2:0/3781909134 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f26e806e680 0x7f26e8070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.383+0000 7f26e7fff700 1 -- 172.21.15.2:0/3781909134 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f26f008e7f0 con 0x7f27000ffda0 2024-09-13T23:08:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.383+0000 7f26fe59c700 1 --2- 172.21.15.2:0/3781909134 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f26e806e680 0x7f26e8070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:30.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.384+0000 7f26fe59c700 1 --2- 172.21.15.2:0/3781909134 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f26e806e680 0x7f26e8070b40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2700197b60 tx=0x7f26f401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:30.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.388+0000 7f26e7fff700 1 -- 172.21.15.2:0/3781909134 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f26f005b530 con 0x7f27000ffda0 2024-09-13T23:08:30.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.639+0000 7f2705189700 1 -- 172.21.15.2:0/3781909134 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f27001971a0 con 0x7f27000ffda0 2024-09-13T23:08:30.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.640+0000 7f26e7fff700 1 -- 172.21.15.2:0/3781909134 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v37) v1 ==== 107+0+5101 (secure 0 0 0) 0x7f26f005b0c0 con 0x7f27000ffda0 2024-09-13T23:08:30.641 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:30.641 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-09-13T23:05:17:145682+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi002.auedll","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/3279333632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3279333632},{"type":"v1","addr":"172.21.15.2:6827","nonce":3279333632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34416,"name":"cephfs.smithi002.gglyyr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/4224459092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4224459092},{"type":"v1","addr":"172.21.15.2:6829","nonce":4224459092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44295,"name":"cephfs.smithi047.gxzkha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6825/1060893681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1060893681},{"type":"v1","addr":"172.21.15.47:6825","nonce":1060893681}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:05:16.148409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi047.nqvveh","rank":0,"incarnation":24,"state":"up:rejoin","state_seq":181,"addr":"172.21.15.47:6827/2007272492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2007272492},{"type":"v1","addr":"172.21.15.47:6827","nonce":2007272492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T23:08:30.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.642+0000 7f2705189700 1 -- 172.21.15.2:0/3781909134 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f26e806e680 msgr2=0x7f26e8070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:30.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.642+0000 7f2705189700 1 --2- 172.21.15.2:0/3781909134 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f26e806e680 0x7f26e8070b40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2700197b60 tx=0x7f26f401a040 comp rx=0 tx=0).stop 2024-09-13T23:08:30.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.642+0000 7f2705189700 1 -- 172.21.15.2:0/3781909134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27000ffda0 msgr2=0x7f270019c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:30.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.642+0000 7f2705189700 1 --2- 172.21.15.2:0/3781909134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27000ffda0 0x7f270019c670 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f26f000cfd0 tx=0x7f26f000a340 comp rx=0 tx=0).stop 2024-09-13T23:08:30.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.642+0000 7f2705189700 1 -- 172.21.15.2:0/3781909134 shutdown_connections 2024-09-13T23:08:30.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.642+0000 7f2705189700 1 --2- 172.21.15.2:0/3781909134 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f26e806e680 0x7f26e8070b40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:30.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.642+0000 7f2705189700 1 --2- 172.21.15.2:0/3781909134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27000ffda0 0x7f270019c670 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:30.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.642+0000 7f2705189700 1 --2- 172.21.15.2:0/3781909134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2700100750 0x7f270019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:30.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.642+0000 7f2705189700 1 -- 172.21.15.2:0/3781909134 >> 172.21.15.2:0/3781909134 conn(0x7f27000fb650 msgr2=0x7f2700104250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:30.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.643+0000 7f2705189700 1 -- 172.21.15.2:0/3781909134 shutdown_connections 2024-09-13T23:08:30.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:30.643+0000 7f2705189700 1 -- 172.21.15.2:0/3781909134 wait complete. 2024-09-13T23:08:30.644 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-09-13T23:08:30.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:30 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/3781909134' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T23:08:31.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:30 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/3781909134' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T23:08:31.328 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-13T23:08:31.328 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-13T23:08:31.539 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:32.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:31 smithi002 ceph-mon[111294]: pgmap v289: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:32.064 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:31 smithi047 ceph-mon[81243]: pgmap v289: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:33.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.236+0000 7fa3647bf700 1 -- 172.21.15.2:0/728987267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35c100ea0 msgr2=0x7fa35c101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.236+0000 7fa3647bf700 1 --2- 172.21.15.2:0/728987267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35c100ea0 0x7fa35c101280 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa358009910 tx=0x7fa358009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:33.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.236+0000 7fa3647bf700 1 -- 172.21.15.2:0/728987267 shutdown_connections 2024-09-13T23:08:33.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.236+0000 7fa3647bf700 1 --2- 172.21.15.2:0/728987267 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa35c101850 0x7fa35c1058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.236+0000 7fa3647bf700 1 --2- 172.21.15.2:0/728987267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35c100ea0 0x7fa35c101280 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.236+0000 7fa3647bf700 1 -- 172.21.15.2:0/728987267 >> 172.21.15.2:0/728987267 conn(0x7fa35c0fc750 msgr2=0x7fa35c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:33.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.236+0000 7fa3647bf700 1 -- 172.21.15.2:0/728987267 shutdown_connections 2024-09-13T23:08:33.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.236+0000 7fa3647bf700 1 -- 172.21.15.2:0/728987267 wait complete. 2024-09-13T23:08:33.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.237+0000 7fa3647bf700 1 Processor -- start 2024-09-13T23:08:33.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.237+0000 7fa3647bf700 1 -- start start 2024-09-13T23:08:33.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.237+0000 7fa3647bf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35c100ea0 0x7fa35c19c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:33.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.237+0000 7fa3647bf700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa35c101850 0x7fa35c19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:33.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.237+0000 7fa3647bf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c19d2e0 con 0x7fa35c100ea0 2024-09-13T23:08:33.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.237+0000 7fa3647bf700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c196790 con 0x7fa35c101850 2024-09-13T23:08:33.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.237+0000 7fa36255b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35c100ea0 0x7fa35c19c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:33.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.237+0000 7fa36255b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35c100ea0 0x7fa35c19c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37982/0 (socket says 172.21.15.2:37982) 2024-09-13T23:08:33.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.237+0000 7fa36255b700 1 -- 172.21.15.2:0/2055493643 learned_addr learned my addr 172.21.15.2:0/2055493643 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:33.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.237+0000 7fa361d5a700 1 --2- 172.21.15.2:0/2055493643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa35c101850 0x7fa35c19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:33.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.238+0000 7fa36255b700 1 -- 172.21.15.2:0/2055493643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa35c101850 msgr2=0x7fa35c19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.238+0000 7fa36255b700 1 --2- 172.21.15.2:0/2055493643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa35c101850 0x7fa35c19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.238+0000 7fa36255b700 1 -- 172.21.15.2:0/2055493643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3580095f0 con 0x7fa35c100ea0 2024-09-13T23:08:33.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.238+0000 7fa36255b700 1 --2- 172.21.15.2:0/2055493643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35c100ea0 0x7fa35c19c710 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa358006010 tx=0x7fa35800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:33.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.238+0000 7fa3537fe700 1 -- 172.21.15.2:0/2055493643 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa35801d070 con 0x7fa35c100ea0 2024-09-13T23:08:33.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.238+0000 7fa3647bf700 1 -- 172.21.15.2:0/2055493643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35c196a10 con 0x7fa35c100ea0 2024-09-13T23:08:33.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.238+0000 7fa3537fe700 1 -- 172.21.15.2:0/2055493643 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa35800f460 con 0x7fa35c100ea0 2024-09-13T23:08:33.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.238+0000 7fa3537fe700 1 -- 172.21.15.2:0/2055493643 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa358017610 con 0x7fa35c100ea0 2024-09-13T23:08:33.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.238+0000 7fa3647bf700 1 -- 172.21.15.2:0/2055493643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35c196f00 con 0x7fa35c100ea0 2024-09-13T23:08:33.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.239+0000 7fa3647bf700 1 -- 172.21.15.2:0/2055493643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa35c109240 con 0x7fa35c100ea0 2024-09-13T23:08:33.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.240+0000 7fa3537fe700 1 -- 172.21.15.2:0/2055493643 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fa35800f5d0 con 0x7fa35c100ea0 2024-09-13T23:08:33.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.240+0000 7fa3537fe700 1 --2- 172.21.15.2:0/2055493643 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa34806e680 0x7fa348070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:33.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.240+0000 7fa3537fe700 1 -- 172.21.15.2:0/2055493643 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa35808fbe0 con 0x7fa35c100ea0 2024-09-13T23:08:33.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.240+0000 7fa361d5a700 1 --2- 172.21.15.2:0/2055493643 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa34806e680 0x7fa348070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:33.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.241+0000 7fa361d5a700 1 --2- 172.21.15.2:0/2055493643 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa34806e680 0x7fa348070b40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa35c197c00 tx=0x7fa34c00a300 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:33.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.245+0000 7fa3537fe700 1 -- 172.21.15.2:0/2055493643 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa35805c8b0 con 0x7fa35c100ea0 2024-09-13T23:08:33.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.500+0000 7fa3647bf700 1 -- 172.21.15.2:0/2055493643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fa35c04f2e0 con 0x7fa35c100ea0 2024-09-13T23:08:33.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.501+0000 7fa3537fe700 1 -- 172.21.15.2:0/2055493643 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v37) v1 ==== 107+0+5110 (secure 0 0 0) 0x7fa35805c440 con 0x7fa35c100ea0 2024-09-13T23:08:33.502 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:33.502 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-13T23:05:18:147247+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi002.auedll","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/3279333632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3279333632},{"type":"v1","addr":"172.21.15.2:6827","nonce":3279333632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34416,"name":"cephfs.smithi002.gglyyr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/4224459092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4224459092},{"type":"v1","addr":"172.21.15.2:6829","nonce":4224459092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44295,"name":"cephfs.smithi047.gxzkha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6825/1060893681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1060893681},{"type":"v1","addr":"172.21.15.47:6825","nonce":1060893681}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:05:18.147243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi047.nqvveh","rank":0,"incarnation":24,"state":"up:active","state_seq":182,"addr":"172.21.15.47:6827/2007272492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2007272492},{"type":"v1","addr":"172.21.15.47:6827","nonce":2007272492}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24277,"qdb_cluster":[24277]},"id":1}]} 2024-09-13T23:08:33.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.503+0000 7fa3647bf700 1 -- 172.21.15.2:0/2055493643 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa34806e680 msgr2=0x7fa348070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.503+0000 7fa3647bf700 1 --2- 172.21.15.2:0/2055493643 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa34806e680 0x7fa348070b40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa35c197c00 tx=0x7fa34c00a300 comp rx=0 tx=0).stop 2024-09-13T23:08:33.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.503+0000 7fa3647bf700 1 -- 172.21.15.2:0/2055493643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35c100ea0 msgr2=0x7fa35c19c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:33.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.503+0000 7fa3647bf700 1 --2- 172.21.15.2:0/2055493643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35c100ea0 0x7fa35c19c710 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa358006010 tx=0x7fa35800bd70 comp rx=0 tx=0).stop 2024-09-13T23:08:33.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.503+0000 7fa3647bf700 1 -- 172.21.15.2:0/2055493643 shutdown_connections 2024-09-13T23:08:33.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.503+0000 7fa3647bf700 1 --2- 172.21.15.2:0/2055493643 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fa34806e680 0x7fa348070b40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.503+0000 7fa3647bf700 1 --2- 172.21.15.2:0/2055493643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35c100ea0 0x7fa35c19c710 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.503+0000 7fa3647bf700 1 --2- 172.21.15.2:0/2055493643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa35c101850 0x7fa35c19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:33.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.503+0000 7fa3647bf700 1 -- 172.21.15.2:0/2055493643 >> 172.21.15.2:0/2055493643 conn(0x7fa35c0fc750 msgr2=0x7fa35c0fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:33.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.503+0000 7fa3647bf700 1 -- 172.21.15.2:0/2055493643 shutdown_connections 2024-09-13T23:08:33.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:33.503+0000 7fa3647bf700 1 -- 172.21.15.2:0/2055493643 wait complete. 2024-09-13T23:08:33.505 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-13T23:08:34.117 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:33 smithi002 ceph-mon[111294]: pgmap v290: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:34.117 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:33 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/2055493643' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T23:08:34.139 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-13T23:08:34.139 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-13T23:08:34.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:33 smithi047 ceph-mon[81243]: pgmap v290: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:34.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:33 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/2055493643' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T23:08:34.347 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.034+0000 7f2e9658e700 1 -- 172.21.15.2:0/2367332037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e900ff990 msgr2=0x7f2e900ffd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.034+0000 7f2e9658e700 1 --2- 172.21.15.2:0/2367332037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e900ff990 0x7f2e900ffd70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2e80009910 tx=0x7f2e80009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.034+0000 7f2e9658e700 1 -- 172.21.15.2:0/2367332037 shutdown_connections 2024-09-13T23:08:36.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.034+0000 7f2e9658e700 1 --2- 172.21.15.2:0/2367332037 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e90100340 0x7f2e9010d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:36.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.034+0000 7f2e9658e700 1 --2- 172.21.15.2:0/2367332037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e900ff990 0x7f2e900ffd70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:36.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.034+0000 7f2e9658e700 1 -- 172.21.15.2:0/2367332037 >> 172.21.15.2:0/2367332037 conn(0x7f2e900fb650 msgr2=0x7f2e900fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:36.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.034+0000 7f2e9658e700 1 -- 172.21.15.2:0/2367332037 shutdown_connections 2024-09-13T23:08:36.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.034+0000 7f2e9658e700 1 -- 172.21.15.2:0/2367332037 wait complete. 2024-09-13T23:08:36.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.035+0000 7f2e9658e700 1 Processor -- start 2024-09-13T23:08:36.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.035+0000 7f2e9658e700 1 -- start start 2024-09-13T23:08:36.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.035+0000 7f2e9658e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e900ff990 0x7f2e9019e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:36.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.035+0000 7f2e9658e700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e90100340 0x7f2e9019eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:36.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.035+0000 7f2e9658e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9019f430 con 0x7f2e900ff990 2024-09-13T23:08:36.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.035+0000 7f2e9658e700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e901988e0 con 0x7f2e90100340 2024-09-13T23:08:36.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.036+0000 7f2e8ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e900ff990 0x7f2e9019e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:36.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.036+0000 7f2e8ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e900ff990 0x7f2e9019e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38002/0 (socket says 172.21.15.2:38002) 2024-09-13T23:08:36.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.036+0000 7f2e8ffff700 1 -- 172.21.15.2:0/533329234 learned_addr learned my addr 172.21.15.2:0/533329234 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:36.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.036+0000 7f2e87fff700 1 --2- 172.21.15.2:0/533329234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e90100340 0x7f2e9019eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:36.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.036+0000 7f2e8ffff700 1 -- 172.21.15.2:0/533329234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e90100340 msgr2=0x7f2e9019eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:36.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.036+0000 7f2e8ffff700 1 --2- 172.21.15.2:0/533329234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e90100340 0x7f2e9019eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:36.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.036+0000 7f2e8ffff700 1 -- 172.21.15.2:0/533329234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e800095f0 con 0x7f2e900ff990 2024-09-13T23:08:36.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.036+0000 7f2e87fff700 1 --2- 172.21.15.2:0/533329234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e90100340 0x7f2e9019eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T23:08:36.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.036+0000 7f2e8ffff700 1 --2- 172.21.15.2:0/533329234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e900ff990 0x7f2e9019e860 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2e800092e0 tx=0x7f2e800056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:36.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.036+0000 7f2e8dffb700 1 -- 172.21.15.2:0/533329234 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e8001d070 con 0x7f2e900ff990 2024-09-13T23:08:36.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.036+0000 7f2e8dffb700 1 -- 172.21.15.2:0/533329234 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e8000f460 con 0x7f2e900ff990 2024-09-13T23:08:36.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.036+0000 7f2e9658e700 1 -- 172.21.15.2:0/533329234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e90198b60 con 0x7f2e900ff990 2024-09-13T23:08:36.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.036+0000 7f2e8dffb700 1 -- 172.21.15.2:0/533329234 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e80021640 con 0x7f2e900ff990 2024-09-13T23:08:36.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.036+0000 7f2e9658e700 1 -- 172.21.15.2:0/533329234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e901990b0 con 0x7f2e900ff990 2024-09-13T23:08:36.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.037+0000 7f2e9658e700 1 -- 172.21.15.2:0/533329234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9010a770 con 0x7f2e900ff990 2024-09-13T23:08:36.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.038+0000 7f2e8dffb700 1 -- 172.21.15.2:0/533329234 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f2e8000f5d0 con 0x7f2e900ff990 2024-09-13T23:08:36.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.038+0000 7f2e8dffb700 1 --2- 172.21.15.2:0/533329234 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2e7c06e680 0x7f2e7c070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:36.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.038+0000 7f2e8dffb700 1 -- 172.21.15.2:0/533329234 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f2e8008f920 con 0x7f2e900ff990 2024-09-13T23:08:36.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.038+0000 7f2e87fff700 1 --2- 172.21.15.2:0/533329234 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2e7c06e680 0x7f2e7c070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:36.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.039+0000 7f2e87fff700 1 --2- 172.21.15.2:0/533329234 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2e7c06e680 0x7f2e7c070b40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2e78005950 tx=0x7f2e780058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:36.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.043+0000 7f2e8dffb700 1 -- 172.21.15.2:0/533329234 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2e8005c5f0 con 0x7f2e900ff990 2024-09-13T23:08:36.044 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:35 smithi002 ceph-mon[111294]: pgmap v291: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:36.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:35 smithi047 ceph-mon[81243]: pgmap v291: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:36.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.301+0000 7f2e9658e700 1 -- 172.21.15.2:0/533329234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f2e90199df0 con 0x7f2e900ff990 2024-09-13T23:08:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.302+0000 7f2e8dffb700 1 -- 172.21.15.2:0/533329234 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v37) v1 ==== 107+0+4309 (secure 0 0 0) 0x7f2e8005c180 con 0x7f2e900ff990 2024-09-13T23:08:36.303 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:36.303 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":29,"btime":"2024-09-13T23:05:27:275310+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi002.auedll","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/3279333632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3279333632},{"type":"v1","addr":"172.21.15.2:6827","nonce":3279333632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34416,"name":"cephfs.smithi002.gglyyr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/4224459092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4224459092},{"type":"v1","addr":"172.21.15.2:6829","nonce":4224459092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44295,"name":"cephfs.smithi047.gxzkha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6825/1060893681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1060893681},{"type":"v1","addr":"172.21.15.47:6825","nonce":1060893681}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:05:27.275307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T23:08:36.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.304+0000 7f2e9658e700 1 -- 172.21.15.2:0/533329234 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2e7c06e680 msgr2=0x7f2e7c070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:36.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.304+0000 7f2e9658e700 1 --2- 172.21.15.2:0/533329234 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2e7c06e680 0x7f2e7c070b40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2e78005950 tx=0x7f2e780058e0 comp rx=0 tx=0).stop 2024-09-13T23:08:36.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.304+0000 7f2e9658e700 1 -- 172.21.15.2:0/533329234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e900ff990 msgr2=0x7f2e9019e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:36.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.304+0000 7f2e9658e700 1 --2- 172.21.15.2:0/533329234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e900ff990 0x7f2e9019e860 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2e800092e0 tx=0x7f2e800056a0 comp rx=0 tx=0).stop 2024-09-13T23:08:36.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.304+0000 7f2e9658e700 1 -- 172.21.15.2:0/533329234 shutdown_connections 2024-09-13T23:08:36.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.304+0000 7f2e9658e700 1 --2- 172.21.15.2:0/533329234 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2e7c06e680 0x7f2e7c070b40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:36.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.304+0000 7f2e9658e700 1 --2- 172.21.15.2:0/533329234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e900ff990 0x7f2e9019e860 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:36.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.304+0000 7f2e9658e700 1 --2- 172.21.15.2:0/533329234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e90100340 0x7f2e9019eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:36.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.304+0000 7f2e9658e700 1 -- 172.21.15.2:0/533329234 >> 172.21.15.2:0/533329234 conn(0x7f2e900fb650 msgr2=0x7f2e900fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:36.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.304+0000 7f2e9658e700 1 -- 172.21.15.2:0/533329234 shutdown_connections 2024-09-13T23:08:36.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:36.304+0000 7f2e9658e700 1 -- 172.21.15.2:0/533329234 wait complete. 2024-09-13T23:08:36.306 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 29 2024-09-13T23:08:36.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:36 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/533329234' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T23:08:36.930 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-13T23:08:36.930 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-13T23:08:37.140 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:37.140 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:36 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/533329234' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T23:08:37.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:37 smithi002 ceph-mon[111294]: pgmap v292: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:08:38.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:37 smithi047 ceph-mon[81243]: pgmap v292: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:08:38.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.814+0000 7f93c979a700 1 -- 172.21.15.2:0/2145343081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c4102720 msgr2=0x7f93c410ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:38.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.814+0000 7f93c979a700 1 --2- 172.21.15.2:0/2145343081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c4102720 0x7f93c410ac10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f93b8009910 tx=0x7f93b8009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:38.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.814+0000 7f93c979a700 1 -- 172.21.15.2:0/2145343081 shutdown_connections 2024-09-13T23:08:38.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.814+0000 7f93c979a700 1 --2- 172.21.15.2:0/2145343081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c4102720 0x7f93c410ac10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:38.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.814+0000 7f93c979a700 1 --2- 172.21.15.2:0/2145343081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c4101e00 0x7f93c41021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:38.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.814+0000 7f93c979a700 1 -- 172.21.15.2:0/2145343081 >> 172.21.15.2:0/2145343081 conn(0x7f93c40fb650 msgr2=0x7f93c40fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:38.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.814+0000 7f93c979a700 1 -- 172.21.15.2:0/2145343081 shutdown_connections 2024-09-13T23:08:38.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.814+0000 7f93c979a700 1 -- 172.21.15.2:0/2145343081 wait complete. 2024-09-13T23:08:38.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.814+0000 7f93c979a700 1 Processor -- start 2024-09-13T23:08:38.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.815+0000 7f93c979a700 1 -- start start 2024-09-13T23:08:38.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.815+0000 7f93c979a700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c4101e00 0x7f93c419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:38.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.815+0000 7f93c979a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c4102720 0x7f93c419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:38.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.815+0000 7f93c979a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c419d1d0 con 0x7f93c4102720 2024-09-13T23:08:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.815+0000 7f93c979a700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c4196710 con 0x7f93c4101e00 2024-09-13T23:08:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.815+0000 7f93c27fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c4102720 0x7f93c419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.815+0000 7f93c27fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c4102720 0x7f93c419cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38020/0 (socket says 172.21.15.2:38020) 2024-09-13T23:08:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.815+0000 7f93c27fc700 1 -- 172.21.15.2:0/1441121099 learned_addr learned my addr 172.21.15.2:0/1441121099 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.815+0000 7f93c2ffd700 1 --2- 172.21.15.2:0/1441121099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c4101e00 0x7f93c419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.815+0000 7f93c27fc700 1 -- 172.21.15.2:0/1441121099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c4101e00 msgr2=0x7f93c419c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.815+0000 7f93c27fc700 1 --2- 172.21.15.2:0/1441121099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c4101e00 0x7f93c419c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.815+0000 7f93c27fc700 1 -- 172.21.15.2:0/1441121099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b80095f0 con 0x7f93c4102720 2024-09-13T23:08:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.816+0000 7f93c27fc700 1 --2- 172.21.15.2:0/1441121099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c4102720 0x7f93c419cbd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f93b800bd70 tx=0x7f93b800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.816+0000 7f93abfff700 1 -- 172.21.15.2:0/1441121099 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93b801d070 con 0x7f93c4102720 2024-09-13T23:08:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.816+0000 7f93abfff700 1 -- 172.21.15.2:0/1441121099 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93b800f460 con 0x7f93c4102720 2024-09-13T23:08:38.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.816+0000 7f93c979a700 1 -- 172.21.15.2:0/1441121099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c4196990 con 0x7f93c4102720 2024-09-13T23:08:38.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.816+0000 7f93abfff700 1 -- 172.21.15.2:0/1441121099 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93b8017630 con 0x7f93c4102720 2024-09-13T23:08:38.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.816+0000 7f93c979a700 1 -- 172.21.15.2:0/1441121099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c4196e80 con 0x7f93c4102720 2024-09-13T23:08:38.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.817+0000 7f93c979a700 1 -- 172.21.15.2:0/1441121099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c4108310 con 0x7f93c4102720 2024-09-13T23:08:38.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.818+0000 7f93abfff700 1 -- 172.21.15.2:0/1441121099 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f93b800fab0 con 0x7f93c4102720 2024-09-13T23:08:38.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.818+0000 7f93abfff700 1 --2- 172.21.15.2:0/1441121099 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f93ac06e680 0x7f93ac070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:38.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.818+0000 7f93abfff700 1 -- 172.21.15.2:0/1441121099 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f93b808fbb0 con 0x7f93c4102720 2024-09-13T23:08:38.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.818+0000 7f93c2ffd700 1 --2- 172.21.15.2:0/1441121099 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f93ac06e680 0x7f93ac070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:38.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.819+0000 7f93c2ffd700 1 --2- 172.21.15.2:0/1441121099 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f93ac06e680 0x7f93ac070b40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f93b4005ea0 tx=0x7f93b4005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:38.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:38.823+0000 7f93abfff700 1 -- 172.21.15.2:0/1441121099 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f93b8096080 con 0x7f93c4102720 2024-09-13T23:08:39.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:39.077+0000 7f93c979a700 1 -- 172.21.15.2:0/1441121099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f93c4197c50 con 0x7f93c4102720 2024-09-13T23:08:39.078 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:08:39.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:39.078+0000 7f93abfff700 1 -- 172.21.15.2:0/1441121099 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v37) v1 ==== 107+0+4388 (secure 0 0 0) 0x7f93b805c880 con 0x7f93c4102720 2024-09-13T23:08:39.079 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:39.079 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":30,"btime":"2024-09-13T23:05:27:281178+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi002.gglyyr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/4224459092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4224459092},{"type":"v1","addr":"172.21.15.2:6829","nonce":4224459092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44295,"name":"cephfs.smithi047.gxzkha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6825/1060893681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1060893681},{"type":"v1","addr":"172.21.15.47:6825","nonce":1060893681}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:05:27.281159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi002.auedll","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.2:6827/3279333632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3279333632},{"type":"v1","addr":"172.21.15.2:6827","nonce":3279333632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T23:08:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:39.080+0000 7f93c979a700 1 -- 172.21.15.2:0/1441121099 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f93ac06e680 msgr2=0x7f93ac070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:39.080+0000 7f93c979a700 1 --2- 172.21.15.2:0/1441121099 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f93ac06e680 0x7f93ac070b40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f93b4005ea0 tx=0x7f93b4005e30 comp rx=0 tx=0).stop 2024-09-13T23:08:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:39.080+0000 7f93c979a700 1 -- 172.21.15.2:0/1441121099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c4102720 msgr2=0x7f93c419cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:39.080+0000 7f93c979a700 1 --2- 172.21.15.2:0/1441121099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c4102720 0x7f93c419cbd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f93b800bd70 tx=0x7f93b800be50 comp rx=0 tx=0).stop 2024-09-13T23:08:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:39.080+0000 7f93c979a700 1 -- 172.21.15.2:0/1441121099 shutdown_connections 2024-09-13T23:08:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:39.080+0000 7f93c979a700 1 --2- 172.21.15.2:0/1441121099 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f93ac06e680 0x7f93ac070b40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:39.080+0000 7f93c979a700 1 --2- 172.21.15.2:0/1441121099 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93c4101e00 0x7f93c419c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:39.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:39.080+0000 7f93c979a700 1 --2- 172.21.15.2:0/1441121099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93c4102720 0x7f93c419cbd0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:39.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:39.080+0000 7f93c979a700 1 -- 172.21.15.2:0/1441121099 >> 172.21.15.2:0/1441121099 conn(0x7f93c40fb650 msgr2=0x7f93c4105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:39.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:39.080+0000 7f93c979a700 1 -- 172.21.15.2:0/1441121099 shutdown_connections 2024-09-13T23:08:39.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:39.080+0000 7f93c979a700 1 -- 172.21.15.2:0/1441121099 wait complete. 2024-09-13T23:08:39.082 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 30 2024-09-13T23:08:39.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:08:39.725 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-13T23:08:39.726 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-13T23:08:39.944 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:39.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:39 smithi002 ceph-mon[111294]: pgmap v293: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:39.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:39 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/1441121099' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T23:08:40.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:39 smithi047 ceph-mon[81243]: pgmap v293: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:40.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:39 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/1441121099' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T23:08:41.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.595+0000 7f68b69ae700 1 -- 172.21.15.2:0/3499964510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b0101e00 msgr2=0x7f68b01021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:41.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.595+0000 7f68b69ae700 1 --2- 172.21.15.2:0/3499964510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b0101e00 0x7f68b01021e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009910 tx=0x7f68a0009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:41.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.595+0000 7f68b69ae700 1 -- 172.21.15.2:0/3499964510 shutdown_connections 2024-09-13T23:08:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.595+0000 7f68b69ae700 1 --2- 172.21.15.2:0/3499964510 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68b0102720 0x7f68b010ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.595+0000 7f68b69ae700 1 --2- 172.21.15.2:0/3499964510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b0101e00 0x7f68b01021e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.595+0000 7f68b69ae700 1 -- 172.21.15.2:0/3499964510 >> 172.21.15.2:0/3499964510 conn(0x7f68b00fb650 msgr2=0x7f68b00fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.595+0000 7f68b69ae700 1 -- 172.21.15.2:0/3499964510 shutdown_connections 2024-09-13T23:08:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.595+0000 7f68b69ae700 1 -- 172.21.15.2:0/3499964510 wait complete. 2024-09-13T23:08:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.595+0000 7f68b69ae700 1 Processor -- start 2024-09-13T23:08:41.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.596+0000 7f68b69ae700 1 -- start start 2024-09-13T23:08:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.596+0000 7f68b69ae700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68b0101e00 0x7f68b01969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.596+0000 7f68b69ae700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b0102720 0x7f68b0196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.596+0000 7f68b69ae700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b01975b0 con 0x7f68b0102720 2024-09-13T23:08:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.596+0000 7f68b69ae700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b019b370 con 0x7f68b0101e00 2024-09-13T23:08:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.596+0000 7f68af7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b0102720 0x7f68b0196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.596+0000 7f68af7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b0102720 0x7f68b0196f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57536/0 (socket says 172.21.15.2:57536) 2024-09-13T23:08:41.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.596+0000 7f68af7fe700 1 -- 172.21.15.2:0/4210129542 learned_addr learned my addr 172.21.15.2:0/4210129542 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.596+0000 7f68affff700 1 --2- 172.21.15.2:0/4210129542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68b0101e00 0x7f68b01969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.596+0000 7f68af7fe700 1 -- 172.21.15.2:0/4210129542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68b0101e00 msgr2=0x7f68b01969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.596+0000 7f68af7fe700 1 --2- 172.21.15.2:0/4210129542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68b0101e00 0x7f68b01969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.596+0000 7f68af7fe700 1 -- 172.21.15.2:0/4210129542 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a00095f0 con 0x7f68b0102720 2024-09-13T23:08:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.596+0000 7f68affff700 1 --2- 172.21.15.2:0/4210129542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68b0101e00 0x7f68b01969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:08:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.597+0000 7f68af7fe700 1 --2- 172.21.15.2:0/4210129542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b0102720 0x7f68b0196f20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f68a400b4d0 tx=0x7f68a400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.597+0000 7f68ad7fa700 1 -- 172.21.15.2:0/4210129542 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68a4011800 con 0x7f68b0102720 2024-09-13T23:08:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.597+0000 7f68ad7fa700 1 -- 172.21.15.2:0/4210129542 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f68a4011e20 con 0x7f68b0102720 2024-09-13T23:08:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.597+0000 7f68b69ae700 1 -- 172.21.15.2:0/4210129542 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b019b650 con 0x7f68b0102720 2024-09-13T23:08:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.597+0000 7f68ad7fa700 1 -- 172.21.15.2:0/4210129542 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68a400f2e0 con 0x7f68b0102720 2024-09-13T23:08:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.597+0000 7f68b69ae700 1 -- 172.21.15.2:0/4210129542 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b019bba0 con 0x7f68b0102720 2024-09-13T23:08:41.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.598+0000 7f68b69ae700 1 -- 172.21.15.2:0/4210129542 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b0108310 con 0x7f68b0102720 2024-09-13T23:08:41.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.598+0000 7f68ad7fa700 1 -- 172.21.15.2:0/4210129542 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f68a4010380 con 0x7f68b0102720 2024-09-13T23:08:41.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.599+0000 7f68ad7fa700 1 --2- 172.21.15.2:0/4210129542 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f689806e680 0x7f6898070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:41.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.599+0000 7f68ad7fa700 1 -- 172.21.15.2:0/4210129542 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f68a408e1b0 con 0x7f68b0102720 2024-09-13T23:08:41.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.599+0000 7f68affff700 1 --2- 172.21.15.2:0/4210129542 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f689806e680 0x7f6898070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:41.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.599+0000 7f68affff700 1 --2- 172.21.15.2:0/4210129542 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f689806e680 0x7f6898070b40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f68a0006010 tx=0x7f68a000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:41.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.603+0000 7f68ad7fa700 1 -- 172.21.15.2:0/4210129542 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f68a405ae80 con 0x7f68b0102720 2024-09-13T23:08:41.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.859+0000 7f68b69ae700 1 -- 172.21.15.2:0/4210129542 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f68b0197cf0 con 0x7f68b0102720 2024-09-13T23:08:41.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.860+0000 7f68ad7fa700 1 -- 172.21.15.2:0/4210129542 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v37) v1 ==== 107+0+5239 (secure 0 0 0) 0x7f68a405aa10 con 0x7f68b0102720 2024-09-13T23:08:41.861 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:41.861 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":31,"btime":"2024-09-13T23:05:35:487655+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi002.gglyyr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/4224459092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4224459092},{"type":"v1","addr":"172.21.15.2:6829","nonce":4224459092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44295,"name":"cephfs.smithi047.gxzkha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6825/1060893681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1060893681},{"type":"v1","addr":"172.21.15.47:6825","nonce":1060893681}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44325,"name":"cephfs.smithi047.nqvveh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6827/2798869340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2798869340},{"type":"v1","addr":"172.21.15.47:6827","nonce":2798869340}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:05:35.308434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi002.auedll","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":16,"addr":"172.21.15.2:6827/3279333632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3279333632},{"type":"v1","addr":"172.21.15.2:6827","nonce":3279333632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T23:08:41.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.862+0000 7f68b69ae700 1 -- 172.21.15.2:0/4210129542 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f689806e680 msgr2=0x7f6898070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:41.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.862+0000 7f68b69ae700 1 --2- 172.21.15.2:0/4210129542 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f689806e680 0x7f6898070b40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f68a0006010 tx=0x7f68a000b540 comp rx=0 tx=0).stop 2024-09-13T23:08:41.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.862+0000 7f68b69ae700 1 -- 172.21.15.2:0/4210129542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b0102720 msgr2=0x7f68b0196f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:41.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.862+0000 7f68b69ae700 1 --2- 172.21.15.2:0/4210129542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b0102720 0x7f68b0196f20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f68a400b4d0 tx=0x7f68a400b890 comp rx=0 tx=0).stop 2024-09-13T23:08:41.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.863+0000 7f68b69ae700 1 -- 172.21.15.2:0/4210129542 shutdown_connections 2024-09-13T23:08:41.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.863+0000 7f68b69ae700 1 --2- 172.21.15.2:0/4210129542 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f689806e680 0x7f6898070b40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:41.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.863+0000 7f68b69ae700 1 --2- 172.21.15.2:0/4210129542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68b0101e00 0x7f68b01969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:41.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.863+0000 7f68b69ae700 1 --2- 172.21.15.2:0/4210129542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b0102720 0x7f68b0196f20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:41.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.863+0000 7f68b69ae700 1 -- 172.21.15.2:0/4210129542 >> 172.21.15.2:0/4210129542 conn(0x7f68b00fb650 msgr2=0x7f68b0105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:41.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.863+0000 7f68b69ae700 1 -- 172.21.15.2:0/4210129542 shutdown_connections 2024-09-13T23:08:41.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:41.863+0000 7f68b69ae700 1 -- 172.21.15.2:0/4210129542 wait complete. 2024-09-13T23:08:41.865 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 31 2024-09-13T23:08:42.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:41 smithi047 ceph-mon[81243]: pgmap v294: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:42.211 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:41 smithi002 ceph-mon[111294]: pgmap v294: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:42.535 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-13T23:08:42.536 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-13T23:08:42.747 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:43.131 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:42 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/4210129542' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T23:08:43.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:42 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/4210129542' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T23:08:43.851 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:43 smithi002 ceph-mon[111294]: pgmap v295: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:44.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:43 smithi047 ceph-mon[81243]: pgmap v295: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:44.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.403+0000 7f4a8996f700 1 -- 172.21.15.2:0/1738753364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a84102720 msgr2=0x7f4a8410ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:44.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.403+0000 7f4a8996f700 1 --2- 172.21.15.2:0/1738753364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a84102720 0x7f4a8410ac10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4a78009910 tx=0x7f4a78009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:44.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.403+0000 7f4a8996f700 1 -- 172.21.15.2:0/1738753364 shutdown_connections 2024-09-13T23:08:44.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.403+0000 7f4a8996f700 1 --2- 172.21.15.2:0/1738753364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a84102720 0x7f4a8410ac10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:44.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.403+0000 7f4a8996f700 1 --2- 172.21.15.2:0/1738753364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a84101e00 0x7f4a841021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:44.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.403+0000 7f4a8996f700 1 -- 172.21.15.2:0/1738753364 >> 172.21.15.2:0/1738753364 conn(0x7f4a840fb650 msgr2=0x7f4a840fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:44.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.403+0000 7f4a8996f700 1 -- 172.21.15.2:0/1738753364 shutdown_connections 2024-09-13T23:08:44.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.403+0000 7f4a8996f700 1 -- 172.21.15.2:0/1738753364 wait complete. 2024-09-13T23:08:44.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.403+0000 7f4a8996f700 1 Processor -- start 2024-09-13T23:08:44.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.404+0000 7f4a8996f700 1 -- start start 2024-09-13T23:08:44.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.404+0000 7f4a8996f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a84101e00 0x7f4a8419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:44.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.404+0000 7f4a8996f700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a84102720 0x7f4a8419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:44.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.404+0000 7f4a8996f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8419d260 con 0x7f4a84101e00 2024-09-13T23:08:44.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.404+0000 7f4a8996f700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a84196710 con 0x7f4a84102720 2024-09-13T23:08:44.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.404+0000 7f4a82ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a84101e00 0x7f4a8419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:44.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.404+0000 7f4a82ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a84101e00 0x7f4a8419c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57552/0 (socket says 172.21.15.2:57552) 2024-09-13T23:08:44.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.404+0000 7f4a82ffd700 1 -- 172.21.15.2:0/573087511 learned_addr learned my addr 172.21.15.2:0/573087511 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:44.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.404+0000 7f4a827fc700 1 --2- 172.21.15.2:0/573087511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a84102720 0x7f4a8419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:44.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.404+0000 7f4a82ffd700 1 -- 172.21.15.2:0/573087511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a84102720 msgr2=0x7f4a8419cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:44.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.404+0000 7f4a82ffd700 1 --2- 172.21.15.2:0/573087511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a84102720 0x7f4a8419cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:44.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.404+0000 7f4a82ffd700 1 -- 172.21.15.2:0/573087511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a780095f0 con 0x7f4a84101e00 2024-09-13T23:08:44.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.404+0000 7f4a82ffd700 1 --2- 172.21.15.2:0/573087511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a84101e00 0x7f4a8419c690 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4a7400c8a0 tx=0x7f4a7400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:44.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.405+0000 7f4a8896d700 1 -- 172.21.15.2:0/573087511 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a7400cea0 con 0x7f4a84101e00 2024-09-13T23:08:44.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.405+0000 7f4a8896d700 1 -- 172.21.15.2:0/573087511 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a74004830 con 0x7f4a84101e00 2024-09-13T23:08:44.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.405+0000 7f4a8996f700 1 -- 172.21.15.2:0/573087511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a841969f0 con 0x7f4a84101e00 2024-09-13T23:08:44.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.405+0000 7f4a8896d700 1 -- 172.21.15.2:0/573087511 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a740055b0 con 0x7f4a84101e00 2024-09-13T23:08:44.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.405+0000 7f4a8996f700 1 -- 172.21.15.2:0/573087511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a84196f40 con 0x7f4a84101e00 2024-09-13T23:08:44.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.406+0000 7f4a8996f700 1 -- 172.21.15.2:0/573087511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a84108310 con 0x7f4a84101e00 2024-09-13T23:08:44.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.406+0000 7f4a8896d700 1 -- 172.21.15.2:0/573087511 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f4a740049a0 con 0x7f4a84101e00 2024-09-13T23:08:44.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.407+0000 7f4a8896d700 1 --2- 172.21.15.2:0/573087511 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4a6c06e680 0x7f4a6c070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:44.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.407+0000 7f4a8896d700 1 -- 172.21.15.2:0/573087511 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f4a7408e320 con 0x7f4a84101e00 2024-09-13T23:08:44.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.407+0000 7f4a827fc700 1 --2- 172.21.15.2:0/573087511 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4a6c06e680 0x7f4a6c070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:44.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.407+0000 7f4a827fc700 1 --2- 172.21.15.2:0/573087511 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4a6c06e680 0x7f4a6c070b40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4a78006010 tx=0x7f4a78005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:44.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.411+0000 7f4a8896d700 1 -- 172.21.15.2:0/573087511 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4a7405aff0 con 0x7f4a84101e00 2024-09-13T23:08:44.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.668+0000 7f4a8996f700 1 -- 172.21.15.2:0/573087511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f4a8404f2e0 con 0x7f4a84101e00 2024-09-13T23:08:44.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.669+0000 7f4a8896d700 1 -- 172.21.15.2:0/573087511 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v37) v1 ==== 107+0+5236 (secure 0 0 0) 0x7f4a74004c50 con 0x7f4a84101e00 2024-09-13T23:08:44.670 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:44.670 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"btime":"2024-09-13T23:05:36:488932+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi002.gglyyr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/4224459092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4224459092},{"type":"v1","addr":"172.21.15.2:6829","nonce":4224459092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44295,"name":"cephfs.smithi047.gxzkha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6825/1060893681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1060893681},{"type":"v1","addr":"172.21.15.47:6825","nonce":1060893681}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44325,"name":"cephfs.smithi047.nqvveh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6827/2798869340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2798869340},{"type":"v1","addr":"172.21.15.47:6827","nonce":2798869340}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:05:35.491761+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi002.auedll","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":17,"addr":"172.21.15.2:6827/3279333632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3279333632},{"type":"v1","addr":"172.21.15.2:6827","nonce":3279333632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T23:08:44.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.671+0000 7f4a8996f700 1 -- 172.21.15.2:0/573087511 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4a6c06e680 msgr2=0x7f4a6c070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:44.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.671+0000 7f4a8996f700 1 --2- 172.21.15.2:0/573087511 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4a6c06e680 0x7f4a6c070b40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4a78006010 tx=0x7f4a78005960 comp rx=0 tx=0).stop 2024-09-13T23:08:44.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.671+0000 7f4a8996f700 1 -- 172.21.15.2:0/573087511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a84101e00 msgr2=0x7f4a8419c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:44.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.671+0000 7f4a8996f700 1 --2- 172.21.15.2:0/573087511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a84101e00 0x7f4a8419c690 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4a7400c8a0 tx=0x7f4a7400cc60 comp rx=0 tx=0).stop 2024-09-13T23:08:44.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.671+0000 7f4a8996f700 1 -- 172.21.15.2:0/573087511 shutdown_connections 2024-09-13T23:08:44.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.671+0000 7f4a8996f700 1 --2- 172.21.15.2:0/573087511 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4a6c06e680 0x7f4a6c070b40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:44.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.671+0000 7f4a8996f700 1 --2- 172.21.15.2:0/573087511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a84101e00 0x7f4a8419c690 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:44.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.671+0000 7f4a8996f700 1 --2- 172.21.15.2:0/573087511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4a84102720 0x7f4a8419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:44.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.671+0000 7f4a8996f700 1 -- 172.21.15.2:0/573087511 >> 172.21.15.2:0/573087511 conn(0x7f4a840fb650 msgr2=0x7f4a84105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:44.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.671+0000 7f4a8996f700 1 -- 172.21.15.2:0/573087511 shutdown_connections 2024-09-13T23:08:44.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:44.671+0000 7f4a8996f700 1 -- 172.21.15.2:0/573087511 wait complete. 2024-09-13T23:08:44.673 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 32 2024-09-13T23:08:44.992 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:44 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/573087511' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T23:08:45.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:44 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/573087511' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T23:08:45.274 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-13T23:08:45.274 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-13T23:08:45.485 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:45.912 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:45 smithi002 ceph-mon[111294]: pgmap v296: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:46.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:45 smithi047 ceph-mon[81243]: pgmap v296: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:47.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.117+0000 7f66ac791700 1 -- 172.21.15.2:0/3066680462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a41027e0 msgr2=0x7f66a410acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:47.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.117+0000 7f66ac791700 1 --2- 172.21.15.2:0/3066680462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a41027e0 0x7f66a410acd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6694009940 tx=0x7f6694009c50 comp rx=0 tx=0).stop 2024-09-13T23:08:47.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.117+0000 7f66ac791700 1 -- 172.21.15.2:0/3066680462 shutdown_connections 2024-09-13T23:08:47.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.117+0000 7f66ac791700 1 --2- 172.21.15.2:0/3066680462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a41027e0 0x7f66a410acd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:47.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.117+0000 7f66ac791700 1 --2- 172.21.15.2:0/3066680462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66a4101ec0 0x7f66a41022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:47.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.117+0000 7f66ac791700 1 -- 172.21.15.2:0/3066680462 >> 172.21.15.2:0/3066680462 conn(0x7f66a40fb650 msgr2=0x7f66a40fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:47.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.117+0000 7f66ac791700 1 -- 172.21.15.2:0/3066680462 shutdown_connections 2024-09-13T23:08:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.117+0000 7f66ac791700 1 -- 172.21.15.2:0/3066680462 wait complete. 2024-09-13T23:08:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.118+0000 7f66ac791700 1 Processor -- start 2024-09-13T23:08:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.118+0000 7f66ac791700 1 -- start start 2024-09-13T23:08:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.118+0000 7f66ac791700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66a4101ec0 0x7f66a40ffb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.118+0000 7f66ac791700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a41027e0 0x7f66a4100060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.118+0000 7f66ac791700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a41005a0 con 0x7f66a41027e0 2024-09-13T23:08:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.118+0000 7f66ac791700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a41006e0 con 0x7f66a4101ec0 2024-09-13T23:08:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.118+0000 7f66a9d2c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a41027e0 0x7f66a4100060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.118+0000 7f66a9d2c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a41027e0 0x7f66a4100060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57572/0 (socket says 172.21.15.2:57572) 2024-09-13T23:08:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.118+0000 7f66a9d2c700 1 -- 172.21.15.2:0/3510160469 learned_addr learned my addr 172.21.15.2:0/3510160469 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.118+0000 7f66aa52d700 1 --2- 172.21.15.2:0/3510160469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66a4101ec0 0x7f66a40ffb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.119+0000 7f66a9d2c700 1 -- 172.21.15.2:0/3510160469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66a4101ec0 msgr2=0x7f66a40ffb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:47.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.119+0000 7f66a9d2c700 1 --2- 172.21.15.2:0/3510160469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66a4101ec0 0x7f66a40ffb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.119+0000 7f66a9d2c700 1 -- 172.21.15.2:0/3510160469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66940095f0 con 0x7f66a41027e0 2024-09-13T23:08:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.119+0000 7f66a9d2c700 1 --2- 172.21.15.2:0/3510160469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a41027e0 0x7f66a4100060 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f66940055f0 tx=0x7f6694005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.119+0000 7f669b7fe700 1 -- 172.21.15.2:0/3510160469 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f669401d070 con 0x7f66a41027e0 2024-09-13T23:08:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.119+0000 7f669b7fe700 1 -- 172.21.15.2:0/3510160469 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6694005920 con 0x7f66a41027e0 2024-09-13T23:08:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.119+0000 7f66ac791700 1 -- 172.21.15.2:0/3510160469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a4100960 con 0x7f66a41027e0 2024-09-13T23:08:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.119+0000 7f669b7fe700 1 -- 172.21.15.2:0/3510160469 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6694021410 con 0x7f66a41027e0 2024-09-13T23:08:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.119+0000 7f66ac791700 1 -- 172.21.15.2:0/3510160469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a41a2e90 con 0x7f66a41027e0 2024-09-13T23:08:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.120+0000 7f66ac791700 1 -- 172.21.15.2:0/3510160469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a4108360 con 0x7f66a41027e0 2024-09-13T23:08:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.121+0000 7f669b7fe700 1 -- 172.21.15.2:0/3510160469 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f669400f6f0 con 0x7f66a41027e0 2024-09-13T23:08:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.121+0000 7f669b7fe700 1 --2- 172.21.15.2:0/3510160469 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f669006e680 0x7f6690070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.121+0000 7f669b7fe700 1 -- 172.21.15.2:0/3510160469 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f669408f750 con 0x7f66a41027e0 2024-09-13T23:08:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.121+0000 7f66aa52d700 1 --2- 172.21.15.2:0/3510160469 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f669006e680 0x7f6690070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.122+0000 7f66aa52d700 1 --2- 172.21.15.2:0/3510160469 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f669006e680 0x7f6690070b40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f66a0009a10 tx=0x7f66a0009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:47.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.126+0000 7f669b7fe700 1 -- 172.21.15.2:0/3510160469 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f66940589a0 con 0x7f66a41027e0 2024-09-13T23:08:47.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.383+0000 7f66ac791700 1 -- 172.21.15.2:0/3510160469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f66a404f2e0 con 0x7f66a41027e0 2024-09-13T23:08:47.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.383+0000 7f669b7fe700 1 -- 172.21.15.2:0/3510160469 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v37) v1 ==== 107+0+5245 (secure 0 0 0) 0x7f669405c060 con 0x7f66a41027e0 2024-09-13T23:08:47.384 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:47.384 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":33,"btime":"2024-09-13T23:05:37:498553+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi002.gglyyr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/4224459092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4224459092},{"type":"v1","addr":"172.21.15.2:6829","nonce":4224459092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44295,"name":"cephfs.smithi047.gxzkha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6825/1060893681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1060893681},{"type":"v1","addr":"172.21.15.47:6825","nonce":1060893681}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44325,"name":"cephfs.smithi047.nqvveh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6827/2798869340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2798869340},{"type":"v1","addr":"172.21.15.47:6827","nonce":2798869340}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:05:37.498548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi002.auedll","rank":0,"incarnation":30,"state":"up:active","state_seq":18,"addr":"172.21.15.2:6827/3279333632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3279333632},{"type":"v1","addr":"172.21.15.2:6827","nonce":3279333632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34384,"qdb_cluster":[34384]},"id":1}]} 2024-09-13T23:08:47.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.385+0000 7f66ac791700 1 -- 172.21.15.2:0/3510160469 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f669006e680 msgr2=0x7f6690070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:47.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.385+0000 7f66ac791700 1 --2- 172.21.15.2:0/3510160469 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f669006e680 0x7f6690070b40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f66a0009a10 tx=0x7f66a0009190 comp rx=0 tx=0).stop 2024-09-13T23:08:47.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.385+0000 7f66ac791700 1 -- 172.21.15.2:0/3510160469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a41027e0 msgr2=0x7f66a4100060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:47.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.385+0000 7f66ac791700 1 --2- 172.21.15.2:0/3510160469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a41027e0 0x7f66a4100060 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f66940055f0 tx=0x7f6694005620 comp rx=0 tx=0).stop 2024-09-13T23:08:47.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.386+0000 7f66ac791700 1 -- 172.21.15.2:0/3510160469 shutdown_connections 2024-09-13T23:08:47.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.386+0000 7f66ac791700 1 --2- 172.21.15.2:0/3510160469 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f669006e680 0x7f6690070b40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:47.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.386+0000 7f66ac791700 1 --2- 172.21.15.2:0/3510160469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66a4101ec0 0x7f66a40ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:47.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.386+0000 7f66ac791700 1 --2- 172.21.15.2:0/3510160469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a41027e0 0x7f66a4100060 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:47.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.386+0000 7f66ac791700 1 -- 172.21.15.2:0/3510160469 >> 172.21.15.2:0/3510160469 conn(0x7f66a40fb650 msgr2=0x7f66a41054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:47.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.386+0000 7f66ac791700 1 -- 172.21.15.2:0/3510160469 shutdown_connections 2024-09-13T23:08:47.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:47.386+0000 7f66ac791700 1 -- 172.21.15.2:0/3510160469 wait complete. 2024-09-13T23:08:47.387 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 33 2024-09-13T23:08:47.971 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-13T23:08:47.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-13T23:08:48.095 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:47 smithi002 ceph-mon[111294]: pgmap v297: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:08:48.095 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:47 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/3510160469' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-13T23:08:48.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:47 smithi047 ceph-mon[81243]: pgmap v297: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:08:48.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:47 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/3510160469' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-13T23:08:48.185 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:49.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.797+0000 7f3e1fea5700 1 -- 172.21.15.2:0/2524862079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e180ffda0 msgr2=0x7f3e18100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:49.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.797+0000 7f3e1fea5700 1 --2- 172.21.15.2:0/2524862079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e180ffda0 0x7f3e18100180 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009910 tx=0x7f3e14009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:49.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.797+0000 7f3e1fea5700 1 -- 172.21.15.2:0/2524862079 shutdown_connections 2024-09-13T23:08:49.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.797+0000 7f3e1fea5700 1 --2- 172.21.15.2:0/2524862079 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e18100750 0x7f3e181047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:49.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.797+0000 7f3e1fea5700 1 --2- 172.21.15.2:0/2524862079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e180ffda0 0x7f3e18100180 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:49.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.797+0000 7f3e1fea5700 1 -- 172.21.15.2:0/2524862079 >> 172.21.15.2:0/2524862079 conn(0x7f3e180fb650 msgr2=0x7f3e180fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:49.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.797+0000 7f3e1fea5700 1 -- 172.21.15.2:0/2524862079 shutdown_connections 2024-09-13T23:08:49.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.797+0000 7f3e1fea5700 1 -- 172.21.15.2:0/2524862079 wait complete. 2024-09-13T23:08:49.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.798+0000 7f3e1fea5700 1 Processor -- start 2024-09-13T23:08:49.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.798+0000 7f3e1fea5700 1 -- start start 2024-09-13T23:08:49.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.798+0000 7f3e1fea5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e180ffda0 0x7f3e18101840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:49.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.798+0000 7f3e1fea5700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e18100750 0x7f3e18101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:49.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.798+0000 7f3e1fea5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e181022c0 con 0x7f3e180ffda0 2024-09-13T23:08:49.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.798+0000 7f3e1fea5700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e18102400 con 0x7f3e18100750 2024-09-13T23:08:49.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.798+0000 7f3e1dc41700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e180ffda0 0x7f3e18101840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:49.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.798+0000 7f3e1dc41700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e180ffda0 0x7f3e18101840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57588/0 (socket says 172.21.15.2:57588) 2024-09-13T23:08:49.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.798+0000 7f3e1dc41700 1 -- 172.21.15.2:0/787560868 learned_addr learned my addr 172.21.15.2:0/787560868 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:49.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.798+0000 7f3e1d440700 1 --2- 172.21.15.2:0/787560868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e18100750 0x7f3e18101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:49.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.798+0000 7f3e1dc41700 1 -- 172.21.15.2:0/787560868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e18100750 msgr2=0x7f3e18101d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:49.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.798+0000 7f3e1dc41700 1 --2- 172.21.15.2:0/787560868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e18100750 0x7f3e18101d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:49.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.798+0000 7f3e1dc41700 1 -- 172.21.15.2:0/787560868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e140095f0 con 0x7f3e180ffda0 2024-09-13T23:08:49.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.798+0000 7f3e1d440700 1 --2- 172.21.15.2:0/787560868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e18100750 0x7f3e18101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T23:08:49.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.799+0000 7f3e1dc41700 1 --2- 172.21.15.2:0/787560868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e180ffda0 0x7f3e18101840 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400b5c0 tx=0x7f3e1400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:49.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.799+0000 7f3e0effd700 1 -- 172.21.15.2:0/787560868 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e1401d070 con 0x7f3e180ffda0 2024-09-13T23:08:49.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.799+0000 7f3e1fea5700 1 -- 172.21.15.2:0/787560868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e18102680 con 0x7f3e180ffda0 2024-09-13T23:08:49.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.799+0000 7f3e0effd700 1 -- 172.21.15.2:0/787560868 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3e14005e00 con 0x7f3e180ffda0 2024-09-13T23:08:49.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.799+0000 7f3e0effd700 1 -- 172.21.15.2:0/787560868 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e14017400 con 0x7f3e180ffda0 2024-09-13T23:08:49.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.799+0000 7f3e1fea5700 1 -- 172.21.15.2:0/787560868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e181a2e10 con 0x7f3e180ffda0 2024-09-13T23:08:49.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.800+0000 7f3e1fea5700 1 -- 172.21.15.2:0/787560868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1804f2e0 con 0x7f3e180ffda0 2024-09-13T23:08:49.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.800+0000 7f3e0effd700 1 -- 172.21.15.2:0/787560868 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f3e1400f460 con 0x7f3e180ffda0 2024-09-13T23:08:49.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.801+0000 7f3e0effd700 1 --2- 172.21.15.2:0/787560868 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3e0406e680 0x7f3e04070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:49.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.801+0000 7f3e0effd700 1 -- 172.21.15.2:0/787560868 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f3e1408faa0 con 0x7f3e180ffda0 2024-09-13T23:08:49.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.801+0000 7f3e1d440700 1 --2- 172.21.15.2:0/787560868 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3e0406e680 0x7f3e04070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:49.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.802+0000 7f3e1d440700 1 --2- 172.21.15.2:0/787560868 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3e0406e680 0x7f3e04070b40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3e08005d90 tx=0x7f3e08005d00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:49.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:49.806+0000 7f3e0effd700 1 -- 172.21.15.2:0/787560868 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3e14058cc0 con 0x7f3e180ffda0 2024-09-13T23:08:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:50.067+0000 7f3e1fea5700 1 -- 172.21.15.2:0/787560868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f3e181a3140 con 0x7f3e180ffda0 2024-09-13T23:08:50.068 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:49 smithi002 ceph-mon[111294]: pgmap v298: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:50.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:50.067+0000 7f3e0effd700 1 -- 172.21.15.2:0/787560868 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v37) v1 ==== 107+0+5245 (secure 0 0 0) 0x7f3e1405c380 con 0x7f3e180ffda0 2024-09-13T23:08:50.069 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:50.069 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":34,"btime":"2024-09-13T23:05:42:487013+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi002.gglyyr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/4224459092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4224459092},{"type":"v1","addr":"172.21.15.2:6829","nonce":4224459092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44295,"name":"cephfs.smithi047.gxzkha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6825/1060893681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1060893681},{"type":"v1","addr":"172.21.15.47:6825","nonce":1060893681}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44325,"name":"cephfs.smithi047.nqvveh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6827/2798869340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2798869340},{"type":"v1","addr":"172.21.15.47:6827","nonce":2798869340}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:05:41.490150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi002.auedll","rank":0,"incarnation":30,"state":"up:active","state_seq":18,"addr":"172.21.15.2:6827/3279333632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3279333632},{"type":"v1","addr":"172.21.15.2:6827","nonce":3279333632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34384,"qdb_cluster":[34384]},"id":1}]} 2024-09-13T23:08:50.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:50.070+0000 7f3e1fea5700 1 -- 172.21.15.2:0/787560868 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3e0406e680 msgr2=0x7f3e04070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:50.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:50.070+0000 7f3e1fea5700 1 --2- 172.21.15.2:0/787560868 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3e0406e680 0x7f3e04070b40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3e08005d90 tx=0x7f3e08005d00 comp rx=0 tx=0).stop 2024-09-13T23:08:50.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:50.070+0000 7f3e1fea5700 1 -- 172.21.15.2:0/787560868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e180ffda0 msgr2=0x7f3e18101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:50.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:50.070+0000 7f3e1fea5700 1 --2- 172.21.15.2:0/787560868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e180ffda0 0x7f3e18101840 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400b5c0 tx=0x7f3e1400be20 comp rx=0 tx=0).stop 2024-09-13T23:08:50.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:50.070+0000 7f3e1fea5700 1 -- 172.21.15.2:0/787560868 shutdown_connections 2024-09-13T23:08:50.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:50.070+0000 7f3e1fea5700 1 --2- 172.21.15.2:0/787560868 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f3e0406e680 0x7f3e04070b40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:50.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:50.070+0000 7f3e1fea5700 1 --2- 172.21.15.2:0/787560868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e180ffda0 0x7f3e18101840 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:50.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:50.070+0000 7f3e1fea5700 1 --2- 172.21.15.2:0/787560868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e18100750 0x7f3e18101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:50.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:50.070+0000 7f3e1fea5700 1 -- 172.21.15.2:0/787560868 >> 172.21.15.2:0/787560868 conn(0x7f3e180fb650 msgr2=0x7f3e18103f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:50.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:50.070+0000 7f3e1fea5700 1 -- 172.21.15.2:0/787560868 shutdown_connections 2024-09-13T23:08:50.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:50.070+0000 7f3e1fea5700 1 -- 172.21.15.2:0/787560868 wait complete. 2024-09-13T23:08:50.072 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 34 2024-09-13T23:08:50.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:49 smithi047 ceph-mon[81243]: pgmap v298: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:50.754 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-13T23:08:50.755 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-13T23:08:50.971 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:50.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:50 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/787560868' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-13T23:08:51.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:50 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/787560868' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-13T23:08:51.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:51 smithi002 ceph-mon[111294]: pgmap v299: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:52.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:51 smithi047 ceph-mon[81243]: pgmap v299: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:52.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.614+0000 7f4afc883700 1 -- 172.21.15.2:0/3127081629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8100ea0 msgr2=0x7f4af8101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:52.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.614+0000 7f4afc883700 1 --2- 172.21.15.2:0/3127081629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8100ea0 0x7f4af8101280 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009910 tx=0x7f4ae0009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:52.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.614+0000 7f4afc883700 1 -- 172.21.15.2:0/3127081629 shutdown_connections 2024-09-13T23:08:52.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.614+0000 7f4afc883700 1 --2- 172.21.15.2:0/3127081629 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af8101850 0x7f4af81058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:52.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.614+0000 7f4afc883700 1 --2- 172.21.15.2:0/3127081629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8100ea0 0x7f4af8101280 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:52.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.614+0000 7f4afc883700 1 -- 172.21.15.2:0/3127081629 >> 172.21.15.2:0/3127081629 conn(0x7f4af80fc750 msgr2=0x7f4af80feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:52.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.614+0000 7f4afc883700 1 -- 172.21.15.2:0/3127081629 shutdown_connections 2024-09-13T23:08:52.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.614+0000 7f4afc883700 1 -- 172.21.15.2:0/3127081629 wait complete. 2024-09-13T23:08:52.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.615+0000 7f4afc883700 1 Processor -- start 2024-09-13T23:08:52.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.615+0000 7f4afc883700 1 -- start start 2024-09-13T23:08:52.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.615+0000 7f4afc883700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8100ea0 0x7f4af819c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:52.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.615+0000 7f4afc883700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af8101850 0x7f4af819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:52.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.615+0000 7f4afc883700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af819d2c0 con 0x7f4af8100ea0 2024-09-13T23:08:52.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.615+0000 7f4afc883700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af8196770 con 0x7f4af8101850 2024-09-13T23:08:52.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.615+0000 7f4af659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8100ea0 0x7f4af819c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:52.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.615+0000 7f4af659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8100ea0 0x7f4af819c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38346/0 (socket says 172.21.15.2:38346) 2024-09-13T23:08:52.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.615+0000 7f4af659c700 1 -- 172.21.15.2:0/1168012920 learned_addr learned my addr 172.21.15.2:0/1168012920 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:52.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.615+0000 7f4af5d9b700 1 --2- 172.21.15.2:0/1168012920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af8101850 0x7f4af819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:52.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.616+0000 7f4af659c700 1 -- 172.21.15.2:0/1168012920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af8101850 msgr2=0x7f4af819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:52.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.616+0000 7f4af659c700 1 --2- 172.21.15.2:0/1168012920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af8101850 0x7f4af819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:52.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.616+0000 7f4af659c700 1 -- 172.21.15.2:0/1168012920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae00095f0 con 0x7f4af8100ea0 2024-09-13T23:08:52.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.616+0000 7f4af659c700 1 --2- 172.21.15.2:0/1168012920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8100ea0 0x7f4af819c6f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00092e0 tx=0x7f4ae000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:52.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.616+0000 7f4aef7fe700 1 -- 172.21.15.2:0/1168012920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ae001d070 con 0x7f4af8100ea0 2024-09-13T23:08:52.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.616+0000 7f4afc883700 1 -- 172.21.15.2:0/1168012920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af81969f0 con 0x7f4af8100ea0 2024-09-13T23:08:52.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.616+0000 7f4aef7fe700 1 -- 172.21.15.2:0/1168012920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ae0005e00 con 0x7f4af8100ea0 2024-09-13T23:08:52.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.616+0000 7f4aef7fe700 1 -- 172.21.15.2:0/1168012920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ae0017400 con 0x7f4af8100ea0 2024-09-13T23:08:52.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.616+0000 7f4afc883700 1 -- 172.21.15.2:0/1168012920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af8196ee0 con 0x7f4af8100ea0 2024-09-13T23:08:52.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.617+0000 7f4afc883700 1 -- 172.21.15.2:0/1168012920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af8109240 con 0x7f4af8100ea0 2024-09-13T23:08:52.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.618+0000 7f4aef7fe700 1 -- 172.21.15.2:0/1168012920 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f4ae00176c0 con 0x7f4af8100ea0 2024-09-13T23:08:52.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.618+0000 7f4aef7fe700 1 --2- 172.21.15.2:0/1168012920 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4ae406e680 0x7f4ae4070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:52.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.618+0000 7f4aef7fe700 1 -- 172.21.15.2:0/1168012920 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f4ae008fb70 con 0x7f4af8100ea0 2024-09-13T23:08:52.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.618+0000 7f4af5d9b700 1 --2- 172.21.15.2:0/1168012920 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4ae406e680 0x7f4ae4070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:52.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.619+0000 7f4af5d9b700 1 --2- 172.21.15.2:0/1168012920 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4ae406e680 0x7f4ae4070b40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4af8197be0 tx=0x7f4ae800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.623+0000 7f4aef7fe700 1 -- 172.21.15.2:0/1168012920 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4ae005c7a0 con 0x7f4af8100ea0 2024-09-13T23:08:52.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.875+0000 7f4afc883700 1 -- 172.21.15.2:0/1168012920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f4af8197cd0 con 0x7f4af8100ea0 2024-09-13T23:08:52.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.875+0000 7f4aef7fe700 1 -- 172.21.15.2:0/1168012920 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v37) v1 ==== 107+0+5244 (secure 0 0 0) 0x7f4ae005c330 con 0x7f4af8100ea0 2024-09-13T23:08:52.876 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:52.876 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":35,"btime":"2024-09-13T23:05:43:488507+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi002.gglyyr","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/4224459092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4224459092},{"type":"v1","addr":"172.21.15.2:6829","nonce":4224459092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44295,"name":"cephfs.smithi047.gxzkha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6825/1060893681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1060893681},{"type":"v1","addr":"172.21.15.47:6825","nonce":1060893681}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44325,"name":"cephfs.smithi047.nqvveh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6827/2798869340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2798869340},{"type":"v1","addr":"172.21.15.47:6827","nonce":2798869340}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:05:42.492628+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi002.auedll","rank":0,"incarnation":30,"state":"up:active","state_seq":18,"addr":"172.21.15.2:6827/3279333632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3279333632},{"type":"v1","addr":"172.21.15.2:6827","nonce":3279333632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34384,"qdb_cluster":[34384]},"id":1}]} 2024-09-13T23:08:52.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.877+0000 7f4afc883700 1 -- 172.21.15.2:0/1168012920 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4ae406e680 msgr2=0x7f4ae4070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:52.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.877+0000 7f4afc883700 1 --2- 172.21.15.2:0/1168012920 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4ae406e680 0x7f4ae4070b40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4af8197be0 tx=0x7f4ae800b410 comp rx=0 tx=0).stop 2024-09-13T23:08:52.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.877+0000 7f4afc883700 1 -- 172.21.15.2:0/1168012920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8100ea0 msgr2=0x7f4af819c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:52.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.877+0000 7f4afc883700 1 --2- 172.21.15.2:0/1168012920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8100ea0 0x7f4af819c6f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00092e0 tx=0x7f4ae000bd70 comp rx=0 tx=0).stop 2024-09-13T23:08:52.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.877+0000 7f4afc883700 1 -- 172.21.15.2:0/1168012920 shutdown_connections 2024-09-13T23:08:52.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.877+0000 7f4afc883700 1 --2- 172.21.15.2:0/1168012920 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f4ae406e680 0x7f4ae4070b40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:52.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.877+0000 7f4afc883700 1 --2- 172.21.15.2:0/1168012920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af8100ea0 0x7f4af819c6f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:52.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.877+0000 7f4afc883700 1 --2- 172.21.15.2:0/1168012920 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4af8101850 0x7f4af819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:52.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.878+0000 7f4afc883700 1 -- 172.21.15.2:0/1168012920 >> 172.21.15.2:0/1168012920 conn(0x7f4af80fc750 msgr2=0x7f4af80fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:52.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.878+0000 7f4afc883700 1 -- 172.21.15.2:0/1168012920 shutdown_connections 2024-09-13T23:08:52.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:52.878+0000 7f4afc883700 1 -- 172.21.15.2:0/1168012920 wait complete. 2024-09-13T23:08:52.880 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 35 2024-09-13T23:08:53.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:52 smithi047 ceph-mon[81243]: pgmap v300: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:53.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:52 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:08:53.163 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:52 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/1168012920' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-13T23:08:53.200 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:52 smithi002 ceph-mon[111294]: pgmap v300: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:53.200 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:52 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:08:53.200 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:52 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/1168012920' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-13T23:08:53.526 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 36 2024-09-13T23:08:53.734 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:55.123 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:54 smithi002 ceph-mon[111294]: pgmap v301: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:55.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.360+0000 7f2d16acd700 1 -- 172.21.15.2:0/2371267273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d10105bd0 msgr2=0x7f2d10105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:55.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.360+0000 7f2d16acd700 1 --2- 172.21.15.2:0/2371267273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d10105bd0 0x7f2d10105fb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2d04009910 tx=0x7f2d04009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:55.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.360+0000 7f2d16acd700 1 -- 172.21.15.2:0/2371267273 shutdown_connections 2024-09-13T23:08:55.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.360+0000 7f2d16acd700 1 --2- 172.21.15.2:0/2371267273 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d100ffc20 0x7f2d10100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:55.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.360+0000 7f2d16acd700 1 --2- 172.21.15.2:0/2371267273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d10105bd0 0x7f2d10105fb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:55.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.360+0000 7f2d16acd700 1 -- 172.21.15.2:0/2371267273 >> 172.21.15.2:0/2371267273 conn(0x7f2d10075670 msgr2=0x7f2d10075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:55.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.360+0000 7f2d16acd700 1 -- 172.21.15.2:0/2371267273 shutdown_connections 2024-09-13T23:08:55.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.360+0000 7f2d16acd700 1 -- 172.21.15.2:0/2371267273 wait complete. 2024-09-13T23:08:55.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.361+0000 7f2d16acd700 1 Processor -- start 2024-09-13T23:08:55.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.361+0000 7f2d16acd700 1 -- start start 2024-09-13T23:08:55.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.362+0000 7f2d16acd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d100ffc20 0x7f2d1019c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:55.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.362+0000 7f2d16acd700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d10105bd0 0x7f2d1019cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:55.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.362+0000 7f2d16acd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1019d1f0 con 0x7f2d100ffc20 2024-09-13T23:08:55.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.362+0000 7f2d16acd700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d101966a0 con 0x7f2d10105bd0 2024-09-13T23:08:55.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.362+0000 7f2d14869700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d100ffc20 0x7f2d1019c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:55.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.362+0000 7f2d14869700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d100ffc20 0x7f2d1019c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38374/0 (socket says 172.21.15.2:38374) 2024-09-13T23:08:55.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.362+0000 7f2d14869700 1 -- 172.21.15.2:0/3776218898 learned_addr learned my addr 172.21.15.2:0/3776218898 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:55.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.362+0000 7f2d0ffff700 1 --2- 172.21.15.2:0/3776218898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d10105bd0 0x7f2d1019cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:55.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.362+0000 7f2d14869700 1 -- 172.21.15.2:0/3776218898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d10105bd0 msgr2=0x7f2d1019cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:55.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.362+0000 7f2d14869700 1 --2- 172.21.15.2:0/3776218898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d10105bd0 0x7f2d1019cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:55.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.362+0000 7f2d14869700 1 -- 172.21.15.2:0/3776218898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d040095f0 con 0x7f2d100ffc20 2024-09-13T23:08:55.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.362+0000 7f2d14869700 1 --2- 172.21.15.2:0/3776218898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d100ffc20 0x7f2d1019c620 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2d04006010 tx=0x7f2d0400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:55.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.363+0000 7f2d0dffb700 1 -- 172.21.15.2:0/3776218898 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d0401d070 con 0x7f2d100ffc20 2024-09-13T23:08:55.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.363+0000 7f2d0dffb700 1 -- 172.21.15.2:0/3776218898 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d04005dc0 con 0x7f2d100ffc20 2024-09-13T23:08:55.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.363+0000 7f2d0dffb700 1 -- 172.21.15.2:0/3776218898 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d04017400 con 0x7f2d100ffc20 2024-09-13T23:08:55.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.363+0000 7f2d16acd700 1 -- 172.21.15.2:0/3776218898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d10196920 con 0x7f2d100ffc20 2024-09-13T23:08:55.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.363+0000 7f2d16acd700 1 -- 172.21.15.2:0/3776218898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d10196e10 con 0x7f2d100ffc20 2024-09-13T23:08:55.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.364+0000 7f2d16acd700 1 -- 172.21.15.2:0/3776218898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1004f2e0 con 0x7f2d100ffc20 2024-09-13T23:08:55.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.364+0000 7f2d0dffb700 1 -- 172.21.15.2:0/3776218898 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f2d04003a60 con 0x7f2d100ffc20 2024-09-13T23:08:55.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.365+0000 7f2d0dffb700 1 --2- 172.21.15.2:0/3776218898 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2d0006e680 0x7f2d00070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:55.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.365+0000 7f2d0dffb700 1 -- 172.21.15.2:0/3776218898 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f2d0408fad0 con 0x7f2d100ffc20 2024-09-13T23:08:55.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.365+0000 7f2d0ffff700 1 --2- 172.21.15.2:0/3776218898 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2d0006e680 0x7f2d00070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:55.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.365+0000 7f2d0ffff700 1 --2- 172.21.15.2:0/3776218898 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2d0006e680 0x7f2d00070b40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2d100ffa40 tx=0x7f2cfc00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:55.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.369+0000 7f2d0dffb700 1 -- 172.21.15.2:0/3776218898 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2d0405c780 con 0x7f2d100ffc20 2024-09-13T23:08:55.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:54 smithi047 ceph-mon[81243]: pgmap v301: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:08:55.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.627+0000 7f2d16acd700 1 -- 172.21.15.2:0/3776218898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f2d101970b0 con 0x7f2d100ffc20 2024-09-13T23:08:55.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.628+0000 7f2d0dffb700 1 -- 172.21.15.2:0/3776218898 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v37) v1 ==== 107+0+5251 (secure 0 0 0) 0x7f2d0405c310 con 0x7f2d100ffc20 2024-09-13T23:08:55.629 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-13T23:08:55.629 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":36,"btime":"2024-09-13T23:05:43:492744+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44295,"name":"cephfs.smithi047.gxzkha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6825/1060893681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":1060893681},{"type":"v1","addr":"172.21.15.47:6825","nonce":1060893681}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44325,"name":"cephfs.smithi047.nqvveh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6827/2798869340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":2798869340},{"type":"v1","addr":"172.21.15.47:6827","nonce":2798869340}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T22:53:05.963265+0000","modified":"2024-09-13T23:05:43.492734+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34384":{"gid":34384,"name":"cephfs.smithi002.auedll","rank":0,"incarnation":30,"state":"up:active","state_seq":18,"addr":"172.21.15.2:6827/3279333632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3279333632},{"type":"v1","addr":"172.21.15.2:6827","nonce":3279333632}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34416":{"gid":34416,"name":"cephfs.smithi002.gglyyr","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6829/4224459092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":4224459092},{"type":"v1","addr":"172.21.15.2:6829","nonce":4224459092}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34384,"qdb_cluster":[34384]},"id":1}]} 2024-09-13T23:08:55.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.630+0000 7f2d16acd700 1 -- 172.21.15.2:0/3776218898 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2d0006e680 msgr2=0x7f2d00070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:55.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.630+0000 7f2d16acd700 1 --2- 172.21.15.2:0/3776218898 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2d0006e680 0x7f2d00070b40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2d100ffa40 tx=0x7f2cfc00b410 comp rx=0 tx=0).stop 2024-09-13T23:08:55.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.630+0000 7f2d16acd700 1 -- 172.21.15.2:0/3776218898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d100ffc20 msgr2=0x7f2d1019c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:55.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.630+0000 7f2d16acd700 1 --2- 172.21.15.2:0/3776218898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d100ffc20 0x7f2d1019c620 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2d04006010 tx=0x7f2d0400bd70 comp rx=0 tx=0).stop 2024-09-13T23:08:55.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.630+0000 7f2d16acd700 1 -- 172.21.15.2:0/3776218898 shutdown_connections 2024-09-13T23:08:55.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.630+0000 7f2d16acd700 1 --2- 172.21.15.2:0/3776218898 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f2d0006e680 0x7f2d00070b40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:55.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.630+0000 7f2d16acd700 1 --2- 172.21.15.2:0/3776218898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d100ffc20 0x7f2d1019c620 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:55.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.630+0000 7f2d16acd700 1 --2- 172.21.15.2:0/3776218898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d10105bd0 0x7f2d1019cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:55.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.630+0000 7f2d16acd700 1 -- 172.21.15.2:0/3776218898 >> 172.21.15.2:0/3776218898 conn(0x7f2d10075670 msgr2=0x7f2d10068660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:55.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.630+0000 7f2d16acd700 1 -- 172.21.15.2:0/3776218898 shutdown_connections 2024-09-13T23:08:55.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:55.630+0000 7f2d16acd700 1 -- 172.21.15.2:0/3776218898 wait complete. 2024-09-13T23:08:55.632 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 36 2024-09-13T23:08:56.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:55 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/3776218898' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-13T23:08:56.370 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-13T23:08:56.381 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-13T23:08:56.381 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-13T23:08:56.381 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T23:08:56.404 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-13T23:08:56.405 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T23:08:56.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:55 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/3776218898' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-13T23:08:56.463 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-13T23:08:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:08:57.180 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:56 smithi002 ceph-mon[111294]: pgmap v302: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:08:57.313 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:56 smithi047 ceph-mon[81243]: pgmap v302: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:08:58.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.352+0000 7fce8c47d700 1 -- 172.21.15.2:0/3322262069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce840ffc20 msgr2=0x7fce84100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:58.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.352+0000 7fce8c47d700 1 --2- 172.21.15.2:0/3322262069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce840ffc20 0x7fce84100080 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fce74009910 tx=0x7fce74009c20 comp rx=0 tx=0).stop 2024-09-13T23:08:58.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.352+0000 7fce8c47d700 1 -- 172.21.15.2:0/3322262069 shutdown_connections 2024-09-13T23:08:58.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.352+0000 7fce8c47d700 1 --2- 172.21.15.2:0/3322262069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce840ffc20 0x7fce84100080 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:58.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.352+0000 7fce8c47d700 1 --2- 172.21.15.2:0/3322262069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce84105bd0 0x7fce84105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:58.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.352+0000 7fce8c47d700 1 -- 172.21.15.2:0/3322262069 >> 172.21.15.2:0/3322262069 conn(0x7fce84075670 msgr2=0x7fce84075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:58.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.352+0000 7fce8c47d700 1 -- 172.21.15.2:0/3322262069 shutdown_connections 2024-09-13T23:08:58.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.352+0000 7fce8c47d700 1 -- 172.21.15.2:0/3322262069 wait complete. 2024-09-13T23:08:58.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.353+0000 7fce8c47d700 1 Processor -- start 2024-09-13T23:08:58.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.353+0000 7fce8c47d700 1 -- start start 2024-09-13T23:08:58.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.353+0000 7fce8c47d700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce840ffc20 0x7fce8419b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:58.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.353+0000 7fce8c47d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce84105bd0 0x7fce8419bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:58.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.353+0000 7fce8c47d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce84195620 con 0x7fce84105bd0 2024-09-13T23:08:58.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.353+0000 7fce8c47d700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce84195790 con 0x7fce840ffc20 2024-09-13T23:08:58.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.353+0000 7fce89a18700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce84105bd0 0x7fce8419bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:58.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.354+0000 7fce89a18700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce84105bd0 0x7fce8419bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38404/0 (socket says 172.21.15.2:38404) 2024-09-13T23:08:58.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.354+0000 7fce89a18700 1 -- 172.21.15.2:0/3587881069 learned_addr learned my addr 172.21.15.2:0/3587881069 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:08:58.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.354+0000 7fce8a219700 1 --2- 172.21.15.2:0/3587881069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce840ffc20 0x7fce8419b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:58.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.354+0000 7fce89a18700 1 -- 172.21.15.2:0/3587881069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce840ffc20 msgr2=0x7fce8419b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:58.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.354+0000 7fce89a18700 1 --2- 172.21.15.2:0/3587881069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce840ffc20 0x7fce8419b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:58.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.354+0000 7fce89a18700 1 -- 172.21.15.2:0/3587881069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce740095f0 con 0x7fce84105bd0 2024-09-13T23:08:58.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.354+0000 7fce89a18700 1 --2- 172.21.15.2:0/3587881069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce84105bd0 0x7fce8419bb70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fce740092e0 tx=0x7fce7400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:58.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.354+0000 7fce7b7fe700 1 -- 172.21.15.2:0/3587881069 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce7401d070 con 0x7fce84105bd0 2024-09-13T23:08:58.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.354+0000 7fce8c47d700 1 -- 172.21.15.2:0/3587881069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce84195a10 con 0x7fce84105bd0 2024-09-13T23:08:58.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.354+0000 7fce7b7fe700 1 -- 172.21.15.2:0/3587881069 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce74005e00 con 0x7fce84105bd0 2024-09-13T23:08:58.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.354+0000 7fce7b7fe700 1 -- 172.21.15.2:0/3587881069 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce74017400 con 0x7fce84105bd0 2024-09-13T23:08:58.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.354+0000 7fce8c47d700 1 -- 172.21.15.2:0/3587881069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce84195f00 con 0x7fce84105bd0 2024-09-13T23:08:58.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.356+0000 7fce8c47d700 1 -- 172.21.15.2:0/3587881069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce841080d0 con 0x7fce84105bd0 2024-09-13T23:08:58.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.356+0000 7fce7b7fe700 1 -- 172.21.15.2:0/3587881069 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fce7400f6f0 con 0x7fce84105bd0 2024-09-13T23:08:58.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.356+0000 7fce7b7fe700 1 --2- 172.21.15.2:0/3587881069 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fce7006e680 0x7fce70070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:08:58.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.357+0000 7fce7b7fe700 1 -- 172.21.15.2:0/3587881069 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fce7408fb50 con 0x7fce84105bd0 2024-09-13T23:08:58.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.357+0000 7fce8a219700 1 --2- 172.21.15.2:0/3587881069 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fce7006e680 0x7fce70070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:08:58.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.357+0000 7fce8a219700 1 --2- 172.21.15.2:0/3587881069 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fce7006e680 0x7fce70070b40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fce80005950 tx=0x7fce8000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:08:58.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.361+0000 7fce7b7fe700 1 -- 172.21.15.2:0/3587881069 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fce74058cf0 con 0x7fce84105bd0 2024-09-13T23:08:58.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.592+0000 7fce8c47d700 1 -- 172.21.15.2:0/3587881069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fce84196b80 con 0x7fce84105bd0 2024-09-13T23:08:58.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.592+0000 7fce7b7fe700 1 -- 172.21.15.2:0/3587881069 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v85) v1 ==== 81+0+2016 (secure 0 0 0) 0x7fce7405c3b0 con 0x7fce84105bd0 2024-09-13T23:08:58.593 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:6827/2007272492 2024-09-14T23:05:27.275056+0000 2024-09-13T23:08:58.593 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:6826/2007272492 2024-09-14T23:05:27.275056+0000 2024-09-13T23:08:58.594 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:6824/2157973647 2024-09-14T23:05:05.566696+0000 2024-09-13T23:08:58.594 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3701486491 2024-09-14T23:00:07.788113+0000 2024-09-13T23:08:58.594 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3738906507 2024-09-14T23:00:07.788113+0000 2024-09-13T23:08:58.594 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:0/3560231298 2024-09-14T22:56:50.135057+0000 2024-09-13T23:08:58.594 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/4160322064 2024-09-14T22:55:45.004693+0000 2024-09-13T23:08:58.594 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2072024940 2024-09-14T22:46:38.903914+0000 2024-09-13T23:08:58.594 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3109882737 2024-09-14T22:47:11.476346+0000 2024-09-13T23:08:58.594 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2669476310 2024-09-14T22:47:11.476346+0000 2024-09-13T23:08:58.594 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:0/3423652126 2024-09-14T22:56:50.135057+0000 2024-09-13T23:08:58.594 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2148833897 2024-09-14T22:55:45.004693+0000 2024-09-13T23:08:58.594 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/525112908 2024-09-14T22:55:45.004693+0000 2024-09-13T23:08:58.594 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1925931750 2024-09-14T22:48:17.145993+0000 2024-09-13T23:08:58.595 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/967175774 2024-09-14T23:00:07.788113+0000 2024-09-13T23:08:58.595 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2 2024-09-14T22:46:38.903914+0000 2024-09-13T23:08:58.595 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:0/3269266238 2024-09-14T22:56:50.135057+0000 2024-09-13T23:08:58.595 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/627756321 2024-09-14T23:00:07.788113+0000 2024-09-13T23:08:58.595 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1799605279 2024-09-14T22:48:17.145993+0000 2024-09-13T23:08:58.595 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2 2024-09-14T22:46:38.903914+0000 2024-09-13T23:08:58.595 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/921759862 2024-09-14T22:46:38.903914+0000 2024-09-13T23:08:58.595 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6827/2162770053 2024-09-14T22:53:22.057637+0000 2024-09-13T23:08:58.595 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:0/2782934931 2024-09-14T22:56:50.135057+0000 2024-09-13T23:08:58.595 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3872121752 2024-09-14T22:48:17.145993+0000 2024-09-13T23:08:58.595 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6826/2162770053 2024-09-14T22:53:22.057637+0000 2024-09-13T23:08:58.595 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:0/626795425 2024-09-14T22:56:50.135057+0000 2024-09-13T23:08:58.595 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:6825/2157973647 2024-09-14T23:05:05.566696+0000 2024-09-13T23:08:58.595 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3631424419 2024-09-14T22:55:45.004693+0000 2024-09-13T23:08:58.596 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/963250354 2024-09-14T22:46:38.903914+0000 2024-09-13T23:08:58.596 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/487476157 2024-09-14T22:47:11.476346+0000 2024-09-13T23:08:58.596 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:6828/1914885837 2024-09-14T22:56:50.135057+0000 2024-09-13T23:08:58.596 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:6829/1914885837 2024-09-14T22:56:50.135057+0000 2024-09-13T23:08:58.596 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:0/262758353 2024-09-14T22:56:50.135057+0000 2024-09-13T23:08:58.596 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/967175774 2024-09-14T23:00:07.788113+0000 2024-09-13T23:08:58.596 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1241824879 2024-09-14T23:00:07.788113+0000 2024-09-13T23:08:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.594+0000 7fce8c47d700 1 -- 172.21.15.2:0/3587881069 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fce7006e680 msgr2=0x7fce70070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.594+0000 7fce8c47d700 1 --2- 172.21.15.2:0/3587881069 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fce7006e680 0x7fce70070b40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fce80005950 tx=0x7fce8000b410 comp rx=0 tx=0).stop 2024-09-13T23:08:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.594+0000 7fce8c47d700 1 -- 172.21.15.2:0/3587881069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce84105bd0 msgr2=0x7fce8419bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:08:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.594+0000 7fce8c47d700 1 --2- 172.21.15.2:0/3587881069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce84105bd0 0x7fce8419bb70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fce740092e0 tx=0x7fce7400bd70 comp rx=0 tx=0).stop 2024-09-13T23:08:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.594+0000 7fce8c47d700 1 -- 172.21.15.2:0/3587881069 shutdown_connections 2024-09-13T23:08:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.594+0000 7fce8c47d700 1 --2- 172.21.15.2:0/3587881069 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7fce7006e680 0x7fce70070b40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.594+0000 7fce8c47d700 1 --2- 172.21.15.2:0/3587881069 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce840ffc20 0x7fce8419b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:58.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.594+0000 7fce8c47d700 1 --2- 172.21.15.2:0/3587881069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce84105bd0 0x7fce8419bb70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:08:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.594+0000 7fce8c47d700 1 -- 172.21.15.2:0/3587881069 >> 172.21.15.2:0/3587881069 conn(0x7fce84075670 msgr2=0x7fce840fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:08:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.595+0000 7fce8c47d700 1 -- 172.21.15.2:0/3587881069 shutdown_connections 2024-09-13T23:08:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:08:58.595+0000 7fce8c47d700 1 -- 172.21.15.2:0/3587881069 wait complete. 2024-09-13T23:08:58.598 INFO:teuthology.orchestra.run.smithi002.stderr:listed 35 entries 2024-09-13T23:08:59.241 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:58 smithi002 ceph-mon[111294]: pgmap v303: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:59.241 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:08:58 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/3587881069' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T23:08:59.263 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-13T23:08:59.263 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T23:08:59.282 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid e41042f8-7221-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-13T23:08:59.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:58 smithi047 ceph-mon[81243]: pgmap v303: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:08:59.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:08:58 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/3587881069' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T23:08:59.529 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-13T23:09:01.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:00 smithi002 ceph-mon[111294]: pgmap v304: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:01.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.231+0000 7f13645b4700 1 -- 172.21.15.2:0/757207612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f135c105bd0 msgr2=0x7f135c105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:01.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.231+0000 7f13645b4700 1 --2- 172.21.15.2:0/757207612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f135c105bd0 0x7f135c105fb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1358009910 tx=0x7f1358009c20 comp rx=0 tx=0).stop 2024-09-13T23:09:01.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.231+0000 7f13645b4700 1 -- 172.21.15.2:0/757207612 shutdown_connections 2024-09-13T23:09:01.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.231+0000 7f13645b4700 1 --2- 172.21.15.2:0/757207612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f135c0ffc20 0x7f135c100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:01.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.231+0000 7f13645b4700 1 --2- 172.21.15.2:0/757207612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f135c105bd0 0x7f135c105fb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:01.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.231+0000 7f13645b4700 1 -- 172.21.15.2:0/757207612 >> 172.21.15.2:0/757207612 conn(0x7f135c075670 msgr2=0x7f135c075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:01.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.231+0000 7f13645b4700 1 -- 172.21.15.2:0/757207612 shutdown_connections 2024-09-13T23:09:01.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.231+0000 7f13645b4700 1 -- 172.21.15.2:0/757207612 wait complete. 2024-09-13T23:09:01.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.232+0000 7f13645b4700 1 Processor -- start 2024-09-13T23:09:01.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.232+0000 7f13645b4700 1 -- start start 2024-09-13T23:09:01.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.232+0000 7f13645b4700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f135c0ffc20 0x7f135c101840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:01.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.232+0000 7f13645b4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f135c105bd0 0x7f135c101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:01.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.232+0000 7f13645b4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c1022c0 con 0x7f135c105bd0 2024-09-13T23:09:01.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.232+0000 7f13645b4700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c102400 con 0x7f135c0ffc20 2024-09-13T23:09:01.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.232+0000 7f1361b4f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f135c105bd0 0x7f135c101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:01.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.232+0000 7f1361b4f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f135c105bd0 0x7f135c101d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50514/0 (socket says 172.21.15.2:50514) 2024-09-13T23:09:01.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.232+0000 7f1361b4f700 1 -- 172.21.15.2:0/2362575132 learned_addr learned my addr 172.21.15.2:0/2362575132 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-13T23:09:01.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.232+0000 7f1362350700 1 --2- 172.21.15.2:0/2362575132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f135c0ffc20 0x7f135c101840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:01.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.233+0000 7f1361b4f700 1 -- 172.21.15.2:0/2362575132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f135c0ffc20 msgr2=0x7f135c101840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:01.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.233+0000 7f1361b4f700 1 --2- 172.21.15.2:0/2362575132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f135c0ffc20 0x7f135c101840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:01.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.233+0000 7f1361b4f700 1 -- 172.21.15.2:0/2362575132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13580095f0 con 0x7f135c105bd0 2024-09-13T23:09:01.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.233+0000 7f1361b4f700 1 --2- 172.21.15.2:0/2362575132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f135c105bd0 0x7f135c101d80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f134c00b4b0 tx=0x7f134c00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:01.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.233+0000 7f13537fe700 1 -- 172.21.15.2:0/2362575132 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f134c011800 con 0x7f135c105bd0 2024-09-13T23:09:01.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.233+0000 7f13645b4700 1 -- 172.21.15.2:0/2362575132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135c1a2b50 con 0x7f135c105bd0 2024-09-13T23:09:01.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.233+0000 7f13537fe700 1 -- 172.21.15.2:0/2362575132 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f134c011e20 con 0x7f135c105bd0 2024-09-13T23:09:01.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.233+0000 7f13537fe700 1 -- 172.21.15.2:0/2362575132 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f134c00f2e0 con 0x7f135c105bd0 2024-09-13T23:09:01.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.233+0000 7f13645b4700 1 -- 172.21.15.2:0/2362575132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135c1a2f60 con 0x7f135c105bd0 2024-09-13T23:09:01.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.234+0000 7f13645b4700 1 -- 172.21.15.2:0/2362575132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f135c04f2e0 con 0x7f135c105bd0 2024-09-13T23:09:01.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.235+0000 7f13537fe700 1 -- 172.21.15.2:0/2362575132 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f134c010380 con 0x7f135c105bd0 2024-09-13T23:09:01.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.235+0000 7f13537fe700 1 --2- 172.21.15.2:0/2362575132 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f134806e680 0x7f1348070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:09:01.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.235+0000 7f13537fe700 1 -- 172.21.15.2:0/2362575132 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f134c08e1b0 con 0x7f135c105bd0 2024-09-13T23:09:01.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.235+0000 7f1362350700 1 --2- 172.21.15.2:0/2362575132 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f134806e680 0x7f1348070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:09:01.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.236+0000 7f1362350700 1 --2- 172.21.15.2:0/2362575132 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f134806e680 0x7f1348070b40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1358006010 tx=0x7f135801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:09:01.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.240+0000 7f13537fe700 1 -- 172.21.15.2:0/2362575132 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f134c057350 con 0x7f135c105bd0 2024-09-13T23:09:01.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:00 smithi047 ceph-mon[81243]: pgmap v304: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:01.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.462+0000 7f13645b4700 1 -- 172.21.15.2:0/2362575132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f135c1a31b0 con 0x7f135c105bd0 2024-09-13T23:09:01.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.463+0000 7f13537fe700 1 -- 172.21.15.2:0/2362575132 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v85) v1 ==== 81+0+2016 (secure 0 0 0) 0x7f134c05aa10 con 0x7f135c105bd0 2024-09-13T23:09:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:6827/2007272492 2024-09-14T23:05:27.275056+0000 2024-09-13T23:09:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:6826/2007272492 2024-09-14T23:05:27.275056+0000 2024-09-13T23:09:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:6824/2157973647 2024-09-14T23:05:05.566696+0000 2024-09-13T23:09:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3701486491 2024-09-14T23:00:07.788113+0000 2024-09-13T23:09:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3738906507 2024-09-14T23:00:07.788113+0000 2024-09-13T23:09:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:0/3560231298 2024-09-14T22:56:50.135057+0000 2024-09-13T23:09:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/4160322064 2024-09-14T22:55:45.004693+0000 2024-09-13T23:09:01.465 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2072024940 2024-09-14T22:46:38.903914+0000 2024-09-13T23:09:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3109882737 2024-09-14T22:47:11.476346+0000 2024-09-13T23:09:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2669476310 2024-09-14T22:47:11.476346+0000 2024-09-13T23:09:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:0/3423652126 2024-09-14T22:56:50.135057+0000 2024-09-13T23:09:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2148833897 2024-09-14T22:55:45.004693+0000 2024-09-13T23:09:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/525112908 2024-09-14T22:55:45.004693+0000 2024-09-13T23:09:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1925931750 2024-09-14T22:48:17.145993+0000 2024-09-13T23:09:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/967175774 2024-09-14T23:00:07.788113+0000 2024-09-13T23:09:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2 2024-09-14T22:46:38.903914+0000 2024-09-13T23:09:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:0/3269266238 2024-09-14T22:56:50.135057+0000 2024-09-13T23:09:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/627756321 2024-09-14T23:00:07.788113+0000 2024-09-13T23:09:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1799605279 2024-09-14T22:48:17.145993+0000 2024-09-13T23:09:01.466 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2 2024-09-14T22:46:38.903914+0000 2024-09-13T23:09:01.467 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/921759862 2024-09-14T22:46:38.903914+0000 2024-09-13T23:09:01.467 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6827/2162770053 2024-09-14T22:53:22.057637+0000 2024-09-13T23:09:01.467 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:0/2782934931 2024-09-14T22:56:50.135057+0000 2024-09-13T23:09:01.467 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3872121752 2024-09-14T22:48:17.145993+0000 2024-09-13T23:09:01.467 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6826/2162770053 2024-09-14T22:53:22.057637+0000 2024-09-13T23:09:01.467 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:0/626795425 2024-09-14T22:56:50.135057+0000 2024-09-13T23:09:01.467 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:6825/2157973647 2024-09-14T23:05:05.566696+0000 2024-09-13T23:09:01.467 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3631424419 2024-09-14T22:55:45.004693+0000 2024-09-13T23:09:01.467 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/963250354 2024-09-14T22:46:38.903914+0000 2024-09-13T23:09:01.467 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/487476157 2024-09-14T22:47:11.476346+0000 2024-09-13T23:09:01.467 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:6828/1914885837 2024-09-14T22:56:50.135057+0000 2024-09-13T23:09:01.467 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:6829/1914885837 2024-09-14T22:56:50.135057+0000 2024-09-13T23:09:01.468 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.47:0/262758353 2024-09-14T22:56:50.135057+0000 2024-09-13T23:09:01.468 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/967175774 2024-09-14T23:00:07.788113+0000 2024-09-13T23:09:01.468 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1241824879 2024-09-14T23:00:07.788113+0000 2024-09-13T23:09:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.465+0000 7f13645b4700 1 -- 172.21.15.2:0/2362575132 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f134806e680 msgr2=0x7f1348070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.465+0000 7f13645b4700 1 --2- 172.21.15.2:0/2362575132 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f134806e680 0x7f1348070b40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1358006010 tx=0x7f135801a040 comp rx=0 tx=0).stop 2024-09-13T23:09:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.465+0000 7f13645b4700 1 -- 172.21.15.2:0/2362575132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f135c105bd0 msgr2=0x7f135c101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:09:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.465+0000 7f13645b4700 1 --2- 172.21.15.2:0/2362575132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f135c105bd0 0x7f135c101d80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f134c00b4b0 tx=0x7f134c00b7c0 comp rx=0 tx=0).stop 2024-09-13T23:09:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.465+0000 7f13645b4700 1 -- 172.21.15.2:0/2362575132 shutdown_connections 2024-09-13T23:09:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.465+0000 7f13645b4700 1 --2- 172.21.15.2:0/2362575132 >> [v2:172.21.15.2:6800/1532736539,v1:172.21.15.2:6801/1532736539] conn(0x7f134806e680 0x7f1348070b40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.465+0000 7f13645b4700 1 --2- 172.21.15.2:0/2362575132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f135c0ffc20 0x7f135c101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.465+0000 7f13645b4700 1 --2- 172.21.15.2:0/2362575132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f135c105bd0 0x7f135c101d80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:09:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.465+0000 7f13645b4700 1 -- 172.21.15.2:0/2362575132 >> 172.21.15.2:0/2362575132 conn(0x7f135c075670 msgr2=0x7f135c0686e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:09:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.465+0000 7f13645b4700 1 -- 172.21.15.2:0/2362575132 shutdown_connections 2024-09-13T23:09:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-13T23:09:01.465+0000 7f13645b4700 1 -- 172.21.15.2:0/2362575132 wait complete. 2024-09-13T23:09:01.469 INFO:teuthology.orchestra.run.smithi002.stderr:listed 35 entries 2024-09-13T23:09:02.098 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:01 smithi002 ceph-mon[111294]: from='client.? 172.21.15.2:0/2362575132' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T23:09:02.122 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2024-09-13T23:09:02.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T23:09:02.123 DEBUG:teuthology.orchestra.run.smithi002:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T23:09:02.153 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T23:09:02.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:01 smithi047 ceph-mon[81243]: from='client.? 172.21.15.2:0/2362575132' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T23:09:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:02 smithi002 ceph-mon[111294]: pgmap v305: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:03.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:02 smithi047 ceph-mon[81243]: pgmap v305: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:05.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:04 smithi002 ceph-mon[111294]: pgmap v306: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:05.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:04 smithi047 ceph-mon[81243]: pgmap v306: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:07.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:06 smithi002 ceph-mon[111294]: pgmap v307: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:09:07.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:07 smithi047 ceph-mon[81243]: pgmap v307: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:09:08.390 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:09:08.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:09:09.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:09 smithi047 ceph-mon[81243]: pgmap v308: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:09.447 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:09 smithi002 ceph-mon[111294]: pgmap v308: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:10.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:10 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:09:10.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:10 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:09:10.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:10 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:09:10.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:10 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:09:10.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:10 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:09:10.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:10 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:09:11.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:11 smithi047 ceph-mon[81243]: pgmap v309: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:11.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:11 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:11.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:11 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:09:11.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:11 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:09:11.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:11 smithi002 ceph-mon[111294]: pgmap v309: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:11.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:11 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:09:11.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:11 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:09:11.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:11 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:09:13.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:13 smithi047 ceph-mon[81243]: pgmap v310: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:13.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:13 smithi002 ceph-mon[111294]: pgmap v310: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:15.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:15 smithi047 ceph-mon[81243]: pgmap v311: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:15.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:15 smithi002 ceph-mon[111294]: pgmap v311: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:17.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:17 smithi047 ceph-mon[81243]: pgmap v312: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:09:17.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:17 smithi002 ceph-mon[111294]: pgmap v312: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:09:19.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:19 smithi047 ceph-mon[81243]: pgmap v313: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:19.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:19 smithi002 ceph-mon[111294]: pgmap v313: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:21.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:21 smithi047 ceph-mon[81243]: pgmap v314: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:21.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:21 smithi002 ceph-mon[111294]: pgmap v314: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:23.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:23 smithi047 ceph-mon[81243]: pgmap v315: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:23.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:23 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:09:23.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:23 smithi002 ceph-mon[111294]: pgmap v315: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:23.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:23 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:09:25.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:25 smithi047 ceph-mon[81243]: pgmap v316: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:25.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:25 smithi002 ceph-mon[111294]: pgmap v316: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:27.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:27 smithi047 ceph-mon[81243]: pgmap v317: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:09:27.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:27 smithi002 ceph-mon[111294]: pgmap v317: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:09:29.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:29 smithi002 ceph-mon[111294]: pgmap v318: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:29.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:29 smithi047 ceph-mon[81243]: pgmap v318: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:31.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:31 smithi047 ceph-mon[81243]: pgmap v319: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:31.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:31 smithi002 ceph-mon[111294]: pgmap v319: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:33.414 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:33 smithi047 ceph-mon[81243]: pgmap v320: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:33.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:33 smithi002 ceph-mon[111294]: pgmap v320: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:35.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:35 smithi047 ceph-mon[81243]: pgmap v321: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:35.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:35 smithi002 ceph-mon[111294]: pgmap v321: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:37.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:37 smithi047 ceph-mon[81243]: pgmap v322: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:09:37.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:37 smithi002 ceph-mon[111294]: pgmap v322: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:09:38.391 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:09:38.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:09:39.403 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:39 smithi002 ceph-mon[111294]: pgmap v323: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:39.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:39 smithi047 ceph-mon[81243]: pgmap v323: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:41.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:41 smithi047 ceph-mon[81243]: pgmap v324: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:41.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:41 smithi002 ceph-mon[111294]: pgmap v324: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:43.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:43 smithi047 ceph-mon[81243]: pgmap v325: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:43.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:43 smithi002 ceph-mon[111294]: pgmap v325: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:45.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:45 smithi047 ceph-mon[81243]: pgmap v326: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:45.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:45 smithi002 ceph-mon[111294]: pgmap v326: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:47.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:47 smithi047 ceph-mon[81243]: pgmap v327: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:09:47.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:47 smithi002 ceph-mon[111294]: pgmap v327: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:09:49.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:49 smithi047 ceph-mon[81243]: pgmap v328: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:49.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:49 smithi002 ceph-mon[111294]: pgmap v328: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:51.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:51 smithi047 ceph-mon[81243]: pgmap v329: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:51.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:51 smithi002 ceph-mon[111294]: pgmap v329: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:53.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:53 smithi047 ceph-mon[81243]: pgmap v330: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:53.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:09:53.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:53 smithi002 ceph-mon[111294]: pgmap v330: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:53.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:09:55.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:55 smithi047 ceph-mon[81243]: pgmap v331: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:55.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:55 smithi002 ceph-mon[111294]: pgmap v331: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:09:57.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:57 smithi047 ceph-mon[81243]: pgmap v332: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:09:57.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:57 smithi002 ceph-mon[111294]: pgmap v332: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:09:59.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:09:59 smithi047 ceph-mon[81243]: pgmap v333: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:09:59.456 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:09:59 smithi002 ceph-mon[111294]: pgmap v333: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:00.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:00 smithi047 ceph-mon[81243]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T23:10:00.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:00 smithi002 ceph-mon[111294]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-13T23:10:01.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:01 smithi047 ceph-mon[81243]: pgmap v334: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:01.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:01 smithi002 ceph-mon[111294]: pgmap v334: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:03.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:03 smithi047 ceph-mon[81243]: pgmap v335: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:03.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:03 smithi002 ceph-mon[111294]: pgmap v335: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:05.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:05 smithi047 ceph-mon[81243]: pgmap v336: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:05.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:05 smithi002 ceph-mon[111294]: pgmap v336: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:07.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:07 smithi047 ceph-mon[81243]: pgmap v337: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:10:07.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:07 smithi002 ceph-mon[111294]: pgmap v337: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:10:08.391 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:10:08.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:10:09.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:09 smithi047 ceph-mon[81243]: pgmap v338: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:09.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:09 smithi002 ceph-mon[111294]: pgmap v338: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:11.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:11 smithi047 ceph-mon[81243]: pgmap v339: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:11.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:11 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:10:11.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:11 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:10:11.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:11 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:10:11.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:11 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:10:11.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:11 smithi002 ceph-mon[111294]: pgmap v339: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:11.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:11 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:10:11.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:11 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:10:11.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:11 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:10:11.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:11 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:10:13.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:13 smithi047 ceph-mon[81243]: pgmap v340: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:13.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:13 smithi002 ceph-mon[111294]: pgmap v340: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:16.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:15 smithi047 ceph-mon[81243]: pgmap v341: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:16.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:15 smithi002 ceph-mon[111294]: pgmap v341: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:18.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:17 smithi047 ceph-mon[81243]: pgmap v342: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:10:18.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:17 smithi002 ceph-mon[111294]: pgmap v342: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:10:20.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:19 smithi047 ceph-mon[81243]: pgmap v343: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:20.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:19 smithi002 ceph-mon[111294]: pgmap v343: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:22.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:21 smithi047 ceph-mon[81243]: pgmap v344: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:22.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:21 smithi002 ceph-mon[111294]: pgmap v344: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:24.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:23 smithi047 ceph-mon[81243]: pgmap v345: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:24.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:23 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:10:24.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:23 smithi002 ceph-mon[111294]: pgmap v345: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:24.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:23 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:10:26.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:25 smithi047 ceph-mon[81243]: pgmap v346: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:26.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:25 smithi002 ceph-mon[111294]: pgmap v346: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:28.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:27 smithi047 ceph-mon[81243]: pgmap v347: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:10:28.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:27 smithi002 ceph-mon[111294]: pgmap v347: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:10:30.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:29 smithi047 ceph-mon[81243]: pgmap v348: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:30.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:29 smithi002 ceph-mon[111294]: pgmap v348: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:32.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:31 smithi047 ceph-mon[81243]: pgmap v349: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:32.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:31 smithi002 ceph-mon[111294]: pgmap v349: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:34.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:33 smithi047 ceph-mon[81243]: pgmap v350: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:34.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:33 smithi002 ceph-mon[111294]: pgmap v350: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:36.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:35 smithi047 ceph-mon[81243]: pgmap v351: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:36.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:35 smithi002 ceph-mon[111294]: pgmap v351: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:38.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:37 smithi047 ceph-mon[81243]: pgmap v352: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:10:38.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:37 smithi002 ceph-mon[111294]: pgmap v352: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:10:39.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:10:39.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:10:40.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:39 smithi047 ceph-mon[81243]: pgmap v353: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:40.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:39 smithi002 ceph-mon[111294]: pgmap v353: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:42.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:41 smithi047 ceph-mon[81243]: pgmap v354: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:42.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:41 smithi002 ceph-mon[111294]: pgmap v354: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:44.108 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:43 smithi047 ceph-mon[81243]: pgmap v355: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:44.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:43 smithi002 ceph-mon[111294]: pgmap v355: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:46.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:45 smithi047 ceph-mon[81243]: pgmap v356: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:46.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:45 smithi002 ceph-mon[111294]: pgmap v356: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:48.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:47 smithi047 ceph-mon[81243]: pgmap v357: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:10:48.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:47 smithi002 ceph-mon[111294]: pgmap v357: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:10:50.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:49 smithi047 ceph-mon[81243]: pgmap v358: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:50.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:49 smithi002 ceph-mon[111294]: pgmap v358: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:52.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:51 smithi047 ceph-mon[81243]: pgmap v359: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:52.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:51 smithi002 ceph-mon[111294]: pgmap v359: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:54.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:53 smithi047 ceph-mon[81243]: pgmap v360: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:54.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:10:54.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:53 smithi002 ceph-mon[111294]: pgmap v360: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:10:54.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:10:56.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:55 smithi047 ceph-mon[81243]: pgmap v361: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:56.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:55 smithi002 ceph-mon[111294]: pgmap v361: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:10:58.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:57 smithi047 ceph-mon[81243]: pgmap v362: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:10:58.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:57 smithi002 ceph-mon[111294]: pgmap v362: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:11:00.165 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:10:59 smithi047 ceph-mon[81243]: pgmap v363: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:00.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:10:59 smithi002 ceph-mon[111294]: pgmap v363: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:02.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:01 smithi047 ceph-mon[81243]: pgmap v364: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:02.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:01 smithi002 ceph-mon[111294]: pgmap v364: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:04.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:03 smithi047 ceph-mon[81243]: pgmap v365: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:04.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:03 smithi002 ceph-mon[111294]: pgmap v365: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:05.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:05 smithi002 ceph-mon[111294]: pgmap v366: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:06.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:05 smithi047 ceph-mon[81243]: pgmap v366: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:08.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:07 smithi047 ceph-mon[81243]: pgmap v367: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:11:08.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:07 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:11:08.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:07 smithi002 ceph-mon[111294]: pgmap v367: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:11:08.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:07 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:11:10.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:09 smithi047 ceph-mon[81243]: pgmap v368: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:10.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:09 smithi002 ceph-mon[111294]: pgmap v368: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:11.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:10 smithi002 ceph-mon[111294]: pgmap v369: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:11.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:10 smithi047 ceph-mon[81243]: pgmap v369: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:12.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:11 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:11:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:11 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:11:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:11 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:11:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:11 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:11:12.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:11 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:11:12.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:11 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:11:12.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:11 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:11:12.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:11 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:11:13.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:12 smithi002 ceph-mon[111294]: pgmap v370: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:13.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:12 smithi047 ceph-mon[81243]: pgmap v370: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:15.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:15 smithi047 ceph-mon[81243]: pgmap v371: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:15.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:15 smithi002 ceph-mon[111294]: pgmap v371: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:17.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:17 smithi047 ceph-mon[81243]: pgmap v372: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:11:17.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:17 smithi002 ceph-mon[111294]: pgmap v372: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:11:19.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:19 smithi047 ceph-mon[81243]: pgmap v373: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:19.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:19 smithi002 ceph-mon[111294]: pgmap v373: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:21.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:21 smithi047 ceph-mon[81243]: pgmap v374: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:21.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:21 smithi002 ceph-mon[111294]: pgmap v374: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:23.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:23 smithi047 ceph-mon[81243]: pgmap v375: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:23.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:23 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:11:23.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:23 smithi002 ceph-mon[111294]: pgmap v375: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:23.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:23 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:11:25.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:25 smithi047 ceph-mon[81243]: pgmap v376: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:25.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:25 smithi002 ceph-mon[111294]: pgmap v376: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:27.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:27 smithi047 ceph-mon[81243]: pgmap v377: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:11:27.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:27 smithi002 ceph-mon[111294]: pgmap v377: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:11:29.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:29 smithi047 ceph-mon[81243]: pgmap v378: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:29.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:29 smithi002 ceph-mon[111294]: pgmap v378: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:31.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:31 smithi047 ceph-mon[81243]: pgmap v379: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:31.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:31 smithi002 ceph-mon[111294]: pgmap v379: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:33.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:33 smithi047 ceph-mon[81243]: pgmap v380: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:33.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:33 smithi002 ceph-mon[111294]: pgmap v380: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:35.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:35 smithi047 ceph-mon[81243]: pgmap v381: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:35.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:35 smithi002 ceph-mon[111294]: pgmap v381: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:37.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:37 smithi047 ceph-mon[81243]: pgmap v382: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:11:37.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:37 smithi002 ceph-mon[111294]: pgmap v382: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:11:38.391 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:11:38.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:11:39.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:39 smithi047 ceph-mon[81243]: pgmap v383: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:39.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:39 smithi002 ceph-mon[111294]: pgmap v383: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:41.387 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:41 smithi002 ceph-mon[111294]: pgmap v384: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:41.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:41 smithi047 ceph-mon[81243]: pgmap v384: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:43.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:43 smithi047 ceph-mon[81243]: pgmap v385: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:43.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:43 smithi002 ceph-mon[111294]: pgmap v385: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:45.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:45 smithi047 ceph-mon[81243]: pgmap v386: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:45.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:45 smithi002 ceph-mon[111294]: pgmap v386: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:47.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:47 smithi047 ceph-mon[81243]: pgmap v387: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:11:47.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:47 smithi002 ceph-mon[111294]: pgmap v387: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:11:49.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:49 smithi047 ceph-mon[81243]: pgmap v388: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:49.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:49 smithi002 ceph-mon[111294]: pgmap v388: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:51.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:51 smithi047 ceph-mon[81243]: pgmap v389: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:51.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:51 smithi002 ceph-mon[111294]: pgmap v389: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:53.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:53 smithi047 ceph-mon[81243]: pgmap v390: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:53.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:11:53.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:53 smithi002 ceph-mon[111294]: pgmap v390: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:53.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:11:55.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:55 smithi047 ceph-mon[81243]: pgmap v391: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:55.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:55 smithi002 ceph-mon[111294]: pgmap v391: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:11:57.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:57 smithi047 ceph-mon[81243]: pgmap v392: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:11:57.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:57 smithi002 ceph-mon[111294]: pgmap v392: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:11:59.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:11:59 smithi047 ceph-mon[81243]: pgmap v393: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:11:59.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:11:59 smithi002 ceph-mon[111294]: pgmap v393: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:01.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:01 smithi047 ceph-mon[81243]: pgmap v394: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:01.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:01 smithi002 ceph-mon[111294]: pgmap v394: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:03.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:03 smithi047 ceph-mon[81243]: pgmap v395: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:03.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:03 smithi002 ceph-mon[111294]: pgmap v395: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:05.371 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:05 smithi047 ceph-mon[81243]: pgmap v396: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:05.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:05 smithi002 ceph-mon[111294]: pgmap v396: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:07.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:07 smithi002 ceph-mon[111294]: pgmap v397: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:12:07.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:07 smithi047 ceph-mon[81243]: pgmap v397: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:12:08.390 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:12:08.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:12:09.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:09 smithi047 ceph-mon[81243]: pgmap v398: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:09.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:09 smithi002 ceph-mon[111294]: pgmap v398: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:11.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:11 smithi047 ceph-mon[81243]: pgmap v399: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:11.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:11 smithi002 ceph-mon[111294]: pgmap v399: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:12:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:12:12.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:12:12.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:12:12.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:12:12.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:12:12.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:12:13.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:13 smithi047 ceph-mon[81243]: pgmap v400: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:13.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:13 smithi002 ceph-mon[111294]: pgmap v400: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:15.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:15 smithi047 ceph-mon[81243]: pgmap v401: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:15.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:15 smithi002 ceph-mon[111294]: pgmap v401: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:17.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:17 smithi047 ceph-mon[81243]: pgmap v402: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:12:17.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:17 smithi002 ceph-mon[111294]: pgmap v402: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:12:19.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:19 smithi047 ceph-mon[81243]: pgmap v403: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:19.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:19 smithi002 ceph-mon[111294]: pgmap v403: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:21.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:21 smithi047 ceph-mon[81243]: pgmap v404: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:21.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:21 smithi002 ceph-mon[111294]: pgmap v404: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:23.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:23 smithi047 ceph-mon[81243]: pgmap v405: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:23.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:23 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:12:23.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:23 smithi002 ceph-mon[111294]: pgmap v405: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:23.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:23 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:12:25.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:25 smithi047 ceph-mon[81243]: pgmap v406: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:25.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:25 smithi002 ceph-mon[111294]: pgmap v406: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:27.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:27 smithi047 ceph-mon[81243]: pgmap v407: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:12:27.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:27 smithi002 ceph-mon[111294]: pgmap v407: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:12:29.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:29 smithi047 ceph-mon[81243]: pgmap v408: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:29.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:29 smithi002 ceph-mon[111294]: pgmap v408: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:31.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:31 smithi047 ceph-mon[81243]: pgmap v409: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:31.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:31 smithi002 ceph-mon[111294]: pgmap v409: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:33.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:33 smithi047 ceph-mon[81243]: pgmap v410: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:33.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:33 smithi002 ceph-mon[111294]: pgmap v410: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:35.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:35 smithi047 ceph-mon[81243]: pgmap v411: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T23:12:35.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:35 smithi002 ceph-mon[111294]: pgmap v411: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T23:12:37.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:37 smithi047 ceph-mon[81243]: pgmap v412: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T23:12:37.445 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:37 smithi002 ceph-mon[111294]: pgmap v412: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T23:12:38.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:12:38.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:12:39.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:39 smithi047 ceph-mon[81243]: pgmap v413: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:12:39.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:39 smithi002 ceph-mon[111294]: pgmap v413: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-13T23:12:41.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:41 smithi047 ceph-mon[81243]: pgmap v414: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T23:12:41.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:41 smithi002 ceph-mon[111294]: pgmap v414: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-09-13T23:12:43.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:43 smithi002 ceph-mon[111294]: pgmap v415: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:43.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:43 smithi047 ceph-mon[81243]: pgmap v415: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:45.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:45 smithi002 ceph-mon[111294]: pgmap v416: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:45.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:45 smithi047 ceph-mon[81243]: pgmap v416: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:47.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:47 smithi002 ceph-mon[111294]: pgmap v417: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:12:47.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:47 smithi047 ceph-mon[81243]: pgmap v417: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:12:49.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:49 smithi002 ceph-mon[111294]: pgmap v418: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:49.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:49 smithi047 ceph-mon[81243]: pgmap v418: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:51.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:51 smithi047 ceph-mon[81243]: pgmap v419: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:51.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:51 smithi002 ceph-mon[111294]: pgmap v419: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:53.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:53 smithi002 ceph-mon[111294]: pgmap v420: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:53.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:53 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:12:53.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:53 smithi047 ceph-mon[81243]: pgmap v420: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:53.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:53 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:12:55.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:55 smithi002 ceph-mon[111294]: pgmap v421: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:55.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:55 smithi047 ceph-mon[81243]: pgmap v421: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:12:57.502 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:57 smithi002 ceph-mon[111294]: pgmap v422: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:12:57.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:57 smithi047 ceph-mon[81243]: pgmap v422: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:12:59.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:12:59 smithi002 ceph-mon[111294]: pgmap v423: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:12:59.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:12:59 smithi047 ceph-mon[81243]: pgmap v423: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:01.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:01 smithi002 ceph-mon[111294]: pgmap v424: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:01.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:01 smithi047 ceph-mon[81243]: pgmap v424: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:03.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:03 smithi002 ceph-mon[111294]: pgmap v425: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:03.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:03 smithi047 ceph-mon[81243]: pgmap v425: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:05.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:05 smithi002 ceph-mon[111294]: pgmap v426: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:05.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:05 smithi047 ceph-mon[81243]: pgmap v426: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:07.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:07 smithi002 ceph-mon[111294]: pgmap v427: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:13:07.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:07 smithi047 ceph-mon[81243]: pgmap v427: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:13:08.390 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:08 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:13:08.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:08 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:13:09.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:09 smithi002 ceph-mon[111294]: pgmap v428: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:09.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:09 smithi047 ceph-mon[81243]: pgmap v428: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:11.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:11 smithi002 ceph-mon[111294]: pgmap v429: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:11.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:11 smithi047 ceph-mon[81243]: pgmap v429: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:12.499 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:12 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:12.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:12 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T23:13:13.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:13 smithi002 ceph-mon[111294]: pgmap v430: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:13.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:13 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:13:13.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:13 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:13:13.500 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:13 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:13:13.662 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:13 smithi047 ceph-mon[81243]: pgmap v430: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:13.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:13 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T23:13:13.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:13 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T23:13:13.663 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:13 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' 2024-09-13T23:13:16.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:15 smithi047 ceph-mon[81243]: pgmap v431: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:16.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:15 smithi002 ceph-mon[111294]: pgmap v431: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:18.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:17 smithi047 ceph-mon[81243]: pgmap v432: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:13:18.213 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:17 smithi002 ceph-mon[111294]: pgmap v432: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:13:20.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:19 smithi047 ceph-mon[81243]: pgmap v433: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:20.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:19 smithi002 ceph-mon[111294]: pgmap v433: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:22.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:21 smithi047 ceph-mon[81243]: pgmap v434: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:22.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:21 smithi002 ceph-mon[111294]: pgmap v434: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:24.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:23 smithi047 ceph-mon[81243]: pgmap v435: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:24.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:23 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:13:24.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:23 smithi002 ceph-mon[111294]: pgmap v435: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:24.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:23 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:13:26.164 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:25 smithi047 ceph-mon[81243]: pgmap v436: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:26.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:25 smithi002 ceph-mon[111294]: pgmap v436: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:28.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:27 smithi047 ceph-mon[81243]: pgmap v437: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:13:28.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:27 smithi002 ceph-mon[111294]: pgmap v437: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:13:30.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:29 smithi047 ceph-mon[81243]: pgmap v438: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:30.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:29 smithi002 ceph-mon[111294]: pgmap v438: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:32.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:31 smithi047 ceph-mon[81243]: pgmap v439: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:32.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:31 smithi002 ceph-mon[111294]: pgmap v439: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:34.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:33 smithi047 ceph-mon[81243]: pgmap v440: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:34.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:33 smithi002 ceph-mon[111294]: pgmap v440: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:36.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:35 smithi047 ceph-mon[81243]: pgmap v441: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:36.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:35 smithi002 ceph-mon[111294]: pgmap v441: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:38.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:37 smithi047 ceph-mon[81243]: pgmap v442: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:13:38.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:37 smithi002 ceph-mon[111294]: pgmap v442: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:13:39.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:38 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:13:39.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:38 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:13:40.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:39 smithi047 ceph-mon[81243]: pgmap v443: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:40.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:39 smithi002 ceph-mon[111294]: pgmap v443: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:42.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:41 smithi047 ceph-mon[81243]: pgmap v444: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:42.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:41 smithi002 ceph-mon[111294]: pgmap v444: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:44.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:43 smithi002 ceph-mon[111294]: pgmap v445: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:44.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:43 smithi047 ceph-mon[81243]: pgmap v445: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:46.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:45 smithi047 ceph-mon[81243]: pgmap v446: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:46.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:45 smithi002 ceph-mon[111294]: pgmap v446: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:48.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:47 smithi047 ceph-mon[81243]: pgmap v447: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:13:48.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:47 smithi002 ceph-mon[111294]: pgmap v447: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:13:50.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:49 smithi047 ceph-mon[81243]: pgmap v448: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:50.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:49 smithi002 ceph-mon[111294]: pgmap v448: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:52.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:51 smithi047 ceph-mon[81243]: pgmap v449: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:52.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:51 smithi002 ceph-mon[111294]: pgmap v449: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:53.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:52 smithi047 ceph-mon[81243]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:13:53.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:52 smithi002 ceph-mon[111294]: from='mgr.34104 172.21.15.2:0/2750771648' entity='mgr.smithi002.yumtzz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T23:13:54.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:53 smithi047 ceph-mon[81243]: pgmap v450: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:54.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:53 smithi002 ceph-mon[111294]: pgmap v450: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:13:56.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:55 smithi047 ceph-mon[81243]: pgmap v451: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:56.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:55 smithi002 ceph-mon[111294]: pgmap v451: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-13T23:13:58.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:57 smithi047 ceph-mon[81243]: pgmap v452: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:13:58.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:57 smithi002 ceph-mon[111294]: pgmap v452: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-13T23:14:00.162 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:13:59 smithi047 ceph-mon[81243]: pgmap v453: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:14:00.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:13:59 smithi002 ceph-mon[111294]: pgmap v453: 65 pgs: 65 active+clean; 254 MiB data, 967 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T23:14:01.226 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-13T23:14:01.227 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-13T23:14:01.229 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-13T23:14:01.240 INFO:tasks.cephadm:Teardown begin 2024-09-13T23:14:01.240 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/cephadm.py", line 2236, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-13T23:14:01.242 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T23:14:01.278 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T23:14:01.311 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-13T23:14:01.311 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T23:14:01.337 DEBUG:teuthology.orchestra.run.smithi047:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T23:14:01.369 INFO:tasks.cephadm:Stopping all daemons... 2024-09-13T23:14:01.369 INFO:tasks.cephadm.mon.smithi002:Stopping mon.smithi002... 2024-09-13T23:14:01.370 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-e41042f8-7221-11ef-bceb-c7b262605968@mon.smithi002 2024-09-13T23:14:01.681 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:14:01 smithi002 systemd[1]: Stopping Ceph mon.smithi002 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:14:01.998 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:14:01 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002[111290]: 2024-09-13T23:14:01.680+0000 7fb0cb9d1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi002 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:14:01.998 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:14:01 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002[111290]: 2024-09-13T23:14:01.680+0000 7fb0cb9d1640 -1 mon.smithi002@0(leader) e3 *** Got Signal Terminated *** 2024-09-13T23:14:01.998 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:14:01 smithi002 podman[159479]: 2024-09-13 23:14:01.741851902 +0000 UTC m=+0.168251763 container died db0ef6c509cf7f9dadd69f2fd8123c47001fb40d3bed81b475f426dd5370da24 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:14:02.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:14:02 smithi002 podman[159479]: 2024-09-13 23:14:02.18050445 +0000 UTC m=+0.606904355 container cleanup db0ef6c509cf7f9dadd69f2fd8123c47001fb40d3bed81b475f426dd5370da24 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True) 2024-09-13T23:14:02.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:14:02 smithi002 bash[159479]: ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002 2024-09-13T23:14:02.614 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e41042f8-7221-11ef-bceb-c7b262605968@mon.smithi002.service' 2024-09-13T23:14:02.638 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:14:02 smithi002 podman[159490]: 2024-09-13 23:14:02.373973999 +0000 UTC m=+0.624203650 container remove db0ef6c509cf7f9dadd69f2fd8123c47001fb40d3bed81b475f426dd5370da24 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi002, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-13T23:14:02.638 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:14:02 smithi002 systemd[1]: ceph-e41042f8-7221-11ef-bceb-c7b262605968@mon.smithi002.service: Deactivated successfully. 2024-09-13T23:14:02.638 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:14:02 smithi002 systemd[1]: Stopped Ceph mon.smithi002 for e41042f8-7221-11ef-bceb-c7b262605968. 2024-09-13T23:14:02.638 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 13 23:14:02 smithi002 systemd[1]: ceph-e41042f8-7221-11ef-bceb-c7b262605968@mon.smithi002.service: Consumed 10.953s CPU time. 2024-09-13T23:14:02.672 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T23:14:02.673 INFO:tasks.cephadm.mon.smithi002:Stopped mon.smithi002 2024-09-13T23:14:02.673 INFO:tasks.cephadm.mon.smithi047:Stopping mon.smithi047... 2024-09-13T23:14:02.673 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-e41042f8-7221-11ef-bceb-c7b262605968@mon.smithi047 2024-09-13T23:14:02.992 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:14:02 smithi047 systemd[1]: Stopping Ceph mon.smithi047 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:14:03.412 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:14:02 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi047[81239]: 2024-09-13T23:14:02.990+0000 7f22d79bc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi047 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:14:03.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:14:02 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi047[81239]: 2024-09-13T23:14:02.990+0000 7f22d79bc640 -1 mon.smithi047@1(peon) e3 *** Got Signal Terminated *** 2024-09-13T23:14:03.413 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:14:03 smithi047 podman[118189]: 2024-09-13 23:14:03.155502635 +0000 UTC m=+0.271152765 container died ea0c2a2e0e1af966b91baa287bfa5a8e50c6525b48626dcdb5d6c71c98031ea4 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi047, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-13T23:14:03.860 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:14:03 smithi047 podman[118189]: 2024-09-13 23:14:03.591199544 +0000 UTC m=+0.706849664 container cleanup ea0c2a2e0e1af966b91baa287bfa5a8e50c6525b48626dcdb5d6c71c98031ea4 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi047, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T23:14:03.861 INFO:journalctl@ceph.mon.smithi047.smithi047.stdout:Sep 13 23:14:03 smithi047 bash[118189]: ceph-e41042f8-7221-11ef-bceb-c7b262605968-mon-smithi047 2024-09-13T23:14:04.031 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e41042f8-7221-11ef-bceb-c7b262605968@mon.smithi047.service' 2024-09-13T23:14:04.083 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T23:14:04.084 INFO:tasks.cephadm.mon.smithi047:Stopped mon.smithi047 2024-09-13T23:14:04.084 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-13T23:14:04.084 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.0 2024-09-13T23:14:04.393 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:14:04 smithi002 systemd[1]: Stopping Ceph osd.0 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:14:04.749 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:14:04 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0[122439]: 2024-09-13T23:14:04.392+0000 7fae67312640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:14:04.750 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:14:04 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0[122439]: 2024-09-13T23:14:04.392+0000 7fae67312640 -1 osd.0 85 *** Got signal Terminated *** 2024-09-13T23:14:04.750 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:14:04 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0[122439]: 2024-09-13T23:14:04.392+0000 7fae67312640 -1 osd.0 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:14:09.999 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:14:09 smithi002 podman[159615]: 2024-09-13 23:14:09.745022195 +0000 UTC m=+5.458108560 container died 0ca6dd66fa683b340037e21bacf8378d6379034c42cbf5cfe3cdf187a458d545 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-13T23:14:10.499 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:14:10 smithi002 podman[159615]: 2024-09-13 23:14:10.093416866 +0000 UTC m=+5.806503221 container cleanup 0ca6dd66fa683b340037e21bacf8378d6379034c42cbf5cfe3cdf187a458d545 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:14:10.500 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:14:10 smithi002 bash[159615]: ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0 2024-09-13T23:14:10.864 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:14:10 smithi002 podman[159643]: 2024-09-13 23:14:10.52822981 +0000 UTC m=+0.785543794 container remove 0ca6dd66fa683b340037e21bacf8378d6379034c42cbf5cfe3cdf187a458d545 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS) 2024-09-13T23:14:11.149 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:14:10 smithi002 podman[159736]: 2024-09-13 23:14:10.767513011 +0000 UTC m=+0.016641238 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:14:11.149 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:14:10 smithi002 podman[159736]: 2024-09-13 23:14:10.879073468 +0000 UTC m=+0.128201686 container create 303916be3a8bcbd33f672ab23d8dd9f4f595d7f074147f141d756a672ecb5617 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:14:11.149 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:14:11 smithi002 podman[159736]: 2024-09-13 23:14:11.148544163 +0000 UTC m=+0.397672382 container init 303916be3a8bcbd33f672ab23d8dd9f4f595d7f074147f141d756a672ecb5617 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ecab7be) 2024-09-13T23:14:11.500 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:14:11 smithi002 podman[159736]: 2024-09-13 23:14:11.152655314 +0000 UTC m=+0.401783542 container start 303916be3a8bcbd33f672ab23d8dd9f4f595d7f074147f141d756a672ecb5617 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:14:11.500 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:14:11 smithi002 podman[159736]: 2024-09-13 23:14:11.265465699 +0000 UTC m=+0.514593926 container attach 303916be3a8bcbd33f672ab23d8dd9f4f595d7f074147f141d756a672ecb5617 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-13T23:14:11.500 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 13 23:14:11 smithi002 podman[159736]: 2024-09-13 23:14:11.357442228 +0000 UTC m=+0.606570447 container died 303916be3a8bcbd33f672ab23d8dd9f4f595d7f074147f141d756a672ecb5617 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-13T23:14:11.988 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.0.service' 2024-09-13T23:14:12.031 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T23:14:12.031 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-13T23:14:12.031 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-13T23:14:12.032 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.1 2024-09-13T23:14:12.255 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:14:12 smithi002 systemd[1]: Stopping Ceph osd.1 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:14:12.749 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:14:12 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1[127983]: 2024-09-13T23:14:12.371+0000 7f06a20d2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:14:12.750 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:14:12 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1[127983]: 2024-09-13T23:14:12.371+0000 7f06a20d2640 -1 osd.1 85 *** Got signal Terminated *** 2024-09-13T23:14:12.750 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:14:12 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1[127983]: 2024-09-13T23:14:12.371+0000 7f06a20d2640 -1 osd.1 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:14:18.143 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:14:17 smithi002 podman[159839]: 2024-09-13 23:14:17.865597702 +0000 UTC m=+5.599572511 container died 6f5ae2cfa81895a3081b5e931fc894a2450905aad20bfc2211264cf7f2f9122c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T23:14:18.490 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:14:18 smithi002 podman[159839]: 2024-09-13 23:14:18.239198661 +0000 UTC m=+5.973173466 container cleanup 6f5ae2cfa81895a3081b5e931fc894a2450905aad20bfc2211264cf7f2f9122c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be) 2024-09-13T23:14:18.490 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:14:18 smithi002 bash[159839]: ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1 2024-09-13T23:14:18.749 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:14:18 smithi002 podman[159857]: 2024-09-13 23:14:18.490404156 +0000 UTC m=+0.622860199 container remove 6f5ae2cfa81895a3081b5e931fc894a2450905aad20bfc2211264cf7f2f9122c (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-13T23:14:19.094 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:14:18 smithi002 podman[159948]: 2024-09-13 23:14:18.717256647 +0000 UTC m=+0.016581726 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:14:19.094 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:14:18 smithi002 podman[159948]: 2024-09-13 23:14:18.876710434 +0000 UTC m=+0.176035505 container create bebf8ce1316121eb5f551af7a3596d49563d25fa71c42508f5637bb71455bbc2 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-13T23:14:19.094 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:14:19 smithi002 podman[159948]: 2024-09-13 23:14:19.093825718 +0000 UTC m=+0.393150788 container init bebf8ce1316121eb5f551af7a3596d49563d25fa71c42508f5637bb71455bbc2 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-13T23:14:19.349 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:14:19 smithi002 podman[159948]: 2024-09-13 23:14:19.097327586 +0000 UTC m=+0.396652658 container start bebf8ce1316121eb5f551af7a3596d49563d25fa71c42508f5637bb71455bbc2 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-ecab7be) 2024-09-13T23:14:19.350 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:14:19 smithi002 podman[159948]: 2024-09-13 23:14:19.168911944 +0000 UTC m=+0.468237017 container attach bebf8ce1316121eb5f551af7a3596d49563d25fa71c42508f5637bb71455bbc2 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:14:19.350 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 13 23:14:19 smithi002 podman[159948]: 2024-09-13 23:14:19.288142499 +0000 UTC m=+0.587467569 container died bebf8ce1316121eb5f551af7a3596d49563d25fa71c42508f5637bb71455bbc2 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-13T23:14:19.891 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.1.service' 2024-09-13T23:14:19.933 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T23:14:19.933 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-13T23:14:19.934 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-13T23:14:19.934 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.2 2024-09-13T23:14:20.249 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:14:20 smithi002 systemd[1]: Stopping Ceph osd.2 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:14:20.749 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:14:20 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2[133385]: 2024-09-13T23:14:20.292+0000 7fba0acca640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:14:20.750 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:14:20 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2[133385]: 2024-09-13T23:14:20.292+0000 7fba0acca640 -1 osd.2 85 *** Got signal Terminated *** 2024-09-13T23:14:20.750 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:14:20 smithi002 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2[133385]: 2024-09-13T23:14:20.292+0000 7fba0acca640 -1 osd.2 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:14:26.048 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:14:25 smithi002 podman[160049]: 2024-09-13 23:14:25.7616554 +0000 UTC m=+5.600038857 container died 15b9e8db7556a471864ab460fc1632e7f03f9bbcb948b9b420e7164ede3ab9ba (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-13T23:14:26.376 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:14:26 smithi002 podman[160049]: 2024-09-13 23:14:26.150367358 +0000 UTC m=+5.988750815 container cleanup 15b9e8db7556a471864ab460fc1632e7f03f9bbcb948b9b420e7164ede3ab9ba (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-13T23:14:26.376 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:14:26 smithi002 bash[160049]: ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2 2024-09-13T23:14:26.703 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:14:26 smithi002 podman[160065]: 2024-09-13 23:14:26.376495312 +0000 UTC m=+0.615274205 container remove 15b9e8db7556a471864ab460fc1632e7f03f9bbcb948b9b420e7164ede3ab9ba (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-13T23:14:26.980 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:14:26 smithi002 podman[160158]: 2024-09-13 23:14:26.606477449 +0000 UTC m=+0.016467421 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:14:26.980 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:14:26 smithi002 podman[160158]: 2024-09-13 23:14:26.718948758 +0000 UTC m=+0.128938721 container create efb9a400916a5d43527ace5fa22efe7dca64abe0ae110057b484cc7ba8b1f0a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-13T23:14:27.250 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:14:26 smithi002 podman[160158]: 2024-09-13 23:14:26.980438866 +0000 UTC m=+0.390428840 container init efb9a400916a5d43527ace5fa22efe7dca64abe0ae110057b484cc7ba8b1f0a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T23:14:27.250 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:14:26 smithi002 podman[160158]: 2024-09-13 23:14:26.984067757 +0000 UTC m=+0.394057728 container start efb9a400916a5d43527ace5fa22efe7dca64abe0ae110057b484cc7ba8b1f0a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T23:14:27.250 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:14:27 smithi002 podman[160158]: 2024-09-13 23:14:27.105057423 +0000 UTC m=+0.515047395 container attach efb9a400916a5d43527ace5fa22efe7dca64abe0ae110057b484cc7ba8b1f0a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-13T23:14:27.250 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 13 23:14:27 smithi002 podman[160158]: 2024-09-13 23:14:27.181221043 +0000 UTC m=+0.591211008 container died efb9a400916a5d43527ace5fa22efe7dca64abe0ae110057b484cc7ba8b1f0a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:14:27.747 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.2.service' 2024-09-13T23:14:27.788 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T23:14:27.788 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-13T23:14:27.789 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-13T23:14:27.789 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.3 2024-09-13T23:14:28.086 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:14:27 smithi047 systemd[1]: Stopping Ceph osd.3 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:14:28.355 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:14:28 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3[90755]: 2024-09-13T23:14:28.086+0000 7f2eb3ac7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:14:28.356 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:14:28 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3[90755]: 2024-09-13T23:14:28.086+0000 7f2eb3ac7640 -1 osd.3 85 *** Got signal Terminated *** 2024-09-13T23:14:28.356 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:14:28 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3[90755]: 2024-09-13T23:14:28.086+0000 7f2eb3ac7640 -1 osd.3 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:14:31.412 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:30 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:14:30.965+0000 7fc2bbd0c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:07.095794+0000 front 2024-09-13T23:14:07.095812+0000 (oldest deadline 2024-09-13T23:14:29.995664+0000) 2024-09-13T23:14:32.412 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:31 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:14:31.921+0000 7fc2bbd0c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:07.095794+0000 front 2024-09-13T23:14:07.095812+0000 (oldest deadline 2024-09-13T23:14:29.995664+0000) 2024-09-13T23:14:33.412 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:32 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:14:32.951+0000 7fc2bbd0c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:07.095794+0000 front 2024-09-13T23:14:07.095812+0000 (oldest deadline 2024-09-13T23:14:29.995664+0000) 2024-09-13T23:14:33.880 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:14:33 smithi047 podman[118311]: 2024-09-13 23:14:33.618259254 +0000 UTC m=+5.626931248 container died de54fd3fea34d3ccf8c793875efe227db06467a83afc8332c6ac04c2a6455850 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-ecab7be, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:14:34.162 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:33 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:14:33.964+0000 7fc2bbd0c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:07.095794+0000 front 2024-09-13T23:14:07.095812+0000 (oldest deadline 2024-09-13T23:14:29.995664+0000) 2024-09-13T23:14:34.162 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:14:33 smithi047 podman[118311]: 2024-09-13 23:14:33.970101659 +0000 UTC m=+5.978773643 container cleanup de54fd3fea34d3ccf8c793875efe227db06467a83afc8332c6ac04c2a6455850 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-ecab7be) 2024-09-13T23:14:34.163 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:14:33 smithi047 bash[118311]: ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3 2024-09-13T23:14:34.662 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:14:34 smithi047 podman[118338]: 2024-09-13 23:14:34.271212398 +0000 UTC m=+0.645144303 container remove de54fd3fea34d3ccf8c793875efe227db06467a83afc8332c6ac04c2a6455850 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-13T23:14:35.007 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:34 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:14:34.927+0000 7fc2bbd0c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:07.095794+0000 front 2024-09-13T23:14:07.095812+0000 (oldest deadline 2024-09-13T23:14:29.995664+0000) 2024-09-13T23:14:35.007 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:14:34 smithi047 podman[118429]: 2024-09-13 23:14:34.649692487 +0000 UTC m=+0.016405533 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:14:35.007 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:14:34 smithi047 podman[118429]: 2024-09-13 23:14:34.872152071 +0000 UTC m=+0.238865102 container create f37cda65cbc12550857afaa04dee22e085b6c2abe3b52e3fbf7c2d62490d0af1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, ceph=True) 2024-09-13T23:14:35.283 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:14:35 smithi047 podman[118429]: 2024-09-13 23:14:35.124673247 +0000 UTC m=+0.491386279 container init f37cda65cbc12550857afaa04dee22e085b6c2abe3b52e3fbf7c2d62490d0af1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, io.buildah.version=1.37.2) 2024-09-13T23:14:35.283 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:14:35 smithi047 podman[118429]: 2024-09-13 23:14:35.1281146 +0000 UTC m=+0.494827637 container start f37cda65cbc12550857afaa04dee22e085b6c2abe3b52e3fbf7c2d62490d0af1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2) 2024-09-13T23:14:35.283 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:14:35 smithi047 podman[118429]: 2024-09-13 23:14:35.224479384 +0000 UTC m=+0.591192416 container attach f37cda65cbc12550857afaa04dee22e085b6c2abe3b52e3fbf7c2d62490d0af1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-ecab7be, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-13T23:14:35.662 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:35 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:35.282+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:08.759750+0000 front 2024-09-13T23:14:08.759774+0000 (oldest deadline 2024-09-13T23:14:34.659510+0000) 2024-09-13T23:14:35.663 INFO:journalctl@ceph.osd.3.smithi047.stdout:Sep 13 23:14:35 smithi047 podman[118429]: 2024-09-13 23:14:35.323509147 +0000 UTC m=+0.690222189 container died f37cda65cbc12550857afaa04dee22e085b6c2abe3b52e3fbf7c2d62490d0af1 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:14:35.897 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.3.service' 2024-09-13T23:14:35.941 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T23:14:35.942 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-13T23:14:35.942 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-13T23:14:35.942 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.4 2024-09-13T23:14:36.163 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:35 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:14:35.949+0000 7fc2bbd0c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:07.095794+0000 front 2024-09-13T23:14:07.095812+0000 (oldest deadline 2024-09-13T23:14:29.995664+0000) 2024-09-13T23:14:36.163 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:36 smithi047 systemd[1]: Stopping Ceph osd.4 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:14:36.662 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:36 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:36.278+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:08.759750+0000 front 2024-09-13T23:14:08.759774+0000 (oldest deadline 2024-09-13T23:14:34.659510+0000) 2024-09-13T23:14:36.663 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:36 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:14:36.264+0000 7fc2bf707640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:14:36.663 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:36 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:14:36.264+0000 7fc2bf707640 -1 osd.4 85 *** Got signal Terminated *** 2024-09-13T23:14:36.663 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:36 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:14:36.264+0000 7fc2bf707640 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:14:37.279 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:36 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:14:36.914+0000 7fc2bbd0c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:07.095794+0000 front 2024-09-13T23:14:07.095812+0000 (oldest deadline 2024-09-13T23:14:29.995664+0000) 2024-09-13T23:14:37.662 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:37 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:37.279+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:08.759750+0000 front 2024-09-13T23:14:08.759774+0000 (oldest deadline 2024-09-13T23:14:34.659510+0000) 2024-09-13T23:14:38.162 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:37 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:14:37.926+0000 7fc2bbd0c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:07.095794+0000 front 2024-09-13T23:14:07.095812+0000 (oldest deadline 2024-09-13T23:14:29.995664+0000) 2024-09-13T23:14:38.662 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:38 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:38.320+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:08.759750+0000 front 2024-09-13T23:14:08.759774+0000 (oldest deadline 2024-09-13T23:14:34.659510+0000) 2024-09-13T23:14:39.310 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:38 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:14:38.925+0000 7fc2bbd0c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:07.095794+0000 front 2024-09-13T23:14:07.095812+0000 (oldest deadline 2024-09-13T23:14:29.995664+0000) 2024-09-13T23:14:39.310 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:38 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:14:38.925+0000 7fc2bbd0c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-13T23:14:14.696579+0000 front 2024-09-13T23:14:14.696537+0000 (oldest deadline 2024-09-13T23:14:38.796489+0000) 2024-09-13T23:14:39.662 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:39 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:39.309+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:08.759750+0000 front 2024-09-13T23:14:08.759774+0000 (oldest deadline 2024-09-13T23:14:34.659510+0000) 2024-09-13T23:14:40.295 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:39 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:14:39.958+0000 7fc2bbd0c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:07.095794+0000 front 2024-09-13T23:14:07.095812+0000 (oldest deadline 2024-09-13T23:14:29.995664+0000) 2024-09-13T23:14:40.296 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:39 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:14:39.958+0000 7fc2bbd0c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-13T23:14:14.696579+0000 front 2024-09-13T23:14:14.696537+0000 (oldest deadline 2024-09-13T23:14:38.796489+0000) 2024-09-13T23:14:40.662 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:40 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:40.295+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:08.759750+0000 front 2024-09-13T23:14:08.759774+0000 (oldest deadline 2024-09-13T23:14:34.659510+0000) 2024-09-13T23:14:41.317 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:40 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:14:40.960+0000 7fc2bbd0c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:07.095794+0000 front 2024-09-13T23:14:07.095812+0000 (oldest deadline 2024-09-13T23:14:29.995664+0000) 2024-09-13T23:14:41.318 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:40 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4[96113]: 2024-09-13T23:14:40.960+0000 7fc2bbd0c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-13T23:14:14.696579+0000 front 2024-09-13T23:14:14.696537+0000 (oldest deadline 2024-09-13T23:14:38.796489+0000) 2024-09-13T23:14:41.662 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:41 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:41.317+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:08.759750+0000 front 2024-09-13T23:14:08.759774+0000 (oldest deadline 2024-09-13T23:14:34.659510+0000) 2024-09-13T23:14:42.098 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:41 smithi047 podman[118532]: 2024-09-13 23:14:41.76854382 +0000 UTC m=+5.594621170 container died 185d7ae7181b12af67bd210c065a4e2782ead79db929d674014fe5b8705a7071 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-ecab7be, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T23:14:42.352 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:42 smithi047 podman[118532]: 2024-09-13 23:14:42.097969059 +0000 UTC m=+5.924046401 container cleanup 185d7ae7181b12af67bd210c065a4e2782ead79db929d674014fe5b8705a7071 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-09-13T23:14:42.352 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:42 smithi047 bash[118532]: ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4 2024-09-13T23:14:42.352 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:42 smithi047 podman[118548]: 2024-09-13 23:14:42.274181995 +0000 UTC m=+0.506028318 container remove 185d7ae7181b12af67bd210c065a4e2782ead79db929d674014fe5b8705a7071 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:14:42.662 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:42 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:42.351+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:08.759750+0000 front 2024-09-13T23:14:08.759774+0000 (oldest deadline 2024-09-13T23:14:34.659510+0000) 2024-09-13T23:14:42.663 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:42 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:42.351+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-13T23:14:16.261039+0000 front 2024-09-13T23:14:16.261101+0000 (oldest deadline 2024-09-13T23:14:42.160877+0000) 2024-09-13T23:14:42.986 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:42 smithi047 podman[118634]: 2024-09-13 23:14:42.631652825 +0000 UTC m=+0.016194207 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:14:42.986 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:42 smithi047 podman[118634]: 2024-09-13 23:14:42.750205537 +0000 UTC m=+0.134746910 container create a1f41ceac3917bd11f94e268558547cabd1088487bdb973162d4420aeeb6114a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-13T23:14:42.986 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:42 smithi047 podman[118634]: 2024-09-13 23:14:42.986113224 +0000 UTC m=+0.370654594 container init a1f41ceac3917bd11f94e268558547cabd1088487bdb973162d4420aeeb6114a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T23:14:43.352 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:42 smithi047 podman[118634]: 2024-09-13 23:14:42.989479046 +0000 UTC m=+0.374020427 container start a1f41ceac3917bd11f94e268558547cabd1088487bdb973162d4420aeeb6114a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be) 2024-09-13T23:14:43.353 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:43 smithi047 podman[118634]: 2024-09-13 23:14:43.069285025 +0000 UTC m=+0.453826395 container attach a1f41ceac3917bd11f94e268558547cabd1088487bdb973162d4420aeeb6114a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-ecab7be) 2024-09-13T23:14:43.353 INFO:journalctl@ceph.osd.4.smithi047.stdout:Sep 13 23:14:43 smithi047 podman[118634]: 2024-09-13 23:14:43.185041821 +0000 UTC m=+0.569583203 container died a1f41ceac3917bd11f94e268558547cabd1088487bdb973162d4420aeeb6114a (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-ecab7be, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-09-13T23:14:43.662 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:43 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:43.352+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:08.759750+0000 front 2024-09-13T23:14:08.759774+0000 (oldest deadline 2024-09-13T23:14:34.659510+0000) 2024-09-13T23:14:43.662 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:43 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:43.352+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-13T23:14:16.261039+0000 front 2024-09-13T23:14:16.261101+0000 (oldest deadline 2024-09-13T23:14:42.160877+0000) 2024-09-13T23:14:43.740 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.4.service' 2024-09-13T23:14:43.787 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T23:14:43.787 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-13T23:14:43.787 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-13T23:14:43.787 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.5 2024-09-13T23:14:44.084 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:43 smithi047 systemd[1]: Stopping Ceph osd.5 for e41042f8-7221-11ef-bceb-c7b262605968... 2024-09-13T23:14:44.413 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:44 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:44.083+0000 7f31e0dbc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T23:14:44.414 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:44 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:44.083+0000 7f31e0dbc640 -1 osd.5 85 *** Got signal Terminated *** 2024-09-13T23:14:44.414 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:44 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:44.083+0000 7f31e0dbc640 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T23:14:44.414 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:44 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:44.312+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:08.759750+0000 front 2024-09-13T23:14:08.759774+0000 (oldest deadline 2024-09-13T23:14:34.659510+0000) 2024-09-13T23:14:44.414 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:44 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:44.312+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-13T23:14:16.261039+0000 front 2024-09-13T23:14:16.261101+0000 (oldest deadline 2024-09-13T23:14:42.160877+0000) 2024-09-13T23:14:45.662 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:45 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:45.268+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:08.759750+0000 front 2024-09-13T23:14:08.759774+0000 (oldest deadline 2024-09-13T23:14:34.659510+0000) 2024-09-13T23:14:45.662 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:45 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:45.268+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-13T23:14:16.261039+0000 front 2024-09-13T23:14:16.261101+0000 (oldest deadline 2024-09-13T23:14:42.160877+0000) 2024-09-13T23:14:46.663 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:46 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:46.306+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:08.759750+0000 front 2024-09-13T23:14:08.759774+0000 (oldest deadline 2024-09-13T23:14:34.659510+0000) 2024-09-13T23:14:46.663 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:46 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:46.306+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-13T23:14:16.261039+0000 front 2024-09-13T23:14:16.261101+0000 (oldest deadline 2024-09-13T23:14:42.160877+0000) 2024-09-13T23:14:47.662 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:47 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:47.344+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:08.759750+0000 front 2024-09-13T23:14:08.759774+0000 (oldest deadline 2024-09-13T23:14:34.659510+0000) 2024-09-13T23:14:47.662 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:47 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:47.344+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-13T23:14:16.261039+0000 front 2024-09-13T23:14:16.261101+0000 (oldest deadline 2024-09-13T23:14:42.160877+0000) 2024-09-13T23:14:47.663 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:47 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:47.344+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6822 osd.2 since back 2024-09-13T23:14:24.461666+0000 front 2024-09-13T23:14:24.461649+0000 (oldest deadline 2024-09-13T23:14:46.761528+0000) 2024-09-13T23:14:48.663 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:48 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:48.383+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-13T23:14:08.759750+0000 front 2024-09-13T23:14:08.759774+0000 (oldest deadline 2024-09-13T23:14:34.659510+0000) 2024-09-13T23:14:48.663 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:48 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:48.383+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-13T23:14:16.261039+0000 front 2024-09-13T23:14:16.261101+0000 (oldest deadline 2024-09-13T23:14:42.160877+0000) 2024-09-13T23:14:48.663 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:48 smithi047 ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5[101026]: 2024-09-13T23:14:48.383+0000 7f31d93b9640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.2:6822 osd.2 since back 2024-09-13T23:14:24.461666+0000 front 2024-09-13T23:14:24.461649+0000 (oldest deadline 2024-09-13T23:14:46.761528+0000) 2024-09-13T23:14:49.876 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:49 smithi047 podman[118738]: 2024-09-13 23:14:49.506209355 +0000 UTC m=+5.520884735 container died aeb44a8238281b8232de7eda7ab8f8924db0d5ee021c940da7179127765593fa (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-13T23:14:50.162 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:49 smithi047 podman[118738]: 2024-09-13 23:14:49.95839249 +0000 UTC m=+5.973067869 container cleanup aeb44a8238281b8232de7eda7ab8f8924db0d5ee021c940da7179127765593fa (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-ecab7be, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T23:14:50.162 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:49 smithi047 bash[118738]: ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5 2024-09-13T23:14:50.589 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:50 smithi047 podman[118753]: 2024-09-13 23:14:50.251358167 +0000 UTC m=+0.737908600 container remove aeb44a8238281b8232de7eda7ab8f8924db0d5ee021c940da7179127765593fa (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T23:14:50.896 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:50 smithi047 podman[118842]: 2024-09-13 23:14:50.491957208 +0000 UTC m=+0.016678451 image pull 0652ff2b5d78add567c2474cd2436ae21ad32722283bcbf25450e33edcd34e34 quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808 2024-09-13T23:14:50.896 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:50 smithi047 podman[118842]: 2024-09-13 23:14:50.602094814 +0000 UTC m=+0.126816057 container create 39caaabe791f4a8ee5469dceb85a258e47fc87a4894f5a59f17373e4a28ebba0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-13T23:14:50.896 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:50 smithi047 podman[118842]: 2024-09-13 23:14:50.812811904 +0000 UTC m=+0.337533149 container init 39caaabe791f4a8ee5469dceb85a258e47fc87a4894f5a59f17373e4a28ebba0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-ecab7be, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-13T23:14:50.896 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:50 smithi047 podman[118842]: 2024-09-13 23:14:50.81626386 +0000 UTC m=+0.340985102 container start 39caaabe791f4a8ee5469dceb85a258e47fc87a4894f5a59f17373e4a28ebba0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-ecab7be, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-13T23:14:50.896 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:50 smithi047 podman[118842]: 2024-09-13 23:14:50.896032299 +0000 UTC m=+0.420753550 container attach 39caaabe791f4a8ee5469dceb85a258e47fc87a4894f5a59f17373e4a28ebba0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ecab7be, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T23:14:51.162 INFO:journalctl@ceph.osd.5.smithi047.stdout:Sep 13 23:14:51 smithi047 podman[118842]: 2024-09-13 23:14:51.026491612 +0000 UTC m=+0.551212857 container died 39caaabe791f4a8ee5469dceb85a258e47fc87a4894f5a59f17373e4a28ebba0 (image=quay.ceph.io/ceph-ci/ceph@sha256:b893710f6933dd3672a2a633ce5ac92081563259207d21cd52290129179ca808, name=ceph-e41042f8-7221-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-ecab7be, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-13T23:14:51.739 DEBUG:teuthology.orchestra.run.smithi047:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e41042f8-7221-11ef-bceb-c7b262605968@osd.5.service' 2024-09-13T23:14:51.785 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T23:14:51.785 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-13T23:14:51.785 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e41042f8-7221-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T23:14:51.948 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T23:14:56.292 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[75498]: fuse finished with error 0 and tester_r 0 2024-09-13T23:15:14.704 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e41042f8-7221-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T23:15:14.867 INFO:teuthology.orchestra.run.smithi047.stdout:Deleting cluster with fsid: e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T23:15:28.342 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T23:15:28.378 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T23:15:28.408 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-13T23:15:28.410 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904340/remote/smithi002/crash 2024-09-13T23:15:28.411 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/crash -- . 2024-09-13T23:15:28.449 INFO:teuthology.orchestra.run.smithi002.stderr:tar: /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T23:15:28.449 INFO:teuthology.orchestra.run.smithi002.stderr:tar: Error is not recoverable: exiting now 2024-09-13T23:15:28.451 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904340/remote/smithi047/crash 2024-09-13T23:15:28.452 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/crash -- . 2024-09-13T23:15:28.477 INFO:teuthology.orchestra.run.smithi047.stderr:tar: /var/lib/ceph/e41042f8-7221-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T23:15:28.477 INFO:teuthology.orchestra.run.smithi047.stderr:tar: Error is not recoverable: exiting now 2024-09-13T23:15:28.478 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-13T23:15:28.479 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T23:15:28.531 INFO:tasks.cephadm:Compressing logs... 2024-09-13T23:15:28.531 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T23:15:28.574 DEBUG:teuthology.orchestra.run.smithi047:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T23:15:28.601 INFO:teuthology.orchestra.run.smithi047.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose --: No such file or directory /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi047.gxzkha.log 2024-09-13T23:15:28.601 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-09-13T23:15:28.601 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi047.nqvveh.log 2024-09-13T23:15:28.601 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mon.smithi047.log 2024-09-13T23:15:28.601 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi047.gxzkha.log: /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi047.nqvveh.log: gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-13T23:15:28.601 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mon.smithi047.log: gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-13T23:15:28.601 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-13T23:15:28.607 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi047.log 2024-09-13T23:15:28.607 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-13T23:15:28.607 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi047.log: gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-13T23:15:28.607 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph.cephadm.log: 85.8% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-13T23:15:28.607 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph.log 2024-09-13T23:15:28.607 INFO:teuthology.orchestra.run.smithi047.stderr: 94.3%/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-osd.5.log: -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi047.log.gz 2024-09-13T23:15:28.607 INFO:teuthology.orchestra.run.smithi047.stderr: 91.6% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-13T23:15:28.611 INFO:teuthology.orchestra.run.smithi002.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T23:15:28.611 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-13T23:15:28.611 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi002.auedll.log 2024-09-13T23:15:28.611 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-13T23:15:28.612 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi002.auedll.log: gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-13T23:15:28.612 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mgr.smithi002.yumtzz.log 2024-09-13T23:15:28.612 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-13T23:15:28.612 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mgr.smithi002.yumtzz.log: gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi002.log 2024-09-13T23:15:28.612 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-13T23:15:28.612 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi002.log: gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-13T23:15:28.612 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph.cephadm.log: 85.9% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-13T23:15:28.612 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph.log 2024-09-13T23:15:28.612 INFO:teuthology.orchestra.run.smithi002.stderr: 94.2% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi002.log.gz 2024-09-13T23:15:28.612 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mon.smithi002.log 2024-09-13T23:15:28.612 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph.log: 91.5% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-13T23:15:28.612 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-13T23:15:28.613 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi002.gglyyr.log 2024-09-13T23:15:28.613 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mon.smithi002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-13T23:15:28.617 INFO:teuthology.orchestra.run.smithi047.stderr: 91.0% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-13T23:15:28.619 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-13T23:15:28.620 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mgr.smithi047.gcymvd.log 2024-09-13T23:15:28.620 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-13T23:15:28.621 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi002.gglyyr.log: 91.1% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-13T23:15:28.621 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-13T23:15:28.622 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mgr.smithi047.gcymvd.log: 88.6% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-13T23:15:28.623 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-13T23:15:28.638 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.1.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-13T23:15:28.675 INFO:teuthology.orchestra.run.smithi047.stderr: 89.3% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mgr.smithi047.gcymvd.log.gz 2024-09-13T23:15:28.702 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 90.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-13T23:15:29.041 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mgr.smithi002.yumtzz.log.gz 2024-09-13T23:15:29.078 INFO:teuthology.orchestra.run.smithi047.stderr: 92.6% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mon.smithi047.log.gz 2024-09-13T23:15:29.930 INFO:teuthology.orchestra.run.smithi002.stderr: 90.5% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mon.smithi002.log.gz 2024-09-13T23:15:32.921 INFO:teuthology.orchestra.run.smithi002.stderr: 93.7% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-13T23:15:33.898 INFO:teuthology.orchestra.run.smithi002.stderr: 93.8% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-13T23:15:33.908 INFO:teuthology.orchestra.run.smithi047.stderr: 93.8% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-13T23:15:34.877 INFO:teuthology.orchestra.run.smithi047.stderr: 93.8% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-13T23:15:35.177 INFO:teuthology.orchestra.run.smithi002.stderr: 93.8% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-13T23:15:35.187 INFO:teuthology.orchestra.run.smithi002.stderr: 94.7% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi002.auedll.log.gz 2024-09-13T23:15:35.302 INFO:teuthology.orchestra.run.smithi047.stderr: 93.8% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-13T23:15:36.588 INFO:teuthology.orchestra.run.smithi047.stderr: 94.8% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi047.nqvveh.log.gz 2024-09-13T23:15:43.912 INFO:teuthology.orchestra.run.smithi002.stderr: 94.8% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi002.gglyyr.log.gz 2024-09-13T23:15:44.863 INFO:teuthology.orchestra.run.smithi002.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-13T23:15:44.865 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-13T23:15:44.865 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m16.277s 2024-09-13T23:15:44.865 INFO:teuthology.orchestra.run.smithi002.stderr:user 0m54.377s 2024-09-13T23:15:44.865 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m1.656s 2024-09-13T23:15:45.361 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-13T23:15:45.361 INFO:teuthology.orchestra.run.smithi047.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-13T23:16:59.732 INFO:teuthology.orchestra.run.smithi047.stderr: 92.6% -- replaced with /var/log/ceph/e41042f8-7221-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi047.gxzkha.log.gz 2024-09-13T23:16:59.733 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-09-13T23:16:59.734 INFO:teuthology.orchestra.run.smithi047.stderr:real 1m31.144s 2024-09-13T23:16:59.734 INFO:teuthology.orchestra.run.smithi047.stderr:user 2m10.738s 2024-09-13T23:16:59.734 INFO:teuthology.orchestra.run.smithi047.stderr:sys 0m3.696s 2024-09-13T23:16:59.734 INFO:tasks.cephadm:Archiving logs... 2024-09-13T23:16:59.734 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904340/remote/smithi002/log 2024-09-13T23:16:59.736 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T23:17:06.248 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904340/remote/smithi047/log 2024-09-13T23:17:06.251 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T23:17:24.466 INFO:tasks.cephadm:Removing cluster... 2024-09-13T23:17:24.467 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e41042f8-7221-11ef-bceb-c7b262605968 --force 2024-09-13T23:17:24.627 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T23:17:24.940 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e41042f8-7221-11ef-bceb-c7b262605968 --force 2024-09-13T23:17:25.100 INFO:teuthology.orchestra.run.smithi047.stdout:Deleting cluster with fsid: e41042f8-7221-11ef-bceb-c7b262605968 2024-09-13T23:17:25.496 INFO:tasks.cephadm:Removing cephadm ... 2024-09-13T23:17:25.496 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T23:17:25.513 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T23:17:25.529 INFO:tasks.cephadm:Teardown complete 2024-09-13T23:17:25.530 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T23:17:25.543 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-13T23:17:25.543 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T23:17:25.544 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T23:17:25.556 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T23:17:25.661 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T23:17:25.672 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T23:17:25.672 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T23:17:25.675 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T23:17:25.687 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-13T23:17:25.689 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-09-13T23:17:25.693 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T23:17:25.693 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-13T23:17:25.693 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 +887ns[ +15us] +/- 38ms 2024-09-13T23:17:25.693 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 33 -56us[ -56us] +/- 63ms 2024-09-13T23:17:25.693 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 +91us[ +91us] +/- 69ms 2024-09-13T23:17:25.693 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:17:25.695 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T23:17:25.695 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-09-13T23:17:25.695 INFO:teuthology.orchestra.run.smithi047.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 -6466ns[-6313ns] +/- 38ms 2024-09-13T23:17:25.695 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 -77us[ -77us] +/- 63ms 2024-09-13T23:17:25.695 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 +83us[ +83us] +/- 69ms 2024-09-13T23:17:25.695 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:17:25.696 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T23:17:25.706 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T23:17:25.707 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T23:17:25.717 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T23:17:25.822 DEBUG:teuthology.orchestra.run.smithi047:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T23:17:25.900 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T23:17:25.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:17:25.930 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T23:17:25.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:17:25.960 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T23:17:25.972 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T23:17:25.982 INFO:teuthology.task.internal:Duration was 2280.932144 seconds 2024-09-13T23:17:25.982 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T23:17:25.992 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T23:17:25.993 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T23:17:25.996 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T23:17:26.033 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T23:17:26.040 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T23:17:26.288 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T23:17:26.288 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2024-09-13T23:17:26.289 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T23:17:26.350 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-09-13T23:17:26.351 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T23:17:26.379 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T23:17:26.379 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T23:17:26.393 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T23:17:26.446 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T23:17:26.447 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T23:17:26.462 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T23:17:27.168 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T23:17:27.182 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T23:17:27.182 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T23:17:27.208 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T23:17:27.236 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T23:17:27.247 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T23:17:27.251 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T23:17:27.273 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2024-09-13T23:17:27.302 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-09-13T23:17:27.346 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T23:17:27.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:17:27.361 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T23:17:27.401 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:17:27.402 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T23:17:27.414 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T23:17:27.414 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904340/remote/smithi002 2024-09-13T23:17:27.415 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T23:17:27.465 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_21:08:03-orch-squid-distro-default-smithi/7904340/remote/smithi047 2024-09-13T23:17:27.466 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T23:17:27.507 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T23:17:27.507 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T23:17:27.510 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T23:17:27.557 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T23:17:27.569 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T23:17:27.569 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T23:17:27.579 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T23:17:27.579 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T23:17:27.582 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T23:17:27.594 INFO:teuthology.orchestra.run.smithi002.stdout: 262169 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 13 23:17 /home/ubuntu/cephtest 2024-09-13T23:17:27.595 INFO:teuthology.orchestra.run.smithi002.stdout: 528365 4 d--------- 2 ubuntu ubuntu 4096 Sep 13 22:53 /home/ubuntu/cephtest/mnt.0 2024-09-13T23:17:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-13T23:17:27.596 INFO:teuthology.orchestra.run.smithi002.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-13T23:17:27.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:17:27.600 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-13T23:17:27.600 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T23:17:27.612 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T23:17:27.622 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-13T23:17:27.625 INFO:teuthology.run:Summary data: description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2280.932144165039 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-09-13T23:17:27.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T23:17:27.733 INFO:teuthology.run:FAIL